[2025-10-27T17:00:01.109003] [INFO ] [MAIN ] Using last completed trading day: 2025-10-27 [2025-10-27T17:00:01.286026] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-27T17:00:01.286179] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-27T17:00:01.357235] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-27T17:00:01.357787] [WARN ] [STATE ] State set to: RUNNING [2025-10-27T17:00:01.357856] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-27T17:00:01.357891] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-27T17:00:01.357969] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-27T17:00:01.358002] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-27T17:00:02.910462] [DEBUG] [SYMBOL ] Found 2418 valid NYSE symbols. [2025-10-27T17:00:02.910633] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-27T17:00:02.910910] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-27T17:00:02.912055] [INFO ] [LOCAL ] Symbols cache updated with 2366 symbols. [2025-10-27T17:00:02.912223] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-27T17:00:02.912260] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-27T17:00:02.912328] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-27T17:00:02.912366] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-27T17:00:02.912400] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-27T17:00:02.912814] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-10-27T17:00:02.912868] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-27T17:00:02.913051] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-27T17:00:02.913091] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2366 valid symbols. [2025-10-27T17:00:02.913125] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-27T17:00:02.913157] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-27T17:00:02.941007] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-27T17:00:02.968311] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-27T17:00:02.968442] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-27T17:00:02.968481] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-27T17:00:02.968510] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-27T17:00:02.968572] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-27T17:00:02.968985] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-10-27T17:00:02.969040] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-27T17:00:02.969074] [INFO ] [MAIN ] Starting incremental update for 2366 symbols. [2025-10-27T17:00:02.969102] [INFO ] [MAIN ] Running in parallel mode [2025-10-27T17:00:02.969322] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2366 symbols [2025-10-27T17:00:03.705877] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:03.813189] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:03.814952] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-27T17:00:03.816773] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:03.818512] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-27T17:00:03.844413] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:03.847316] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-27T17:00:03.847945] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-27T17:00:03.848079] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-27T17:00:03.848205] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-27T17:00:04.034544] [DEBUG] [LOCAL ] AAMI: Loaded 24637 existing records from primary storage. [2025-10-27T17:00:04.082973] [INFO ] [MAIN ] AAMI: Loaded 24637 existing records. [2025-10-27T17:00:04.343218] [DEBUG] [LOCAL ] A: Loaded 51315 existing records from primary storage. [2025-10-27T17:00:04.424154] [INFO ] [MAIN ] A: Loaded 51315 existing records. [2025-10-27T17:00:04.431085] [DEBUG] [LOCAL ] AA: Loaded 54402 existing records from primary storage. [2025-10-27T17:00:04.527350] [INFO ] [MAIN ] AA: Loaded 54402 existing records. [2025-10-27T17:00:04.762241] [WARN ] [MAIN ] AAMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:04.888461] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-27T17:00:04.897638] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:04.910029] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-27T17:00:04.933058] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-27T17:00:04.938378] [DEBUG] [LOCAL ] AAMI: Deleted primary data file. [2025-10-27T17:00:04.985529] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-27T17:00:05.116301] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:05.164724] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:05.196955] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-27T17:00:05.197393] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-27T17:00:05.197709] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-27T17:00:05.197804] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-27T17:00:05.215058] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-27T17:00:05.227949] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-27T17:00:05.238984] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-27T17:00:05.244243] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-27T17:00:05.989450] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:06.014810] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-10-27T17:00:06.002612] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-27T17:00:06.067751] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-27T17:00:06.242160] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:06.253269] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-27T17:00:06.321504] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:06.321849] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-27T17:00:06.475063] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-27T17:00:06.476533] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-27T17:00:06.842309] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-27T17:00:06.846357] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-10-27T17:00:06.849994] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-27T17:00:06.851054] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-27T17:00:07.192029] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-27T17:00:07.193218] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-27T17:00:07.539311] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-27T17:00:07.540231] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-27T17:00:07.886399] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T17:00:07.896390] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-27T17:00:07.931270] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T17:00:07.935041] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-10-27T17:00:08.161482] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-27T17:00:08.172076] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-27T17:00:08.208987] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-27T17:00:08.209884] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-27T17:00:08.663426] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-27T17:00:08.665546] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-27T17:00:09.206566] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-27T17:00:09.207791] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-27T17:00:09.405541] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T17:00:09.410392] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-10-27T17:00:09.493686] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-27T17:00:09.494724] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-27T17:00:09.522819] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T17:00:09.533303] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-27T17:00:09.773560] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-27T17:00:09.785213] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-27T17:00:10.048262] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-27T17:00:10.049143] [INFO ] [REMOTE ] AAM: Full fetch complete (916 records). [2025-10-27T17:00:10.049232] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-27T17:00:10.247830] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 185 unique days, need 200 days [2025-10-27T17:00:10.248029] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:00:10.248099] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:00:10.248171] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-27T17:00:10.248234] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-27T17:00:10.248272] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-27T17:00:10.248312] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-27T17:00:10.248381] [INFO ] [MAIN ] Update Progress: 1/2366 symbols completed. AAM took 7.3s. Estimated remaining: 4h 46m 55s. Rate: 8.2 symbols/min [2025-10-27T17:00:10.434287] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:10.489777] [DEBUG] [LOCAL ] AAP: Loaded 52419 existing records from primary storage. [2025-10-27T17:00:10.490207] [INFO ] [MAIN ] AAP: Loaded 52419 existing records. [2025-10-27T17:00:10.692781] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:10.693088] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-27T17:00:10.693202] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-27T17:00:10.693680] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-27T17:00:10.693741] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-27T17:00:11.022614] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T17:00:11.083848] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-10-27T17:00:11.105473] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:11.105722] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-27T17:00:11.852980] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-27T17:00:11.863752] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-27T17:00:11.916121] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-27T17:00:11.926802] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-27T17:00:12.271877] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T17:00:12.277267] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-10-27T17:00:13.325586] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-27T17:00:13.337845] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-27T17:00:14.173218] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-27T17:00:14.178427] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-10-27T17:00:14.227734] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-27T17:00:14.239066] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-27T17:00:14.722402] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-10-27T17:00:14.743629] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-27T17:00:14.761463] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-27T17:00:14.771835] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-27T17:00:15.741967] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T17:00:15.747842] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-10-27T17:00:16.118318] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-27T17:00:16.130180] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-27T17:00:16.778452] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-27T17:00:16.789753] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-27T17:00:16.865540] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-27T17:00:16.876886] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-27T17:00:17.326435] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-27T17:00:17.332915] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-10-27T17:00:17.409217] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T17:00:17.419865] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-27T17:00:18.361851] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T17:00:18.373228] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-27T17:00:18.664705] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T17:00:18.671260] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-10. [2025-10-27T17:00:18.834785] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-27T17:00:18.846118] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-27T17:00:18.881665] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T17:00:18.893147] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-27T17:00:19.838778] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-27T17:00:19.843097] [INFO ] [REMOTE ] AAMI: Full fetch complete (33111 records). [2025-10-27T17:00:19.843179] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-10-27T17:00:20.221047] [DEBUG] [VALIDATOR ] AAMI: All expected trading days are present. [2025-10-27T17:00:20.221177] [DEBUG] [VALIDATOR ] AAMI: Primary data validation passed. [2025-10-27T17:00:20.221628] [INFO ] [MAIN ] AAMI: Fetched primary data is valid. [2025-10-27T17:00:20.221878] [DEBUG] [LOCAL ] AAMI: Saving primary data. [2025-10-27T17:00:20.223748] [DEBUG] [LOCAL ] AAMI: Trimmed 33111 records to 23916 (keeping 200 days of data) [2025-10-27T17:00:20.397905] [DEBUG] [LOCAL ] AAMI: Primary data saved (23916 records). [2025-10-27T17:00:20.401198] [INFO ] [MAIN ] AAMI: Full history saved. [2025-10-27T17:00:20.401622] [INFO ] [MAIN ] Update Progress: 2/2366 symbols completed. AAMI took 17.3s. Estimated remaining: 5h 43m 25s. Rate: 6.9 symbols/min [2025-10-27T17:00:20.415003] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-27T17:00:20.528282] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-27T17:00:20.589234] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:20.620162] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T17:00:20.638804] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-27T17:00:20.652136] [DEBUG] [LOCAL ] AAT: Loaded 30590 existing records from primary storage. [2025-10-27T17:00:20.652378] [INFO ] [MAIN ] AAT: Loaded 30590 existing records. [2025-10-27T17:00:20.837543] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:20.837818] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-27T17:00:20.837866] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-27T17:00:20.838056] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-27T17:00:20.838093] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-27T17:00:21.215162] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:21.215674] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-27T17:00:21.571146] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-27T17:00:21.583413] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-27T17:00:22.556785] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-27T17:00:22.568123] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-27T17:00:22.866979] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T17:00:22.872468] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-27T17:00:22.912962] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-27T17:00:22.923337] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-27T17:00:23.613981] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-27T17:00:23.625305] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-27T17:00:23.901915] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T17:00:23.907609] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-27T17:00:24.500456] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-27T17:00:24.511561] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-27T17:00:24.704434] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-27T17:00:24.713814] [INFO ] [REMOTE ] A: Full fetch complete (73568 records). [2025-10-27T17:00:24.713929] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-27T17:00:25.144582] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-27T17:00:25.144962] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-27T17:00:25.121399] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T17:00:25.146259] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-27T17:00:25.154417] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-27T17:00:25.154962] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-27T17:00:25.159146] [DEBUG] [LOCAL ] A: Trimmed 73568 records to 50510 (keeping 200 days of data) [2025-10-27T17:00:25.418988] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-27T17:00:25.444592] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-27T17:00:25.531354] [DEBUG] [LOCAL ] A: Primary data saved (50510 records). [2025-10-27T17:00:25.531536] [INFO ] [MAIN ] A: Full history saved. [2025-10-27T17:00:25.532015] [INFO ] [MAIN ] Update Progress: 3/2366 symbols completed. A took 22.6s. Estimated remaining: 4h 56m 12s. Rate: 8.0 symbols/min [2025-10-27T17:00:25.728861] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:25.729067] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-27T17:00:25.729125] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-27T17:00:25.729256] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-27T17:00:25.729297] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-27T17:00:25.729338] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-27T17:00:25.729369] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-27T17:00:26.089509] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:26.089875] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-10-27T17:00:26.279838] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:00:26.280086] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-10-27T17:00:26.280225] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:00:26.280303] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-27T17:00:26.280367] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:00:26.280438] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-27T17:00:26.280498] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-27T17:00:26.280535] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-27T17:00:26.280574] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-27T17:00:26.280619] [INFO ] [MAIN ] Update Progress: 4/2366 symbols completed. AAUC took 0.7s. Estimated remaining: 3h 49m 25s. Rate: 10.3 symbols/min [2025-10-27T17:00:26.452017] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:26.475365] [DEBUG] [LOCAL ] AB: Loaded 24911 existing records from primary storage. [2025-10-27T17:00:26.475684] [INFO ] [MAIN ] AB: Loaded 24911 existing records. [2025-10-27T17:00:26.662672] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:26.663101] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-27T17:00:26.663418] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-27T17:00:26.679763] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-27T17:00:26.682537] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-27T17:00:26.710549] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T17:00:26.750913] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-27T17:00:27.059768] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-10-27T17:00:27.135087] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-27T17:00:27.160258] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:27.160746] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-27T17:00:28.031204] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-27T17:00:28.038095] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-27T17:00:28.064889] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.62 seconds). [2025-10-27T17:00:28.076445] [INFO ] [REMOTE ] AA: Full fetch complete (77735 records). [2025-10-27T17:00:28.076577] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-27T17:00:28.477054] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-27T17:00:28.477142] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-27T17:00:28.477925] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-27T17:00:28.477995] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-27T17:00:28.479708] [DEBUG] [LOCAL ] AA: Trimmed 77735 records to 53622 (keeping 200 days of data) [2025-10-27T17:00:28.828188] [DEBUG] [LOCAL ] AA: Primary data saved (53622 records). [2025-10-27T17:00:28.828334] [INFO ] [MAIN ] AA: Full history saved. [2025-10-27T17:00:28.828563] [INFO ] [MAIN ] Update Progress: 5/2366 symbols completed. AA took 25.9s. Estimated remaining: 3h 23m 31s. Rate: 11.6 symbols/min [2025-10-27T17:00:29.006716] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:29.025920] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-27T17:00:29.032861] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-27T17:00:29.080880] [DEBUG] [LOCAL ] ABBV: Loaded 54458 existing records from primary storage. [2025-10-27T17:00:29.081236] [INFO ] [MAIN ] ABBV: Loaded 54458 existing records. [2025-10-27T17:00:29.271942] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-27T17:00:29.302464] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-27T17:00:29.301714] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:29.303935] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-27T17:00:29.303994] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-27T17:00:29.304462] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-10-27T17:00:29.304522] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-27T17:00:29.499599] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-27T17:00:29.597715] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-27T17:00:29.715090] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:29.715904] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-27T17:00:30.494274] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T17:00:30.501748] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-27T17:00:30.614710] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T17:00:30.623311] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-27T17:00:31.325050] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T17:00:31.334349] [INFO ] [REMOTE ] AAP: Full fetch complete (74667 records). [2025-10-27T17:00:31.334508] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-27T17:00:31.335384] [FATAL] [VALIDATOR ] AAP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:00:31.335494] [FATAL] [MAIN ] AAP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:00:31.335539] [WARN ] [MAIN ] AAP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:00:31.335591] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-27T17:00:31.335677] [DEBUG] [LOCAL ] AAP: No primary data file found to delete. [2025-10-27T17:00:31.335736] [INFO ] [LOCAL ] AAP: Starting deletion of derivative data. [2025-10-27T17:00:31.335896] [DEBUG] [LOCAL ] AAP: Deleted derivative data file. [2025-10-27T17:00:31.336053] [INFO ] [MAIN ] Update Progress: 6/2366 symbols completed. AAP took 21.1s. Estimated remaining: 3h 5m 58s. Rate: 12.7 symbols/min [2025-10-27T17:00:31.532963] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:31.553570] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-27T17:00:31.561742] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-27T17:00:31.599088] [DEBUG] [LOCAL ] ABCB: Loaded 30712 existing records from primary storage. [2025-10-27T17:00:31.599404] [INFO ] [MAIN ] ABCB: Loaded 30712 existing records. [2025-10-27T17:00:31.799897] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:31.800305] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-27T17:00:31.800364] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-27T17:00:31.800704] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-27T17:00:31.800765] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-27T17:00:32.289013] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:32.289774] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-27T17:00:32.341738] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-27T17:00:32.375327] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-27T17:00:32.378872] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-10-27T17:00:32.393851] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-27T17:00:33.509166] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-27T17:00:33.515512] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-27T17:00:33.800067] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T17:00:33.806792] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-27T17:00:33.865710] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T17:00:33.874067] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-27T17:00:34.345771] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-27T17:00:34.355611] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-27T17:00:34.722318] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T17:00:34.728790] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-27T17:00:34.848205] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-27T17:00:34.854315] [INFO ] [REMOTE ] AAT: Full fetch complete (43049 records). [2025-10-27T17:00:34.854485] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-27T17:00:35.275618] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T17:00:35.275766] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-27T17:00:35.281541] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-27T17:00:35.283224] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-27T17:00:35.282832] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-27T17:00:35.283376] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-27T17:00:35.285414] [DEBUG] [LOCAL ] AAT: Trimmed 43049 records to 29917 (keeping 200 days of data) [2025-10-27T17:00:35.466448] [DEBUG] [LOCAL ] AAT: Primary data saved (29917 records). [2025-10-27T17:00:35.466596] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-27T17:00:35.468906] [INFO ] [MAIN ] Update Progress: 7/2366 symbols completed. AAT took 15.1s. Estimated remaining: 3h 2m 32s. Rate: 12.9 symbols/min [2025-10-27T17:00:35.642360] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:35.696161] [DEBUG] [LOCAL ] ABEV: Loaded 54059 existing records from primary storage. [2025-10-27T17:00:35.696530] [INFO ] [MAIN ] ABEV: Loaded 54059 existing records. [2025-10-27T17:00:35.889383] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:35.889853] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-27T17:00:35.889973] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-27T17:00:35.890581] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-27T17:00:35.890673] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-27T17:00:36.217947] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T17:00:36.299297] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:36.299967] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-27T17:00:36.300673] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-27T17:00:36.377891] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-27T17:00:36.389230] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-27T17:00:36.443093] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T17:00:36.447953] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-27T17:00:37.285223] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-27T17:00:37.290822] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-27T17:00:37.771106] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T17:00:37.778931] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-27T17:00:38.060058] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-27T17:00:38.065018] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-27T17:00:38.215478] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-27T17:00:38.227321] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-27T17:00:38.667023] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-27T17:00:38.679336] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-27T17:00:38.704846] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-27T17:00:38.714305] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-27T17:00:38.952790] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-27T17:00:38.961853] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-27T17:00:39.745796] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T17:00:39.751424] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-27T17:00:39.981597] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-27T17:00:39.991751] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-27T17:00:40.045358] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T17:00:40.050110] [INFO ] [REMOTE ] AB: Full fetch complete (43819 records). [2025-10-27T17:00:40.050225] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-27T17:00:40.437620] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-27T17:00:40.437744] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-27T17:00:40.438244] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-27T17:00:40.438320] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-27T17:00:40.439528] [DEBUG] [LOCAL ] AB: Trimmed 43819 records to 24063 (keeping 200 days of data) [2025-10-27T17:00:40.583908] [DEBUG] [LOCAL ] AB: Primary data saved (24063 records). [2025-10-27T17:00:40.584136] [INFO ] [MAIN ] AB: Full history saved. [2025-10-27T17:00:40.584319] [INFO ] [MAIN ] Update Progress: 8/2366 symbols completed. AB took 14.3s. Estimated remaining: 3h 4m 47s. Rate: 12.8 symbols/min [2025-10-27T17:00:40.760782] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:40.798023] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-27T17:00:40.839762] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-27T17:00:40.841415] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T17:00:40.857996] [DEBUG] [LOCAL ] ABG: Loaded 18043 existing records from primary storage. [2025-10-27T17:00:40.858461] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-27T17:00:40.859594] [INFO ] [MAIN ] ABG: Loaded 18043 existing records. [2025-10-27T17:00:41.050233] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:41.050476] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-27T17:00:41.050552] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-27T17:00:41.050813] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-27T17:00:41.050881] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-27T17:00:41.411462] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:41.412026] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-27T17:00:41.478944] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T17:00:41.489877] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-27T17:00:42.186868] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T17:00:42.198359] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-27T17:00:42.543876] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T17:00:42.554561] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-27T17:00:42.659265] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T17:00:42.664861] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-27T17:00:43.226491] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-27T17:00:43.238458] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-27T17:00:43.264382] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-27T17:00:43.272113] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-27T17:00:43.356577] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-27T17:00:43.360527] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-27T17:00:44.276271] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T17:00:44.281443] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-27T17:00:44.443435] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-27T17:00:44.455978] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-27T17:00:44.474201] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-27T17:00:44.480591] [INFO ] [REMOTE ] ABCB: Full fetch complete (44873 records). [2025-10-27T17:00:44.480776] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-27T17:00:44.853267] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-27T17:00:44.853356] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-27T17:00:44.853834] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-27T17:00:44.853899] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-27T17:00:44.855007] [DEBUG] [LOCAL ] ABCB: Trimmed 44873 records to 30102 (keeping 200 days of data) [2025-10-27T17:00:45.037871] [DEBUG] [LOCAL ] ABCB: Primary data saved (30102 records). [2025-10-27T17:00:45.038018] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-27T17:00:45.040786] [INFO ] [MAIN ] Update Progress: 9/2366 symbols completed. ABCB took 13.7s. Estimated remaining: 3h 3m 38s. Rate: 12.8 symbols/min [2025-10-27T17:00:45.224569] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:45.262198] [DEBUG] [LOCAL ] ABM: Loaded 32551 existing records from primary storage. [2025-10-27T17:00:45.262512] [INFO ] [MAIN ] ABM: Loaded 32551 existing records. [2025-10-27T17:00:45.506619] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:45.508999] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-27T17:00:45.508897] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-27T17:00:45.519619] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-27T17:00:45.520465] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-27T17:00:45.520595] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-27T17:00:45.521033] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-27T17:00:45.670893] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T17:00:45.708578] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-27T17:00:45.906711] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:45.906997] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-27T17:00:46.357193] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-27T17:00:46.368406] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-27T17:00:46.473674] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-27T17:00:46.477176] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-27T17:00:47.114085] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-27T17:00:47.118241] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-27T17:00:47.299840] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-27T17:00:47.310524] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-27T17:00:47.333059] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T17:00:47.340597] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-27T17:00:47.818937] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-27T17:00:47.823894] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-27T17:00:48.176014] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-27T17:00:48.181079] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-27T17:00:48.243480] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T17:00:48.254689] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-27T17:00:48.594008] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-27T17:00:48.599223] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-27T17:00:48.753182] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T17:00:48.765367] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-27T17:00:48.819220] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T17:00:48.829610] [INFO ] [REMOTE ] ABBV: Full fetch complete (77839 records). [2025-10-27T17:00:48.829816] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-27T17:00:49.257996] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-10-27T17:00:49.258163] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-10-27T17:00:49.259017] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-10-27T17:00:49.259108] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-10-27T17:00:49.261224] [DEBUG] [LOCAL ] ABBV: Trimmed 77839 records to 53674 (keeping 200 days of data) [2025-10-27T17:00:49.373985] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-27T17:00:49.407495] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-27T17:00:49.630387] [DEBUG] [LOCAL ] ABBV: Primary data saved (53674 records). [2025-10-27T17:00:49.630546] [INFO ] [MAIN ] ABBV: Full history saved. [2025-10-27T17:00:49.633308] [INFO ] [MAIN ] Update Progress: 10/2366 symbols completed. ABBV took 20.8s. Estimated remaining: 3h 3m 14s. Rate: 12.9 symbols/min [2025-10-27T17:00:49.807952] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:49.864607] [DEBUG] [LOCAL ] ABR: Loaded 52600 existing records from primary storage. [2025-10-27T17:00:49.864952] [INFO ] [MAIN ] ABR: Loaded 52600 existing records. [2025-10-27T17:00:50.054343] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:50.054711] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-27T17:00:50.054840] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-27T17:00:50.055128] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-27T17:00:50.055170] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-27T17:00:50.174201] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-27T17:00:50.204458] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-27T17:00:50.442258] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:50.442609] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-27T17:00:50.471543] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-27T17:00:50.482770] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-27T17:00:50.557335] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T17:00:50.564787] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-27T17:00:51.371014] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-27T17:00:51.374553] [INFO ] [REMOTE ] ABG: Full fetch complete (26743 records). [2025-10-27T17:00:51.374635] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-27T17:00:51.764333] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-27T17:00:51.765504] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-27T17:00:51.764900] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-27T17:00:51.771223] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-27T17:00:51.772004] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-27T17:00:51.771733] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-27T17:00:51.773492] [DEBUG] [LOCAL ] ABG: Trimmed 26743 records to 17425 (keeping 200 days of data) [2025-10-27T17:00:51.876670] [DEBUG] [LOCAL ] ABG: Primary data saved (17425 records). [2025-10-27T17:00:51.876812] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-27T17:00:51.876913] [INFO ] [MAIN ] Update Progress: 11/2366 symbols completed. ABG took 11.3s. Estimated remaining: 2h 54m 31s. Rate: 13.5 symbols/min [2025-10-27T17:00:52.051540] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:52.132754] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-27T17:00:52.131517] [DEBUG] [LOCAL ] ABT: Loaded 54404 existing records from primary storage. [2025-10-27T17:00:52.144557] [INFO ] [MAIN ] ABT: Loaded 54404 existing records. [2025-10-27T17:00:52.188712] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-27T17:00:52.328626] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:52.328875] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-27T17:00:52.328923] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-27T17:00:52.329106] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-27T17:00:52.329145] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-27T17:00:52.698300] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:52.699044] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-27T17:00:52.753900] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T17:00:52.761616] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-27T17:00:52.859007] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-27T17:00:52.870084] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-27T17:00:53.720232] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-27T17:00:53.727328] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-27T17:00:53.958314] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-27T17:00:53.969490] [INFO ] [REMOTE ] ABEV: Full fetch complete (77334 records). [2025-10-27T17:00:53.969612] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-27T17:00:54.365992] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-27T17:00:54.366078] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-27T17:00:54.366786] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-27T17:00:54.366849] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-27T17:00:54.368358] [DEBUG] [LOCAL ] ABEV: Trimmed 77334 records to 53283 (keeping 200 days of data) [2025-10-27T17:00:54.673010] [DEBUG] [LOCAL ] ABEV: Primary data saved (53283 records). [2025-10-27T17:00:54.673179] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-27T17:00:54.675000] [INFO ] [MAIN ] Update Progress: 12/2366 symbols completed. ABEV took 19.2s. Estimated remaining: 2h 49m 3s. Rate: 13.9 symbols/min [2025-10-27T17:00:54.878024] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:54.880309] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-27T17:00:54.891837] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-27T17:00:54.918898] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-27T17:00:54.933755] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-27T17:00:54.944176] [DEBUG] [LOCAL ] ACA: Loaded 22746 existing records from primary storage. [2025-10-27T17:00:54.944413] [INFO ] [MAIN ] ACA: Loaded 22746 existing records. [2025-10-27T17:00:55.127698] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:55.127888] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-27T17:00:55.127933] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-27T17:00:55.128121] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-10-27T17:00:55.128175] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-27T17:00:55.495575] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:55.496072] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-27T17:00:55.529818] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-27T17:00:55.536693] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-27T17:00:56.614773] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T17:00:56.619583] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-27T17:00:56.771687] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-27T17:00:56.782420] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-27T17:00:57.007692] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-27T17:00:57.018541] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-27T17:00:57.057672] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T17:00:57.065742] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-27T17:00:57.400690] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T17:00:57.405759] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-27T17:00:58.111351] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-27T17:00:58.117532] [INFO ] [REMOTE ] ABM: Full fetch complete (45101 records). [2025-10-27T17:00:58.117694] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-27T17:00:58.552397] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-27T17:00:58.552548] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-27T17:00:58.553109] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-27T17:00:58.553245] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-27T17:00:58.554592] [DEBUG] [LOCAL ] ABM: Trimmed 45101 records to 31780 (keeping 200 days of data) [2025-10-27T17:00:58.743329] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-27T17:00:58.776793] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-27T17:00:58.801761] [DEBUG] [LOCAL ] ABM: Primary data saved (31780 records). [2025-10-27T17:00:58.803129] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-27T17:00:58.807307] [INFO ] [MAIN ] Update Progress: 13/2366 symbols completed. ABM took 13.8s. Estimated remaining: 2h 48m 27s. Rate: 14.0 symbols/min [2025-10-27T17:00:58.941273] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T17:00:58.978171] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-27T17:00:59.065612] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:59.068421] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-27T17:00:59.084104] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-27T17:00:59.131336] [DEBUG] [LOCAL ] ACCO: Loaded 37089 existing records from primary storage. [2025-10-27T17:00:59.131958] [INFO ] [MAIN ] ACCO: Loaded 37089 existing records. [2025-10-27T17:00:59.321572] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:59.321878] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-27T17:00:59.321933] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-27T17:00:59.322167] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-27T17:00:59.322223] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-27T17:00:59.706358] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:59.706791] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-27T17:01:00.109781] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-27T17:01:00.116248] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-27T17:01:02.398012] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (3.62 seconds). [2025-10-27T17:01:02.410143] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-27T17:01:02.465708] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (3.38 seconds). [2025-10-27T17:01:02.477940] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (2.77 seconds). [2025-10-27T17:01:02.486026] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-27T17:01:02.487095] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-27T17:01:03.742002] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (3.63 seconds). [2025-10-27T17:01:03.747675] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-27T17:01:05.844783] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-27T17:01:05.850444] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-27T17:01:05.950910] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (3.46 seconds). [2025-10-27T17:01:05.960310] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-27T17:01:06.052859] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (3.57 seconds). [2025-10-27T17:01:06.063229] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-27T17:01:06.801852] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (4.39 seconds). [2025-10-27T17:01:06.812955] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-27T17:01:07.446925] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-27T17:01:07.454512] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-27T17:01:07.573168] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T17:01:07.585053] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-27T17:01:08.301459] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-27T17:01:08.310100] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-27T17:01:09.121423] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-27T17:01:09.144599] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-27T17:01:09.147834] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-27T17:01:09.154687] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-27T17:01:09.293972] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-27T17:01:09.304892] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-27T17:01:09.791116] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-27T17:01:09.795759] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-27T17:01:10.022435] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T17:01:10.032853] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-27T17:01:10.567875] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T17:01:10.579564] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-27T17:01:11.373383] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-27T17:01:11.385269] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-27T17:01:11.524613] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T17:01:11.528827] [INFO ] [REMOTE ] ACA: Full fetch complete (34115 records). [2025-10-27T17:01:11.528937] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-27T17:01:11.936824] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-10-27T17:01:11.937025] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-10-27T17:01:11.937457] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-10-27T17:01:11.937536] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-10-27T17:01:11.960432] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-27T17:01:11.969146] [DEBUG] [LOCAL ] ACA: Trimmed 34115 records to 22078 (keeping 200 days of data) [2025-10-27T17:01:11.970082] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-27T17:01:12.104871] [DEBUG] [LOCAL ] ACA: Primary data saved (22078 records). [2025-10-27T17:01:12.104994] [INFO ] [MAIN ] ACA: Full history saved. [2025-10-27T17:01:12.105072] [INFO ] [MAIN ] Update Progress: 14/2366 symbols completed. ACA took 17.4s. Estimated remaining: 3h 13m 35s. Rate: 12.1 symbols/min [2025-10-27T17:01:12.275342] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:01:12.305470] [DEBUG] [LOCAL ] ACEL: Loaded 26599 existing records from primary storage. [2025-10-27T17:01:12.305923] [INFO ] [MAIN ] ACEL: Loaded 26599 existing records. [2025-10-27T17:01:12.514901] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:01:12.515597] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-27T17:01:12.515887] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-27T17:01:12.516429] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-27T17:01:12.516512] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-27T17:01:12.720879] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-27T17:01:12.826515] [INFO ] [REMOTE ] ABR: Full fetch complete (74974 records). [2025-10-27T17:01:12.843747] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-27T17:01:12.865202] [FATAL] [VALIDATOR ] ABR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:01:12.870733] [FATAL] [MAIN ] ABR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:01:12.881109] [WARN ] [MAIN ] ABR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:01:12.886319] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-27T17:01:12.903840] [DEBUG] [LOCAL ] ABR: No primary data file found to delete. [2025-10-27T17:01:12.923064] [INFO ] [LOCAL ] ABR: Starting deletion of derivative data. [2025-10-27T17:01:12.943378] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:01:12.943771] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-27T17:01:12.943841] [DEBUG] [LOCAL ] ABR: Deleted derivative data file. [2025-10-27T17:01:12.945802] [INFO ] [MAIN ] Update Progress: 15/2366 symbols completed. ABR took 23.3s. Estimated remaining: 3h 2m 48s. Rate: 12.9 symbols/min [2025-10-27T17:01:13.114239] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:01:13.172386] [DEBUG] [LOCAL ] ACHR: Loaded 54598 existing records from primary storage. [2025-10-27T17:01:13.172771] [INFO ] [MAIN ] ACHR: Loaded 54598 existing records. [2025-10-27T17:01:13.348175] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:01:13.348430] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-27T17:01:13.348480] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-27T17:01:13.348862] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-27T17:01:13.348920] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-27T17:01:13.714605] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:01:13.715254] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-27T17:01:13.780545] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-27T17:01:13.792328] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-27T17:01:13.954010] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T17:01:13.959894] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-27T17:01:14.144803] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-27T17:01:14.153141] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-27T17:01:15.197906] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T17:01:15.203752] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-27T17:01:15.468723] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T17:01:15.481429] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-27T17:01:15.937770] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T17:01:15.946025] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-27T17:01:16.142994] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T17:01:16.261191] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-27T17:01:16.271103] [INFO ] [REMOTE ] ABT: Full fetch complete (77384 records). [2025-10-27T17:01:16.271241] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-27T17:01:16.272083] [FATAL] [VALIDATOR ] ABT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:01:16.272172] [FATAL] [MAIN ] ABT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:01:16.272213] [WARN ] [MAIN ] ABT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:01:16.272274] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-27T17:01:16.272335] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-10-27T17:01:16.272370] [INFO ] [LOCAL ] ABT: Starting deletion of derivative data. [2025-10-27T17:01:16.272495] [DEBUG] [LOCAL ] ABT: Deleted derivative data file. [2025-10-27T17:01:16.273960] [INFO ] [MAIN ] Update Progress: 16/2366 symbols completed. ABT took 24.4s. Estimated remaining: 2h 59m 27s. Rate: 13.1 symbols/min [2025-10-27T17:01:16.420851] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-27T17:01:16.446952] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:01:16.492028] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.78 seconds). [2025-10-27T17:01:16.544771] [DEBUG] [LOCAL ] ACI: Loaded 54065 existing records from primary storage. [2025-10-27T17:01:16.545099] [INFO ] [MAIN ] ACI: Loaded 54065 existing records. [2025-10-27T17:01:16.726619] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:01:16.726842] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-27T17:01:16.726889] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-27T17:01:16.727070] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-27T17:01:16.727108] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-27T17:01:17.092090] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:01:17.112027] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T17:01:17.214936] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-27T17:01:18.001723] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T17:01:18.014901] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-27T17:01:18.818094] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-27T17:01:18.821173] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T17:01:18.919152] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T17:01:19.614945] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-27T17:01:20.414920] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-27T17:01:20.734985] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-27T17:01:21.214990] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-27T17:01:21.266592] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-27T17:01:21.726685] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T17:01:22.014968] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-27T17:01:22.354755] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-27T17:01:22.814958] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-27T17:01:23.614962] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-27T17:01:24.124348] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T17:01:24.414975] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-27T17:01:25.123527] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (3.11 seconds). [2025-10-27T17:01:25.214909] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-27T17:01:25.475760] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T17:01:26.019047] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-27T17:01:26.021274] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T17:01:26.815003] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-27T17:01:27.614913] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-27T17:01:27.809747] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-27T17:01:28.002179] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T17:01:28.009436] [INFO ] [REMOTE ] ACCO: Full fetch complete (53892 records). [2025-10-27T17:01:28.009590] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-27T17:01:28.417525] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-27T17:01:28.417220] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-27T17:01:28.418721] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-27T17:01:28.419366] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-27T17:01:28.419720] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-27T17:01:28.422162] [DEBUG] [LOCAL ] ACCO: Trimmed 53892 records to 36287 (keeping 200 days of data) [2025-10-27T17:01:28.439426] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-27T17:01:28.584185] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-27T17:01:28.692113] [DEBUG] [LOCAL ] ACCO: Primary data saved (36287 records). [2025-10-27T17:01:28.692258] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-27T17:01:28.692337] [INFO ] [MAIN ] Update Progress: 17/2366 symbols completed. ACCO took 29.9s. Estimated remaining: 3h 17m 25s. Rate: 11.9 symbols/min [2025-10-27T17:01:28.898271] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:01:28.942590] [DEBUG] [LOCAL ] ACM: Loaded 43273 existing records from primary storage. [2025-10-27T17:01:28.942936] [INFO ] [MAIN ] ACM: Loaded 43273 existing records. [2025-10-27T17:01:29.117277] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:01:29.117504] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-27T17:01:29.117557] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-27T17:01:29.117786] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-27T17:01:29.117843] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-27T17:01:29.215725] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-27T17:01:29.469949] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:01:30.015011] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-27T17:01:30.524252] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T17:01:30.528934] [INFO ] [REMOTE ] ACEL: Full fetch complete (38668 records). [2025-10-27T17:01:30.529020] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-27T17:01:30.814921] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-27T17:01:30.904534] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-27T17:01:30.904617] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-27T17:01:30.905044] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-27T17:01:30.905100] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-27T17:01:30.905953] [DEBUG] [LOCAL ] ACEL: Trimmed 38668 records to 25768 (keeping 200 days of data) [2025-10-27T17:01:31.053749] [DEBUG] [LOCAL ] ACEL: Primary data saved (25768 records). [2025-10-27T17:01:31.053927] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-27T17:01:31.054045] [INFO ] [MAIN ] Update Progress: 18/2366 symbols completed. ACEL took 18.9s. Estimated remaining: 3h 11m 30s. Rate: 12.3 symbols/min [2025-10-27T17:01:31.260225] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:01:31.265060] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-10-27T17:01:31.325791] [DEBUG] [LOCAL ] ACN: Loaded 54215 existing records from primary storage. [2025-10-27T17:01:31.326098] [INFO ] [MAIN ] ACN: Loaded 54215 existing records. [2025-10-27T17:01:31.510315] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:01:31.510737] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-27T17:01:31.510814] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-27T17:01:31.519172] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-27T17:01:31.533212] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-27T17:01:31.616003] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-27T17:01:31.610797] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T17:01:31.914672] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:01:32.414918] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-27T17:01:32.686451] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-27T17:01:33.214996] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-27T17:01:33.869296] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T17:01:34.014922] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-27T17:01:34.391894] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-10-27T17:01:34.815000] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-27T17:01:34.966723] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-27T17:01:35.260795] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T17:01:35.614941] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-27T17:01:36.414923] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-27T17:01:37.214976] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-27T17:01:37.393521] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-27T17:01:37.571676] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-10-27T17:01:38.021163] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-27T17:01:38.039930] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-27T17:01:38.673279] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T17:01:38.814910] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-27T17:01:39.614962] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-27T17:01:40.244597] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T17:01:40.417365] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-27T17:01:40.423454] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-27T17:01:41.214942] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-27T17:01:41.501993] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-27T17:01:41.901430] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-27T17:01:42.014998] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-27T17:01:42.814987] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-27T17:01:42.892179] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T17:01:43.614982] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-27T17:01:44.414955] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-27T17:01:44.553739] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-27T17:01:44.606700] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-27T17:01:45.170979] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T17:01:45.215012] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-27T17:01:46.014933] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-27T17:01:46.067548] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-27T17:01:46.077869] [INFO ] [REMOTE ] ACI: Full fetch complete (77232 records). [2025-10-27T17:01:46.078049] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-27T17:01:46.466327] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-27T17:01:46.466405] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-27T17:01:46.467099] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-27T17:01:46.467164] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-27T17:01:46.468541] [DEBUG] [LOCAL ] ACI: Trimmed 77232 records to 53285 (keeping 200 days of data) [2025-10-27T17:01:46.778930] [DEBUG] [LOCAL ] ACI: Primary data saved (53285 records). [2025-10-27T17:01:46.779057] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-27T17:01:46.779132] [INFO ] [MAIN ] Update Progress: 19/2366 symbols completed. ACI took 30.5s. Estimated remaining: 3h 33m 43s. Rate: 11.0 symbols/min [2025-10-27T17:01:46.826090] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-27T17:01:46.955170] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:01:46.984237] [DEBUG] [LOCAL ] ACP: Loaded 31563 existing records from primary storage. [2025-10-27T17:01:46.984495] [INFO ] [MAIN ] ACP: Loaded 31563 existing records. [2025-10-27T17:01:47.158097] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:01:47.158314] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-27T17:01:47.158360] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-27T17:01:47.158606] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-27T17:01:47.158703] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-27T17:01:47.503949] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:01:47.614896] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-27T17:01:48.029012] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-27T17:01:48.414973] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-27T17:01:48.455218] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (3.24 seconds). [2025-10-27T17:01:48.465546] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-27T17:01:48.465695] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-27T17:01:48.669623] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T17:01:48.898996] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-27T17:01:48.899091] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-27T17:01:48.899828] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-27T17:01:48.899980] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-27T17:01:48.921222] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T17:01:48.928766] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-10-27T17:01:49.216485] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-27T17:01:49.234387] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-10-27T17:01:49.234473] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-27T17:01:49.236693] [INFO ] [MAIN ] Update Progress: 20/2366 symbols completed. ACHR took 36.3s. Estimated remaining: 3h 27m 45s. Rate: 11.3 symbols/min [2025-10-27T17:01:49.408365] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:01:49.416408] [DEBUG] [LOCAL ] ACR: Loaded 5349 existing records from primary storage. [2025-10-27T17:01:49.416584] [INFO ] [MAIN ] ACR: Loaded 5349 existing records. [2025-10-27T17:01:49.590139] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:01:49.590383] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-27T17:01:49.590440] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-27T17:01:49.590575] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-27T17:01:49.590612] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-27T17:01:49.954227] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:01:49.989559] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-27T17:01:50.014909] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-27T17:01:50.814958] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-27T17:01:50.918777] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-27T17:01:51.614903] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-27T17:01:51.765385] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-27T17:01:52.180353] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-27T17:01:52.414715] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T17:01:52.416352] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-27T17:01:53.186551] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T17:01:53.214993] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-27T17:01:54.015002] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-27T17:01:54.563300] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-27T17:01:54.814984] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-27T17:01:55.614925] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-27T17:01:55.691038] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-27T17:01:55.723018] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-27T17:01:56.414949] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-27T17:01:57.214962] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-27T17:01:57.489753] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-27T17:01:57.996225] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-27T17:01:58.014951] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-27T17:01:58.814941] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-27T17:01:58.985079] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-27T17:01:59.196836] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T17:01:59.269516] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-27T17:01:59.614943] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-27T17:02:00.415025] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-27T17:02:01.215007] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-27T17:02:01.871414] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-27T17:02:02.014968] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-27T17:02:02.815064] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-27T17:02:04.069960] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (3.65 seconds). [2025-10-27T17:02:04.072103] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-27T17:02:05.537515] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (4.32 seconds). [2025-10-27T17:02:05.545255] [INFO ] [REMOTE ] ACM: Full fetch complete (62972 records). [2025-10-27T17:02:05.545405] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-27T17:02:05.546155] [FATAL] [VALIDATOR ] ACM: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:02:05.546244] [FATAL] [MAIN ] ACM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:02:05.546287] [WARN ] [MAIN ] ACM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:02:05.546326] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-27T17:02:05.546380] [DEBUG] [LOCAL ] ACM: No primary data file found to delete. [2025-10-27T17:02:05.546415] [INFO ] [LOCAL ] ACM: Starting deletion of derivative data. [2025-10-27T17:02:05.546829] [DEBUG] [LOCAL ] ACM: Deleted derivative data file. [2025-10-27T17:02:05.548669] [INFO ] [MAIN ] Update Progress: 21/2366 symbols completed. ACM took 36.9s. Estimated remaining: 3h 48m 8s. Rate: 10.3 symbols/min [2025-10-27T17:02:05.742184] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:02:05.762901] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-10-27T17:02:05.770625] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-27T17:02:05.801770] [DEBUG] [LOCAL ] ACRE: Loaded 33607 existing records from primary storage. [2025-10-27T17:02:05.802034] [INFO ] [MAIN ] ACRE: Loaded 33607 existing records. [2025-10-27T17:02:05.984491] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:02:05.984895] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-27T17:02:05.984977] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-27T17:02:05.985291] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-27T17:02:05.985426] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-27T17:02:06.215568] [DEBUG] [REMOTE ] ACR: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-27T17:02:06.250787] [WARN ] [REMOTE ] ACR: No data returned for month 2025-06 [2025-10-27T17:02:06.263008] [FATAL] [REMOTE ] ACR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:02:06.283399] [FATAL] [MAIN ] ACR: Failed to fetch primary data. [2025-10-27T17:02:06.287014] [WARN ] [MAIN ] ACR: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:02:06.287613] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-27T17:02:06.298380] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-10-27T17:02:06.298542] [INFO ] [LOCAL ] ACR: Starting deletion of derivative data. [2025-10-27T17:02:06.373593] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:02:06.374195] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-27T17:02:06.373891] [DEBUG] [LOCAL ] ACR: Deleted derivative data file. [2025-10-27T17:02:06.375431] [INFO ] [MAIN ] Update Progress: 22/2366 symbols completed. ACR took 17.1s. Estimated remaining: 3h 39m 8s. Rate: 10.7 symbols/min [2025-10-27T17:02:06.530387] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (4.52 seconds). [2025-10-27T17:02:06.579499] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-27T17:02:06.596850] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:02:06.606537] [DEBUG] [LOCAL ] ACV: Loaded 7578 existing records from primary storage. [2025-10-27T17:02:06.606762] [INFO ] [MAIN ] ACV: Loaded 7578 existing records. [2025-10-27T17:02:06.785257] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:02:06.785454] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-27T17:02:06.785500] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-27T17:02:06.785703] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-27T17:02:06.785760] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-27T17:02:07.147346] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:02:07.165228] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-27T17:02:07.167502] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T17:02:07.614973] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-27T17:02:07.685211] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-27T17:02:08.414930] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-27T17:02:08.463007] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-27T17:02:08.513392] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-27T17:02:08.543190] [INFO ] [REMOTE ] ACN: Full fetch complete (77419 records). [2025-10-27T17:02:08.543497] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-27T17:02:08.545353] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-27T17:02:08.941859] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-27T17:02:08.941944] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-27T17:02:08.942634] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-27T17:02:08.942724] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-27T17:02:08.944793] [DEBUG] [LOCAL ] ACN: Trimmed 77419 records to 53433 (keeping 200 days of data) [2025-10-27T17:02:09.069784] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T17:02:09.237528] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-27T17:02:09.283464] [DEBUG] [LOCAL ] ACN: Primary data saved (53433 records). [2025-10-27T17:02:09.283891] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-27T17:02:09.283997] [INFO ] [MAIN ] Update Progress: 23/2366 symbols completed. ACN took 38.2s. Estimated remaining: 3h 34m 28s. Rate: 10.9 symbols/min [2025-10-27T17:02:09.468630] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:02:09.520804] [DEBUG] [LOCAL ] ACVA: Loaded 49969 existing records from primary storage. [2025-10-27T17:02:09.521281] [INFO ] [MAIN ] ACVA: Loaded 49969 existing records. [2025-10-27T17:02:09.719324] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:02:09.719683] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-27T17:02:09.719749] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-27T17:02:09.720006] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-27T17:02:09.720064] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-27T17:02:10.016029] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-27T17:02:10.123721] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:02:10.141405] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T17:02:10.814969] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-27T17:02:11.300933] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-27T17:02:11.506918] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-27T17:02:11.513044] [INFO ] [REMOTE ] ACP: Full fetch complete (46262 records). [2025-10-27T17:02:11.513151] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-27T17:02:11.513738] [FATAL] [VALIDATOR ] ACP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:02:11.513821] [FATAL] [MAIN ] ACP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:02:11.513863] [WARN ] [MAIN ] ACP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:02:11.513924] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-27T17:02:11.513987] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-10-27T17:02:11.514020] [INFO ] [LOCAL ] ACP: Starting deletion of derivative data. [2025-10-27T17:02:11.514160] [DEBUG] [LOCAL ] ACP: Deleted derivative data file. [2025-10-27T17:02:11.514243] [INFO ] [MAIN ] Update Progress: 24/2366 symbols completed. ACP took 24.7s. Estimated remaining: 3h 29m 4s. Rate: 11.2 symbols/min [2025-10-27T17:02:11.620048] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-27T17:02:11.692744] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:02:11.692909] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-27T17:02:11.692946] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-27T17:02:11.693052] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-27T17:02:11.693092] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-27T17:02:11.693132] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-27T17:02:11.693164] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-27T17:02:12.049003] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:02:12.353799] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-27T17:02:12.414935] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-27T17:02:13.214942] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-10-27T17:02:13.418074] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:02:13.418370] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-10-27T17:02:13.418459] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:02:13.418528] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-27T17:02:13.418594] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:02:13.418691] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-27T17:02:13.418762] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-27T17:02:13.418802] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-27T17:02:13.418842] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-27T17:02:13.418888] [INFO ] [MAIN ] Update Progress: 25/2366 symbols completed. AD took 1.9s. Estimated remaining: 3h 23m 35s. Rate: 11.5 symbols/min [2025-10-27T17:02:13.607885] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:02:13.647873] [DEBUG] [LOCAL ] ADC: Loaded 47102 existing records from primary storage. [2025-10-27T17:02:13.648391] [INFO ] [MAIN ] ADC: Loaded 47102 existing records. [2025-10-27T17:02:13.762141] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T17:02:13.856355] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:02:13.856551] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-27T17:02:13.856597] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-27T17:02:13.856817] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-27T17:02:13.856871] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-27T17:02:14.027525] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-27T17:02:14.211838] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:02:14.814961] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-27T17:02:15.615047] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-27T17:02:15.752461] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-27T17:02:16.414971] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-27T17:02:16.807083] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-27T17:02:17.214947] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-27T17:02:17.321709] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-27T17:02:18.014980] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-27T17:02:18.247837] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-27T17:02:18.408190] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-27T17:02:18.814937] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-27T17:02:18.844246] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-27T17:02:19.615012] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-27T17:02:20.284821] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T17:02:20.414976] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-27T17:02:20.895476] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T17:02:21.214994] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-27T17:02:22.014939] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-27T17:02:22.070775] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T17:02:22.449107] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-27T17:02:22.814940] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-27T17:02:22.964256] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-27T17:02:23.614999] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-27T17:02:24.414958] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-27T17:02:25.071372] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-27T17:02:25.158623] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T17:02:25.214908] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-27T17:02:25.663430] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T17:02:26.014972] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-27T17:02:26.251550] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T17:02:26.463013] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-27T17:02:26.814961] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-27T17:02:27.319303] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-27T17:02:27.614948] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-27T17:02:28.415005] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-27T17:02:29.214937] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-27T17:02:29.608173] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-27T17:02:29.958347] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T17:02:29.962512] [INFO ] [REMOTE ] ACV: Full fetch complete (10600 records). [2025-10-27T17:02:29.963607] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-27T17:02:30.017324] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-27T17:02:30.352886] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-27T17:02:30.523058] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-27T17:02:30.523207] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-27T17:02:30.523442] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-27T17:02:30.523490] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-27T17:02:30.524275] [DEBUG] [LOCAL ] ACV: Trimmed 10600 records to 7257 (keeping 200 days of data) [2025-10-27T17:02:30.577928] [DEBUG] [LOCAL ] ACV: Primary data saved (7257 records). [2025-10-27T17:02:30.578108] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-27T17:02:30.578214] [INFO ] [MAIN ] Update Progress: 26/2366 symbols completed. ACV took 24.2s. Estimated remaining: 3h 41m 25s. Rate: 10.6 symbols/min [2025-10-27T17:02:30.822146] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-27T17:02:30.841954] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:02:30.915958] [DEBUG] [LOCAL ] ADCT: Loaded 36037 existing records from primary storage. [2025-10-27T17:02:30.916353] [INFO ] [MAIN ] ADCT: Loaded 36037 existing records. [2025-10-27T17:02:31.134989] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:02:31.135436] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-27T17:02:31.135526] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-27T17:02:31.135818] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-27T17:02:31.135978] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-27T17:02:31.318368] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T17:02:31.548269] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:02:31.614948] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-27T17:02:32.113742] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T17:02:32.414964] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-27T17:02:33.195528] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-27T17:02:33.214912] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-27T17:02:33.587868] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T17:02:34.015020] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-27T17:02:34.260709] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-27T17:02:34.815025] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-27T17:02:35.491114] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T17:02:35.614951] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-27T17:02:36.276919] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T17:02:36.414978] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-27T17:02:36.505272] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-27T17:02:37.214939] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-27T17:02:37.715705] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T17:02:38.014941] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-27T17:02:38.356001] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T17:02:38.814963] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-27T17:02:38.868740] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T17:02:39.614941] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-27T17:02:40.414978] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-27T17:02:40.472265] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T17:02:40.555596] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-27T17:02:41.214929] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-27T17:02:42.014975] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-27T17:02:42.051486] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-27T17:02:42.814933] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-27T17:02:42.905528] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T17:02:43.614947] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-27T17:02:43.748336] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T17:02:43.757600] [INFO ] [REMOTE ] ADC: Full fetch complete (66727 records). [2025-10-27T17:02:43.757777] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-27T17:02:44.140989] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-27T17:02:44.211189] [INFO ] [REMOTE ] ACRE: Full fetch complete (49150 records). [2025-10-27T17:02:44.213668] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-27T17:02:44.326009] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-27T17:02:44.349060] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-27T17:02:44.361013] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-27T17:02:44.361199] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-27T17:02:44.426988] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-27T17:02:44.449857] [DEBUG] [LOCAL ] ADC: Trimmed 66727 records to 46272 (keeping 200 days of data) [2025-10-27T17:02:44.918828] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-27T17:02:44.919207] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-27T17:02:44.922785] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-27T17:02:44.923758] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-27T17:02:44.955629] [DEBUG] [LOCAL ] ACRE: Trimmed 49150 records to 32703 (keeping 200 days of data) [2025-10-27T17:02:44.992694] [DEBUG] [LOCAL ] ADC: Primary data saved (46272 records). [2025-10-27T17:02:44.992871] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-27T17:02:44.992990] [INFO ] [MAIN ] Update Progress: 27/2366 symbols completed. ADC took 31.6s. Estimated remaining: 3h 53m 56s. Rate: 10.0 symbols/min [2025-10-27T17:02:45.304345] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:02:45.393170] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T17:02:45.421177] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-27T17:02:45.425153] [DEBUG] [LOCAL ] ACRE: Primary data saved (32703 records). [2025-10-27T17:02:45.425576] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-27T17:02:45.426879] [INFO ] [MAIN ] Update Progress: 28/2366 symbols completed. ACRE took 39.9s. Estimated remaining: 3h 46m 5s. Rate: 10.3 symbols/min [2025-10-27T17:02:45.655257] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:02:45.657516] [DEBUG] [LOCAL ] ADM: Loaded 54167 existing records from primary storage. [2025-10-27T17:02:45.658250] [INFO ] [MAIN ] ADM: Loaded 54167 existing records. [2025-10-27T17:02:45.857025] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:02:45.867990] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-27T17:02:45.868177] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-27T17:02:45.868488] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-27T17:02:45.868530] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-27T17:02:45.994237] [DEBUG] [LOCAL ] ADNT: Loaded 46882 existing records from primary storage. [2025-10-27T17:02:46.040449] [INFO ] [MAIN ] ADNT: Loaded 46882 existing records. [2025-10-27T17:02:46.111133] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T17:02:46.271433] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-27T17:02:46.519060] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:02:46.515122] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:02:46.519874] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-27T17:02:46.519969] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-27T17:02:46.520170] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-27T17:02:46.520212] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-27T17:02:46.829450] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-27T17:02:46.921305] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:02:46.941228] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T17:02:47.615045] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-27T17:02:48.415056] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-27T17:02:48.470585] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-27T17:02:48.481344] [INFO ] [REMOTE ] ACVA: Full fetch complete (71060 records). [2025-10-27T17:02:48.481537] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-27T17:02:48.927507] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-27T17:02:48.927774] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-27T17:02:48.928479] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-27T17:02:48.928633] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-27T17:02:48.955557] [DEBUG] [LOCAL ] ACVA: Trimmed 71060 records to 49125 (keeping 200 days of data) [2025-10-27T17:02:48.962685] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-27T17:02:49.165811] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T17:02:49.224859] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-27T17:02:49.298951] [DEBUG] [LOCAL ] ACVA: Primary data saved (49125 records). [2025-10-27T17:02:49.299086] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-27T17:02:49.301701] [INFO ] [MAIN ] Update Progress: 29/2366 symbols completed. ACVA took 40.0s. Estimated remaining: 3h 43m 24s. Rate: 10.5 symbols/min [2025-10-27T17:02:49.466679] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:02:49.527020] [DEBUG] [LOCAL ] ADT: Loaded 54214 existing records from primary storage. [2025-10-27T17:02:49.527458] [INFO ] [MAIN ] ADT: Loaded 54214 existing records. [2025-10-27T17:02:49.727954] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:02:49.728212] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-27T17:02:49.729104] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-27T17:02:49.730339] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T17:02:49.733363] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-27T17:02:49.738394] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-27T17:02:50.020567] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-27T17:02:50.093617] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:02:50.815013] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-27T17:02:50.941712] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-27T17:02:51.168935] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T17:02:51.614984] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-27T17:02:52.414980] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-27T17:02:53.220750] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-27T17:02:53.240036] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-27T17:02:53.334286] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-27T17:02:54.009723] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T17:02:54.020233] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-27T17:02:54.814951] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-27T17:02:55.036880] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-27T17:02:55.045293] [INFO ] [REMOTE ] ADCT: Full fetch complete (51456 records). [2025-10-27T17:02:55.045472] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-27T17:02:55.436151] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-27T17:02:55.436288] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-27T17:02:55.436813] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-27T17:02:55.436878] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-27T17:02:55.438234] [DEBUG] [LOCAL ] ADCT: Trimmed 51456 records to 35566 (keeping 200 days of data) [2025-10-27T17:02:55.616005] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-27T17:02:55.644187] [DEBUG] [LOCAL ] ADCT: Primary data saved (35566 records). [2025-10-27T17:02:55.644448] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-27T17:02:55.644828] [INFO ] [MAIN ] Update Progress: 30/2366 symbols completed. ADCT took 25.1s. Estimated remaining: 3h 44m 6s. Rate: 10.4 symbols/min [2025-10-27T17:02:55.824437] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-27T17:02:55.892547] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:02:55.920546] [DEBUG] [LOCAL ] ADX: Loaded 28052 existing records from primary storage. [2025-10-27T17:02:55.920896] [INFO ] [MAIN ] ADX: Loaded 28052 existing records. [2025-10-27T17:02:56.110254] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:02:56.110686] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-27T17:02:56.110827] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-27T17:02:56.111069] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-27T17:02:56.111216] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-27T17:02:56.362186] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-27T17:02:56.423087] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-27T17:02:56.527257] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:02:57.215011] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-27T17:02:57.928836] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T17:02:58.014947] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-27T17:02:58.103837] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-27T17:02:58.823564] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-27T17:02:58.825541] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T17:02:59.614935] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-27T17:02:59.770356] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-27T17:03:00.414992] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-27T17:03:01.214992] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-27T17:03:01.834251] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-27T17:03:02.014906] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-27T17:03:02.380071] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (3.56 seconds). [2025-10-27T17:03:02.814967] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-27T17:03:04.928509] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (4.51 seconds). [2025-10-27T17:03:04.938925] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-27T17:03:05.317458] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (4.10 seconds). [2025-10-27T17:03:05.323912] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-27T17:03:06.956372] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (4.14 seconds). [2025-10-27T17:03:06.967877] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-27T17:03:07.042869] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (5.03 seconds). [2025-10-27T17:03:07.054188] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-27T17:03:07.695300] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-27T17:03:07.702049] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-27T17:03:08.743173] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (3.80 seconds). [2025-10-27T17:03:08.753064] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-27T17:03:09.779998] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-27T17:03:09.786497] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-27T17:03:09.830886] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (2.86 seconds). [2025-10-27T17:03:09.843507] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-27T17:03:10.182308] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (3.13 seconds). [2025-10-27T17:03:10.194361] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-27T17:03:10.237473] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T17:03:10.814938] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-27T17:03:11.335804] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-27T17:03:11.596590] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-27T17:03:11.614908] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-27T17:03:12.328663] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-27T17:03:12.384276] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T17:03:12.392089] [INFO ] [REMOTE ] ADNT: Full fetch complete (67402 records). [2025-10-27T17:03:12.392213] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-27T17:03:12.393038] [FATAL] [VALIDATOR ] ADNT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:03:12.393124] [FATAL] [MAIN ] ADNT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:03:12.393166] [WARN ] [MAIN ] ADNT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:03:12.393234] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-27T17:03:12.393297] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-10-27T17:03:12.393332] [INFO ] [LOCAL ] ADNT: Starting deletion of derivative data. [2025-10-27T17:03:12.393489] [DEBUG] [LOCAL ] ADNT: Deleted derivative data file. [2025-10-27T17:03:12.395159] [INFO ] [MAIN ] Update Progress: 31/2366 symbols completed. ADNT took 27.0s. Estimated remaining: 3h 57m 48s. Rate: 9.8 symbols/min [2025-10-27T17:03:12.425048] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-27T17:03:12.577397] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:03:12.596923] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T17:03:12.652413] [DEBUG] [LOCAL ] AEE: Loaded 50716 existing records from primary storage. [2025-10-27T17:03:12.652739] [INFO ] [MAIN ] AEE: Loaded 50716 existing records. [2025-10-27T17:03:12.825412] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:03:12.825607] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-27T17:03:12.825683] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-27T17:03:12.825876] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-27T17:03:12.825916] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-27T17:03:13.178484] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:03:13.214899] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-27T17:03:13.904950] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T17:03:14.014923] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-27T17:03:14.814950] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-27T17:03:15.062205] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-27T17:03:15.450861] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T17:03:15.614927] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-27T17:03:16.414953] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-27T17:03:16.450302] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-27T17:03:17.143190] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T17:03:17.153739] [INFO ] [REMOTE ] ADM: Full fetch complete (77477 records). [2025-10-27T17:03:17.153894] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-27T17:03:17.220797] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-27T17:03:17.580597] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-27T17:03:17.608158] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-27T17:03:17.608245] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-27T17:03:17.609437] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-27T17:03:17.609506] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-27T17:03:17.610989] [DEBUG] [LOCAL ] ADM: Trimmed 77477 records to 53387 (keeping 200 days of data) [2025-10-27T17:03:17.935484] [DEBUG] [LOCAL ] ADM: Primary data saved (53387 records). [2025-10-27T17:03:17.935719] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-27T17:03:17.935822] [INFO ] [MAIN ] Update Progress: 32/2366 symbols completed. ADM took 32.9s. Estimated remaining: 3h 57m 0s. Rate: 9.8 symbols/min [2025-10-27T17:03:18.020006] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-27T17:03:18.129636] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:03:18.140076] [DEBUG] [LOCAL ] AEFC: Loaded 7718 existing records from primary storage. [2025-10-27T17:03:18.140287] [INFO ] [MAIN ] AEFC: Loaded 7718 existing records. [2025-10-27T17:03:18.328397] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:03:18.328610] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-27T17:03:18.328685] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-27T17:03:18.328848] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-27T17:03:18.328888] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-27T17:03:18.705160] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:03:18.732040] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T17:03:18.814912] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-27T17:03:19.614963] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-27T17:03:20.131831] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-27T17:03:20.203224] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-27T17:03:20.415001] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-27T17:03:20.899989] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T17:03:21.214966] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-27T17:03:22.016623] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-27T17:03:22.017582] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T17:03:22.564470] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-27T17:03:22.773414] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T17:03:22.814987] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-27T17:03:23.614956] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-27T17:03:24.414970] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-27T17:03:24.627919] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-27T17:03:24.966533] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T17:03:24.976592] [INFO ] [REMOTE ] ADX: Full fetch complete (41757 records). [2025-10-27T17:03:24.976939] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-27T17:03:25.218274] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-27T17:03:25.244858] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-27T17:03:25.430667] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-27T17:03:25.430795] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-27T17:03:25.431342] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-27T17:03:25.431410] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-27T17:03:25.433162] [DEBUG] [LOCAL ] ADX: Trimmed 41757 records to 27465 (keeping 200 days of data) [2025-10-27T17:03:25.607871] [DEBUG] [LOCAL ] ADX: Primary data saved (27465 records). [2025-10-27T17:03:25.608077] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-27T17:03:25.608183] [INFO ] [MAIN ] Update Progress: 33/2366 symbols completed. ADX took 30.0s. Estimated remaining: 3h 58m 46s. Rate: 9.8 symbols/min [2025-10-27T17:03:25.817588] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:03:25.871101] [DEBUG] [LOCAL ] AEG: Loaded 50239 existing records from primary storage. [2025-10-27T17:03:25.871790] [INFO ] [MAIN ] AEG: Loaded 50239 existing records. [2025-10-27T17:03:26.029284] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-27T17:03:26.079992] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:03:26.080344] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-27T17:03:26.080397] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-27T17:03:26.080615] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-27T17:03:26.080693] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-27T17:03:26.470714] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:03:26.814942] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-27T17:03:26.990771] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T17:03:27.102000] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-27T17:03:27.614943] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-27T17:03:28.378634] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-27T17:03:28.414897] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-27T17:03:28.445289] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-27T17:03:28.455973] [INFO ] [REMOTE ] ADT: Full fetch complete (77378 records). [2025-10-27T17:03:28.456112] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-27T17:03:28.836868] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-27T17:03:28.837075] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-27T17:03:28.837843] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-27T17:03:28.837917] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-27T17:03:28.844268] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-27T17:03:28.847498] [DEBUG] [LOCAL ] ADT: Trimmed 77378 records to 53432 (keeping 200 days of data) [2025-10-27T17:03:29.149735] [DEBUG] [LOCAL ] ADT: Primary data saved (53432 records). [2025-10-27T17:03:29.149859] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-27T17:03:29.152130] [INFO ] [MAIN ] Update Progress: 34/2366 symbols completed. ADT took 39.9s. Estimated remaining: 3h 55m 42s. Rate: 9.9 symbols/min [2025-10-27T17:03:29.220230] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-27T17:03:29.327699] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:03:29.394414] [DEBUG] [LOCAL ] AEM: Loaded 54253 existing records from primary storage. [2025-10-27T17:03:29.394736] [INFO ] [MAIN ] AEM: Loaded 54253 existing records. [2025-10-27T17:03:29.570672] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:03:29.570824] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-27T17:03:29.570871] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-27T17:03:29.571047] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-27T17:03:29.571086] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-27T17:03:29.702246] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-27T17:03:29.933129] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:03:30.014898] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-27T17:03:30.815023] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-27T17:03:31.614990] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-27T17:03:31.685191] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T17:03:32.079369] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T17:03:32.414920] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-27T17:03:32.465320] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-27T17:03:33.215098] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-27T17:03:34.014954] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-27T17:03:34.172243] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-27T17:03:34.430878] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-27T17:03:34.825691] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-27T17:03:34.831781] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-27T17:03:35.614964] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-27T17:03:36.047373] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-27T17:03:36.414980] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-27T17:03:37.151220] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T17:03:37.153135] [INFO ] [REMOTE ] AEFC: Full fetch complete (11564 records). [2025-10-27T17:03:37.153248] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-27T17:03:37.153761] [FATAL] [VALIDATOR ] AEFC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:03:37.153846] [FATAL] [MAIN ] AEFC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:03:37.153890] [WARN ] [MAIN ] AEFC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:03:37.153954] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-27T17:03:37.154019] [DEBUG] [LOCAL ] AEFC: No primary data file found to delete. [2025-10-27T17:03:37.154055] [INFO ] [LOCAL ] AEFC: Starting deletion of derivative data. [2025-10-27T17:03:37.154184] [DEBUG] [LOCAL ] AEFC: Deleted derivative data file. [2025-10-27T17:03:37.154256] [INFO ] [MAIN ] Update Progress: 35/2366 symbols completed. AEFC took 19.2s. Estimated remaining: 3h 57m 45s. Rate: 9.8 symbols/min [2025-10-27T17:03:37.222150] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-27T17:03:37.333477] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:03:37.385456] [DEBUG] [LOCAL ] AEO: Loaded 54343 existing records from primary storage. [2025-10-27T17:03:37.385864] [INFO ] [MAIN ] AEO: Loaded 54343 existing records. [2025-10-27T17:03:37.611061] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-27T17:03:37.627574] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:03:37.628675] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-27T17:03:37.628745] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-27T17:03:37.628959] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-27T17:03:37.629019] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-27T17:03:38.018356] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-27T17:03:38.041542] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:03:38.815000] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-27T17:03:39.465194] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-27T17:03:39.623033] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-27T17:03:39.628494] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-27T17:03:40.420062] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-27T17:03:40.437892] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-27T17:03:41.037007] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T17:03:41.214947] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-27T17:03:42.014954] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-27T17:03:42.453101] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-27T17:03:42.814939] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-27T17:03:43.005338] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-27T17:03:43.614967] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-27T17:03:44.165213] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-27T17:03:44.414951] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-27T17:03:44.733183] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-27T17:03:45.202361] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T17:03:45.214898] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-27T17:03:45.717944] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T17:03:46.014971] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-27T17:03:46.705913] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T17:03:46.814982] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-27T17:03:47.614949] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-27T17:03:48.051829] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-27T17:03:48.414935] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-27T17:03:48.590691] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-27T17:03:49.027479] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-27T17:03:49.036957] [INFO ] [REMOTE ] AEE: Full fetch complete (72959 records). [2025-10-27T17:03:49.037074] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-27T17:03:49.227625] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-27T17:03:49.457089] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-27T17:03:49.457182] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-27T17:03:49.458002] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-27T17:03:49.458113] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-27T17:03:49.459768] [DEBUG] [LOCAL ] AEE: Trimmed 72959 records to 49892 (keeping 200 days of data) [2025-10-27T17:03:49.704083] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-27T17:03:49.797624] [DEBUG] [LOCAL ] AEE: Primary data saved (49892 records). [2025-10-27T17:03:49.797773] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-27T17:03:49.799320] [INFO ] [MAIN ] Update Progress: 36/2366 symbols completed. AEE took 37.4s. Estimated remaining: 4h 4m 41s. Rate: 9.5 symbols/min [2025-10-27T17:03:50.027930] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-27T17:03:50.035424] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:03:50.086159] [DEBUG] [LOCAL ] AER: Loaded 48541 existing records from primary storage. [2025-10-27T17:03:50.086494] [INFO ] [MAIN ] AER: Loaded 48541 existing records. [2025-10-27T17:03:50.297003] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:03:50.297243] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-27T17:03:50.297289] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-27T17:03:50.297503] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-27T17:03:50.297560] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-27T17:03:50.655582] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:03:50.814901] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-27T17:03:50.896867] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T17:03:51.615001] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-27T17:03:52.274739] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-27T17:03:52.351486] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-27T17:03:52.414915] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-27T17:03:53.202687] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T17:03:53.214902] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-27T17:03:53.752638] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T17:03:54.014975] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-27T17:03:54.466706] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T17:03:54.814978] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-27T17:03:55.614994] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-27T17:03:56.319260] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-27T17:03:56.414907] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-27T17:03:56.652381] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-27T17:03:56.661941] [INFO ] [REMOTE ] AEG: Full fetch complete (70640 records). [2025-10-27T17:03:56.662050] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-27T17:03:57.052672] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-27T17:03:57.052887] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-27T17:03:57.053708] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-27T17:03:57.053797] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-27T17:03:57.055364] [DEBUG] [LOCAL ] AEG: Trimmed 70640 records to 49423 (keeping 200 days of data) [2025-10-27T17:03:57.221183] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-27T17:03:57.297437] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T17:03:57.369832] [DEBUG] [LOCAL ] AEG: Primary data saved (49423 records). [2025-10-27T17:03:57.369950] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-27T17:03:57.372864] [INFO ] [MAIN ] Update Progress: 37/2366 symbols completed. AEG took 31.8s. Estimated remaining: 4h 5m 55s. Rate: 9.5 symbols/min [2025-10-27T17:03:58.014909] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-27T17:03:58.405581] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-27T17:03:58.814906] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-27T17:03:58.897940] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-27T17:03:59.614976] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-27T17:03:59.671022] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T17:04:00.415000] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-27T17:04:02.342992] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (3.53 seconds). [2025-10-27T17:04:02.354541] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-27T17:04:02.401840] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-10-27T17:04:02.412994] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-27T17:04:04.025903] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (3.61 seconds). [2025-10-27T17:04:04.035991] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-27T17:04:05.329480] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T17:04:05.338833] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-27T17:04:05.446096] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (3.09 seconds). [2025-10-27T17:04:05.457347] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-27T17:04:05.957225] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (3.54 seconds). [2025-10-27T17:04:05.968613] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-27T17:04:07.623217] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-27T17:04:07.661089] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-27T17:04:07.659798] [INFO ] [REMOTE ] AEO: Full fetch complete (77651 records). [2025-10-27T17:04:07.670960] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-27T17:04:07.671947] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-27T17:04:08.073429] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-27T17:04:08.073763] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-27T17:04:08.074511] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-27T17:04:08.074558] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-27T17:04:08.076084] [DEBUG] [LOCAL ] AEO: Trimmed 77651 records to 53563 (keeping 200 days of data) [2025-10-27T17:04:08.397013] [DEBUG] [LOCAL ] AEO: Primary data saved (53563 records). [2025-10-27T17:04:08.397320] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-27T17:04:08.397449] [INFO ] [MAIN ] Update Progress: 38/2366 symbols completed. AEO took 31.2s. Estimated remaining: 4h 10m 36s. Rate: 9.3 symbols/min [2025-10-27T17:04:08.424262] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-27T17:04:08.434334] [INFO ] [REMOTE ] AEM: Full fetch complete (77489 records). [2025-10-27T17:04:08.434461] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-27T17:04:08.825279] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-27T17:04:08.825387] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-27T17:04:08.826202] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-27T17:04:08.826365] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-27T17:04:08.828330] [DEBUG] [LOCAL ] AEM: Trimmed 77489 records to 53473 (keeping 200 days of data) [2025-10-27T17:04:09.144243] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T17:04:09.197317] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-27T17:04:09.208254] [DEBUG] [LOCAL ] AEM: Primary data saved (53473 records). [2025-10-27T17:04:09.208418] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-27T17:04:09.211062] [INFO ] [MAIN ] Update Progress: 39/2366 symbols completed. AEM took 40.1s. Estimated remaining: 4h 4m 52s. Rate: 9.5 symbols/min [2025-10-27T17:04:10.831267] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-27T17:04:10.845240] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-27T17:04:12.859638] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-27T17:04:12.868314] [INFO ] [REMOTE ] AER: Full fetch complete (69908 records). [2025-10-27T17:04:12.868424] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-27T17:04:13.264852] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-27T17:04:13.264934] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-27T17:04:13.265613] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-27T17:04:13.265691] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-27T17:04:13.267152] [DEBUG] [LOCAL ] AER: Trimmed 69908 records to 47685 (keeping 200 days of data) [2025-10-27T17:04:13.552423] [DEBUG] [LOCAL ] AER: Primary data saved (47685 records). [2025-10-27T17:04:13.552570] [INFO ] [MAIN ] AER: Full history saved. [2025-10-27T17:04:13.554168] [INFO ] [MAIN ] Update Progress: 40/2366 symbols completed. AER took 23.8s. Estimated remaining: 4h 2m 52s. Rate: 9.6 symbols/min [2025-10-27T17:04:14.150817] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:04:14.144746] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:04:14.202938] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-27T17:04:14.228361] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:04:14.260323] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-27T17:04:14.260174] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:04:14.261451] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-27T17:04:14.261736] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-27T17:04:14.264219] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-27T17:04:14.264299] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-27T17:04:14.374968] [DEBUG] [LOCAL ] AFB: Loaded 11166 existing records from primary storage. [2025-10-27T17:04:14.396251] [INFO ] [MAIN ] AFB: Loaded 11166 existing records. [2025-10-27T17:04:14.724078] [DEBUG] [LOCAL ] AESI: Loaded 50567 existing records from primary storage. [2025-10-27T17:04:14.756333] [INFO ] [MAIN ] AESI: Loaded 50567 existing records. [2025-10-27T17:04:14.877468] [DEBUG] [LOCAL ] AES: Loaded 54443 existing records from primary storage. [2025-10-27T17:04:14.971198] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:04:14.997614] [INFO ] [MAIN ] AES: Loaded 54443 existing records. [2025-10-27T17:04:15.072707] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:04:15.013054] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-27T17:04:15.124711] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-27T17:04:15.125121] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-01. [2025-10-27T17:04:15.212545] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-27T17:04:15.246459] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-27T17:04:15.386507] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:04:15.431058] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-27T17:04:15.454387] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:04:15.431234] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:04:15.465228] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-27T17:04:15.465575] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-27T17:04:15.471039] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-27T17:04:15.470812] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-01 [2025-10-27T17:04:15.481882] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-27T17:04:15.476383] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-27T17:04:15.482041] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-27T17:04:15.492758] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-27T17:04:15.492869] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:04:15.546347] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-27T17:04:15.576514] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:04:15.646709] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-27T17:04:15.713492] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-27T17:04:15.734815] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-27T17:04:15.772417] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-27T17:04:15.790794] [INFO ] [MAIN ] Update Progress: 41/2366 symbols completed. AEXA took 2.2s. Estimated remaining: 3h 58m 57s. Rate: 9.7 symbols/min [2025-10-27T17:04:16.594876] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:04:16.588519] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:04:16.610791] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-27T17:04:16.728205] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:04:16.734928] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-27T17:04:16.812441] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:04:16.820930] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-27T17:04:16.835810] [DEBUG] [LOCAL ] AFG: Loaded 32241 existing records from primary storage. [2025-10-27T17:04:16.836073] [INFO ] [MAIN ] AFG: Loaded 32241 existing records. [2025-10-27T17:04:17.025550] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:04:17.025794] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-27T17:04:17.025846] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-27T17:04:17.026024] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-27T17:04:17.026064] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-27T17:04:17.391772] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:04:17.392099] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-27T17:04:17.649024] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-27T17:04:17.651846] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-27T17:04:18.547402] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-27T17:04:18.550394] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-27T17:04:18.645060] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T17:04:18.650447] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-27T17:04:18.870065] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-27T17:04:18.880789] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-27T17:04:18.905509] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-27T17:04:18.914724] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-27T17:04:19.107691] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T17:04:19.110910] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-27T17:04:19.664820] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-27T17:04:19.668529] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-27T17:04:19.863460] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T17:04:19.870486] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-27T17:04:20.077016] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-27T17:04:20.086388] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-27T17:04:20.263247] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-27T17:04:20.266042] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-27T17:04:20.467592] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T17:04:20.477596] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-27T17:04:21.290859] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T17:04:21.298837] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-27T17:04:21.335777] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T17:04:21.475756] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-27T17:04:22.014949] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-27T17:04:22.123585] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-27T17:04:22.651224] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T17:04:22.814932] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-27T17:04:23.292250] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-27T17:04:23.614988] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-27T17:04:24.373580] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-27T17:04:24.414985] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-27T17:04:24.901208] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-27T17:04:25.003014] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T17:04:25.214996] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-27T17:04:26.014982] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-27T17:04:26.814985] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-27T17:04:26.963804] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-27T17:04:27.032892] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-27T17:04:27.575812] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-27T17:04:27.578291] [INFO ] [REMOTE ] AFB: Full fetch complete (16284 records). [2025-10-27T17:04:27.578378] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-27T17:04:27.620121] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-27T17:04:27.941289] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-27T17:04:27.941371] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-27T17:04:27.941661] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-27T17:04:27.941726] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-27T17:04:27.942259] [DEBUG] [LOCAL ] AFB: Trimmed 16284 records to 10957 (keeping 200 days of data) [2025-10-27T17:04:28.008012] [DEBUG] [LOCAL ] AFB: Primary data saved (10957 records). [2025-10-27T17:04:28.008150] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-27T17:04:28.008232] [INFO ] [MAIN ] Update Progress: 42/2366 symbols completed. AFB took 14.4s. Estimated remaining: 4h 4m 25s. Rate: 9.5 symbols/min [2025-10-27T17:04:28.179765] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:04:28.183571] [DEBUG] [LOCAL ] AFGB: Loaded 2224 existing records from primary storage. [2025-10-27T17:04:28.183779] [INFO ] [MAIN ] AFGB: Loaded 2224 existing records. [2025-10-27T17:04:28.364707] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:04:28.364909] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-27T17:04:28.364957] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-27T17:04:28.365075] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-27T17:04:28.365154] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-27T17:04:28.426837] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-27T17:04:28.748989] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:04:29.215009] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-27T17:04:29.780035] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-27T17:04:30.015009] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-27T17:04:30.162226] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-27T17:04:30.250635] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-27T17:04:30.814978] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-27T17:04:31.419893] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T17:04:31.614960] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-27T17:04:32.414925] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-27T17:04:32.778062] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-27T17:04:32.861711] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T17:04:33.214996] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-27T17:04:33.786938] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T17:04:34.014929] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-27T17:04:34.814929] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-27T17:04:34.874557] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T17:04:35.270904] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-27T17:04:35.492064] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T17:04:35.614924] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-27T17:04:36.414952] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-27T17:04:37.214948] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-27T17:04:37.283765] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T17:04:37.557614] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-27T17:04:38.014948] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-27T17:04:38.730900] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-27T17:04:38.814920] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-27T17:04:39.572391] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-27T17:04:39.614926] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-27T17:04:40.133371] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-27T17:04:40.423195] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-27T17:04:40.445142] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-27T17:04:41.214985] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-27T17:04:41.931753] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T17:04:42.014919] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-27T17:04:42.814930] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-27T17:04:43.205738] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-27T17:04:43.484706] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T17:04:43.614923] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-27T17:04:43.671550] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-27T17:04:43.687115] [INFO ] [REMOTE ] AES: Full fetch complete (77841 records). [2025-10-27T17:04:43.687345] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-27T17:04:44.079787] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-27T17:04:44.079866] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-27T17:04:44.080664] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-27T17:04:44.080731] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-27T17:04:44.082249] [DEBUG] [LOCAL ] AES: Trimmed 77841 records to 53663 (keeping 200 days of data) [2025-10-27T17:04:44.411449] [DEBUG] [LOCAL ] AES: Primary data saved (53663 records). [2025-10-27T17:04:44.411615] [INFO ] [MAIN ] AES: Full history saved. [2025-10-27T17:04:44.411740] [INFO ] [MAIN ] Update Progress: 43/2366 symbols completed. AES took 30.9s. Estimated remaining: 4h 13m 24s. Rate: 9.2 symbols/min [2025-10-27T17:04:44.423429] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-27T17:04:44.585225] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:04:44.589466] [DEBUG] [LOCAL ] AFGC: Loaded 2572 existing records from primary storage. [2025-10-27T17:04:44.589620] [INFO ] [MAIN ] AFGC: Loaded 2572 existing records. [2025-10-27T17:04:44.768766] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:04:44.769213] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-27T17:04:44.769357] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-27T17:04:44.769506] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-27T17:04:44.769545] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-27T17:04:44.924754] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T17:04:44.998816] [INFO ] [REMOTE ] AFG: Full fetch complete (46863 records). [2025-10-27T17:04:45.035758] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-27T17:04:45.218119] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-27T17:04:45.326848] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:04:45.582461] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-27T17:04:45.582542] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-27T17:04:45.583045] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-27T17:04:45.583108] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-27T17:04:45.584132] [DEBUG] [LOCAL ] AFG: Trimmed 46863 records to 31571 (keeping 200 days of data) [2025-10-27T17:04:45.675981] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-27T17:04:45.785054] [DEBUG] [LOCAL ] AFG: Primary data saved (31571 records). [2025-10-27T17:04:45.785202] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-27T17:04:45.785284] [INFO ] [MAIN ] Update Progress: 44/2366 symbols completed. AFG took 30.0s. Estimated remaining: 4h 8m 45s. Rate: 9.3 symbols/min [2025-10-27T17:04:45.956126] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:04:45.959415] [DEBUG] [LOCAL ] AFGD: Loaded 1763 existing records from primary storage. [2025-10-27T17:04:45.959551] [INFO ] [MAIN ] AFGD: Loaded 1763 existing records. [2025-10-27T17:04:46.020136] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-27T17:04:46.147687] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:04:46.148131] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-27T17:04:46.148207] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-27T17:04:46.148496] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-27T17:04:46.148566] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-27T17:04:46.464450] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-27T17:04:46.534607] [INFO ] [REMOTE ] AESI: Full fetch complete (71871 records). [2025-10-27T17:04:46.552557] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-27T17:04:46.556492] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:04:46.821294] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-27T17:04:46.875417] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-27T17:04:47.001861] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-27T17:04:47.001956] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-27T17:04:47.002634] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-27T17:04:47.002722] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-27T17:04:47.004206] [DEBUG] [LOCAL ] AESI: Trimmed 71871 records to 49777 (keeping 200 days of data) [2025-10-27T17:04:47.236535] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-27T17:04:47.309509] [DEBUG] [LOCAL ] AESI: Primary data saved (49777 records). [2025-10-27T17:04:47.309680] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-27T17:04:47.309784] [INFO ] [MAIN ] Update Progress: 45/2366 symbols completed. AESI took 33.7s. Estimated remaining: 4h 4m 26s. Rate: 9.5 symbols/min [2025-10-27T17:04:47.479890] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:04:47.484265] [DEBUG] [LOCAL ] AFGE: Loaded 2255 existing records from primary storage. [2025-10-27T17:04:47.484405] [INFO ] [MAIN ] AFGE: Loaded 2255 existing records. [2025-10-27T17:04:47.623175] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-27T17:04:47.665014] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:04:47.665223] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-27T17:04:47.665271] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-27T17:04:47.665390] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-27T17:04:47.665428] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-27T17:04:48.009394] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:04:48.094788] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-27T17:04:48.414942] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-27T17:04:48.934298] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-27T17:04:49.214975] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-27T17:04:49.517272] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-27T17:04:50.014952] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-27T17:04:50.313831] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-27T17:04:50.814941] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-27T17:04:51.340939] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-27T17:04:51.614999] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-27T17:04:52.197239] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-27T17:04:52.414990] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-27T17:04:52.722123] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-27T17:04:53.214952] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-27T17:04:54.015002] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-27T17:04:54.174566] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-27T17:04:54.294206] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-27T17:04:54.814937] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-27T17:04:55.327047] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-27T17:04:55.614946] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-27T17:04:56.172919] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-27T17:04:56.414940] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-27T17:04:56.844122] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-27T17:04:57.214930] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-27T17:04:57.760707] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-27T17:04:58.014933] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-27T17:04:58.322596] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-27T17:04:58.814941] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-27T17:04:59.279612] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-27T17:04:59.614935] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-27T17:05:00.003992] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-27T17:05:00.414973] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-27T17:05:01.214948] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-27T17:05:02.014983] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-27T17:05:02.814942] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-27T17:05:03.717311] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (3.30 seconds). [2025-10-27T17:05:03.718619] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-27T17:05:03.784474] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-27T17:05:04.414943] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-27T17:05:04.504637] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T17:05:04.505451] [INFO ] [REMOTE ] AFGB: Full fetch complete (3402 records). [2025-10-27T17:05:04.505519] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-27T17:05:04.505913] [FATAL] [VALIDATOR ] AFGB: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:05:04.505994] [FATAL] [MAIN ] AFGB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:05:04.506036] [WARN ] [MAIN ] AFGB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:05:04.506074] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-27T17:05:04.506146] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-27T17:05:04.506228] [INFO ] [LOCAL ] AFGB: Starting deletion of derivative data. [2025-10-27T17:05:04.506362] [DEBUG] [LOCAL ] AFGB: Deleted derivative data file. [2025-10-27T17:05:04.506444] [INFO ] [MAIN ] Update Progress: 46/2366 symbols completed. AFGB took 36.5s. Estimated remaining: 4h 13m 28s. Rate: 9.2 symbols/min [2025-10-27T17:05:04.614526] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-27T17:05:04.678775] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:05:04.727739] [DEBUG] [LOCAL ] AFL: Loaded 53948 existing records from primary storage. [2025-10-27T17:05:04.728104] [INFO ] [MAIN ] AFL: Loaded 53948 existing records. [2025-10-27T17:05:04.907803] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:05:04.908010] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-27T17:05:04.908058] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-27T17:05:04.908328] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-27T17:05:04.908393] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-27T17:05:05.089918] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-27T17:05:05.229852] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-27T17:05:05.267467] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:05:05.625264] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T17:05:05.626085] [INFO ] [REMOTE ] AFGE: Full fetch complete (3287 records). [2025-10-27T17:05:05.626153] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-27T17:05:05.906786] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-27T17:05:06.005308] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-27T17:05:06.005393] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-27T17:05:06.005543] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-27T17:05:06.005609] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-27T17:05:06.006028] [DEBUG] [LOCAL ] AFGE: Trimmed 3287 records to 2214 (keeping 200 days of data) [2025-10-27T17:05:06.016138] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-27T17:05:06.019593] [DEBUG] [LOCAL ] AFGE: Primary data saved (2214 records). [2025-10-27T17:05:06.020497] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-27T17:05:06.020578] [INFO ] [MAIN ] Update Progress: 47/2366 symbols completed. AFGE took 18.7s. Estimated remaining: 4h 9m 13s. Rate: 9.3 symbols/min [2025-10-27T17:05:06.215679] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:05:06.264635] [DEBUG] [LOCAL ] AG: Loaded 54423 existing records from primary storage. [2025-10-27T17:05:06.264962] [INFO ] [MAIN ] AG: Loaded 54423 existing records. [2025-10-27T17:05:06.440192] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:05:06.440393] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-27T17:05:06.440452] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-27T17:05:06.440678] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-27T17:05:06.440743] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-27T17:05:06.519447] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-27T17:05:06.806566] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:05:06.814902] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-27T17:05:07.615019] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-27T17:05:08.414969] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-27T17:05:08.578808] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-27T17:05:08.868472] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-27T17:05:09.214912] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-27T17:05:09.298374] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T17:05:09.678191] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-27T17:05:10.014931] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-27T17:05:10.814912] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-27T17:05:10.887309] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T17:05:10.888136] [INFO ] [REMOTE ] AFGD: Full fetch complete (2677 records). [2025-10-27T17:05:10.888207] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-27T17:05:10.888551] [FATAL] [VALIDATOR ] AFGD: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:05:10.888634] [FATAL] [MAIN ] AFGD: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:05:10.888758] [WARN ] [MAIN ] AFGD: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:05:10.888842] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-27T17:05:10.888923] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-10-27T17:05:10.888973] [INFO ] [LOCAL ] AFGD: Starting deletion of derivative data. [2025-10-27T17:05:10.889111] [DEBUG] [LOCAL ] AFGD: Deleted derivative data file. [2025-10-27T17:05:10.889206] [INFO ] [MAIN ] Update Progress: 48/2366 symbols completed. AFGD took 25.1s. Estimated remaining: 4h 7m 50s. Rate: 9.4 symbols/min [2025-10-27T17:05:11.055179] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:05:11.094202] [DEBUG] [LOCAL ] AGCO: Loaded 42682 existing records from primary storage. [2025-10-27T17:05:11.094501] [INFO ] [MAIN ] AGCO: Loaded 42682 existing records. [2025-10-27T17:05:11.269531] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:05:11.269764] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-27T17:05:11.269817] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-27T17:05:11.269987] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-27T17:05:11.270031] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-27T17:05:11.626713] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:05:11.620959] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-27T17:05:12.399712] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-27T17:05:12.414914] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-27T17:05:13.214994] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-27T17:05:13.496444] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-27T17:05:13.770565] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T17:05:14.014928] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-27T17:05:14.050957] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-27T17:05:14.814934] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-27T17:05:15.614949] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-27T17:05:16.296827] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-27T17:05:16.414960] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-27T17:05:16.799383] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-27T17:05:17.213492] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-27T17:05:17.223772] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-27T17:05:17.704438] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-27T17:05:17.855165] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T17:05:18.015069] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-27T17:05:18.815023] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-27T17:05:19.614947] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-27T17:05:20.066702] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-27T17:05:20.175559] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-27T17:05:20.235901] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-27T17:05:20.414981] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-27T17:05:20.887526] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-27T17:05:20.888501] [INFO ] [REMOTE ] AFGC: Full fetch complete (3571 records). [2025-10-27T17:05:20.888573] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-27T17:05:21.220516] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-27T17:05:21.244764] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-27T17:05:21.244836] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-27T17:05:21.244965] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-27T17:05:21.245004] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-27T17:05:21.245376] [DEBUG] [LOCAL ] AFGC: Trimmed 3571 records to 2550 (keeping 200 days of data) [2025-10-27T17:05:21.268352] [DEBUG] [LOCAL ] AFGC: Primary data saved (2550 records). [2025-10-27T17:05:21.268447] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-27T17:05:21.268527] [INFO ] [MAIN ] Update Progress: 49/2366 symbols completed. AFGC took 36.9s. Estimated remaining: 4h 10m 51s. Rate: 9.2 symbols/min [2025-10-27T17:05:21.440719] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:05:21.459930] [DEBUG] [LOCAL ] AGD: Loaded 19455 existing records from primary storage. [2025-10-27T17:05:21.460199] [INFO ] [MAIN ] AGD: Loaded 19455 existing records. [2025-10-27T17:05:21.654752] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:05:21.655031] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-27T17:05:21.655106] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-27T17:05:21.655344] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-27T17:05:21.655415] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-27T17:05:22.020273] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-27T17:05:22.102226] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:05:22.809161] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T17:05:22.819290] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-27T17:05:23.614927] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-27T17:05:23.934915] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-27T17:05:24.414931] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-27T17:05:24.901526] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-27T17:05:25.215005] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-27T17:05:25.573040] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-27T17:05:25.676170] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T17:05:26.015000] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-27T17:05:26.815089] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-27T17:05:27.615019] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-27T17:05:27.788396] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-27T17:05:28.013823] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-27T17:05:28.131633] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T17:05:28.237574] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T17:05:28.414996] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-27T17:05:29.214945] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-27T17:05:29.797940] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T17:05:30.014932] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-27T17:05:30.814939] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-27T17:05:31.231103] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-27T17:05:31.620174] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-27T17:05:31.631869] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T17:05:32.415008] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-27T17:05:32.830213] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-27T17:05:33.214944] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-27T17:05:33.257179] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-27T17:05:33.267276] [INFO ] [REMOTE ] AFL: Full fetch complete (77068 records). [2025-10-27T17:05:33.267394] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-27T17:05:33.695111] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-27T17:05:33.695226] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-27T17:05:33.696171] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-27T17:05:33.696257] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-27T17:05:33.697815] [DEBUG] [LOCAL ] AFL: Trimmed 77068 records to 53160 (keeping 200 days of data) [2025-10-27T17:05:33.972536] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T17:05:34.017757] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-27T17:05:34.064573] [DEBUG] [LOCAL ] AFL: Primary data saved (53160 records). [2025-10-27T17:05:34.064764] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-27T17:05:34.064855] [INFO ] [MAIN ] Update Progress: 50/2366 symbols completed. AFL took 29.6s. Estimated remaining: 4h 15m 36s. Rate: 9.1 symbols/min [2025-10-27T17:05:34.232781] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:05:34.280906] [DEBUG] [LOCAL ] AGI: Loaded 54201 existing records from primary storage. [2025-10-27T17:05:34.281313] [INFO ] [MAIN ] AGI: Loaded 54201 existing records. [2025-10-27T17:05:34.479396] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:05:34.479591] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-27T17:05:34.479637] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-27T17:05:34.479850] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-27T17:05:34.479896] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-27T17:05:34.841211] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:05:34.834975] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-27T17:05:34.850579] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-27T17:05:34.926094] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-27T17:05:35.615032] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-27T17:05:36.267232] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T17:05:36.414929] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-27T17:05:37.214942] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-27T17:05:37.312528] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-27T17:05:37.493778] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-27T17:05:38.014957] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-27T17:05:38.494280] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-27T17:05:38.814936] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-27T17:05:39.614956] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-27T17:05:40.287718] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T17:05:40.414940] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-27T17:05:41.008948] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T17:05:41.079443] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (3.06 seconds). [2025-10-27T17:05:41.089582] [INFO ] [REMOTE ] AG: Full fetch complete (77792 records). [2025-10-27T17:05:41.089731] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-27T17:05:41.227734] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-27T17:05:41.500700] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-27T17:05:41.500782] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-27T17:05:41.501500] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-27T17:05:41.501562] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-27T17:05:41.502972] [DEBUG] [LOCAL ] AG: Trimmed 77792 records to 53643 (keeping 200 days of data) [2025-10-27T17:05:41.823693] [DEBUG] [LOCAL ] AG: Primary data saved (53643 records). [2025-10-27T17:05:41.823872] [INFO ] [MAIN ] AG: Full history saved. [2025-10-27T17:05:41.824906] [INFO ] [MAIN ] Update Progress: 51/2366 symbols completed. AG took 35.8s. Estimated remaining: 4h 16m 21s. Rate: 9.0 symbols/min [2025-10-27T17:05:42.000999] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:05:42.014945] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-27T17:05:42.052904] [DEBUG] [LOCAL ] AGL: Loaded 53365 existing records from primary storage. [2025-10-27T17:05:42.053329] [INFO ] [MAIN ] AGL: Loaded 53365 existing records. [2025-10-27T17:05:42.197052] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-27T17:05:42.246480] [INFO ] [REMOTE ] AGCO: Full fetch complete (61497 records). [2025-10-27T17:05:42.263057] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-27T17:05:42.269127] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:05:42.269416] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-27T17:05:42.269479] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-27T17:05:42.269828] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-27T17:05:42.269905] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-27T17:05:42.976373] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:05:43.026313] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-27T17:05:43.074873] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-27T17:05:43.075054] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-27T17:05:43.075816] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-27T17:05:43.075921] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-27T17:05:43.103724] [DEBUG] [LOCAL ] AGCO: Trimmed 61497 records to 41854 (keeping 200 days of data) [2025-10-27T17:05:43.106851] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-27T17:05:43.367388] [DEBUG] [LOCAL ] AGCO: Primary data saved (41854 records). [2025-10-27T17:05:43.367536] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-27T17:05:43.368186] [INFO ] [MAIN ] Update Progress: 52/2366 symbols completed. AGCO took 32.5s. Estimated remaining: 4h 12m 28s. Rate: 9.2 symbols/min [2025-10-27T17:05:43.511997] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T17:05:43.562305] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:05:43.574342] [DEBUG] [LOCAL ] AGM: Loaded 10702 existing records from primary storage. [2025-10-27T17:05:43.574565] [INFO ] [MAIN ] AGM: Loaded 10702 existing records. [2025-10-27T17:05:43.620171] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-27T17:05:43.774020] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:05:43.774223] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-27T17:05:43.774272] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-27T17:05:43.774436] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-27T17:05:43.774492] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-27T17:05:44.151350] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:05:44.414939] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-27T17:05:44.824582] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-27T17:05:45.062262] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-27T17:05:45.227176] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-27T17:05:45.233014] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T17:05:45.962323] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-27T17:05:46.014969] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-27T17:05:46.774183] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T17:05:46.814955] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-27T17:05:47.614979] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-27T17:05:48.394519] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-27T17:05:48.414914] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-27T17:05:49.214910] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-27T17:05:49.550688] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-27T17:05:49.633734] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-27T17:05:50.014929] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-27T17:05:50.806237] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T17:05:50.815372] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-27T17:05:51.511311] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-27T17:05:51.614912] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-27T17:05:52.414951] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-27T17:05:52.632719] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-27T17:05:52.969525] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-27T17:05:53.174431] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-27T17:05:53.214971] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-27T17:05:54.014989] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-27T17:05:54.654637] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T17:05:54.814919] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-27T17:05:55.615027] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-27T17:05:55.726151] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T17:05:56.219527] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-27T17:05:56.231676] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-27T17:05:56.414958] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-27T17:05:57.214993] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-27T17:05:57.823785] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T17:05:58.014984] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-27T17:05:58.375387] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T17:05:58.815000] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-27T17:05:59.614958] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-27T17:05:59.824148] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-27T17:06:00.414919] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-27T17:06:00.541333] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T17:06:00.548158] [INFO ] [REMOTE ] AGD: Full fetch complete (26515 records). [2025-10-27T17:06:00.548285] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-27T17:06:00.936290] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-27T17:06:00.936368] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-27T17:06:00.936714] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-27T17:06:00.936777] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-27T17:06:00.937486] [DEBUG] [LOCAL ] AGD: Trimmed 26515 records to 19100 (keeping 200 days of data) [2025-10-27T17:06:01.048834] [DEBUG] [LOCAL ] AGD: Primary data saved (19100 records). [2025-10-27T17:06:01.048977] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-27T17:06:01.049061] [INFO ] [MAIN ] Update Progress: 53/2366 symbols completed. AGD took 39.8s. Estimated remaining: 4h 20m 27s. Rate: 8.9 symbols/min [2025-10-27T17:06:01.217001] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:06:01.215454] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-27T17:06:01.244029] [DEBUG] [LOCAL ] AGO: Loaded 28041 existing records from primary storage. [2025-10-27T17:06:01.244305] [INFO ] [MAIN ] AGO: Loaded 28041 existing records. [2025-10-27T17:06:01.428966] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:06:01.429292] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-27T17:06:01.429341] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-27T17:06:01.429544] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-27T17:06:01.429600] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-27T17:06:01.792685] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:06:01.825841] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-27T17:06:02.014919] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-27T17:06:02.815004] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-27T17:06:03.204031] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-27T17:06:03.614942] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-27T17:06:04.194981] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T17:06:04.414914] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-27T17:06:04.516797] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-27T17:06:04.749059] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-27T17:06:05.039534] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (4.62 seconds). [2025-10-27T17:06:05.049262] [INFO ] [REMOTE ] AGI: Full fetch complete (76961 records). [2025-10-27T17:06:05.049391] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-27T17:06:05.050212] [FATAL] [VALIDATOR ] AGI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:06:05.050305] [FATAL] [MAIN ] AGI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:06:05.050348] [WARN ] [MAIN ] AGI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:06:05.050386] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-27T17:06:05.050457] [DEBUG] [LOCAL ] AGI: No primary data file found to delete. [2025-10-27T17:06:05.050529] [INFO ] [LOCAL ] AGI: Starting deletion of derivative data. [2025-10-27T17:06:05.050723] [DEBUG] [LOCAL ] AGI: Deleted derivative data file. [2025-10-27T17:06:05.052509] [INFO ] [MAIN ] Update Progress: 54/2366 symbols completed. AGI took 31.0s. Estimated remaining: 4h 18m 23s. Rate: 8.9 symbols/min [2025-10-27T17:06:05.226666] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-27T17:06:05.229224] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:06:05.267482] [DEBUG] [LOCAL ] AGRO: Loaded 32912 existing records from primary storage. [2025-10-27T17:06:05.267785] [INFO ] [MAIN ] AGRO: Loaded 32912 existing records. [2025-10-27T17:06:05.445594] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:06:05.445814] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-27T17:06:05.445861] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-27T17:06:05.446202] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-27T17:06:05.446280] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-27T17:06:05.845624] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:06:05.856791] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-27T17:06:06.007862] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T17:06:06.014910] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-27T17:06:06.814926] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-27T17:06:06.990782] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T17:06:06.993312] [INFO ] [REMOTE ] AGM: Full fetch complete (13289 records). [2025-10-27T17:06:06.993382] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-27T17:06:07.350548] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-27T17:06:07.350861] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-27T17:06:07.351100] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-27T17:06:07.351141] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-27T17:06:07.351597] [DEBUG] [LOCAL ] AGM: Trimmed 13289 records to 10480 (keeping 200 days of data) [2025-10-27T17:06:07.416692] [DEBUG] [LOCAL ] AGM: Primary data saved (10480 records). [2025-10-27T17:06:07.416820] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-27T17:06:07.416900] [INFO ] [MAIN ] Update Progress: 55/2366 symbols completed. AGM took 24.0s. Estimated remaining: 4h 15m 13s. Rate: 9.1 symbols/min [2025-10-27T17:06:07.584119] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:06:07.615961] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-27T17:06:07.617999] [DEBUG] [LOCAL ] AGX: Loaded 33012 existing records from primary storage. [2025-10-27T17:06:07.618291] [INFO ] [MAIN ] AGX: Loaded 33012 existing records. [2025-10-27T17:06:07.803327] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:06:07.803528] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-27T17:06:07.803573] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-27T17:06:07.804073] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-27T17:06:07.804132] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-27T17:06:08.185677] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:06:08.212863] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T17:06:08.414950] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-27T17:06:08.871584] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T17:06:09.214953] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-27T17:06:10.015026] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-27T17:06:10.445247] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T17:06:10.699046] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-27T17:06:10.814953] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-27T17:06:11.223359] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T17:06:11.614989] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-27T17:06:12.272163] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T17:06:12.414949] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-27T17:06:13.013303] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T17:06:13.214954] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-27T17:06:13.738202] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T17:06:14.014970] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-27T17:06:14.820868] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-27T17:06:14.834921] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T17:06:15.430449] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T17:06:15.614930] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-27T17:06:16.120110] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T17:06:16.414945] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-27T17:06:17.093398] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-27T17:06:17.149240] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T17:06:17.214950] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-27T17:06:18.014936] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-27T17:06:18.068493] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T17:06:18.814930] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-27T17:06:19.055260] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-27T17:06:19.614951] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-27T17:06:20.420396] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-27T17:06:20.440877] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T17:06:20.702898] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-27T17:06:21.215034] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-27T17:06:21.546896] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T17:06:22.014957] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-27T17:06:22.814919] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-27T17:06:23.168093] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-27T17:06:23.379193] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T17:06:23.614948] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-27T17:06:23.691461] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-27T17:06:24.415003] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-27T17:06:25.214974] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-27T17:06:25.264211] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T17:06:25.320245] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T17:06:26.015002] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-27T17:06:26.526219] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T17:06:26.815003] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-27T17:06:27.181009] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T17:06:27.614947] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-27T17:06:28.415021] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-27T17:06:28.540973] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T17:06:28.550612] [INFO ] [REMOTE ] AGL: Full fetch complete (75614 records). [2025-10-27T17:06:28.550803] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-27T17:06:28.551563] [FATAL] [VALIDATOR ] AGL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:06:28.551670] [FATAL] [MAIN ] AGL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:06:28.551728] [WARN ] [MAIN ] AGL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:06:28.551769] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-27T17:06:28.551825] [DEBUG] [LOCAL ] AGL: No primary data file found to delete. [2025-10-27T17:06:28.551869] [INFO ] [LOCAL ] AGL: Starting deletion of derivative data. [2025-10-27T17:06:28.551996] [DEBUG] [LOCAL ] AGL: Deleted derivative data file. [2025-10-27T17:06:28.552581] [INFO ] [MAIN ] Update Progress: 56/2366 symbols completed. AGL took 46.7s. Estimated remaining: 4h 25m 5s. Rate: 8.7 symbols/min [2025-10-27T17:06:28.719146] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:06:28.757448] [DEBUG] [LOCAL ] AHH: Loaded 40649 existing records from primary storage. [2025-10-27T17:06:28.757797] [INFO ] [MAIN ] AHH: Loaded 40649 existing records. [2025-10-27T17:06:28.933330] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:06:28.933517] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-27T17:06:28.933563] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-27T17:06:28.933758] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-27T17:06:28.933814] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-27T17:06:29.219037] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-27T17:06:29.292893] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:06:29.313534] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-27T17:06:29.667586] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T17:06:30.014990] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-27T17:06:30.814954] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-27T17:06:31.022132] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-27T17:06:31.540578] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T17:06:31.545957] [INFO ] [REMOTE ] AGX: Full fetch complete (48565 records). [2025-10-27T17:06:31.546046] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-27T17:06:31.546617] [FATAL] [VALIDATOR ] AGX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:06:31.546735] [FATAL] [MAIN ] AGX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:06:31.546815] [WARN ] [MAIN ] AGX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:06:31.546906] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-27T17:06:31.546987] [DEBUG] [LOCAL ] AGX: No primary data file found to delete. [2025-10-27T17:06:31.547025] [INFO ] [LOCAL ] AGX: Starting deletion of derivative data. [2025-10-27T17:06:31.547142] [DEBUG] [LOCAL ] AGX: Deleted derivative data file. [2025-10-27T17:06:31.547211] [INFO ] [MAIN ] Update Progress: 57/2366 symbols completed. AGX took 24.1s. Estimated remaining: 4h 22m 21s. Rate: 8.8 symbols/min [2025-10-27T17:06:31.620317] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-27T17:06:31.715551] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:06:31.715734] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-27T17:06:31.715782] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-27T17:06:31.715915] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-27T17:06:31.715972] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-27T17:06:31.716017] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-27T17:06:31.716051] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-27T17:06:32.094935] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:06:32.098074] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-27T17:06:32.414937] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-27T17:06:33.209012] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-27T17:06:33.217792] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-10-27T17:06:33.391534] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T17:06:33.396920] [INFO ] [REMOTE ] AGO: Full fetch complete (39694 records). [2025-10-27T17:06:33.397004] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-27T17:06:33.463966] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:06:33.480904] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-10-27T17:06:33.502159] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:06:33.502360] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-27T17:06:33.502750] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:06:33.508237] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-27T17:06:33.518593] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-27T17:06:33.523927] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-27T17:06:33.541148] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-27T17:06:33.557856] [INFO ] [MAIN ] Update Progress: 58/2366 symbols completed. AHL took 2.0s. Estimated remaining: 4h 19m 3s. Rate: 8.9 symbols/min [2025-10-27T17:06:33.921142] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:06:33.951727] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-27T17:06:33.951806] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-27T17:06:33.952225] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-27T17:06:33.952264] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-27T17:06:33.953249] [DEBUG] [LOCAL ] AGO: Trimmed 39694 records to 27300 (keeping 200 days of data) [2025-10-27T17:06:34.039692] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-27T17:06:34.130110] [DEBUG] [LOCAL ] AGO: Primary data saved (27300 records). [2025-10-27T17:06:34.143360] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-27T17:06:34.144379] [INFO ] [MAIN ] Update Progress: 59/2366 symbols completed. AGO took 33.1s. Estimated remaining: 4h 14m 56s. Rate: 9.0 symbols/min [2025-10-27T17:06:34.216980] [DEBUG] [LOCAL ] AHR: Loaded 49637 existing records from primary storage. [2025-10-27T17:06:34.239393] [INFO ] [MAIN ] AHR: Loaded 49637 existing records. [2025-10-27T17:06:34.433838] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:06:34.528429] [DEBUG] [LOCAL ] AHT: Loaded 6490 existing records from primary storage. [2025-10-27T17:06:34.525162] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:06:34.528695] [INFO ] [MAIN ] AHT: Loaded 6490 existing records. [2025-10-27T17:06:34.597432] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-27T17:06:34.609945] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-27T17:06:34.638693] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-27T17:06:34.649320] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-27T17:06:34.803789] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:06:34.822840] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-27T17:06:34.815131] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-27T17:06:34.826098] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-27T17:06:34.827245] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-27T17:06:34.827617] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-27T17:06:35.389679] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:06:35.466895] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:06:35.517200] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T17:06:35.614904] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-27T17:06:35.751149] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-27T17:06:35.757150] [INFO ] [REMOTE ] AGRO: Full fetch complete (48705 records). [2025-10-27T17:06:35.757241] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-27T17:06:36.122222] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-27T17:06:36.122304] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-27T17:06:36.122841] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-27T17:06:36.122903] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-27T17:06:36.123931] [DEBUG] [LOCAL ] AGRO: Trimmed 48705 records to 32070 (keeping 200 days of data) [2025-10-27T17:06:36.318808] [DEBUG] [LOCAL ] AGRO: Primary data saved (32070 records). [2025-10-27T17:06:36.318948] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-27T17:06:36.319056] [INFO ] [MAIN ] Update Progress: 60/2366 symbols completed. AGRO took 31.3s. Estimated remaining: 4h 11m 58s. Rate: 9.2 symbols/min [2025-10-27T17:06:36.416723] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-27T17:06:36.487302] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:06:36.539699] [DEBUG] [LOCAL ] AI: Loaded 54544 existing records from primary storage. [2025-10-27T17:06:36.540030] [INFO ] [MAIN ] AI: Loaded 54544 existing records. [2025-10-27T17:06:36.719543] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:06:36.719810] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-27T17:06:36.719861] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-27T17:06:36.720128] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-27T17:06:36.720166] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-27T17:06:37.081922] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:06:37.109014] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T17:06:37.214924] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-27T17:06:37.560443] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T17:06:38.015032] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-27T17:06:38.814944] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-27T17:06:39.095563] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-27T17:06:39.614994] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-27T17:06:40.212378] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-27T17:06:40.323618] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T17:06:40.414939] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-27T17:06:41.214966] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-27T17:06:41.273586] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-27T17:06:41.848565] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T17:06:41.972858] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T17:06:42.014953] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-27T17:06:42.814959] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-27T17:06:43.548274] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-27T17:06:43.614936] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-27T17:06:44.415056] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-27T17:06:44.687635] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T17:06:45.003907] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-27T17:06:45.214924] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-27T17:06:45.472383] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-10-27T17:06:45.700008] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-27T17:06:46.014983] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-27T17:06:46.814977] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-27T17:06:47.150952] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T17:06:47.614992] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-27T17:06:48.180826] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-27T17:06:48.414942] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-27T17:06:49.214927] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-27T17:06:49.369340] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-27T17:06:49.622923] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T17:06:50.014993] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-27T17:06:50.239780] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-27T17:06:50.814988] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-27T17:06:51.603018] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-27T17:06:51.614895] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-27T17:06:52.414973] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-27T17:06:52.743759] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T17:06:53.152755] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (3.14 seconds). [2025-10-27T17:06:53.214898] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-27T17:06:54.015022] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-27T17:06:54.163797] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T17:06:54.171187] [INFO ] [REMOTE ] AHH: Full fetch complete (59333 records). [2025-10-27T17:06:54.171317] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-27T17:06:54.547775] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-27T17:06:54.547854] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-27T17:06:54.548473] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-27T17:06:54.548521] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-27T17:06:54.549728] [DEBUG] [LOCAL ] AHH: Trimmed 59333 records to 39774 (keeping 200 days of data) [2025-10-27T17:06:54.787741] [DEBUG] [LOCAL ] AHH: Primary data saved (39774 records). [2025-10-27T17:06:54.787890] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-27T17:06:54.788866] [INFO ] [MAIN ] Update Progress: 61/2366 symbols completed. AHH took 26.2s. Estimated remaining: 4h 19m 21s. Rate: 8.9 symbols/min [2025-10-27T17:06:54.820773] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-27T17:06:54.984417] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:06:55.036284] [DEBUG] [LOCAL ] AIG: Loaded 54234 existing records from primary storage. [2025-10-27T17:06:55.036583] [INFO ] [MAIN ] AIG: Loaded 54234 existing records. [2025-10-27T17:06:55.247997] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:06:55.248428] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-27T17:06:55.248571] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-27T17:06:55.249018] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-27T17:06:55.249155] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-27T17:06:55.550489] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-27T17:06:55.634272] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T17:06:55.669225] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-27T17:06:55.701962] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:06:56.095699] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-27T17:06:56.414976] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-27T17:06:57.215030] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-27T17:06:57.869607] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-27T17:06:57.946711] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T17:06:58.014916] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-27T17:06:58.459967] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T17:06:58.814955] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-27T17:06:59.508992] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-27T17:06:59.614911] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-27T17:06:59.864136] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-27T17:07:00.308448] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-27T17:07:00.415005] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-27T17:07:01.214951] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-27T17:07:02.014947] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-27T17:07:02.549296] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-27T17:07:02.551540] [INFO ] [REMOTE ] AHT: Full fetch complete (9033 records). [2025-10-27T17:07:02.551630] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-27T17:07:02.820227] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-27T17:07:03.041797] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-27T17:07:03.041949] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-27T17:07:03.042272] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-27T17:07:03.042328] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-27T17:07:03.043506] [DEBUG] [LOCAL ] AHT: Trimmed 9033 records to 6347 (keeping 200 days of data) [2025-10-27T17:07:03.091991] [DEBUG] [LOCAL ] AHT: Primary data saved (6347 records). [2025-10-27T17:07:03.092193] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-27T17:07:03.092297] [INFO ] [MAIN ] Update Progress: 62/2366 symbols completed. AHT took 28.9s. Estimated remaining: 4h 20m 12s. Rate: 8.9 symbols/min [2025-10-27T17:07:03.395534] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:07:03.395834] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-27T17:07:03.395895] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-27T17:07:03.396034] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-27T17:07:03.396079] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-27T17:07:03.396122] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-27T17:07:03.396157] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-27T17:07:03.873307] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:07:03.874017] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-10-27T17:07:03.929098] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-10-27T17:07:04.119800] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:07:04.120156] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-10-27T17:07:04.120248] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:07:04.120295] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-27T17:07:04.120355] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:07:04.120427] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-27T17:07:04.120492] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-27T17:07:04.120529] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-27T17:07:04.120568] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-27T17:07:04.120613] [INFO ] [MAIN ] Update Progress: 63/2366 symbols completed. AII took 1.0s. Estimated remaining: 4h 16m 35s. Rate: 9.0 symbols/min [2025-10-27T17:07:04.298635] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:07:04.319597] [DEBUG] [LOCAL ] AIN: Loaded 24638 existing records from primary storage. [2025-10-27T17:07:04.319877] [INFO ] [MAIN ] AIN: Loaded 24638 existing records. [2025-10-27T17:07:04.416123] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-27T17:07:04.537794] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-27T17:07:04.558930] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:07:04.575690] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-27T17:07:04.575781] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-27T17:07:04.576057] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-27T17:07:04.576121] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-27T17:07:04.932815] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:07:05.214975] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-27T17:07:05.323210] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-27T17:07:05.862589] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T17:07:06.014938] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-27T17:07:06.814934] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-27T17:07:07.513752] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-27T17:07:07.610275] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T17:07:07.621937] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-27T17:07:07.914845] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-27T17:07:08.414935] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-27T17:07:09.214998] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-27T17:07:09.747854] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T17:07:10.020031] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-27T17:07:10.033586] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-27T17:07:10.043808] [INFO ] [REMOTE ] AI: Full fetch complete (77915 records). [2025-10-27T17:07:10.043933] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-27T17:07:10.430612] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-27T17:07:10.430733] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-27T17:07:10.431579] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-27T17:07:10.431768] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-27T17:07:10.433265] [DEBUG] [LOCAL ] AI: Trimmed 77915 records to 53764 (keeping 200 days of data) [2025-10-27T17:07:10.648396] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T17:07:10.760625] [DEBUG] [LOCAL ] AI: Primary data saved (53764 records). [2025-10-27T17:07:10.760807] [INFO ] [MAIN ] AI: Full history saved. [2025-10-27T17:07:10.763309] [INFO ] [MAIN ] Update Progress: 64/2366 symbols completed. AI took 34.4s. Estimated remaining: 4h 16m 27s. Rate: 9.0 symbols/min [2025-10-27T17:07:10.820075] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-27T17:07:10.940106] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:07:10.955812] [DEBUG] [LOCAL ] AIO: Loaded 13183 existing records from primary storage. [2025-10-27T17:07:10.956044] [INFO ] [MAIN ] AIO: Loaded 13183 existing records. [2025-10-27T17:07:11.137404] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:07:11.137623] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-27T17:07:11.137711] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-27T17:07:11.137882] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-27T17:07:11.137921] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-27T17:07:11.514502] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:07:11.615366] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-27T17:07:11.616837] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-27T17:07:12.391912] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-27T17:07:12.414902] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-27T17:07:12.821503] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T17:07:13.214961] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-27T17:07:14.015042] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-27T17:07:14.241461] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-27T17:07:14.585390] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-27T17:07:14.594804] [INFO ] [REMOTE ] AHR: Full fetch complete (70486 records). [2025-10-27T17:07:14.594947] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-27T17:07:14.595717] [FATAL] [VALIDATOR ] AHR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:07:14.595815] [FATAL] [MAIN ] AHR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:07:14.595856] [WARN ] [MAIN ] AHR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:07:14.595893] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-27T17:07:14.595949] [DEBUG] [LOCAL ] AHR: No primary data file found to delete. [2025-10-27T17:07:14.595984] [INFO ] [LOCAL ] AHR: Starting deletion of derivative data. [2025-10-27T17:07:14.596126] [DEBUG] [LOCAL ] AHR: Deleted derivative data file. [2025-10-27T17:07:14.596196] [INFO ] [MAIN ] Update Progress: 65/2366 symbols completed. AHR took 41.0s. Estimated remaining: 4h 14m 40s. Rate: 9.0 symbols/min [2025-10-27T17:07:14.762628] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:07:14.789784] [DEBUG] [LOCAL ] AIR: Loaded 29010 existing records from primary storage. [2025-10-27T17:07:14.790019] [INFO ] [MAIN ] AIR: Loaded 29010 existing records. [2025-10-27T17:07:14.820380] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-27T17:07:14.965952] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:07:14.966149] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-27T17:07:14.966195] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-27T17:07:14.966368] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-27T17:07:14.966405] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-27T17:07:15.316257] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:07:15.614991] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-27T17:07:15.766601] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T17:07:16.046216] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-27T17:07:16.414953] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-27T17:07:16.551117] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T17:07:17.214959] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-27T17:07:18.014998] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-27T17:07:18.118895] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T17:07:18.227974] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-27T17:07:18.576898] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T17:07:18.814954] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-27T17:07:19.614970] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-27T17:07:19.895909] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T17:07:20.414972] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-27T17:07:20.462986] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T17:07:21.214967] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-27T17:07:21.943629] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T17:07:22.014939] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-27T17:07:22.483947] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-27T17:07:22.814951] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-27T17:07:23.615246] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-27T17:07:23.615153] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T17:07:23.979976] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T17:07:24.414952] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-27T17:07:24.790386] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-27T17:07:25.214934] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-27T17:07:25.654961] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T17:07:26.015005] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-27T17:07:26.364134] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-27T17:07:26.814951] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-27T17:07:27.517202] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T17:07:27.614968] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-27T17:07:27.903162] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-27T17:07:28.415018] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-27T17:07:29.004393] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-27T17:07:29.027949] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-27T17:07:29.214969] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-27T17:07:30.015054] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-27T17:07:30.457564] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-27T17:07:30.814964] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-27T17:07:30.827196] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-27T17:07:31.614979] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-27T17:07:31.932184] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-27T17:07:31.942718] [INFO ] [REMOTE ] AIG: Full fetch complete (77560 records). [2025-10-27T17:07:31.942885] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-27T17:07:32.355607] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-27T17:07:32.363335] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-27T17:07:32.364939] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-27T17:07:32.364592] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-27T17:07:32.367783] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-27T17:07:32.369479] [DEBUG] [LOCAL ] AIG: Trimmed 77560 records to 53450 (keeping 200 days of data) [2025-10-27T17:07:32.424316] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-27T17:07:32.694738] [DEBUG] [LOCAL ] AIG: Primary data saved (53450 records). [2025-10-27T17:07:32.694873] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-27T17:07:32.695849] [INFO ] [MAIN ] Update Progress: 66/2366 symbols completed. AIG took 37.9s. Estimated remaining: 4h 21m 12s. Rate: 8.8 symbols/min [2025-10-27T17:07:32.882431] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:07:32.911686] [DEBUG] [LOCAL ] AIT: Loaded 26948 existing records from primary storage. [2025-10-27T17:07:32.911949] [INFO ] [MAIN ] AIT: Loaded 26948 existing records. [2025-10-27T17:07:33.085498] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:07:33.085718] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-27T17:07:33.085785] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-27T17:07:33.086085] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-27T17:07:33.086158] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-27T17:07:33.222213] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-27T17:07:33.447941] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:07:33.588869] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-27T17:07:33.592072] [INFO ] [REMOTE ] AIO: Full fetch complete (20060 records). [2025-10-27T17:07:33.592159] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-27T17:07:33.951024] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-27T17:07:33.951244] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-27T17:07:33.951558] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-27T17:07:33.951724] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-27T17:07:33.952607] [DEBUG] [LOCAL ] AIO: Trimmed 20060 records to 12787 (keeping 200 days of data) [2025-10-27T17:07:34.003862] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T17:07:34.020804] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-27T17:07:34.048535] [DEBUG] [LOCAL ] AIO: Primary data saved (12787 records). [2025-10-27T17:07:34.048676] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-27T17:07:34.048771] [INFO ] [MAIN ] Update Progress: 67/2366 symbols completed. AIO took 23.3s. Estimated remaining: 4h 17m 58s. Rate: 8.9 symbols/min [2025-10-27T17:07:34.223337] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:07:34.261135] [DEBUG] [LOCAL ] AIV: Loaded 42538 existing records from primary storage. [2025-10-27T17:07:34.261420] [INFO ] [MAIN ] AIV: Loaded 42538 existing records. [2025-10-27T17:07:34.440569] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:07:34.440778] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-27T17:07:34.440827] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-27T17:07:34.441008] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-27T17:07:34.441054] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-27T17:07:34.785950] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:07:34.814984] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-27T17:07:34.981505] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-27T17:07:35.614962] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-27T17:07:36.039244] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T17:07:36.044808] [INFO ] [REMOTE ] AIN: Full fetch complete (33752 records). [2025-10-27T17:07:36.045011] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-27T17:07:36.427271] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-27T17:07:36.442624] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-27T17:07:36.442765] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-27T17:07:36.443296] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-27T17:07:36.443409] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-27T17:07:36.444563] [DEBUG] [LOCAL ] AIN: Trimmed 33752 records to 24135 (keeping 200 days of data) [2025-10-27T17:07:36.594976] [DEBUG] [LOCAL ] AIN: Primary data saved (24135 records). [2025-10-27T17:07:36.595164] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-27T17:07:36.595268] [INFO ] [MAIN ] Update Progress: 68/2366 symbols completed. AIN took 32.5s. Estimated remaining: 4h 15m 30s. Rate: 9.0 symbols/min [2025-10-27T17:07:36.769828] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:07:36.799721] [DEBUG] [LOCAL ] AIZ: Loaded 29600 existing records from primary storage. [2025-10-27T17:07:36.800149] [INFO ] [MAIN ] AIZ: Loaded 29600 existing records. [2025-10-27T17:07:36.987274] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:07:36.987600] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-27T17:07:36.987683] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-27T17:07:36.987922] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-27T17:07:36.987979] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-27T17:07:37.217929] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-27T17:07:37.375782] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-27T17:07:37.397666] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:07:37.729922] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-27T17:07:38.014963] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-27T17:07:38.814916] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-27T17:07:38.928822] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T17:07:39.033226] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T17:07:39.614948] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-27T17:07:40.029842] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-27T17:07:40.414927] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-27T17:07:40.567964] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T17:07:41.214966] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-27T17:07:41.543885] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T17:07:42.014990] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-27T17:07:42.559260] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T17:07:42.814978] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-27T17:07:43.371166] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T17:07:43.614943] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-27T17:07:44.414989] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-27T17:07:44.443894] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T17:07:44.471458] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-27T17:07:45.214978] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-27T17:07:45.835794] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T17:07:46.014957] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-27T17:07:46.138481] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-27T17:07:46.814945] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-27T17:07:47.105934] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-27T17:07:47.614989] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-27T17:07:48.099065] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T17:07:48.414937] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-27T17:07:48.816486] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-27T17:07:49.214946] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-27T17:07:49.470608] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-27T17:07:50.014944] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-27T17:07:50.186196] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T17:07:50.814953] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-27T17:07:50.984468] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T17:07:51.614939] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-27T17:07:51.709922] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-27T17:07:52.414936] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-27T17:07:52.850552] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T17:07:53.214936] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-27T17:07:53.504506] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T17:07:54.014949] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-27T17:07:54.130430] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-27T17:07:54.814923] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-27T17:07:55.155794] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T17:07:55.614940] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-27T17:07:56.380719] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T17:07:56.390688] [INFO ] [REMOTE ] AIR: Full fetch complete (40217 records). [2025-10-27T17:07:56.390869] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-27T17:07:56.423660] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-27T17:07:56.785536] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-27T17:07:56.785612] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-27T17:07:56.786093] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-27T17:07:56.786170] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-27T17:07:56.787067] [DEBUG] [LOCAL ] AIR: Trimmed 40217 records to 28344 (keeping 200 days of data) [2025-10-27T17:07:56.953384] [DEBUG] [LOCAL ] AIR: Primary data saved (28344 records). [2025-10-27T17:07:56.953514] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-27T17:07:56.953965] [INFO ] [MAIN ] Update Progress: 69/2366 symbols completed. AIR took 42.4s. Estimated remaining: 4h 22m 59s. Rate: 8.7 symbols/min [2025-10-27T17:07:57.119071] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T17:07:57.157033] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:07:57.168012] [DEBUG] [LOCAL ] AIZN: Loaded 3851 existing records from primary storage. [2025-10-27T17:07:57.168240] [INFO ] [MAIN ] AIZN: Loaded 3851 existing records. [2025-10-27T17:07:57.222224] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-27T17:07:57.351211] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:07:57.351412] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-27T17:07:57.351461] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-27T17:07:57.351582] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-27T17:07:57.351623] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-27T17:07:57.730318] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:07:57.981703] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T17:07:58.014942] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-27T17:07:58.525504] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-27T17:07:58.814936] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-27T17:07:59.522255] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T17:07:59.614975] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-27T17:08:00.209367] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T17:08:00.214569] [INFO ] [REMOTE ] AIZ: Full fetch complete (42690 records). [2025-10-27T17:08:00.214745] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-27T17:08:00.420127] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-27T17:08:00.605908] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-27T17:08:00.606022] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-27T17:08:00.606695] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-27T17:08:00.606763] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-27T17:08:00.608314] [DEBUG] [LOCAL ] AIZ: Trimmed 42690 records to 28903 (keeping 200 days of data) [2025-10-27T17:08:00.796126] [DEBUG] [LOCAL ] AIZ: Primary data saved (28903 records). [2025-10-27T17:08:00.796325] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-27T17:08:00.796423] [INFO ] [MAIN ] Update Progress: 70/2366 symbols completed. AIZ took 24.2s. Estimated remaining: 4h 21m 13s. Rate: 8.8 symbols/min [2025-10-27T17:08:00.978554] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:08:01.031460] [DEBUG] [LOCAL ] AJG: Loaded 47015 existing records from primary storage. [2025-10-27T17:08:01.031945] [INFO ] [MAIN ] AJG: Loaded 47015 existing records. [2025-10-27T17:08:01.221602] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-27T17:08:01.228684] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:08:01.230136] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-27T17:08:01.230214] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-27T17:08:01.230505] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-27T17:08:01.230564] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-27T17:08:01.678268] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:08:01.898252] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-27T17:08:01.908209] [INFO ] [REMOTE ] AIV: Full fetch complete (60392 records). [2025-10-27T17:08:01.908338] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-27T17:08:02.020015] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-27T17:08:02.321703] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-27T17:08:02.322245] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-27T17:08:02.322747] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-27T17:08:02.323383] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-27T17:08:02.328540] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-27T17:08:02.329831] [DEBUG] [LOCAL ] AIV: Trimmed 60392 records to 41782 (keeping 200 days of data) [2025-10-27T17:08:02.562785] [DEBUG] [LOCAL ] AIV: Primary data saved (41782 records). [2025-10-27T17:08:02.562904] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-27T17:08:02.564007] [INFO ] [MAIN ] Update Progress: 71/2366 symbols completed. AIV took 28.5s. Estimated remaining: 4h 18m 22s. Rate: 8.9 symbols/min [2025-10-27T17:08:02.727397] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:08:02.727565] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-27T17:08:02.727606] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-27T17:08:02.727738] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-27T17:08:02.727780] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-27T17:08:02.727821] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-27T17:08:02.727862] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-27T17:08:02.820117] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-27T17:08:03.083738] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:08:03.614982] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-27T17:08:03.641398] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-27T17:08:04.045046] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-27T17:08:04.126195] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-27T17:08:04.128019] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-27T17:08:04.414945] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-27T17:08:05.214953] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-27T17:08:05.540334] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T17:08:06.014891] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-27T17:08:06.494907] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-27T17:08:06.499622] [INFO ] [REMOTE ] AIT: Full fetch complete (38969 records). [2025-10-27T17:08:06.499780] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-27T17:08:06.793197] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T17:08:06.820088] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-27T17:08:06.887846] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-27T17:08:06.887929] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-27T17:08:06.888374] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-27T17:08:06.888419] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-27T17:08:06.889405] [DEBUG] [LOCAL ] AIT: Trimmed 38969 records to 26203 (keeping 200 days of data) [2025-10-27T17:08:07.051452] [DEBUG] [LOCAL ] AIT: Primary data saved (26203 records). [2025-10-27T17:08:07.051625] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-27T17:08:07.051745] [INFO ] [MAIN ] Update Progress: 72/2366 symbols completed. AIT took 34.4s. Estimated remaining: 4h 17m 3s. Rate: 8.9 symbols/min [2025-10-27T17:08:07.216830] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:08:07.259822] [DEBUG] [LOCAL ] AKR: Loaded 46704 existing records from primary storage. [2025-10-27T17:08:07.260129] [INFO ] [MAIN ] AKR: Loaded 46704 existing records. [2025-10-27T17:08:07.432737] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:08:07.432894] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-27T17:08:07.432938] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-27T17:08:07.433142] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-27T17:08:07.433197] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-27T17:08:07.620075] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-27T17:08:07.784798] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:08:08.199946] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T17:08:08.362976] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-27T17:08:08.415006] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-27T17:08:09.214983] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-27T17:08:09.688326] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T17:08:10.014950] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-27T17:08:10.814988] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-27T17:08:11.015326] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-27T17:08:11.234137] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T17:08:11.251925] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-27T17:08:11.614947] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-27T17:08:12.081937] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-27T17:08:12.415059] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-27T17:08:13.215007] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-27T17:08:13.517197] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-27T17:08:13.696890] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T17:08:14.014930] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-27T17:08:14.768724] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-27T17:08:14.814918] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-27T17:08:15.614965] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-27T17:08:15.662103] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T17:08:16.414954] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-27T17:08:16.785139] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-27T17:08:16.972149] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-27T17:08:17.214975] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-27T17:08:17.496999] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-27T17:08:18.014979] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-27T17:08:18.631181] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-27T17:08:18.814950] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-27T17:08:19.614940] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-27T17:08:19.893567] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-27T17:08:20.414937] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-27T17:08:20.579252] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-27T17:08:20.672895] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-27T17:08:21.214931] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-27T17:08:21.757031] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-27T17:08:21.758504] [INFO ] [REMOTE ] AKA: Full fetch complete (2846 records). [2025-10-27T17:08:21.758572] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-27T17:08:21.937910] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-27T17:08:21.938126] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:08:21.938194] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:08:21.938265] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-27T17:08:21.938327] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-27T17:08:21.938363] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-27T17:08:21.938400] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-27T17:08:21.938465] [INFO ] [MAIN ] Update Progress: 73/2366 symbols completed. AKA took 19.4s. Estimated remaining: 4h 21m 13s. Rate: 8.8 symbols/min [2025-10-27T17:08:22.020101] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-27T17:08:22.106182] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:08:22.148194] [DEBUG] [LOCAL ] AL: Loaded 45506 existing records from primary storage. [2025-10-27T17:08:22.148504] [INFO ] [MAIN ] AL: Loaded 45506 existing records. [2025-10-27T17:08:22.323951] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:08:22.324429] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-27T17:08:22.324483] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-27T17:08:22.324939] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-27T17:08:22.324996] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-27T17:08:22.692962] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:08:22.814930] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-27T17:08:23.614998] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-27T17:08:23.971344] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-27T17:08:24.171487] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T17:08:24.354392] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-27T17:08:24.414930] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-27T17:08:25.214959] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-27T17:08:25.776079] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T17:08:26.014934] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-27T17:08:26.814916] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-27T17:08:26.915314] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-27T17:08:27.380420] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-27T17:08:27.620055] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-27T17:08:27.638063] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T17:08:28.414954] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-27T17:08:28.861957] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T17:08:29.214944] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-27T17:08:29.908739] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T17:08:30.014985] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-27T17:08:30.242953] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-27T17:08:30.814997] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-27T17:08:31.201416] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T17:08:31.614975] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-27T17:08:32.263753] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T17:08:32.414946] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-27T17:08:33.215009] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-27T17:08:33.692539] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-27T17:08:33.808927] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T17:08:33.836832] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T17:08:34.014916] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-27T17:08:34.815011] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-27T17:08:35.168204] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T17:08:35.252875] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-27T17:08:35.254165] [INFO ] [REMOTE ] AIZN: Full fetch complete (5720 records). [2025-10-27T17:08:35.254234] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-27T17:08:35.608502] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-27T17:08:35.608581] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-27T17:08:35.608779] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-27T17:08:35.608843] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-27T17:08:35.609229] [DEBUG] [LOCAL ] AIZN: Trimmed 5720 records to 3678 (keeping 200 days of data) [2025-10-27T17:08:35.620379] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-27T17:08:35.634936] [DEBUG] [LOCAL ] AIZN: Primary data saved (3678 records). [2025-10-27T17:08:35.635059] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-27T17:08:35.635141] [INFO ] [MAIN ] Update Progress: 74/2366 symbols completed. AIZN took 38.7s. Estimated remaining: 4h 24m 39s. Rate: 8.7 symbols/min [2025-10-27T17:08:35.807024] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:08:35.864465] [DEBUG] [LOCAL ] ALB: Loaded 54142 existing records from primary storage. [2025-10-27T17:08:35.864836] [INFO ] [MAIN ] ALB: Loaded 54142 existing records. [2025-10-27T17:08:36.040719] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:08:36.040930] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-27T17:08:36.040996] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-27T17:08:36.041197] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-27T17:08:36.041236] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-27T17:08:36.386091] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:08:36.414930] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-27T17:08:37.184275] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T17:08:37.214936] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-27T17:08:37.825245] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T17:08:38.014984] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-27T17:08:38.814966] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-27T17:08:39.087006] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-27T17:08:39.283351] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-27T17:08:39.614997] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-27T17:08:39.894407] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-27T17:08:40.414978] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-27T17:08:40.837890] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T17:08:40.846600] [INFO ] [REMOTE ] AKR: Full fetch complete (65419 records). [2025-10-27T17:08:40.846741] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-27T17:08:41.231219] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-27T17:08:41.227908] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-27T17:08:41.232518] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-27T17:08:41.233369] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-27T17:08:41.233537] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-27T17:08:41.234867] [DEBUG] [LOCAL ] AKR: Trimmed 65419 records to 45897 (keeping 200 days of data) [2025-10-27T17:08:41.511116] [DEBUG] [LOCAL ] AKR: Primary data saved (45897 records). [2025-10-27T17:08:41.511260] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-27T17:08:41.512247] [INFO ] [MAIN ] Update Progress: 75/2366 symbols completed. AKR took 34.5s. Estimated remaining: 4h 23m 60s. Rate: 8.7 symbols/min [2025-10-27T17:08:41.691626] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:08:41.765577] [DEBUG] [LOCAL ] ALC: Loaded 51966 existing records from primary storage. [2025-10-27T17:08:41.764440] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T17:08:41.775345] [INFO ] [MAIN ] ALC: Loaded 51966 existing records. [2025-10-27T17:08:41.955733] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:08:41.955987] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-27T17:08:41.956037] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-27T17:08:41.956238] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-27T17:08:41.956277] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-27T17:08:42.020200] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-27T17:08:42.330971] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:08:42.719681] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-27T17:08:42.815005] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-27T17:08:43.346524] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-27T17:08:43.355246] [INFO ] [REMOTE ] AJG: Full fetch complete (68703 records). [2025-10-27T17:08:43.355361] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-27T17:08:43.620572] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-27T17:08:43.813773] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-27T17:08:43.813912] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-27T17:08:43.814967] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-27T17:08:43.815038] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-27T17:08:43.817141] [DEBUG] [LOCAL ] AJG: Trimmed 68703 records to 46202 (keeping 200 days of data) [2025-10-27T17:08:44.188670] [DEBUG] [LOCAL ] AJG: Primary data saved (46202 records). [2025-10-27T17:08:44.189014] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-27T17:08:44.190042] [INFO ] [MAIN ] Update Progress: 76/2366 symbols completed. AJG took 43.4s. Estimated remaining: 4h 21m 45s. Rate: 8.7 symbols/min [2025-10-27T17:08:44.222977] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T17:08:44.419945] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-27T17:08:44.422692] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:08:44.471217] [DEBUG] [LOCAL ] ALE: Loaded 32460 existing records from primary storage. [2025-10-27T17:08:44.471702] [INFO ] [MAIN ] ALE: Loaded 32460 existing records. [2025-10-27T17:08:44.702957] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:08:44.703288] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-27T17:08:44.703362] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-27T17:08:44.703691] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-27T17:08:44.703776] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-27T17:08:45.148532] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:08:45.220069] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-27T17:08:45.242338] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T17:08:45.964223] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T17:08:46.014897] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-27T17:08:46.814952] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-27T17:08:47.388457] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-27T17:08:47.614995] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-27T17:08:47.896001] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-27T17:08:47.906315] [INFO ] [REMOTE ] AL: Full fetch complete (63880 records). [2025-10-27T17:08:47.906535] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-27T17:08:48.325794] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T17:08:48.361388] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-27T17:08:48.361504] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-27T17:08:48.362719] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-27T17:08:48.362804] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-27T17:08:48.364901] [DEBUG] [LOCAL ] AL: Trimmed 63880 records to 44745 (keeping 200 days of data) [2025-10-27T17:08:48.421416] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-27T17:08:48.648323] [DEBUG] [LOCAL ] AL: Primary data saved (44745 records). [2025-10-27T17:08:48.648540] [INFO ] [MAIN ] AL: Full history saved. [2025-10-27T17:08:48.649016] [INFO ] [MAIN ] Update Progress: 77/2366 symbols completed. AL took 26.7s. Estimated remaining: 4h 20m 27s. Rate: 8.8 symbols/min [2025-10-27T17:08:49.214963] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-27T17:08:49.304141] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T17:08:50.014994] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-27T17:08:50.339853] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-27T17:08:50.364886] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T17:08:50.815001] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-27T17:08:51.614986] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-27T17:08:51.735279] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T17:08:52.415158] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-27T17:08:52.421283] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-27T17:08:52.535760] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T17:08:53.214994] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-27T17:08:54.014966] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-27T17:08:54.462611] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-27T17:08:54.722071] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T17:08:54.814992] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-27T17:08:55.499504] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-27T17:08:55.614933] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-27T17:08:56.414943] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-27T17:08:56.793281] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-27T17:08:56.858128] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T17:08:57.214946] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-27T17:08:58.014959] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-27T17:08:58.436620] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T17:08:58.814968] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-27T17:08:59.267473] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-27T17:08:59.311375] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-10-27T17:08:59.614934] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-27T17:09:00.164996] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T17:09:00.415008] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-27T17:09:01.215002] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-27T17:09:01.909986] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-27T17:09:02.014974] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-27T17:09:02.900792] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-27T17:09:02.913135] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-27T17:09:03.663323] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T17:09:03.672056] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-27T17:09:04.584751] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-27T17:09:04.595705] [INFO ] [REMOTE ] ALC: Full fetch complete (73584 records). [2025-10-27T17:09:04.595931] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-27T17:09:04.597088] [FATAL] [VALIDATOR ] ALC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:09:04.597184] [FATAL] [MAIN ] ALC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:09:04.597230] [WARN ] [MAIN ] ALC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:09:04.597272] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-27T17:09:04.597338] [DEBUG] [LOCAL ] ALC: No primary data file found to delete. [2025-10-27T17:09:04.597377] [INFO ] [LOCAL ] ALC: Starting deletion of derivative data. [2025-10-27T17:09:04.597703] [DEBUG] [LOCAL ] ALC: Deleted derivative data file. [2025-10-27T17:09:04.598457] [INFO ] [MAIN ] Update Progress: 78/2366 symbols completed. ALC took 23.1s. Estimated remaining: 4h 24m 48s. Rate: 8.6 symbols/min [2025-10-27T17:09:04.644819] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (3.43 seconds). [2025-10-27T17:09:04.656981] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-27T17:09:05.182312] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T17:09:05.214937] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-27T17:09:06.910498] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-27T17:09:06.923409] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-27T17:09:06.999143] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-27T17:09:07.008230] [INFO ] [REMOTE ] ALE: Full fetch complete (44323 records). [2025-10-27T17:09:07.008453] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-27T17:09:07.413616] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-27T17:09:07.413742] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-27T17:09:07.414231] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-27T17:09:07.414273] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-27T17:09:07.415366] [DEBUG] [LOCAL ] ALE: Trimmed 44323 records to 31792 (keeping 200 days of data) [2025-10-27T17:09:07.606511] [DEBUG] [LOCAL ] ALE: Primary data saved (31792 records). [2025-10-27T17:09:07.606666] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-27T17:09:07.606765] [INFO ] [MAIN ] Update Progress: 79/2366 symbols completed. ALE took 23.4s. Estimated remaining: 4h 22m 47s. Rate: 8.7 symbols/min [2025-10-27T17:09:09.526396] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-27T17:09:09.537372] [INFO ] [REMOTE ] ALB: Full fetch complete (77115 records). [2025-10-27T17:09:09.537599] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-27T17:09:09.954553] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-27T17:09:09.954695] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-27T17:09:09.955561] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-27T17:09:09.955609] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-27T17:09:09.957677] [DEBUG] [LOCAL ] ALB: Trimmed 77115 records to 53362 (keeping 200 days of data) [2025-10-27T17:09:10.309194] [DEBUG] [LOCAL ] ALB: Primary data saved (53362 records). [2025-10-27T17:09:10.309481] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-27T17:09:10.311968] [INFO ] [MAIN ] Update Progress: 80/2366 symbols completed. ALB took 34.7s. Estimated remaining: 4h 20m 40s. Rate: 8.8 symbols/min [2025-10-27T17:09:11.027891] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:09:11.099446] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-27T17:09:11.118092] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-27T17:09:11.147811] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-27T17:09:11.172299] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-27T17:09:11.147488] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:09:11.172727] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-27T17:09:11.172133] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:09:11.173452] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-27T17:09:11.167034] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:09:11.305402] [DEBUG] [LOCAL ] ALG: Loaded 9813 existing records from primary storage. [2025-10-27T17:09:11.324782] [INFO ] [MAIN ] ALG: Loaded 9813 existing records. [2025-10-27T17:09:11.629884] [DEBUG] [LOCAL ] ALEX: Loaded 31192 existing records from primary storage. [2025-10-27T17:09:11.688599] [INFO ] [MAIN ] ALEX: Loaded 31192 existing records. [2025-10-27T17:09:11.722361] [DEBUG] [LOCAL ] ALIT: Loaded 53550 existing records from primary storage. [2025-10-27T17:09:11.828485] [INFO ] [MAIN ] ALIT: Loaded 53550 existing records. [2025-10-27T17:09:11.893086] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:09:11.928073] [INFO ] [REMOTE ] ALH: Fetching primary data for 2025-01. [2025-10-27T17:09:11.998950] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:09:12.100353] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-27T17:09:12.130299] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-27T17:09:12.223861] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-27T17:09:12.239471] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:09:12.245207] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-27T17:09:12.264331] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-27T17:09:12.264163] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-27T17:09:12.292478] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:09:12.371765] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-27T17:09:12.359814] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:09:12.372271] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-27T17:09:12.372179] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-27T17:09:12.359987] [WARN ] [REMOTE ] ALH: No data returned for month 2025-01 [2025-10-27T17:09:12.482700] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:09:12.482523] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-27T17:09:12.525381] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-27T17:09:12.536047] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-27T17:09:12.569007] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-27T17:09:12.530693] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:09:12.623742] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-27T17:09:12.683534] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-27T17:09:12.769906] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-27T17:09:12.873377] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-27T17:09:12.923689] [INFO ] [MAIN ] Update Progress: 81/2366 symbols completed. ALH took 2.6s. Estimated remaining: 4h 18m 34s. Rate: 8.8 symbols/min [2025-10-27T17:09:13.503768] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:09:13.576555] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:09:13.592793] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-27T17:09:13.618546] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:09:13.639886] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-27T17:09:13.734466] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:09:13.734973] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-27T17:09:13.789048] [DEBUG] [LOCAL ] ALK: Loaded 53867 existing records from primary storage. [2025-10-27T17:09:13.789567] [INFO ] [MAIN ] ALK: Loaded 53867 existing records. [2025-10-27T17:09:13.991040] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:09:13.991328] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-27T17:09:13.991381] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-27T17:09:13.991705] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-27T17:09:13.991764] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-27T17:09:14.371822] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:09:14.372227] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-27T17:09:14.480390] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-27T17:09:14.483928] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-27T17:09:15.086129] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T17:09:15.089375] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-27T17:09:15.364568] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-27T17:09:15.375055] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-27T17:09:15.452367] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-27T17:09:15.460885] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-27T17:09:15.978591] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-27T17:09:15.982308] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-27T17:09:16.208999] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T17:09:16.214505] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-27T17:09:16.335156] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-27T17:09:16.345925] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-27T17:09:16.877822] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T17:09:16.891762] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-27T17:09:16.946267] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T17:09:17.214997] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-27T17:09:17.591755] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T17:09:17.726027] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-27T17:09:17.972515] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-27T17:09:18.015029] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-27T17:09:18.814999] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-27T17:09:19.161525] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-27T17:09:19.614984] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-27T17:09:19.778404] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-27T17:09:19.882188] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-27T17:09:20.414969] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-27T17:09:20.724707] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-27T17:09:21.214945] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-27T17:09:21.384802] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-27T17:09:22.014960] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-27T17:09:22.814934] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-27T17:09:22.935031] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T17:09:23.315760] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T17:09:23.568293] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-27T17:09:23.614940] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-27T17:09:24.414939] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-27T17:09:24.847836] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T17:09:25.214944] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-27T17:09:25.758712] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-27T17:09:26.014943] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-27T17:09:26.662928] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-27T17:09:26.814931] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-27T17:09:26.881434] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T17:09:27.615011] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-27T17:09:28.205297] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-27T17:09:28.207234] [INFO ] [REMOTE ] ALG: Full fetch complete (15120 records). [2025-10-27T17:09:28.207302] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-27T17:09:28.422248] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-27T17:09:28.580350] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-27T17:09:28.580468] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-27T17:09:28.580839] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-27T17:09:28.580915] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-27T17:09:28.581703] [DEBUG] [LOCAL ] ALG: Trimmed 15120 records to 9543 (keeping 200 days of data) [2025-10-27T17:09:28.634617] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-27T17:09:28.677974] [DEBUG] [LOCAL ] ALG: Primary data saved (9543 records). [2025-10-27T17:09:28.678089] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-27T17:09:28.678160] [INFO ] [MAIN ] Update Progress: 82/2366 symbols completed. ALG took 18.3s. Estimated remaining: 4h 22m 37s. Rate: 8.7 symbols/min [2025-10-27T17:09:28.845432] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:09:28.891841] [DEBUG] [LOCAL ] ALL: Loaded 50286 existing records from primary storage. [2025-10-27T17:09:28.892133] [INFO ] [MAIN ] ALL: Loaded 50286 existing records. [2025-10-27T17:09:29.067787] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:09:29.067935] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-27T17:09:29.067982] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-27T17:09:29.068216] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-27T17:09:29.068255] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-27T17:09:29.242342] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-27T17:09:29.424418] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:09:29.748603] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-27T17:09:30.014932] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-27T17:09:30.814923] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-27T17:09:31.211930] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-27T17:09:31.614952] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-27T17:09:31.775702] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T17:09:32.308953] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T17:09:32.414974] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-27T17:09:33.095335] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T17:09:33.214995] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-27T17:09:33.834088] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T17:09:34.014944] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-27T17:09:34.814944] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-27T17:09:34.992635] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-27T17:09:35.482471] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T17:09:35.614938] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-27T17:09:35.711767] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-27T17:09:36.414943] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-27T17:09:37.215004] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-27T17:09:37.410403] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-27T17:09:38.014969] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-27T17:09:38.131829] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T17:09:38.815000] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-27T17:09:38.891846] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T17:09:38.898058] [INFO ] [REMOTE ] ALEX: Full fetch complete (44566 records). [2025-10-27T17:09:38.898145] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-27T17:09:39.273378] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-27T17:09:39.273456] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-27T17:09:39.273959] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-27T17:09:39.274023] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-27T17:09:39.274956] [DEBUG] [LOCAL ] ALEX: Trimmed 44566 records to 30369 (keeping 200 days of data) [2025-10-27T17:09:39.455528] [DEBUG] [LOCAL ] ALEX: Primary data saved (30369 records). [2025-10-27T17:09:39.455681] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-27T17:09:39.455777] [INFO ] [MAIN ] Update Progress: 83/2366 symbols completed. ALEX took 29.1s. Estimated remaining: 4h 24m 17s. Rate: 8.6 symbols/min [2025-10-27T17:09:39.621052] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-27T17:09:39.623505] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:09:39.665817] [DEBUG] [LOCAL ] ALLE: Loaded 44606 existing records from primary storage. [2025-10-27T17:09:39.666112] [INFO ] [MAIN ] ALLE: Loaded 44606 existing records. [2025-10-27T17:09:39.848742] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:09:39.848973] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-27T17:09:39.849128] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-27T17:09:39.858563] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-27T17:09:39.873187] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-27T17:09:39.943501] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-27T17:09:40.264633] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:09:40.293390] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-27T17:09:40.303692] [INFO ] [REMOTE ] ALIT: Full fetch complete (76618 records). [2025-10-27T17:09:40.303830] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-27T17:09:40.420125] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-27T17:09:40.695885] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-27T17:09:40.695959] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-27T17:09:40.696738] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-27T17:09:40.696802] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-27T17:09:40.698216] [DEBUG] [LOCAL ] ALIT: Trimmed 76618 records to 52760 (keeping 200 days of data) [2025-10-27T17:09:41.005943] [DEBUG] [LOCAL ] ALIT: Primary data saved (52760 records). [2025-10-27T17:09:41.006103] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-27T17:09:41.007323] [INFO ] [MAIN ] Update Progress: 84/2366 symbols completed. ALIT took 30.7s. Estimated remaining: 4h 21m 43s. Rate: 8.7 symbols/min [2025-10-27T17:09:41.197054] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T17:09:41.218275] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-27T17:09:41.214394] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:09:41.283366] [DEBUG] [LOCAL ] ALLY: Loaded 53998 existing records from primary storage. [2025-10-27T17:09:41.283732] [INFO ] [MAIN ] ALLY: Loaded 53998 existing records. [2025-10-27T17:09:41.460444] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:09:41.460663] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-27T17:09:41.460724] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-27T17:09:41.461050] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-27T17:09:41.461087] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-27T17:09:41.817279] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:09:41.906526] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T17:09:42.014959] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-27T17:09:42.674388] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-27T17:09:42.814927] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-27T17:09:43.462315] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-27T17:09:43.614932] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-27T17:09:44.414830] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-27T17:09:44.414995] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-27T17:09:45.084155] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T17:09:45.214903] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-27T17:09:46.014975] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-27T17:09:46.452384] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-27T17:09:46.463273] [INFO ] [REMOTE ] ALK: Full fetch complete (77042 records). [2025-10-27T17:09:46.463446] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-27T17:09:46.817046] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-27T17:09:46.879702] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-27T17:09:46.879835] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-27T17:09:46.880811] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-27T17:09:46.880952] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-27T17:09:46.882674] [DEBUG] [LOCAL ] ALK: Trimmed 77042 records to 53087 (keeping 200 days of data) [2025-10-27T17:09:47.150118] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-27T17:09:47.236062] [DEBUG] [LOCAL ] ALK: Primary data saved (53087 records). [2025-10-27T17:09:47.236203] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-27T17:09:47.236283] [INFO ] [MAIN ] Update Progress: 85/2366 symbols completed. ALK took 34.3s. Estimated remaining: 4h 21m 19s. Rate: 8.7 symbols/min [2025-10-27T17:09:47.413063] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:09:47.452275] [DEBUG] [LOCAL ] ALSN: Loaded 43809 existing records from primary storage. [2025-10-27T17:09:47.452680] [INFO ] [MAIN ] ALSN: Loaded 43809 existing records. [2025-10-27T17:09:47.624290] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-27T17:09:47.626053] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T17:09:47.685577] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:09:47.685940] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-27T17:09:47.685989] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-27T17:09:47.686275] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-27T17:09:47.686360] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-27T17:09:48.048785] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:09:48.414983] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-27T17:09:48.867830] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-27T17:09:49.215755] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-27T17:09:49.220909] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-27T17:09:49.569086] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T17:09:50.014936] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-27T17:09:50.814930] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-27T17:09:51.327632] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-27T17:09:51.614945] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-27T17:09:51.811868] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-27T17:09:52.229059] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T17:09:52.414935] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-27T17:09:52.903099] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-27T17:09:53.215004] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-27T17:09:53.662615] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T17:09:54.014962] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-27T17:09:54.383378] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T17:09:54.814939] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-27T17:09:55.596966] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T17:09:55.614894] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-27T17:09:56.224563] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T17:09:56.414928] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-27T17:09:56.882279] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T17:09:57.214936] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-27T17:09:58.014993] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-27T17:09:58.294995] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T17:09:58.814951] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-27T17:09:59.367670] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-27T17:09:59.463209] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T17:09:59.614912] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-27T17:10:00.414973] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-27T17:10:00.630006] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-27T17:10:01.214935] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-27T17:10:01.775499] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-27T17:10:02.014938] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-27T17:10:02.814955] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-27T17:10:03.401028] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (2.99 seconds). [2025-10-27T17:10:03.615001] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-27T17:10:04.362915] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-27T17:10:04.414963] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-27T17:10:05.077792] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (3.86 seconds). [2025-10-27T17:10:05.116712] [INFO ] [REMOTE ] ALL: Full fetch complete (71993 records). [2025-10-27T17:10:05.116931] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-27T17:10:05.120235] [FATAL] [VALIDATOR ] ALL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:10:05.119883] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-27T17:10:05.120450] [FATAL] [MAIN ] ALL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:10:05.131529] [WARN ] [MAIN ] ALL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:10:05.132064] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-27T17:10:05.132149] [DEBUG] [LOCAL ] ALL: No primary data file found to delete. [2025-10-27T17:10:05.132192] [INFO ] [LOCAL ] ALL: Starting deletion of derivative data. [2025-10-27T17:10:05.132382] [DEBUG] [LOCAL ] ALL: Deleted derivative data file. [2025-10-27T17:10:05.133552] [INFO ] [MAIN ] Update Progress: 86/2366 symbols completed. ALL took 36.5s. Estimated remaining: 4h 26m 4s. Rate: 8.6 symbols/min [2025-10-27T17:10:05.215365] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-27T17:10:05.327294] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:10:05.357560] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (3.34 seconds). [2025-10-27T17:10:05.375510] [INFO ] [REMOTE ] ALLE: Full fetch complete (64578 records). [2025-10-27T17:10:05.375891] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-27T17:10:05.377500] [FATAL] [VALIDATOR ] ALLE: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:10:05.378073] [FATAL] [MAIN ] ALLE: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:10:05.385597] [WARN ] [MAIN ] ALLE: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:10:05.385753] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-27T17:10:05.386368] [DEBUG] [LOCAL ] ALLE: No primary data file found to delete. [2025-10-27T17:10:05.386170] [DEBUG] [LOCAL ] ALTG: Loaded 23319 existing records from primary storage. [2025-10-27T17:10:05.386582] [INFO ] [LOCAL ] ALLE: Starting deletion of derivative data. [2025-10-27T17:10:05.386914] [INFO ] [MAIN ] ALTG: Loaded 23319 existing records. [2025-10-27T17:10:05.432037] [DEBUG] [LOCAL ] ALLE: Deleted derivative data file. [2025-10-27T17:10:05.462600] [INFO ] [MAIN ] Update Progress: 87/2366 symbols completed. ALLE took 26.0s. Estimated remaining: 4h 23m 3s. Rate: 8.7 symbols/min [2025-10-27T17:10:05.723144] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:10:05.734562] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-27T17:10:05.750384] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-27T17:10:05.778322] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-27T17:10:05.802427] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-27T17:10:05.802313] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:10:05.918124] [DEBUG] [LOCAL ] ALUR: Loaded 9342 existing records from primary storage. [2025-10-27T17:10:05.918705] [INFO ] [MAIN ] ALUR: Loaded 9342 existing records. [2025-10-27T17:10:06.337670] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:10:06.349154] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-27T17:10:06.357133] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-27T17:10:06.391333] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-27T17:10:06.430541] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:10:06.431095] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-27T17:10:06.431447] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-27T17:10:06.431037] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-27T17:10:06.788965] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:10:06.814939] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-27T17:10:07.614965] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-27T17:10:08.035965] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T17:10:08.131357] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-10-27T17:10:08.414997] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-27T17:10:08.667036] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-27T17:10:09.214928] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-27T17:10:09.641366] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-27T17:10:10.010031] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T17:10:10.020121] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-27T17:10:10.220382] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-27T17:10:10.814946] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-27T17:10:11.529778] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T17:10:11.614975] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-27T17:10:11.880217] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T17:10:12.414975] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-27T17:10:13.214935] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-27T17:10:13.343778] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T17:10:13.632694] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-27T17:10:14.014990] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-27T17:10:14.363186] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T17:10:14.769786] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-27T17:10:14.814962] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-27T17:10:15.614940] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-27T17:10:15.712628] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T17:10:16.414991] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-27T17:10:17.214972] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-27T17:10:17.492503] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-27T17:10:17.502578] [INFO ] [REMOTE ] ALLY: Full fetch complete (76867 records). [2025-10-27T17:10:17.502757] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-27T17:10:17.503594] [FATAL] [VALIDATOR ] ALLY: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:10:17.503716] [FATAL] [MAIN ] ALLY: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:10:17.503762] [WARN ] [MAIN ] ALLY: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:10:17.503800] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-27T17:10:17.503856] [DEBUG] [LOCAL ] ALLY: No primary data file found to delete. [2025-10-27T17:10:17.503891] [INFO ] [LOCAL ] ALLY: Starting deletion of derivative data. [2025-10-27T17:10:17.504058] [DEBUG] [LOCAL ] ALLY: Deleted derivative data file. [2025-10-27T17:10:17.505047] [INFO ] [MAIN ] Update Progress: 88/2366 symbols completed. ALLY took 36.5s. Estimated remaining: 4h 25m 8s. Rate: 8.6 symbols/min [2025-10-27T17:10:17.641281] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T17:10:17.694694] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:10:17.734490] [DEBUG] [LOCAL ] ALV: Loaded 42871 existing records from primary storage. [2025-10-27T17:10:17.734786] [INFO ] [MAIN ] ALV: Loaded 42871 existing records. [2025-10-27T17:10:17.909616] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:10:17.909810] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-27T17:10:17.909858] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-27T17:10:17.910100] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-27T17:10:17.910140] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-27T17:10:18.015756] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-27T17:10:18.269599] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:10:18.814936] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-27T17:10:19.239300] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-27T17:10:19.247701] [INFO ] [REMOTE ] ALSN: Full fetch complete (62810 records). [2025-10-27T17:10:19.247813] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-27T17:10:19.616070] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-27T17:10:19.636098] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-27T17:10:19.636179] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-27T17:10:19.636816] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-27T17:10:19.636879] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-27T17:10:19.638106] [DEBUG] [LOCAL ] ALSN: Trimmed 62810 records to 43052 (keeping 200 days of data) [2025-10-27T17:10:19.876192] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-27T17:10:19.923840] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-27T17:10:19.933940] [DEBUG] [LOCAL ] ALSN: Primary data saved (43052 records). [2025-10-27T17:10:19.934030] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-27T17:10:19.935140] [INFO ] [MAIN ] Update Progress: 89/2366 symbols completed. ALSN took 32.7s. Estimated remaining: 4h 23m 5s. Rate: 8.7 symbols/min [2025-10-27T17:10:20.108721] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:10:20.119277] [DEBUG] [LOCAL ] ALX: Loaded 7452 existing records from primary storage. [2025-10-27T17:10:20.119503] [INFO ] [MAIN ] ALX: Loaded 7452 existing records. [2025-10-27T17:10:20.301841] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:10:20.302106] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-27T17:10:20.302163] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-27T17:10:20.302479] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-27T17:10:20.302539] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-27T17:10:20.420085] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-27T17:10:20.659496] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:10:21.214955] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-27T17:10:21.615887] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-27T17:10:21.808283] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-27T17:10:22.014972] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-27T17:10:22.401250] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (2.79 seconds). [2025-10-27T17:10:22.814991] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-27T17:10:23.346633] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-27T17:10:23.614943] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-27T17:10:23.980165] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-27T17:10:24.241695] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T17:10:24.414969] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-27T17:10:25.214985] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-27T17:10:26.010336] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-27T17:10:26.014892] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-27T17:10:26.391933] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-27T17:10:26.743361] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-27T17:10:26.814921] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-27T17:10:27.233528] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-27T17:10:27.614961] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-27T17:10:28.197724] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-27T17:10:28.414965] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-27T17:10:29.214957] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-27T17:10:30.014911] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-27T17:10:30.109289] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-27T17:10:30.145194] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-27T17:10:30.596558] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T17:10:30.815014] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-27T17:10:31.614979] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-27T17:10:32.415009] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-27T17:10:32.429067] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-27T17:10:33.152801] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-27T17:10:33.214898] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-27T17:10:33.274257] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T17:10:34.014993] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-27T17:10:34.500332] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-27T17:10:34.814910] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-27T17:10:34.949231] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-27T17:10:35.377142] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T17:10:35.379230] [INFO ] [REMOTE ] ALUR: Full fetch complete (18318 records). [2025-10-27T17:10:35.379310] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-27T17:10:35.620032] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-27T17:10:35.744713] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-27T17:10:35.744797] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-27T17:10:35.745101] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-27T17:10:35.745147] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-27T17:10:35.745685] [DEBUG] [LOCAL ] ALUR: Trimmed 18318 records to 9135 (keeping 200 days of data) [2025-10-27T17:10:35.795629] [DEBUG] [LOCAL ] ALUR: Primary data saved (9135 records). [2025-10-27T17:10:35.795781] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-27T17:10:35.795861] [INFO ] [MAIN ] Update Progress: 90/2366 symbols completed. ALUR took 30.3s. Estimated remaining: 4h 26m 43s. Rate: 8.5 symbols/min [2025-10-27T17:10:35.960178] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:10:36.009898] [DEBUG] [LOCAL ] AM: Loaded 52592 existing records from primary storage. [2025-10-27T17:10:36.010193] [INFO ] [MAIN ] AM: Loaded 52592 existing records. [2025-10-27T17:10:36.192596] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:10:36.192828] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-27T17:10:36.192888] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-27T17:10:36.193072] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-27T17:10:36.193111] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-27T17:10:36.423264] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-27T17:10:36.547054] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:10:36.620560] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T17:10:36.624780] [INFO ] [REMOTE ] ALTG: Full fetch complete (33323 records). [2025-10-27T17:10:36.624856] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-27T17:10:36.987706] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-27T17:10:36.987806] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-27T17:10:36.988209] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-27T17:10:36.988252] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-27T17:10:36.989001] [DEBUG] [LOCAL ] ALTG: Trimmed 33323 records to 22760 (keeping 200 days of data) [2025-10-27T17:10:37.095980] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-27T17:10:37.122363] [DEBUG] [LOCAL ] ALTG: Primary data saved (22760 records). [2025-10-27T17:10:37.122471] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-27T17:10:37.122542] [INFO ] [MAIN ] Update Progress: 91/2366 symbols completed. ALTG took 32.0s. Estimated remaining: 4h 24m 14s. Rate: 8.6 symbols/min [2025-10-27T17:10:37.220095] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-27T17:10:37.295583] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:10:37.328457] [DEBUG] [LOCAL ] AMBC: Loaded 36371 existing records from primary storage. [2025-10-27T17:10:37.328762] [INFO ] [MAIN ] AMBC: Loaded 36371 existing records. [2025-10-27T17:10:37.505103] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:10:37.505288] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-27T17:10:37.505337] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-27T17:10:37.505521] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-27T17:10:37.505562] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-27T17:10:37.848373] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:10:38.014920] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-27T17:10:38.814940] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-27T17:10:38.911141] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T17:10:39.614970] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-27T17:10:39.673967] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T17:10:40.414934] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-27T17:10:40.844400] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-27T17:10:41.214969] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-27T17:10:41.395757] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T17:10:41.612500] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-27T17:10:41.880088] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-27T17:10:42.014943] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-27T17:10:42.814953] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-27T17:10:43.475874] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-27T17:10:43.614943] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-27T17:10:43.880974] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T17:10:44.414938] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-27T17:10:45.214961] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-27T17:10:45.390784] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-27T17:10:45.608348] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T17:10:45.763421] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-27T17:10:46.014954] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-27T17:10:46.814947] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-27T17:10:46.906905] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-27T17:10:46.909362] [INFO ] [REMOTE ] ALX: Full fetch complete (8259 records). [2025-10-27T17:10:46.909428] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-27T17:10:46.909837] [FATAL] [VALIDATOR ] ALX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:10:46.909915] [FATAL] [MAIN ] ALX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:10:46.909956] [WARN ] [MAIN ] ALX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:10:46.909992] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-27T17:10:46.910045] [DEBUG] [LOCAL ] ALX: No primary data file found to delete. [2025-10-27T17:10:46.910078] [INFO ] [LOCAL ] ALX: Starting deletion of derivative data. [2025-10-27T17:10:46.910226] [DEBUG] [LOCAL ] ALX: Deleted derivative data file. [2025-10-27T17:10:46.910308] [INFO ] [MAIN ] Update Progress: 92/2366 symbols completed. ALX took 27.0s. Estimated remaining: 4h 25m 17s. Rate: 8.6 symbols/min [2025-10-27T17:10:47.073765] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:10:47.124348] [DEBUG] [LOCAL ] AMBP: Loaded 45024 existing records from primary storage. [2025-10-27T17:10:47.124682] [INFO ] [MAIN ] AMBP: Loaded 45024 existing records. [2025-10-27T17:10:47.297049] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:10:47.297246] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-27T17:10:47.297325] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-27T17:10:47.297550] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-27T17:10:47.297604] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-27T17:10:47.622910] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-27T17:10:47.644369] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:10:48.414989] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-27T17:10:48.486124] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T17:10:48.616845] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T17:10:49.214983] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-27T17:10:50.014920] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-27T17:10:50.351024] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-27T17:10:50.386455] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-27T17:10:50.814933] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-27T17:10:51.614922] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-27T17:10:51.947107] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T17:10:52.196966] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-27T17:10:52.414978] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-27T17:10:53.214969] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-27T17:10:53.358805] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-27T17:10:53.762386] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T17:10:54.014968] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-27T17:10:54.765939] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T17:10:54.792144] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T17:10:54.814894] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-27T17:10:55.614987] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-27T17:10:56.296521] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-27T17:10:56.303484] [INFO ] [REMOTE ] AMBC: Full fetch complete (51861 records). [2025-10-27T17:10:56.303572] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-27T17:10:56.420120] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-27T17:10:56.674665] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-27T17:10:56.674745] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-27T17:10:56.675251] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-27T17:10:56.675290] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-27T17:10:56.676260] [DEBUG] [LOCAL ] AMBC: Trimmed 51861 records to 35502 (keeping 200 days of data) [2025-10-27T17:10:56.870315] [DEBUG] [LOCAL ] AMBC: Primary data saved (35502 records). [2025-10-27T17:10:56.870435] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-27T17:10:56.870529] [INFO ] [MAIN ] Update Progress: 93/2366 symbols completed. AMBC took 19.7s. Estimated remaining: 4h 26m 22s. Rate: 8.5 symbols/min [2025-10-27T17:10:57.047683] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:10:57.047920] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-27T17:10:57.048016] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-27T17:10:57.048351] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-27T17:10:57.048545] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-27T17:10:57.048723] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-27T17:10:57.048842] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-27T17:10:57.234921] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-27T17:10:57.367621] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T17:10:57.420456] [INFO ] [REMOTE ] ALV: Full fetch complete (62451 records). [2025-10-27T17:10:57.423681] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-27T17:10:57.448102] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:10:57.823376] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-27T17:10:57.823461] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-27T17:10:57.824104] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-27T17:10:57.824166] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-27T17:10:57.825427] [DEBUG] [LOCAL ] ALV: Trimmed 62451 records to 42134 (keeping 200 days of data) [2025-10-27T17:10:58.033922] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-10-27T17:10:58.089687] [DEBUG] [LOCAL ] ALV: Primary data saved (42134 records). [2025-10-27T17:10:58.089832] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-27T17:10:58.090627] [INFO ] [MAIN ] Update Progress: 94/2366 symbols completed. ALV took 40.6s. Estimated remaining: 4h 23m 54s. Rate: 8.6 symbols/min [2025-10-27T17:10:58.285888] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:10:58.367796] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-27T17:10:58.368938] [DEBUG] [LOCAL ] AMC: Loaded 54546 existing records from primary storage. [2025-10-27T17:10:58.380118] [INFO ] [MAIN ] AMC: Loaded 54546 existing records. [2025-10-27T17:10:58.458249] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:10:58.482238] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-10-27T17:10:58.484633] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:10:58.484761] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-27T17:10:58.484832] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:10:58.490599] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-27T17:10:58.500965] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-27T17:10:58.511260] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-27T17:10:58.529939] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-27T17:10:58.535670] [INFO ] [MAIN ] Update Progress: 95/2366 symbols completed. AMBQ took 1.7s. Estimated remaining: 4h 21m 11s. Rate: 8.7 symbols/min [2025-10-27T17:10:58.597458] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:10:58.629290] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-27T17:10:58.646298] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-27T17:10:58.667494] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-27T17:10:58.678174] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-27T17:10:58.815915] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-27T17:10:58.832487] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:10:59.136005] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:10:59.181931] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-27T17:10:59.184554] [DEBUG] [LOCAL ] AMCR: Loaded 54450 existing records from primary storage. [2025-10-27T17:10:59.194156] [INFO ] [MAIN ] AMCR: Loaded 54450 existing records. [2025-10-27T17:10:59.368428] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:10:59.368670] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-27T17:10:59.368737] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-27T17:10:59.368968] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-27T17:10:59.369012] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-27T17:10:59.620108] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-27T17:10:59.752722] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:11:00.137961] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-27T17:11:00.414940] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-27T17:11:01.214918] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-27T17:11:02.014967] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-27T17:11:02.358490] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.74 seconds). [2025-10-27T17:11:02.823806] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-27T17:11:02.847870] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-27T17:11:03.614996] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-27T17:11:04.116217] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-27T17:11:04.347815] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (3.13 seconds). [2025-10-27T17:11:04.415000] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-27T17:11:05.160486] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-27T17:11:05.214908] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-27T17:11:05.492036] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-27T17:11:05.767021] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-27T17:11:06.014924] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-27T17:11:06.815008] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-27T17:11:07.056010] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T17:11:07.582835] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T17:11:07.614900] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-27T17:11:08.345743] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T17:11:08.414945] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-27T17:11:09.215000] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-27T17:11:09.832344] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T17:11:09.876518] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-27T17:11:10.014973] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-27T17:11:10.814932] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-27T17:11:11.109566] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-27T17:11:11.614944] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-27T17:11:12.415019] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-27T17:11:13.016761] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (3.00 seconds). [2025-10-27T17:11:13.027128] [INFO ] [REMOTE ] AM: Full fetch complete (75654 records). [2025-10-27T17:11:13.027270] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-27T17:11:13.356186] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-27T17:11:13.387890] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-27T17:11:13.476227] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-27T17:11:13.476304] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-27T17:11:13.477050] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-27T17:11:13.477113] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-27T17:11:13.478540] [DEBUG] [LOCAL ] AM: Trimmed 75654 records to 51802 (keeping 200 days of data) [2025-10-27T17:11:13.792744] [DEBUG] [LOCAL ] AM: Primary data saved (51802 records). [2025-10-27T17:11:13.792987] [INFO ] [MAIN ] AM: Full history saved. [2025-10-27T17:11:13.794020] [INFO ] [MAIN ] Update Progress: 96/2366 symbols completed. AM took 38.0s. Estimated remaining: 4h 24m 22s. Rate: 8.6 symbols/min [2025-10-27T17:11:13.965499] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:11:13.996947] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T17:11:14.014910] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-27T17:11:14.050201] [DEBUG] [LOCAL ] AME: Loaded 49145 existing records from primary storage. [2025-10-27T17:11:14.050489] [INFO ] [MAIN ] AME: Loaded 49145 existing records. [2025-10-27T17:11:14.234473] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:11:14.234871] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-27T17:11:14.234980] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-27T17:11:14.235350] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-27T17:11:14.235408] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-27T17:11:14.601083] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:11:14.686525] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (3.07 seconds). [2025-10-27T17:11:14.752266] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-27T17:11:14.814911] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-27T17:11:15.598487] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T17:11:15.614899] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-27T17:11:16.414911] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-27T17:11:16.653995] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-27T17:11:17.214939] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-27T17:11:17.589108] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-27T17:11:18.014955] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-27T17:11:18.812079] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T17:11:18.821683] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-27T17:11:18.944221] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-27T17:11:19.384100] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-27T17:11:19.614968] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-27T17:11:20.414997] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-27T17:11:20.969400] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-27T17:11:20.977249] [INFO ] [REMOTE ] AMBP: Full fetch complete (64998 records). [2025-10-27T17:11:20.977437] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-27T17:11:21.233049] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-27T17:11:21.368774] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-27T17:11:21.368847] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-27T17:11:21.369464] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-27T17:11:21.369502] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-27T17:11:21.370748] [DEBUG] [LOCAL ] AMBP: Trimmed 64998 records to 44283 (keeping 200 days of data) [2025-10-27T17:11:21.615211] [DEBUG] [LOCAL ] AMBP: Primary data saved (44283 records). [2025-10-27T17:11:21.615333] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-27T17:11:21.617293] [INFO ] [MAIN ] Update Progress: 97/2366 symbols completed. AMBP took 34.7s. Estimated remaining: 4h 24m 35s. Rate: 8.6 symbols/min [2025-10-27T17:11:21.796120] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:11:21.826117] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-27T17:11:21.853968] [DEBUG] [LOCAL ] AMG: Loaded 20306 existing records from primary storage. [2025-10-27T17:11:21.854224] [INFO ] [MAIN ] AMG: Loaded 20306 existing records. [2025-10-27T17:11:22.045577] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-27T17:11:22.055319] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:11:22.066396] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-27T17:11:22.066528] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-27T17:11:22.068207] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-27T17:11:22.069222] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T17:11:22.077849] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-27T17:11:22.434221] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:11:22.814956] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-27T17:11:23.614934] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-27T17:11:23.919935] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-10-27T17:11:24.138594] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-27T17:11:24.324090] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-27T17:11:24.414902] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-27T17:11:25.214989] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-27T17:11:25.918097] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-27T17:11:26.014917] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-27T17:11:26.636585] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-27T17:11:26.814934] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-27T17:11:27.068460] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-27T17:11:27.078800] [INFO ] [REMOTE ] AMCR: Full fetch complete (77843 records). [2025-10-27T17:11:27.078923] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-27T17:11:27.478504] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-27T17:11:27.478699] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-27T17:11:27.479589] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-27T17:11:27.479694] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-27T17:11:27.481386] [DEBUG] [LOCAL ] AMCR: Trimmed 77843 records to 53670 (keeping 200 days of data) [2025-10-27T17:11:27.667798] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-27T17:11:27.679038] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T17:11:27.769446] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-27T17:11:27.861453] [DEBUG] [LOCAL ] AMCR: Primary data saved (53670 records). [2025-10-27T17:11:27.861594] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-27T17:11:27.861699] [INFO ] [MAIN ] Update Progress: 98/2366 symbols completed. AMCR took 29.3s. Estimated remaining: 4h 24m 10s. Rate: 8.6 symbols/min [2025-10-27T17:11:28.038303] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:11:28.083393] [DEBUG] [LOCAL ] AMH: Loaded 52581 existing records from primary storage. [2025-10-27T17:11:28.083781] [INFO ] [MAIN ] AMH: Loaded 52581 existing records. [2025-10-27T17:11:28.261383] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:11:28.261575] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-27T17:11:28.261620] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-27T17:11:28.261978] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-27T17:11:28.262034] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-27T17:11:28.416818] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-27T17:11:28.630419] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:11:29.215005] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-27T17:11:30.014937] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-27T17:11:30.086511] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-27T17:11:30.131002] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-27T17:11:30.814972] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-27T17:11:31.172976] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-27T17:11:31.614930] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-27T17:11:31.669087] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-27T17:11:32.414982] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-27T17:11:32.779428] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-27T17:11:32.936104] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-27T17:11:32.946124] [INFO ] [REMOTE ] AMC: Full fetch complete (77930 records). [2025-10-27T17:11:32.946235] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-27T17:11:33.220209] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-27T17:11:33.346694] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-27T17:11:33.346777] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-27T17:11:33.347578] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-27T17:11:33.347663] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-27T17:11:33.349144] [DEBUG] [LOCAL ] AMC: Trimmed 77930 records to 53766 (keeping 200 days of data) [2025-10-27T17:11:33.637892] [DEBUG] [LOCAL ] AMC: Primary data saved (53766 records). [2025-10-27T17:11:33.638020] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-27T17:11:33.638698] [INFO ] [MAIN ] Update Progress: 99/2366 symbols completed. AMC took 35.5s. Estimated remaining: 4h 23m 36s. Rate: 8.6 symbols/min [2025-10-27T17:11:33.818851] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:11:33.860370] [DEBUG] [LOCAL ] AMN: Loaded 42147 existing records from primary storage. [2025-10-27T17:11:33.860716] [INFO ] [MAIN ] AMN: Loaded 42147 existing records. [2025-10-27T17:11:34.027532] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-27T17:11:34.078074] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:11:34.079892] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-27T17:11:34.080055] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-27T17:11:34.089263] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-27T17:11:34.089823] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-27T17:11:34.089882] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-27T17:11:34.455407] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:11:34.610268] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-27T17:11:34.814952] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-27T17:11:35.206830] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T17:11:35.614963] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-27T17:11:36.414922] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-27T17:11:36.609566] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-27T17:11:36.660598] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T17:11:37.214945] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-27T17:11:37.847293] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T17:11:38.014994] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-27T17:11:38.818514] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-27T17:11:38.824075] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T17:11:38.903834] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T17:11:39.614914] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-27T17:11:39.999807] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-27T17:11:40.414927] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-27T17:11:40.576738] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-27T17:11:41.214987] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-27T17:11:41.620909] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T17:11:41.879454] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T17:11:42.014910] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-27T17:11:42.814994] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-27T17:11:43.096366] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T17:11:43.100179] [INFO ] [REMOTE ] AMG: Full fetch complete (29493 records). [2025-10-27T17:11:43.100249] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-27T17:11:43.458384] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-27T17:11:43.458480] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-27T17:11:43.458852] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-27T17:11:43.458913] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-27T17:11:43.459729] [DEBUG] [LOCAL ] AMG: Trimmed 29493 records to 19768 (keeping 200 days of data) [2025-10-27T17:11:43.578640] [DEBUG] [LOCAL ] AMG: Primary data saved (19768 records). [2025-10-27T17:11:43.578791] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-27T17:11:43.578866] [INFO ] [MAIN ] Update Progress: 100/2366 symbols completed. AMG took 22.0s. Estimated remaining: 4h 24m 36s. Rate: 8.6 symbols/min [2025-10-27T17:11:43.624526] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-27T17:11:43.752697] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:11:43.782053] [DEBUG] [LOCAL ] AMP: Loaded 32168 existing records from primary storage. [2025-10-27T17:11:43.782306] [INFO ] [MAIN ] AMP: Loaded 32168 existing records. [2025-10-27T17:11:43.960446] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:11:43.960687] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-27T17:11:43.960762] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-27T17:11:43.961054] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-27T17:11:43.961125] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-27T17:11:44.307389] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:11:44.414903] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-27T17:11:44.837789] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-27T17:11:45.214908] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-27T17:11:45.450589] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-27T17:11:45.689633] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T17:11:46.014975] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-27T17:11:46.650983] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T17:11:46.814945] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-27T17:11:47.614954] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-27T17:11:48.011202] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-27T17:11:48.414928] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-27T17:11:48.479088] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T17:11:48.488477] [INFO ] [REMOTE ] AME: Full fetch complete (70232 records). [2025-10-27T17:11:48.488612] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-27T17:11:48.878208] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-27T17:11:48.878301] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-27T17:11:48.879060] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-27T17:11:48.879138] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-27T17:11:48.880733] [DEBUG] [LOCAL ] AME: Trimmed 70232 records to 48327 (keeping 200 days of data) [2025-10-27T17:11:48.909181] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T17:11:49.209609] [DEBUG] [LOCAL ] AME: Primary data saved (48327 records). [2025-10-27T17:11:49.209766] [INFO ] [MAIN ] AME: Full history saved. [2025-10-27T17:11:49.210390] [INFO ] [MAIN ] Update Progress: 101/2366 symbols completed. AME took 35.4s. Estimated remaining: 4h 23m 58s. Rate: 8.6 symbols/min [2025-10-27T17:11:49.231273] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-27T17:11:49.385514] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:11:49.434520] [DEBUG] [LOCAL ] AMPX: Loaded 53219 existing records from primary storage. [2025-10-27T17:11:49.434845] [INFO ] [MAIN ] AMPX: Loaded 53219 existing records. [2025-10-27T17:11:49.617336] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:11:49.617748] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-27T17:11:49.617828] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-27T17:11:49.618205] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-27T17:11:49.618304] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-27T17:11:49.910824] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T17:11:50.016452] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-27T17:11:50.019742] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:11:50.223199] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-27T17:11:50.814943] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-27T17:11:51.448607] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T17:11:51.614940] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-27T17:11:52.323632] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-27T17:11:52.414948] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-27T17:11:53.214933] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-27T17:11:53.411486] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-27T17:11:53.615105] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T17:11:54.014959] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-27T17:11:54.636840] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T17:11:54.814918] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-27T17:11:55.469389] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T17:11:55.614924] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-27T17:11:56.414922] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-27T17:11:56.470017] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-27T17:11:57.214928] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-27T17:11:57.277520] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T17:11:57.510088] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T17:11:58.014955] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-27T17:11:58.814925] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-27T17:11:59.217752] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-27T17:11:59.620792] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-27T17:11:59.634670] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T17:12:00.414954] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-27T17:12:01.169217] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-27T17:12:01.179476] [INFO ] [REMOTE ] AMH: Full fetch complete (75133 records). [2025-10-27T17:12:01.179628] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-27T17:12:01.222302] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-27T17:12:01.597802] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-27T17:12:01.597921] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-27T17:12:01.598695] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-27T17:12:01.598858] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-27T17:12:01.620390] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-27T17:12:01.628124] [DEBUG] [LOCAL ] AMH: Trimmed 75133 records to 51793 (keeping 200 days of data) [2025-10-27T17:12:01.950122] [DEBUG] [LOCAL ] AMH: Primary data saved (51793 records). [2025-10-27T17:12:01.950252] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-27T17:12:01.951286] [INFO ] [MAIN ] Update Progress: 102/2366 symbols completed. AMH took 34.1s. Estimated remaining: 4h 25m 59s. Rate: 8.5 symbols/min [2025-10-27T17:12:02.021732] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-27T17:12:02.127494] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:12:02.167260] [DEBUG] [LOCAL ] AMPY: Loaded 40008 existing records from primary storage. [2025-10-27T17:12:02.167625] [INFO ] [MAIN ] AMPY: Loaded 40008 existing records. [2025-10-27T17:12:02.363816] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:12:02.364043] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-27T17:12:02.364091] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-27T17:12:02.364306] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-27T17:12:02.364363] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-27T17:12:02.726798] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:12:02.761546] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-27T17:12:02.814906] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-27T17:12:02.912927] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T17:12:03.614917] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-27T17:12:03.945055] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-27T17:12:04.347075] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-27T17:12:04.375466] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-27T17:12:04.414911] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-27T17:12:05.214920] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-27T17:12:05.394069] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-27T17:12:06.014963] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-27T17:12:06.814973] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-27T17:12:07.183614] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-27T17:12:07.308188] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T17:12:07.614908] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-27T17:12:08.076972] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-27T17:12:08.414944] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-27T17:12:08.873701] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T17:12:09.214988] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-27T17:12:09.955464] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T17:12:10.014909] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-27T17:12:10.814917] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-27T17:12:10.866309] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-27T17:12:10.872361] [INFO ] [REMOTE ] AMP: Full fetch complete (47498 records). [2025-10-27T17:12:10.872459] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-27T17:12:11.246896] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-27T17:12:11.246972] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-27T17:12:11.247494] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-27T17:12:11.247556] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-27T17:12:11.248525] [DEBUG] [LOCAL ] AMP: Trimmed 47498 records to 31375 (keeping 200 days of data) [2025-10-27T17:12:11.438159] [DEBUG] [LOCAL ] AMP: Primary data saved (31375 records). [2025-10-27T17:12:11.438285] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-27T17:12:11.439270] [INFO ] [MAIN ] Update Progress: 103/2366 symbols completed. AMP took 27.9s. Estimated remaining: 4h 26m 45s. Rate: 8.5 symbols/min [2025-10-27T17:12:11.603201] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:12:11.621439] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-27T17:12:11.635104] [DEBUG] [LOCAL ] AMR: Loaded 29133 existing records from primary storage. [2025-10-27T17:12:11.635354] [INFO ] [MAIN ] AMR: Loaded 29133 existing records. [2025-10-27T17:12:11.817117] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:12:11.817389] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-27T17:12:11.817487] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-27T17:12:11.817991] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-27T17:12:11.818075] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-27T17:12:12.135833] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-27T17:12:12.236295] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:12:12.295485] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-27T17:12:12.414931] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-27T17:12:13.162566] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T17:12:13.214929] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-27T17:12:14.015011] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-27T17:12:14.155397] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-27T17:12:14.814941] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-27T17:12:14.875815] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T17:12:15.446434] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T17:12:15.454227] [INFO ] [REMOTE ] AMN: Full fetch complete (60174 records). [2025-10-27T17:12:15.454329] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-27T17:12:15.620519] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-27T17:12:15.855461] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-27T17:12:15.855539] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-27T17:12:15.856133] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-27T17:12:15.856194] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-27T17:12:15.857321] [DEBUG] [LOCAL ] AMN: Trimmed 60174 records to 41409 (keeping 200 days of data) [2025-10-27T17:12:16.091661] [DEBUG] [LOCAL ] AMN: Primary data saved (41409 records). [2025-10-27T17:12:16.091789] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-27T17:12:16.092733] [INFO ] [MAIN ] Update Progress: 104/2366 symbols completed. AMN took 42.5s. Estimated remaining: 4h 25m 45s. Rate: 8.5 symbols/min [2025-10-27T17:12:16.269702] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:12:16.307889] [DEBUG] [LOCAL ] AMRC: Loaded 39067 existing records from primary storage. [2025-10-27T17:12:16.308239] [INFO ] [MAIN ] AMRC: Loaded 39067 existing records. [2025-10-27T17:12:16.424271] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-27T17:12:16.445022] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-27T17:12:16.592963] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:12:16.593519] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-27T17:12:16.593610] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-27T17:12:16.593982] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-27T17:12:16.594253] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-27T17:12:16.733033] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T17:12:16.989780] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:12:17.214943] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-27T17:12:18.014917] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-27T17:12:18.340765] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T17:12:18.446709] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-27T17:12:18.814935] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-27T17:12:19.614953] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-27T17:12:19.740715] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-27T17:12:20.414969] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-27T17:12:20.682392] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T17:12:21.215044] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-27T17:12:21.430439] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-27T17:12:21.477308] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-27T17:12:21.487057] [INFO ] [REMOTE ] AMPX: Full fetch complete (74879 records). [2025-10-27T17:12:21.487188] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-27T17:12:21.488024] [FATAL] [VALIDATOR ] AMPX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:12:21.488112] [FATAL] [MAIN ] AMPX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:12:21.488154] [WARN ] [MAIN ] AMPX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:12:21.488191] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-27T17:12:21.488251] [DEBUG] [LOCAL ] AMPX: No primary data file found to delete. [2025-10-27T17:12:21.488284] [INFO ] [LOCAL ] AMPX: Starting deletion of derivative data. [2025-10-27T17:12:21.488508] [DEBUG] [LOCAL ] AMPX: Deleted derivative data file. [2025-10-27T17:12:21.488925] [INFO ] [MAIN ] Update Progress: 105/2366 symbols completed. AMPX took 32.3s. Estimated remaining: 4h 25m 3s. Rate: 8.5 symbols/min [2025-10-27T17:12:21.654915] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:12:21.655043] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-27T17:12:21.655078] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-27T17:12:21.655180] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-27T17:12:21.655220] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-27T17:12:21.655262] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-27T17:12:21.655292] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-27T17:12:22.005240] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:12:22.014912] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-10-27T17:12:22.674768] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:12:22.675293] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-10-27T17:12:22.693222] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:12:22.693362] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-27T17:12:22.694118] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:12:22.694978] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-27T17:12:22.694870] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T17:12:22.695148] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-27T17:12:22.701823] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-27T17:12:22.702631] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-27T17:12:22.702745] [INFO ] [MAIN ] Update Progress: 106/2366 symbols completed. AMRZ took 1.2s. Estimated remaining: 4h 22m 52s. Rate: 8.6 symbols/min [2025-10-27T17:12:22.820168] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-27T17:12:22.870575] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:12:22.924597] [DEBUG] [LOCAL ] AMT: Loaded 53186 existing records from primary storage. [2025-10-27T17:12:22.924977] [INFO ] [MAIN ] AMT: Loaded 53186 existing records. [2025-10-27T17:12:23.099088] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:12:23.099310] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-27T17:12:23.099373] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-27T17:12:23.099701] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-27T17:12:23.099757] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-27T17:12:23.456680] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:12:23.614960] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-27T17:12:23.710589] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T17:12:24.415001] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-27T17:12:24.862041] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T17:12:25.214961] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-27T17:12:25.500103] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-27T17:12:26.014970] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-27T17:12:26.643243] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T17:12:26.814941] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-27T17:12:27.102625] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-27T17:12:27.615010] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-27T17:12:28.345547] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T17:12:28.414940] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-27T17:12:28.814409] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T17:12:29.214941] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-27T17:12:30.014942] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-27T17:12:30.113002] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-27T17:12:30.814961] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-27T17:12:31.160352] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-27T17:12:31.265811] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T17:12:31.614955] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-27T17:12:32.305880] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T17:12:32.414969] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-27T17:12:32.963117] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T17:12:33.214963] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-27T17:12:33.974951] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-27T17:12:33.984127] [INFO ] [REMOTE ] AMPY: Full fetch complete (53700 records). [2025-10-27T17:12:33.984296] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-27T17:12:34.020080] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-27T17:12:34.394779] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-27T17:12:34.394880] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-27T17:12:34.395477] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-27T17:12:34.395519] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-27T17:12:34.396942] [DEBUG] [LOCAL ] AMPY: Trimmed 53700 records to 39370 (keeping 200 days of data) [2025-10-27T17:12:34.616196] [DEBUG] [LOCAL ] AMPY: Primary data saved (39370 records). [2025-10-27T17:12:34.616435] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-27T17:12:34.617230] [INFO ] [MAIN ] Update Progress: 107/2366 symbols completed. AMPY took 32.7s. Estimated remaining: 4h 24m 29s. Rate: 8.5 symbols/min [2025-10-27T17:12:34.813669] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:12:34.823250] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-27T17:12:34.842119] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T17:12:34.867226] [DEBUG] [LOCAL ] AMTB: Loaded 20875 existing records from primary storage. [2025-10-27T17:12:34.867520] [INFO ] [MAIN ] AMTB: Loaded 20875 existing records. [2025-10-27T17:12:35.049087] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:12:35.049305] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-27T17:12:35.049352] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-27T17:12:35.049594] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-27T17:12:35.049690] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-27T17:12:35.395618] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:12:35.614907] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-27T17:12:35.729836] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T17:12:36.246998] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T17:12:36.414938] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-27T17:12:36.620992] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T17:12:37.215007] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-27T17:12:38.014917] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-27T17:12:38.175297] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-27T17:12:38.815005] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-27T17:12:39.130450] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-27T17:12:39.236808] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-27T17:12:39.614953] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-27T17:12:39.988576] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T17:12:40.414991] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-27T17:12:40.607238] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-27T17:12:41.214958] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-27T17:12:41.426542] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-27T17:12:41.431833] [INFO ] [REMOTE ] AMR: Full fetch complete (40658 records). [2025-10-27T17:12:41.431915] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-27T17:12:41.807997] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-27T17:12:41.808075] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-27T17:12:41.808504] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-27T17:12:41.808545] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-27T17:12:41.809458] [DEBUG] [LOCAL ] AMR: Trimmed 40658 records to 28408 (keeping 200 days of data) [2025-10-27T17:12:41.983020] [DEBUG] [LOCAL ] AMR: Primary data saved (28408 records). [2025-10-27T17:12:41.983235] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-27T17:12:41.983339] [INFO ] [MAIN ] Update Progress: 108/2366 symbols completed. AMR took 30.5s. Estimated remaining: 4h 24m 29s. Rate: 8.5 symbols/min [2025-10-27T17:12:42.020070] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-27T17:12:42.165983] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:12:42.172741] [DEBUG] [LOCAL ] AMTD: Loaded 3828 existing records from primary storage. [2025-10-27T17:12:42.172944] [INFO ] [MAIN ] AMTD: Loaded 3828 existing records. [2025-10-27T17:12:42.361234] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:12:42.361525] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-27T17:12:42.361577] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-27T17:12:42.361792] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-27T17:12:42.361852] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-27T17:12:42.740607] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:12:42.814935] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-27T17:12:43.110099] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-27T17:12:43.619023] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-27T17:12:43.621504] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-27T17:12:43.629506] [INFO ] [REMOTE ] AMRC: Full fetch complete (54689 records). [2025-10-27T17:12:43.629594] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-27T17:12:44.015504] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-27T17:12:44.015605] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-27T17:12:44.016242] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-27T17:12:44.016299] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-27T17:12:44.017500] [DEBUG] [LOCAL ] AMRC: Trimmed 54689 records to 38274 (keeping 200 days of data) [2025-10-27T17:12:44.233125] [DEBUG] [LOCAL ] AMRC: Primary data saved (38274 records). [2025-10-27T17:12:44.233257] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-27T17:12:44.233795] [INFO ] [MAIN ] Update Progress: 109/2366 symbols completed. AMRC took 28.1s. Estimated remaining: 4h 22m 43s. Rate: 8.6 symbols/min [2025-10-27T17:12:44.413541] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:12:44.418747] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-27T17:12:44.425826] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T17:12:44.475312] [DEBUG] [LOCAL ] AMTM: Loaded 50952 existing records from primary storage. [2025-10-27T17:12:44.475602] [INFO ] [MAIN ] AMTM: Loaded 50952 existing records. [2025-10-27T17:12:44.649783] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:12:44.649999] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-27T17:12:44.650045] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-27T17:12:44.650225] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-27T17:12:44.650263] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-27T17:12:45.004930] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:12:45.106821] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T17:12:45.214935] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-27T17:12:45.613288] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T17:12:46.014993] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-27T17:12:46.543350] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-27T17:12:46.814942] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-27T17:12:47.390298] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T17:12:47.521697] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T17:12:47.614940] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-27T17:12:48.414937] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-27T17:12:48.512154] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-27T17:12:49.026422] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-27T17:12:49.214955] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-27T17:12:50.014930] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-27T17:12:50.765438] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-27T17:12:50.814929] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-27T17:12:51.437575] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T17:12:51.614925] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-27T17:12:52.414936] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-27T17:12:52.614980] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T17:12:53.054061] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T17:12:53.214916] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-27T17:12:53.379955] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T17:12:54.014990] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-27T17:12:54.743372] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T17:12:54.753452] [INFO ] [REMOTE ] AMT: Full fetch complete (76158 records). [2025-10-27T17:12:54.753577] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-27T17:12:54.820174] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-27T17:12:55.142499] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-27T17:12:55.142575] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-27T17:12:55.143288] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-27T17:12:55.143349] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-27T17:12:55.144927] [DEBUG] [LOCAL ] AMT: Trimmed 76158 records to 52406 (keeping 200 days of data) [2025-10-27T17:12:55.428313] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T17:12:55.535942] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-27T17:12:55.543294] [DEBUG] [LOCAL ] AMT: Primary data saved (52406 records). [2025-10-27T17:12:55.543408] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-27T17:12:55.543816] [INFO ] [MAIN ] Update Progress: 110/2366 symbols completed. AMT took 32.8s. Estimated remaining: 4h 24m 5s. Rate: 8.5 symbols/min [2025-10-27T17:12:55.620019] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-27T17:12:55.713053] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:12:55.723952] [DEBUG] [LOCAL ] AMWL: Loaded 9978 existing records from primary storage. [2025-10-27T17:12:55.724185] [INFO ] [MAIN ] AMWL: Loaded 9978 existing records. [2025-10-27T17:12:55.899512] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:12:55.899736] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-27T17:12:55.899788] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-27T17:12:55.899934] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-27T17:12:55.899970] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-27T17:12:56.251137] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:12:56.414914] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-27T17:12:56.798365] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T17:12:57.121793] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-27T17:12:57.214953] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-27T17:12:57.902784] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-27T17:12:58.014932] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-27T17:12:58.770306] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T17:12:58.814903] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-27T17:12:59.614969] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-27T17:13:00.420063] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-27T17:13:00.438250] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T17:13:00.773466] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-27T17:13:00.779268] [INFO ] [REMOTE ] AMTB: Full fetch complete (29791 records). [2025-10-27T17:13:00.779355] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-27T17:13:01.137413] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-27T17:13:01.137499] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-27T17:13:01.137862] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-27T17:13:01.137922] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-27T17:13:01.138578] [DEBUG] [LOCAL ] AMTB: Trimmed 29791 records to 20491 (keeping 200 days of data) [2025-10-27T17:13:01.226533] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-27T17:13:01.270356] [DEBUG] [LOCAL ] AMTB: Primary data saved (20491 records). [2025-10-27T17:13:01.270521] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-27T17:13:01.270616] [INFO ] [MAIN ] Update Progress: 111/2366 symbols completed. AMTB took 26.7s. Estimated remaining: 4h 23m 31s. Rate: 8.6 symbols/min [2025-10-27T17:13:01.445699] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:13:01.493079] [DEBUG] [LOCAL ] AMX: Loaded 49882 existing records from primary storage. [2025-10-27T17:13:01.493426] [INFO ] [MAIN ] AMX: Loaded 49882 existing records. [2025-10-27T17:13:01.673033] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:13:01.673245] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-27T17:13:01.673292] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-27T17:13:01.673484] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-27T17:13:01.673524] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-27T17:13:02.024283] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-27T17:13:02.030551] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:13:02.814965] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-27T17:13:03.703179] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-27T17:13:03.713859] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-27T17:13:03.831606] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-27T17:13:03.845850] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (3.43 seconds). [2025-10-27T17:13:04.203541] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T17:13:04.415006] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-27T17:13:04.756750] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-27T17:13:05.214956] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-27T17:13:05.530020] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-27T17:13:06.015023] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-27T17:13:06.331460] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T17:13:06.814957] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-27T17:13:06.826630] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T17:13:07.614948] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-27T17:13:08.012554] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-27T17:13:08.414949] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-27T17:13:09.214919] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-27T17:13:09.787489] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-27T17:13:09.793294] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T17:13:10.014942] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-27T17:13:10.531623] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T17:13:10.811594] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-27T17:13:10.814885] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-27T17:13:11.614934] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-27T17:13:11.695590] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-27T17:13:12.091849] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-27T17:13:12.414939] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-27T17:13:12.779210] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-27T17:13:13.214934] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-27T17:13:13.959632] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-27T17:13:14.014927] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-27T17:13:14.695864] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-27T17:13:14.814957] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-27T17:13:15.615004] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-27T17:13:16.414979] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-27T17:13:16.464495] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-27T17:13:16.993187] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T17:13:17.007890] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-27T17:13:17.214983] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-27T17:13:17.616312] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-27T17:13:18.014993] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-27T17:13:18.755904] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T17:13:18.757149] [INFO ] [REMOTE ] AMTD: Full fetch complete (5358 records). [2025-10-27T17:13:18.757217] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-27T17:13:18.820069] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-27T17:13:19.111871] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-27T17:13:19.111981] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-27T17:13:19.112150] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-27T17:13:19.112191] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-27T17:13:19.112543] [DEBUG] [LOCAL ] AMTD: Trimmed 5358 records to 3794 (keeping 200 days of data) [2025-10-27T17:13:19.133039] [DEBUG] [LOCAL ] AMTD: Primary data saved (3794 records). [2025-10-27T17:13:19.133107] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-27T17:13:19.133185] [INFO ] [MAIN ] Update Progress: 112/2366 symbols completed. AMTD took 37.1s. Estimated remaining: 4h 27m 3s. Rate: 8.4 symbols/min [2025-10-27T17:13:19.300950] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:13:19.329912] [DEBUG] [LOCAL ] AN: Loaded 31602 existing records from primary storage. [2025-10-27T17:13:19.330191] [INFO ] [MAIN ] AN: Loaded 31602 existing records. [2025-10-27T17:13:19.505009] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:13:19.505203] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-27T17:13:19.505248] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-27T17:13:19.505443] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-27T17:13:19.505481] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-27T17:13:19.620099] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-27T17:13:19.859076] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:13:20.414920] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-27T17:13:20.646544] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-27T17:13:20.655726] [INFO ] [REMOTE ] AMTM: Full fetch complete (73508 records). [2025-10-27T17:13:20.655846] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-27T17:13:21.043817] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-27T17:13:21.043899] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-27T17:13:21.044626] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-27T17:13:21.044713] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-27T17:13:21.046088] [DEBUG] [LOCAL ] AMTM: Trimmed 73508 records to 50131 (keeping 200 days of data) [2025-10-27T17:13:21.214963] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-27T17:13:21.332200] [DEBUG] [LOCAL ] AMTM: Primary data saved (50131 records). [2025-10-27T17:13:21.332322] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-27T17:13:21.332396] [INFO ] [MAIN ] Update Progress: 113/2366 symbols completed. AMTM took 37.1s. Estimated remaining: 4h 25m 18s. Rate: 8.5 symbols/min [2025-10-27T17:13:21.419029] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-27T17:13:21.520598] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:13:21.571218] [DEBUG] [LOCAL ] ANET: Loaded 54546 existing records from primary storage. [2025-10-27T17:13:21.571524] [INFO ] [MAIN ] ANET: Loaded 54546 existing records. [2025-10-27T17:13:21.779481] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:13:21.782382] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-27T17:13:21.782443] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-27T17:13:21.782892] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-27T17:13:21.783209] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-27T17:13:21.785005] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-27T17:13:22.020186] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-27T17:13:22.152557] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:13:22.641882] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T17:13:22.814945] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-27T17:13:23.203101] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T17:13:23.614954] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-27T17:13:24.414959] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-27T17:13:25.021393] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T17:13:25.196208] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-27T17:13:25.200092] [INFO ] [REMOTE ] AMWL: Full fetch complete (14742 records). [2025-10-27T17:13:25.200175] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-27T17:13:25.200597] [FATAL] [VALIDATOR ] AMWL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:13:25.200717] [FATAL] [MAIN ] AMWL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:13:25.200803] [WARN ] [MAIN ] AMWL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:13:25.200894] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-27T17:13:25.200975] [DEBUG] [LOCAL ] AMWL: No primary data file found to delete. [2025-10-27T17:13:25.201014] [INFO ] [LOCAL ] AMWL: Starting deletion of derivative data. [2025-10-27T17:13:25.201157] [DEBUG] [LOCAL ] AMWL: Deleted derivative data file. [2025-10-27T17:13:25.201269] [INFO ] [MAIN ] Update Progress: 114/2366 symbols completed. AMWL took 29.7s. Estimated remaining: 4h 24m 8s. Rate: 8.5 symbols/min [2025-10-27T17:13:25.222417] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-27T17:13:25.376434] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:13:25.427790] [DEBUG] [LOCAL ] ANF: Loaded 52772 existing records from primary storage. [2025-10-27T17:13:25.428099] [INFO ] [MAIN ] ANF: Loaded 52772 existing records. [2025-10-27T17:13:25.603112] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:13:25.603354] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-27T17:13:25.603403] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-27T17:13:25.603676] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-27T17:13:25.603731] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-27T17:13:25.960745] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (3.15 seconds). [2025-10-27T17:13:26.005730] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:13:26.014953] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-27T17:13:26.429463] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T17:13:26.815017] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-27T17:13:27.614968] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-27T17:13:27.989966] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-27T17:13:28.422517] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-27T17:13:28.424984] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T17:13:28.673464] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T17:13:29.214952] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-27T17:13:30.014977] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-27T17:13:30.261640] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-27T17:13:30.471957] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T17:13:30.814925] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-27T17:13:31.614934] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-27T17:13:31.998681] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-27T17:13:32.178448] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-27T17:13:32.188009] [INFO ] [REMOTE ] AMX: Full fetch complete (71013 records). [2025-10-27T17:13:32.188140] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-27T17:13:32.424235] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-27T17:13:32.599674] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-27T17:13:32.599767] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-27T17:13:32.600487] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-27T17:13:32.600548] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-27T17:13:32.601886] [DEBUG] [LOCAL ] AMX: Trimmed 71013 records to 49065 (keeping 200 days of data) [2025-10-27T17:13:32.884143] [DEBUG] [LOCAL ] AMX: Primary data saved (49065 records). [2025-10-27T17:13:32.884266] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-27T17:13:32.885165] [INFO ] [MAIN ] Update Progress: 115/2366 symbols completed. AMX took 31.6s. Estimated remaining: 4h 24m 13s. Rate: 8.5 symbols/min [2025-10-27T17:13:33.055194] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:13:33.055428] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-27T17:13:33.055497] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-27T17:13:33.055683] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-27T17:13:33.055808] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-27T17:13:33.055941] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-27T17:13:33.055990] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-27T17:13:33.194925] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T17:13:33.223848] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-27T17:13:33.453531] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:13:34.014932] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-10-27T17:13:34.075849] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-27T17:13:34.220705] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:13:34.220996] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-10-27T17:13:34.221090] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:13:34.221137] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-27T17:13:34.221197] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:13:34.221267] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-27T17:13:34.221331] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-27T17:13:34.221367] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-27T17:13:34.221406] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-27T17:13:34.221450] [INFO ] [MAIN ] Update Progress: 116/2366 symbols completed. ANGX took 1.3s. Estimated remaining: 4h 22m 15s. Rate: 8.6 symbols/min [2025-10-27T17:13:34.386944] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:13:34.405537] [DEBUG] [LOCAL ] ANRO: Loaded 20129 existing records from primary storage. [2025-10-27T17:13:34.405795] [INFO ] [MAIN ] ANRO: Loaded 20129 existing records. [2025-10-27T17:13:34.583102] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:13:34.583304] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-27T17:13:34.583373] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-27T17:13:34.583589] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-27T17:13:34.583634] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-27T17:13:34.823581] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-27T17:13:34.970777] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:13:35.062950] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T17:13:35.614969] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-27T17:13:36.415010] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-27T17:13:36.659816] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-27T17:13:37.220335] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-27T17:13:37.228564] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-27T17:13:38.014936] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-27T17:13:38.287044] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-10-27T17:13:38.814947] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-27T17:13:39.614929] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-27T17:13:39.797903] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T17:13:39.833383] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-27T17:13:40.415001] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-27T17:13:40.459320] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T17:13:41.040437] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-27T17:13:41.214941] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-27T17:13:42.018980] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-27T17:13:42.023244] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T17:13:42.290217] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T17:13:42.814914] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-27T17:13:43.467238] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T17:13:43.614953] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-27T17:13:44.414937] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-27T17:13:44.589402] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-27T17:13:44.744593] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-27T17:13:45.200398] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-27T17:13:45.214917] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-27T17:13:46.014987] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-27T17:13:46.667617] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-27T17:13:46.673674] [INFO ] [REMOTE ] AN: Full fetch complete (47236 records). [2025-10-27T17:13:46.673805] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-27T17:13:46.821759] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-27T17:13:47.059872] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-27T17:13:47.059956] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-27T17:13:47.060478] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-27T17:13:47.060522] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-27T17:13:47.061689] [DEBUG] [LOCAL ] AN: Trimmed 47236 records to 30923 (keeping 200 days of data) [2025-10-27T17:13:47.244054] [DEBUG] [LOCAL ] AN: Primary data saved (30923 records). [2025-10-27T17:13:47.244196] [INFO ] [MAIN ] AN: Full history saved. [2025-10-27T17:13:47.244274] [INFO ] [MAIN ] Update Progress: 117/2366 symbols completed. AN took 28.1s. Estimated remaining: 4h 24m 4s. Rate: 8.5 symbols/min [2025-10-27T17:13:47.614946] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-27T17:13:48.316970] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-27T17:13:48.415002] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-27T17:13:48.469230] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T17:13:49.214919] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-27T17:13:49.276542] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T17:13:49.984827] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-27T17:13:50.015002] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-27T17:13:50.723700] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-27T17:13:50.814921] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-27T17:13:51.614986] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-27T17:13:52.002277] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-27T17:13:52.414942] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-27T17:13:52.649797] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-27T17:13:53.214972] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-27T17:13:53.307636] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T17:13:54.015009] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-27T17:13:54.169374] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-27T17:13:54.180067] [INFO ] [REMOTE ] ANET: Full fetch complete (77945 records). [2025-10-27T17:13:54.180221] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-27T17:13:54.624029] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-27T17:13:54.624614] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-27T17:13:54.626001] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-27T17:13:54.627845] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-27T17:13:54.627720] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-27T17:13:54.641536] [DEBUG] [LOCAL ] ANET: Trimmed 77945 records to 53766 (keeping 200 days of data) [2025-10-27T17:13:54.654059] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-27T17:13:54.825381] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-27T17:13:54.978296] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-10-27T17:13:54.978436] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-27T17:13:54.979217] [INFO ] [MAIN ] Update Progress: 118/2366 symbols completed. ANET took 33.6s. Estimated remaining: 4h 24m 10s. Rate: 8.5 symbols/min [2025-10-27T17:13:55.614954] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-27T17:13:56.160811] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-27T17:13:56.414919] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-27T17:13:57.019739] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-27T17:13:57.031070] [INFO ] [REMOTE ] ANF: Full fetch complete (75805 records). [2025-10-27T17:13:57.031205] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-27T17:13:57.479067] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-27T17:13:57.479214] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-27T17:13:57.480087] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-27T17:13:57.480151] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-27T17:13:57.481567] [DEBUG] [LOCAL ] ANF: Trimmed 75805 records to 51990 (keeping 200 days of data) [2025-10-27T17:13:57.709720] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-27T17:13:57.737263] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-27T17:13:57.820214] [DEBUG] [LOCAL ] ANF: Primary data saved (51990 records). [2025-10-27T17:13:57.820356] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-27T17:13:57.821809] [INFO ] [MAIN ] Update Progress: 119/2366 symbols completed. ANF took 32.6s. Estimated remaining: 4h 22m 44s. Rate: 8.6 symbols/min [2025-10-27T17:13:59.182110] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T17:13:59.187925] [INFO ] [REMOTE ] ANRO: Full fetch complete (30413 records). [2025-10-27T17:13:59.188007] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-27T17:13:59.188448] [FATAL] [VALIDATOR ] ANRO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:13:59.188527] [FATAL] [MAIN ] ANRO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:13:59.188569] [WARN ] [MAIN ] ANRO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:13:59.188605] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-27T17:13:59.188684] [DEBUG] [LOCAL ] ANRO: No primary data file found to delete. [2025-10-27T17:13:59.188738] [INFO ] [LOCAL ] ANRO: Starting deletion of derivative data. [2025-10-27T17:13:59.188905] [DEBUG] [LOCAL ] ANRO: Deleted derivative data file. [2025-10-27T17:13:59.188987] [INFO ] [MAIN ] Update Progress: 120/2366 symbols completed. ANRO took 25.0s. Estimated remaining: 4h 20m 51s. Rate: 8.6 symbols/min [2025-10-27T17:13:59.790902] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:13:59.879959] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:13:59.884991] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:13:59.900261] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-27T17:13:59.919213] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:13:59.915723] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-27T17:13:59.919988] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-27T17:13:59.920044] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-27T17:13:59.920087] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-27T17:13:59.920118] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-27T17:14:00.055909] [DEBUG] [LOCAL ] ANVS: Loaded 24280 existing records from primary storage. [2025-10-27T17:14:00.056546] [DEBUG] [LOCAL ] AOD: Loaded 31268 existing records from primary storage. [2025-10-27T17:14:00.073015] [INFO ] [MAIN ] ANVS: Loaded 24280 existing records. [2025-10-27T17:14:00.073420] [INFO ] [MAIN ] AOD: Loaded 31268 existing records. [2025-10-27T17:14:00.087158] [DEBUG] [LOCAL ] AOMR: Loaded 16465 existing records from primary storage. [2025-10-27T17:14:00.102766] [INFO ] [MAIN ] AOMR: Loaded 16465 existing records. [2025-10-27T17:14:00.761461] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:14:00.798964] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:14:00.838860] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-27T17:14:00.804635] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-27T17:14:00.847711] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:14:00.844177] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-27T17:14:00.853297] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-27T17:14:00.872032] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-27T17:14:00.872150] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-27T17:14:00.886509] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-27T17:14:00.904527] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-27T17:14:00.880870] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-27T17:14:00.904990] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-27T17:14:00.905061] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-27T17:14:00.905271] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-27T17:14:00.940426] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:14:01.030958] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-10-27T17:14:01.595637] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:14:01.707083] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-10-27T17:14:01.775544] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:14:01.822459] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-27T17:14:01.904076] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:14:01.973795] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-27T17:14:02.043997] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-27T17:14:02.107232] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-27T17:14:02.110710] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:14:02.150710] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-27T17:14:02.185077] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:14:02.178508] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-27T17:14:02.207034] [INFO ] [MAIN ] Update Progress: 121/2366 symbols completed. AOMD took 3.0s. Estimated remaining: 4h 19m 31s. Rate: 8.7 symbols/min [2025-10-27T17:14:02.213223] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:14:02.213963] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-27T17:14:02.244428] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-27T17:14:02.408397] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:14:02.454778] [DEBUG] [LOCAL ] AON: Loaded 45634 existing records from primary storage. [2025-10-27T17:14:02.455105] [INFO ] [MAIN ] AON: Loaded 45634 existing records. [2025-10-27T17:14:02.634739] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:14:02.635011] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-27T17:14:02.635059] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-27T17:14:02.635236] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-27T17:14:02.635272] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-27T17:14:02.991919] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:14:02.992291] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-27T17:14:03.442337] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T17:14:03.449484] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-27T17:14:03.675263] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-27T17:14:03.678951] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-27T17:14:03.772919] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-27T17:14:03.778629] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-27T17:14:04.779542] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-27T17:14:04.788142] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-27T17:14:04.832230] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T17:14:04.860011] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T17:14:05.184056] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T17:14:05.214896] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-27T17:14:05.943122] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T17:14:06.026556] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-27T17:14:06.029693] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T17:14:06.814943] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-27T17:14:06.984387] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T17:14:07.505385] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-27T17:14:07.615040] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-27T17:14:08.414964] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-27T17:14:08.619363] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-27T17:14:09.214996] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-27T17:14:09.719060] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T17:14:10.014968] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-27T17:14:10.215798] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T17:14:10.814950] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-27T17:14:11.180027] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T17:14:11.615000] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-27T17:14:12.112422] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-27T17:14:12.414995] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-27T17:14:12.658429] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T17:14:13.010709] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T17:14:13.215008] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-27T17:14:14.014943] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-27T17:14:14.178786] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-27T17:14:14.814941] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-27T17:14:15.614942] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-27T17:14:16.122587] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-27T17:14:16.325188] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T17:14:16.414957] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-27T17:14:17.172034] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T17:14:17.203477] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-27T17:14:17.214888] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-27T17:14:17.862236] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-27T17:14:17.865249] [INFO ] [REMOTE ] AOMR: Full fetch complete (23074 records). [2025-10-27T17:14:17.865327] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-27T17:14:18.020045] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-27T17:14:18.267434] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-27T17:14:18.267562] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-27T17:14:18.268013] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-27T17:14:18.268079] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-27T17:14:18.268954] [DEBUG] [LOCAL ] AOMR: Trimmed 23074 records to 16054 (keeping 200 days of data) [2025-10-27T17:14:18.370189] [DEBUG] [LOCAL ] AOMR: Primary data saved (16054 records). [2025-10-27T17:14:18.370419] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-27T17:14:18.370521] [INFO ] [MAIN ] Update Progress: 122/2366 symbols completed. AOMR took 19.2s. Estimated remaining: 4h 22m 14s. Rate: 8.6 symbols/min [2025-10-27T17:14:18.543857] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:14:18.573859] [DEBUG] [LOCAL ] AORT: Loaded 29251 existing records from primary storage. [2025-10-27T17:14:18.574237] [INFO ] [MAIN ] AORT: Loaded 29251 existing records. [2025-10-27T17:14:18.755153] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:14:18.755439] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-27T17:14:18.755491] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-27T17:14:18.755731] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-27T17:14:18.755789] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-27T17:14:18.820103] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-27T17:14:19.164699] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:14:19.451178] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T17:14:19.614901] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-27T17:14:20.003045] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T17:14:20.401342] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-27T17:14:20.414923] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-27T17:14:21.215007] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-27T17:14:21.599698] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T17:14:22.014941] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-27T17:14:22.814974] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-27T17:14:23.018769] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-27T17:14:23.060295] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-27T17:14:23.500492] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-27T17:14:23.614989] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-27T17:14:24.415013] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-27T17:14:24.608157] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-27T17:14:25.214951] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-27T17:14:25.994165] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T17:14:26.014905] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-27T17:14:26.227002] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-27T17:14:26.815001] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-27T17:14:27.614990] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-27T17:14:27.691167] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-27T17:14:27.938016] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T17:14:28.415005] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-27T17:14:28.579349] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T17:14:28.586063] [INFO ] [REMOTE ] AOD: Full fetch complete (44864 records). [2025-10-27T17:14:28.586211] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-27T17:14:28.961127] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-27T17:14:28.961202] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-27T17:14:28.961691] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-27T17:14:28.961753] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-27T17:14:28.962732] [DEBUG] [LOCAL ] AOD: Trimmed 44864 records to 30589 (keeping 200 days of data) [2025-10-27T17:14:29.137919] [DEBUG] [LOCAL ] AOD: Primary data saved (30589 records). [2025-10-27T17:14:29.138048] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-27T17:14:29.139373] [INFO ] [MAIN ] Update Progress: 123/2366 symbols completed. AOD took 29.9s. Estimated remaining: 4h 23m 15s. Rate: 8.5 symbols/min [2025-10-27T17:14:29.220174] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-27T17:14:29.309072] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:14:29.355716] [DEBUG] [LOCAL ] AOS: Loaded 49354 existing records from primary storage. [2025-10-27T17:14:29.356037] [INFO ] [MAIN ] AOS: Loaded 49354 existing records. [2025-10-27T17:14:29.528952] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:14:29.529152] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-27T17:14:29.529197] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-27T17:14:29.529430] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-27T17:14:29.529467] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-27T17:14:29.883990] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:14:29.923819] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-27T17:14:29.933462] [INFO ] [REMOTE ] ANVS: Full fetch complete (36725 records). [2025-10-27T17:14:29.933690] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-27T17:14:30.020151] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-27T17:14:30.311709] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-27T17:14:30.311788] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-27T17:14:30.312190] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-27T17:14:30.312228] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-27T17:14:30.312983] [DEBUG] [LOCAL ] ANVS: Trimmed 36725 records to 23987 (keeping 200 days of data) [2025-10-27T17:14:30.441636] [DEBUG] [LOCAL ] ANVS: Primary data saved (23987 records). [2025-10-27T17:14:30.441802] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-27T17:14:30.441976] [INFO ] [MAIN ] Update Progress: 124/2366 symbols completed. ANVS took 31.3s. Estimated remaining: 4h 21m 24s. Rate: 8.6 symbols/min [2025-10-27T17:14:30.558720] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T17:14:30.636742] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:14:30.645898] [DEBUG] [LOCAL ] AP: Loaded 7509 existing records from primary storage. [2025-10-27T17:14:30.646064] [INFO ] [MAIN ] AP: Loaded 7509 existing records. [2025-10-27T17:14:30.820205] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-27T17:14:30.824926] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:14:30.825233] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-27T17:14:30.825281] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-27T17:14:30.825447] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-27T17:14:30.825505] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-27T17:14:31.189560] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:14:31.449626] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T17:14:31.614987] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-27T17:14:32.226581] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T17:14:32.414925] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-27T17:14:32.467880] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-27T17:14:33.214958] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-27T17:14:33.647064] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T17:14:33.677990] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-27T17:14:34.014998] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-27T17:14:34.354132] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-27T17:14:34.814967] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-27T17:14:35.615037] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-27T17:14:36.350356] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T17:14:36.415024] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-27T17:14:36.751470] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T17:14:37.214965] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-27T17:14:37.961348] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-27T17:14:37.970637] [INFO ] [REMOTE ] AON: Full fetch complete (65222 records). [2025-10-27T17:14:37.970923] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-27T17:14:38.020187] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-27T17:14:38.383430] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-27T17:14:38.383629] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-27T17:14:38.384530] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-27T17:14:38.384623] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-27T17:14:38.386659] [DEBUG] [LOCAL ] AON: Trimmed 65222 records to 44854 (keeping 200 days of data) [2025-10-27T17:14:38.656534] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T17:14:38.731816] [DEBUG] [LOCAL ] AON: Primary data saved (44854 records). [2025-10-27T17:14:38.731947] [INFO ] [MAIN ] AON: Full history saved. [2025-10-27T17:14:38.732403] [INFO ] [MAIN ] Update Progress: 125/2366 symbols completed. AON took 36.5s. Estimated remaining: 4h 21m 41s. Rate: 8.6 symbols/min [2025-10-27T17:14:38.820298] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-27T17:14:38.909338] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:14:38.945536] [DEBUG] [LOCAL ] APAM: Loaded 36093 existing records from primary storage. [2025-10-27T17:14:38.945841] [INFO ] [MAIN ] APAM: Loaded 36093 existing records. [2025-10-27T17:14:39.132203] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:14:39.132600] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-27T17:14:39.132699] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-27T17:14:39.133025] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-27T17:14:39.133128] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-27T17:14:39.252086] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-27T17:14:39.528964] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:14:39.614926] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-27T17:14:40.414961] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-27T17:14:40.664476] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-27T17:14:40.880438] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T17:14:41.214916] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-27T17:14:41.256869] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-27T17:14:42.014958] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-27T17:14:42.551499] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T17:14:42.814959] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-27T17:14:43.245074] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T17:14:43.614977] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-27T17:14:44.103474] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T17:14:44.414999] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-27T17:14:44.478828] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-27T17:14:45.214986] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-27T17:14:45.798253] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-27T17:14:46.014981] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-27T17:14:46.388012] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T17:14:46.814964] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-27T17:14:46.890074] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T17:14:47.311974] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-27T17:14:47.614974] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-27T17:14:48.414979] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-27T17:14:49.214993] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-27T17:14:49.705232] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-27T17:14:49.945054] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T17:14:50.014956] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-27T17:14:50.620682] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T17:14:50.814964] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-27T17:14:50.869987] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T17:14:51.617023] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-27T17:14:51.620537] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-27T17:14:52.414953] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-27T17:14:52.606354] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T17:14:52.612039] [INFO ] [REMOTE ] AORT: Full fetch complete (42389 records). [2025-10-27T17:14:52.612160] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-27T17:14:52.987577] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-27T17:14:53.022349] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-27T17:14:53.022457] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-27T17:14:53.023023] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-27T17:14:53.023089] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-27T17:14:53.024522] [DEBUG] [LOCAL ] AORT: Trimmed 42389 records to 28591 (keeping 200 days of data) [2025-10-27T17:14:53.193955] [DEBUG] [LOCAL ] AORT: Primary data saved (28591 records). [2025-10-27T17:14:53.194146] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-27T17:14:53.194239] [INFO ] [MAIN ] Update Progress: 126/2366 symbols completed. AORT took 34.8s. Estimated remaining: 4h 23m 46s. Rate: 8.5 symbols/min [2025-10-27T17:14:53.220035] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-27T17:14:53.374471] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:14:53.425097] [DEBUG] [LOCAL ] APD: Loaded 46082 existing records from primary storage. [2025-10-27T17:14:53.425557] [INFO ] [MAIN ] APD: Loaded 46082 existing records. [2025-10-27T17:14:53.614700] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:14:53.615007] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-27T17:14:53.615062] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-27T17:14:53.615319] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-27T17:14:53.615376] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-27T17:14:53.991791] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:14:54.014938] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-27T17:14:54.645622] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T17:14:54.814966] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-27T17:14:55.614970] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-27T17:14:55.968259] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-27T17:14:56.388105] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T17:14:56.398449] [INFO ] [REMOTE ] AOS: Full fetch complete (71067 records). [2025-10-27T17:14:56.398718] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-27T17:14:56.422554] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-27T17:14:56.834113] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-27T17:14:56.834320] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-27T17:14:56.835185] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-27T17:14:56.830303] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T17:14:56.835414] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-27T17:14:56.840935] [DEBUG] [LOCAL ] AOS: Trimmed 71067 records to 48566 (keeping 200 days of data) [2025-10-27T17:14:57.140137] [DEBUG] [LOCAL ] AOS: Primary data saved (48566 records). [2025-10-27T17:14:57.140324] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-27T17:14:57.141259] [INFO ] [MAIN ] Update Progress: 127/2366 symbols completed. AOS took 28.0s. Estimated remaining: 4h 22m 44s. Rate: 8.5 symbols/min [2025-10-27T17:14:57.220102] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-27T17:14:57.316960] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:14:57.373482] [DEBUG] [LOCAL ] APG: Loaded 51359 existing records from primary storage. [2025-10-27T17:14:57.373927] [INFO ] [MAIN ] APG: Loaded 51359 existing records. [2025-10-27T17:14:57.577433] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:14:57.577974] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-27T17:14:57.578092] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-27T17:14:57.578739] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-27T17:14:57.578849] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-27T17:14:57.741742] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-27T17:14:57.937588] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-27T17:14:58.022164] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-27T17:14:58.028098] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:14:58.814979] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-27T17:14:59.611807] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T17:14:59.620714] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-27T17:15:00.414994] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-27T17:15:00.478526] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T17:15:00.617804] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-27T17:15:01.215025] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-27T17:15:02.015061] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-27T17:15:02.815009] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-27T17:15:03.012110] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T17:15:03.014281] [INFO ] [REMOTE ] AP: Full fetch complete (9166 records). [2025-10-27T17:15:03.014374] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-27T17:15:03.414543] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-27T17:15:03.415195] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-27T17:15:03.415573] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-27T17:15:03.415809] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-27T17:15:03.416701] [DEBUG] [LOCAL ] AP: Trimmed 9166 records to 7468 (keeping 200 days of data) [2025-10-27T17:15:03.488630] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-27T17:15:03.506868] [DEBUG] [LOCAL ] AP: Primary data saved (7468 records). [2025-10-27T17:15:03.537705] [INFO ] [MAIN ] AP: Full history saved. [2025-10-27T17:15:03.537980] [INFO ] [MAIN ] Update Progress: 128/2366 symbols completed. AP took 33.1s. Estimated remaining: 4h 22m 26s. Rate: 8.5 symbols/min [2025-10-27T17:15:03.588376] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (3.17 seconds). [2025-10-27T17:15:03.626174] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-27T17:15:03.740148] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:15:03.795222] [DEBUG] [LOCAL ] APH: Loaded 54471 existing records from primary storage. [2025-10-27T17:15:03.795664] [INFO ] [MAIN ] APH: Loaded 54471 existing records. [2025-10-27T17:15:03.988060] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:15:03.988462] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-27T17:15:03.988525] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-27T17:15:03.988839] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-27T17:15:03.988900] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-27T17:15:04.357768] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:15:04.414999] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-27T17:15:04.742633] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-27T17:15:05.092696] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T17:15:05.215008] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-27T17:15:06.015055] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-27T17:15:06.814946] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-27T17:15:07.075790] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-27T17:15:07.465260] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T17:15:07.577848] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-27T17:15:07.615056] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-27T17:15:08.286243] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T17:15:08.415020] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-27T17:15:09.083099] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T17:15:09.089582] [INFO ] [REMOTE ] APAM: Full fetch complete (51909 records). [2025-10-27T17:15:09.089702] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-27T17:15:09.226561] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-27T17:15:09.466911] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-27T17:15:09.467039] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-27T17:15:09.467633] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-27T17:15:09.467720] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-27T17:15:09.468743] [DEBUG] [LOCAL ] APAM: Trimmed 51909 records to 35313 (keeping 200 days of data) [2025-10-27T17:15:09.674763] [DEBUG] [LOCAL ] APAM: Primary data saved (35313 records). [2025-10-27T17:15:09.674886] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-27T17:15:09.675294] [INFO ] [MAIN ] Update Progress: 129/2366 symbols completed. APAM took 30.9s. Estimated remaining: 4h 22m 3s. Rate: 8.5 symbols/min [2025-10-27T17:15:09.844541] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:15:09.893433] [DEBUG] [LOCAL ] APLE: Loaded 52707 existing records from primary storage. [2025-10-27T17:15:09.893750] [INFO ] [MAIN ] APLE: Loaded 52707 existing records. [2025-10-27T17:15:10.020067] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-27T17:15:10.099902] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:15:10.100283] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-27T17:15:10.100353] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-27T17:15:10.100706] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-27T17:15:10.100763] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-27T17:15:10.492401] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:15:10.522257] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-27T17:15:10.814924] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-27T17:15:11.521525] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T17:15:11.614904] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-27T17:15:11.778506] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-27T17:15:12.414970] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-27T17:15:12.635934] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-27T17:15:12.868325] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-27T17:15:13.214973] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-27T17:15:13.759208] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T17:15:14.014959] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-27T17:15:14.463990] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T17:15:14.814939] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-27T17:15:15.614917] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-27T17:15:15.968779] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-27T17:15:16.166404] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T17:15:16.414944] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-27T17:15:17.214997] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-27T17:15:17.934045] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-27T17:15:18.014951] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-27T17:15:18.048771] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-27T17:15:18.550530] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T17:15:18.815014] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-27T17:15:19.466274] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-27T17:15:19.614913] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-27T17:15:20.171318] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-27T17:15:20.414968] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-27T17:15:21.214964] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-27T17:15:21.624774] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-27T17:15:21.986417] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-27T17:15:22.014927] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-27T17:15:22.814928] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-27T17:15:22.979744] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T17:15:23.615001] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-27T17:15:23.760344] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-27T17:15:24.414913] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-27T17:15:24.518601] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-27T17:15:25.087122] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T17:15:25.214911] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-27T17:15:26.015031] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-27T17:15:26.050986] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-27T17:15:26.815013] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-27T17:15:26.894884] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T17:15:27.614929] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-27T17:15:27.687506] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-27T17:15:27.696299] [INFO ] [REMOTE ] APD: Full fetch complete (67277 records). [2025-10-27T17:15:27.696408] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-27T17:15:28.081387] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-27T17:15:28.081488] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-27T17:15:28.082220] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-27T17:15:28.082284] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-27T17:15:28.083738] [DEBUG] [LOCAL ] APD: Trimmed 67277 records to 45282 (keeping 200 days of data) [2025-10-27T17:15:28.367451] [DEBUG] [LOCAL ] APD: Primary data saved (45282 records). [2025-10-27T17:15:28.367585] [INFO ] [MAIN ] APD: Full history saved. [2025-10-27T17:15:28.368701] [INFO ] [MAIN ] Update Progress: 130/2366 symbols completed. APD took 35.2s. Estimated remaining: 4h 25m 17s. Rate: 8.4 symbols/min [2025-10-27T17:15:28.422910] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-27T17:15:28.539136] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:15:28.593400] [DEBUG] [LOCAL ] APO: Loaded 54163 existing records from primary storage. [2025-10-27T17:15:28.593729] [INFO ] [MAIN ] APO: Loaded 54163 existing records. [2025-10-27T17:15:28.781754] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:15:28.782068] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-27T17:15:28.782181] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-27T17:15:28.782583] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-27T17:15:28.782730] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-27T17:15:29.135804] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-27T17:15:29.225846] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:15:29.226838] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-27T17:15:29.252457] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-27T17:15:29.262167] [INFO ] [REMOTE ] APG: Full fetch complete (71911 records). [2025-10-27T17:15:29.262340] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-27T17:15:29.263283] [FATAL] [VALIDATOR ] APG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:15:29.263383] [FATAL] [MAIN ] APG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:15:29.263427] [WARN ] [MAIN ] APG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:15:29.263467] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-27T17:15:29.263568] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-10-27T17:15:29.263636] [INFO ] [LOCAL ] APG: Starting deletion of derivative data. [2025-10-27T17:15:29.263864] [DEBUG] [LOCAL ] APG: Deleted derivative data file. [2025-10-27T17:15:29.264744] [INFO ] [MAIN ] Update Progress: 131/2366 symbols completed. APG took 32.1s. Estimated remaining: 4h 23m 24s. Rate: 8.5 symbols/min [2025-10-27T17:15:29.433743] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:15:29.444038] [DEBUG] [LOCAL ] APOS: Loaded 7137 existing records from primary storage. [2025-10-27T17:15:29.444286] [INFO ] [MAIN ] APOS: Loaded 7137 existing records. [2025-10-27T17:15:29.621305] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:15:29.621505] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-27T17:15:29.621551] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-27T17:15:29.621741] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-10-27T17:15:29.621798] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-27T17:15:29.980069] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:15:30.014903] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-27T17:15:30.073713] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-27T17:15:30.813411] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-27T17:15:30.823068] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-27T17:15:30.839851] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-27T17:15:31.614986] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-27T17:15:32.233604] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T17:15:32.414966] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-27T17:15:32.586175] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-27T17:15:33.214959] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-27T17:15:34.015014] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-27T17:15:34.181515] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-27T17:15:34.753010] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-27T17:15:34.814918] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-27T17:15:35.021598] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-27T17:15:35.614932] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-27T17:15:35.724179] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-27T17:15:36.414918] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-27T17:15:37.214943] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-27T17:15:37.262229] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T17:15:37.944603] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-27T17:15:38.014942] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-27T17:15:38.486000] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-27T17:15:38.496260] [INFO ] [REMOTE ] APH: Full fetch complete (77870 records). [2025-10-27T17:15:38.496392] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-27T17:15:38.612443] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T17:15:38.820027] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-27T17:15:38.891980] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-27T17:15:38.892055] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-27T17:15:38.892789] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-27T17:15:38.892852] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-27T17:15:38.894322] [DEBUG] [LOCAL ] APH: Trimmed 77870 records to 53691 (keeping 200 days of data) [2025-10-27T17:15:39.220782] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-10-27T17:15:39.220940] [INFO ] [MAIN ] APH: Full history saved. [2025-10-27T17:15:39.221051] [INFO ] [MAIN ] Update Progress: 132/2366 symbols completed. APH took 35.7s. Estimated remaining: 4h 24m 5s. Rate: 8.5 symbols/min [2025-10-27T17:15:39.341684] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-27T17:15:39.397175] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:15:39.446316] [DEBUG] [LOCAL ] APTV: Loaded 52575 existing records from primary storage. [2025-10-27T17:15:39.446628] [INFO ] [MAIN ] APTV: Loaded 52575 existing records. [2025-10-27T17:15:39.620747] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-27T17:15:39.625431] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:15:39.626540] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-27T17:15:39.626627] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-27T17:15:39.626872] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-27T17:15:39.626920] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-27T17:15:39.976782] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:15:40.414998] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-27T17:15:40.956420] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-27T17:15:41.214966] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-27T17:15:41.885691] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T17:15:42.014957] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-27T17:15:42.588591] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T17:15:42.814975] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-27T17:15:43.487762] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T17:15:43.614928] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-27T17:15:44.396907] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T17:15:44.407126] [INFO ] [REMOTE ] APLE: Full fetch complete (74772 records). [2025-10-27T17:15:44.407287] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-27T17:15:44.420581] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-27T17:15:44.801184] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-27T17:15:44.801267] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-27T17:15:44.802066] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-27T17:15:44.802130] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-27T17:15:44.803520] [DEBUG] [LOCAL ] APLE: Trimmed 74772 records to 51909 (keeping 200 days of data) [2025-10-27T17:15:45.116548] [DEBUG] [LOCAL ] APLE: Primary data saved (51909 records). [2025-10-27T17:15:45.116829] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-27T17:15:45.117246] [INFO ] [MAIN ] Update Progress: 133/2366 symbols completed. APLE took 35.4s. Estimated remaining: 4h 23m 38s. Rate: 8.5 symbols/min [2025-10-27T17:15:45.219541] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-27T17:15:45.295888] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:15:45.347520] [DEBUG] [LOCAL ] AQN: Loaded 52380 existing records from primary storage. [2025-10-27T17:15:45.347913] [INFO ] [MAIN ] AQN: Loaded 52380 existing records. [2025-10-27T17:15:45.529856] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:15:45.530215] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-27T17:15:45.530264] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-27T17:15:45.546885] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-10-27T17:15:45.558927] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-27T17:15:45.592421] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-27T17:15:45.946961] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:15:45.948078] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-27T17:15:45.982597] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T17:15:46.014943] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-27T17:15:46.814932] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-27T17:15:47.407591] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T17:15:47.614961] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-27T17:15:48.414971] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-27T17:15:48.650567] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T17:15:48.654934] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-27T17:15:48.656432] [INFO ] [REMOTE ] APOS: Full fetch complete (10222 records). [2025-10-27T17:15:48.667998] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-27T17:15:49.029804] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-10-27T17:15:49.029882] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-10-27T17:15:49.030123] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-10-27T17:15:49.030163] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-10-27T17:15:49.030564] [DEBUG] [LOCAL ] APOS: Trimmed 10222 records to 6830 (keeping 200 days of data) [2025-10-27T17:15:49.071240] [DEBUG] [LOCAL ] APOS: Primary data saved (6830 records). [2025-10-27T17:15:49.071334] [INFO ] [MAIN ] APOS: Full history saved. [2025-10-27T17:15:49.071409] [INFO ] [MAIN ] Update Progress: 134/2366 symbols completed. APOS took 19.8s. Estimated remaining: 4h 22m 39s. Rate: 8.5 symbols/min [2025-10-27T17:15:49.219270] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-27T17:15:49.240181] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:15:49.246011] [DEBUG] [LOCAL ] AQNB: Loaded 3910 existing records from primary storage. [2025-10-27T17:15:49.246163] [INFO ] [MAIN ] AQNB: Loaded 3910 existing records. [2025-10-27T17:15:49.425187] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:15:49.425530] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-27T17:15:49.425600] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-27T17:15:49.425842] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-27T17:15:49.425898] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-27T17:15:49.771058] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:15:50.014927] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-27T17:15:50.193933] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-27T17:15:50.597425] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T17:15:50.764536] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-27T17:15:50.814905] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-27T17:15:51.614958] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-27T17:15:51.619141] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T17:15:52.414945] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-27T17:15:52.925828] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-27T17:15:53.155397] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T17:15:53.214899] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-27T17:15:54.014992] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-27T17:15:54.389894] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T17:15:54.814967] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-27T17:15:54.968442] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T17:15:55.614945] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-27T17:15:56.049995] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-27T17:15:56.414916] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-27T17:15:56.642898] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-27T17:15:57.022265] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T17:15:57.214983] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-27T17:15:58.015011] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-27T17:15:58.814972] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-27T17:15:59.235157] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-27T17:15:59.433118] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-27T17:15:59.614905] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-27T17:15:59.815315] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-27T17:16:00.414961] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-27T17:16:01.214955] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-27T17:16:01.673468] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-27T17:16:02.015185] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-27T17:16:02.641782] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T17:16:02.815309] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-27T17:16:02.961273] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-27T17:16:03.614973] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-27T17:16:03.730784] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-27T17:16:04.348288] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T17:16:04.414932] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-27T17:16:05.214999] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-27T17:16:06.014988] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-27T17:16:06.230439] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-10-27T17:16:06.554037] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-27T17:16:06.584514] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-27T17:16:06.814963] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-27T17:16:07.305366] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-27T17:16:07.614961] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-27T17:16:08.414994] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-27T17:16:08.642412] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-27T17:16:08.652589] [INFO ] [REMOTE ] APO: Full fetch complete (77454 records). [2025-10-27T17:16:08.652755] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-27T17:16:09.040573] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-27T17:16:09.040677] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-27T17:16:09.041446] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-27T17:16:09.041490] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-27T17:16:09.042917] [DEBUG] [LOCAL ] APO: Trimmed 77454 records to 53373 (keeping 200 days of data) [2025-10-27T17:16:09.227821] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-27T17:16:09.379022] [DEBUG] [LOCAL ] APO: Primary data saved (53373 records). [2025-10-27T17:16:09.379166] [INFO ] [MAIN ] APO: Full history saved. [2025-10-27T17:16:09.380210] [INFO ] [MAIN ] Update Progress: 135/2366 symbols completed. APO took 41.0s. Estimated remaining: 4h 26m 11s. Rate: 8.4 symbols/min [2025-10-27T17:16:09.486325] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-27T17:16:09.487913] [INFO ] [REMOTE ] AQNB: Full fetch complete (5357 records). [2025-10-27T17:16:09.488832] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-27T17:16:09.604680] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:16:09.627971] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-27T17:16:09.957628] [DEBUG] [LOCAL ] AR: Loaded 54367 existing records from primary storage. [2025-10-27T17:16:09.982600] [INFO ] [MAIN ] AR: Loaded 54367 existing records. [2025-10-27T17:16:10.042856] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-27T17:16:10.050704] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-27T17:16:10.063689] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-27T17:16:10.076484] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-27T17:16:10.105029] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-27T17:16:10.138200] [DEBUG] [LOCAL ] AQNB: Trimmed 5357 records to 3764 (keeping 200 days of data) [2025-10-27T17:16:10.228106] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:16:10.230870] [DEBUG] [LOCAL ] AQNB: Primary data saved (3764 records). [2025-10-27T17:16:10.231027] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-27T17:16:10.231115] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-27T17:16:10.231185] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-27T17:16:10.231297] [INFO ] [MAIN ] Update Progress: 136/2366 symbols completed. AQNB took 21.2s. Estimated remaining: 4h 24m 20s. Rate: 8.4 symbols/min [2025-10-27T17:16:10.242821] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-27T17:16:10.264269] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-27T17:16:10.549852] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:16:10.804482] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:16:10.816674] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-27T17:16:10.818269] [DEBUG] [LOCAL ] ARCO: Loaded 44792 existing records from primary storage. [2025-10-27T17:16:10.818491] [INFO ] [MAIN ] ARCO: Loaded 44792 existing records. [2025-10-27T17:16:11.010123] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:16:11.010384] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-27T17:16:11.010436] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-27T17:16:11.010785] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-10-27T17:16:11.010842] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-27T17:16:11.365891] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:16:11.401223] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-27T17:16:11.614925] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-27T17:16:11.759496] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T17:16:12.421912] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-27T17:16:12.448079] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-27T17:16:13.081286] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T17:16:13.214924] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-27T17:16:13.935632] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T17:16:14.014932] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-27T17:16:14.814991] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-27T17:16:15.492721] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T17:16:15.582240] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-27T17:16:15.614911] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-27T17:16:15.746047] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T17:16:15.755751] [INFO ] [REMOTE ] APTV: Full fetch complete (75744 records). [2025-10-27T17:16:15.755886] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-27T17:16:16.131461] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-27T17:16:16.131540] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-27T17:16:16.132284] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-27T17:16:16.132349] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-27T17:16:16.133777] [DEBUG] [LOCAL ] APTV: Trimmed 75744 records to 51758 (keeping 200 days of data) [2025-10-27T17:16:16.415697] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-27T17:16:16.430851] [DEBUG] [LOCAL ] APTV: Primary data saved (51758 records). [2025-10-27T17:16:16.431009] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-27T17:16:16.432096] [INFO ] [MAIN ] Update Progress: 137/2366 symbols completed. APTV took 37.2s. Estimated remaining: 4h 23m 58s. Rate: 8.4 symbols/min [2025-10-27T17:16:16.614619] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:16:16.632049] [DEBUG] [LOCAL ] ARDC: Loaded 15417 existing records from primary storage. [2025-10-27T17:16:16.632285] [INFO ] [MAIN ] ARDC: Loaded 15417 existing records. [2025-10-27T17:16:16.812292] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:16:16.812512] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-27T17:16:16.812564] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-27T17:16:16.812760] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-27T17:16:16.812821] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-27T17:16:17.183748] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:16:17.209101] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T17:16:17.217354] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-27T17:16:17.963989] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T17:16:18.015018] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-27T17:16:18.150093] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T17:16:18.814933] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-27T17:16:19.128938] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T17:16:19.615007] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-27T17:16:20.417094] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-27T17:16:20.419471] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T17:16:20.702556] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-27T17:16:21.215009] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-27T17:16:22.014930] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-27T17:16:22.087908] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T17:16:22.814955] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-27T17:16:22.884254] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-27T17:16:23.614913] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-27T17:16:23.675020] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-27T17:16:23.880371] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T17:16:24.414940] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-27T17:16:25.144456] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T17:16:25.154611] [INFO ] [REMOTE ] AQN: Full fetch complete (74918 records). [2025-10-27T17:16:25.155252] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-27T17:16:25.157299] [FATAL] [VALIDATOR ] AQN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:16:25.157464] [FATAL] [MAIN ] AQN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:16:25.157517] [WARN ] [MAIN ] AQN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:16:25.157637] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-27T17:16:25.157755] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-27T17:16:25.157798] [INFO ] [LOCAL ] AQN: Starting deletion of derivative data. [2025-10-27T17:16:25.158022] [DEBUG] [LOCAL ] AQN: Deleted derivative data file. [2025-10-27T17:16:25.158513] [INFO ] [MAIN ] Update Progress: 138/2366 symbols completed. AQN took 40.0s. Estimated remaining: 4h 24m 17s. Rate: 8.4 symbols/min [2025-10-27T17:16:25.228087] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-27T17:16:25.348548] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:16:25.381995] [DEBUG] [LOCAL ] ARDT: Loaded 27853 existing records from primary storage. [2025-10-27T17:16:25.382367] [INFO ] [MAIN ] ARDT: Loaded 27853 existing records. [2025-10-27T17:16:25.571608] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:16:25.571964] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-27T17:16:25.572025] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-27T17:16:25.572303] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-27T17:16:25.572352] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-27T17:16:25.965712] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:16:26.005715] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T17:16:26.007018] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-27T17:16:26.016617] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-27T17:16:26.814963] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-27T17:16:27.165687] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T17:16:27.614949] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-27T17:16:28.375019] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T17:16:28.414925] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-27T17:16:28.628341] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-27T17:16:29.214935] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-27T17:16:30.014922] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-27T17:16:30.093209] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-27T17:16:30.131270] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T17:16:30.814982] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-27T17:16:31.234791] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T17:16:31.408599] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-27T17:16:31.614998] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-27T17:16:32.414942] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-27T17:16:32.685924] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T17:16:33.215014] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-27T17:16:33.548125] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-27T17:16:33.949102] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-27T17:16:34.014905] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-27T17:16:34.814902] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-27T17:16:34.863615] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T17:16:35.614940] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-27T17:16:36.291346] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-27T17:16:36.414911] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-27T17:16:36.794746] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-27T17:16:37.214999] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-27T17:16:37.613473] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-27T17:16:37.617311] [INFO ] [REMOTE ] ARDC: Full fetch complete (21681 records). [2025-10-27T17:16:37.617380] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-27T17:16:37.974498] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-27T17:16:37.974576] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-27T17:16:37.974906] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-27T17:16:37.974969] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-27T17:16:37.975541] [DEBUG] [LOCAL ] ARDC: Trimmed 21681 records to 14965 (keeping 200 days of data) [2025-10-27T17:16:38.019364] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-27T17:16:38.065172] [DEBUG] [LOCAL ] ARDC: Primary data saved (14965 records). [2025-10-27T17:16:38.065264] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-27T17:16:38.065334] [INFO ] [MAIN ] Update Progress: 139/2366 symbols completed. ARDC took 21.6s. Estimated remaining: 4h 25m 43s. Rate: 8.4 symbols/min [2025-10-27T17:16:38.233122] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:16:38.279613] [DEBUG] [LOCAL ] ARE: Loaded 51653 existing records from primary storage. [2025-10-27T17:16:38.279931] [INFO ] [MAIN ] ARE: Loaded 51653 existing records. [2025-10-27T17:16:38.453408] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:16:38.453630] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-27T17:16:38.453711] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-27T17:16:38.453987] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-27T17:16:38.454042] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-27T17:16:38.811005] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:16:38.814898] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-27T17:16:38.876252] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T17:16:39.199445] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T17:16:39.614961] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-27T17:16:40.103401] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-27T17:16:40.414987] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-27T17:16:41.227024] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-27T17:16:41.233999] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T17:16:41.780906] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-27T17:16:42.014972] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-27T17:16:42.604878] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T17:16:42.814910] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-27T17:16:43.292226] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T17:16:43.614950] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-27T17:16:44.027916] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-27T17:16:44.414946] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-27T17:16:45.214942] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-27T17:16:45.662181] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-27T17:16:45.671818] [INFO ] [REMOTE ] AR: Full fetch complete (77346 records). [2025-10-27T17:16:45.671937] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-27T17:16:45.673237] [FATAL] [VALIDATOR ] AR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:16:45.673322] [FATAL] [MAIN ] AR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:16:45.673389] [WARN ] [MAIN ] AR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:16:45.673462] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-27T17:16:45.673524] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-10-27T17:16:45.673560] [INFO ] [LOCAL ] AR: Starting deletion of derivative data. [2025-10-27T17:16:45.673705] [DEBUG] [LOCAL ] AR: Deleted derivative data file. [2025-10-27T17:16:45.673796] [INFO ] [MAIN ] Update Progress: 140/2366 symbols completed. AR took 36.3s. Estimated remaining: 4h 25m 43s. Rate: 8.4 symbols/min [2025-10-27T17:16:45.842686] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:16:45.888678] [DEBUG] [LOCAL ] ARES: Loaded 50410 existing records from primary storage. [2025-10-27T17:16:45.889104] [INFO ] [MAIN ] ARES: Loaded 50410 existing records. [2025-10-27T17:16:46.034568] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-27T17:16:46.083211] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:16:46.099448] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-27T17:16:46.099542] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-27T17:16:46.101007] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T17:16:46.104510] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-27T17:16:46.110571] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-27T17:16:46.479718] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:16:46.619679] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-27T17:16:46.627784] [INFO ] [REMOTE ] ARCO: Full fetch complete (64740 records). [2025-10-27T17:16:46.627932] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-27T17:16:46.824588] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-27T17:16:47.051736] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-10-27T17:16:47.051854] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-10-27T17:16:47.052718] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-10-27T17:16:47.052843] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-10-27T17:16:47.054848] [DEBUG] [LOCAL ] ARCO: Trimmed 64740 records to 44014 (keeping 200 days of data) [2025-10-27T17:16:47.329058] [DEBUG] [LOCAL ] ARCO: Primary data saved (44014 records). [2025-10-27T17:16:47.329242] [INFO ] [MAIN ] ARCO: Full history saved. [2025-10-27T17:16:47.329339] [INFO ] [MAIN ] Update Progress: 141/2366 symbols completed. ARCO took 37.1s. Estimated remaining: 4h 24m 9s. Rate: 8.4 symbols/min [2025-10-27T17:16:47.502067] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:16:47.546139] [DEBUG] [LOCAL ] ARI: Loaded 44089 existing records from primary storage. [2025-10-27T17:16:47.546547] [INFO ] [MAIN ] ARI: Loaded 44089 existing records. [2025-10-27T17:16:47.620104] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-27T17:16:47.755149] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:16:47.755460] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-27T17:16:47.755514] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-27T17:16:47.755887] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-27T17:16:47.755947] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-27T17:16:48.151329] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:16:48.173072] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-27T17:16:48.414975] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-27T17:16:49.045002] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-27T17:16:49.214953] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-27T17:16:49.451773] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T17:16:49.484856] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-27T17:16:50.014950] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-27T17:16:50.814918] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-27T17:16:50.855356] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T17:16:51.186922] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T17:16:51.614952] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-27T17:16:51.672277] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T17:16:52.415018] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-27T17:16:52.992706] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-27T17:16:53.214934] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-27T17:16:54.014925] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-27T17:16:54.221941] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-27T17:16:54.804256] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T17:16:54.816529] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-27T17:16:55.203202] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-27T17:16:55.209277] [INFO ] [REMOTE ] ARDT: Full fetch complete (41765 records). [2025-10-27T17:16:55.209369] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-27T17:16:55.584988] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-27T17:16:55.585077] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-27T17:16:55.585560] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-27T17:16:55.585602] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-27T17:16:55.586529] [DEBUG] [LOCAL ] ARDT: Trimmed 41765 records to 27328 (keeping 200 days of data) [2025-10-27T17:16:55.635507] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-27T17:16:55.743586] [DEBUG] [LOCAL ] ARDT: Primary data saved (27328 records). [2025-10-27T17:16:55.743750] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-27T17:16:55.743834] [INFO ] [MAIN ] Update Progress: 142/2366 symbols completed. ARDT took 30.6s. Estimated remaining: 4h 24m 22s. Rate: 8.4 symbols/min [2025-10-27T17:16:55.914288] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:16:55.956544] [DEBUG] [LOCAL ] ARLO: Loaded 44193 existing records from primary storage. [2025-10-27T17:16:55.956897] [INFO ] [MAIN ] ARLO: Loaded 44193 existing records. [2025-10-27T17:16:56.147033] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:16:56.147329] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-27T17:16:56.147407] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-27T17:16:56.147775] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-10-27T17:16:56.147833] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-27T17:16:56.415561] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-27T17:16:56.520206] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:16:56.562781] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-27T17:16:57.214910] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-27T17:16:57.270100] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T17:16:58.014959] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-27T17:16:58.074788] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-27T17:16:58.814450] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T17:16:58.823931] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-27T17:16:59.594747] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T17:16:59.614893] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-27T17:16:59.958196] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T17:17:00.414940] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-27T17:17:01.224357] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-27T17:17:01.225734] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-27T17:17:02.014985] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-27T17:17:02.530868] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-27T17:17:02.815004] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-27T17:17:03.614920] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-27T17:17:03.784316] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-27T17:17:03.861977] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-27T17:17:04.414967] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-27T17:17:04.648492] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-27T17:17:05.004804] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T17:17:05.215000] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-27T17:17:05.609507] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T17:17:06.014975] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-27T17:17:06.753165] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T17:17:06.814908] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-27T17:17:07.617052] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-27T17:17:07.619516] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-27T17:17:07.629221] [INFO ] [REMOTE ] ARE: Full fetch complete (72668 records). [2025-10-27T17:17:07.629328] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-27T17:17:07.630052] [FATAL] [VALIDATOR ] ARE: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:17:07.630146] [FATAL] [MAIN ] ARE: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:17:07.630216] [WARN ] [MAIN ] ARE: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:17:07.630291] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-27T17:17:07.630354] [DEBUG] [LOCAL ] ARE: No primary data file found to delete. [2025-10-27T17:17:07.630389] [INFO ] [LOCAL ] ARE: Starting deletion of derivative data. [2025-10-27T17:17:07.630541] [DEBUG] [LOCAL ] ARE: Deleted derivative data file. [2025-10-27T17:17:07.631535] [INFO ] [MAIN ] Update Progress: 143/2366 symbols completed. ARE took 29.6s. Estimated remaining: 4h 25m 29s. Rate: 8.4 symbols/min [2025-10-27T17:17:07.824806] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:17:07.880133] [DEBUG] [LOCAL ] ARMK: Loaded 51086 existing records from primary storage. [2025-10-27T17:17:07.880467] [INFO ] [MAIN ] ARMK: Loaded 51086 existing records. [2025-10-27T17:17:08.070776] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:17:08.071213] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-27T17:17:08.071285] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-27T17:17:08.071600] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-27T17:17:08.071763] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-27T17:17:08.423561] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-27T17:17:08.458760] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-27T17:17:08.464384] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:17:08.884062] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-27T17:17:09.214962] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-27T17:17:10.020038] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-27T17:17:10.040551] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T17:17:10.814968] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-27T17:17:11.179492] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-27T17:17:11.439583] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T17:17:11.614910] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-27T17:17:12.414976] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-27T17:17:12.452845] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-27T17:17:12.823065] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T17:17:13.214948] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-27T17:17:13.947044] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T17:17:14.014910] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-27T17:17:14.814992] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-27T17:17:14.938095] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-27T17:17:15.179785] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-27T17:17:15.614942] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-27T17:17:16.415000] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-27T17:17:16.670492] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-27T17:17:16.909861] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T17:17:16.917817] [INFO ] [REMOTE ] ARI: Full fetch complete (62196 records). [2025-10-27T17:17:16.917918] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-27T17:17:17.220097] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-27T17:17:17.302365] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-27T17:17:17.302437] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-27T17:17:17.303051] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-27T17:17:17.303115] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-27T17:17:17.304237] [DEBUG] [LOCAL ] ARI: Trimmed 62196 records to 43209 (keeping 200 days of data) [2025-10-27T17:17:17.551220] [DEBUG] [LOCAL ] ARI: Primary data saved (43209 records). [2025-10-27T17:17:17.551343] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-27T17:17:17.551419] [INFO ] [MAIN ] Update Progress: 144/2366 symbols completed. ARI took 30.2s. Estimated remaining: 4h 26m 4s. Rate: 8.4 symbols/min [2025-10-27T17:17:17.715437] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:17:17.757866] [DEBUG] [LOCAL ] AROC: Loaded 49804 existing records from primary storage. [2025-10-27T17:17:17.758174] [INFO ] [MAIN ] AROC: Loaded 49804 existing records. [2025-10-27T17:17:17.943983] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:17:17.944472] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-27T17:17:17.944607] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-27T17:17:17.944971] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-27T17:17:17.945025] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-27T17:17:18.015427] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-27T17:17:18.369678] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:17:18.372502] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-27T17:17:18.814971] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-27T17:17:18.962418] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-27T17:17:19.314088] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T17:17:19.614993] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-27T17:17:20.415060] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-27T17:17:20.610850] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-27T17:17:21.030466] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T17:17:21.214968] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-27T17:17:21.974579] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T17:17:22.014936] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-27T17:17:22.815131] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-27T17:17:23.381502] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-27T17:17:23.391419] [INFO ] [REMOTE ] ARES: Full fetch complete (71717 records). [2025-10-27T17:17:23.391572] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-27T17:17:23.620037] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-27T17:17:23.814883] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-27T17:17:23.815023] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-27T17:17:23.815765] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-27T17:17:23.815840] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-27T17:17:23.817151] [DEBUG] [LOCAL ] ARES: Trimmed 71717 records to 49601 (keeping 200 days of data) [2025-10-27T17:17:24.151587] [DEBUG] [LOCAL ] ARES: Primary data saved (49601 records). [2025-10-27T17:17:24.151822] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-27T17:17:24.153173] [INFO ] [MAIN ] Update Progress: 145/2366 symbols completed. ARES took 38.5s. Estimated remaining: 4h 25m 48s. Rate: 8.4 symbols/min [2025-10-27T17:17:24.154280] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-27T17:17:24.292346] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T17:17:24.373180] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:17:24.420673] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-27T17:17:24.422489] [DEBUG] [LOCAL ] ARR: Loaded 52859 existing records from primary storage. [2025-10-27T17:17:24.422896] [INFO ] [MAIN ] ARR: Loaded 52859 existing records. [2025-10-27T17:17:24.603248] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:17:24.603578] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-27T17:17:24.603633] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-27T17:17:24.603994] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-10-27T17:17:24.604043] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-27T17:17:24.999086] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:17:25.057169] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T17:17:25.214927] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-27T17:17:26.014910] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-27T17:17:26.101174] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-27T17:17:26.814928] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-27T17:17:26.924774] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T17:17:26.932762] [INFO ] [REMOTE ] ARLO: Full fetch complete (62921 records). [2025-10-27T17:17:26.932870] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-27T17:17:26.933545] [FATAL] [VALIDATOR ] ARLO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:17:26.933628] [FATAL] [MAIN ] ARLO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:17:26.933705] [WARN ] [MAIN ] ARLO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:17:26.933775] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-27T17:17:26.933837] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-10-27T17:17:26.933871] [INFO ] [LOCAL ] ARLO: Starting deletion of derivative data. [2025-10-27T17:17:26.933985] [DEBUG] [LOCAL ] ARLO: Deleted derivative data file. [2025-10-27T17:17:26.935013] [INFO ] [MAIN ] Update Progress: 146/2366 symbols completed. ARLO took 31.2s. Estimated remaining: 4h 24m 34s. Rate: 8.4 symbols/min [2025-10-27T17:17:27.106100] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:17:27.146414] [DEBUG] [LOCAL ] ARW: Loaded 33601 existing records from primary storage. [2025-10-27T17:17:27.146695] [INFO ] [MAIN ] ARW: Loaded 33601 existing records. [2025-10-27T17:17:27.332355] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:17:27.332706] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-27T17:17:27.332847] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-27T17:17:27.333156] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-27T17:17:27.333267] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-27T17:17:27.616413] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-27T17:17:27.703663] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T17:17:27.746259] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:17:28.333293] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T17:17:28.414960] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-27T17:17:29.214953] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-27T17:17:29.461226] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-27T17:17:29.707618] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-27T17:17:30.014941] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-27T17:17:30.818558] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-27T17:17:30.823634] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-27T17:17:31.184612] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T17:17:31.614959] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-27T17:17:32.414912] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-27T17:17:32.667463] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-27T17:17:33.037765] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-27T17:17:33.214940] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-27T17:17:33.890432] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T17:17:34.014917] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-27T17:17:34.400360] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T17:17:34.814940] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-27T17:17:35.614925] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-27T17:17:35.967301] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-27T17:17:35.976922] [INFO ] [REMOTE ] ARMK: Full fetch complete (72916 records). [2025-10-27T17:17:35.977094] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-27T17:17:36.388728] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-27T17:17:36.388818] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-27T17:17:36.389602] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-27T17:17:36.389687] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-27T17:17:36.391070] [DEBUG] [LOCAL ] ARMK: Trimmed 72916 records to 50218 (keeping 200 days of data) [2025-10-27T17:17:36.443278] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-27T17:17:36.706224] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-27T17:17:36.730994] [DEBUG] [LOCAL ] ARMK: Primary data saved (50218 records). [2025-10-27T17:17:36.731452] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-27T17:17:36.732320] [INFO ] [MAIN ] Update Progress: 147/2366 symbols completed. ARMK took 29.1s. Estimated remaining: 4h 25m 7s. Rate: 8.4 symbols/min [2025-10-27T17:17:36.895337] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:17:36.895519] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-27T17:17:36.895555] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-27T17:17:36.895687] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-27T17:17:36.895739] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-27T17:17:36.895780] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-27T17:17:36.895811] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-27T17:17:37.220089] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-27T17:17:37.260483] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:17:37.397535] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-27T17:17:37.597749] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-27T17:17:38.014938] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-10-27T17:17:38.601360] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T17:17:38.814961] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-27T17:17:39.493459] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:17:39.493798] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-10-27T17:17:39.493908] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:17:39.493953] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-27T17:17:39.493985] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:17:39.494019] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-27T17:17:39.494072] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-27T17:17:39.494106] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-27T17:17:39.494145] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-27T17:17:39.494189] [INFO ] [MAIN ] Update Progress: 148/2366 symbols completed. ARX took 2.8s. Estimated remaining: 4h 23m 54s. Rate: 8.4 symbols/min [2025-10-27T17:17:39.620099] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-27T17:17:39.664559] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:17:39.717660] [DEBUG] [LOCAL ] AS: Loaded 53975 existing records from primary storage. [2025-10-27T17:17:39.717969] [INFO ] [MAIN ] AS: Loaded 53975 existing records. [2025-10-27T17:17:39.894224] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:17:39.894428] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-27T17:17:39.894474] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-27T17:17:39.894764] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-27T17:17:39.894823] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-27T17:17:40.242542] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:17:40.414907] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-27T17:17:40.532449] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T17:17:41.214946] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-27T17:17:41.742740] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T17:17:42.014908] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-27T17:17:42.067738] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-27T17:17:42.814982] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-27T17:17:42.886596] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T17:17:43.149042] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T17:17:43.614953] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-27T17:17:44.414966] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-27T17:17:44.854201] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-27T17:17:44.864006] [INFO ] [REMOTE ] AROC: Full fetch complete (71463 records). [2025-10-27T17:17:44.864132] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-27T17:17:45.216052] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-27T17:17:45.255773] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-27T17:17:45.255849] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-27T17:17:45.256531] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-27T17:17:45.256593] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-27T17:17:45.257990] [DEBUG] [LOCAL ] AROC: Trimmed 71463 records to 49007 (keeping 200 days of data) [2025-10-27T17:17:45.510253] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T17:17:45.578637] [DEBUG] [LOCAL ] AROC: Primary data saved (49007 records). [2025-10-27T17:17:45.578796] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-27T17:17:45.578917] [INFO ] [MAIN ] Update Progress: 149/2366 symbols completed. AROC took 28.0s. Estimated remaining: 4h 23m 31s. Rate: 8.4 symbols/min [2025-10-27T17:17:45.721358] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-27T17:17:45.797931] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:17:45.813032] [DEBUG] [LOCAL ] ASA: Loaded 15913 existing records from primary storage. [2025-10-27T17:17:45.813336] [INFO ] [MAIN ] ASA: Loaded 15913 existing records. [2025-10-27T17:17:46.002049] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:17:46.002291] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-27T17:17:46.002349] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-27T17:17:46.002830] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-27T17:17:46.002888] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-27T17:17:46.024896] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-27T17:17:46.387484] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:17:46.473361] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T17:17:46.814953] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-27T17:17:47.051878] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T17:17:47.614991] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-27T17:17:48.113612] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T17:17:48.414925] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-27T17:17:49.005415] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T17:17:49.214951] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-27T17:17:50.014920] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-27T17:17:50.357812] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-27T17:17:50.814941] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-27T17:17:51.460975] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-27T17:17:51.614944] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-27T17:17:52.110196] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-27T17:17:52.164265] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-27T17:17:52.414929] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-27T17:17:52.471506] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T17:17:53.214912] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-27T17:17:53.525205] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T17:17:54.014924] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-27T17:17:54.690035] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-27T17:17:54.696581] [INFO ] [REMOTE ] ARW: Full fetch complete (48385 records). [2025-10-27T17:17:54.696706] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-27T17:17:54.697420] [FATAL] [VALIDATOR ] ARW: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:17:54.697511] [FATAL] [MAIN ] ARW: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:17:54.697554] [WARN ] [MAIN ] ARW: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:17:54.697591] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-27T17:17:54.697667] [DEBUG] [LOCAL ] ARW: No primary data file found to delete. [2025-10-27T17:17:54.697737] [INFO ] [LOCAL ] ARW: Starting deletion of derivative data. [2025-10-27T17:17:54.697913] [DEBUG] [LOCAL ] ARW: Deleted derivative data file. [2025-10-27T17:17:54.699178] [INFO ] [MAIN ] Update Progress: 150/2366 symbols completed. ARW took 27.8s. Estimated remaining: 4h 23m 53s. Rate: 8.4 symbols/min [2025-10-27T17:17:54.820064] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-27T17:17:54.871495] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:17:54.930268] [DEBUG] [LOCAL ] ASAN: Loaded 53499 existing records from primary storage. [2025-10-27T17:17:54.930614] [INFO ] [MAIN ] ASAN: Loaded 53499 existing records. [2025-10-27T17:17:55.107313] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:17:55.107540] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-27T17:17:55.107603] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-27T17:17:55.107834] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-27T17:17:55.107893] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-27T17:17:55.473555] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:17:55.554992] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-27T17:17:55.614861] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-27T17:17:56.074196] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-27T17:17:56.330238] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-27T17:17:56.414915] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-27T17:17:56.916800] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-27T17:17:57.214933] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-27T17:17:58.014998] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-27T17:17:58.722357] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T17:17:58.814949] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-27T17:17:59.614945] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-27T17:18:00.318260] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-27T17:18:00.414916] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-27T17:18:00.593046] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-27T17:18:00.982673] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-27T17:18:01.214990] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-27T17:18:02.015029] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-27T17:18:02.790592] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-27T17:18:02.814911] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-27T17:18:03.276005] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-27T17:18:03.614953] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-27T17:18:03.775369] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-10-27T17:18:04.258039] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T17:18:04.414910] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-27T17:18:04.762566] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T17:18:05.214952] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-27T17:18:05.876804] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T17:18:06.014916] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-27T17:18:06.514038] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T17:18:06.815159] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-27T17:18:06.840314] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-27T17:18:06.845355] [INFO ] [REMOTE ] ASA: Full fetch complete (20761 records). [2025-10-27T17:18:06.845448] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-27T17:18:06.846174] [FATAL] [VALIDATOR ] ASA: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:18:06.846288] [FATAL] [MAIN ] ASA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:18:06.846374] [WARN ] [MAIN ] ASA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:18:06.846469] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-27T17:18:06.846571] [DEBUG] [LOCAL ] ASA: No primary data file found to delete. [2025-10-27T17:18:06.846619] [INFO ] [LOCAL ] ASA: Starting deletion of derivative data. [2025-10-27T17:18:06.846883] [DEBUG] [LOCAL ] ASA: Deleted derivative data file. [2025-10-27T17:18:06.846985] [INFO ] [MAIN ] Update Progress: 151/2366 symbols completed. ASA took 21.3s. Estimated remaining: 4h 24m 59s. Rate: 8.4 symbols/min [2025-10-27T17:18:07.031783] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:18:07.086587] [DEBUG] [LOCAL ] ASB: Loaded 50446 existing records from primary storage. [2025-10-27T17:18:07.087066] [INFO ] [MAIN ] ASB: Loaded 50446 existing records. [2025-10-27T17:18:07.285768] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:18:07.286044] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-27T17:18:07.286098] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-27T17:18:07.286329] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-27T17:18:07.286369] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-27T17:18:07.620066] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-27T17:18:07.680755] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:18:08.415170] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-27T17:18:08.418447] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T17:18:09.214928] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-27T17:18:09.727483] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-27T17:18:09.818479] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T17:18:10.014949] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-27T17:18:10.655054] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T17:18:10.815149] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-27T17:18:11.615026] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-27T17:18:11.702278] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T17:18:12.286024] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T17:18:12.414936] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-27T17:18:13.214973] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-27T17:18:13.523887] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T17:18:13.637224] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-27T17:18:13.646714] [INFO ] [REMOTE ] ARR: Full fetch complete (75153 records). [2025-10-27T17:18:13.646827] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-27T17:18:13.647464] [FATAL] [VALIDATOR ] ARR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:18:13.647549] [FATAL] [MAIN ] ARR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:18:13.647590] [WARN ] [MAIN ] ARR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:18:13.647679] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-27T17:18:13.647752] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-27T17:18:13.647796] [INFO ] [LOCAL ] ARR: Starting deletion of derivative data. [2025-10-27T17:18:13.647929] [DEBUG] [LOCAL ] ARR: Deleted derivative data file. [2025-10-27T17:18:13.647993] [INFO ] [MAIN ] Update Progress: 152/2366 symbols completed. ARR took 49.5s. Estimated remaining: 4h 24m 47s. Rate: 8.4 symbols/min [2025-10-27T17:18:13.814937] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:18:13.820376] [DEBUG] [LOCAL ] ASBA: Loaded 3508 existing records from primary storage. [2025-10-27T17:18:13.820513] [INFO ] [MAIN ] ASBA: Loaded 3508 existing records. [2025-10-27T17:18:13.992545] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:18:13.992799] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-27T17:18:13.992865] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-27T17:18:13.992990] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-27T17:18:13.993027] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-27T17:18:14.022677] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-27T17:18:14.339700] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:18:14.567395] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T17:18:14.814919] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-27T17:18:15.305503] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-27T17:18:15.614965] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-27T17:18:15.999768] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-27T17:18:16.312108] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-27T17:18:16.414960] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-27T17:18:17.214974] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-27T17:18:17.595885] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-27T17:18:18.014899] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-27T17:18:18.054299] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-27T17:18:18.814958] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-27T17:18:19.614940] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-27T17:18:19.744327] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-27T17:18:19.967130] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-27T17:18:20.366236] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T17:18:20.414918] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-27T17:18:21.214959] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-27T17:18:22.014941] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-27T17:18:22.282114] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-27T17:18:22.292433] [INFO ] [REMOTE ] AS: Full fetch complete (76926 records). [2025-10-27T17:18:22.292596] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-27T17:18:22.702322] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-27T17:18:22.702400] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-27T17:18:22.703171] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-27T17:18:22.703235] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-27T17:18:22.704732] [DEBUG] [LOCAL ] AS: Trimmed 76926 records to 53194 (keeping 200 days of data) [2025-10-27T17:18:22.818230] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-27T17:18:23.011831] [DEBUG] [LOCAL ] AS: Primary data saved (53194 records). [2025-10-27T17:18:23.012074] [INFO ] [MAIN ] AS: Full history saved. [2025-10-27T17:18:23.013324] [INFO ] [MAIN ] Update Progress: 153/2366 symbols completed. AS took 43.5s. Estimated remaining: 4h 25m 11s. Rate: 8.3 symbols/min [2025-10-27T17:18:23.133367] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-27T17:18:23.164934] [INFO ] [REMOTE ] ASAN: Full fetch complete (76239 records). [2025-10-27T17:18:23.175350] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-27T17:18:23.210435] [FATAL] [VALIDATOR ] ASAN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:18:23.228934] [FATAL] [MAIN ] ASAN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:18:23.228319] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:18:23.229421] [WARN ] [MAIN ] ASAN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:18:23.229592] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-27T17:18:23.229689] [DEBUG] [LOCAL ] ASAN: No primary data file found to delete. [2025-10-27T17:18:23.229746] [INFO ] [LOCAL ] ASAN: Starting deletion of derivative data. [2025-10-27T17:18:23.229878] [DEBUG] [LOCAL ] ASAN: Deleted derivative data file. [2025-10-27T17:18:23.230963] [INFO ] [MAIN ] Update Progress: 154/2366 symbols completed. ASAN took 28.5s. Estimated remaining: 4h 23m 24s. Rate: 8.4 symbols/min [2025-10-27T17:18:23.413845] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:18:23.430341] [DEBUG] [LOCAL ] ASC: Loaded 37801 existing records from primary storage. [2025-10-27T17:18:23.430840] [INFO ] [MAIN ] ASC: Loaded 37801 existing records. [2025-10-27T17:18:23.475737] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-27T17:18:23.628243] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-27T17:18:23.630568] [DEBUG] [LOCAL ] ASG: Loaded 19621 existing records from primary storage. [2025-10-27T17:18:23.635111] [INFO ] [MAIN ] ASG: Loaded 19621 existing records. [2025-10-27T17:18:23.634935] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:18:23.672130] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-27T17:18:23.678728] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-27T17:18:23.710453] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-27T17:18:23.726782] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-27T17:18:23.949429] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:18:23.969191] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-27T17:18:23.969389] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-27T17:18:24.001665] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-27T17:18:24.011740] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-27T17:18:24.051189] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-27T17:18:24.207617] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-27T17:18:24.349398] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:18:24.420567] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-27T17:18:24.600262] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:18:24.838286] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-27T17:18:25.214947] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-27T17:18:26.014941] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-27T17:18:26.529500] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-27T17:18:26.564256] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T17:18:26.814949] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-27T17:18:27.614943] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-27T17:18:27.939852] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-27T17:18:28.414927] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-27T17:18:28.587564] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-27T17:18:29.214957] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-27T17:18:29.491256] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T17:18:30.014920] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-27T17:18:30.206768] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-27T17:18:30.814939] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-27T17:18:31.239353] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-27T17:18:31.240698] [INFO ] [REMOTE ] ASBA: Full fetch complete (5134 records). [2025-10-27T17:18:31.240768] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-27T17:18:31.546427] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T17:18:31.620019] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-27T17:18:31.652700] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-27T17:18:31.652792] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-27T17:18:31.652930] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-27T17:18:31.652968] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-27T17:18:31.653348] [DEBUG] [LOCAL ] ASBA: Trimmed 5134 records to 3407 (keeping 200 days of data) [2025-10-27T17:18:31.673487] [DEBUG] [LOCAL ] ASBA: Primary data saved (3407 records). [2025-10-27T17:18:31.673604] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-27T17:18:31.673703] [INFO ] [MAIN ] Update Progress: 155/2366 symbols completed. ASBA took 18.0s. Estimated remaining: 4h 23m 35s. Rate: 8.4 symbols/min [2025-10-27T17:18:31.845067] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:18:31.866831] [DEBUG] [LOCAL ] ASGI: Loaded 23238 existing records from primary storage. [2025-10-27T17:18:31.867070] [INFO ] [MAIN ] ASGI: Loaded 23238 existing records. [2025-10-27T17:18:32.041128] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:18:32.041335] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-27T17:18:32.041381] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-27T17:18:32.041547] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-27T17:18:32.041585] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-27T17:18:32.388584] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:18:32.414901] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-27T17:18:33.214977] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-27T17:18:33.501075] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-27T17:18:33.563707] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T17:18:34.014939] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-27T17:18:34.342843] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-27T17:18:34.814972] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-27T17:18:35.288063] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T17:18:35.614939] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-27T17:18:36.414962] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-27T17:18:36.520677] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T17:18:36.743036] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-27T17:18:37.062189] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T17:18:37.214950] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-27T17:18:38.014955] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-27T17:18:38.236214] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T17:18:38.814960] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-27T17:18:39.614970] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-27T17:18:39.894965] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T17:18:40.245783] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T17:18:40.414941] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-27T17:18:40.792413] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-27T17:18:41.214996] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-27T17:18:41.443588] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T17:18:42.014946] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-27T17:18:42.397820] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-27T17:18:42.407060] [INFO ] [REMOTE ] ASB: Full fetch complete (71958 records). [2025-10-27T17:18:42.407168] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-27T17:18:42.407986] [FATAL] [VALIDATOR ] ASB: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:18:42.408073] [FATAL] [MAIN ] ASB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:18:42.408114] [WARN ] [MAIN ] ASB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:18:42.408152] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-27T17:18:42.408206] [DEBUG] [LOCAL ] ASB: No primary data file found to delete. [2025-10-27T17:18:42.408240] [INFO ] [LOCAL ] ASB: Starting deletion of derivative data. [2025-10-27T17:18:42.408376] [DEBUG] [LOCAL ] ASB: Deleted derivative data file. [2025-10-27T17:18:42.408463] [INFO ] [MAIN ] Update Progress: 156/2366 symbols completed. ASB took 35.6s. Estimated remaining: 4h 24m 19s. Rate: 8.4 symbols/min [2025-10-27T17:18:42.575629] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:18:42.607978] [DEBUG] [LOCAL ] ASGN: Loaded 37382 existing records from primary storage. [2025-10-27T17:18:42.608277] [INFO ] [MAIN ] ASGN: Loaded 37382 existing records. [2025-10-27T17:18:42.787723] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:18:42.788016] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-27T17:18:42.788211] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-27T17:18:42.788494] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-27T17:18:42.788561] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-27T17:18:42.825336] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-27T17:18:42.910454] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T17:18:43.167137] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:18:43.614940] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-27T17:18:44.358213] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T17:18:44.414983] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-27T17:18:44.495679] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-27T17:18:45.214938] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-27T17:18:45.765863] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T17:18:45.926160] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T17:18:46.015005] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-27T17:18:46.721142] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-27T17:18:46.814955] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-27T17:18:47.614924] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-27T17:18:48.091739] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-27T17:18:48.255183] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-27T17:18:48.414939] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-27T17:18:49.214912] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-27T17:18:49.688871] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T17:18:49.951549] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-27T17:18:50.014926] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-27T17:18:50.722893] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-27T17:18:50.814964] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-27T17:18:51.614961] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-27T17:18:51.813360] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-27T17:18:52.414958] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-27T17:18:53.036304] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T17:18:53.214959] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-27T17:18:53.638717] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T17:18:53.645966] [INFO ] [REMOTE ] ASC: Full fetch complete (55718 records). [2025-10-27T17:18:53.646124] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-27T17:18:53.647088] [FATAL] [VALIDATOR ] ASC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:18:53.647190] [FATAL] [MAIN ] ASC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:18:53.647236] [WARN ] [MAIN ] ASC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:18:53.647276] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-27T17:18:53.647334] [DEBUG] [LOCAL ] ASC: No primary data file found to delete. [2025-10-27T17:18:53.647370] [INFO ] [LOCAL ] ASC: Starting deletion of derivative data. [2025-10-27T17:18:53.647592] [DEBUG] [LOCAL ] ASC: Deleted derivative data file. [2025-10-27T17:18:53.647725] [INFO ] [MAIN ] Update Progress: 157/2366 symbols completed. ASC took 30.6s. Estimated remaining: 4h 25m 9s. Rate: 8.3 symbols/min [2025-10-27T17:18:54.014942] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-27T17:18:54.226330] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-27T17:18:54.814942] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-27T17:18:55.054446] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T17:18:55.058900] [INFO ] [REMOTE ] ASG: Full fetch complete (30864 records). [2025-10-27T17:18:55.059044] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-27T17:18:55.441123] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-27T17:18:55.441203] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-27T17:18:55.441616] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-27T17:18:55.441700] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-27T17:18:55.442346] [DEBUG] [LOCAL ] ASG: Trimmed 30864 records to 19127 (keeping 200 days of data) [2025-10-27T17:18:55.544778] [DEBUG] [LOCAL ] ASG: Primary data saved (19127 records). [2025-10-27T17:18:55.544900] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-27T17:18:55.545018] [INFO ] [MAIN ] Update Progress: 158/2366 symbols completed. ASG took 32.3s. Estimated remaining: 4h 23m 47s. Rate: 8.4 symbols/min [2025-10-27T17:18:55.620948] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-27T17:18:55.632556] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T17:18:56.415072] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-27T17:18:56.649939] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-27T17:18:57.131504] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-27T17:18:57.214914] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-27T17:18:58.015053] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-27T17:18:58.475502] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-27T17:18:58.480097] [INFO ] [REMOTE ] ASGI: Full fetch complete (32653 records). [2025-10-27T17:18:58.480171] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-27T17:18:58.480705] [FATAL] [VALIDATOR ] ASGI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:18:58.480788] [FATAL] [MAIN ] ASGI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:18:58.480829] [WARN ] [MAIN ] ASGI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:18:58.480899] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-27T17:18:58.480960] [DEBUG] [LOCAL ] ASGI: No primary data file found to delete. [2025-10-27T17:18:58.480994] [INFO ] [LOCAL ] ASGI: Starting deletion of derivative data. [2025-10-27T17:18:58.481127] [DEBUG] [LOCAL ] ASGI: Deleted derivative data file. [2025-10-27T17:18:58.481211] [INFO ] [MAIN ] Update Progress: 159/2366 symbols completed. ASGI took 26.8s. Estimated remaining: 4h 22m 41s. Rate: 8.4 symbols/min [2025-10-27T17:18:59.652501] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T17:18:59.660717] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-27T17:19:01.216610] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T17:19:01.225132] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-27T17:19:02.526013] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-27T17:19:02.534213] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-27T17:19:03.786910] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T17:19:03.795737] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-27T17:19:04.919048] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-27T17:19:04.927197] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-27T17:19:06.337984] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T17:19:06.346616] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-27T17:19:07.765993] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T17:19:07.777332] [INFO ] [REMOTE ] ASGN: Full fetch complete (53864 records). [2025-10-27T17:19:07.777492] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-27T17:19:08.154505] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-27T17:19:08.154580] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-27T17:19:08.155139] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-27T17:19:08.155201] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-27T17:19:08.156250] [DEBUG] [LOCAL ] ASGN: Trimmed 53864 records to 36722 (keeping 200 days of data) [2025-10-27T17:19:08.358302] [DEBUG] [LOCAL ] ASGN: Primary data saved (36722 records). [2025-10-27T17:19:08.358445] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-27T17:19:08.358524] [INFO ] [MAIN ] Update Progress: 160/2366 symbols completed. ASGN took 25.9s. Estimated remaining: 4h 23m 12s. Rate: 8.4 symbols/min [2025-10-27T17:19:09.086531] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:19:09.111192] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:19:09.171537] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:19:09.203343] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:19:09.212515] [DEBUG] [LOCAL ] ASIX: Loaded 23254 existing records from primary storage. [2025-10-27T17:19:09.213690] [INFO ] [MAIN ] ASIX: Loaded 23254 existing records. [2025-10-27T17:19:09.368150] [DEBUG] [LOCAL ] ASH: Loaded 37849 existing records from primary storage. [2025-10-27T17:19:09.423921] [DEBUG] [LOCAL ] ASR: Loaded 9542 existing records from primary storage. [2025-10-27T17:19:09.429319] [INFO ] [MAIN ] ASH: Loaded 37849 existing records. [2025-10-27T17:19:09.437965] [INFO ] [MAIN ] ASR: Loaded 9542 existing records. [2025-10-27T17:19:09.462037] [DEBUG] [LOCAL ] ASPN: Loaded 50576 existing records from primary storage. [2025-10-27T17:19:09.479756] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:19:09.485457] [INFO ] [MAIN ] ASPN: Loaded 50576 existing records. [2025-10-27T17:19:09.485347] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-27T17:19:09.553547] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-27T17:19:09.674401] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-27T17:19:09.750334] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-27T17:19:10.021495] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:19:10.117616] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-27T17:19:10.104975] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:19:10.118568] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-27T17:19:10.125742] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-27T17:19:10.141711] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-27T17:19:10.150528] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:19:10.141877] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-27T17:19:10.192749] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-27T17:19:10.225826] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-27T17:19:10.225732] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-27T17:19:10.293540] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-27T17:19:10.269105] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-27T17:19:10.421512] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-27T17:19:10.439092] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-27T17:19:10.899173] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:19:10.943059] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-27T17:19:11.393271] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:19:11.454937] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-27T17:19:11.582922] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:19:11.598876] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-27T17:19:11.658674] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:19:11.659063] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-27T17:19:12.432710] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-27T17:19:12.434624] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-27T17:19:12.450844] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T17:19:12.454593] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-27T17:19:13.039323] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T17:19:13.047040] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-27T17:19:13.146087] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-27T17:19:13.150182] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-27T17:19:13.672489] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-27T17:19:13.683084] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-27T17:19:13.689348] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-27T17:19:13.691324] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-27T17:19:14.008860] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-27T17:19:14.016769] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-27T17:19:14.070172] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T17:19:14.074487] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-27T17:19:14.214243] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-27T17:19:14.216573] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-27T17:19:14.741758] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-27T17:19:14.744821] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-27T17:19:14.869505] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-27T17:19:14.875601] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-27T17:19:14.912742] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T17:19:15.152229] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T17:19:15.183762] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-27T17:19:15.614982] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-27T17:19:16.129682] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T17:19:16.414961] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-27T17:19:16.785041] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-27T17:19:17.218208] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-27T17:19:17.227919] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-27T17:19:18.014996] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-27T17:19:18.428750] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T17:19:18.814975] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-27T17:19:18.877703] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-27T17:19:19.614950] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-27T17:19:20.088184] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-27T17:19:20.335088] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T17:19:20.414905] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-27T17:19:21.214984] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-27T17:19:21.794731] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-27T17:19:22.014959] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-27T17:19:22.814902] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-27T17:19:22.920333] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T17:19:23.063319] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-27T17:19:23.614913] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-27T17:19:24.196939] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T17:19:24.414984] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-27T17:19:25.094128] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T17:19:25.214966] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-27T17:19:25.466606] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-27T17:19:26.014923] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-27T17:19:26.308456] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T17:19:26.316091] [INFO ] [REMOTE ] ASH: Full fetch complete (55657 records). [2025-10-27T17:19:26.316187] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-27T17:19:26.725238] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-27T17:19:26.725337] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-27T17:19:26.725940] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-27T17:19:26.726003] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-27T17:19:26.727060] [DEBUG] [LOCAL ] ASH: Trimmed 55657 records to 37142 (keeping 200 days of data) [2025-10-27T17:19:26.815481] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-27T17:19:26.975816] [DEBUG] [LOCAL ] ASH: Primary data saved (37142 records). [2025-10-27T17:19:26.977103] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-27T17:19:26.977253] [INFO ] [MAIN ] Update Progress: 161/2366 symbols completed. ASH took 18.6s. Estimated remaining: 4h 25m 42s. Rate: 8.3 symbols/min [2025-10-27T17:19:26.976966] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-27T17:19:27.152320] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:19:27.202525] [DEBUG] [LOCAL ] ASX: Loaded 53647 existing records from primary storage. [2025-10-27T17:19:27.202871] [INFO ] [MAIN ] ASX: Loaded 53647 existing records. [2025-10-27T17:19:27.390041] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:19:27.391055] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-27T17:19:27.391107] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-27T17:19:27.391322] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-27T17:19:27.391381] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-27T17:19:27.622150] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-27T17:19:27.750172] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:19:27.760552] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T17:19:28.414939] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-27T17:19:29.215004] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-27T17:19:29.320326] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-27T17:19:30.014991] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-27T17:19:30.284159] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-27T17:19:30.309634] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T17:19:30.814971] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-27T17:19:31.313872] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T17:19:31.614962] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-27T17:19:31.669934] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-27T17:19:31.675223] [INFO ] [REMOTE ] ASIX: Full fetch complete (31063 records). [2025-10-27T17:19:31.675362] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-27T17:19:32.049753] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-27T17:19:32.049867] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-27T17:19:32.050348] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-27T17:19:32.050394] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-27T17:19:32.051477] [DEBUG] [LOCAL ] ASIX: Trimmed 31063 records to 22673 (keeping 200 days of data) [2025-10-27T17:19:32.190886] [DEBUG] [LOCAL ] ASIX: Primary data saved (22673 records). [2025-10-27T17:19:32.191070] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-27T17:19:32.191171] [INFO ] [MAIN ] Update Progress: 162/2366 symbols completed. ASIX took 23.8s. Estimated remaining: 4h 25m 7s. Rate: 8.3 symbols/min [2025-10-27T17:19:32.333805] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T17:19:32.361758] [INFO ] [REMOTE ] ASR: Full fetch complete (12588 records). [2025-10-27T17:19:32.368477] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-27T17:19:32.417554] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-27T17:19:32.419616] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:19:32.718289] [DEBUG] [LOCAL ] ATEN: Loaded 38121 existing records from primary storage. [2025-10-27T17:19:32.718776] [INFO ] [MAIN ] ATEN: Loaded 38121 existing records. [2025-10-27T17:19:33.000863] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-27T17:19:33.001403] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-27T17:19:33.005089] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-27T17:19:33.005175] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-27T17:19:33.004630] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:19:33.005866] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-27T17:19:33.006231] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-27T17:19:33.006326] [DEBUG] [LOCAL ] ASR: Trimmed 12588 records to 9374 (keeping 200 days of data) [2025-10-27T17:19:33.006834] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-27T17:19:33.006913] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-27T17:19:33.186435] [DEBUG] [LOCAL ] ASR: Primary data saved (9374 records). [2025-10-27T17:19:33.202016] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-27T17:19:33.214988] [INFO ] [MAIN ] Update Progress: 163/2366 symbols completed. ASR took 24.8s. Estimated remaining: 4h 23m 36s. Rate: 8.4 symbols/min [2025-10-27T17:19:33.215110] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-27T17:19:33.585533] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:19:33.616107] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:19:33.644065] [DEBUG] [LOCAL ] ATGE: Loaded 30729 existing records from primary storage. [2025-10-27T17:19:33.644434] [INFO ] [MAIN ] ATGE: Loaded 30729 existing records. [2025-10-27T17:19:33.838062] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:19:33.850981] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-27T17:19:33.851440] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-27T17:19:33.852854] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T17:19:33.862267] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-27T17:19:33.862607] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-27T17:19:34.018072] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-27T17:19:34.218469] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:19:34.814970] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-27T17:19:35.011713] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-27T17:19:35.614940] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-27T17:19:36.272779] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-27T17:19:36.313102] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-27T17:19:36.414934] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-27T17:19:37.022136] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T17:19:37.214936] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-27T17:19:37.330976] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T17:19:38.014932] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-27T17:19:38.815154] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-27T17:19:39.237201] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-27T17:19:39.614927] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-27T17:19:39.899680] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-27T17:19:40.107829] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-27T17:19:40.414933] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-27T17:19:41.028374] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T17:19:41.214931] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-27T17:19:41.660033] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-27T17:19:42.014941] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-27T17:19:42.814940] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-27T17:19:42.908830] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T17:19:43.056014] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T17:19:43.614981] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-27T17:19:44.414973] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-27T17:19:44.583124] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T17:19:44.830184] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-27T17:19:45.214992] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-27T17:19:45.790777] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T17:19:46.014985] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-27T17:19:46.736266] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T17:19:46.814924] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-27T17:19:47.569097] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-27T17:19:47.614915] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-27T17:19:48.414958] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-27T17:19:48.561358] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-27T17:19:48.724487] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-27T17:19:49.214993] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-27T17:19:50.023162] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-27T17:19:50.033162] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-27T17:19:50.045221] [INFO ] [REMOTE ] ASPN: Full fetch complete (72577 records). [2025-10-27T17:19:50.045467] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-27T17:19:50.469601] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-27T17:19:50.469766] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-27T17:19:50.470801] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-27T17:19:50.470885] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-27T17:19:50.472930] [DEBUG] [LOCAL ] ASPN: Trimmed 72577 records to 49804 (keeping 200 days of data) [2025-10-27T17:19:50.779919] [DEBUG] [LOCAL ] ASPN: Primary data saved (49804 records). [2025-10-27T17:19:50.780190] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-27T17:19:50.780333] [INFO ] [MAIN ] Update Progress: 164/2366 symbols completed. ASPN took 42.4s. Estimated remaining: 4h 25m 49s. Rate: 8.3 symbols/min [2025-10-27T17:19:50.820091] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-27T17:19:50.913410] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T17:19:51.005297] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:19:51.035439] [DEBUG] [LOCAL ] ATHM: Loaded 31589 existing records from primary storage. [2025-10-27T17:19:51.035792] [INFO ] [MAIN ] ATHM: Loaded 31589 existing records. [2025-10-27T17:19:51.215384] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:19:51.215704] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-27T17:19:51.215783] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-27T17:19:51.215960] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-27T17:19:51.216000] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-27T17:19:51.591917] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:19:51.615010] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-27T17:19:51.709815] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T17:19:52.227799] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T17:19:52.415004] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-27T17:19:52.714613] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-27T17:19:53.214937] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-27T17:19:53.961499] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T17:19:54.014963] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-27T17:19:54.366324] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T17:19:54.814957] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-27T17:19:55.217843] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-27T17:19:55.615062] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-27T17:19:56.025795] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T17:19:56.034271] [INFO ] [REMOTE ] ATEN: Full fetch complete (56540 records). [2025-10-27T17:19:56.034490] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-27T17:19:56.431678] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-27T17:19:56.488888] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-27T17:19:56.488969] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-27T17:19:56.489633] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-27T17:19:56.489722] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-27T17:19:56.490874] [DEBUG] [LOCAL ] ATEN: Trimmed 56540 records to 37301 (keeping 200 days of data) [2025-10-27T17:19:56.724771] [DEBUG] [LOCAL ] ATEN: Primary data saved (37301 records). [2025-10-27T17:19:56.724914] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-27T17:19:56.725289] [INFO ] [MAIN ] Update Progress: 165/2366 symbols completed. ATEN took 24.5s. Estimated remaining: 4h 25m 24s. Rate: 8.3 symbols/min [2025-10-27T17:19:56.889194] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:19:56.899113] [DEBUG] [LOCAL ] ATHS: Loaded 6543 existing records from primary storage. [2025-10-27T17:19:56.899328] [INFO ] [MAIN ] ATHS: Loaded 6543 existing records. [2025-10-27T17:19:57.070696] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:19:57.070947] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-27T17:19:57.070995] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-27T17:19:57.071139] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-27T17:19:57.071178] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-27T17:19:57.219337] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-27T17:19:57.422826] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:19:57.642761] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-27T17:19:58.014961] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-27T17:19:58.184452] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-27T17:19:58.522951] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-27T17:19:58.814989] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-27T17:19:58.907834] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-27T17:19:59.614976] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-27T17:20:00.054044] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-27T17:20:00.078137] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-27T17:20:00.414929] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-27T17:20:01.215039] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-27T17:20:02.014941] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-27T17:20:02.077448] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T17:20:02.610287] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T17:20:02.814969] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-27T17:20:03.451503] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T17:20:03.614942] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-27T17:20:04.185046] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T17:20:04.414942] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-27T17:20:04.674062] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-27T17:20:04.680138] [INFO ] [REMOTE ] ATGE: Full fetch complete (45340 records). [2025-10-27T17:20:04.680298] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-27T17:20:05.059377] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-27T17:20:05.059518] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-27T17:20:05.060074] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-27T17:20:05.060191] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-27T17:20:05.061200] [DEBUG] [LOCAL ] ATGE: Trimmed 45340 records to 29886 (keeping 200 days of data) [2025-10-27T17:20:05.218787] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-27T17:20:05.234311] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T17:20:05.245819] [DEBUG] [LOCAL ] ATGE: Primary data saved (29886 records). [2025-10-27T17:20:05.246573] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-27T17:20:05.246710] [INFO ] [MAIN ] Update Progress: 166/2366 symbols completed. ATGE took 32.0s. Estimated remaining: 4h 25m 34s. Rate: 8.3 symbols/min [2025-10-27T17:20:05.409967] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:20:05.457681] [DEBUG] [LOCAL ] ATI: Loaded 52040 existing records from primary storage. [2025-10-27T17:20:05.458002] [INFO ] [MAIN ] ATI: Loaded 52040 existing records. [2025-10-27T17:20:05.629020] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:20:05.629222] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-27T17:20:05.629268] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-27T17:20:05.629835] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-27T17:20:05.629917] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-27T17:20:05.975594] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:20:06.014925] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-27T17:20:06.814956] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-27T17:20:06.846158] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-27T17:20:07.464794] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T17:20:07.614971] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-27T17:20:07.712836] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T17:20:08.414960] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-27T17:20:09.215003] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-27T17:20:09.624257] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T17:20:09.787550] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-27T17:20:09.787844] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-27T17:20:09.801807] [INFO ] [REMOTE ] ASX: Full fetch complete (76783 records). [2025-10-27T17:20:09.801983] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-27T17:20:10.022829] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-27T17:20:10.201212] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-27T17:20:10.201303] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-27T17:20:10.202078] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-27T17:20:10.202141] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-27T17:20:10.203700] [DEBUG] [LOCAL ] ASX: Trimmed 76783 records to 52859 (keeping 200 days of data) [2025-10-27T17:20:10.507286] [DEBUG] [LOCAL ] ASX: Primary data saved (52859 records). [2025-10-27T17:20:10.507453] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-27T17:20:10.508471] [INFO ] [MAIN ] Update Progress: 167/2366 symbols completed. ASX took 43.5s. Estimated remaining: 4h 25m 0s. Rate: 8.3 symbols/min [2025-10-27T17:20:10.624870] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T17:20:10.690980] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:20:10.725803] [DEBUG] [LOCAL ] ATKR: Loaded 35299 existing records from primary storage. [2025-10-27T17:20:10.726084] [INFO ] [MAIN ] ATKR: Loaded 35299 existing records. [2025-10-27T17:20:10.820118] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-27T17:20:10.906796] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:20:10.907011] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-27T17:20:10.907056] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-27T17:20:10.907480] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-27T17:20:10.907538] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-27T17:20:11.250916] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:20:11.614995] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-27T17:20:12.065692] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T17:20:12.414992] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-27T17:20:12.770581] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T17:20:13.214992] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-27T17:20:13.886710] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T17:20:14.014955] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-27T17:20:14.715048] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-27T17:20:14.814928] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-27T17:20:14.911555] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-27T17:20:15.614927] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-27T17:20:15.929600] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-27T17:20:16.415008] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-27T17:20:16.986387] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-27T17:20:17.043269] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-27T17:20:17.214977] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-27T17:20:18.015005] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-27T17:20:18.814993] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-27T17:20:19.614286] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-27T17:20:19.615463] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-27T17:20:19.616066] [INFO ] [REMOTE ] ATHS: Full fetch complete (9517 records). [2025-10-27T17:20:19.616170] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-27T17:20:19.616701] [FATAL] [VALIDATOR ] ATHS: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:20:19.617674] [FATAL] [MAIN ] ATHS: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:20:19.617745] [WARN ] [MAIN ] ATHS: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:20:19.617793] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-27T17:20:19.617850] [DEBUG] [LOCAL ] ATHS: No primary data file found to delete. [2025-10-27T17:20:19.617887] [INFO ] [LOCAL ] ATHS: Starting deletion of derivative data. [2025-10-27T17:20:19.618024] [DEBUG] [LOCAL ] ATHS: Deleted derivative data file. [2025-10-27T17:20:19.618107] [INFO ] [MAIN ] Update Progress: 168/2366 symbols completed. ATHS took 22.9s. Estimated remaining: 4h 25m 18s. Rate: 8.3 symbols/min [2025-10-27T17:20:19.807787] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:20:19.847448] [DEBUG] [LOCAL ] ATMU: Loaded 39070 existing records from primary storage. [2025-10-27T17:20:19.847893] [INFO ] [MAIN ] ATMU: Loaded 39070 existing records. [2025-10-27T17:20:20.031147] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:20:20.031446] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-27T17:20:20.031503] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-27T17:20:20.031833] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-27T17:20:20.031891] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-27T17:20:20.403688] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:20:20.414919] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-27T17:20:20.515740] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-27T17:20:20.772142] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-27T17:20:21.214958] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-27T17:20:21.262569] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (3.25 seconds). [2025-10-27T17:20:21.837960] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T17:20:22.014983] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-27T17:20:22.084905] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-27T17:20:22.749991] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-27T17:20:22.814939] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-27T17:20:23.515187] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-27T17:20:23.614975] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-27T17:20:24.414965] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-27T17:20:25.214953] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-27T17:20:25.379234] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-27T17:20:25.591300] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-27T17:20:26.014930] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-27T17:20:26.291252] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T17:20:26.298632] [INFO ] [REMOTE ] ATHM: Full fetch complete (48927 records). [2025-10-27T17:20:26.298775] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-27T17:20:26.299396] [FATAL] [VALIDATOR ] ATHM: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:20:26.299480] [FATAL] [MAIN ] ATHM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:20:26.299522] [WARN ] [MAIN ] ATHM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:20:26.299597] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-27T17:20:26.299703] [DEBUG] [LOCAL ] ATHM: No primary data file found to delete. [2025-10-27T17:20:26.299754] [INFO ] [LOCAL ] ATHM: Starting deletion of derivative data. [2025-10-27T17:20:26.299897] [DEBUG] [LOCAL ] ATHM: Deleted derivative data file. [2025-10-27T17:20:26.299987] [INFO ] [MAIN ] Update Progress: 169/2366 symbols completed. ATHM took 35.5s. Estimated remaining: 4h 25m 3s. Rate: 8.3 symbols/min [2025-10-27T17:20:26.482596] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:20:26.523058] [DEBUG] [LOCAL ] ATO: Loaded 42051 existing records from primary storage. [2025-10-27T17:20:26.523337] [INFO ] [MAIN ] ATO: Loaded 42051 existing records. [2025-10-27T17:20:26.697862] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:20:26.698080] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-27T17:20:26.698127] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-27T17:20:26.698309] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-27T17:20:26.698345] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-27T17:20:26.820077] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-27T17:20:27.049049] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:20:27.470555] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T17:20:27.614986] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-27T17:20:27.990527] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-27T17:20:28.414999] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-27T17:20:28.709594] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-27T17:20:29.214961] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-27T17:20:29.407346] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T17:20:30.014977] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-27T17:20:30.814976] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-27T17:20:30.889561] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T17:20:31.614918] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-27T17:20:31.919633] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-27T17:20:32.008635] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-27T17:20:32.415012] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-27T17:20:33.159482] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-27T17:20:33.214959] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-27T17:20:33.554467] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T17:20:34.014951] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-27T17:20:34.793635] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T17:20:34.800152] [INFO ] [REMOTE ] ATKR: Full fetch complete (52994 records). [2025-10-27T17:20:34.800340] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-27T17:20:34.821110] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-27T17:20:35.174022] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-27T17:20:35.174093] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-27T17:20:35.174625] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-27T17:20:35.174699] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-27T17:20:35.175724] [DEBUG] [LOCAL ] ATKR: Trimmed 52994 records to 34497 (keeping 200 days of data) [2025-10-27T17:20:35.391450] [DEBUG] [LOCAL ] ATKR: Primary data saved (34497 records). [2025-10-27T17:20:35.391629] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-27T17:20:35.391853] [INFO ] [MAIN ] Update Progress: 170/2366 symbols completed. ATKR took 24.9s. Estimated remaining: 4h 25m 20s. Rate: 8.3 symbols/min [2025-10-27T17:20:35.600182] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:20:35.604855] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T17:20:35.615169] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-27T17:20:35.647819] [DEBUG] [LOCAL ] ATR: Loaded 30816 existing records from primary storage. [2025-10-27T17:20:35.648068] [INFO ] [MAIN ] ATR: Loaded 30816 existing records. [2025-10-27T17:20:35.825068] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:20:35.825305] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-27T17:20:35.825359] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-27T17:20:35.825530] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-27T17:20:35.825567] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-27T17:20:36.183384] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:20:36.243621] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T17:20:36.414910] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-27T17:20:36.706064] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-27T17:20:37.214987] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-27T17:20:37.836538] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T17:20:38.014981] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-27T17:20:38.751927] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-27T17:20:38.761627] [INFO ] [REMOTE ] ATI: Full fetch complete (74172 records). [2025-10-27T17:20:38.761819] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-27T17:20:38.825579] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-27T17:20:39.156392] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-27T17:20:39.156605] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-27T17:20:39.157505] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-27T17:20:39.157598] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-27T17:20:39.159334] [DEBUG] [LOCAL ] ATI: Trimmed 74172 records to 51272 (keeping 200 days of data) [2025-10-27T17:20:39.314168] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T17:20:39.511679] [DEBUG] [LOCAL ] ATI: Primary data saved (51272 records). [2025-10-27T17:20:39.511859] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-27T17:20:39.511971] [INFO ] [MAIN ] Update Progress: 171/2366 symbols completed. ATI took 34.3s. Estimated remaining: 4h 24m 33s. Rate: 8.3 symbols/min [2025-10-27T17:20:39.624027] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-27T17:20:39.700379] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:20:39.717441] [DEBUG] [LOCAL ] ATS: Loaded 17194 existing records from primary storage. [2025-10-27T17:20:39.717698] [INFO ] [MAIN ] ATS: Loaded 17194 existing records. [2025-10-27T17:20:39.899696] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:20:39.899918] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-27T17:20:39.900005] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-27T17:20:39.900202] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-27T17:20:39.900258] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-27T17:20:40.096266] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T17:20:40.291634] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:20:40.414979] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-27T17:20:41.192245] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-27T17:20:41.214980] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-27T17:20:41.267455] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T17:20:42.014936] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-27T17:20:42.213280] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-27T17:20:42.815014] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-27T17:20:43.205718] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T17:20:43.614969] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-27T17:20:43.968502] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T17:20:44.414957] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-27T17:20:44.661092] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-27T17:20:45.214944] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-27T17:20:45.588007] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T17:20:46.014940] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-27T17:20:46.814957] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-27T17:20:46.890002] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-27T17:20:47.034173] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T17:20:47.614935] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-27T17:20:48.194144] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T17:20:48.414985] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-27T17:20:48.927362] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-27T17:20:49.129589] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-27T17:20:49.215004] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-27T17:20:50.014947] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-27T17:20:50.333977] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T17:20:50.814988] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-27T17:20:51.614936] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-27T17:20:51.688430] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T17:20:51.746261] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-27T17:20:52.229493] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T17:20:52.414936] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-27T17:20:53.214926] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-27T17:20:53.406453] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-27T17:20:54.014904] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-27T17:20:54.403189] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T17:20:54.814945] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-27T17:20:55.580254] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T17:20:55.587197] [INFO ] [REMOTE ] ATMU: Full fetch complete (56659 records). [2025-10-27T17:20:55.587297] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-27T17:20:55.620025] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-27T17:20:55.971450] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-27T17:20:55.971525] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-27T17:20:55.972143] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-27T17:20:55.972206] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-27T17:20:55.973271] [DEBUG] [LOCAL ] ATMU: Trimmed 56659 records to 38247 (keeping 200 days of data) [2025-10-27T17:20:56.195568] [DEBUG] [LOCAL ] ATMU: Primary data saved (38247 records). [2025-10-27T17:20:56.195723] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-27T17:20:56.196165] [INFO ] [MAIN ] Update Progress: 172/2366 symbols completed. ATMU took 36.6s. Estimated remaining: 4h 26m 26s. Rate: 8.2 symbols/min [2025-10-27T17:20:56.389498] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:20:56.418821] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-27T17:20:56.461732] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T17:20:56.470610] [DEBUG] [LOCAL ] ATUS: Loaded 50699 existing records from primary storage. [2025-10-27T17:20:56.471960] [INFO ] [MAIN ] ATUS: Loaded 50699 existing records. [2025-10-27T17:20:56.671779] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:20:56.672162] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-27T17:20:56.672234] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-27T17:20:56.672412] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-27T17:20:56.672453] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-27T17:20:56.980719] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-27T17:20:57.047969] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:20:57.214925] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-27T17:20:57.426828] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-27T17:20:58.014947] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-27T17:20:58.814987] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-27T17:20:59.147776] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-27T17:20:59.213051] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-27T17:20:59.614924] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-27T17:20:59.679105] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T17:21:00.414951] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-27T17:21:01.215002] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-27T17:21:01.533901] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-27T17:21:01.984351] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T17:21:01.988906] [INFO ] [REMOTE ] ATS: Full fetch complete (25353 records). [2025-10-27T17:21:01.989079] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-27T17:21:02.020299] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-27T17:21:02.373837] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-27T17:21:02.373926] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-27T17:21:02.374284] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-27T17:21:02.374323] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-27T17:21:02.375115] [DEBUG] [LOCAL ] ATS: Trimmed 25353 records to 16610 (keeping 200 days of data) [2025-10-27T17:21:02.466206] [DEBUG] [LOCAL ] ATS: Primary data saved (16610 records). [2025-10-27T17:21:02.466337] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-27T17:21:02.466413] [INFO ] [MAIN ] Update Progress: 173/2366 symbols completed. ATS took 23.0s. Estimated remaining: 4h 26m 6s. Rate: 8.2 symbols/min [2025-10-27T17:21:02.629754] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:21:02.677033] [DEBUG] [LOCAL ] AU: Loaded 53860 existing records from primary storage. [2025-10-27T17:21:02.677333] [INFO ] [MAIN ] AU: Loaded 53860 existing records. [2025-10-27T17:21:02.821724] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-27T17:21:02.850389] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:21:02.851366] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-27T17:21:02.851414] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-27T17:21:02.851594] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-27T17:21:02.851631] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-27T17:21:03.200761] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:21:03.615055] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-27T17:21:04.274681] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (3.06 seconds). [2025-10-27T17:21:04.299106] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-27T17:21:04.304795] [INFO ] [REMOTE ] ATR: Full fetch complete (44013 records). [2025-10-27T17:21:04.304884] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-27T17:21:04.414923] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-27T17:21:04.698583] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-27T17:21:04.698682] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-27T17:21:04.699178] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-27T17:21:04.699219] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-27T17:21:04.700128] [DEBUG] [LOCAL ] ATR: Trimmed 44013 records to 30289 (keeping 200 days of data) [2025-10-27T17:21:04.888539] [DEBUG] [LOCAL ] ATR: Primary data saved (30289 records). [2025-10-27T17:21:04.888695] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-27T17:21:04.890269] [INFO ] [MAIN ] Update Progress: 174/2366 symbols completed. ATR took 29.5s. Estimated remaining: 4h 24m 57s. Rate: 8.3 symbols/min [2025-10-27T17:21:05.060251] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:21:05.121351] [DEBUG] [LOCAL ] AUB: Loaded 46502 existing records from primary storage. [2025-10-27T17:21:05.121636] [INFO ] [MAIN ] AUB: Loaded 46502 existing records. [2025-10-27T17:21:05.302787] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:21:05.303096] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-27T17:21:05.303158] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-27T17:21:05.303417] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-27T17:21:05.303491] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-27T17:21:05.727952] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:21:05.728587] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-27T17:21:05.731305] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-27T17:21:06.025820] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-27T17:21:06.028287] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-27T17:21:06.291684] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (3.47 seconds). [2025-10-27T17:21:06.814987] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-27T17:21:07.054435] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-27T17:21:07.614921] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-27T17:21:07.944899] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-27T17:21:08.091083] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-27T17:21:08.414947] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-27T17:21:08.951266] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-27T17:21:08.958919] [INFO ] [REMOTE ] ATO: Full fetch complete (60598 records). [2025-10-27T17:21:08.959075] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-27T17:21:09.220173] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-27T17:21:09.345457] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-27T17:21:09.345530] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-27T17:21:09.346203] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-27T17:21:09.346267] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-27T17:21:09.347539] [DEBUG] [LOCAL ] ATO: Trimmed 60598 records to 41245 (keeping 200 days of data) [2025-10-27T17:21:09.594382] [DEBUG] [LOCAL ] ATO: Primary data saved (41245 records). [2025-10-27T17:21:09.594499] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-27T17:21:09.595513] [INFO ] [MAIN ] Update Progress: 175/2366 symbols completed. ATO took 43.3s. Estimated remaining: 4h 24m 18s. Rate: 8.3 symbols/min [2025-10-27T17:21:09.761506] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:21:09.770385] [DEBUG] [LOCAL ] AUNA: Loaded 5332 existing records from primary storage. [2025-10-27T17:21:09.770587] [INFO ] [MAIN ] AUNA: Loaded 5332 existing records. [2025-10-27T17:21:09.944105] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:21:09.944245] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-27T17:21:09.944292] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-27T17:21:09.944415] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-27T17:21:09.944450] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-27T17:21:10.020074] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-27T17:21:10.293690] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:21:10.814947] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-27T17:21:10.983596] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-27T17:21:10.998363] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-27T17:21:11.160154] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T17:21:11.359722] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-27T17:21:11.615062] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-27T17:21:12.414965] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-27T17:21:12.802472] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T17:21:13.214951] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-27T17:21:13.746968] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-27T17:21:13.943190] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-27T17:21:14.014917] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-27T17:21:14.649987] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T17:21:14.814939] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-27T17:21:15.614991] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-27T17:21:15.968964] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T17:21:16.280240] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-27T17:21:16.414931] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-27T17:21:17.214963] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-27T17:21:17.644065] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-27T17:21:18.014950] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-27T17:21:18.814981] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-27T17:21:19.162899] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T17:21:19.222757] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-27T17:21:19.283632] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-27T17:21:19.614996] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-27T17:21:20.414940] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-27T17:21:20.887494] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T17:21:21.023019] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T17:21:21.214933] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-27T17:21:22.014912] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-27T17:21:22.484259] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-27T17:21:22.707565] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T17:21:22.814960] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-27T17:21:23.615019] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-27T17:21:23.985267] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T17:21:24.414964] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-27T17:21:24.991978] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-27T17:21:25.214972] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-27T17:21:25.623511] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-27T17:21:25.697892] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-27T17:21:26.014940] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-27T17:21:26.812207] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-27T17:21:26.813883] [INFO ] [REMOTE ] AUNA: Full fetch complete (7826 records). [2025-10-27T17:21:26.813951] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-27T17:21:26.814311] [FATAL] [VALIDATOR ] AUNA: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:21:26.814390] [FATAL] [MAIN ] AUNA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:21:26.814454] [WARN ] [MAIN ] AUNA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:21:26.814524] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-27T17:21:26.814586] [DEBUG] [LOCAL ] AUNA: No primary data file found to delete. [2025-10-27T17:21:26.814621] [INFO ] [LOCAL ] AUNA: Starting deletion of derivative data. [2025-10-27T17:21:26.814772] [DEBUG] [LOCAL ] AUNA: Deleted derivative data file. [2025-10-27T17:21:26.814848] [INFO ] [MAIN ] Update Progress: 176/2366 symbols completed. AUNA took 17.2s. Estimated remaining: 4h 26m 15s. Rate: 8.2 symbols/min [2025-10-27T17:21:26.815021] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-27T17:21:26.992466] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:21:27.029712] [DEBUG] [LOCAL ] AVA: Loaded 38783 existing records from primary storage. [2025-10-27T17:21:27.030015] [INFO ] [MAIN ] AVA: Loaded 38783 existing records. [2025-10-27T17:21:27.208458] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:21:27.208685] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-27T17:21:27.208745] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-27T17:21:27.208993] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-27T17:21:27.209051] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-27T17:21:27.565150] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:21:27.614979] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-27T17:21:28.415015] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-27T17:21:28.614011] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-27T17:21:28.658518] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-27T17:21:29.214957] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-27T17:21:30.014970] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-27T17:21:30.160930] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T17:21:30.504358] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-27T17:21:30.815010] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-27T17:21:31.615001] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-27T17:21:31.743221] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T17:21:31.961891] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-27T17:21:32.414991] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-27T17:21:33.169971] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T17:21:33.214908] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-27T17:21:33.580878] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-27T17:21:34.015005] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-27T17:21:34.814929] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-27T17:21:34.920781] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-27T17:21:35.627137] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-27T17:21:35.636012] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-27T17:21:35.649953] [INFO ] [REMOTE ] AUB: Full fetch complete (66490 records). [2025-10-27T17:21:35.650196] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-27T17:21:36.161771] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-27T17:21:36.161871] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-27T17:21:36.162624] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-27T17:21:36.162720] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-27T17:21:36.164171] [DEBUG] [LOCAL ] AUB: Trimmed 66490 records to 45688 (keeping 200 days of data) [2025-10-27T17:21:36.417279] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-27T17:21:36.492108] [DEBUG] [LOCAL ] AUB: Primary data saved (45688 records). [2025-10-27T17:21:36.492237] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-27T17:21:36.493926] [INFO ] [MAIN ] Update Progress: 177/2366 symbols completed. AUB took 31.6s. Estimated remaining: 4h 26m 37s. Rate: 8.2 symbols/min [2025-10-27T17:21:36.663355] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:21:36.674230] [DEBUG] [LOCAL ] AVAL: Loaded 8579 existing records from primary storage. [2025-10-27T17:21:36.674582] [INFO ] [MAIN ] AVAL: Loaded 8579 existing records. [2025-10-27T17:21:36.848272] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:21:36.848527] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-27T17:21:36.848707] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-27T17:21:36.848949] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-27T17:21:36.849006] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-27T17:21:37.210999] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:21:37.222743] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-27T17:21:37.244696] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-27T17:21:37.625796] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-27T17:21:37.635059] [INFO ] [REMOTE ] ATUS: Full fetch complete (71447 records). [2025-10-27T17:21:37.635163] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-27T17:21:38.027773] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-27T17:21:38.024191] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-27T17:21:38.027893] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-27T17:21:38.029875] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-27T17:21:38.037844] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-27T17:21:38.053494] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T17:21:38.062375] [DEBUG] [LOCAL ] ATUS: Trimmed 71447 records to 49931 (keeping 200 days of data) [2025-10-27T17:21:38.166229] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-27T17:21:38.352077] [DEBUG] [LOCAL ] ATUS: Primary data saved (49931 records). [2025-10-27T17:21:38.352245] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-27T17:21:38.352817] [INFO ] [MAIN ] Update Progress: 178/2366 symbols completed. ATUS took 42.2s. Estimated remaining: 4h 25m 23s. Rate: 8.2 symbols/min [2025-10-27T17:21:38.523456] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:21:38.565790] [DEBUG] [LOCAL ] AVB: Loaded 42750 existing records from primary storage. [2025-10-27T17:21:38.566097] [INFO ] [MAIN ] AVB: Loaded 42750 existing records. [2025-10-27T17:21:38.782282] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:21:38.782509] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-27T17:21:38.782557] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-27T17:21:38.782767] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-27T17:21:38.782823] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-27T17:21:38.823572] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-27T17:21:39.136367] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:21:39.614915] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-27T17:21:39.921748] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-27T17:21:40.170532] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-27T17:21:40.414958] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-27T17:21:40.506149] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-27T17:21:41.214942] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-27T17:21:41.637064] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-27T17:21:42.015120] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-27T17:21:42.624125] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T17:21:42.814942] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-27T17:21:43.190862] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T17:21:43.386612] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-27T17:21:43.614974] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-27T17:21:44.168084] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-27T17:21:44.414934] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-27T17:21:45.198639] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T17:21:45.214931] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-27T17:21:45.681671] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-27T17:21:46.014961] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-27T17:21:46.814983] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-27T17:21:47.431978] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-27T17:21:47.452326] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T17:21:47.614965] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-27T17:21:48.415005] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-27T17:21:49.214963] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-27T17:21:49.657122] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-27T17:21:49.819679] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T17:21:50.014961] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-27T17:21:50.035905] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T17:21:50.814959] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-27T17:21:51.548443] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T17:21:51.614947] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-27T17:21:52.099814] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-27T17:21:52.107532] [INFO ] [REMOTE ] AVA: Full fetch complete (55433 records). [2025-10-27T17:21:52.107765] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-27T17:21:52.420123] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-27T17:21:52.539546] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-27T17:21:52.539713] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-27T17:21:52.540595] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-27T17:21:52.540684] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-27T17:21:52.542361] [DEBUG] [LOCAL ] AVA: Trimmed 55433 records to 37994 (keeping 200 days of data) [2025-10-27T17:21:52.792135] [DEBUG] [LOCAL ] AVA: Primary data saved (37994 records). [2025-10-27T17:21:52.792341] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-27T17:21:52.793495] [INFO ] [MAIN ] Update Progress: 179/2366 symbols completed. AVA took 26.0s. Estimated remaining: 4h 26m 43s. Rate: 8.2 symbols/min [2025-10-27T17:21:52.985069] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:21:52.985464] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-27T17:21:52.985527] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-27T17:21:52.985763] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-27T17:21:52.985865] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-27T17:21:52.985986] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-27T17:21:52.986239] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-27T17:21:53.232573] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-27T17:21:53.380120] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-27T17:21:53.409293] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:21:53.754858] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-27T17:21:54.014989] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-10-27T17:21:54.225955] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:21:54.226302] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-10-27T17:21:54.226401] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:21:54.226476] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-27T17:21:54.226553] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:21:54.226635] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-27T17:21:54.226751] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-27T17:21:54.226799] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-27T17:21:54.226850] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-27T17:21:54.226905] [INFO ] [MAIN ] Update Progress: 180/2366 symbols completed. AVBC took 1.4s. Estimated remaining: 4h 25m 24s. Rate: 8.2 symbols/min [2025-10-27T17:21:54.414161] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:21:54.435798] [DEBUG] [LOCAL ] AVD: Loaded 21565 existing records from primary storage. [2025-10-27T17:21:54.436053] [INFO ] [MAIN ] AVD: Loaded 21565 existing records. [2025-10-27T17:21:54.614091] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:21:54.637431] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-27T17:21:54.637522] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-27T17:21:54.640233] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-27T17:21:54.640347] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-27T17:21:54.705669] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-27T17:21:54.752517] [INFO ] [REMOTE ] AU: Full fetch complete (76654 records). [2025-10-27T17:21:54.752744] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-27T17:21:54.816803] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-27T17:21:55.226516] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:21:55.454006] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-27T17:21:55.454100] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-27T17:21:55.454937] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-27T17:21:55.455002] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-27T17:21:55.456531] [DEBUG] [LOCAL ] AU: Trimmed 76654 records to 53079 (keeping 200 days of data) [2025-10-27T17:21:55.633682] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-27T17:21:55.788762] [DEBUG] [LOCAL ] AU: Primary data saved (53079 records). [2025-10-27T17:21:55.788974] [INFO ] [MAIN ] AU: Full history saved. [2025-10-27T17:21:55.789076] [INFO ] [MAIN ] Update Progress: 181/2366 symbols completed. AU took 53.3s. Estimated remaining: 4h 24m 8s. Rate: 8.3 symbols/min [2025-10-27T17:21:55.923861] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-27T17:21:55.964944] [INFO ] [REMOTE ] AVAL: Full fetch complete (15124 records). [2025-10-27T17:21:55.965915] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-27T17:21:55.992087] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:21:56.252783] [DEBUG] [LOCAL ] AVK: Loaded 18934 existing records from primary storage. [2025-10-27T17:21:56.269867] [INFO ] [MAIN ] AVK: Loaded 18934 existing records. [2025-10-27T17:21:56.416733] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-27T17:21:56.568635] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-27T17:21:56.569385] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-27T17:21:56.573049] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-27T17:21:56.573199] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-27T17:21:56.572629] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:21:56.573983] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-27T17:21:56.574241] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-27T17:21:56.574367] [DEBUG] [LOCAL ] AVAL: Trimmed 15124 records to 8321 (keeping 200 days of data) [2025-10-27T17:21:56.574813] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-27T17:21:56.575110] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-27T17:21:56.706930] [DEBUG] [LOCAL ] AVAL: Primary data saved (8321 records). [2025-10-27T17:21:56.728493] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-27T17:21:56.728706] [INFO ] [MAIN ] Update Progress: 182/2366 symbols completed. AVAL took 20.2s. Estimated remaining: 4h 22m 45s. Rate: 8.3 symbols/min [2025-10-27T17:21:57.113484] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:21:57.204165] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:21:57.227842] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-27T17:21:57.239820] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-27T17:21:57.261036] [DEBUG] [LOCAL ] AVNS: Loaded 33963 existing records from primary storage. [2025-10-27T17:21:57.261344] [INFO ] [MAIN ] AVNS: Loaded 33963 existing records. [2025-10-27T17:21:57.454442] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:21:57.454662] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-27T17:21:57.454725] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-27T17:21:57.454968] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-27T17:21:57.455012] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-27T17:21:57.870733] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:21:57.873284] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-27T17:21:58.014934] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-27T17:21:58.366088] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T17:21:58.814935] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-27T17:21:59.097111] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T17:21:59.509771] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-27T17:21:59.614961] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-27T17:22:00.414942] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-27T17:22:01.222143] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-27T17:22:01.226527] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T17:22:02.015005] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-27T17:22:02.815030] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-27T17:22:03.485735] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (3.07 seconds). [2025-10-27T17:22:03.614908] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-27T17:22:04.483911] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (3.26 seconds). [2025-10-27T17:22:04.491185] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-27T17:22:04.852369] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-27T17:22:04.969139] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T17:22:05.214996] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-27T17:22:05.347848] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T17:22:05.521568] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (3.51 seconds). [2025-10-27T17:22:06.014930] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-27T17:22:06.031071] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T17:22:06.814958] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-27T17:22:07.444883] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-27T17:22:07.614964] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-27T17:22:07.682442] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-27T17:22:08.414977] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-27T17:22:08.712338] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T17:22:09.214942] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-27T17:22:09.238189] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T17:22:10.014979] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-27T17:22:10.263594] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-27T17:22:10.814960] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-27T17:22:11.601144] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T17:22:11.614911] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-27T17:22:12.045303] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T17:22:12.414948] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-27T17:22:12.787799] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T17:22:13.161915] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-27T17:22:13.214914] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-27T17:22:14.015017] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-27T17:22:14.548283] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T17:22:14.814918] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-27T17:22:14.838601] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T17:22:15.614975] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-27T17:22:16.414911] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-27T17:22:16.471884] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T17:22:16.479900] [INFO ] [REMOTE ] AVB: Full fetch complete (59578 records). [2025-10-27T17:22:16.480010] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-27T17:22:16.861830] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-27T17:22:16.861900] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-27T17:22:16.862507] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-27T17:22:16.862547] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-27T17:22:16.863714] [DEBUG] [LOCAL ] AVB: Trimmed 59578 records to 41943 (keeping 200 days of data) [2025-10-27T17:22:17.146500] [DEBUG] [LOCAL ] AVB: Primary data saved (41943 records). [2025-10-27T17:22:17.146671] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-27T17:22:17.147468] [INFO ] [MAIN ] Update Progress: 183/2366 symbols completed. AVB took 38.8s. Estimated remaining: 4h 25m 15s. Rate: 8.2 symbols/min [2025-10-27T17:22:17.218425] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-27T17:22:17.301280] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-27T17:22:17.360715] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:22:17.367353] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T17:22:17.406007] [DEBUG] [LOCAL ] AVNT: Loaded 39076 existing records from primary storage. [2025-10-27T17:22:17.406289] [INFO ] [MAIN ] AVNT: Loaded 39076 existing records. [2025-10-27T17:22:17.590738] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:22:17.590947] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-27T17:22:17.590995] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-27T17:22:17.591273] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-27T17:22:17.591331] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-27T17:22:17.951680] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:22:18.014993] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-27T17:22:18.452815] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T17:22:18.814996] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-27T17:22:19.256225] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T17:22:19.614962] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-27T17:22:19.780036] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-27T17:22:20.415006] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-27T17:22:20.569456] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-27T17:22:20.573945] [INFO ] [REMOTE ] AVK: Full fetch complete (26797 records). [2025-10-27T17:22:20.574017] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-27T17:22:20.940063] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-27T17:22:20.940160] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-27T17:22:20.940575] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-27T17:22:20.940636] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-27T17:22:20.941346] [DEBUG] [LOCAL ] AVK: Trimmed 26797 records to 18417 (keeping 200 days of data) [2025-10-27T17:22:21.052137] [DEBUG] [LOCAL ] AVK: Primary data saved (18417 records). [2025-10-27T17:22:21.052282] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-27T17:22:21.052364] [INFO ] [MAIN ] Update Progress: 184/2366 symbols completed. AVK took 25.3s. Estimated remaining: 4h 24m 28s. Rate: 8.3 symbols/min [2025-10-27T17:22:21.226117] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-27T17:22:21.231223] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:22:21.282153] [DEBUG] [LOCAL ] AVTR: Loaded 54350 existing records from primary storage. [2025-10-27T17:22:21.282479] [INFO ] [MAIN ] AVTR: Loaded 54350 existing records. [2025-10-27T17:22:21.459670] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:22:21.459987] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-27T17:22:21.460062] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-27T17:22:21.460391] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-27T17:22:21.460474] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-27T17:22:21.647342] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T17:22:21.848675] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:22:22.014946] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-27T17:22:22.318915] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T17:22:22.322434] [INFO ] [REMOTE ] AVD: Full fetch complete (32316 records). [2025-10-27T17:22:22.322514] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-27T17:22:22.699487] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-27T17:22:22.699564] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-27T17:22:22.699985] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-27T17:22:22.700048] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-27T17:22:22.700773] [DEBUG] [LOCAL ] AVD: Trimmed 32316 records to 20940 (keeping 200 days of data) [2025-10-27T17:22:22.815915] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-27T17:22:22.821222] [DEBUG] [LOCAL ] AVD: Primary data saved (20940 records). [2025-10-27T17:22:22.821311] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-27T17:22:22.821419] [INFO ] [MAIN ] Update Progress: 185/2366 symbols completed. AVD took 28.6s. Estimated remaining: 4h 23m 16s. Rate: 8.3 symbols/min [2025-10-27T17:22:23.007420] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:22:23.049822] [DEBUG] [LOCAL ] AVY: Loaded 38829 existing records from primary storage. [2025-10-27T17:22:23.050160] [INFO ] [MAIN ] AVY: Loaded 38829 existing records. [2025-10-27T17:22:23.266222] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:22:23.266672] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-27T17:22:23.266843] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-27T17:22:23.267188] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-10-27T17:22:23.267251] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-27T17:22:23.616370] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-27T17:22:23.767347] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:22:23.814368] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-27T17:22:24.225601] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T17:22:24.414928] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-27T17:22:25.000591] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T17:22:25.214956] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-27T17:22:26.014981] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-27T17:22:26.201544] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-27T17:22:26.296238] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-27T17:22:26.814938] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-27T17:22:27.556531] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-27T17:22:27.614930] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-27T17:22:28.415019] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-27T17:22:28.517816] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-27T17:22:28.616976] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T17:22:29.215157] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-27T17:22:29.984866] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T17:22:30.014968] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-27T17:22:30.328385] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T17:22:30.814965] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-27T17:22:31.233907] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-27T17:22:31.614949] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-27T17:22:31.851676] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-27T17:22:32.414938] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-27T17:22:33.136139] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-27T17:22:33.214974] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-27T17:22:34.014965] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-27T17:22:34.135333] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T17:22:34.814966] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-27T17:22:35.067061] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-27T17:22:35.208973] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T17:22:35.615011] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-27T17:22:36.017537] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-27T17:22:36.414985] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-27T17:22:37.214915] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-27T17:22:37.241117] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T17:22:37.693804] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T17:22:38.014928] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-27T17:22:38.814952] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-27T17:22:39.044182] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-27T17:22:39.301836] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T17:22:39.614977] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-27T17:22:39.772089] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-27T17:22:40.415019] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-27T17:22:40.608985] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-27T17:22:41.214944] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-27T17:22:41.641970] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-27T17:22:41.648163] [INFO ] [REMOTE ] AVNS: Full fetch complete (48263 records). [2025-10-27T17:22:41.648274] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-27T17:22:42.020198] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-27T17:22:42.022903] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-27T17:22:42.023000] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-27T17:22:42.024372] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-27T17:22:42.024439] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-27T17:22:42.025539] [DEBUG] [LOCAL ] AVNS: Trimmed 48263 records to 33316 (keeping 200 days of data) [2025-10-27T17:22:42.218608] [DEBUG] [LOCAL ] AVNS: Primary data saved (33316 records). [2025-10-27T17:22:42.218753] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-27T17:22:42.218831] [INFO ] [MAIN ] Update Progress: 186/2366 symbols completed. AVNS took 45.5s. Estimated remaining: 4h 25m 31s. Rate: 8.2 symbols/min [2025-10-27T17:22:42.392180] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:22:42.415841] [DEBUG] [LOCAL ] AWF: Loaded 24433 existing records from primary storage. [2025-10-27T17:22:42.416240] [INFO ] [MAIN ] AWF: Loaded 24433 existing records. [2025-10-27T17:22:42.545886] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-27T17:22:42.600999] [INFO ] [REMOTE ] AVNT: Full fetch complete (55946 records). [2025-10-27T17:22:42.625602] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:22:42.625694] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-27T17:22:42.625950] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-27T17:22:42.626059] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-27T17:22:42.626358] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-27T17:22:42.657594] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-27T17:22:42.818336] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-27T17:22:43.373816] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-27T17:22:43.378052] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:22:43.378458] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-27T17:22:43.379122] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-27T17:22:43.379209] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-27T17:22:43.380487] [DEBUG] [LOCAL ] AVNT: Trimmed 55946 records to 38236 (keeping 200 days of data) [2025-10-27T17:22:43.510823] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T17:22:43.620531] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-27T17:22:43.654825] [DEBUG] [LOCAL ] AVNT: Primary data saved (38236 records). [2025-10-27T17:22:43.654938] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-27T17:22:43.655014] [INFO ] [MAIN ] Update Progress: 187/2366 symbols completed. AVNT took 26.5s. Estimated remaining: 4h 24m 15s. Rate: 8.2 symbols/min [2025-10-27T17:22:43.821010] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:22:43.845107] [DEBUG] [LOCAL ] AWI: Loaded 25413 existing records from primary storage. [2025-10-27T17:22:43.845343] [INFO ] [MAIN ] AWI: Loaded 25413 existing records. [2025-10-27T17:22:44.018296] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:22:44.018478] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-27T17:22:44.018523] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-27T17:22:44.018740] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-27T17:22:44.018794] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-27T17:22:44.390596] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:22:44.424387] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-27T17:22:44.443987] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T17:22:45.214902] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-27T17:22:45.274661] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T17:22:45.826286] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T17:22:46.014950] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-27T17:22:46.382426] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T17:22:46.814942] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-27T17:22:47.122325] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T17:22:47.614997] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-27T17:22:47.986999] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T17:22:48.414912] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-27T17:22:48.773458] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-27T17:22:49.214942] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-27T17:22:49.708474] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T17:22:50.014941] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-27T17:22:50.240383] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-27T17:22:50.814919] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-27T17:22:50.924534] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-27T17:22:51.614957] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-27T17:22:52.414968] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-27T17:22:52.578392] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-27T17:22:52.586749] [INFO ] [REMOTE ] AVY: Full fetch complete (56772 records). [2025-10-27T17:22:52.586848] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-27T17:22:52.991577] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-27T17:22:52.991732] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-27T17:22:52.992466] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-27T17:22:52.992633] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-27T17:22:52.994566] [DEBUG] [LOCAL ] AVY: Trimmed 56772 records to 37987 (keeping 200 days of data) [2025-10-27T17:22:53.117909] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T17:22:53.233348] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-27T17:22:53.270624] [DEBUG] [LOCAL ] AVY: Primary data saved (37987 records). [2025-10-27T17:22:53.270943] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-27T17:22:53.271915] [INFO ] [MAIN ] Update Progress: 188/2366 symbols completed. AVY took 30.4s. Estimated remaining: 4h 24m 35s. Rate: 8.2 symbols/min [2025-10-27T17:22:53.465513] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:22:53.463997] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-27T17:22:53.519819] [DEBUG] [LOCAL ] AWK: Loaded 49024 existing records from primary storage. [2025-10-27T17:22:53.520148] [INFO ] [MAIN ] AWK: Loaded 49024 existing records. [2025-10-27T17:22:53.698211] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:22:53.698495] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-27T17:22:53.698550] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-27T17:22:53.698825] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-27T17:22:53.698880] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-27T17:22:54.027858] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-27T17:22:54.079955] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:22:54.814962] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-27T17:22:54.961381] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T17:22:55.064272] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T17:22:55.595674] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-27T17:22:55.614974] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-27T17:22:56.414998] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-27T17:22:56.707246] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-27T17:22:57.215004] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-27T17:22:57.905625] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T17:22:58.015002] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-27T17:22:58.814966] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-27T17:22:59.157304] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-27T17:22:59.614954] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-27T17:23:00.414999] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-27T17:23:04.815593] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (6.80 seconds). [2025-10-27T17:23:04.822114] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-27T17:23:05.686202] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (6.07 seconds). [2025-10-27T17:23:05.696181] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-27T17:23:05.777992] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (6.96 seconds). [2025-10-27T17:23:05.784005] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-27T17:23:06.672047] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (6.26 seconds). [2025-10-27T17:23:06.682125] [INFO ] [REMOTE ] AVTR: Full fetch complete (77676 records). [2025-10-27T17:23:06.682239] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-27T17:23:07.084307] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-27T17:23:07.084438] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-27T17:23:07.085545] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-27T17:23:07.085630] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-27T17:23:07.087540] [DEBUG] [LOCAL ] AVTR: Trimmed 77676 records to 53570 (keeping 200 days of data) [2025-10-27T17:23:07.405309] [DEBUG] [LOCAL ] AVTR: Primary data saved (53570 records). [2025-10-27T17:23:07.405447] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-27T17:23:07.405524] [INFO ] [MAIN ] Update Progress: 189/2366 symbols completed. AVTR took 46.4s. Estimated remaining: 4h 25m 47s. Rate: 8.2 symbols/min [2025-10-27T17:23:07.577701] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:23:07.598968] [DEBUG] [LOCAL ] AWP: Loaded 21870 existing records from primary storage. [2025-10-27T17:23:07.599278] [INFO ] [MAIN ] AWP: Loaded 21870 existing records. [2025-10-27T17:23:07.778004] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:23:07.778231] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-27T17:23:07.778281] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-27T17:23:07.778439] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-27T17:23:07.778480] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-27T17:23:08.031079] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (3.21 seconds). [2025-10-27T17:23:08.076873] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-27T17:23:08.187838] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:23:08.188691] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-27T17:23:08.484339] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-10-27T17:23:08.490980] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-27T17:23:08.856569] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (3.16 seconds). [2025-10-27T17:23:08.867454] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-27T17:23:09.277638] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-27T17:23:09.284412] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-27T17:23:09.783230] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-27T17:23:09.789608] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-27T17:23:10.117579] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-27T17:23:10.124046] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-27T17:23:10.186493] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-27T17:23:10.194599] [INFO ] [REMOTE ] AWI: Full fetch complete (36170 records). [2025-10-27T17:23:10.194929] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-27T17:23:10.608888] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-27T17:23:10.633012] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-27T17:23:10.633120] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-27T17:23:10.633434] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-27T17:23:10.634257] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-27T17:23:10.634998] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-27T17:23:10.635901] [DEBUG] [LOCAL ] AWI: Trimmed 36170 records to 24899 (keeping 200 days of data) [2025-10-27T17:23:10.787666] [DEBUG] [LOCAL ] AWI: Primary data saved (24899 records). [2025-10-27T17:23:10.787847] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-27T17:23:10.787933] [INFO ] [MAIN ] Update Progress: 190/2366 symbols completed. AWI took 27.1s. Estimated remaining: 4h 24m 54s. Rate: 8.2 symbols/min [2025-10-27T17:23:10.956512] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:23:10.976444] [DEBUG] [LOCAL ] AWR: Loaded 22990 existing records from primary storage. [2025-10-27T17:23:10.976863] [INFO ] [MAIN ] AWR: Loaded 22990 existing records. [2025-10-27T17:23:11.157142] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:23:11.157443] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-27T17:23:11.157542] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-27T17:23:11.162961] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-27T17:23:11.169634] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-27T17:23:11.169224] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-27T17:23:11.216442] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-27T17:23:11.263696] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T17:23:11.294966] [INFO ] [REMOTE ] AWF: Full fetch complete (35908 records). [2025-10-27T17:23:11.300758] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-27T17:23:11.796779] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:23:11.829131] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-27T17:23:11.941086] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-27T17:23:11.941184] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-27T17:23:11.941591] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-27T17:23:11.941746] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-27T17:23:11.942835] [DEBUG] [LOCAL ] AWF: Trimmed 35908 records to 23920 (keeping 200 days of data) [2025-10-27T17:23:12.091077] [DEBUG] [LOCAL ] AWF: Primary data saved (23920 records). [2025-10-27T17:23:12.091395] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-27T17:23:12.091603] [INFO ] [MAIN ] Update Progress: 191/2366 symbols completed. AWF took 29.9s. Estimated remaining: 4h 23m 39s. Rate: 8.2 symbols/min [2025-10-27T17:23:12.215030] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T17:23:12.251114] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-27T17:23:12.329603] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:23:12.363841] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-27T17:23:12.378420] [DEBUG] [LOCAL ] AX: Loaded 28100 existing records from primary storage. [2025-10-27T17:23:12.378714] [INFO ] [MAIN ] AX: Loaded 28100 existing records. [2025-10-27T17:23:12.420026] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-27T17:23:12.561400] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:23:12.561776] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-27T17:23:12.561831] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-27T17:23:12.562024] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-27T17:23:12.562082] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-27T17:23:12.913588] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:23:13.106386] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-27T17:23:13.162488] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-27T17:23:13.214915] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-27T17:23:13.925734] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T17:23:14.014906] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-27T17:23:14.198746] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T17:23:14.814950] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-27T17:23:15.413359] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-27T17:23:15.614946] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-27T17:23:15.846989] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T17:23:16.414948] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-27T17:23:17.214989] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-27T17:23:17.462840] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-27T17:23:17.465910] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T17:23:17.776458] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T17:23:18.014934] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-27T17:23:18.815002] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-27T17:23:19.614922] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-27T17:23:19.698049] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T17:23:19.924085] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T17:23:20.414943] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-27T17:23:21.025349] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T17:23:21.214998] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-27T17:23:22.014954] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-27T17:23:22.155032] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-27T17:23:22.164389] [INFO ] [REMOTE ] AWK: Full fetch complete (70909 records). [2025-10-27T17:23:22.164508] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-27T17:23:22.568672] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-27T17:23:22.599190] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-27T17:23:22.599325] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-27T17:23:22.601061] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-27T17:23:22.601137] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-27T17:23:22.602714] [DEBUG] [LOCAL ] AWK: Trimmed 70909 records to 48248 (keeping 200 days of data) [2025-10-27T17:23:22.821235] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-27T17:23:22.910305] [DEBUG] [LOCAL ] AWK: Primary data saved (48248 records). [2025-10-27T17:23:22.910459] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-27T17:23:22.911272] [INFO ] [MAIN ] Update Progress: 192/2366 symbols completed. AWK took 29.6s. Estimated remaining: 4h 24m 11s. Rate: 8.2 symbols/min [2025-10-27T17:23:23.099929] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:23:23.103229] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-27T17:23:23.161964] [DEBUG] [LOCAL ] AXL: Loaded 51299 existing records from primary storage. [2025-10-27T17:23:23.162301] [INFO ] [MAIN ] AXL: Loaded 51299 existing records. [2025-10-27T17:23:23.351434] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:23:23.351668] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-27T17:23:23.351729] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-27T17:23:23.351931] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-27T17:23:23.351987] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-27T17:23:23.617495] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-27T17:23:23.742462] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:23:23.804884] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T17:23:24.414971] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-27T17:23:24.871726] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-27T17:23:25.215007] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-27T17:23:25.917515] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-27T17:23:26.014953] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-27T17:23:26.060061] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T17:23:26.814951] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-27T17:23:27.282877] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-27T17:23:27.614948] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-27T17:23:28.169946] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T17:23:28.414937] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-27T17:23:28.467404] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-27T17:23:29.111375] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-27T17:23:29.214967] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-27T17:23:30.014928] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-27T17:23:30.028149] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-27T17:23:30.814921] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-27T17:23:31.508345] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T17:23:31.614948] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-27T17:23:32.101370] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T17:23:32.105256] [INFO ] [REMOTE ] AWP: Full fetch complete (31364 records). [2025-10-27T17:23:32.105368] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-27T17:23:32.105952] [FATAL] [VALIDATOR ] AWP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:23:32.106036] [FATAL] [MAIN ] AWP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:23:32.106081] [WARN ] [MAIN ] AWP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:23:32.106158] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-27T17:23:32.106234] [DEBUG] [LOCAL ] AWP: No primary data file found to delete. [2025-10-27T17:23:32.106280] [INFO ] [LOCAL ] AWP: Starting deletion of derivative data. [2025-10-27T17:23:32.106445] [DEBUG] [LOCAL ] AWP: Deleted derivative data file. [2025-10-27T17:23:32.106548] [INFO ] [MAIN ] Update Progress: 193/2366 symbols completed. AWP took 24.7s. Estimated remaining: 4h 24m 26s. Rate: 8.2 symbols/min [2025-10-27T17:23:32.272489] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:23:32.319003] [DEBUG] [LOCAL ] AXP: Loaded 53922 existing records from primary storage. [2025-10-27T17:23:32.319299] [INFO ] [MAIN ] AXP: Loaded 53922 existing records. [2025-10-27T17:23:32.416208] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-27T17:23:32.494088] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:23:32.494251] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-27T17:23:32.494321] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-27T17:23:32.494635] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-27T17:23:32.494725] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-27T17:23:32.851995] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:23:33.139224] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-27T17:23:33.214901] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-27T17:23:33.263780] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T17:23:34.014965] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-27T17:23:34.126057] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-27T17:23:34.814992] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-27T17:23:35.614991] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-27T17:23:36.105547] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-27T17:23:36.221402] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T17:23:36.414916] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-27T17:23:36.525892] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-27T17:23:37.214915] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-27T17:23:37.457594] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T17:23:38.014919] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-27T17:23:38.073334] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T17:23:38.814968] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-27T17:23:39.614984] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-27T17:23:39.811808] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-27T17:23:40.414916] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-27T17:23:40.730516] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-27T17:23:40.890129] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-27T17:23:41.214950] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-27T17:23:41.472351] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-27T17:23:41.477434] [INFO ] [REMOTE ] AX: Full fetch complete (41897 records). [2025-10-27T17:23:41.477521] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-27T17:23:41.848993] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-27T17:23:41.849083] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-27T17:23:41.849590] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-27T17:23:41.849678] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-27T17:23:41.850519] [DEBUG] [LOCAL ] AX: Trimmed 41897 records to 27347 (keeping 200 days of data) [2025-10-27T17:23:42.002632] [DEBUG] [LOCAL ] AX: Primary data saved (27347 records). [2025-10-27T17:23:42.002803] [INFO ] [MAIN ] AX: Full history saved. [2025-10-27T17:23:42.002883] [INFO ] [MAIN ] Update Progress: 194/2366 symbols completed. AX took 29.9s. Estimated remaining: 4h 24m 47s. Rate: 8.2 symbols/min [2025-10-27T17:23:42.023826] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-27T17:23:42.171198] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:23:42.176304] [DEBUG] [LOCAL ] AXR: Loaded 2937 existing records from primary storage. [2025-10-27T17:23:42.176501] [INFO ] [MAIN ] AXR: Loaded 2937 existing records. [2025-10-27T17:23:42.348624] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:23:42.348848] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-27T17:23:42.348893] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-27T17:23:42.349013] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-27T17:23:42.349049] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-27T17:23:42.706514] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:23:42.814923] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-27T17:23:43.107576] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-27T17:23:43.151893] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T17:23:43.156802] [INFO ] [REMOTE ] AWR: Full fetch complete (32500 records). [2025-10-27T17:23:43.156907] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-27T17:23:43.520983] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-27T17:23:43.521057] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-27T17:23:43.521468] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-27T17:23:43.521512] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-27T17:23:43.522239] [DEBUG] [LOCAL ] AWR: Trimmed 32500 records to 22460 (keeping 200 days of data) [2025-10-27T17:23:43.617013] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-27T17:23:43.655224] [DEBUG] [LOCAL ] AWR: Primary data saved (22460 records). [2025-10-27T17:23:43.655351] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-27T17:23:43.655427] [INFO ] [MAIN ] Update Progress: 195/2366 symbols completed. AWR took 32.9s. Estimated remaining: 4h 23m 37s. Rate: 8.2 symbols/min [2025-10-27T17:23:43.833394] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:23:43.868501] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T17:23:43.905055] [DEBUG] [LOCAL ] AXS: Loaded 39390 existing records from primary storage. [2025-10-27T17:23:43.905397] [INFO ] [MAIN ] AXS: Loaded 39390 existing records. [2025-10-27T17:23:44.077793] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:23:44.078000] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-27T17:23:44.078046] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-27T17:23:44.078288] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-27T17:23:44.078326] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-27T17:23:44.420056] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-27T17:23:44.449028] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:23:44.973750] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-27T17:23:45.214939] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-27T17:23:45.544864] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T17:23:46.014926] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-27T17:23:46.814952] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-27T17:23:46.914372] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T17:23:47.615385] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-27T17:23:47.954045] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-27T17:23:48.162718] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T17:23:48.414981] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-27T17:23:48.795762] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T17:23:49.214958] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-27T17:23:49.606417] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-27T17:23:50.014942] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-27T17:23:50.397332] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-27T17:23:50.814969] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-27T17:23:51.404129] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-27T17:23:51.494998] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T17:23:51.614926] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-27T17:23:52.415010] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-27T17:23:52.914469] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-27T17:23:52.924270] [INFO ] [REMOTE ] AXL: Full fetch complete (73212 records). [2025-10-27T17:23:52.924393] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-27T17:23:53.004498] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-27T17:23:53.220080] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-27T17:23:53.325707] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-27T17:23:53.325790] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-27T17:23:53.326499] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-27T17:23:53.326539] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-27T17:23:53.328004] [DEBUG] [LOCAL ] AXL: Trimmed 73212 records to 50492 (keeping 200 days of data) [2025-10-27T17:23:53.599317] [DEBUG] [LOCAL ] AXL: Primary data saved (50492 records). [2025-10-27T17:23:53.599467] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-27T17:23:53.599585] [INFO ] [MAIN ] Update Progress: 196/2366 symbols completed. AXL took 30.7s. Estimated remaining: 4h 23m 59s. Rate: 8.2 symbols/min [2025-10-27T17:23:53.764686] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:23:53.811426] [DEBUG] [LOCAL ] AXTA: Loaded 53069 existing records from primary storage. [2025-10-27T17:23:53.811756] [INFO ] [MAIN ] AXTA: Loaded 53069 existing records. [2025-10-27T17:23:53.984220] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:23:53.984448] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-27T17:23:53.984501] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-27T17:23:53.984720] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-27T17:23:53.984777] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-27T17:23:54.020164] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-27T17:23:54.341258] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:23:54.395766] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-27T17:23:54.557865] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T17:23:54.814969] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-27T17:23:55.614995] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-27T17:23:56.415004] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-27T17:23:56.585842] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-27T17:23:56.906557] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-27T17:23:57.214978] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-27T17:23:57.682786] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T17:23:58.014920] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-27T17:23:58.805490] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T17:23:58.814888] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-27T17:23:59.365130] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T17:23:59.614971] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-27T17:24:00.150456] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T17:24:00.415009] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-27T17:24:01.214951] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-27T17:24:02.020063] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-27T17:24:02.039573] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-27T17:24:02.815006] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-27T17:24:03.954355] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (2.74 seconds). [2025-10-27T17:24:03.955806] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-27T17:24:05.026543] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T17:24:05.027982] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-27T17:24:05.052055] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (3.03 seconds). [2025-10-27T17:24:05.114958] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (4.70 seconds). [2025-10-27T17:24:05.214930] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-27T17:24:05.771608] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.96 seconds). [2025-10-27T17:24:05.771800] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-27T17:24:06.014956] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-27T17:24:06.748878] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T17:24:06.814913] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-27T17:24:07.614943] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-27T17:24:07.996513] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T17:24:08.006684] [INFO ] [REMOTE ] AXP: Full fetch complete (77103 records). [2025-10-27T17:24:08.006822] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-27T17:24:08.397379] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-27T17:24:08.397478] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-27T17:24:08.398332] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-27T17:24:08.398412] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-27T17:24:08.410140] [DEBUG] [LOCAL ] AXP: Trimmed 77103 records to 53134 (keeping 200 days of data) [2025-10-27T17:24:08.415353] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-27T17:24:08.432222] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T17:24:08.778768] [DEBUG] [LOCAL ] AXP: Primary data saved (53134 records). [2025-10-27T17:24:08.779038] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-27T17:24:08.779157] [INFO ] [MAIN ] Update Progress: 197/2366 symbols completed. AXP took 36.7s. Estimated remaining: 4h 25m 19s. Rate: 8.2 symbols/min [2025-10-27T17:24:08.887396] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-27T17:24:08.928316] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T17:24:09.214990] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-27T17:24:09.944102] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T17:24:09.945268] [INFO ] [REMOTE ] AXR: Full fetch complete (4286 records). [2025-10-27T17:24:09.945340] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-27T17:24:10.021103] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-27T17:24:10.304168] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-27T17:24:10.304252] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-27T17:24:10.304421] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-27T17:24:10.304462] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-27T17:24:10.304876] [DEBUG] [LOCAL ] AXR: Trimmed 4286 records to 2799 (keeping 200 days of data) [2025-10-27T17:24:10.320902] [DEBUG] [LOCAL ] AXR: Primary data saved (2799 records). [2025-10-27T17:24:10.320965] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-27T17:24:10.321037] [INFO ] [MAIN ] Update Progress: 198/2366 symbols completed. AXR took 28.3s. Estimated remaining: 4h 24m 8s. Rate: 8.2 symbols/min [2025-10-27T17:24:10.815050] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-27T17:24:11.153496] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-27T17:24:11.614959] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-27T17:24:12.553115] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-27T17:24:12.563917] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-27T17:24:12.907046] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-27T17:24:13.215010] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-27T17:24:13.930854] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-27T17:24:14.014940] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-27T17:24:14.556011] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-27T17:24:14.564566] [INFO ] [REMOTE ] AXS: Full fetch complete (56295 records). [2025-10-27T17:24:14.564758] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-27T17:24:14.940413] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-27T17:24:14.940539] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-27T17:24:14.941151] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-27T17:24:14.941213] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-27T17:24:14.942470] [DEBUG] [LOCAL ] AXS: Trimmed 56295 records to 38703 (keeping 200 days of data) [2025-10-27T17:24:15.181474] [DEBUG] [LOCAL ] AXS: Primary data saved (38703 records). [2025-10-27T17:24:15.181611] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-27T17:24:15.182537] [INFO ] [MAIN ] Update Progress: 199/2366 symbols completed. AXS took 31.5s. Estimated remaining: 4h 23m 34s. Rate: 8.2 symbols/min [2025-10-27T17:24:15.548982] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T17:24:15.560838] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-27T17:24:17.251673] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-27T17:24:17.262870] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-27T17:24:18.774130] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-27T17:24:18.784537] [INFO ] [REMOTE ] AXTA: Full fetch complete (75504 records). [2025-10-27T17:24:18.784735] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-27T17:24:19.175540] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-27T17:24:19.175631] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-27T17:24:19.176420] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-27T17:24:19.176473] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-27T17:24:19.178025] [DEBUG] [LOCAL ] AXTA: Trimmed 75504 records to 52292 (keeping 200 days of data) [2025-10-27T17:24:19.472139] [DEBUG] [LOCAL ] AXTA: Primary data saved (52292 records). [2025-10-27T17:24:19.472288] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-27T17:24:19.472391] [INFO ] [MAIN ] Update Progress: 200/2366 symbols completed. AXTA took 25.9s. Estimated remaining: 4h 22m 54s. Rate: 8.2 symbols/min [2025-10-27T17:24:20.082420] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:24:20.132429] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:24:20.133229] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:24:20.133450] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-27T17:24:20.139748] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-27T17:24:20.189477] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-27T17:24:20.209020] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-27T17:24:20.212968] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-27T17:24:20.213162] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-27T17:24:20.212731] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:24:20.311758] [DEBUG] [LOCAL ] AZO: Loaded 11011 existing records from primary storage. [2025-10-27T17:24:20.324361] [INFO ] [MAIN ] AZO: Loaded 11011 existing records. [2025-10-27T17:24:20.488135] [DEBUG] [LOCAL ] AYI: Loaded 24296 existing records from primary storage. [2025-10-27T17:24:20.535348] [INFO ] [MAIN ] AYI: Loaded 24296 existing records. [2025-10-27T17:24:20.571911] [DEBUG] [LOCAL ] AZZ: Loaded 23290 existing records from primary storage. [2025-10-27T17:24:20.604609] [INFO ] [MAIN ] AZZ: Loaded 23290 existing records. [2025-10-27T17:24:21.025243] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:24:21.096425] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-27T17:24:21.097384] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-27T17:24:21.101288] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:24:21.117763] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-27T17:24:21.163052] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-27T17:24:21.206465] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-27T17:24:21.192386] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-27T17:24:21.241359] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:24:21.271532] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-27T17:24:21.314298] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:24:21.325580] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-27T17:24:21.320023] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-27T17:24:21.325708] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-27T17:24:21.341392] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-27T17:24:21.366798] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-27T17:24:21.367071] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-27T17:24:22.459100] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:24:22.475188] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-27T17:24:22.693415] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:24:22.731504] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-27T17:24:22.754347] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:24:22.756137] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T17:24:22.762770] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-27T17:24:22.762455] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-27T17:24:23.069677] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:24:23.070144] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-27T17:24:23.070245] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:24:23.070334] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-27T17:24:23.070399] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:24:23.070474] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-27T17:24:23.070574] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-27T17:24:23.070635] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-27T17:24:23.070729] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-27T17:24:23.070794] [INFO ] [MAIN ] Update Progress: 201/2366 symbols completed. B took 3.6s. Estimated remaining: 4h 22m 7s. Rate: 8.3 symbols/min [2025-10-27T17:24:23.254435] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:24:23.314820] [DEBUG] [LOCAL ] BA: Loaded 54570 existing records from primary storage. [2025-10-27T17:24:23.315400] [INFO ] [MAIN ] BA: Loaded 54570 existing records. [2025-10-27T17:24:23.517886] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:24:23.527184] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-27T17:24:23.527078] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T17:24:23.530705] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-27T17:24:23.527324] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-27T17:24:23.531769] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-27T17:24:23.531868] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-27T17:24:23.909371] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:24:23.909827] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-27T17:24:24.063967] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-27T17:24:24.068919] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-27T17:24:24.129711] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T17:24:24.132097] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-27T17:24:24.273380] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-27T17:24:24.279802] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-27T17:24:24.688762] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T17:24:24.693620] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-27T17:24:24.860387] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T17:24:25.012584] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-27T17:24:25.214963] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-27T17:24:25.498805] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T17:24:26.014957] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-27T17:24:26.131938] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T17:24:26.420486] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-10-27T17:24:26.814945] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-27T17:24:26.956108] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-27T17:24:27.615008] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-27T17:24:28.414964] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-27T17:24:28.625561] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-27T17:24:28.782917] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-27T17:24:29.051731] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-27T17:24:29.214963] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-27T17:24:30.014961] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-27T17:24:30.120425] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T17:24:30.713105] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-27T17:24:30.814940] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-27T17:24:31.614987] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-27T17:24:32.414969] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-27T17:24:32.548540] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-27T17:24:32.927105] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-27T17:24:33.009402] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-27T17:24:33.214948] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-27T17:24:34.014941] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-27T17:24:34.295491] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-27T17:24:34.814961] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-27T17:24:35.614999] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-27T17:24:35.734568] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T17:24:35.885737] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-27T17:24:36.414962] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-27T17:24:36.648363] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T17:24:37.214928] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-27T17:24:37.265292] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-27T17:24:37.861532] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-27T17:24:38.014923] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-27T17:24:38.814948] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-27T17:24:39.079291] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-27T17:24:39.084934] [INFO ] [REMOTE ] AZZ: Full fetch complete (32113 records). [2025-10-27T17:24:39.085010] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-27T17:24:39.470435] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-27T17:24:39.470520] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-27T17:24:39.470997] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-27T17:24:39.471059] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-27T17:24:39.471950] [DEBUG] [LOCAL ] AZZ: Trimmed 32113 records to 22861 (keeping 200 days of data) [2025-10-27T17:24:39.615743] [DEBUG] [LOCAL ] AZZ: Primary data saved (22861 records). [2025-10-27T17:24:39.615813] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-27T17:24:39.616071] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-27T17:24:39.617086] [INFO ] [MAIN ] Update Progress: 202/2366 symbols completed. AZZ took 20.1s. Estimated remaining: 4h 23m 39s. Rate: 8.2 symbols/min [2025-10-27T17:24:39.787397] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:24:39.843753] [DEBUG] [LOCAL ] BABA: Loaded 54600 existing records from primary storage. [2025-10-27T17:24:39.844069] [INFO ] [MAIN ] BABA: Loaded 54600 existing records. [2025-10-27T17:24:40.015825] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:24:40.016046] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-27T17:24:40.016092] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-27T17:24:40.016292] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-27T17:24:40.016347] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-27T17:24:40.365744] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:24:40.414898] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-27T17:24:40.951504] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T17:24:41.086958] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-27T17:24:41.214931] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-27T17:24:42.015012] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-27T17:24:42.577578] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-27T17:24:42.668750] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-27T17:24:42.814983] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-27T17:24:42.983481] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-27T17:24:43.614961] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-27T17:24:43.701292] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-27T17:24:44.414951] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-27T17:24:45.214952] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-27T17:24:45.708368] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T17:24:45.711158] [INFO ] [REMOTE ] AZO: Full fetch complete (16042 records). [2025-10-27T17:24:45.711233] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-27T17:24:46.016814] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-27T17:24:46.109364] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-27T17:24:46.109593] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-27T17:24:46.110266] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-27T17:24:46.110389] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-27T17:24:46.111742] [DEBUG] [LOCAL ] AZO: Trimmed 16042 records to 10621 (keeping 200 days of data) [2025-10-27T17:24:46.188344] [DEBUG] [LOCAL ] AZO: Primary data saved (10621 records). [2025-10-27T17:24:46.188673] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-27T17:24:46.188823] [INFO ] [MAIN ] Update Progress: 203/2366 symbols completed. AZO took 26.7s. Estimated remaining: 4h 23m 24s. Rate: 8.2 symbols/min [2025-10-27T17:24:46.341357] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-27T17:24:46.417224] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:24:46.463935] [DEBUG] [LOCAL ] BAC: Loaded 54588 existing records from primary storage. [2025-10-27T17:24:46.464245] [INFO ] [MAIN ] BAC: Loaded 54588 existing records. [2025-10-27T17:24:46.635474] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:24:46.635696] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-27T17:24:46.635752] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-27T17:24:46.635937] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-27T17:24:46.635974] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-27T17:24:46.840446] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-27T17:24:46.989068] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:24:47.210728] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T17:24:47.614931] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-27T17:24:48.018872] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.80 seconds). [2025-10-27T17:24:48.414972] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-27T17:24:48.639765] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-27T17:24:49.214966] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-27T17:24:49.644858] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-27T17:24:50.015009] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-27T17:24:50.582275] [DEBUG] [REMOTE ] BABA: Error fetching primary data for 2025-03: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-27T17:24:50.582374] [WARN ] [REMOTE ] BABA: No data returned for month 2025-03 [2025-10-27T17:24:50.582442] [FATAL] [REMOTE ] BABA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:24:50.582484] [FATAL] [MAIN ] BABA: Failed to fetch primary data. [2025-10-27T17:24:50.582515] [WARN ] [MAIN ] BABA: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:24:50.582576] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-27T17:24:50.582636] [DEBUG] [LOCAL ] BABA: No primary data file found to delete. [2025-10-27T17:24:50.582721] [INFO ] [LOCAL ] BABA: Starting deletion of derivative data. [2025-10-27T17:24:50.582839] [DEBUG] [LOCAL ] BABA: Deleted derivative data file. [2025-10-27T17:24:50.582890] [INFO ] [MAIN ] Update Progress: 204/2366 symbols completed. BABA took 11.0s. Estimated remaining: 4h 22m 46s. Rate: 8.2 symbols/min [2025-10-27T17:24:50.754848] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:24:50.807189] [DEBUG] [LOCAL ] BAH: Loaded 52412 existing records from primary storage. [2025-10-27T17:24:50.807523] [INFO ] [MAIN ] BAH: Loaded 52412 existing records. [2025-10-27T17:24:50.838831] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-27T17:24:50.987984] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:24:50.988180] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-27T17:24:50.988226] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-27T17:24:50.988410] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-27T17:24:50.988450] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-27T17:24:51.353362] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:24:51.453594] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-27T17:24:51.614932] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-27T17:24:51.849839] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-27T17:24:52.169282] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-27T17:24:52.272192] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-27T17:24:52.282547] [INFO ] [REMOTE ] BA: Full fetch complete (77969 records). [2025-10-27T17:24:52.282705] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-27T17:24:52.429219] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-27T17:24:52.679248] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-27T17:24:52.679326] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-27T17:24:52.680134] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-27T17:24:52.680196] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-27T17:24:52.681700] [DEBUG] [LOCAL ] BA: Trimmed 77969 records to 53790 (keeping 200 days of data) [2025-10-27T17:24:52.999535] [DEBUG] [LOCAL ] BA: Primary data saved (53790 records). [2025-10-27T17:24:52.999683] [INFO ] [MAIN ] BA: Full history saved. [2025-10-27T17:24:53.000423] [INFO ] [MAIN ] Update Progress: 205/2366 symbols completed. BA took 29.9s. Estimated remaining: 4h 21m 47s. Rate: 8.3 symbols/min [2025-10-27T17:24:53.173079] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:24:53.209637] [DEBUG] [LOCAL ] BAK: Loaded 39995 existing records from primary storage. [2025-10-27T17:24:53.209940] [INFO ] [MAIN ] BAK: Loaded 39995 existing records. [2025-10-27T17:24:53.221181] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-27T17:24:53.391618] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:24:53.391822] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-27T17:24:53.391868] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-27T17:24:53.392290] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-27T17:24:53.392333] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-27T17:24:53.750520] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:24:54.014962] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-27T17:24:54.243799] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-27T17:24:54.815025] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-27T17:24:55.118671] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-27T17:24:55.465386] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-27T17:24:55.614930] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-27T17:24:56.013788] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T17:24:56.414968] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-27T17:24:56.920328] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T17:24:56.925421] [INFO ] [REMOTE ] AYI: Full fetch complete (36376 records). [2025-10-27T17:24:56.925526] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-27T17:24:57.223436] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-27T17:24:57.322480] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-27T17:24:57.322584] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-27T17:24:57.323192] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-27T17:24:57.323260] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-27T17:24:57.324409] [DEBUG] [LOCAL ] AYI: Trimmed 36376 records to 23636 (keeping 200 days of data) [2025-10-27T17:24:57.505160] [DEBUG] [LOCAL ] AYI: Primary data saved (23636 records). [2025-10-27T17:24:57.513212] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-27T17:24:57.513458] [INFO ] [MAIN ] Update Progress: 206/2366 symbols completed. AYI took 38.0s. Estimated remaining: 4h 21m 11s. Rate: 8.3 symbols/min [2025-10-27T17:24:57.549095] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T17:24:57.705886] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:24:57.761081] [DEBUG] [LOCAL ] BALL: Loaded 52693 existing records from primary storage. [2025-10-27T17:24:57.761541] [INFO ] [MAIN ] BALL: Loaded 52693 existing records. [2025-10-27T17:24:57.948019] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:24:57.948313] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-27T17:24:57.948385] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-27T17:24:57.948634] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-27T17:24:57.948735] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-27T17:24:58.025147] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-27T17:24:58.351851] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:24:58.815037] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-27T17:24:59.124343] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T17:24:59.614966] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-27T17:24:59.932107] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-10-27T17:25:00.229036] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T17:25:00.414978] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-27T17:25:01.215011] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-27T17:25:01.653551] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-27T17:25:02.014977] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-27T17:25:02.815078] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-27T17:25:04.121437] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (3.71 seconds). [2025-10-27T17:25:04.134304] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-27T17:25:04.405106] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (3.19 seconds). [2025-10-27T17:25:04.415167] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-27T17:25:05.059427] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-27T17:25:05.214953] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-27T17:25:05.599659] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (3.58 seconds). [2025-10-27T17:25:05.864309] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-27T17:25:06.014935] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-27T17:25:06.427118] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-27T17:25:06.484819] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T17:25:06.814999] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-27T17:25:07.614991] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-27T17:25:08.014926] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-27T17:25:08.414944] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-27T17:25:08.955289] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-27T17:25:09.214943] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-27T17:25:09.370399] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-27T17:25:09.767454] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T17:25:10.014935] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-27T17:25:10.814999] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-27T17:25:11.614981] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-27T17:25:11.696308] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-27T17:25:11.932324] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-27T17:25:12.132310] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T17:25:12.414949] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-27T17:25:12.945959] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-27T17:25:13.215000] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-27T17:25:13.495312] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-27T17:25:14.014995] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-27T17:25:14.815009] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-27T17:25:14.952364] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-27T17:25:15.542311] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-27T17:25:15.614949] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-27T17:25:16.414918] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-27T17:25:16.765694] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-27T17:25:17.213045] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-27T17:25:17.222716] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-27T17:25:18.014969] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-27T17:25:18.820057] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-27T17:25:18.842913] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-27T17:25:18.887465] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T17:25:19.614996] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-27T17:25:19.757631] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T17:25:20.068420] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T17:25:20.414984] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-27T17:25:21.214937] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-27T17:25:21.360112] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T17:25:21.368457] [INFO ] [REMOTE ] BAK: Full fetch complete (56810 records). [2025-10-27T17:25:21.368751] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-27T17:25:21.811538] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-27T17:25:21.811769] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-27T17:25:21.812596] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-27T17:25:21.812707] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-27T17:25:21.814317] [DEBUG] [LOCAL ] BAK: Trimmed 56810 records to 39231 (keeping 200 days of data) [2025-10-27T17:25:22.018168] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-27T17:25:22.048861] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T17:25:22.090353] [DEBUG] [LOCAL ] BAK: Primary data saved (39231 records). [2025-10-27T17:25:22.090506] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-27T17:25:22.090592] [INFO ] [MAIN ] Update Progress: 207/2366 symbols completed. BAK took 29.1s. Estimated remaining: 4h 24m 4s. Rate: 8.2 symbols/min [2025-10-27T17:25:22.257071] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:25:22.257233] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-27T17:25:22.257269] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-27T17:25:22.257389] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-27T17:25:22.257440] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-27T17:25:22.257482] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-27T17:25:22.257514] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-27T17:25:22.595943] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:25:22.814944] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-27T17:25:23.614963] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-27T17:25:23.793546] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-27T17:25:23.804983] [INFO ] [REMOTE ] BAH: Full fetch complete (75272 records). [2025-10-27T17:25:23.805148] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-27T17:25:24.153684] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T17:25:24.155332] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.94 seconds). [2025-10-27T17:25:24.215267] [INFO ] [REMOTE ] BAC: Full fetch complete (77988 records). [2025-10-27T17:25:24.225800] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-27T17:25:24.383858] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-27T17:25:24.396092] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-27T17:25:24.404352] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-27T17:25:24.410769] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-27T17:25:24.420357] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-27T17:25:24.482935] [DEBUG] [LOCAL ] BAH: Trimmed 75272 records to 51639 (keeping 200 days of data) [2025-10-27T17:25:24.879856] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-27T17:25:24.882405] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-27T17:25:24.883480] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-27T17:25:24.883855] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-27T17:25:24.890284] [DEBUG] [LOCAL ] BAC: Trimmed 77988 records to 53808 (keeping 200 days of data) [2025-10-27T17:25:25.061142] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T17:25:25.204127] [DEBUG] [LOCAL ] BAH: Primary data saved (51639 records). [2025-10-27T17:25:25.210690] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-27T17:25:25.214289] [INFO ] [MAIN ] Update Progress: 208/2366 symbols completed. BAH took 34.6s. Estimated remaining: 4h 23m 13s. Rate: 8.2 symbols/min [2025-10-27T17:25:25.215889] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-27T17:25:25.497790] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:25:25.608419] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-27T17:25:25.639788] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-10-27T17:25:25.640029] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-27T17:25:25.640127] [INFO ] [MAIN ] Update Progress: 209/2366 symbols completed. BAC took 39.5s. Estimated remaining: 4h 21m 55s. Rate: 8.2 symbols/min [2025-10-27T17:25:25.837479] [DEBUG] [LOCAL ] BAM: Loaded 52844 existing records from primary storage. [2025-10-27T17:25:25.836533] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:25:25.838023] [INFO ] [MAIN ] BAM: Loaded 52844 existing records. [2025-10-27T17:25:26.016496] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-27T17:25:26.016408] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:25:26.016789] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-27T17:25:26.017586] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-27T17:25:26.031122] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-27T17:25:26.031211] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-27T17:25:26.152682] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T17:25:26.161052] [DEBUG] [LOCAL ] BANC: Loaded 52164 existing records from primary storage. [2025-10-27T17:25:26.172195] [INFO ] [MAIN ] BANC: Loaded 52164 existing records. [2025-10-27T17:25:26.519065] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:25:26.547490] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-27T17:25:26.566418] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-27T17:25:26.587045] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:25:26.587331] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-27T17:25:26.587412] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-27T17:25:26.821928] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-27T17:25:26.939475] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:25:27.614954] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-27T17:25:27.747672] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T17:25:27.757621] [INFO ] [REMOTE ] BALL: Full fetch complete (75627 records). [2025-10-27T17:25:27.757755] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-27T17:25:28.164224] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-27T17:25:28.164321] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-27T17:25:28.165218] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-27T17:25:28.165294] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-27T17:25:28.166856] [DEBUG] [LOCAL ] BALL: Trimmed 75627 records to 51906 (keeping 200 days of data) [2025-10-27T17:25:28.395971] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T17:25:28.415062] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-27T17:25:28.508052] [DEBUG] [LOCAL ] BALL: Primary data saved (51906 records). [2025-10-27T17:25:28.508195] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-27T17:25:28.508283] [INFO ] [MAIN ] Update Progress: 210/2366 symbols completed. BALL took 31.0s. Estimated remaining: 4h 21m 2s. Rate: 8.3 symbols/min [2025-10-27T17:25:28.672629] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:25:28.697699] [DEBUG] [LOCAL ] BAP: Loaded 25783 existing records from primary storage. [2025-10-27T17:25:28.697940] [INFO ] [MAIN ] BAP: Loaded 25783 existing records. [2025-10-27T17:25:28.871014] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:25:28.871180] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-27T17:25:28.871224] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-27T17:25:28.871389] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-27T17:25:28.871426] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-27T17:25:29.159428] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-27T17:25:29.225351] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-27T17:25:29.229914] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:25:29.427747] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-27T17:25:29.753563] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-27T17:25:30.014943] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-27T17:25:30.814987] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-27T17:25:31.614924] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-27T17:25:31.745223] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-27T17:25:32.029276] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T17:25:32.123182] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-27T17:25:32.414945] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-27T17:25:33.215016] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-27T17:25:34.014941] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-27T17:25:34.248218] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-27T17:25:34.305805] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-27T17:25:34.814920] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-27T17:25:35.366055] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-27T17:25:35.614957] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-27T17:25:36.280501] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T17:25:36.301112] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-27T17:25:36.414910] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-27T17:25:37.214988] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-27T17:25:37.577176] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-27T17:25:38.014980] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-27T17:25:38.274283] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T17:25:38.651260] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-27T17:25:38.814937] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-27T17:25:39.614964] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-27T17:25:40.076133] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-27T17:25:40.414984] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-27T17:25:41.035635] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T17:25:41.154752] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-27T17:25:41.214979] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-27T17:25:42.014947] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-27T17:25:42.303499] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T17:25:42.308018] [INFO ] [REMOTE ] BALY: Full fetch complete (16307 records). [2025-10-27T17:25:42.308126] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-27T17:25:42.495708] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-27T17:25:42.496006] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:25:42.496072] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:25:42.496140] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-27T17:25:42.496201] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-27T17:25:42.496236] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-27T17:25:42.496275] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-27T17:25:42.496329] [INFO ] [MAIN ] Update Progress: 211/2366 symbols completed. BALY took 20.4s. Estimated remaining: 4h 22m 4s. Rate: 8.2 symbols/min [2025-10-27T17:25:42.670969] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:25:42.705185] [DEBUG] [LOCAL ] BARK: Loaded 38672 existing records from primary storage. [2025-10-27T17:25:42.705480] [INFO ] [MAIN ] BARK: Loaded 38672 existing records. [2025-10-27T17:25:42.814941] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-27T17:25:42.894301] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:25:42.894503] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-27T17:25:42.894552] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-27T17:25:42.894797] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-27T17:25:42.894854] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-27T17:25:43.289711] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:25:43.445481] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T17:25:43.614941] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-27T17:25:44.099092] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T17:25:44.414939] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-27T17:25:45.214948] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-27T17:25:45.504562] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-27T17:25:45.726335] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-27T17:25:46.014941] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-27T17:25:46.205286] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-27T17:25:46.814923] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-27T17:25:47.589126] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-27T17:25:47.614900] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-27T17:25:47.677268] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-27T17:25:48.414938] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-27T17:25:48.819244] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T17:25:49.214994] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-27T17:25:49.751786] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-27T17:25:50.014942] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-27T17:25:50.232857] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T17:25:50.814981] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-27T17:25:51.362197] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T17:25:51.614981] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-27T17:25:52.263577] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T17:25:52.414983] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-27T17:25:52.597736] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-27T17:25:53.173614] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-27T17:25:53.214983] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-27T17:25:54.014927] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-27T17:25:54.047186] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T17:25:54.815019] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-27T17:25:55.477691] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-27T17:25:55.614976] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-27T17:25:56.335930] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-27T17:25:56.342752] [INFO ] [REMOTE ] BAP: Full fetch complete (37273 records). [2025-10-27T17:25:56.342862] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-27T17:25:56.420055] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-27T17:25:56.713817] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-27T17:25:56.713891] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-27T17:25:56.714316] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-27T17:25:56.714354] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-27T17:25:56.715141] [DEBUG] [LOCAL ] BAP: Trimmed 37273 records to 24970 (keeping 200 days of data) [2025-10-27T17:25:56.862436] [DEBUG] [LOCAL ] BAP: Primary data saved (24970 records). [2025-10-27T17:25:56.862608] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-27T17:25:56.862803] [INFO ] [MAIN ] Update Progress: 212/2366 symbols completed. BAP took 28.4s. Estimated remaining: 4h 23m 8s. Rate: 8.2 symbols/min [2025-10-27T17:25:57.038949] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:25:57.123522] [DEBUG] [LOCAL ] BAX: Loaded 54316 existing records from primary storage. [2025-10-27T17:25:57.125983] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T17:25:57.126613] [INFO ] [MAIN ] BAX: Loaded 54316 existing records. [2025-10-27T17:25:57.220246] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-27T17:25:57.315805] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:25:57.316078] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-27T17:25:57.316127] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-27T17:25:57.316373] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-27T17:25:57.316461] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-27T17:25:57.673983] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:25:57.804081] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T17:25:58.014986] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-27T17:25:58.569114] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T17:25:58.815013] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-27T17:25:59.096598] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-27T17:25:59.614975] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-27T17:26:00.396026] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T17:26:00.406871] [INFO ] [REMOTE ] BAM: Full fetch complete (75312 records). [2025-10-27T17:26:00.407035] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-27T17:26:00.420545] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-27T17:26:00.819330] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-27T17:26:00.819417] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-27T17:26:00.820296] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-27T17:26:00.820364] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-27T17:26:00.821922] [DEBUG] [LOCAL ] BAM: Trimmed 75312 records to 52063 (keeping 200 days of data) [2025-10-27T17:26:01.133480] [DEBUG] [LOCAL ] BAM: Primary data saved (52063 records). [2025-10-27T17:26:01.133673] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-27T17:26:01.134700] [INFO ] [MAIN ] Update Progress: 213/2366 symbols completed. BAM took 35.9s. Estimated remaining: 4h 22m 30s. Rate: 8.2 symbols/min [2025-10-27T17:26:01.225797] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-27T17:26:01.308754] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:26:01.361866] [DEBUG] [LOCAL ] BB: Loaded 53644 existing records from primary storage. [2025-10-27T17:26:01.362183] [INFO ] [MAIN ] BB: Loaded 53644 existing records. [2025-10-27T17:26:01.544989] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:26:01.545199] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-27T17:26:01.545248] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-27T17:26:01.545437] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-27T17:26:01.545475] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-27T17:26:01.962738] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:26:02.007418] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-27T17:26:02.021559] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-27T17:26:02.814981] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-27T17:26:05.177007] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-27T17:26:05.186164] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-27T17:26:05.326966] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (4.91 seconds). [2025-10-27T17:26:05.337373] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-27T17:26:05.509352] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (3.49 seconds). [2025-10-27T17:26:05.519678] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-27T17:26:05.725790] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (4.50 seconds). [2025-10-27T17:26:05.735753] [INFO ] [REMOTE ] BANC: Full fetch complete (74656 records). [2025-10-27T17:26:05.735863] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-27T17:26:06.115908] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-27T17:26:06.115979] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-27T17:26:06.116710] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-27T17:26:06.116772] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-27T17:26:06.118187] [DEBUG] [LOCAL ] BANC: Trimmed 74656 records to 51382 (keeping 200 days of data) [2025-10-27T17:26:06.413617] [DEBUG] [LOCAL ] BANC: Primary data saved (51382 records). [2025-10-27T17:26:06.413769] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-27T17:26:06.413848] [INFO ] [MAIN ] Update Progress: 214/2366 symbols completed. BANC took 40.8s. Estimated remaining: 4h 22m 2s. Rate: 8.2 symbols/min [2025-10-27T17:26:06.577700] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:26:06.624208] [DEBUG] [LOCAL ] BBAI: Loaded 54600 existing records from primary storage. [2025-10-27T17:26:06.624498] [INFO ] [MAIN ] BBAI: Loaded 54600 existing records. [2025-10-27T17:26:06.802964] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:26:06.803265] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-27T17:26:06.803384] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-27T17:26:06.803784] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-27T17:26:06.803841] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-27T17:26:07.135467] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-27T17:26:07.182131] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:26:07.177594] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-27T17:26:07.182595] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-27T17:26:07.589005] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-27T17:26:07.614899] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-27T17:26:07.665226] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-27T17:26:08.107163] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-27T17:26:08.415020] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-27T17:26:09.115599] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T17:26:09.214985] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-27T17:26:09.929523] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-27T17:26:10.015008] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-27T17:26:10.273832] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T17:26:10.486400] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-27T17:26:10.815004] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-27T17:26:11.614990] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-27T17:26:12.088452] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-27T17:26:12.097200] [INFO ] [REMOTE ] BARK: Full fetch complete (55926 records). [2025-10-27T17:26:12.097416] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-27T17:26:12.423208] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-27T17:26:12.562843] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-27T17:26:12.562957] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-27T17:26:12.563695] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-27T17:26:12.563825] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-27T17:26:12.595732] [DEBUG] [LOCAL ] BARK: Trimmed 55926 records to 37982 (keeping 200 days of data) [2025-10-27T17:26:12.597993] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-27T17:26:12.818928] [DEBUG] [LOCAL ] BARK: Primary data saved (37982 records). [2025-10-27T17:26:12.819077] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-27T17:26:12.819161] [INFO ] [MAIN ] Update Progress: 215/2366 symbols completed. BARK took 30.3s. Estimated remaining: 4h 21m 46s. Rate: 8.2 symbols/min [2025-10-27T17:26:12.987800] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:26:13.026859] [DEBUG] [LOCAL ] BBAR: Loaded 43302 existing records from primary storage. [2025-10-27T17:26:13.027238] [INFO ] [MAIN ] BBAR: Loaded 43302 existing records. [2025-10-27T17:26:13.215970] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-27T17:26:13.215734] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:26:13.217729] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-27T17:26:13.217808] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-27T17:26:13.218120] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-27T17:26:13.218211] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-27T17:26:13.564003] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-27T17:26:13.640598] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:26:14.015026] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-27T17:26:14.450579] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-27T17:26:14.814960] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-27T17:26:15.480150] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-27T17:26:15.517582] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-27T17:26:15.614900] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-27T17:26:16.415021] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-27T17:26:17.093158] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-27T17:26:17.138530] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T17:26:17.214914] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-27T17:26:17.899708] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T17:26:18.014909] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-27T17:26:18.814965] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-27T17:26:18.957552] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T17:26:19.316822] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T17:26:19.614949] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-27T17:26:20.414958] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-27T17:26:20.932882] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T17:26:21.160275] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-27T17:26:21.214904] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-27T17:26:21.954244] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T17:26:22.014966] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-27T17:26:22.814941] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-27T17:26:23.232975] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-27T17:26:23.520824] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-27T17:26:23.614924] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-27T17:26:24.414923] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-27T17:26:24.472615] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T17:26:25.044748] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T17:26:25.214978] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-27T17:26:26.014987] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-27T17:26:26.814920] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-27T17:26:26.919145] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-27T17:26:26.960026] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-27T17:26:27.614976] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-27T17:26:28.150934] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-27T17:26:28.414954] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-27T17:26:29.158697] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-27T17:26:29.214902] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-27T17:26:29.321397] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T17:26:30.015009] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-27T17:26:30.472768] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-27T17:26:30.482786] [INFO ] [REMOTE ] BB: Full fetch complete (76958 records). [2025-10-27T17:26:30.482909] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-27T17:26:30.820121] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-27T17:26:30.875250] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-27T17:26:30.875327] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-27T17:26:30.876127] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-27T17:26:30.876193] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-27T17:26:30.877628] [DEBUG] [LOCAL ] BB: Trimmed 76958 records to 52860 (keeping 200 days of data) [2025-10-27T17:26:31.187565] [DEBUG] [LOCAL ] BB: Primary data saved (52860 records). [2025-10-27T17:26:31.187738] [INFO ] [MAIN ] BB: Full history saved. [2025-10-27T17:26:31.188823] [INFO ] [MAIN ] Update Progress: 216/2366 symbols completed. BB took 30.1s. Estimated remaining: 4h 23m 29s. Rate: 8.2 symbols/min [2025-10-27T17:26:31.364874] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:26:31.461000] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-27T17:26:31.484848] [DEBUG] [LOCAL ] BBD: Loaded 54051 existing records from primary storage. [2025-10-27T17:26:31.486884] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T17:26:31.487234] [INFO ] [MAIN ] BBD: Loaded 54051 existing records. [2025-10-27T17:26:31.620006] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-27T17:26:31.677088] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:26:31.677355] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-27T17:26:31.677421] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-27T17:26:31.677730] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-27T17:26:31.677786] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-27T17:26:32.046380] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:26:32.102506] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-27T17:26:32.414937] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-27T17:26:33.214952] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-27T17:26:33.729804] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-27T17:26:33.739524] [INFO ] [REMOTE ] BAX: Full fetch complete (77232 records). [2025-10-27T17:26:33.739706] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-27T17:26:33.740529] [FATAL] [VALIDATOR ] BAX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:26:33.740621] [FATAL] [MAIN ] BAX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:26:33.740699] [WARN ] [MAIN ] BAX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:26:33.740748] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-27T17:26:33.740807] [DEBUG] [LOCAL ] BAX: No primary data file found to delete. [2025-10-27T17:26:33.740885] [INFO ] [LOCAL ] BAX: Starting deletion of derivative data. [2025-10-27T17:26:33.741046] [DEBUG] [LOCAL ] BAX: Deleted derivative data file. [2025-10-27T17:26:33.741133] [INFO ] [MAIN ] Update Progress: 217/2366 symbols completed. BAX took 36.9s. Estimated remaining: 4h 22m 34s. Rate: 8.2 symbols/min [2025-10-27T17:26:33.907191] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:26:33.937571] [DEBUG] [LOCAL ] BBDC: Loaded 33245 existing records from primary storage. [2025-10-27T17:26:33.937887] [INFO ] [MAIN ] BBDC: Loaded 33245 existing records. [2025-10-27T17:26:34.026049] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-27T17:26:34.113797] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:26:34.113973] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-27T17:26:34.114017] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-27T17:26:34.114182] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-27T17:26:34.114220] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-27T17:26:34.483206] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:26:34.732838] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T17:26:34.814904] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-27T17:26:35.068349] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-27T17:26:35.615000] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-27T17:26:35.670706] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-27T17:26:35.994032] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-27T17:26:36.414967] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-27T17:26:37.064478] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-27T17:26:37.073393] [INFO ] [REMOTE ] BBAR: Full fetch complete (61256 records). [2025-10-27T17:26:37.073527] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-27T17:26:37.220111] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-27T17:26:37.468128] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-27T17:26:37.468305] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-27T17:26:37.469034] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-27T17:26:37.469119] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-27T17:26:37.492907] [DEBUG] [LOCAL ] BBAR: Trimmed 61256 records to 42596 (keeping 200 days of data) [2025-10-27T17:26:37.495909] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T17:26:37.758172] [DEBUG] [LOCAL ] BBAR: Primary data saved (42596 records). [2025-10-27T17:26:37.758302] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-27T17:26:37.758381] [INFO ] [MAIN ] Update Progress: 218/2366 symbols completed. BBAR took 24.9s. Estimated remaining: 4h 21m 54s. Rate: 8.2 symbols/min [2025-10-27T17:26:37.924052] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:26:37.930305] [DEBUG] [LOCAL ] BBDO: Loaded 4992 existing records from primary storage. [2025-10-27T17:26:37.930495] [INFO ] [MAIN ] BBDO: Loaded 4992 existing records. [2025-10-27T17:26:38.020098] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-27T17:26:38.110012] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:26:38.110253] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-27T17:26:38.110300] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-27T17:26:38.110440] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-27T17:26:38.110478] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-27T17:26:38.459235] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:26:38.814958] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-27T17:26:39.220682] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-27T17:26:39.505492] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T17:26:39.577975] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-27T17:26:39.614936] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-27T17:26:40.279597] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-27T17:26:40.414990] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-27T17:26:41.214953] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-27T17:26:42.014956] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-27T17:26:42.376549] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-27T17:26:42.583503] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T17:26:42.814959] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-27T17:26:42.960173] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-10-27T17:26:42.972075] [INFO ] [REMOTE ] BBAI: Full fetch complete (78000 records). [2025-10-27T17:26:42.972361] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-27T17:26:43.371675] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-27T17:26:43.371768] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-27T17:26:43.372584] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-27T17:26:43.372627] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-27T17:26:43.374133] [DEBUG] [LOCAL ] BBAI: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-27T17:26:43.630504] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-27T17:26:43.681236] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-10-27T17:26:43.681412] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-27T17:26:43.683016] [INFO ] [MAIN ] Update Progress: 219/2366 symbols completed. BBAI took 37.3s. Estimated remaining: 4h 21m 33s. Rate: 8.2 symbols/min [2025-10-27T17:26:43.850364] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:26:43.870104] [DEBUG] [LOCAL ] BBN: Loaded 17992 existing records from primary storage. [2025-10-27T17:26:43.870342] [INFO ] [MAIN ] BBN: Loaded 17992 existing records. [2025-10-27T17:26:44.052665] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:26:44.053057] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-27T17:26:44.053111] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-27T17:26:44.053289] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-27T17:26:44.053345] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-27T17:26:44.289225] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-27T17:26:44.372716] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T17:26:44.422834] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-27T17:26:44.466284] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:26:45.214936] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-27T17:26:45.682729] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T17:26:45.717105] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-27T17:26:46.014933] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-27T17:26:46.814956] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-27T17:26:46.875418] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-27T17:26:47.614952] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-27T17:26:48.414946] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-27T17:26:48.450506] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-27T17:26:48.493264] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-27T17:26:48.780322] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-27T17:26:49.214974] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-27T17:26:50.015022] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-27T17:26:50.651232] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T17:26:50.710539] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-27T17:26:50.814936] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-27T17:26:51.614934] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-27T17:26:52.045056] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-27T17:26:52.051821] [INFO ] [REMOTE ] BBDC: Full fetch complete (48847 records). [2025-10-27T17:26:52.051945] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-27T17:26:52.415935] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-27T17:26:52.451594] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-27T17:26:52.451702] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-27T17:26:52.452321] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-27T17:26:52.452380] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-27T17:26:52.453530] [DEBUG] [LOCAL ] BBDC: Trimmed 48847 records to 32408 (keeping 200 days of data) [2025-10-27T17:26:52.653845] [DEBUG] [LOCAL ] BBDC: Primary data saved (32408 records). [2025-10-27T17:26:52.653976] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-27T17:26:52.654059] [INFO ] [MAIN ] Update Progress: 220/2366 symbols completed. BBDC took 18.9s. Estimated remaining: 4h 21m 42s. Rate: 8.2 symbols/min [2025-10-27T17:26:52.852230] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:26:52.852425] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-27T17:26:52.852463] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-27T17:26:52.852573] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-27T17:26:52.852614] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-27T17:26:52.852688] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-27T17:26:52.852739] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-27T17:26:53.220811] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-27T17:26:53.253565] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:26:53.290744] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T17:26:53.337604] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T17:26:53.783237] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-27T17:26:54.014957] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-27T17:26:54.815010] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-10-27T17:26:55.020384] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:26:55.020730] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-10-27T17:26:55.020815] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:26:55.020862] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-27T17:26:55.020896] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:26:55.020931] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-27T17:26:55.020986] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-27T17:26:55.021022] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-27T17:26:55.021061] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-27T17:26:55.021106] [INFO ] [MAIN ] Update Progress: 221/2366 symbols completed. BBT took 2.4s. Estimated remaining: 4h 20m 46s. Rate: 8.2 symbols/min [2025-10-27T17:26:55.186784] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:26:55.194749] [DEBUG] [LOCAL ] BBU: Loaded 5880 existing records from primary storage. [2025-10-27T17:26:55.194956] [INFO ] [MAIN ] BBU: Loaded 5880 existing records. [2025-10-27T17:26:55.372148] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:26:55.372353] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-27T17:26:55.372399] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-27T17:26:55.372543] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-27T17:26:55.372579] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-27T17:26:55.618799] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-27T17:26:55.737205] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:26:55.943483] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T17:26:56.414979] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-27T17:26:56.564362] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-27T17:26:57.215008] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-27T17:26:58.014912] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-27T17:26:58.054687] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T17:26:58.070439] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-27T17:26:58.712848] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-27T17:26:58.814980] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-27T17:26:59.229173] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-27T17:26:59.614941] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-27T17:27:00.163883] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-27T17:27:00.415018] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-27T17:27:01.214988] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-27T17:27:02.014933] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-27T17:27:02.815060] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-27T17:27:04.022905] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-10-27T17:27:04.024368] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-27T17:27:04.314605] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-27T17:27:04.414924] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-27T17:27:04.543674] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-27T17:27:04.625797] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-27T17:27:04.816278] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (4.40 seconds). [2025-10-27T17:27:05.214956] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-27T17:27:05.406058] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T17:27:06.015037] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-27T17:27:06.106087] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-27T17:27:06.459778] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-27T17:27:06.814951] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-27T17:27:07.620308] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-27T17:27:07.622918] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T17:27:08.414984] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-27T17:27:08.477363] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-27T17:27:09.100120] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-27T17:27:09.101637] [INFO ] [REMOTE ] BBDO: Full fetch complete (7357 records). [2025-10-27T17:27:09.101733] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-27T17:27:09.102092] [FATAL] [VALIDATOR ] BBDO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:27:09.102192] [FATAL] [MAIN ] BBDO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:27:09.102235] [WARN ] [MAIN ] BBDO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:27:09.102298] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-27T17:27:09.102358] [DEBUG] [LOCAL ] BBDO: No primary data file found to delete. [2025-10-27T17:27:09.102393] [INFO ] [LOCAL ] BBDO: Starting deletion of derivative data. [2025-10-27T17:27:09.102525] [DEBUG] [LOCAL ] BBDO: Deleted derivative data file. [2025-10-27T17:27:09.102610] [INFO ] [MAIN ] Update Progress: 222/2366 symbols completed. BBDO took 31.3s. Estimated remaining: 4h 21m 45s. Rate: 8.2 symbols/min [2025-10-27T17:27:09.220140] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-27T17:27:09.271801] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:27:09.285671] [DEBUG] [LOCAL ] BBUC: Loaded 14138 existing records from primary storage. [2025-10-27T17:27:09.285938] [INFO ] [MAIN ] BBUC: Loaded 14138 existing records. [2025-10-27T17:27:09.461104] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:27:09.461297] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-27T17:27:09.461342] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-27T17:27:09.461618] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-27T17:27:09.461707] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-27T17:27:09.814872] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:27:10.014926] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-27T17:27:10.095592] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-27T17:27:10.814944] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-27T17:27:10.924246] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-27T17:27:11.614983] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-27T17:27:12.038608] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T17:27:12.414947] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-27T17:27:12.482888] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-27T17:27:13.214954] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-27T17:27:13.625203] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T17:27:13.999901] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-27T17:27:14.014896] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-27T17:27:14.662832] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-27T17:27:14.814946] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-27T17:27:15.250708] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-27T17:27:15.614948] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-27T17:27:16.415001] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-27T17:27:16.673246] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-27T17:27:17.215026] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-27T17:27:17.347701] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T17:27:17.350623] [INFO ] [REMOTE ] BBN: Full fetch complete (24881 records). [2025-10-27T17:27:17.350718] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-27T17:27:17.351186] [FATAL] [VALIDATOR ] BBN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:27:17.351264] [FATAL] [MAIN ] BBN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:27:17.351305] [WARN ] [MAIN ] BBN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:27:17.351342] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-27T17:27:17.351396] [DEBUG] [LOCAL ] BBN: No primary data file found to delete. [2025-10-27T17:27:17.351429] [INFO ] [LOCAL ] BBN: Starting deletion of derivative data. [2025-10-27T17:27:17.351577] [DEBUG] [LOCAL ] BBN: Deleted derivative data file. [2025-10-27T17:27:17.351684] [INFO ] [MAIN ] Update Progress: 223/2366 symbols completed. BBN took 33.7s. Estimated remaining: 4h 21m 46s. Rate: 8.2 symbols/min [2025-10-27T17:27:17.515496] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:27:17.567287] [DEBUG] [LOCAL ] BBVA: Loaded 49816 existing records from primary storage. [2025-10-27T17:27:17.567620] [INFO ] [MAIN ] BBVA: Loaded 49816 existing records. [2025-10-27T17:27:17.740766] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:27:17.740941] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-27T17:27:17.740986] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-27T17:27:17.741180] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-27T17:27:17.741217] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-27T17:27:18.020111] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-27T17:27:18.082798] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:27:18.698440] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-27T17:27:18.814992] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-27T17:27:18.932741] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T17:27:19.588068] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T17:27:19.591509] [INFO ] [REMOTE ] BBU: Full fetch complete (7577 records). [2025-10-27T17:27:19.591707] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-27T17:27:19.617679] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-27T17:27:19.980022] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-27T17:27:19.980125] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-27T17:27:19.980442] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-27T17:27:19.980520] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-27T17:27:19.981021] [DEBUG] [LOCAL ] BBU: Trimmed 7577 records to 5811 (keeping 200 days of data) [2025-10-27T17:27:20.016433] [DEBUG] [LOCAL ] BBU: Primary data saved (5811 records). [2025-10-27T17:27:20.016595] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-27T17:27:20.016710] [INFO ] [MAIN ] Update Progress: 224/2366 symbols completed. BBU took 25.0s. Estimated remaining: 4h 20m 54s. Rate: 8.2 symbols/min [2025-10-27T17:27:20.193154] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:27:20.224554] [DEBUG] [LOCAL ] BBW: Loaded 27551 existing records from primary storage. [2025-10-27T17:27:20.224939] [INFO ] [MAIN ] BBW: Loaded 27551 existing records. [2025-10-27T17:27:20.455037] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-27T17:27:20.460715] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:27:20.462457] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-27T17:27:20.462522] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-27T17:27:20.462774] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-27T17:27:20.462834] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-27T17:27:20.616111] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T17:27:20.841738] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:27:21.214966] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-27T17:27:21.942486] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T17:27:22.014979] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-27T17:27:22.167715] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T17:27:22.178065] [INFO ] [REMOTE ] BBD: Full fetch complete (77271 records). [2025-10-27T17:27:22.178235] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-27T17:27:22.559682] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-27T17:27:22.559770] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-27T17:27:22.560510] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-27T17:27:22.560552] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-27T17:27:22.562074] [DEBUG] [LOCAL ] BBD: Trimmed 77271 records to 53275 (keeping 200 days of data) [2025-10-27T17:27:22.826200] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-27T17:27:22.868310] [DEBUG] [LOCAL ] BBD: Primary data saved (53275 records). [2025-10-27T17:27:22.868414] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-27T17:27:22.869258] [INFO ] [MAIN ] Update Progress: 225/2366 symbols completed. BBD took 51.7s. Estimated remaining: 4h 20m 5s. Rate: 8.2 symbols/min [2025-10-27T17:27:23.036440] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:27:23.087303] [DEBUG] [LOCAL ] BBWI: Loaded 54371 existing records from primary storage. [2025-10-27T17:27:23.087732] [INFO ] [MAIN ] BBWI: Loaded 54371 existing records. [2025-10-27T17:27:23.270901] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:27:23.271226] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-27T17:27:23.271277] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-27T17:27:23.271474] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-27T17:27:23.271515] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-27T17:27:23.527254] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T17:27:23.589462] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-27T17:27:23.619998] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-27T17:27:23.691517] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:27:24.414963] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-27T17:27:24.773860] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T17:27:25.179256] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-27T17:27:25.214936] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-27T17:27:25.812497] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-27T17:27:26.014925] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-27T17:27:26.814951] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-27T17:27:27.292125] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T17:27:27.614909] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-27T17:27:27.904993] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T17:27:27.909064] [INFO ] [REMOTE ] BBUC: Full fetch complete (19293 records). [2025-10-27T17:27:27.909155] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-27T17:27:28.275012] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-27T17:27:28.275128] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-27T17:27:28.275613] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-27T17:27:28.275716] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-27T17:27:28.276692] [DEBUG] [LOCAL ] BBUC: Trimmed 19293 records to 13766 (keeping 200 days of data) [2025-10-27T17:27:28.361418] [DEBUG] [LOCAL ] BBUC: Primary data saved (13766 records). [2025-10-27T17:27:28.361547] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-27T17:27:28.361624] [INFO ] [MAIN ] Update Progress: 226/2366 symbols completed. BBUC took 19.3s. Estimated remaining: 4h 19m 40s. Rate: 8.2 symbols/min [2025-10-27T17:27:28.422796] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-27T17:27:28.546858] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:27:28.593300] [DEBUG] [LOCAL ] BBY: Loaded 54210 existing records from primary storage. [2025-10-27T17:27:28.593617] [INFO ] [MAIN ] BBY: Loaded 54210 existing records. [2025-10-27T17:27:28.773769] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:27:28.774133] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-27T17:27:28.774190] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-27T17:27:28.774369] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-27T17:27:28.774407] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-27T17:27:29.126054] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:27:29.199913] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T17:27:29.214922] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-27T17:27:29.423698] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T17:27:30.014996] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-27T17:27:30.488995] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T17:27:30.814951] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-27T17:27:31.624014] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-27T17:27:31.631376] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T17:27:31.997989] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T17:27:32.414917] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-27T17:27:32.458767] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-27T17:27:33.214945] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-27T17:27:34.008392] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-27T17:27:34.019366] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-27T17:27:34.539192] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T17:27:34.814940] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-27T17:27:35.392726] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T17:27:35.614934] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-27T17:27:35.905619] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-27T17:27:36.414966] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-27T17:27:37.214913] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-27T17:27:37.247964] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-27T17:27:37.684176] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-27T17:27:38.015016] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-27T17:27:38.814949] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-27T17:27:38.934506] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T17:27:38.960153] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T17:27:39.614956] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-27T17:27:40.421527] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-27T17:27:40.451840] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-27T17:27:40.451350] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T17:27:41.214939] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-27T17:27:42.014921] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-27T17:27:42.157885] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T17:27:42.814936] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-27T17:27:42.842550] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-27T17:27:43.039412] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-27T17:27:43.614936] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-27T17:27:44.284112] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T17:27:44.414931] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-27T17:27:45.214910] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-27T17:27:45.432734] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-27T17:27:45.703627] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T17:27:46.014934] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-27T17:27:46.515224] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T17:27:46.814976] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-27T17:27:47.298555] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-27T17:27:47.614913] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-27T17:27:48.061766] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-27T17:27:48.414935] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-27T17:27:49.214957] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-27T17:27:49.456980] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-27T17:27:49.616468] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-27T17:27:49.622706] [INFO ] [REMOTE ] BBW: Full fetch complete (39374 records). [2025-10-27T17:27:49.622812] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-27T17:27:49.998036] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-27T17:27:49.998109] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-27T17:27:49.998606] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-27T17:27:49.998693] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-27T17:27:49.999583] [DEBUG] [LOCAL ] BBW: Trimmed 39374 records to 26942 (keeping 200 days of data) [2025-10-27T17:27:50.052621] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-27T17:27:50.164752] [DEBUG] [LOCAL ] BBW: Primary data saved (26942 records). [2025-10-27T17:27:50.164892] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-27T17:27:50.164991] [INFO ] [MAIN ] Update Progress: 227/2366 symbols completed. BBW took 30.1s. Estimated remaining: 4h 21m 50s. Rate: 8.2 symbols/min [2025-10-27T17:27:50.331919] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:27:50.369767] [DEBUG] [LOCAL ] BC: Loaded 44612 existing records from primary storage. [2025-10-27T17:27:50.370059] [INFO ] [MAIN ] BC: Loaded 44612 existing records. [2025-10-27T17:27:50.555239] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:27:50.555453] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-27T17:27:50.555501] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-27T17:27:50.556051] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-27T17:27:50.556107] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-27T17:27:50.818912] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-27T17:27:50.933628] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:27:50.961810] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-27T17:27:51.389754] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-27T17:27:51.614945] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-27T17:27:52.420552] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-27T17:27:52.427316] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-27T17:27:53.214982] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-27T17:27:53.431931] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-27T17:27:53.441499] [INFO ] [REMOTE ] BBVA: Full fetch complete (71908 records). [2025-10-27T17:27:53.441620] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-27T17:27:53.842807] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-27T17:27:53.842912] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-27T17:27:53.843762] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-27T17:27:53.843844] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-27T17:27:53.845259] [DEBUG] [LOCAL ] BBVA: Trimmed 71908 records to 48999 (keeping 200 days of data) [2025-10-27T17:27:54.023355] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-27T17:27:54.094121] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T17:27:54.167487] [DEBUG] [LOCAL ] BBVA: Primary data saved (48999 records). [2025-10-27T17:27:54.167616] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-27T17:27:54.167723] [INFO ] [MAIN ] Update Progress: 228/2366 symbols completed. BBVA took 36.8s. Estimated remaining: 4h 21m 11s. Rate: 8.2 symbols/min [2025-10-27T17:27:54.337733] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:27:54.374562] [DEBUG] [LOCAL ] BCAT: Loaded 34675 existing records from primary storage. [2025-10-27T17:27:54.374849] [INFO ] [MAIN ] BCAT: Loaded 34675 existing records. [2025-10-27T17:27:54.550405] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:27:54.550682] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-27T17:27:54.550751] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-27T17:27:54.551325] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-27T17:27:54.551385] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-27T17:27:54.823933] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-27T17:27:54.906445] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:27:55.077414] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-27T17:27:55.614899] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-27T17:27:56.125316] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-27T17:27:56.137192] [INFO ] [REMOTE ] BBY: Full fetch complete (77407 records). [2025-10-27T17:27:56.137459] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-27T17:27:56.418059] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-27T17:27:56.537279] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-27T17:27:56.537399] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-27T17:27:56.538288] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-27T17:27:56.538351] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-27T17:27:56.554878] [DEBUG] [LOCAL ] BBY: Trimmed 77407 records to 53430 (keeping 200 days of data) [2025-10-27T17:27:56.566730] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-27T17:27:56.903377] [DEBUG] [LOCAL ] BBY: Primary data saved (53430 records). [2025-10-27T17:27:56.903548] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-27T17:27:56.903756] [INFO ] [MAIN ] Update Progress: 229/2366 symbols completed. BBY took 28.5s. Estimated remaining: 4h 20m 21s. Rate: 8.2 symbols/min [2025-10-27T17:27:57.066114] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T17:27:57.133415] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:27:57.162927] [DEBUG] [LOCAL ] BCC: Loaded 29040 existing records from primary storage. [2025-10-27T17:27:57.163209] [INFO ] [MAIN ] BCC: Loaded 29040 existing records. [2025-10-27T17:27:57.223959] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-27T17:27:57.338175] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:27:57.338408] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-27T17:27:57.338456] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-27T17:27:57.338640] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-27T17:27:57.338728] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-27T17:27:57.686582] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:27:57.790036] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T17:27:58.014975] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-27T17:27:58.814924] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-27T17:27:58.953427] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T17:27:59.025553] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-27T17:27:59.614977] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-27T17:27:59.876249] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-27T17:28:00.415039] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-27T17:28:01.214972] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-27T17:28:02.014955] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-27T17:28:02.433427] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (2.82 seconds). [2025-10-27T17:28:02.815022] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-27T17:28:04.269099] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (3.85 seconds). [2025-10-27T17:28:04.275765] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-27T17:28:04.945551] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-27T17:28:04.956400] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-27T17:28:05.438359] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (4.22 seconds). [2025-10-27T17:28:05.446927] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-27T17:28:05.812772] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T17:28:06.014914] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-27T17:28:06.258240] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (4.24 seconds). [2025-10-27T17:28:06.380913] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T17:28:06.607398] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-27T17:28:06.814931] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-27T17:28:07.332361] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T17:28:07.615065] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-27T17:28:07.861112] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T17:28:08.414979] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-27T17:28:08.804067] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T17:28:09.214917] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-27T17:28:09.215600] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-27T17:28:10.014985] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-27T17:28:10.814951] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-27T17:28:11.432410] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-27T17:28:11.444858] [INFO ] [REMOTE ] BBWI: Full fetch complete (77636 records). [2025-10-27T17:28:11.445117] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-27T17:28:11.625785] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-27T17:28:11.772254] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-27T17:28:11.876749] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-27T17:28:11.876841] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-27T17:28:11.877690] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-27T17:28:11.877753] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-27T17:28:11.879256] [DEBUG] [LOCAL ] BBWI: Trimmed 77636 records to 53591 (keeping 200 days of data) [2025-10-27T17:28:12.218130] [DEBUG] [LOCAL ] BBWI: Primary data saved (53591 records). [2025-10-27T17:28:12.231492] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-27T17:28:12.232566] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T17:28:12.232992] [INFO ] [MAIN ] Update Progress: 230/2366 symbols completed. BBWI took 49.4s. Estimated remaining: 4h 21m 28s. Rate: 8.2 symbols/min [2025-10-27T17:28:12.415574] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-27T17:28:12.415504] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:28:12.464574] [DEBUG] [LOCAL ] BCE: Loaded 53017 existing records from primary storage. [2025-10-27T17:28:12.464935] [INFO ] [MAIN ] BCE: Loaded 53017 existing records. [2025-10-27T17:28:12.637387] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:28:12.637587] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-27T17:28:12.637633] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-27T17:28:12.637942] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-27T17:28:12.637998] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-27T17:28:12.984841] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:28:13.163127] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-27T17:28:13.214901] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-27T17:28:13.287099] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-27T17:28:14.015007] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-27T17:28:14.578876] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-27T17:28:14.814913] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-27T17:28:15.576882] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T17:28:15.614921] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-27T17:28:16.414952] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-27T17:28:16.521456] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-27T17:28:17.214938] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-27T17:28:17.364715] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-27T17:28:17.406798] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T17:28:18.014956] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-27T17:28:18.771272] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-27T17:28:18.779903] [INFO ] [REMOTE ] BC: Full fetch complete (63922 records). [2025-10-27T17:28:18.780087] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-27T17:28:18.820155] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-27T17:28:19.204294] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-27T17:28:19.204564] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-27T17:28:19.205826] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-27T17:28:19.205919] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-27T17:28:19.207924] [DEBUG] [LOCAL ] BC: Trimmed 63922 records to 43867 (keeping 200 days of data) [2025-10-27T17:28:19.298626] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-27T17:28:19.519977] [DEBUG] [LOCAL ] BC: Primary data saved (43867 records). [2025-10-27T17:28:19.520166] [INFO ] [MAIN ] BC: Full history saved. [2025-10-27T17:28:19.520269] [INFO ] [MAIN ] Update Progress: 231/2366 symbols completed. BC took 29.4s. Estimated remaining: 4h 21m 20s. Rate: 8.2 symbols/min [2025-10-27T17:28:19.623598] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-27T17:28:19.704526] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:28:19.737393] [DEBUG] [LOCAL ] BCH: Loaded 30400 existing records from primary storage. [2025-10-27T17:28:19.737786] [INFO ] [MAIN ] BCH: Loaded 30400 existing records. [2025-10-27T17:28:19.962094] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:28:19.962413] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-27T17:28:19.962496] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-27T17:28:19.962852] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-27T17:28:19.962939] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-27T17:28:20.376178] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:28:20.410906] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T17:28:20.415028] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-27T17:28:21.214975] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-27T17:28:21.249369] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T17:28:21.528334] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-27T17:28:21.535577] [INFO ] [REMOTE ] BCC: Full fetch complete (41760 records). [2025-10-27T17:28:21.535766] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-27T17:28:21.980212] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-27T17:28:21.980298] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-27T17:28:21.980825] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-27T17:28:21.980888] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-27T17:28:21.981857] [DEBUG] [LOCAL ] BCC: Trimmed 41760 records to 28474 (keeping 200 days of data) [2025-10-27T17:28:22.034136] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-27T17:28:22.153634] [DEBUG] [LOCAL ] BCC: Primary data saved (28474 records). [2025-10-27T17:28:22.153828] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-27T17:28:22.153920] [INFO ] [MAIN ] Update Progress: 232/2366 symbols completed. BCC took 25.3s. Estimated remaining: 4h 20m 30s. Rate: 8.2 symbols/min [2025-10-27T17:28:22.319056] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:28:22.344011] [DEBUG] [LOCAL ] BCO: Loaded 25188 existing records from primary storage. [2025-10-27T17:28:22.344270] [INFO ] [MAIN ] BCO: Loaded 25188 existing records. [2025-10-27T17:28:22.543745] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:28:22.544107] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-27T17:28:22.544182] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-27T17:28:22.544388] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-27T17:28:22.544440] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-27T17:28:22.822201] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-27T17:28:22.824548] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T17:28:22.950914] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:28:22.965055] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T17:28:23.614956] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-27T17:28:24.356046] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T17:28:24.414902] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-27T17:28:24.776972] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T17:28:25.214941] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-27T17:28:25.792315] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T17:28:26.014939] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-27T17:28:26.196753] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-27T17:28:26.814942] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-27T17:28:27.080440] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-27T17:28:27.614992] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-27T17:28:28.415023] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-27T17:28:28.482693] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T17:28:28.829319] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T17:28:28.836165] [INFO ] [REMOTE ] BCAT: Full fetch complete (50048 records). [2025-10-27T17:28:28.836260] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-27T17:28:29.207337] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-27T17:28:29.207417] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-27T17:28:29.207978] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-27T17:28:29.208040] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-27T17:28:29.209004] [DEBUG] [LOCAL ] BCAT: Trimmed 50048 records to 34005 (keeping 200 days of data) [2025-10-27T17:28:29.264016] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-27T17:28:29.417332] [DEBUG] [LOCAL ] BCAT: Primary data saved (34005 records). [2025-10-27T17:28:29.417477] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-27T17:28:29.417558] [INFO ] [MAIN ] Update Progress: 233/2366 symbols completed. BCAT took 35.2s. Estimated remaining: 4h 20m 22s. Rate: 8.2 symbols/min [2025-10-27T17:28:29.595054] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:28:29.614534] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-27T17:28:29.676999] [DEBUG] [LOCAL ] BCS: Loaded 54220 existing records from primary storage. [2025-10-27T17:28:29.677352] [INFO ] [MAIN ] BCS: Loaded 54220 existing records. [2025-10-27T17:28:29.856523] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:28:29.856740] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-27T17:28:29.856793] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-27T17:28:29.857097] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-27T17:28:29.857136] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-27T17:28:30.015247] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-27T17:28:30.219158] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:28:30.560197] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T17:28:30.814964] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-27T17:28:31.594510] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T17:28:31.614916] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-27T17:28:32.077194] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T17:28:32.414950] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-27T17:28:33.214912] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-27T17:28:33.386242] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-27T17:28:33.689413] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-27T17:28:34.014967] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-27T17:28:34.233786] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-27T17:28:34.815015] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-27T17:28:35.513152] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-27T17:28:35.614911] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-27T17:28:36.272340] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-27T17:28:36.414942] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-27T17:28:36.646111] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T17:28:37.214968] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-27T17:28:38.014980] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-27T17:28:38.284340] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-27T17:28:38.814923] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-27T17:28:38.835855] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T17:28:38.889772] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T17:28:39.614999] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-27T17:28:39.781103] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T17:28:40.414934] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-27T17:28:40.441082] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T17:28:41.214913] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-27T17:28:41.608668] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T17:28:42.014917] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-27T17:28:42.259521] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T17:28:42.265910] [INFO ] [REMOTE ] BCH: Full fetch complete (41816 records). [2025-10-27T17:28:42.266005] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-27T17:28:42.651683] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-27T17:28:42.651770] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-27T17:28:42.652269] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-27T17:28:42.652310] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-27T17:28:42.653238] [DEBUG] [LOCAL ] BCH: Trimmed 41816 records to 29646 (keeping 200 days of data) [2025-10-27T17:28:42.818696] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-27T17:28:42.831596] [DEBUG] [LOCAL ] BCH: Primary data saved (29646 records). [2025-10-27T17:28:42.831750] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-27T17:28:42.831859] [INFO ] [MAIN ] Update Progress: 234/2366 symbols completed. BCH took 23.3s. Estimated remaining: 4h 21m 10s. Rate: 8.2 symbols/min [2025-10-27T17:28:42.923280] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-27T17:28:43.024076] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:28:43.052326] [DEBUG] [LOCAL ] BCSF: Loaded 28577 existing records from primary storage. [2025-10-27T17:28:43.052578] [INFO ] [MAIN ] BCSF: Loaded 28577 existing records. [2025-10-27T17:28:43.233052] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:28:43.233261] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-27T17:28:43.233317] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-27T17:28:43.233501] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-27T17:28:43.233539] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-27T17:28:43.581919] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:28:43.614898] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-27T17:28:44.414908] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-27T17:28:44.509924] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T17:28:44.827436] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T17:28:45.214916] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-27T17:28:45.502272] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-27T17:28:46.014947] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-27T17:28:46.230894] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T17:28:46.814976] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-27T17:28:47.111207] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-27T17:28:47.614977] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-27T17:28:48.414905] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-27T17:28:48.568854] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-27T17:28:48.883626] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-27T17:28:49.214932] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-27T17:28:50.021289] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-27T17:28:50.030074] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-27T17:28:50.067542] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T17:28:50.814946] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-27T17:28:50.891298] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T17:28:50.895019] [INFO ] [REMOTE ] BCO: Full fetch complete (35977 records). [2025-10-27T17:28:50.895096] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-27T17:28:51.289825] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-27T17:28:51.289934] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-27T17:28:51.290432] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-27T17:28:51.290475] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-27T17:28:51.291250] [DEBUG] [LOCAL ] BCO: Trimmed 35977 records to 24419 (keeping 200 days of data) [2025-10-27T17:28:51.432106] [DEBUG] [LOCAL ] BCO: Primary data saved (24419 records). [2025-10-27T17:28:51.432225] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-27T17:28:51.432310] [INFO ] [MAIN ] Update Progress: 235/2366 symbols completed. BCO took 29.3s. Estimated remaining: 4h 21m 14s. Rate: 8.2 symbols/min [2025-10-27T17:28:51.610134] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:28:51.614981] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-27T17:28:51.637875] [DEBUG] [LOCAL ] BCX: Loaded 22345 existing records from primary storage. [2025-10-27T17:28:51.638270] [INFO ] [MAIN ] BCX: Loaded 22345 existing records. [2025-10-27T17:28:51.818815] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:28:51.819011] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-27T17:28:51.819058] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-27T17:28:51.819232] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-27T17:28:51.819300] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-27T17:28:52.212425] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:28:52.414994] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-27T17:28:52.475702] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T17:28:52.486121] [INFO ] [REMOTE ] BCE: Full fetch complete (76097 records). [2025-10-27T17:28:52.486293] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-27T17:28:52.961729] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-27T17:28:52.961831] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-27T17:28:52.962901] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-27T17:28:52.962980] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-27T17:28:52.964583] [DEBUG] [LOCAL ] BCE: Trimmed 76097 records to 52235 (keeping 200 days of data) [2025-10-27T17:28:53.249203] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-27T17:28:53.368214] [DEBUG] [LOCAL ] BCE: Primary data saved (52235 records). [2025-10-27T17:28:53.368357] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-27T17:28:53.368822] [INFO ] [MAIN ] Update Progress: 236/2366 symbols completed. BCE took 41.1s. Estimated remaining: 4h 20m 18s. Rate: 8.2 symbols/min [2025-10-27T17:28:53.555470] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:28:53.581825] [DEBUG] [LOCAL ] BDC: Loaded 24242 existing records from primary storage. [2025-10-27T17:28:53.582081] [INFO ] [MAIN ] BDC: Loaded 24242 existing records. [2025-10-27T17:28:53.870935] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-27T17:28:53.875189] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:28:53.886993] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-27T17:28:53.887770] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-27T17:28:53.907100] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-27T17:28:53.907799] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T17:28:53.908139] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-27T17:28:54.025377] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-27T17:28:54.283438] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T17:28:54.331714] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:28:54.814943] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-27T17:28:55.244254] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T17:28:55.614951] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-27T17:28:55.962961] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T17:28:56.414925] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-27T17:28:56.681791] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T17:28:57.214953] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-27T17:28:58.014917] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-27T17:28:58.035883] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T17:28:58.190303] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-27T17:28:58.814921] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-27T17:28:59.168168] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-27T17:28:59.427493] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-27T17:28:59.614947] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-27T17:29:00.414950] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-27T17:29:01.214938] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-27T17:29:02.015030] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-27T17:29:02.247569] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-27T17:29:02.815019] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-27T17:29:03.548484] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (3.13 seconds). [2025-10-27T17:29:03.566950] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-27T17:29:03.614930] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-27T17:29:04.368766] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-27T17:29:04.414911] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-27T17:29:05.106173] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-27T17:29:05.214915] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-27T17:29:05.365453] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-27T17:29:05.389452] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-27T17:29:06.014949] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-27T17:29:06.619622] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T17:29:06.814938] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-27T17:29:07.240088] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T17:29:07.620100] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-27T17:29:07.631248] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T17:29:08.415009] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-27T17:29:09.214947] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-27T17:29:09.430022] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-27T17:29:09.441673] [INFO ] [REMOTE ] BCS: Full fetch complete (77524 records). [2025-10-27T17:29:09.441921] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-27T17:29:09.881632] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-27T17:29:09.881879] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-27T17:29:09.883067] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-27T17:29:09.883285] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-27T17:29:09.896568] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-27T17:29:09.901454] [DEBUG] [LOCAL ] BCS: Trimmed 77524 records to 53437 (keeping 200 days of data) [2025-10-27T17:29:10.015188] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-27T17:29:10.018293] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-27T17:29:10.033703] [INFO ] [REMOTE ] BCSF: Full fetch complete (39946 records). [2025-10-27T17:29:10.038815] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-27T17:29:10.563568] [DEBUG] [LOCAL ] BCS: Primary data saved (53437 records). [2025-10-27T17:29:10.573963] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-27T17:29:10.579177] [INFO ] [MAIN ] Update Progress: 237/2366 symbols completed. BCS took 41.2s. Estimated remaining: 4h 21m 39s. Rate: 8.1 symbols/min [2025-10-27T17:29:10.638224] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-27T17:29:10.638318] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-27T17:29:10.638873] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-27T17:29:10.638935] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-27T17:29:10.639806] [DEBUG] [LOCAL ] BCSF: Trimmed 39946 records to 27770 (keeping 200 days of data) [2025-10-27T17:29:10.802020] [DEBUG] [LOCAL ] BCSF: Primary data saved (27770 records). [2025-10-27T17:29:10.802151] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-27T17:29:10.802233] [INFO ] [MAIN ] Update Progress: 238/2366 symbols completed. BCSF took 28.0s. Estimated remaining: 4h 20m 28s. Rate: 8.2 symbols/min [2025-10-27T17:29:10.814914] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-27T17:29:11.442520] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T17:29:11.525532] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T17:29:11.614935] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-27T17:29:12.415031] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-27T17:29:12.791929] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-27T17:29:12.797178] [INFO ] [REMOTE ] BCX: Full fetch complete (33624 records). [2025-10-27T17:29:12.797285] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-27T17:29:13.158843] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-27T17:29:13.158921] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-27T17:29:13.159348] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-27T17:29:13.159387] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-27T17:29:13.160171] [DEBUG] [LOCAL ] BCX: Trimmed 33624 records to 21778 (keeping 200 days of data) [2025-10-27T17:29:13.291725] [DEBUG] [LOCAL ] BCX: Primary data saved (21778 records). [2025-10-27T17:29:13.291906] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-27T17:29:13.292152] [INFO ] [MAIN ] Update Progress: 239/2366 symbols completed. BCX took 21.9s. Estimated remaining: 4h 19m 37s. Rate: 8.2 symbols/min [2025-10-27T17:29:13.327093] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T17:29:13.333518] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-27T17:29:14.568165] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T17:29:14.573747] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-27T17:29:15.350266] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-27T17:29:15.356592] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-27T17:29:16.265194] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-27T17:29:16.271667] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-27T17:29:17.349549] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T17:29:17.356238] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-27T17:29:18.131873] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-27T17:29:18.136352] [INFO ] [REMOTE ] BDC: Full fetch complete (35610 records). [2025-10-27T17:29:18.136438] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-27T17:29:18.531922] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-27T17:29:18.531995] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-27T17:29:18.532420] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-27T17:29:18.532460] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-27T17:29:18.533224] [DEBUG] [LOCAL ] BDC: Trimmed 35610 records to 23527 (keeping 200 days of data) [2025-10-27T17:29:18.674148] [DEBUG] [LOCAL ] BDC: Primary data saved (23527 records). [2025-10-27T17:29:18.674273] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-27T17:29:18.674346] [INFO ] [MAIN ] Update Progress: 240/2366 symbols completed. BDC took 25.3s. Estimated remaining: 4h 19m 13s. Rate: 8.2 symbols/min [2025-10-27T17:29:19.173157] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:29:19.353378] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:29:19.375362] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:29:19.377334] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:29:19.430011] [DEBUG] [LOCAL ] BDJ: Loaded 29651 existing records from primary storage. [2025-10-27T17:29:19.430449] [INFO ] [MAIN ] BDJ: Loaded 29651 existing records. [2025-10-27T17:29:19.600354] [DEBUG] [LOCAL ] BDX: Loaded 52874 existing records from primary storage. [2025-10-27T17:29:19.618771] [INFO ] [MAIN ] BDX: Loaded 52874 existing records. [2025-10-27T17:29:19.613289] [DEBUG] [LOCAL ] BDN: Loaded 48337 existing records from primary storage. [2025-10-27T17:29:19.670910] [INFO ] [MAIN ] BDN: Loaded 48337 existing records. [2025-10-27T17:29:19.773205] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:29:19.826391] [DEBUG] [LOCAL ] BE: Loaded 54441 existing records from primary storage. [2025-10-27T17:29:19.849357] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-27T17:29:19.888442] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-27T17:29:19.888232] [INFO ] [MAIN ] BE: Loaded 54441 existing records. [2025-10-27T17:29:19.959327] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-27T17:29:19.970632] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-27T17:29:20.107340] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:29:20.135226] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-27T17:29:20.174032] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-27T17:29:20.252386] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-27T17:29:20.255736] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-27T17:29:20.372467] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:29:20.414803] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-27T17:29:20.483971] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-27T17:29:20.492402] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:29:20.546803] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-27T17:29:20.560996] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-27T17:29:20.560858] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-27T17:29:20.605611] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-27T17:29:20.591119] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-27T17:29:20.622537] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-27T17:29:21.411067] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:29:21.526147] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-27T17:29:21.620261] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:29:21.642209] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-27T17:29:21.818761] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:29:21.815782] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:29:21.819274] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-27T17:29:21.819057] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-27T17:29:22.976377] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-27T17:29:22.982782] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-27T17:29:23.077578] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T17:29:23.087192] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-27T17:29:23.299366] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T17:29:23.309635] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-27T17:29:23.632858] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-27T17:29:23.643069] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-27T17:29:23.823818] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-27T17:29:23.830875] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-27T17:29:24.153144] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-27T17:29:24.414990] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-27T17:29:24.791198] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T17:29:24.937898] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T17:29:24.974251] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-27T17:29:25.214963] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-27T17:29:25.597363] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-27T17:29:26.014991] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-27T17:29:26.789470] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T17:29:26.814900] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-27T17:29:27.192772] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-27T17:29:27.615003] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-27T17:29:28.414951] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-27T17:29:28.931498] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-27T17:29:29.129432] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T17:29:29.214900] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-27T17:29:29.318097] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-27T17:29:30.014945] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-27T17:29:30.476387] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T17:29:30.814897] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-27T17:29:30.854680] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-27T17:29:31.614991] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-27T17:29:31.937023] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-27T17:29:32.414949] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-27T17:29:33.204094] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T17:29:33.214909] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-27T17:29:34.014969] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-27T17:29:34.106926] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-27T17:29:34.340961] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T17:29:34.814970] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-27T17:29:35.551284] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-27T17:29:35.614908] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-27T17:29:36.120407] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T17:29:36.414949] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-27T17:29:37.214994] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-27T17:29:37.293059] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-27T17:29:37.355897] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T17:29:38.015020] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-27T17:29:38.822361] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-27T17:29:38.827562] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-27T17:29:39.263237] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T17:29:39.614952] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-27T17:29:40.414956] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-27T17:29:40.656788] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-27T17:29:41.056131] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T17:29:41.214958] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-27T17:29:41.795030] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-27T17:29:41.804560] [INFO ] [REMOTE ] BDN: Full fetch complete (69371 records). [2025-10-27T17:29:41.804761] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-27T17:29:42.023707] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-27T17:29:42.204481] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-27T17:29:42.204564] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-27T17:29:42.205336] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-27T17:29:42.205403] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-27T17:29:42.206764] [DEBUG] [LOCAL ] BDN: Trimmed 69371 records to 47524 (keeping 200 days of data) [2025-10-27T17:29:42.327825] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-27T17:29:42.408243] [INFO ] [REMOTE ] BDJ: Full fetch complete (42734 records). [2025-10-27T17:29:42.416605] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-27T17:29:42.703833] [DEBUG] [LOCAL ] BDN: Primary data saved (47524 records). [2025-10-27T17:29:42.735739] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-27T17:29:42.741241] [INFO ] [MAIN ] Update Progress: 241/2366 symbols completed. BDN took 24.0s. Estimated remaining: 4h 21m 33s. Rate: 8.1 symbols/min [2025-10-27T17:29:42.820945] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-27T17:29:43.127726] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:29:43.138725] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-27T17:29:43.138856] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-27T17:29:43.139347] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-27T17:29:43.139497] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-27T17:29:43.139126] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-27T17:29:43.139683] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-27T17:29:43.139792] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-27T17:29:43.139910] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-27T17:29:43.173183] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-27T17:29:43.216781] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-27T17:29:43.261084] [DEBUG] [LOCAL ] BDJ: Trimmed 42734 records to 28843 (keeping 200 days of data) [2025-10-27T17:29:43.708440] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:29:43.702696] [DEBUG] [LOCAL ] BDJ: Primary data saved (28843 records). [2025-10-27T17:29:43.708841] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-27T17:29:43.709083] [INFO ] [MAIN ] Update Progress: 242/2366 symbols completed. BDJ took 25.0s. Estimated remaining: 4h 20m 29s. Rate: 8.2 symbols/min [2025-10-27T17:29:43.709394] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-27T17:29:43.900403] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:29:43.958473] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-27T17:29:43.985299] [DEBUG] [LOCAL ] BEKE: Loaded 53965 existing records from primary storage. [2025-10-27T17:29:43.985617] [INFO ] [MAIN ] BEKE: Loaded 53965 existing records. [2025-10-27T17:29:44.161240] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-27T17:29:44.161091] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:29:44.162548] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-27T17:29:44.162606] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-27T17:29:44.162855] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-27T17:29:44.162914] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-27T17:29:44.420157] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-27T17:29:44.531035] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:29:44.883332] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-27T17:29:44.920877] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-27T17:29:45.214950] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-27T17:29:46.014991] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-27T17:29:46.757707] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-27T17:29:46.814964] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-27T17:29:47.615057] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-27T17:29:48.008770] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-27T17:29:48.013589] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-27T17:29:48.369164] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-27T17:29:48.414906] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-27T17:29:49.215022] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-27T17:29:50.014945] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-27T17:29:50.083607] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T17:29:50.304671] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-27T17:29:50.814965] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-27T17:29:51.306635] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-27T17:29:51.614935] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-27T17:29:52.079902] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-27T17:29:52.414959] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-27T17:29:52.489000] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-27T17:29:53.214947] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-27T17:29:53.817415] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T17:29:54.014969] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-27T17:29:54.814999] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-27T17:29:55.372019] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-27T17:29:55.382718] [INFO ] [REMOTE ] BE: Full fetch complete (77816 records). [2025-10-27T17:29:55.382867] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-27T17:29:55.621971] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-27T17:29:55.726625] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T17:29:55.833991] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-27T17:29:55.834087] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-27T17:29:55.834964] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-27T17:29:55.835030] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-27T17:29:55.836582] [DEBUG] [LOCAL ] BE: Trimmed 77816 records to 53661 (keeping 200 days of data) [2025-10-27T17:29:56.130861] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-27T17:29:56.151938] [DEBUG] [LOCAL ] BE: Primary data saved (53661 records). [2025-10-27T17:29:56.152076] [INFO ] [MAIN ] BE: Full history saved. [2025-10-27T17:29:56.154196] [INFO ] [MAIN ] Update Progress: 243/2366 symbols completed. BE took 37.5s. Estimated remaining: 4h 21m 6s. Rate: 8.1 symbols/min [2025-10-27T17:29:56.353517] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:29:56.354772] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-27T17:29:56.365098] [INFO ] [REMOTE ] BDX: Full fetch complete (75399 records). [2025-10-27T17:29:56.365237] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-27T17:29:56.420262] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-27T17:29:56.736042] [DEBUG] [LOCAL ] BEN: Loaded 53886 existing records from primary storage. [2025-10-27T17:29:56.759065] [INFO ] [MAIN ] BEN: Loaded 53886 existing records. [2025-10-27T17:29:56.904256] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-27T17:29:56.919921] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-27T17:29:56.930981] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-27T17:29:56.942205] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-27T17:29:56.947489] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-27T17:29:56.999352] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:29:56.999921] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-27T17:29:57.000009] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-27T17:29:57.000243] [DEBUG] [LOCAL ] BDX: Trimmed 75399 records to 52047 (keeping 200 days of data) [2025-10-27T17:29:57.000369] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-27T17:29:57.000457] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-27T17:29:57.219893] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-27T17:29:57.487958] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:29:57.685823] [DEBUG] [LOCAL ] BDX: Primary data saved (52047 records). [2025-10-27T17:29:57.685953] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-27T17:29:57.686030] [INFO ] [MAIN ] Update Progress: 244/2366 symbols completed. BDX took 39.0s. Estimated remaining: 4h 20m 8s. Rate: 8.2 symbols/min [2025-10-27T17:29:57.850050] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:29:57.885085] [DEBUG] [LOCAL ] BEP: Loaded 39485 existing records from primary storage. [2025-10-27T17:29:57.885357] [INFO ] [MAIN ] BEP: Loaded 39485 existing records. [2025-10-27T17:29:58.026087] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-27T17:29:58.067879] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:29:58.068056] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-27T17:29:58.068105] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-27T17:29:58.068311] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-27T17:29:58.068370] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-27T17:29:58.426334] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-27T17:29:58.426204] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:29:58.814908] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-27T17:29:58.946501] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-27T17:29:59.614945] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-27T17:30:00.052154] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T17:30:00.415010] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-27T17:30:01.220051] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-27T17:30:01.234398] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T17:30:02.014986] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-27T17:30:02.404749] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-27T17:30:02.762728] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T17:30:02.814991] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-27T17:30:03.614921] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-27T17:30:03.802083] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T17:30:03.803317] [INFO ] [REMOTE ] BEDU: Full fetch complete (1333 records). [2025-10-27T17:30:03.803400] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-27T17:30:04.005462] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-27T17:30:04.005701] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:30:04.005764] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:30:04.005832] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-27T17:30:04.005899] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-27T17:30:04.005957] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-27T17:30:04.005999] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-27T17:30:04.006057] [INFO ] [MAIN ] Update Progress: 245/2366 symbols completed. BEDU took 21.3s. Estimated remaining: 4h 19m 52s. Rate: 8.2 symbols/min [2025-10-27T17:30:04.180359] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:30:04.221820] [DEBUG] [LOCAL ] BEPC: Loaded 47001 existing records from primary storage. [2025-10-27T17:30:04.222184] [INFO ] [MAIN ] BEPC: Loaded 47001 existing records. [2025-10-27T17:30:04.407115] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:30:04.407362] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-27T17:30:04.407420] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-27T17:30:04.407697] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-27T17:30:04.407753] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-27T17:30:04.438532] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-27T17:30:04.762933] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:30:05.009471] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (2.99 seconds). [2025-10-27T17:30:05.215025] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-27T17:30:06.015012] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-27T17:30:06.848753] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-27T17:30:06.859237] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-27T17:30:06.958995] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (3.34 seconds). [2025-10-27T17:30:07.624720] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-27T17:30:07.632577] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-27T17:30:07.797568] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-27T17:30:08.082374] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-27T17:30:08.415051] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-27T17:30:09.215010] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-27T17:30:09.431202] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-27T17:30:09.972597] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T17:30:10.015016] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-27T17:30:10.437258] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-27T17:30:10.814926] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-27T17:30:11.614953] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-27T17:30:11.672044] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T17:30:12.303184] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T17:30:12.414959] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-27T17:30:12.931793] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T17:30:13.215014] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-27T17:30:14.014963] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-27T17:30:14.814952] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-27T17:30:14.877740] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-27T17:30:14.918082] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-27T17:30:15.476666] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T17:30:15.614942] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-27T17:30:16.181155] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T17:30:16.415009] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-27T17:30:17.215008] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-27T17:30:17.259687] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T17:30:18.020876] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-27T17:30:18.039147] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T17:30:18.250865] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T17:30:18.814998] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-27T17:30:19.253611] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T17:30:19.614939] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-27T17:30:20.414957] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-27T17:30:21.114958] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-27T17:30:21.125103] [INFO ] [REMOTE ] BEKE: Full fetch complete (77327 records). [2025-10-27T17:30:21.125243] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-27T17:30:21.229303] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-27T17:30:21.432283] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-27T17:30:21.559207] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-27T17:30:21.559281] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-27T17:30:21.560062] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-27T17:30:21.560123] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-27T17:30:21.561931] [DEBUG] [LOCAL ] BEKE: Trimmed 77327 records to 53182 (keeping 200 days of data) [2025-10-27T17:30:21.876040] [DEBUG] [LOCAL ] BEKE: Primary data saved (53182 records). [2025-10-27T17:30:21.876170] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-27T17:30:21.876246] [INFO ] [MAIN ] Update Progress: 246/2366 symbols completed. BEKE took 38.2s. Estimated remaining: 4h 21m 15s. Rate: 8.1 symbols/min [2025-10-27T17:30:22.043538] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:30:22.042188] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-27T17:30:22.066559] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-27T17:30:22.078577] [DEBUG] [LOCAL ] BEPH: Loaded 4959 existing records from primary storage. [2025-10-27T17:30:22.078782] [INFO ] [MAIN ] BEPH: Loaded 4959 existing records. [2025-10-27T17:30:22.256091] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:30:22.256313] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-27T17:30:22.256369] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-27T17:30:22.256514] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-27T17:30:22.256568] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-27T17:30:22.599400] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:30:22.814902] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-27T17:30:22.906858] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-27T17:30:23.209031] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-27T17:30:23.358544] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-27T17:30:23.615010] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-27T17:30:24.415019] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-27T17:30:25.082106] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T17:30:25.215003] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-27T17:30:25.576121] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-27T17:30:25.898980] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T17:30:26.014899] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-27T17:30:26.814952] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-27T17:30:27.394837] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T17:30:27.614953] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-27T17:30:28.324089] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-27T17:30:28.414980] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-27T17:30:28.633431] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-27T17:30:28.642480] [INFO ] [REMOTE ] BEP: Full fetch complete (59200 records). [2025-10-27T17:30:28.642696] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-27T17:30:29.048634] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-27T17:30:29.048737] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-27T17:30:29.049383] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-27T17:30:29.049421] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-27T17:30:29.050465] [DEBUG] [LOCAL ] BEP: Trimmed 59200 records to 38684 (keeping 200 days of data) [2025-10-27T17:30:29.218714] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-27T17:30:29.274186] [DEBUG] [LOCAL ] BEP: Primary data saved (38684 records). [2025-10-27T17:30:29.274324] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-27T17:30:29.274404] [INFO ] [MAIN ] Update Progress: 247/2366 symbols completed. BEP took 31.6s. Estimated remaining: 4h 21m 8s. Rate: 8.1 symbols/min [2025-10-27T17:30:29.437853] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:30:29.444079] [DEBUG] [LOCAL ] BEPI: Loaded 3610 existing records from primary storage. [2025-10-27T17:30:29.444246] [INFO ] [MAIN ] BEPI: Loaded 3610 existing records. [2025-10-27T17:30:29.620594] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:30:29.620807] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-27T17:30:29.620867] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-27T17:30:29.621080] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-27T17:30:29.621205] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-27T17:30:29.970637] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:30:29.999321] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T17:30:30.014928] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-27T17:30:30.505398] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-27T17:30:30.814910] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-27T17:30:31.066907] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-27T17:30:31.614954] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-27T17:30:32.202282] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T17:30:32.211824] [INFO ] [REMOTE ] BEPC: Full fetch complete (68818 records). [2025-10-27T17:30:32.211993] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-27T17:30:32.421166] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-27T17:30:32.596931] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-27T17:30:32.597019] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-27T17:30:32.597759] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-27T17:30:32.597822] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-27T17:30:32.599303] [DEBUG] [LOCAL ] BEPC: Trimmed 68818 records to 46201 (keeping 200 days of data) [2025-10-27T17:30:32.886247] [DEBUG] [LOCAL ] BEPC: Primary data saved (46201 records). [2025-10-27T17:30:32.891135] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-27T17:30:32.891718] [INFO ] [MAIN ] Update Progress: 248/2366 symbols completed. BEPC took 28.9s. Estimated remaining: 4h 20m 28s. Rate: 8.1 symbols/min [2025-10-27T17:30:32.891925] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-27T17:30:33.064436] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:30:33.069732] [DEBUG] [LOCAL ] BEPJ: Loaded 3102 existing records from primary storage. [2025-10-27T17:30:33.069902] [INFO ] [MAIN ] BEPJ: Loaded 3102 existing records. [2025-10-27T17:30:33.220358] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-27T17:30:33.256759] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:30:33.257311] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-27T17:30:33.257391] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-27T17:30:33.257718] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-27T17:30:33.257803] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-27T17:30:33.608430] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-27T17:30:33.658106] [INFO ] [REMOTE ] BEN: Full fetch complete (77059 records). [2025-10-27T17:30:33.660096] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-27T17:30:33.679000] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:30:34.023237] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-27T17:30:34.073284] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-27T17:30:34.073439] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-27T17:30:34.074240] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-27T17:30:34.074303] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-27T17:30:34.075786] [DEBUG] [LOCAL ] BEN: Trimmed 77059 records to 53102 (keeping 200 days of data) [2025-10-27T17:30:34.188027] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T17:30:34.409239] [DEBUG] [LOCAL ] BEN: Primary data saved (53102 records). [2025-10-27T17:30:34.409362] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-27T17:30:34.409855] [INFO ] [MAIN ] Update Progress: 249/2366 symbols completed. BEN took 38.3s. Estimated remaining: 4h 19m 31s. Rate: 8.2 symbols/min [2025-10-27T17:30:34.584372] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:30:34.581273] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-27T17:30:34.621098] [DEBUG] [LOCAL ] BFAM: Loaded 34346 existing records from primary storage. [2025-10-27T17:30:34.621378] [INFO ] [MAIN ] BFAM: Loaded 34346 existing records. [2025-10-27T17:30:34.792968] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:30:34.793156] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-27T17:30:34.793244] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-27T17:30:34.793456] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-27T17:30:34.793504] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-27T17:30:34.822600] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-27T17:30:35.156175] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:30:35.176292] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-27T17:30:35.614936] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-27T17:30:36.414941] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-27T17:30:36.528301] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-27T17:30:37.074493] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-27T17:30:37.214943] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-27T17:30:37.601903] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-27T17:30:38.014983] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-27T17:30:38.581066] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T17:30:38.814915] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-27T17:30:39.349142] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-27T17:30:39.614987] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-27T17:30:40.414944] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-27T17:30:40.837254] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-27T17:30:40.941183] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-27T17:30:41.214947] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-27T17:30:41.873710] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-27T17:30:42.014990] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-27T17:30:42.765922] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T17:30:42.814937] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-27T17:30:43.275530] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-27T17:30:43.614962] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-27T17:30:44.164896] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-27T17:30:44.414980] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-27T17:30:45.214947] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-27T17:30:45.620186] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T17:30:45.800625] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-27T17:30:46.014923] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-27T17:30:46.323660] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-27T17:30:46.814937] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-27T17:30:47.490414] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-27T17:30:47.614937] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-27T17:30:48.414951] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-27T17:30:48.744859] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-27T17:30:48.863292] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-27T17:30:49.214940] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-27T17:30:49.596699] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-27T17:30:50.014958] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-27T17:30:50.465971] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T17:30:50.815022] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-27T17:30:51.435412] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-27T17:30:51.614986] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-27T17:30:52.414948] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-27T17:30:53.037986] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T17:30:53.066926] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-27T17:30:53.068531] [INFO ] [REMOTE ] BEPI: Full fetch complete (4696 records). [2025-10-27T17:30:53.068607] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-27T17:30:53.220175] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-27T17:30:53.440153] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-27T17:30:53.440239] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-27T17:30:53.440394] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-27T17:30:53.440436] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-27T17:30:53.440944] [DEBUG] [LOCAL ] BEPI: Trimmed 4696 records to 3495 (keeping 200 days of data) [2025-10-27T17:30:53.462189] [DEBUG] [LOCAL ] BEPI: Primary data saved (3495 records). [2025-10-27T17:30:53.462330] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-27T17:30:53.462410] [INFO ] [MAIN ] Update Progress: 250/2366 symbols completed. BEPI took 24.2s. Estimated remaining: 4h 21m 3s. Rate: 8.1 symbols/min [2025-10-27T17:30:53.637363] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:30:53.675591] [DEBUG] [LOCAL ] BFH: Loaded 42050 existing records from primary storage. [2025-10-27T17:30:53.675944] [INFO ] [MAIN ] BFH: Loaded 42050 existing records. [2025-10-27T17:30:53.861107] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:30:53.861322] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-27T17:30:53.861370] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-27T17:30:53.861555] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-27T17:30:53.861594] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-27T17:30:54.020199] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-27T17:30:54.245785] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:30:54.523198] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-27T17:30:54.663583] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T17:30:54.814931] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-27T17:30:55.614964] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-27T17:30:56.115957] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-27T17:30:56.246092] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T17:30:56.414938] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-27T17:30:56.907418] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-27T17:30:56.908407] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4400 records). [2025-10-27T17:30:56.908476] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-27T17:30:57.220398] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-27T17:30:57.305740] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-27T17:30:57.305829] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-27T17:30:57.306008] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-27T17:30:57.306047] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-27T17:30:57.306521] [DEBUG] [LOCAL ] BEPJ: Trimmed 4400 records to 3063 (keeping 200 days of data) [2025-10-27T17:30:57.328638] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3063 records). [2025-10-27T17:30:57.328791] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-27T17:30:57.328875] [INFO ] [MAIN ] Update Progress: 251/2366 symbols completed. BEPJ took 24.4s. Estimated remaining: 4h 20m 25s. Rate: 8.1 symbols/min [2025-10-27T17:30:57.509412] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:30:57.522977] [DEBUG] [LOCAL ] BFK: Loaded 14046 existing records from primary storage. [2025-10-27T17:30:57.523208] [INFO ] [MAIN ] BFK: Loaded 14046 existing records. [2025-10-27T17:30:57.708224] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:30:57.708455] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-27T17:30:57.708500] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-27T17:30:57.708705] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-27T17:30:57.708761] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-27T17:30:57.982849] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T17:30:58.020085] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-27T17:30:58.081555] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:30:58.814942] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-27T17:30:59.240263] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-27T17:30:59.614938] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-27T17:31:00.118112] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-27T17:31:00.204044] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-27T17:31:00.205523] [INFO ] [REMOTE ] BEPH: Full fetch complete (7520 records). [2025-10-27T17:31:00.205591] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-27T17:31:00.420061] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-27T17:31:00.571766] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-27T17:31:00.571844] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-27T17:31:00.572053] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-27T17:31:00.572092] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-27T17:31:00.572473] [DEBUG] [LOCAL ] BEPH: Trimmed 7520 records to 4804 (keeping 200 days of data) [2025-10-27T17:31:00.600827] [DEBUG] [LOCAL ] BEPH: Primary data saved (4804 records). [2025-10-27T17:31:00.600914] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-27T17:31:00.600986] [INFO ] [MAIN ] Update Progress: 252/2366 symbols completed. BEPH took 38.7s. Estimated remaining: 4h 19m 43s. Rate: 8.1 symbols/min [2025-10-27T17:31:00.774174] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:31:00.822279] [DEBUG] [LOCAL ] BFLY: Loaded 52623 existing records from primary storage. [2025-10-27T17:31:00.822583] [INFO ] [MAIN ] BFLY: Loaded 52623 existing records. [2025-10-27T17:31:00.997872] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:31:00.998564] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-27T17:31:00.998617] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-27T17:31:00.998926] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-27T17:31:00.998982] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-27T17:31:01.221452] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-27T17:31:01.374045] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:31:02.015021] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-27T17:31:02.815006] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-27T17:31:04.051691] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (3.63 seconds). [2025-10-27T17:31:04.060110] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-27T17:31:04.389445] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (3.17 seconds). [2025-10-27T17:31:04.414932] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-27T17:31:04.789159] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-27T17:31:05.214987] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-27T17:31:05.291228] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (3.28 seconds). [2025-10-27T17:31:05.564973] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T17:31:06.015013] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-27T17:31:06.698081] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T17:31:06.782609] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-27T17:31:06.790131] [INFO ] [REMOTE ] BFAM: Full fetch complete (47535 records). [2025-10-27T17:31:06.790311] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-27T17:31:06.824737] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-27T17:31:07.172737] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-27T17:31:07.172828] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-27T17:31:07.173428] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-27T17:31:07.173472] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-27T17:31:07.174790] [DEBUG] [LOCAL ] BFAM: Trimmed 47535 records to 33693 (keeping 200 days of data) [2025-10-27T17:31:07.373521] [DEBUG] [LOCAL ] BFAM: Primary data saved (33693 records). [2025-10-27T17:31:07.373671] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-27T17:31:07.373785] [INFO ] [MAIN ] Update Progress: 253/2366 symbols completed. BFAM took 33.0s. Estimated remaining: 4h 19m 31s. Rate: 8.1 symbols/min [2025-10-27T17:31:07.549405] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:31:07.577408] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T17:31:07.595041] [DEBUG] [LOCAL ] BFS: Loaded 9682 existing records from primary storage. [2025-10-27T17:31:07.595250] [INFO ] [MAIN ] BFS: Loaded 9682 existing records. [2025-10-27T17:31:07.625712] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-27T17:31:07.784279] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:31:07.784585] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-27T17:31:07.784761] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-27T17:31:07.784912] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-27T17:31:07.784950] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-27T17:31:07.901703] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-27T17:31:08.178011] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:31:08.414946] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-27T17:31:09.101300] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T17:31:09.214972] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-27T17:31:09.260167] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-27T17:31:09.959754] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-27T17:31:10.014959] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-27T17:31:10.814955] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-27T17:31:11.366791] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T17:31:11.614952] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-27T17:31:12.416821] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-27T17:31:12.420724] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T17:31:12.449446] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-27T17:31:13.214959] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-27T17:31:13.222445] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-27T17:31:13.875732] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-27T17:31:14.014933] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-27T17:31:14.814961] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-27T17:31:15.458221] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T17:31:15.614950] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-27T17:31:15.980582] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T17:31:16.414981] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-27T17:31:16.588787] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-27T17:31:16.855499] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-27T17:31:17.214908] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-27T17:31:18.014929] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-27T17:31:18.095475] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-27T17:31:18.814943] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-27T17:31:19.467967] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T17:31:19.546010] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-27T17:31:19.614944] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-27T17:31:20.282620] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-27T17:31:20.414980] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-27T17:31:21.214954] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-27T17:31:21.875138] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T17:31:22.014974] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-27T17:31:22.138778] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T17:31:22.522622] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-27T17:31:22.814954] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-27T17:31:23.614958] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-27T17:31:24.414962] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-27T17:31:24.472744] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T17:31:24.475896] [INFO ] [REMOTE ] BFK: Full fetch complete (19232 records). [2025-10-27T17:31:24.475983] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-27T17:31:24.476447] [FATAL] [VALIDATOR ] BFK: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:31:24.476531] [FATAL] [MAIN ] BFK: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:31:24.476593] [WARN ] [MAIN ] BFK: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:31:24.476688] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-27T17:31:24.476759] [DEBUG] [LOCAL ] BFK: No primary data file found to delete. [2025-10-27T17:31:24.476795] [INFO ] [LOCAL ] BFK: Starting deletion of derivative data. [2025-10-27T17:31:24.476925] [DEBUG] [LOCAL ] BFK: Deleted derivative data file. [2025-10-27T17:31:24.476996] [INFO ] [MAIN ] Update Progress: 254/2366 symbols completed. BFK took 27.1s. Estimated remaining: 4h 20m 45s. Rate: 8.1 symbols/min [2025-10-27T17:31:24.646160] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:31:24.668504] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-27T17:31:24.688469] [DEBUG] [LOCAL ] BFZ: Loaded 12259 existing records from primary storage. [2025-10-27T17:31:24.688731] [INFO ] [MAIN ] BFZ: Loaded 12259 existing records. [2025-10-27T17:31:24.861980] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:31:24.862149] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-27T17:31:24.862195] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-27T17:31:24.862340] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-27T17:31:24.862379] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-27T17:31:25.211785] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:31:25.214897] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-27T17:31:25.735953] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-27T17:31:25.855040] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T17:31:26.014960] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-27T17:31:26.814905] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-27T17:31:26.962838] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T17:31:27.614952] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-27T17:31:28.414921] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-27T17:31:28.655547] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T17:31:29.057533] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T17:31:29.214987] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-27T17:31:29.363201] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-27T17:31:30.014941] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-27T17:31:30.517213] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-27T17:31:30.814966] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-27T17:31:30.871383] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T17:31:30.879548] [INFO ] [REMOTE ] BFH: Full fetch complete (60258 records). [2025-10-27T17:31:30.879698] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-27T17:31:31.249947] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-27T17:31:31.250020] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-27T17:31:31.250629] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-27T17:31:31.250707] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-27T17:31:31.251829] [DEBUG] [LOCAL ] BFH: Trimmed 60258 records to 41171 (keeping 200 days of data) [2025-10-27T17:31:31.491861] [DEBUG] [LOCAL ] BFH: Primary data saved (41171 records). [2025-10-27T17:31:31.491985] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-27T17:31:31.492057] [INFO ] [MAIN ] Update Progress: 255/2366 symbols completed. BFH took 38.0s. Estimated remaining: 4h 20m 34s. Rate: 8.1 symbols/min [2025-10-27T17:31:31.611350] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-27T17:31:31.616691] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-27T17:31:31.681265] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:31:31.730789] [DEBUG] [LOCAL ] BG: Loaded 51175 existing records from primary storage. [2025-10-27T17:31:31.731224] [INFO ] [MAIN ] BG: Loaded 51175 existing records. [2025-10-27T17:31:31.908268] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:31:31.908487] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-27T17:31:31.908535] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-27T17:31:31.908852] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-27T17:31:31.908909] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-27T17:31:32.260061] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:31:32.414951] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-27T17:31:32.899117] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-27T17:31:33.214988] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-27T17:31:33.791821] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-27T17:31:33.850135] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T17:31:34.014990] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-27T17:31:34.814945] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-27T17:31:35.602326] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T17:31:35.614895] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-27T17:31:35.669797] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-27T17:31:36.414946] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-27T17:31:37.081941] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T17:31:37.101889] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-27T17:31:37.214940] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-27T17:31:38.015023] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-27T17:31:38.815040] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-27T17:31:38.865376] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-27T17:31:39.574035] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T17:31:39.614912] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-27T17:31:39.753360] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-27T17:31:39.755838] [INFO ] [REMOTE ] BFS: Full fetch complete (13122 records). [2025-10-27T17:31:39.755906] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-27T17:31:40.115792] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-27T17:31:40.115869] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-27T17:31:40.116153] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-27T17:31:40.116218] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-27T17:31:40.116794] [DEBUG] [LOCAL ] BFS: Trimmed 13122 records to 9503 (keeping 200 days of data) [2025-10-27T17:31:40.180117] [DEBUG] [LOCAL ] BFS: Primary data saved (9503 records). [2025-10-27T17:31:40.180338] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-27T17:31:40.180494] [INFO ] [MAIN ] Update Progress: 256/2366 symbols completed. BFS took 32.8s. Estimated remaining: 4h 20m 37s. Rate: 8.1 symbols/min [2025-10-27T17:31:40.348383] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:31:40.365222] [DEBUG] [LOCAL ] BGB: Loaded 17817 existing records from primary storage. [2025-10-27T17:31:40.365441] [INFO ] [MAIN ] BGB: Loaded 17817 existing records. [2025-10-27T17:31:40.426599] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-27T17:31:40.545477] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:31:40.545741] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-27T17:31:40.545798] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-27T17:31:40.546032] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-27T17:31:40.546070] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-27T17:31:40.894970] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:31:41.214954] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-27T17:31:41.574605] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-27T17:31:41.584620] [INFO ] [REMOTE ] BFLY: Full fetch complete (75494 records). [2025-10-27T17:31:41.584792] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-27T17:31:42.010930] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-27T17:31:42.011219] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-27T17:31:42.012204] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-27T17:31:42.012284] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-27T17:31:42.014078] [DEBUG] [LOCAL ] BFLY: Trimmed 75494 records to 51867 (keeping 200 days of data) [2025-10-27T17:31:42.014938] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-27T17:31:42.256710] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-27T17:31:42.292816] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-27T17:31:42.382993] [DEBUG] [LOCAL ] BFLY: Primary data saved (51867 records). [2025-10-27T17:31:42.383159] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-27T17:31:42.383260] [INFO ] [MAIN ] Update Progress: 257/2366 symbols completed. BFLY took 41.8s. Estimated remaining: 4h 19m 47s. Rate: 8.1 symbols/min [2025-10-27T17:31:42.568029] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:31:42.586264] [DEBUG] [LOCAL ] BGH: Loaded 17283 existing records from primary storage. [2025-10-27T17:31:42.586534] [INFO ] [MAIN ] BGH: Loaded 17283 existing records. [2025-10-27T17:31:42.790860] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:31:42.802332] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-27T17:31:42.803425] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-27T17:31:42.803768] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-27T17:31:42.808019] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-27T17:31:42.808116] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-27T17:31:42.820101] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-27T17:31:43.205843] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:31:43.615013] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-27T17:31:44.205100] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-27T17:31:44.325203] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-27T17:31:44.414974] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-27T17:31:45.214970] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-27T17:31:46.015013] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-27T17:31:46.278432] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-27T17:31:46.359625] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T17:31:46.628567] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-27T17:31:46.814997] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-27T17:31:47.310277] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-27T17:31:47.614989] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-27T17:31:48.110549] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-27T17:31:48.414951] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-27T17:31:49.215003] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-27T17:31:49.849233] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T17:31:50.014925] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-27T17:31:50.204095] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T17:31:50.815011] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-27T17:31:51.049477] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-27T17:31:51.614995] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-27T17:31:52.414928] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-27T17:31:52.571426] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T17:31:52.574062] [INFO ] [REMOTE ] BFZ: Full fetch complete (17706 records). [2025-10-27T17:31:52.574130] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-27T17:31:52.956603] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-27T17:31:53.002626] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-27T17:31:53.002743] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-27T17:31:53.003132] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-27T17:31:53.003175] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-27T17:31:53.003784] [DEBUG] [LOCAL ] BFZ: Trimmed 17706 records to 11944 (keeping 200 days of data) [2025-10-27T17:31:53.073097] [DEBUG] [LOCAL ] BFZ: Primary data saved (11944 records). [2025-10-27T17:31:53.073231] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-27T17:31:53.073307] [INFO ] [MAIN ] Update Progress: 258/2366 symbols completed. BFZ took 28.6s. Estimated remaining: 4h 20m 7s. Rate: 8.1 symbols/min [2025-10-27T17:31:53.220838] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-27T17:31:53.241244] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:31:53.255290] [DEBUG] [LOCAL ] BGR: Loaded 13583 existing records from primary storage. [2025-10-27T17:31:53.256177] [INFO ] [MAIN ] BGR: Loaded 13583 existing records. [2025-10-27T17:31:53.432521] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:31:53.432762] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-27T17:31:53.432814] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-27T17:31:53.432985] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-27T17:31:53.433021] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-27T17:31:53.795266] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:31:53.817762] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T17:31:54.014987] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-27T17:31:54.788732] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-27T17:31:54.814924] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-27T17:31:54.932292] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T17:31:54.941497] [INFO ] [REMOTE ] BG: Full fetch complete (72699 records). [2025-10-27T17:31:54.941634] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-27T17:31:54.942409] [FATAL] [VALIDATOR ] BG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:31:54.942497] [FATAL] [MAIN ] BG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:31:54.942542] [WARN ] [MAIN ] BG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:31:54.942580] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-27T17:31:54.942635] [DEBUG] [LOCAL ] BG: No primary data file found to delete. [2025-10-27T17:31:54.942724] [INFO ] [LOCAL ] BG: Starting deletion of derivative data. [2025-10-27T17:31:54.942926] [DEBUG] [LOCAL ] BG: Deleted derivative data file. [2025-10-27T17:31:54.943020] [INFO ] [MAIN ] Update Progress: 259/2366 symbols completed. BG took 23.5s. Estimated remaining: 4h 19m 14s. Rate: 8.1 symbols/min [2025-10-27T17:31:55.119296] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:31:55.163194] [DEBUG] [LOCAL ] BGS: Loaded 51254 existing records from primary storage. [2025-10-27T17:31:55.163548] [INFO ] [MAIN ] BGS: Loaded 51254 existing records. [2025-10-27T17:31:55.338110] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:31:55.338347] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-27T17:31:55.338417] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-27T17:31:55.338846] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-27T17:31:55.338906] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-27T17:31:55.618205] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-27T17:31:55.699972] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:31:55.777425] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-27T17:31:56.221194] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T17:31:56.414969] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-27T17:31:57.183207] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-27T17:31:57.214912] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-27T17:31:57.899198] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-27T17:31:58.014908] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-27T17:31:58.815053] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-27T17:31:58.865043] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-27T17:31:59.614965] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-27T17:31:59.851001] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T17:32:00.414960] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-27T17:32:00.648325] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-27T17:32:01.214939] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-27T17:32:02.014972] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-27T17:32:02.814966] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-27T17:32:03.396908] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (2.98 seconds). [2025-10-27T17:32:03.614962] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-27T17:32:04.249726] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (3.03 seconds). [2025-10-27T17:32:04.311482] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-27T17:32:04.414965] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-27T17:32:04.558179] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T17:32:04.588325] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-27T17:32:05.214930] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-27T17:32:05.661073] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T17:32:06.014958] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-27T17:32:06.437419] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T17:32:06.708665] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-27T17:32:06.814909] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-27T17:32:07.614913] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-27T17:32:07.901904] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T17:32:07.905530] [INFO ] [REMOTE ] BGH: Full fetch complete (22912 records). [2025-10-27T17:32:07.905608] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-27T17:32:07.906114] [FATAL] [VALIDATOR ] BGH: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:32:07.906196] [FATAL] [MAIN ] BGH: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:32:07.906258] [WARN ] [MAIN ] BGH: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:32:07.906347] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-27T17:32:07.906414] [DEBUG] [LOCAL ] BGH: No primary data file found to delete. [2025-10-27T17:32:07.906450] [INFO ] [LOCAL ] BGH: Starting deletion of derivative data. [2025-10-27T17:32:07.906713] [DEBUG] [LOCAL ] BGH: Deleted derivative data file. [2025-10-27T17:32:07.906808] [INFO ] [MAIN ] Update Progress: 260/2366 symbols completed. BGH took 25.5s. Estimated remaining: 4h 19m 52s. Rate: 8.1 symbols/min [2025-10-27T17:32:08.074839] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:32:08.084995] [DEBUG] [LOCAL ] BGSF: Loaded 8349 existing records from primary storage. [2025-10-27T17:32:08.085211] [INFO ] [MAIN ] BGSF: Loaded 8349 existing records. [2025-10-27T17:32:08.270630] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:32:08.271004] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-27T17:32:08.271092] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-27T17:32:08.279575] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-27T17:32:08.280325] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-27T17:32:08.280025] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-27T17:32:08.421202] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-27T17:32:08.644100] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:32:09.214975] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-27T17:32:09.352593] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-27T17:32:10.015040] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-27T17:32:10.666723] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-27T17:32:10.814980] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-27T17:32:10.941441] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-27T17:32:11.094477] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-27T17:32:11.614950] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-27T17:32:12.337697] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-27T17:32:12.414942] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-27T17:32:13.214933] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-27T17:32:13.365067] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T17:32:13.975587] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-27T17:32:14.014923] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-27T17:32:14.814924] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-27T17:32:14.969407] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-27T17:32:15.614950] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-27T17:32:15.896743] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T17:32:15.900454] [INFO ] [REMOTE ] BGB: Full fetch complete (26510 records). [2025-10-27T17:32:15.900542] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-27T17:32:16.276998] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-27T17:32:16.277093] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-27T17:32:16.277511] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-27T17:32:16.277574] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-27T17:32:16.278481] [DEBUG] [LOCAL ] BGB: Trimmed 26510 records to 17226 (keeping 200 days of data) [2025-10-27T17:32:16.382820] [DEBUG] [LOCAL ] BGB: Primary data saved (17226 records). [2025-10-27T17:32:16.382954] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-27T17:32:16.383034] [INFO ] [MAIN ] Update Progress: 261/2366 symbols completed. BGB took 36.2s. Estimated remaining: 4h 19m 53s. Rate: 8.1 symbols/min [2025-10-27T17:32:16.420108] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-27T17:32:16.561123] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:32:16.578383] [DEBUG] [LOCAL ] BGT: Loaded 16371 existing records from primary storage. [2025-10-27T17:32:16.578622] [INFO ] [MAIN ] BGT: Loaded 16371 existing records. [2025-10-27T17:32:16.750924] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:32:16.751182] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-27T17:32:16.751237] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-27T17:32:16.751411] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-27T17:32:16.751467] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-27T17:32:17.109889] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:32:17.119884] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-27T17:32:17.153861] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-27T17:32:17.214918] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-27T17:32:18.014967] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-27T17:32:18.472581] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T17:32:18.689330] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-27T17:32:18.814931] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-27T17:32:19.615470] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-27T17:32:19.615398] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T17:32:19.962873] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-27T17:32:20.414954] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-27T17:32:21.214920] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-27T17:32:21.293688] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-27T17:32:21.850359] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-27T17:32:22.014910] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-27T17:32:22.814963] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-27T17:32:22.897188] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-27T17:32:23.473295] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-27T17:32:23.614921] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-27T17:32:24.414938] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-27T17:32:24.665010] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-27T17:32:25.214945] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-27T17:32:25.646029] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T17:32:26.020009] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-27T17:32:26.021789] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T17:32:26.814949] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-27T17:32:27.056763] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T17:32:27.059707] [INFO ] [REMOTE ] BGR: Full fetch complete (19852 records). [2025-10-27T17:32:27.059783] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-27T17:32:27.420691] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-27T17:32:27.420775] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-27T17:32:27.421143] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-27T17:32:27.421180] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-27T17:32:27.421750] [DEBUG] [LOCAL ] BGR: Trimmed 19852 records to 13127 (keeping 200 days of data) [2025-10-27T17:32:27.481753] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-27T17:32:27.505298] [DEBUG] [LOCAL ] BGR: Primary data saved (13127 records). [2025-10-27T17:32:27.505433] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-27T17:32:27.505508] [INFO ] [MAIN ] Update Progress: 262/2366 symbols completed. BGR took 34.4s. Estimated remaining: 4h 20m 16s. Rate: 8.1 symbols/min [2025-10-27T17:32:27.620027] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-27T17:32:27.674781] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:32:27.692186] [DEBUG] [LOCAL ] BGX: Loaded 11319 existing records from primary storage. [2025-10-27T17:32:27.692445] [INFO ] [MAIN ] BGX: Loaded 11319 existing records. [2025-10-27T17:32:27.868767] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:32:27.868984] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-27T17:32:27.869045] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-27T17:32:27.869190] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-27T17:32:27.869228] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-27T17:32:28.231090] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:32:28.390419] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-27T17:32:28.414907] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-27T17:32:29.082672] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-27T17:32:29.214952] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-27T17:32:30.014920] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-27T17:32:30.363753] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-27T17:32:30.814939] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-27T17:32:31.505969] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T17:32:31.614939] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-27T17:32:31.926526] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T17:32:32.415001] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-27T17:32:33.172734] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T17:32:33.214900] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-27T17:32:33.298377] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-27T17:32:34.014947] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-27T17:32:34.814937] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-27T17:32:34.945692] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T17:32:34.993895] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T17:32:35.614958] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-27T17:32:35.748198] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T17:32:35.751037] [INFO ] [REMOTE ] BGSF: Full fetch complete (9772 records). [2025-10-27T17:32:35.751123] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-27T17:32:36.101988] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-27T17:32:36.102062] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-27T17:32:36.102293] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-27T17:32:36.102332] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-27T17:32:36.102777] [DEBUG] [LOCAL ] BGSF: Trimmed 9772 records to 8297 (keeping 200 days of data) [2025-10-27T17:32:36.152040] [DEBUG] [LOCAL ] BGSF: Primary data saved (8297 records). [2025-10-27T17:32:36.152150] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-27T17:32:36.152222] [INFO ] [MAIN ] Update Progress: 263/2366 symbols completed. BGSF took 28.2s. Estimated remaining: 4h 20m 18s. Rate: 8.1 symbols/min [2025-10-27T17:32:36.326159] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:32:36.335693] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-27T17:32:36.358058] [DEBUG] [LOCAL ] BGY: Loaded 21577 existing records from primary storage. [2025-10-27T17:32:36.358319] [INFO ] [MAIN ] BGY: Loaded 21577 existing records. [2025-10-27T17:32:36.420148] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-27T17:32:36.538022] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:32:36.538210] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-27T17:32:36.538257] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-27T17:32:36.538413] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-27T17:32:36.538451] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-27T17:32:36.888235] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:32:37.214923] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-27T17:32:38.020015] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-27T17:32:38.037049] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-27T17:32:38.046974] [INFO ] [REMOTE ] BGS: Full fetch complete (72671 records). [2025-10-27T17:32:38.047113] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-27T17:32:38.408992] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T17:32:38.469727] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-27T17:32:38.469815] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-27T17:32:38.470554] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-27T17:32:38.470605] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-27T17:32:38.472011] [DEBUG] [LOCAL ] BGS: Trimmed 72671 records to 50455 (keeping 200 days of data) [2025-10-27T17:32:38.593749] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-27T17:32:38.771054] [DEBUG] [LOCAL ] BGS: Primary data saved (50455 records). [2025-10-27T17:32:38.771190] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-27T17:32:38.771269] [INFO ] [MAIN ] Update Progress: 264/2366 symbols completed. BGS took 43.8s. Estimated remaining: 4h 19m 32s. Rate: 8.1 symbols/min [2025-10-27T17:32:38.822800] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-27T17:32:38.941061] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:32:38.956426] [DEBUG] [LOCAL ] BH: Loaded 16651 existing records from primary storage. [2025-10-27T17:32:38.956638] [INFO ] [MAIN ] BH: Loaded 16651 existing records. [2025-10-27T17:32:39.128712] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:32:39.128904] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-27T17:32:39.128949] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-27T17:32:39.129105] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-27T17:32:39.129142] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-27T17:32:39.490678] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:32:39.614923] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-27T17:32:39.880988] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T17:32:40.177631] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-27T17:32:40.414990] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-27T17:32:41.214992] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-27T17:32:41.271858] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T17:32:41.275050] [INFO ] [REMOTE ] BGT: Full fetch complete (24122 records). [2025-10-27T17:32:41.275127] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-27T17:32:41.637886] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-27T17:32:41.637967] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-27T17:32:41.638346] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-27T17:32:41.638386] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-27T17:32:41.639018] [DEBUG] [LOCAL ] BGT: Trimmed 24122 records to 15819 (keeping 200 days of data) [2025-10-27T17:32:41.741911] [DEBUG] [LOCAL ] BGT: Primary data saved (15819 records). [2025-10-27T17:32:41.742032] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-27T17:32:41.742113] [INFO ] [MAIN ] Update Progress: 265/2366 symbols completed. BGT took 25.4s. Estimated remaining: 4h 18m 50s. Rate: 8.1 symbols/min [2025-10-27T17:32:41.911186] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:32:41.952497] [DEBUG] [LOCAL ] BHC: Loaded 47252 existing records from primary storage. [2025-10-27T17:32:41.952895] [INFO ] [MAIN ] BHC: Loaded 47252 existing records. [2025-10-27T17:32:42.018588] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-27T17:32:42.134811] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:32:42.135013] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-27T17:32:42.135074] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-27T17:32:42.135420] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-27T17:32:42.135479] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-27T17:32:42.460917] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T17:32:42.521630] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:32:42.814982] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-27T17:32:42.993258] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-27T17:32:43.194605] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-27T17:32:43.614939] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-27T17:32:44.340933] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-27T17:32:44.414905] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-27T17:32:45.165357] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-27T17:32:45.214903] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-27T17:32:45.861186] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-27T17:32:46.014952] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-27T17:32:46.814915] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-27T17:32:46.956635] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-27T17:32:47.617203] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-27T17:32:47.621811] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T17:32:48.414996] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-27T17:32:48.860533] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T17:32:49.214935] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-27T17:32:49.981768] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-27T17:32:50.016672] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-27T17:32:50.021321] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T17:32:50.814919] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-27T17:32:50.947826] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-27T17:32:51.349531] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-27T17:32:51.614974] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-27T17:32:52.265456] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-27T17:32:52.414988] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-27T17:32:53.192958] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-27T17:32:53.214922] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-27T17:32:54.010318] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-27T17:32:54.014892] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-27T17:32:54.814994] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-27T17:32:55.152123] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T17:32:55.155756] [INFO ] [REMOTE ] BGX: Full fetch complete (16442 records). [2025-10-27T17:32:55.155853] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-27T17:32:55.548169] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-27T17:32:55.548249] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-27T17:32:55.548564] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-27T17:32:55.548603] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-27T17:32:55.549152] [DEBUG] [LOCAL ] BGX: Trimmed 16442 records to 10924 (keeping 200 days of data) [2025-10-27T17:32:55.613877] [DEBUG] [LOCAL ] BGX: Primary data saved (10924 records). [2025-10-27T17:32:55.614008] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-27T17:32:55.614084] [INFO ] [MAIN ] Update Progress: 266/2366 symbols completed. BGX took 28.1s. Estimated remaining: 4h 19m 34s. Rate: 8.1 symbols/min [2025-10-27T17:32:55.625090] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-27T17:32:55.791617] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:32:55.813837] [DEBUG] [LOCAL ] BHE: Loaded 23916 existing records from primary storage. [2025-10-27T17:32:55.814132] [INFO ] [MAIN ] BHE: Loaded 23916 existing records. [2025-10-27T17:32:55.995537] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:32:55.995778] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-27T17:32:55.995847] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-27T17:32:55.996112] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-27T17:32:55.996175] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-27T17:32:56.172622] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T17:32:56.394287] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:32:56.410369] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-27T17:32:56.415032] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-27T17:32:57.214973] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-27T17:32:57.717552] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T17:32:58.014952] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-27T17:32:58.214407] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T17:32:58.777483] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T17:32:58.814903] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-27T17:32:59.614940] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-27T17:32:59.900062] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T17:32:59.904409] [INFO ] [REMOTE ] BGY: Full fetch complete (32855 records). [2025-10-27T17:32:59.904488] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-27T17:33:00.280918] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-27T17:33:00.280995] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-27T17:33:00.281414] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-27T17:33:00.281453] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-27T17:33:00.282165] [DEBUG] [LOCAL ] BGY: Trimmed 32855 records to 21175 (keeping 200 days of data) [2025-10-27T17:33:00.400118] [DEBUG] [LOCAL ] BGY: Primary data saved (21175 records). [2025-10-27T17:33:00.400239] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-27T17:33:00.400311] [INFO ] [MAIN ] Update Progress: 267/2366 symbols completed. BGY took 24.2s. Estimated remaining: 4h 19m 5s. Rate: 8.1 symbols/min [2025-10-27T17:33:00.420829] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-27T17:33:00.583626] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:33:00.604452] [DEBUG] [LOCAL ] BHK: Loaded 24267 existing records from primary storage. [2025-10-27T17:33:00.604743] [INFO ] [MAIN ] BHK: Loaded 24267 existing records. [2025-10-27T17:33:00.783824] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:33:00.784028] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-27T17:33:00.784075] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-27T17:33:00.784273] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-27T17:33:00.784310] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-27T17:33:01.145229] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:33:01.214944] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-27T17:33:01.948069] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-27T17:33:02.015004] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-27T17:33:02.814999] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-27T17:33:03.696088] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (3.28 seconds). [2025-10-27T17:33:03.699934] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-27T17:33:04.699714] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T17:33:04.704274] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-27T17:33:04.825818] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-10-27T17:33:04.941782] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (3.73 seconds). [2025-10-27T17:33:05.213357] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-27T17:33:05.222816] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-27T17:33:06.014997] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-27T17:33:06.571359] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-27T17:33:06.750807] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T17:33:06.814929] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-27T17:33:07.233491] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-27T17:33:07.417747] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-27T17:33:07.614960] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-27T17:33:08.414912] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-27T17:33:08.676841] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T17:33:09.214997] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-27T17:33:09.906320] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-27T17:33:10.014914] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-27T17:33:10.058016] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-27T17:33:10.814941] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-27T17:33:11.048739] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T17:33:11.051794] [INFO ] [REMOTE ] BH: Full fetch complete (19480 records). [2025-10-27T17:33:11.051873] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-27T17:33:11.052309] [FATAL] [VALIDATOR ] BH: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:33:11.052390] [FATAL] [MAIN ] BH: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:33:11.052459] [WARN ] [MAIN ] BH: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:33:11.052533] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-27T17:33:11.052597] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-10-27T17:33:11.052634] [INFO ] [LOCAL ] BH: Starting deletion of derivative data. [2025-10-27T17:33:11.052863] [DEBUG] [LOCAL ] BH: Deleted derivative data file. [2025-10-27T17:33:11.052950] [INFO ] [MAIN ] Update Progress: 268/2366 symbols completed. BH took 32.3s. Estimated remaining: 4h 19m 23s. Rate: 8.1 symbols/min [2025-10-27T17:33:11.220139] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:33:11.267498] [DEBUG] [LOCAL ] BHP: Loaded 54141 existing records from primary storage. [2025-10-27T17:33:11.267828] [INFO ] [MAIN ] BHP: Loaded 54141 existing records. [2025-10-27T17:33:11.440260] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:33:11.440471] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-27T17:33:11.440516] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-27T17:33:11.440746] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-27T17:33:11.440804] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-27T17:33:11.633430] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-27T17:33:11.615310] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-27T17:33:11.819730] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:33:12.415011] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-27T17:33:12.712839] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-27T17:33:13.142192] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-27T17:33:13.214927] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-27T17:33:14.021184] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-27T17:33:14.024766] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-27T17:33:14.814917] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-27T17:33:14.929743] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T17:33:15.614970] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-27T17:33:16.373935] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T17:33:16.414959] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-27T17:33:17.214913] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-27T17:33:17.344696] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-27T17:33:17.522744] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-27T17:33:18.014919] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-27T17:33:18.424029] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T17:33:18.814958] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-27T17:33:19.240311] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-27T17:33:19.614943] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-27T17:33:20.271609] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-27T17:33:20.414917] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-27T17:33:21.142349] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-27T17:33:21.214931] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-27T17:33:22.014917] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-27T17:33:22.189459] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-27T17:33:22.436630] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T17:33:22.445500] [INFO ] [REMOTE ] BHC: Full fetch complete (67621 records). [2025-10-27T17:33:22.445624] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-27T17:33:22.822090] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-27T17:33:22.838891] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-27T17:33:22.839099] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-27T17:33:22.840403] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-27T17:33:22.840470] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-27T17:33:22.841842] [DEBUG] [LOCAL ] BHC: Trimmed 67621 records to 46452 (keeping 200 days of data) [2025-10-27T17:33:23.095539] [DEBUG] [LOCAL ] BHC: Primary data saved (46452 records). [2025-10-27T17:33:23.095639] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-27T17:33:23.096534] [INFO ] [MAIN ] Update Progress: 269/2366 symbols completed. BHC took 41.4s. Estimated remaining: 4h 19m 52s. Rate: 8.1 symbols/min [2025-10-27T17:33:23.276396] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:33:23.285109] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T17:33:23.311783] [DEBUG] [LOCAL ] BHR: Loaded 22412 existing records from primary storage. [2025-10-27T17:33:23.312055] [INFO ] [MAIN ] BHR: Loaded 22412 existing records. [2025-10-27T17:33:23.488491] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:33:23.488787] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-27T17:33:23.488839] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-27T17:33:23.489029] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-27T17:33:23.489066] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-27T17:33:23.625517] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-27T17:33:23.844833] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:33:23.863884] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T17:33:24.414950] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-27T17:33:25.214939] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-27T17:33:25.671397] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-27T17:33:25.698112] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-27T17:33:26.014969] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-27T17:33:26.476106] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-27T17:33:26.814960] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-27T17:33:27.614967] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-27T17:33:28.008003] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-27T17:33:28.160503] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T17:33:28.275457] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T17:33:28.414944] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-27T17:33:29.214940] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-27T17:33:29.374026] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T17:33:29.380205] [INFO ] [REMOTE ] BHE: Full fetch complete (36202 records). [2025-10-27T17:33:29.380334] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-27T17:33:29.381040] [FATAL] [VALIDATOR ] BHE: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:33:29.381141] [FATAL] [MAIN ] BHE: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:33:29.381195] [WARN ] [MAIN ] BHE: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:33:29.381271] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-27T17:33:29.381350] [DEBUG] [LOCAL ] BHE: No primary data file found to delete. [2025-10-27T17:33:29.381405] [INFO ] [LOCAL ] BHE: Starting deletion of derivative data. [2025-10-27T17:33:29.381600] [DEBUG] [LOCAL ] BHE: Deleted derivative data file. [2025-10-27T17:33:29.381750] [INFO ] [MAIN ] Update Progress: 270/2366 symbols completed. BHE took 33.8s. Estimated remaining: 4h 19m 36s. Rate: 8.1 symbols/min [2025-10-27T17:33:29.556806] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:33:29.556955] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-27T17:33:29.556991] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-27T17:33:29.557100] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-27T17:33:29.557141] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-27T17:33:29.557183] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-27T17:33:29.557216] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-27T17:33:29.913832] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:33:29.998696] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-27T17:33:30.003398] [INFO ] [REMOTE ] BHK: Full fetch complete (30776 records). [2025-10-27T17:33:30.003524] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-27T17:33:30.025023] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-27T17:33:30.378560] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-27T17:33:30.378627] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-27T17:33:30.379058] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-27T17:33:30.379108] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-27T17:33:30.379823] [DEBUG] [LOCAL ] BHK: Trimmed 30776 records to 23928 (keeping 200 days of data) [2025-10-27T17:33:30.517337] [DEBUG] [LOCAL ] BHK: Primary data saved (23928 records). [2025-10-27T17:33:30.517458] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-27T17:33:30.517537] [INFO ] [MAIN ] Update Progress: 271/2366 symbols completed. BHK took 30.1s. Estimated remaining: 4h 18m 40s. Rate: 8.1 symbols/min [2025-10-27T17:33:30.589956] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-27T17:33:30.689586] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:33:30.735073] [DEBUG] [LOCAL ] BHVN: Loaded 51373 existing records from primary storage. [2025-10-27T17:33:30.735390] [INFO ] [MAIN ] BHVN: Loaded 51373 existing records. [2025-10-27T17:33:30.820189] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-27T17:33:30.912076] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:33:30.912276] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-27T17:33:30.912331] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-27T17:33:30.912631] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-27T17:33:30.912722] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-27T17:33:31.268134] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:33:31.614967] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-27T17:33:31.741199] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T17:33:32.414935] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-27T17:33:32.700289] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-27T17:33:32.780706] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-27T17:33:33.214942] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-27T17:33:34.015001] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-27T17:33:34.700348] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-27T17:33:34.814899] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-27T17:33:35.614922] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-27T17:33:35.707469] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T17:33:35.826087] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T17:33:36.422306] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-27T17:33:36.424116] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T17:33:37.214986] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-27T17:33:38.014914] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-27T17:33:38.063973] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T17:33:38.366548] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T17:33:38.815076] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-27T17:33:39.614937] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-27T17:33:40.104006] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-27T17:33:40.211223] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-27T17:33:40.414960] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-27T17:33:40.458437] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T17:33:40.835192] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-27T17:33:41.214910] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-27T17:33:42.015005] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-27T17:33:42.404398] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T17:33:42.814952] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-27T17:33:43.090519] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-27T17:33:43.614964] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-27T17:33:43.826904] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-27T17:33:43.880783] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-27T17:33:44.414960] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-27T17:33:45.214935] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-27T17:33:45.540082] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-27T17:33:46.014938] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-27T17:33:46.187239] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-27T17:33:46.497522] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-27T17:33:46.814960] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-27T17:33:47.615003] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-27T17:33:47.942074] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-27T17:33:48.414937] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-27T17:33:48.930313] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T17:33:48.931183] [INFO ] [REMOTE ] BHV: Full fetch complete (1428 records). [2025-10-27T17:33:48.931252] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-27T17:33:49.109118] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-27T17:33:49.109411] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:33:49.124074] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:33:49.134989] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-27T17:33:49.135134] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-27T17:33:49.135186] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-27T17:33:49.135399] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-27T17:33:49.135492] [INFO ] [MAIN ] Update Progress: 272/2366 symbols completed. BHV took 19.8s. Estimated remaining: 4h 19m 59s. Rate: 8.1 symbols/min [2025-10-27T17:33:49.136907] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-27T17:33:49.219123] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-27T17:33:49.236224] [INFO ] [REMOTE ] BHP: Full fetch complete (77439 records). [2025-10-27T17:33:49.246675] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-27T17:33:49.399487] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:33:49.755095] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-27T17:33:49.754873] [DEBUG] [LOCAL ] BILL: Loaded 53268 existing records from primary storage. [2025-10-27T17:33:49.755264] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-27T17:33:49.756265] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-27T17:33:49.756343] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-27T17:33:49.756609] [INFO ] [MAIN ] BILL: Loaded 53268 existing records. [2025-10-27T17:33:49.856450] [DEBUG] [LOCAL ] BHP: Trimmed 77439 records to 53359 (keeping 200 days of data) [2025-10-27T17:33:50.015700] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-27T17:33:50.025182] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:33:50.033349] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-27T17:33:50.035622] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-27T17:33:50.036867] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-27T17:33:50.037434] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-27T17:33:50.613335] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:33:50.618741] [DEBUG] [LOCAL ] BHP: Primary data saved (53359 records). [2025-10-27T17:33:50.619140] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-27T17:33:50.619235] [INFO ] [MAIN ] Update Progress: 273/2366 symbols completed. BHP took 39.6s. Estimated remaining: 4h 19m 5s. Rate: 8.1 symbols/min [2025-10-27T17:33:50.792790] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:33:50.815556] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-27T17:33:50.816847] [DEBUG] [LOCAL ] BIO: Loaded 24067 existing records from primary storage. [2025-10-27T17:33:50.817108] [INFO ] [MAIN ] BIO: Loaded 24067 existing records. [2025-10-27T17:33:51.001970] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:33:51.002263] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-27T17:33:51.002322] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-27T17:33:51.002485] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-27T17:33:51.002523] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-27T17:33:51.313567] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T17:33:51.412316] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-27T17:33:51.415963] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:33:51.614948] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-27T17:33:52.414918] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-27T17:33:52.450232] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T17:33:52.673917] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-27T17:33:53.215007] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-27T17:33:53.469197] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T17:33:54.014953] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-27T17:33:54.814984] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-27T17:33:55.102047] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-27T17:33:55.243092] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T17:33:55.539673] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-27T17:33:55.614932] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-27T17:33:56.414930] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-27T17:33:57.201482] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T17:33:57.214902] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-27T17:33:57.261060] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-27T17:33:57.858940] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-27T17:33:58.014946] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-27T17:33:58.814965] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-27T17:33:59.614951] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-27T17:33:59.756567] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T17:33:59.830543] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-27T17:34:00.414932] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-27T17:34:01.214953] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-27T17:34:02.014918] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-27T17:34:02.402789] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (2.79 seconds). [2025-10-27T17:34:02.412704] [INFO ] [REMOTE ] BHVN: Full fetch complete (70833 records). [2025-10-27T17:34:02.412851] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-27T17:34:02.801098] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-27T17:34:02.801191] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-27T17:34:02.802006] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-27T17:34:02.802081] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-27T17:34:02.803463] [DEBUG] [LOCAL ] BHVN: Trimmed 70833 records to 50598 (keeping 200 days of data) [2025-10-27T17:34:03.090336] [DEBUG] [LOCAL ] BHVN: Primary data saved (50598 records). [2025-10-27T17:34:03.090461] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-27T17:34:03.090536] [INFO ] [MAIN ] Update Progress: 274/2366 symbols completed. BHVN took 32.6s. Estimated remaining: 4h 19m 36s. Rate: 8.1 symbols/min [2025-10-27T17:34:03.259704] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:34:03.295018] [DEBUG] [LOCAL ] BIP: Loaded 39408 existing records from primary storage. [2025-10-27T17:34:03.295297] [INFO ] [MAIN ] BIP: Loaded 39408 existing records. [2025-10-27T17:34:03.474974] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:34:03.475164] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-27T17:34:03.475211] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-27T17:34:03.475393] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-27T17:34:03.475448] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-27T17:34:03.827721] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:34:03.828056] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-27T17:34:04.738403] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-27T17:34:04.744678] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-27T17:34:04.975378] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (3.76 seconds). [2025-10-27T17:34:04.981477] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-27T17:34:05.139788] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (4.72 seconds). [2025-10-27T17:34:05.215012] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-27T17:34:05.216093] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T17:34:05.984551] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T17:34:05.989985] [INFO ] [REMOTE ] BHR: Full fetch complete (31193 records). [2025-10-27T17:34:05.990097] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-27T17:34:06.022948] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-27T17:34:06.372930] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-27T17:34:06.373011] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-27T17:34:06.373472] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-27T17:34:06.373515] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-27T17:34:06.374247] [DEBUG] [LOCAL ] BHR: Trimmed 31193 records to 21977 (keeping 200 days of data) [2025-10-27T17:34:06.498223] [DEBUG] [LOCAL ] BHR: Primary data saved (21977 records). [2025-10-27T17:34:06.498345] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-27T17:34:06.498419] [INFO ] [MAIN ] Update Progress: 275/2366 symbols completed. BHR took 43.4s. Estimated remaining: 4h 18m 58s. Rate: 8.1 symbols/min [2025-10-27T17:34:06.674123] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:34:06.717914] [DEBUG] [LOCAL ] BIPC: Loaded 41611 existing records from primary storage. [2025-10-27T17:34:06.718304] [INFO ] [MAIN ] BIPC: Loaded 41611 existing records. [2025-10-27T17:34:06.908229] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:34:06.909124] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-27T17:34:06.921717] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-27T17:34:06.924906] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-27T17:34:06.925047] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-27T17:34:06.930599] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-27T17:34:06.967975] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-27T17:34:07.126347] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-27T17:34:07.338849] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:34:07.593040] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T17:34:07.614905] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-27T17:34:07.997236] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T17:34:08.414909] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-27T17:34:08.712252] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T17:34:09.214931] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-27T17:34:09.765959] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T17:34:10.014967] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-27T17:34:10.621217] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T17:34:10.814936] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-27T17:34:11.250556] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T17:34:11.615010] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-27T17:34:12.324054] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T17:34:12.414931] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-27T17:34:12.694073] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-27T17:34:13.214979] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-27T17:34:13.565408] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-27T17:34:14.014954] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-27T17:34:14.769754] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T17:34:14.814919] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-27T17:34:15.615010] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-27T17:34:16.006504] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-27T17:34:16.265259] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T17:34:16.414945] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-27T17:34:17.090871] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-27T17:34:17.214929] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-27T17:34:17.348204] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-27T17:34:18.014935] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-27T17:34:18.415327] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-27T17:34:18.814894] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-27T17:34:18.846783] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-27T17:34:19.615005] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-27T17:34:20.137456] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-27T17:34:20.284984] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-27T17:34:20.414949] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-27T17:34:21.214977] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-27T17:34:21.978333] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-27T17:34:21.982315] [INFO ] [REMOTE ] BIO: Full fetch complete (34657 records). [2025-10-27T17:34:21.982404] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-27T17:34:22.015442] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-27T17:34:22.347399] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-27T17:34:22.428635] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-27T17:34:22.428737] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-27T17:34:22.429182] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-27T17:34:22.429221] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-27T17:34:22.429963] [DEBUG] [LOCAL ] BIO: Trimmed 34657 records to 23423 (keeping 200 days of data) [2025-10-27T17:34:22.573732] [DEBUG] [LOCAL ] BIO: Primary data saved (23423 records). [2025-10-27T17:34:22.574156] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-27T17:34:22.574264] [INFO ] [MAIN ] Update Progress: 276/2366 symbols completed. BIO took 32.0s. Estimated remaining: 4h 19m 56s. Rate: 8.0 symbols/min [2025-10-27T17:34:22.750448] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:34:22.754493] [DEBUG] [LOCAL ] BIPH: Loaded 2371 existing records from primary storage. [2025-10-27T17:34:22.754664] [INFO ] [MAIN ] BIPH: Loaded 2371 existing records. [2025-10-27T17:34:22.820971] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-27T17:34:22.936858] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:34:22.937104] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-27T17:34:22.937151] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-27T17:34:22.937738] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-27T17:34:22.937796] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-27T17:34:23.284837] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:34:23.614955] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-27T17:34:23.676387] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T17:34:24.414930] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-27T17:34:24.679343] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-27T17:34:24.690231] [INFO ] [REMOTE ] BILL: Full fetch complete (76123 records). [2025-10-27T17:34:24.690376] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-27T17:34:24.873461] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-27T17:34:25.126871] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-27T17:34:25.126954] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-27T17:34:25.127800] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-27T17:34:25.127864] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-27T17:34:25.129351] [DEBUG] [LOCAL ] BILL: Trimmed 76123 records to 52486 (keeping 200 days of data) [2025-10-27T17:34:25.218737] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-27T17:34:25.430483] [DEBUG] [LOCAL ] BILL: Primary data saved (52486 records). [2025-10-27T17:34:25.430621] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-27T17:34:25.430734] [INFO ] [MAIN ] Update Progress: 277/2366 symbols completed. BILL took 36.3s. Estimated remaining: 4h 19m 14s. Rate: 8.1 symbols/min [2025-10-27T17:34:25.892601] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-27T17:34:26.014950] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-27T17:34:26.225494] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-27T17:34:26.574721] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-27T17:34:26.814937] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-27T17:34:27.614985] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-27T17:34:27.751019] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-27T17:34:28.029804] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-27T17:34:28.415002] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-27T17:34:29.214991] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-27T17:34:29.964172] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T17:34:30.014907] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-27T17:34:30.480914] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T17:34:30.488776] [INFO ] [REMOTE ] BIPC: Full fetch complete (60177 records). [2025-10-27T17:34:30.488860] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-27T17:34:30.820132] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-27T17:34:30.870411] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-27T17:34:30.870562] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-27T17:34:30.871281] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-27T17:34:30.871342] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-27T17:34:30.872530] [DEBUG] [LOCAL ] BIPC: Trimmed 60177 records to 40781 (keeping 200 days of data) [2025-10-27T17:34:31.116036] [DEBUG] [LOCAL ] BIPC: Primary data saved (40781 records). [2025-10-27T17:34:31.116149] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-27T17:34:31.116990] [INFO ] [MAIN ] Update Progress: 278/2366 symbols completed. BIPC took 24.6s. Estimated remaining: 4h 18m 53s. Rate: 8.1 symbols/min [2025-10-27T17:34:31.296953] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-27T17:34:31.621412] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-27T17:34:31.636525] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-27T17:34:31.645781] [INFO ] [REMOTE ] BIP: Full fetch complete (57672 records). [2025-10-27T17:34:31.645898] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-27T17:34:32.024626] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-27T17:34:32.024857] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-27T17:34:32.025514] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-27T17:34:32.025555] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-27T17:34:32.026710] [DEBUG] [LOCAL ] BIP: Trimmed 57672 records to 38519 (keeping 200 days of data) [2025-10-27T17:34:32.241460] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-27T17:34:32.257832] [DEBUG] [LOCAL ] BIP: Primary data saved (38519 records). [2025-10-27T17:34:32.257928] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-27T17:34:32.257997] [INFO ] [MAIN ] Update Progress: 279/2366 symbols completed. BIP took 29.2s. Estimated remaining: 4h 17m 59s. Rate: 8.1 symbols/min [2025-10-27T17:34:32.414958] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-27T17:34:32.753670] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-27T17:34:33.214988] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-27T17:34:33.737453] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-27T17:34:34.014969] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-27T17:34:34.337089] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-27T17:34:34.814941] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-27T17:34:35.325175] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-27T17:34:35.614925] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-27T17:34:36.132508] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-27T17:34:36.414978] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-27T17:34:37.042428] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T17:34:37.043536] [INFO ] [REMOTE ] BIPH: Full fetch complete (3641 records). [2025-10-27T17:34:37.043617] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-27T17:34:37.395259] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-27T17:34:37.395332] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-27T17:34:37.395450] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-27T17:34:37.395486] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-27T17:34:37.395849] [DEBUG] [LOCAL ] BIPH: Trimmed 3641 records to 2251 (keeping 200 days of data) [2025-10-27T17:34:37.409185] [DEBUG] [LOCAL ] BIPH: Primary data saved (2251 records). [2025-10-27T17:34:37.409244] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-27T17:34:37.409308] [INFO ] [MAIN ] Update Progress: 280/2366 symbols completed. BIPH took 14.8s. Estimated remaining: 4h 17m 35s. Rate: 8.1 symbols/min [2025-10-27T17:34:38.108476] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:34:38.091972] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:34:38.125762] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:34:38.124981] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:34:38.134752] [DEBUG] [LOCAL ] BIPJ: Loaded 3116 existing records from primary storage. [2025-10-27T17:34:38.137560] [DEBUG] [LOCAL ] BIPI: Loaded 2842 existing records from primary storage. [2025-10-27T17:34:38.138357] [INFO ] [MAIN ] BIPI: Loaded 2842 existing records. [2025-10-27T17:34:38.138100] [INFO ] [MAIN ] BIPJ: Loaded 3116 existing records. [2025-10-27T17:34:38.384823] [DEBUG] [LOCAL ] BIT: Loaded 24068 existing records from primary storage. [2025-10-27T17:34:38.434315] [INFO ] [MAIN ] BIT: Loaded 24068 existing records. [2025-10-27T17:34:38.549967] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:34:38.594512] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-27T17:34:38.603417] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:34:38.603632] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-27T17:34:38.638674] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-27T17:34:38.638858] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-27T17:34:38.664730] [DEBUG] [LOCAL ] BIRK: Loaded 51897 existing records from primary storage. [2025-10-27T17:34:38.669940] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-27T17:34:38.692850] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-27T17:34:38.685808] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-27T17:34:38.693049] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-27T17:34:38.697478] [INFO ] [MAIN ] BIRK: Loaded 51897 existing records. [2025-10-27T17:34:39.093738] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:34:39.129986] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-27T17:34:39.130098] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-27T17:34:39.149746] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-27T17:34:39.220506] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-27T17:34:39.409231] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:34:39.552058] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-27T17:34:39.552226] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-27T17:34:39.629701] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-27T17:34:39.630155] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-27T17:34:40.060186] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:34:40.114692] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-27T17:34:40.176727] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:34:40.187698] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-27T17:34:40.422633] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:34:40.435282] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-27T17:34:40.544788] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:34:40.545156] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-27T17:34:40.650979] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-27T17:34:40.652279] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-27T17:34:40.858062] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-27T17:34:40.939927] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-27T17:34:41.214924] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-27T17:34:41.543186] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-27T17:34:41.772894] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-27T17:34:41.776765] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T17:34:42.014935] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-27T17:34:42.815007] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-27T17:34:43.429784] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-27T17:34:43.614917] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-27T17:34:43.662890] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T17:34:44.045460] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-27T17:34:44.414952] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-27T17:34:45.063728] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-27T17:34:45.214946] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-27T17:34:46.014989] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-27T17:34:46.411754] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-27T17:34:46.814967] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-27T17:34:46.908490] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T17:34:47.095818] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-27T17:34:47.614949] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-27T17:34:48.415005] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-27T17:34:49.214924] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-27T17:34:49.287515] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-27T17:34:49.342675] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-27T17:34:49.918330] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T17:34:50.014940] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-27T17:34:50.357385] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-27T17:34:50.814964] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-27T17:34:51.614915] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-27T17:34:52.162544] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-27T17:34:52.414909] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-27T17:34:52.635415] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T17:34:52.786540] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-27T17:34:53.214935] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-27T17:34:54.014914] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-27T17:34:54.336892] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T17:34:54.415338] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-27T17:34:54.814942] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-27T17:34:55.614995] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-27T17:34:55.863409] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-27T17:34:56.078258] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-27T17:34:56.414961] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-27T17:34:57.214988] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-27T17:34:57.870102] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-27T17:34:57.909382] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T17:34:58.014904] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-27T17:34:58.815045] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-27T17:34:59.155252] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-27T17:34:59.614964] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-27T17:34:59.662565] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T17:34:59.993017] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-27T17:35:00.414988] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-27T17:35:01.214967] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-27T17:35:02.014993] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-27T17:35:02.814965] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-27T17:35:03.666546] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (3.25 seconds). [2025-10-27T17:35:03.671822] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-27T17:35:03.802149] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T17:35:03.803213] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4129 records). [2025-10-27T17:35:03.803281] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-27T17:35:03.803747] [FATAL] [VALIDATOR ] BIPJ: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:35:03.803868] [FATAL] [MAIN ] BIPJ: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:35:03.803939] [WARN ] [MAIN ] BIPJ: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:35:03.804011] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-27T17:35:03.804072] [DEBUG] [LOCAL ] BIPJ: No primary data file found to delete. [2025-10-27T17:35:03.804107] [INFO ] [LOCAL ] BIPJ: Starting deletion of derivative data. [2025-10-27T17:35:03.804244] [DEBUG] [LOCAL ] BIPJ: Deleted derivative data file. [2025-10-27T17:35:03.804328] [INFO ] [MAIN ] Update Progress: 281/2366 symbols completed. BIPJ took 26.4s. Estimated remaining: 4h 19m 48s. Rate: 8.0 symbols/min [2025-10-27T17:35:03.979578] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:35:04.038212] [DEBUG] [LOCAL ] BJ: Loaded 52222 existing records from primary storage. [2025-10-27T17:35:04.038545] [INFO ] [MAIN ] BJ: Loaded 52222 existing records. [2025-10-27T17:35:04.148983] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (2.93 seconds). [2025-10-27T17:35:04.234665] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:35:04.234912] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-27T17:35:04.234966] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-27T17:35:04.235179] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-27T17:35:04.235223] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-27T17:35:04.418715] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-27T17:35:04.658297] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:35:04.928427] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-27T17:35:05.173671] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (3.16 seconds). [2025-10-27T17:35:05.214922] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-27T17:35:05.237086] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T17:35:06.014980] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-27T17:35:06.357141] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T17:35:06.358255] [INFO ] [REMOTE ] BIPI: Full fetch complete (4506 records). [2025-10-27T17:35:06.358326] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-27T17:35:06.797723] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-27T17:35:06.797842] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-27T17:35:06.798042] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-27T17:35:06.798086] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-27T17:35:06.798689] [DEBUG] [LOCAL ] BIPI: Trimmed 4506 records to 2727 (keeping 200 days of data) [2025-10-27T17:35:06.815777] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-27T17:35:06.818756] [DEBUG] [LOCAL ] BIPI: Primary data saved (2727 records). [2025-10-27T17:35:06.819942] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-27T17:35:06.820075] [INFO ] [MAIN ] Update Progress: 282/2366 symbols completed. BIPI took 29.4s. Estimated remaining: 4h 19m 8s. Rate: 8.0 symbols/min [2025-10-27T17:35:07.035629] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:35:07.093958] [DEBUG] [LOCAL ] BK: Loaded 54317 existing records from primary storage. [2025-10-27T17:35:07.094422] [INFO ] [MAIN ] BK: Loaded 54317 existing records. [2025-10-27T17:35:07.319251] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:35:07.319600] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-27T17:35:07.319679] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-27T17:35:07.320011] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-27T17:35:07.320070] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-27T17:35:07.618120] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-27T17:35:07.711407] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:35:08.414996] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-27T17:35:08.557820] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-27T17:35:09.207536] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-27T17:35:09.217201] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-27T17:35:09.397042] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-10-27T17:35:10.015028] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-27T17:35:10.263098] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-27T17:35:10.659487] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T17:35:10.665184] [INFO ] [REMOTE ] BIT: Full fetch complete (32438 records). [2025-10-27T17:35:10.665303] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-27T17:35:10.821065] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-27T17:35:11.076404] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-27T17:35:11.076487] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-27T17:35:11.076931] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-27T17:35:11.076993] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-27T17:35:11.077795] [DEBUG] [LOCAL ] BIT: Trimmed 32438 records to 23558 (keeping 200 days of data) [2025-10-27T17:35:11.217053] [DEBUG] [LOCAL ] BIT: Primary data saved (23558 records). [2025-10-27T17:35:11.217201] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-27T17:35:11.217308] [INFO ] [MAIN ] Update Progress: 283/2366 symbols completed. BIT took 33.8s. Estimated remaining: 4h 18m 38s. Rate: 8.1 symbols/min [2025-10-27T17:35:11.392470] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:35:11.436440] [DEBUG] [LOCAL ] BKD: Loaded 51079 existing records from primary storage. [2025-10-27T17:35:11.436926] [INFO ] [MAIN ] BKD: Loaded 51079 existing records. [2025-10-27T17:35:11.621099] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-27T17:35:11.626874] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:35:11.628074] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-27T17:35:11.628157] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-27T17:35:11.628721] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-27T17:35:11.628816] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-27T17:35:11.823460] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-27T17:35:12.050709] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:35:12.414973] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-27T17:35:12.863959] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-27T17:35:12.874247] [INFO ] [REMOTE ] BIRK: Full fetch complete (73461 records). [2025-10-27T17:35:12.874430] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-27T17:35:13.220255] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-27T17:35:13.277058] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-27T17:35:13.277139] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-27T17:35:13.277935] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-27T17:35:13.277998] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-27T17:35:13.279312] [DEBUG] [LOCAL ] BIRK: Trimmed 73461 records to 51082 (keeping 200 days of data) [2025-10-27T17:35:13.582949] [DEBUG] [LOCAL ] BIRK: Primary data saved (51082 records). [2025-10-27T17:35:13.583185] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-27T17:35:13.583284] [INFO ] [MAIN ] Update Progress: 284/2366 symbols completed. BIRK took 36.2s. Estimated remaining: 4h 17m 53s. Rate: 8.1 symbols/min [2025-10-27T17:35:13.767604] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:35:13.802776] [DEBUG] [LOCAL ] BKE: Loaded 34000 existing records from primary storage. [2025-10-27T17:35:13.803187] [INFO ] [MAIN ] BKE: Loaded 34000 existing records. [2025-10-27T17:35:13.986177] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-27T17:35:14.054209] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:35:14.056572] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T17:35:14.056987] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-27T17:35:14.068399] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-27T17:35:14.069283] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-27T17:35:14.069509] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-27T17:35:14.069551] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-27T17:35:14.455986] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:35:14.745605] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T17:35:14.814973] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-27T17:35:15.561837] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T17:35:15.615048] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-27T17:35:16.415030] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-27T17:35:16.747432] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T17:35:16.909310] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-27T17:35:17.214968] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-27T17:35:17.828495] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T17:35:18.014970] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-27T17:35:18.681065] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T17:35:18.814922] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-27T17:35:19.614967] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-27T17:35:19.921185] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-27T17:35:19.989781] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T17:35:20.414959] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-27T17:35:21.214918] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-27T17:35:21.276546] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-27T17:35:21.305168] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T17:35:22.014937] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-27T17:35:22.528384] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-27T17:35:22.814950] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-27T17:35:23.261670] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T17:35:23.614934] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-27T17:35:24.399120] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T17:35:24.414913] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-27T17:35:24.589353] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-27T17:35:25.214948] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-27T17:35:25.901662] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T17:35:26.014951] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-27T17:35:26.814930] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-27T17:35:26.867249] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T17:35:27.614961] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-27T17:35:27.965223] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-27T17:35:28.414915] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-27T17:35:28.662538] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-27T17:35:29.110404] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-27T17:35:29.214938] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-27T17:35:29.821114] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-27T17:35:30.014929] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-27T17:35:30.313668] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T17:35:30.814939] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-27T17:35:31.614958] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-27T17:35:31.854433] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-27T17:35:32.055175] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-27T17:35:32.414907] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-27T17:35:32.867686] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-27T17:35:33.214928] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-27T17:35:33.833945] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T17:35:34.014969] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-27T17:35:34.696999] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-27T17:35:34.710375] [INFO ] [REMOTE ] BJ: Full fetch complete (74386 records). [2025-10-27T17:35:34.710568] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-27T17:35:34.823724] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-27T17:35:35.124273] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-27T17:35:35.124363] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-27T17:35:35.125166] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-27T17:35:35.125234] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-27T17:35:35.126791] [DEBUG] [LOCAL ] BJ: Trimmed 74386 records to 51411 (keeping 200 days of data) [2025-10-27T17:35:35.434283] [DEBUG] [LOCAL ] BJ: Primary data saved (51411 records). [2025-10-27T17:35:35.434440] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-27T17:35:35.436880] [INFO ] [MAIN ] Update Progress: 285/2366 symbols completed. BJ took 31.6s. Estimated remaining: 4h 19m 31s. Rate: 8.0 symbols/min [2025-10-27T17:35:35.605592] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:35:35.614939] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-27T17:35:35.642999] [DEBUG] [LOCAL ] BKH: Loaded 37992 existing records from primary storage. [2025-10-27T17:35:35.643412] [INFO ] [MAIN ] BKH: Loaded 37992 existing records. [2025-10-27T17:35:35.829234] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-27T17:35:35.865778] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:35:35.867031] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-27T17:35:35.867140] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-27T17:35:35.867410] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-27T17:35:35.867466] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-27T17:35:36.221175] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:35:36.414944] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-27T17:35:36.523048] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-27T17:35:36.782236] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-27T17:35:36.792396] [INFO ] [REMOTE ] BK: Full fetch complete (77669 records). [2025-10-27T17:35:36.792528] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-27T17:35:37.180568] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-27T17:35:37.180669] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-27T17:35:37.181514] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-27T17:35:37.181577] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-27T17:35:37.182973] [DEBUG] [LOCAL ] BK: Trimmed 77669 records to 53535 (keeping 200 days of data) [2025-10-27T17:35:37.235850] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-27T17:35:37.505876] [DEBUG] [LOCAL ] BK: Primary data saved (53535 records). [2025-10-27T17:35:37.506031] [INFO ] [MAIN ] BK: Full history saved. [2025-10-27T17:35:37.506174] [INFO ] [MAIN ] Update Progress: 286/2366 symbols completed. BK took 30.7s. Estimated remaining: 4h 18m 44s. Rate: 8.0 symbols/min [2025-10-27T17:35:37.633891] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-27T17:35:37.711336] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:35:37.747679] [DEBUG] [LOCAL ] BKKT: Loaded 38106 existing records from primary storage. [2025-10-27T17:35:37.747989] [INFO ] [MAIN ] BKKT: Loaded 38106 existing records. [2025-10-27T17:35:37.919440] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:35:37.919661] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-27T17:35:37.919723] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-27T17:35:37.919902] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-27T17:35:37.919940] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-27T17:35:38.019309] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-27T17:35:38.269070] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:35:38.324511] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-27T17:35:38.814959] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-27T17:35:39.614940] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-27T17:35:39.824426] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-27T17:35:40.285673] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T17:35:40.414996] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-27T17:35:40.974823] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T17:35:41.214957] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-27T17:35:41.780244] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T17:35:42.014961] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-27T17:35:42.158894] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-27T17:35:42.165301] [INFO ] [REMOTE ] BKE: Full fetch complete (50041 records). [2025-10-27T17:35:42.165409] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-27T17:35:42.572629] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-27T17:35:42.572733] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-27T17:35:42.573301] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-27T17:35:42.573340] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-27T17:35:42.574363] [DEBUG] [LOCAL ] BKE: Trimmed 50041 records to 33221 (keeping 200 days of data) [2025-10-27T17:35:42.779922] [DEBUG] [LOCAL ] BKE: Primary data saved (33221 records). [2025-10-27T17:35:42.780053] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-27T17:35:42.780127] [INFO ] [MAIN ] Update Progress: 287/2366 symbols completed. BKE took 29.2s. Estimated remaining: 4h 18m 21s. Rate: 8.0 symbols/min [2025-10-27T17:35:42.821118] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-27T17:35:42.946180] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:35:42.955136] [DEBUG] [LOCAL ] BKN: Loaded 7384 existing records from primary storage. [2025-10-27T17:35:42.955413] [INFO ] [MAIN ] BKN: Loaded 7384 existing records. [2025-10-27T17:35:43.131075] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:35:43.131303] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-27T17:35:43.131356] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-27T17:35:43.131501] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-27T17:35:43.131538] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-27T17:35:43.487480] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:35:43.507373] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T17:35:43.614924] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-27T17:35:43.956836] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T17:35:44.414970] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-27T17:35:44.971804] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T17:35:45.028777] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-27T17:35:45.214932] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-27T17:35:45.625221] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-27T17:35:46.014935] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-27T17:35:46.473620] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-27T17:35:46.814939] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-27T17:35:47.614971] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-27T17:35:48.164570] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-27T17:35:48.414935] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-27T17:35:48.854009] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-27T17:35:49.214911] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-27T17:35:49.249766] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-27T17:35:49.682822] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-27T17:35:50.014933] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-27T17:35:50.777561] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-27T17:35:50.814914] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-27T17:35:51.614946] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-27T17:35:51.960135] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T17:35:52.414937] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-27T17:35:53.042272] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T17:35:53.052542] [INFO ] [REMOTE ] BKD: Full fetch complete (72099 records). [2025-10-27T17:35:53.052776] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-27T17:35:53.220238] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-27T17:35:53.474003] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-27T17:35:53.474096] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-27T17:35:53.475026] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-27T17:35:53.475104] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-27T17:35:53.476945] [DEBUG] [LOCAL ] BKD: Trimmed 72099 records to 50297 (keeping 200 days of data) [2025-10-27T17:35:53.780240] [DEBUG] [LOCAL ] BKD: Primary data saved (50297 records). [2025-10-27T17:35:53.780377] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-27T17:35:53.780456] [INFO ] [MAIN ] Update Progress: 288/2366 symbols completed. BKD took 42.6s. Estimated remaining: 4h 18m 39s. Rate: 8.0 symbols/min [2025-10-27T17:35:53.946779] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:35:53.990457] [DEBUG] [LOCAL ] BKSY: Loaded 49624 existing records from primary storage. [2025-10-27T17:35:53.990929] [INFO ] [MAIN ] BKSY: Loaded 49624 existing records. [2025-10-27T17:35:54.021004] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-27T17:35:54.115068] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T17:35:54.200908] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:35:54.201100] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-27T17:35:54.201145] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-27T17:35:54.201314] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-27T17:35:54.201352] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-27T17:35:54.503352] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-27T17:35:54.570498] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:35:54.591210] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T17:35:54.814915] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-27T17:35:55.614950] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-27T17:35:56.375241] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T17:35:56.414911] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-27T17:35:57.063574] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T17:35:57.214958] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-27T17:35:58.014932] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-27T17:35:58.092720] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T17:35:58.164906] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-27T17:35:58.814979] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-27T17:35:59.448420] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T17:35:59.615001] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-27T17:36:00.061611] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-27T17:36:00.414977] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-27T17:36:01.214944] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-27T17:36:01.831360] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-27T17:36:02.014936] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-27T17:36:02.814944] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-27T17:36:03.917948] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-10-27T17:36:03.920523] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-27T17:36:04.670120] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (4.26 seconds). [2025-10-27T17:36:04.680781] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-27T17:36:05.501042] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T17:36:05.502909] [INFO ] [REMOTE ] BKN: Full fetch complete (11095 records). [2025-10-27T17:36:05.502981] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-27T17:36:05.913193] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-27T17:36:05.913310] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-27T17:36:05.913710] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-27T17:36:05.913797] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-27T17:36:05.914582] [DEBUG] [LOCAL ] BKN: Trimmed 11095 records to 7164 (keeping 200 days of data) [2025-10-27T17:36:05.978200] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (3.16 seconds). [2025-10-27T17:36:05.998220] [DEBUG] [LOCAL ] BKN: Primary data saved (7164 records). [2025-10-27T17:36:05.998778] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-27T17:36:05.998890] [INFO ] [MAIN ] Update Progress: 289/2366 symbols completed. BKN took 23.2s. Estimated remaining: 4h 19m 5s. Rate: 8.0 symbols/min [2025-10-27T17:36:05.999209] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-27T17:36:06.192829] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:36:06.208840] [DEBUG] [LOCAL ] BKT: Loaded 12963 existing records from primary storage. [2025-10-27T17:36:06.209084] [INFO ] [MAIN ] BKT: Loaded 12963 existing records. [2025-10-27T17:36:06.416111] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:36:06.416484] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-27T17:36:06.416578] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-27T17:36:06.416920] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-27T17:36:06.417024] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-27T17:36:06.532753] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (4.52 seconds). [2025-10-27T17:36:06.608008] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-27T17:36:06.845878] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:36:06.846173] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-27T17:36:06.885619] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-27T17:36:07.165507] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T17:36:07.614918] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-27T17:36:07.657010] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T17:36:08.414964] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-27T17:36:08.549314] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-27T17:36:09.084177] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T17:36:09.215012] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-27T17:36:09.547465] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T17:36:09.555111] [INFO ] [REMOTE ] BKH: Full fetch complete (53060 records). [2025-10-27T17:36:09.555228] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-27T17:36:09.555927] [FATAL] [VALIDATOR ] BKH: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:36:09.556016] [FATAL] [MAIN ] BKH: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:36:09.556060] [WARN ] [MAIN ] BKH: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:36:09.556100] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-27T17:36:09.556156] [DEBUG] [LOCAL ] BKH: No primary data file found to delete. [2025-10-27T17:36:09.556191] [INFO ] [LOCAL ] BKH: Starting deletion of derivative data. [2025-10-27T17:36:09.556315] [DEBUG] [LOCAL ] BKH: Deleted derivative data file. [2025-10-27T17:36:09.556774] [INFO ] [MAIN ] Update Progress: 290/2366 symbols completed. BKH took 34.1s. Estimated remaining: 4h 18m 30s. Rate: 8.0 symbols/min [2025-10-27T17:36:09.760619] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:36:09.802588] [DEBUG] [LOCAL ] BKU: Loaded 42767 existing records from primary storage. [2025-10-27T17:36:09.802914] [INFO ] [MAIN ] BKU: Loaded 42767 existing records. [2025-10-27T17:36:10.006552] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:36:10.006819] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-27T17:36:10.006890] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-27T17:36:10.007150] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-27T17:36:10.007217] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-27T17:36:10.020080] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-27T17:36:10.366556] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:36:10.623454] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T17:36:10.814949] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-27T17:36:11.614958] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-27T17:36:11.796818] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T17:36:12.238298] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-27T17:36:12.248071] [INFO ] [REMOTE ] BKKT: Full fetch complete (52381 records). [2025-10-27T17:36:12.248180] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-27T17:36:12.425456] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-27T17:36:12.665845] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-27T17:36:12.665940] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-27T17:36:12.666539] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-27T17:36:12.666583] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-27T17:36:12.667618] [DEBUG] [LOCAL ] BKKT: Trimmed 52381 records to 37775 (keeping 200 days of data) [2025-10-27T17:36:12.881105] [DEBUG] [LOCAL ] BKKT: Primary data saved (37775 records). [2025-10-27T17:36:12.881234] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-27T17:36:12.881311] [INFO ] [MAIN ] Update Progress: 291/2366 symbols completed. BKKT took 35.4s. Estimated remaining: 4h 17m 53s. Rate: 8.0 symbols/min [2025-10-27T17:36:13.045303] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:36:13.072710] [DEBUG] [LOCAL ] BKV: Loaded 29719 existing records from primary storage. [2025-10-27T17:36:13.072954] [INFO ] [MAIN ] BKV: Loaded 29719 existing records. [2025-10-27T17:36:13.220430] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-27T17:36:13.250158] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:36:13.250438] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-27T17:36:13.250490] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-27T17:36:13.250791] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-27T17:36:13.250849] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-27T17:36:13.609726] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:36:13.650086] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-27T17:36:13.718385] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-27T17:36:13.861900] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T17:36:14.014954] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-27T17:36:14.433866] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-27T17:36:14.814979] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-27T17:36:15.592707] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-27T17:36:15.614909] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-27T17:36:16.389342] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-27T17:36:16.414899] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-27T17:36:17.214926] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-27T17:36:17.222774] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-27T17:36:18.014984] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-27T17:36:18.263299] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-27T17:36:18.814941] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-27T17:36:19.614915] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-27T17:36:19.694209] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T17:36:19.913421] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-27T17:36:20.414946] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-27T17:36:20.813839] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T17:36:21.214911] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-27T17:36:21.288148] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T17:36:22.014932] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-27T17:36:22.039069] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T17:36:22.804005] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T17:36:22.814912] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-27T17:36:23.614909] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-27T17:36:23.690224] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-27T17:36:24.414929] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-27T17:36:24.526112] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-27T17:36:25.214953] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-27T17:36:25.898299] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-27T17:36:25.902549] [INFO ] [REMOTE ] BKT: Full fetch complete (16805 records). [2025-10-27T17:36:25.902618] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-27T17:36:26.020151] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-27T17:36:26.276000] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-27T17:36:26.276176] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-27T17:36:26.276670] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-27T17:36:26.276761] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-27T17:36:26.277727] [DEBUG] [LOCAL ] BKT: Trimmed 16805 records to 12719 (keeping 200 days of data) [2025-10-27T17:36:26.360076] [DEBUG] [LOCAL ] BKT: Primary data saved (12719 records). [2025-10-27T17:36:26.360332] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-27T17:36:26.360434] [INFO ] [MAIN ] Update Progress: 292/2366 symbols completed. BKT took 20.4s. Estimated remaining: 4h 18m 28s. Rate: 8.0 symbols/min [2025-10-27T17:36:26.524117] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-27T17:36:26.604715] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:36:26.639592] [DEBUG] [LOCAL ] BLCO: Loaded 35220 existing records from primary storage. [2025-10-27T17:36:26.639909] [INFO ] [MAIN ] BLCO: Loaded 35220 existing records. [2025-10-27T17:36:26.815713] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-27T17:36:26.827952] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:36:26.828204] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-27T17:36:26.828252] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-27T17:36:26.828462] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-27T17:36:26.828519] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-27T17:36:27.193885] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:36:27.362285] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T17:36:27.614936] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-27T17:36:27.834014] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-27T17:36:28.414939] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-27T17:36:28.688447] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-27T17:36:29.214953] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-27T17:36:29.838180] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T17:36:30.014910] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-27T17:36:30.045936] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-27T17:36:30.814970] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-27T17:36:31.198971] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T17:36:31.614973] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-27T17:36:31.735114] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-27T17:36:32.414939] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-27T17:36:33.214954] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-27T17:36:33.702167] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-27T17:36:33.712213] [INFO ] [REMOTE ] BKSY: Full fetch complete (70741 records). [2025-10-27T17:36:33.712345] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-27T17:36:33.832959] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T17:36:34.023024] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-27T17:36:34.132386] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-27T17:36:34.132508] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-27T17:36:34.133313] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-27T17:36:34.133393] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-27T17:36:34.135002] [DEBUG] [LOCAL ] BKSY: Trimmed 70741 records to 48907 (keeping 200 days of data) [2025-10-27T17:36:34.356555] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T17:36:34.447598] [DEBUG] [LOCAL ] BKSY: Primary data saved (48907 records). [2025-10-27T17:36:34.447757] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-27T17:36:34.447840] [INFO ] [MAIN ] Update Progress: 293/2366 symbols completed. BKSY took 40.7s. Estimated remaining: 4h 18m 25s. Rate: 8.0 symbols/min [2025-10-27T17:36:34.617506] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:36:34.648704] [DEBUG] [LOCAL ] BLD: Loaded 27346 existing records from primary storage. [2025-10-27T17:36:34.649040] [INFO ] [MAIN ] BLD: Loaded 27346 existing records. [2025-10-27T17:36:34.827637] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-27T17:36:34.832739] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:36:34.833861] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-27T17:36:34.833915] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-27T17:36:34.834077] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-27T17:36:34.834116] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-27T17:36:35.196457] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:36:35.280089] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-27T17:36:35.614989] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-27T17:36:36.215059] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-27T17:36:36.414949] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-27T17:36:36.480754] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T17:36:37.214979] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-27T17:36:37.394279] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-27T17:36:38.014942] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-27T17:36:38.344253] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T17:36:38.797518] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T17:36:38.814903] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-27T17:36:39.614936] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-27T17:36:40.097004] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T17:36:40.414918] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-27T17:36:40.940506] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T17:36:41.214950] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-27T17:36:41.439177] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-27T17:36:42.014970] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-27T17:36:42.335885] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-27T17:36:42.341995] [INFO ] [REMOTE ] BKV: Full fetch complete (44860 records). [2025-10-27T17:36:42.342091] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-27T17:36:42.728535] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-27T17:36:42.728622] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-27T17:36:42.729169] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-27T17:36:42.729223] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-27T17:36:42.730139] [DEBUG] [LOCAL ] BKV: Trimmed 44860 records to 29033 (keeping 200 days of data) [2025-10-27T17:36:42.816355] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-27T17:36:42.896436] [DEBUG] [LOCAL ] BKV: Primary data saved (29033 records). [2025-10-27T17:36:42.896554] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-27T17:36:42.896626] [INFO ] [MAIN ] Update Progress: 294/2366 symbols completed. BKV took 30.0s. Estimated remaining: 4h 18m 24s. Rate: 8.0 symbols/min [2025-10-27T17:36:43.066914] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:36:43.114283] [DEBUG] [LOCAL ] BLDR: Loaded 52578 existing records from primary storage. [2025-10-27T17:36:43.114630] [INFO ] [MAIN ] BLDR: Loaded 52578 existing records. [2025-10-27T17:36:43.290831] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:36:43.291205] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-27T17:36:43.291417] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-27T17:36:43.291956] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-27T17:36:43.292047] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-27T17:36:43.419111] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T17:36:43.620014] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-27T17:36:43.675204] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:36:44.139296] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T17:36:44.414995] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-27T17:36:44.619450] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T17:36:45.212499] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-27T17:36:45.215202] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-27T17:36:46.015001] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-27T17:36:46.299691] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T17:36:46.814993] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-27T17:36:47.214505] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T17:36:47.614952] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-27T17:36:48.255305] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T17:36:48.404679] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-27T17:36:48.414894] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-27T17:36:49.214909] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-27T17:36:49.235835] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-27T17:36:50.014926] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-27T17:36:50.215996] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-27T17:36:50.814994] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-27T17:36:51.614917] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-27T17:36:51.671285] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T17:36:51.722024] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T17:36:51.730966] [INFO ] [REMOTE ] BKU: Full fetch complete (61197 records). [2025-10-27T17:36:51.731076] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-27T17:36:52.105057] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-27T17:36:52.105135] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-27T17:36:52.105816] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-27T17:36:52.105879] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-27T17:36:52.107186] [DEBUG] [LOCAL ] BKU: Trimmed 61197 records to 42038 (keeping 200 days of data) [2025-10-27T17:36:52.353623] [DEBUG] [LOCAL ] BKU: Primary data saved (42038 records). [2025-10-27T17:36:52.353766] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-27T17:36:52.354458] [INFO ] [MAIN ] Update Progress: 295/2366 symbols completed. BKU took 42.8s. Estimated remaining: 4h 18m 31s. Rate: 8.0 symbols/min [2025-10-27T17:36:52.420118] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-27T17:36:52.522890] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:36:52.538553] [DEBUG] [LOCAL ] BLE: Loaded 13757 existing records from primary storage. [2025-10-27T17:36:52.538796] [INFO ] [MAIN ] BLE: Loaded 13757 existing records. [2025-10-27T17:36:52.716893] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:36:52.717134] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-27T17:36:52.717202] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-27T17:36:52.717398] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-27T17:36:52.717453] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-27T17:36:53.062912] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:36:53.214920] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-27T17:36:53.527999] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-27T17:36:53.533837] [INFO ] [REMOTE ] BLCO: Full fetch complete (52121 records). [2025-10-27T17:36:53.533928] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-27T17:36:53.913389] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-27T17:36:53.913482] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-27T17:36:53.914151] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-27T17:36:53.914240] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-27T17:36:53.915424] [DEBUG] [LOCAL ] BLCO: Trimmed 52121 records to 34457 (keeping 200 days of data) [2025-10-27T17:36:54.015232] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-27T17:36:54.119199] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-27T17:36:54.158497] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T17:36:54.185894] [DEBUG] [LOCAL ] BLCO: Primary data saved (34457 records). [2025-10-27T17:36:54.186006] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-27T17:36:54.186102] [INFO ] [MAIN ] Update Progress: 296/2366 symbols completed. BLCO took 27.8s. Estimated remaining: 4h 17m 44s. Rate: 8.0 symbols/min [2025-10-27T17:36:54.360537] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:36:54.394528] [DEBUG] [LOCAL ] BLK: Loaded 34575 existing records from primary storage. [2025-10-27T17:36:54.394818] [INFO ] [MAIN ] BLK: Loaded 34575 existing records. [2025-10-27T17:36:54.570859] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:36:54.571017] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-27T17:36:54.571063] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-27T17:36:54.571487] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-27T17:36:54.571524] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-27T17:36:54.819503] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-27T17:36:54.925962] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:36:55.218973] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-27T17:36:55.223513] [INFO ] [REMOTE ] BLD: Full fetch complete (39776 records). [2025-10-27T17:36:55.223592] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-27T17:36:55.587974] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-27T17:36:55.588044] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-27T17:36:55.588534] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-27T17:36:55.588573] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-27T17:36:55.589371] [DEBUG] [LOCAL ] BLD: Trimmed 39776 records to 26648 (keeping 200 days of data) [2025-10-27T17:36:55.638060] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-27T17:36:55.747492] [DEBUG] [LOCAL ] BLD: Primary data saved (26648 records). [2025-10-27T17:36:55.748027] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-27T17:36:55.748143] [INFO ] [MAIN ] Update Progress: 297/2366 symbols completed. BLD took 21.3s. Estimated remaining: 4h 16m 55s. Rate: 8.1 symbols/min [2025-10-27T17:36:55.919275] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:36:55.960019] [DEBUG] [LOCAL ] BLND: Loaded 49966 existing records from primary storage. [2025-10-27T17:36:55.960304] [INFO ] [MAIN ] BLND: Loaded 49966 existing records. [2025-10-27T17:36:56.141301] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:36:56.141763] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-27T17:36:56.141919] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-27T17:36:56.148042] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-27T17:36:56.148152] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-27T17:36:56.191755] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-27T17:36:56.425195] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-27T17:36:56.541539] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:36:56.608034] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-27T17:36:57.215012] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-27T17:36:58.014951] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-27T17:36:58.285517] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T17:36:58.457589] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T17:36:58.814935] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-27T17:36:59.620020] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-27T17:36:59.635504] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T17:37:00.304364] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-27T17:37:00.414918] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-27T17:37:01.029600] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T17:37:01.214945] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-27T17:37:02.015009] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-27T17:37:02.815005] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-27T17:37:04.174735] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (3.76 seconds). [2025-10-27T17:37:04.185556] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-27T17:37:04.221127] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (3.01 seconds). [2025-10-27T17:37:04.414950] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-27T17:37:05.373854] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-10-27T17:37:05.377069] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-27T17:37:05.862164] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (3.85 seconds). [2025-10-27T17:37:06.014919] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-27T17:37:06.160239] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-27T17:37:06.297594] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-27T17:37:06.590976] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-27T17:37:06.814951] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-27T17:37:07.334461] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T17:37:07.614939] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-27T17:37:08.049698] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T17:37:08.414913] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-27T17:37:08.537004] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-27T17:37:09.214947] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-27T17:37:09.960754] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-27T17:37:10.014927] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-27T17:37:10.096590] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-27T17:37:10.814935] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-27T17:37:11.508545] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T17:37:11.614936] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-27T17:37:12.257512] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T17:37:12.414953] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-27T17:37:13.015146] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T17:37:13.214971] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-27T17:37:13.639898] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-27T17:37:14.014984] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-27T17:37:14.675480] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T17:37:14.814912] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-27T17:37:15.426948] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T17:37:15.614937] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-27T17:37:16.372263] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T17:37:16.414931] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-27T17:37:17.169516] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T17:37:17.214914] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-27T17:37:17.585468] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T17:37:18.014950] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-27T17:37:18.608308] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T17:37:18.618103] [INFO ] [REMOTE ] BLDR: Full fetch complete (74774 records). [2025-10-27T17:37:18.618248] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-27T17:37:18.825104] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-27T17:37:19.015380] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-27T17:37:19.015481] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-27T17:37:19.016454] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-27T17:37:19.016535] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-27T17:37:19.018150] [DEBUG] [LOCAL ] BLDR: Trimmed 74774 records to 51805 (keeping 200 days of data) [2025-10-27T17:37:19.333007] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-27T17:37:19.359094] [DEBUG] [LOCAL ] BLDR: Primary data saved (51805 records). [2025-10-27T17:37:19.359242] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-27T17:37:19.359343] [INFO ] [MAIN ] Update Progress: 298/2366 symbols completed. BLDR took 36.5s. Estimated remaining: 4h 18m 40s. Rate: 8.0 symbols/min [2025-10-27T17:37:19.536399] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:37:19.536570] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-27T17:37:19.536625] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-27T17:37:19.536765] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-27T17:37:19.536808] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-27T17:37:19.536850] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-27T17:37:19.536883] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-27T17:37:19.620022] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-27T17:37:19.894418] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:37:20.162248] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-27T17:37:20.172048] [INFO ] [REMOTE ] BLND: Full fetch complete (72204 records). [2025-10-27T17:37:20.172174] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-27T17:37:20.415636] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-10-27T17:37:20.487043] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-27T17:37:20.586606] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-27T17:37:20.586726] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-27T17:37:20.587573] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-27T17:37:20.587637] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-27T17:37:20.589139] [DEBUG] [LOCAL ] BLND: Trimmed 72204 records to 49191 (keeping 200 days of data) [2025-10-27T17:37:20.857429] [DEBUG] [LOCAL ] BLND: Primary data saved (49191 records). [2025-10-27T17:37:20.857577] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-27T17:37:20.857683] [INFO ] [MAIN ] Update Progress: 299/2366 symbols completed. BLND took 25.1s. Estimated remaining: 4h 17m 51s. Rate: 8.0 symbols/min [2025-10-27T17:37:20.889586] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:37:20.927860] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-10-27T17:37:20.938758] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:37:20.949784] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-27T17:37:20.958111] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:37:20.960567] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-27T17:37:20.960704] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-27T17:37:20.961068] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-27T17:37:20.976760] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-27T17:37:20.981994] [INFO ] [MAIN ] Update Progress: 300/2366 symbols completed. BLSH took 1.6s. Estimated remaining: 4h 16m 52s. Rate: 8.0 symbols/min [2025-10-27T17:37:21.110722] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:37:21.214911] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:37:21.220529] [DEBUG] [LOCAL ] BLW: Loaded 13127 existing records from primary storage. [2025-10-27T17:37:21.220132] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-27T17:37:21.222004] [INFO ] [MAIN ] BLW: Loaded 13127 existing records. [2025-10-27T17:37:21.400104] [DEBUG] [LOCAL ] BLX: Loaded 15597 existing records from primary storage. [2025-10-27T17:37:21.421702] [INFO ] [MAIN ] BLX: Loaded 15597 existing records. [2025-10-27T17:37:21.421566] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:37:21.495148] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-27T17:37:21.510747] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-27T17:37:21.521246] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-27T17:37:21.531801] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-27T17:37:21.702224] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:37:21.702471] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-27T17:37:21.702550] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-27T17:37:21.708332] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-27T17:37:21.713529] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-27T17:37:22.024537] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-27T17:37:22.167939] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-27T17:37:22.263559] [INFO ] [REMOTE ] BLE: Full fetch complete (19543 records). [2025-10-27T17:37:22.309949] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:37:22.320679] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-27T17:37:22.451385] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:37:22.733052] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-27T17:37:22.733124] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-27T17:37:22.733465] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-27T17:37:22.733503] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-27T17:37:22.734043] [DEBUG] [LOCAL ] BLE: Trimmed 19543 records to 13448 (keeping 200 days of data) [2025-10-27T17:37:22.811052] [DEBUG] [LOCAL ] BLE: Primary data saved (13448 records). [2025-10-27T17:37:22.811182] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-27T17:37:22.811260] [INFO ] [MAIN ] Update Progress: 301/2366 symbols completed. BLE took 30.5s. Estimated remaining: 4h 16m 6s. Rate: 8.1 symbols/min [2025-10-27T17:37:22.822707] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-27T17:37:22.979093] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:37:23.011862] [DEBUG] [LOCAL ] BMA: Loaded 37210 existing records from primary storage. [2025-10-27T17:37:23.012133] [INFO ] [MAIN ] BMA: Loaded 37210 existing records. [2025-10-27T17:37:23.187469] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:37:23.187746] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-27T17:37:23.187798] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-27T17:37:23.188142] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-27T17:37:23.188198] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-27T17:37:23.535071] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:37:23.614915] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-27T17:37:23.659849] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T17:37:23.758612] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-27T17:37:24.284680] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-27T17:37:24.414971] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-27T17:37:25.062289] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T17:37:25.214930] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-27T17:37:26.014998] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-27T17:37:26.814946] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-27T17:37:26.867766] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T17:37:26.871221] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T17:37:27.614938] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-27T17:37:27.820685] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T17:37:28.165290] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-27T17:37:28.414963] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-27T17:37:29.062974] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-27T17:37:29.214977] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-27T17:37:30.014996] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-27T17:37:30.146668] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-27T17:37:30.814917] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-27T17:37:31.165476] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T17:37:31.466706] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-27T17:37:31.614939] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-27T17:37:32.414926] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-27T17:37:32.971930] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T17:37:33.214935] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-27T17:37:33.827086] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T17:37:34.014930] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-27T17:37:34.626405] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T17:37:34.814904] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-27T17:37:35.192472] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-27T17:37:35.614954] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-27T17:37:36.215765] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T17:37:36.333893] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T17:37:36.414902] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-27T17:37:37.132630] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-27T17:37:37.214896] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-27T17:37:37.850431] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-27T17:37:38.014991] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-27T17:37:38.814957] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-27T17:37:39.497494] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-27T17:37:39.614954] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-27T17:37:40.414944] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-27T17:37:40.817298] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-27T17:37:41.214903] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-27T17:37:41.231686] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-27T17:37:41.234895] [INFO ] [REMOTE ] BLX: Full fetch complete (22366 records). [2025-10-27T17:37:41.234966] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-27T17:37:41.574048] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-10-27T17:37:41.629463] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-27T17:37:41.629545] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-27T17:37:41.630005] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-27T17:37:41.630068] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-27T17:37:41.630760] [DEBUG] [LOCAL ] BLX: Trimmed 22366 records to 14966 (keeping 200 days of data) [2025-10-27T17:37:41.727798] [DEBUG] [LOCAL ] BLX: Primary data saved (14966 records). [2025-10-27T17:37:41.727940] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-27T17:37:41.728020] [INFO ] [MAIN ] Update Progress: 302/2366 symbols completed. BLX took 20.7s. Estimated remaining: 4h 17m 17s. Rate: 8.0 symbols/min [2025-10-27T17:37:41.920931] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:37:41.933076] [DEBUG] [LOCAL ] BME: Loaded 11345 existing records from primary storage. [2025-10-27T17:37:41.933330] [INFO ] [MAIN ] BME: Loaded 11345 existing records. [2025-10-27T17:37:42.023416] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-27T17:37:42.110485] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:37:42.110715] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-27T17:37:42.110781] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-27T17:37:42.110948] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-27T17:37:42.111002] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-27T17:37:42.480464] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:37:42.824933] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-27T17:37:42.827201] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-27T17:37:42.834713] [INFO ] [REMOTE ] BLK: Full fetch complete (52786 records). [2025-10-27T17:37:42.834844] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-27T17:37:43.232000] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-27T17:37:43.232142] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-27T17:37:43.232821] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-27T17:37:43.232903] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-27T17:37:43.234067] [DEBUG] [LOCAL ] BLK: Trimmed 52786 records to 33685 (keeping 200 days of data) [2025-10-27T17:37:43.365837] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-27T17:37:43.481907] [DEBUG] [LOCAL ] BLK: Primary data saved (33685 records). [2025-10-27T17:37:43.482023] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-27T17:37:43.482093] [INFO ] [MAIN ] Update Progress: 303/2366 symbols completed. BLK took 49.3s. Estimated remaining: 4h 16m 31s. Rate: 8.0 symbols/min [2025-10-27T17:37:43.624763] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-27T17:37:43.650287] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:37:43.660735] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T17:37:43.686672] [DEBUG] [LOCAL ] BMEZ: Loaded 25339 existing records from primary storage. [2025-10-27T17:37:43.686927] [INFO ] [MAIN ] BMEZ: Loaded 25339 existing records. [2025-10-27T17:37:43.863875] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:37:43.864057] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-27T17:37:43.864102] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-27T17:37:43.864289] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-27T17:37:43.864343] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-27T17:37:44.210252] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:37:44.402714] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T17:37:44.414901] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-27T17:37:45.026184] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T17:37:45.214962] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-27T17:37:46.014939] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-27T17:37:46.352745] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T17:37:46.814920] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-27T17:37:47.250433] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-27T17:37:47.336456] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-27T17:37:47.614932] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-27T17:37:48.414950] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-27T17:37:48.723117] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T17:37:49.214973] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-27T17:37:49.515940] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T17:37:49.754181] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-27T17:37:50.015097] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-27T17:37:50.556406] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-27T17:37:50.814939] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-27T17:37:51.614970] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-27T17:37:51.628185] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-27T17:37:52.248007] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-27T17:37:52.415008] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-27T17:37:53.214979] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-27T17:37:53.824159] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-27T17:37:53.832815] [INFO ] [REMOTE ] BMA: Full fetch complete (52574 records). [2025-10-27T17:37:53.832992] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-27T17:37:54.020983] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-27T17:37:54.219454] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-27T17:37:54.219558] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-27T17:37:54.220312] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-27T17:37:54.220391] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-27T17:37:54.221674] [DEBUG] [LOCAL ] BMA: Trimmed 52574 records to 36661 (keeping 200 days of data) [2025-10-27T17:37:54.240758] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-27T17:37:54.466714] [DEBUG] [LOCAL ] BMA: Primary data saved (36661 records). [2025-10-27T17:37:54.466874] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-27T17:37:54.466956] [INFO ] [MAIN ] Update Progress: 304/2366 symbols completed. BMA took 31.7s. Estimated remaining: 4h 16m 47s. Rate: 8.0 symbols/min [2025-10-27T17:37:54.634523] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:37:54.659702] [DEBUG] [LOCAL ] BMI: Loaded 25241 existing records from primary storage. [2025-10-27T17:37:54.659974] [INFO ] [MAIN ] BMI: Loaded 25241 existing records. [2025-10-27T17:37:54.816857] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-27T17:37:54.842406] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:37:54.842669] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-27T17:37:54.842732] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-27T17:37:54.843034] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-27T17:37:54.843075] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-27T17:37:55.004452] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T17:37:55.262448] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:37:55.614972] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-27T17:37:56.164381] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T17:37:56.414985] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-27T17:37:56.759743] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T17:37:57.214947] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-27T17:37:57.238149] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T17:37:58.014927] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-27T17:37:58.343089] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T17:37:58.507940] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-27T17:37:58.814957] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-27T17:37:59.614951] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-27T17:37:59.925847] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-27T17:38:00.415023] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-27T17:38:00.987841] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T17:38:01.214960] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-27T17:38:02.015045] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-27T17:38:02.814989] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-27T17:38:03.340997] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (2.93 seconds). [2025-10-27T17:38:03.614982] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-27T17:38:04.067944] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-27T17:38:04.226628] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (3.01 seconds). [2025-10-27T17:38:04.231529] [INFO ] [REMOTE ] BLW: Full fetch complete (19150 records). [2025-10-27T17:38:04.231710] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-27T17:38:04.420157] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-27T17:38:04.595545] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-27T17:38:04.595620] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-27T17:38:04.595996] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-27T17:38:04.596049] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-27T17:38:04.596558] [DEBUG] [LOCAL ] BLW: Trimmed 19150 records to 12668 (keeping 200 days of data) [2025-10-27T17:38:04.672760] [DEBUG] [LOCAL ] BLW: Primary data saved (12668 records). [2025-10-27T17:38:04.672996] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-27T17:38:04.673093] [INFO ] [MAIN ] Update Progress: 305/2366 symbols completed. BLW took 43.8s. Estimated remaining: 4h 16m 58s. Rate: 8.0 symbols/min [2025-10-27T17:38:04.853052] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:38:04.862412] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-27T17:38:04.870989] [DEBUG] [LOCAL ] BMN: Loaded 2676 existing records from primary storage. [2025-10-27T17:38:04.871160] [INFO ] [MAIN ] BMN: Loaded 2676 existing records. [2025-10-27T17:38:05.041501] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:38:05.041731] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-27T17:38:05.041784] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-27T17:38:05.041910] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-27T17:38:05.041947] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-27T17:38:05.224113] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-27T17:38:05.388138] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:38:05.453264] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-27T17:38:05.610758] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-27T17:38:06.014949] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-27T17:38:06.663062] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-27T17:38:06.815011] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-27T17:38:07.186049] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-27T17:38:07.614942] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-27T17:38:07.941113] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T17:38:08.395180] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T17:38:08.414908] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-27T17:38:09.214961] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-27T17:38:09.393916] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T17:38:10.014945] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-27T17:38:10.232618] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T17:38:10.235288] [INFO ] [REMOTE ] BME: Full fetch complete (15573 records). [2025-10-27T17:38:10.235356] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-27T17:38:10.593390] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-27T17:38:10.593461] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-27T17:38:10.593783] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-27T17:38:10.593844] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-27T17:38:10.594327] [DEBUG] [LOCAL ] BME: Trimmed 15573 records to 11046 (keeping 200 days of data) [2025-10-27T17:38:10.645007] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-27T17:38:10.664060] [DEBUG] [LOCAL ] BME: Primary data saved (11046 records). [2025-10-27T17:38:10.664149] [INFO ] [MAIN ] BME: Full history saved. [2025-10-27T17:38:10.664219] [INFO ] [MAIN ] Update Progress: 306/2366 symbols completed. BME took 28.9s. Estimated remaining: 4h 16m 41s. Rate: 8.0 symbols/min [2025-10-27T17:38:10.827460] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-27T17:38:10.830971] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:38:10.868912] [DEBUG] [LOCAL ] BMO: Loaded 41424 existing records from primary storage. [2025-10-27T17:38:10.869194] [INFO ] [MAIN ] BMO: Loaded 41424 existing records. [2025-10-27T17:38:11.049215] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:38:11.049428] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-27T17:38:11.049473] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-27T17:38:11.049773] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-27T17:38:11.049830] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-27T17:38:11.400162] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:38:11.614952] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-27T17:38:11.727288] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-27T17:38:12.414951] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-27T17:38:13.214959] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-27T17:38:13.342589] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T17:38:13.536057] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-27T17:38:13.672177] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-27T17:38:14.014925] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-27T17:38:14.814954] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-27T17:38:15.345257] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T17:38:15.614965] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-27T17:38:15.965122] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T17:38:15.970393] [INFO ] [REMOTE ] BMEZ: Full fetch complete (39067 records). [2025-10-27T17:38:15.970535] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-27T17:38:16.353137] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-27T17:38:16.353213] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-27T17:38:16.353755] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-27T17:38:16.353819] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-27T17:38:16.354676] [DEBUG] [LOCAL ] BMEZ: Trimmed 39067 records to 24659 (keeping 200 days of data) [2025-10-27T17:38:16.441159] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-27T17:38:16.503852] [DEBUG] [LOCAL ] BMEZ: Primary data saved (24659 records). [2025-10-27T17:38:16.503987] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-27T17:38:16.504068] [INFO ] [MAIN ] Update Progress: 307/2366 symbols completed. BMEZ took 33.0s. Estimated remaining: 4h 16m 22s. Rate: 8.0 symbols/min [2025-10-27T17:38:16.672299] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:38:16.724800] [DEBUG] [LOCAL ] BMY: Loaded 54537 existing records from primary storage. [2025-10-27T17:38:16.725106] [INFO ] [MAIN ] BMY: Loaded 54537 existing records. [2025-10-27T17:38:16.933701] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:38:16.934061] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-27T17:38:16.934285] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-27T17:38:16.934499] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-27T17:38:16.936283] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-27T17:38:16.936363] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-27T17:38:17.229107] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-27T17:38:17.249837] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T17:38:17.333888] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:38:17.637072] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-27T17:38:18.014942] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-27T17:38:18.814998] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-27T17:38:19.017466] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T17:38:19.022910] [INFO ] [REMOTE ] BMI: Full fetch complete (34176 records). [2025-10-27T17:38:19.022994] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-27T17:38:19.304076] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-27T17:38:19.386831] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-27T17:38:19.386894] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-27T17:38:19.387337] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-27T17:38:19.387397] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-27T17:38:19.388124] [DEBUG] [LOCAL ] BMI: Trimmed 34176 records to 24626 (keeping 200 days of data) [2025-10-27T17:38:19.533430] [DEBUG] [LOCAL ] BMI: Primary data saved (24626 records). [2025-10-27T17:38:19.533552] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-27T17:38:19.533625] [INFO ] [MAIN ] Update Progress: 308/2366 symbols completed. BMI took 25.1s. Estimated remaining: 4h 15m 45s. Rate: 8.0 symbols/min [2025-10-27T17:38:19.620154] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-27T17:38:19.705169] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:38:19.752598] [DEBUG] [LOCAL ] BN: Loaded 53759 existing records from primary storage. [2025-10-27T17:38:19.752941] [INFO ] [MAIN ] BN: Loaded 53759 existing records. [2025-10-27T17:38:19.923856] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:38:19.924078] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-27T17:38:19.924134] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-27T17:38:19.924421] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-27T17:38:19.924476] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-27T17:38:20.266729] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:38:20.414919] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-27T17:38:20.855608] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T17:38:21.214981] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-27T17:38:21.881231] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T17:38:22.014973] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-27T17:38:22.814983] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-27T17:38:22.900609] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T17:38:23.270636] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-27T17:38:23.614960] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-27T17:38:24.351118] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-27T17:38:24.414962] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-27T17:38:24.756194] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-27T17:38:24.942833] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-27T17:38:25.214915] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-27T17:38:25.603310] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-27T17:38:26.014932] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-27T17:38:26.377905] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-27T17:38:26.814943] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-27T17:38:27.614930] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-27T17:38:28.044597] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T17:38:28.414979] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-27T17:38:28.521835] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T17:38:29.214926] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-27T17:38:29.804031] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-27T17:38:30.014917] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-27T17:38:30.233844] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-27T17:38:30.814939] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-27T17:38:31.323674] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T17:38:31.324763] [INFO ] [REMOTE ] BMN: Full fetch complete (3718 records). [2025-10-27T17:38:31.324831] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-27T17:38:31.620051] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-27T17:38:31.683167] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-27T17:38:31.683387] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-27T17:38:31.683600] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-27T17:38:31.683707] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-27T17:38:31.684087] [DEBUG] [LOCAL ] BMN: Trimmed 3718 records to 2612 (keeping 200 days of data) [2025-10-27T17:38:31.701253] [DEBUG] [LOCAL ] BMN: Primary data saved (2612 records). [2025-10-27T17:38:31.701331] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-27T17:38:31.701412] [INFO ] [MAIN ] Update Progress: 309/2366 symbols completed. BMN took 27.0s. Estimated remaining: 4h 16m 9s. Rate: 8.0 symbols/min [2025-10-27T17:38:31.877802] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:38:31.903335] [DEBUG] [LOCAL ] BNED: Loaded 28526 existing records from primary storage. [2025-10-27T17:38:31.903584] [INFO ] [MAIN ] BNED: Loaded 28526 existing records. [2025-10-27T17:38:32.099079] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:38:32.112762] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-27T17:38:32.117943] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-27T17:38:32.131928] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-27T17:38:32.134822] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-27T17:38:32.200619] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-27T17:38:32.420755] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-27T17:38:32.503723] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:38:33.214945] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-27T17:38:34.014967] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-27T17:38:34.041833] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-27T17:38:34.132953] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-27T17:38:34.820330] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-27T17:38:34.822234] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T17:38:35.614968] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-27T17:38:35.661688] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T17:38:36.415004] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-27T17:38:36.675218] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-27T17:38:37.175944] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-27T17:38:37.214897] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-27T17:38:37.959721] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T17:38:38.014918] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-27T17:38:38.389842] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-27T17:38:38.397337] [INFO ] [REMOTE ] BMO: Full fetch complete (59745 records). [2025-10-27T17:38:38.397442] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-27T17:38:38.773119] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-27T17:38:38.773192] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-27T17:38:38.773858] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-27T17:38:38.773919] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-27T17:38:38.775062] [DEBUG] [LOCAL ] BMO: Trimmed 59745 records to 40521 (keeping 200 days of data) [2025-10-27T17:38:38.828404] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-27T17:38:39.020561] [DEBUG] [LOCAL ] BMO: Primary data saved (40521 records). [2025-10-27T17:38:39.020713] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-27T17:38:39.020798] [INFO ] [MAIN ] Update Progress: 310/2366 symbols completed. BMO took 28.4s. Estimated remaining: 4h 16m 1s. Rate: 8.0 symbols/min [2025-10-27T17:38:39.188507] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:38:39.194501] [DEBUG] [LOCAL ] BNH: Loaded 4742 existing records from primary storage. [2025-10-27T17:38:39.194693] [INFO ] [MAIN ] BNH: Loaded 4742 existing records. [2025-10-27T17:38:39.369478] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:38:39.369689] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-27T17:38:39.369746] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-27T17:38:39.369882] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-27T17:38:39.369920] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-27T17:38:39.617097] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-27T17:38:39.727304] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:38:39.870452] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-27T17:38:40.414946] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-27T17:38:40.511826] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T17:38:40.579783] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-27T17:38:41.214947] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-27T17:38:41.706356] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-27T17:38:42.014966] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-27T17:38:42.331109] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-27T17:38:42.417636] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-27T17:38:42.814969] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-27T17:38:43.614950] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-27T17:38:44.415011] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-27T17:38:44.732003] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-27T17:38:45.050110] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T17:38:45.214973] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-27T17:38:45.999622] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-27T17:38:46.014906] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-27T17:38:46.814916] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-27T17:38:47.169966] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-27T17:38:47.300673] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-27T17:38:47.614945] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-27T17:38:47.740426] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T17:38:48.027446] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-27T17:38:48.415011] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-27T17:38:49.214973] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-27T17:38:49.579898] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-27T17:38:49.772701] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T17:38:50.014964] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-27T17:38:50.814950] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-27T17:38:51.419457] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T17:38:51.614949] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-27T17:38:51.779540] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-27T17:38:52.335763] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T17:38:52.414963] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-27T17:38:53.214959] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-27T17:38:54.015025] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-27T17:38:54.156885] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-27T17:38:54.169285] [INFO ] [REMOTE ] BMY: Full fetch complete (77937 records). [2025-10-27T17:38:54.169520] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-27T17:38:54.599868] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-27T17:38:54.645922] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T17:38:54.651719] [INFO ] [REMOTE ] BN: Full fetch complete (76951 records). [2025-10-27T17:38:54.674167] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-27T17:38:54.822262] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-27T17:38:54.816190] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-27T17:38:54.838380] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-27T17:38:54.844930] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-27T17:38:54.856426] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-27T17:38:54.917189] [DEBUG] [LOCAL ] BMY: Trimmed 77937 records to 53757 (keeping 200 days of data) [2025-10-27T17:38:55.255472] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-27T17:38:55.257320] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-27T17:38:55.262457] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-27T17:38:55.265613] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-27T17:38:55.265686] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-27T17:38:55.286497] [DEBUG] [LOCAL ] BN: Trimmed 76951 records to 52973 (keeping 200 days of data) [2025-10-27T17:38:55.618292] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-27T17:38:55.726954] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-10-27T17:38:55.729757] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-27T17:38:55.733538] [INFO ] [MAIN ] Update Progress: 311/2366 symbols completed. BMY took 39.2s. Estimated remaining: 4h 16m 54s. Rate: 8.0 symbols/min [2025-10-27T17:38:55.981184] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:38:55.996278] [DEBUG] [LOCAL ] BN: Primary data saved (52973 records). [2025-10-27T17:38:55.996691] [INFO ] [MAIN ] BN: Full history saved. [2025-10-27T17:38:55.997109] [INFO ] [MAIN ] Update Progress: 312/2366 symbols completed. BN took 36.5s. Estimated remaining: 4h 15m 59s. Rate: 8.0 symbols/min [2025-10-27T17:38:56.082889] [DEBUG] [LOCAL ] BNJ: Loaded 2516 existing records from primary storage. [2025-10-27T17:38:56.104990] [INFO ] [MAIN ] BNJ: Loaded 2516 existing records. [2025-10-27T17:38:56.310340] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:38:56.334710] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T17:38:56.353875] [INFO ] [REMOTE ] BNH: Full fetch complete (6864 records). [2025-10-27T17:38:56.376078] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-27T17:38:56.381214] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:38:56.387417] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-27T17:38:56.393864] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-27T17:38:56.431743] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-27T17:38:56.426217] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-27T17:38:56.432057] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-27T17:38:56.735809] [DEBUG] [LOCAL ] BNL: Loaded 47664 existing records from primary storage. [2025-10-27T17:38:56.816475] [INFO ] [MAIN ] BNL: Loaded 47664 existing records. [2025-10-27T17:38:57.413978] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:38:57.419554] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:38:57.420021] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-27T17:38:57.420595] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-27T17:38:57.420224] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-27T17:38:57.420748] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-27T17:38:57.421721] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-27T17:38:57.422014] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-27T17:38:57.422059] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-27T17:38:57.423048] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-27T17:38:57.423261] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-27T17:38:57.423191] [DEBUG] [LOCAL ] BNH: Trimmed 6864 records to 4511 (keeping 200 days of data) [2025-10-27T17:38:57.562682] [DEBUG] [LOCAL ] BNH: Primary data saved (4511 records). [2025-10-27T17:38:57.568411] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-27T17:38:57.568543] [INFO ] [MAIN ] Update Progress: 313/2366 symbols completed. BNH took 18.5s. Estimated remaining: 4h 15m 13s. Rate: 8.0 symbols/min [2025-10-27T17:38:57.907349] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:38:58.017535] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:38:58.037923] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-27T17:38:58.045398] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-27T17:38:58.048763] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-27T17:38:58.091813] [DEBUG] [LOCAL ] BNS: Loaded 52124 existing records from primary storage. [2025-10-27T17:38:58.092130] [INFO ] [MAIN ] BNS: Loaded 52124 existing records. [2025-10-27T17:38:58.265631] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:38:58.265850] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-27T17:38:58.265897] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-27T17:38:58.266071] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-27T17:38:58.266108] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-27T17:38:58.555678] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-27T17:38:58.627297] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:38:58.814982] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-27T17:38:59.614941] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-27T17:39:00.323962] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T17:39:00.414914] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-27T17:39:01.214990] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-27T17:39:01.358195] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T17:39:02.014948] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-27T17:39:02.814986] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-27T17:39:03.314836] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T17:39:03.614971] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-27T17:39:04.049964] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (3.64 seconds). [2025-10-27T17:39:04.166345] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T17:39:04.276142] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-27T17:39:04.414906] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-27T17:39:04.929584] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (3.71 seconds). [2025-10-27T17:39:05.215039] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-27T17:39:05.610676] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T17:39:06.014973] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-27T17:39:06.420770] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-27T17:39:06.585868] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-27T17:39:06.814969] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-27T17:39:07.615000] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-27T17:39:08.203494] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-27T17:39:08.360677] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T17:39:08.414895] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-27T17:39:09.214945] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-27T17:39:09.524920] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-27T17:39:09.740530] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T17:39:10.015000] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-27T17:39:10.814961] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-27T17:39:10.882565] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-27T17:39:11.614945] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-27T17:39:12.120504] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T17:39:12.419992] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-27T17:39:12.428572] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T17:39:12.923184] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-27T17:39:13.214939] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-27T17:39:14.014996] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-27T17:39:14.513391] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T17:39:14.814955] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-27T17:39:15.125501] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-27T17:39:15.504880] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T17:39:15.614915] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-27T17:39:16.414962] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-27T17:39:17.049236] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T17:39:17.204668] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T17:39:17.208962] [INFO ] [REMOTE ] BNED: Full fetch complete (41504 records). [2025-10-27T17:39:17.209048] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-27T17:39:17.220199] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-27T17:39:17.590969] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-27T17:39:17.591044] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-27T17:39:17.591539] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-27T17:39:17.591578] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-27T17:39:17.592418] [DEBUG] [LOCAL ] BNED: Trimmed 41504 records to 27853 (keeping 200 days of data) [2025-10-27T17:39:17.745810] [DEBUG] [LOCAL ] BNED: Primary data saved (27853 records). [2025-10-27T17:39:17.745932] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-27T17:39:17.746027] [INFO ] [MAIN ] Update Progress: 314/2366 symbols completed. BNED took 46.0s. Estimated remaining: 4h 16m 29s. Rate: 8.0 symbols/min [2025-10-27T17:39:17.913823] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:39:17.920109] [DEBUG] [LOCAL ] BNT: Loaded 3567 existing records from primary storage. [2025-10-27T17:39:17.920278] [INFO ] [MAIN ] BNT: Loaded 3567 existing records. [2025-10-27T17:39:18.018285] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-27T17:39:18.098914] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:39:18.099108] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-27T17:39:18.099181] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-27T17:39:18.099301] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-27T17:39:18.099342] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-27T17:39:18.456209] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:39:18.629733] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T17:39:18.630820] [INFO ] [REMOTE ] BNJ: Full fetch complete (3866 records). [2025-10-27T17:39:18.630887] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-27T17:39:18.817327] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-27T17:39:18.833282] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-27T17:39:19.033063] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-27T17:39:19.033140] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-27T17:39:19.033272] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-27T17:39:19.033311] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-27T17:39:19.033668] [DEBUG] [LOCAL ] BNJ: Trimmed 3866 records to 2407 (keeping 200 days of data) [2025-10-27T17:39:19.047882] [DEBUG] [LOCAL ] BNJ: Primary data saved (2407 records). [2025-10-27T17:39:19.047941] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-27T17:39:19.048005] [INFO ] [MAIN ] Update Progress: 315/2366 symbols completed. BNJ took 23.3s. Estimated remaining: 4h 15m 41s. Rate: 8.0 symbols/min [2025-10-27T17:39:19.225135] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:39:19.233898] [DEBUG] [LOCAL ] BNY: Loaded 7303 existing records from primary storage. [2025-10-27T17:39:19.234097] [INFO ] [MAIN ] BNY: Loaded 7303 existing records. [2025-10-27T17:39:19.410085] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:39:19.410263] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-27T17:39:19.410309] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-27T17:39:19.410484] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-27T17:39:19.410527] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-27T17:39:19.620087] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-27T17:39:19.767328] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:39:20.090194] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T17:39:20.414922] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-27T17:39:20.730542] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-27T17:39:21.069284] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T17:39:21.214924] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-27T17:39:22.014939] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-27T17:39:22.814925] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-27T17:39:22.893576] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-27T17:39:23.298399] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-27T17:39:23.564434] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-27T17:39:23.614953] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-27T17:39:23.962137] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-27T17:39:24.414927] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-27T17:39:25.078089] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-27T17:39:25.214919] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-27T17:39:26.014979] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-27T17:39:26.696844] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T17:39:26.816971] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-27T17:39:26.820828] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-27T17:39:27.433732] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T17:39:27.615150] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-27T17:39:28.415001] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-27T17:39:28.831302] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-27T17:39:29.046491] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-27T17:39:29.214980] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-27T17:39:29.898808] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-27T17:39:30.014965] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-27T17:39:30.314940] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-27T17:39:30.814994] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-27T17:39:31.614914] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-27T17:39:31.826438] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-27T17:39:32.219055] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-27T17:39:32.414918] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-27T17:39:32.843493] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-27T17:39:33.214922] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-27T17:39:33.560926] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-27T17:39:34.014952] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-27T17:39:34.523422] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-27T17:39:34.814938] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-27T17:39:35.591066] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-27T17:39:35.614902] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-27T17:39:36.335162] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-27T17:39:36.414941] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-27T17:39:37.214943] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-27T17:39:37.736189] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T17:39:37.746345] [INFO ] [REMOTE ] BNL: Full fetch complete (67241 records). [2025-10-27T17:39:37.746556] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-27T17:39:38.020709] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-27T17:39:38.164519] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-27T17:39:38.164640] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-27T17:39:38.165713] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-27T17:39:38.165780] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-27T17:39:38.167753] [DEBUG] [LOCAL ] BNL: Trimmed 67241 records to 46837 (keeping 200 days of data) [2025-10-27T17:39:38.473637] [DEBUG] [LOCAL ] BNL: Primary data saved (46837 records). [2025-10-27T17:39:38.474130] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-27T17:39:38.474321] [INFO ] [MAIN ] Update Progress: 316/2366 symbols completed. BNL took 42.5s. Estimated remaining: 4h 16m 51s. Rate: 8.0 symbols/min [2025-10-27T17:39:38.597556] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-27T17:39:38.677244] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:39:38.701781] [DEBUG] [LOCAL ] BOC: Loaded 18411 existing records from primary storage. [2025-10-27T17:39:38.702198] [INFO ] [MAIN ] BOC: Loaded 18411 existing records. [2025-10-27T17:39:38.823897] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-27T17:39:38.944220] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:39:38.944548] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-27T17:39:38.944601] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-27T17:39:38.944897] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-27T17:39:38.944956] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-27T17:39:39.380109] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-27T17:39:39.404208] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:39:39.405247] [INFO ] [REMOTE ] BNS: Full fetch complete (74560 records). [2025-10-27T17:39:39.405446] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-27T17:39:39.537828] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-27T17:39:39.573172] [INFO ] [REMOTE ] BNY: Full fetch complete (10378 records). [2025-10-27T17:39:39.588503] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-27T17:39:39.625175] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-27T17:39:40.078510] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-27T17:39:40.090213] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-27T17:39:40.099457] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-27T17:39:40.102010] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-27T17:39:40.185231] [DEBUG] [LOCAL ] BNS: Trimmed 74560 records to 51296 (keeping 200 days of data) [2025-10-27T17:39:40.185480] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-27T17:39:40.185881] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-27T17:39:40.186082] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-27T17:39:40.186163] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-27T17:39:40.187797] [DEBUG] [LOCAL ] BNY: Trimmed 10378 records to 7109 (keeping 200 days of data) [2025-10-27T17:39:40.318768] [DEBUG] [LOCAL ] BNY: Primary data saved (7109 records). [2025-10-27T17:39:40.326695] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-27T17:39:40.329101] [INFO ] [MAIN ] Update Progress: 317/2366 symbols completed. BNY took 21.3s. Estimated remaining: 4h 16m 7s. Rate: 8.0 symbols/min [2025-10-27T17:39:40.416544] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-27T17:39:40.563045] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-27T17:39:40.574769] [DEBUG] [LOCAL ] BNS: Primary data saved (51296 records). [2025-10-27T17:39:40.574896] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-27T17:39:40.574981] [INFO ] [MAIN ] Update Progress: 318/2366 symbols completed. BNS took 43.0s. Estimated remaining: 4h 15m 12s. Rate: 8.0 symbols/min [2025-10-27T17:39:41.019303] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T17:39:41.214983] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-27T17:39:41.818048] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-27T17:39:42.014955] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-27T17:39:42.814940] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-27T17:39:42.845466] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-27T17:39:43.524843] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-27T17:39:43.527058] [INFO ] [REMOTE ] BNT: Full fetch complete (4847 records). [2025-10-27T17:39:43.527147] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-27T17:39:43.621695] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-27T17:39:43.906962] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-27T17:39:43.907034] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-27T17:39:43.907154] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-27T17:39:43.907215] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-27T17:39:43.907575] [DEBUG] [LOCAL ] BNT: Trimmed 4847 records to 3318 (keeping 200 days of data) [2025-10-27T17:39:43.926789] [DEBUG] [LOCAL ] BNT: Primary data saved (3318 records). [2025-10-27T17:39:43.926849] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-27T17:39:43.926912] [INFO ] [MAIN ] Update Progress: 319/2366 symbols completed. BNT took 26.2s. Estimated remaining: 4h 14m 38s. Rate: 8.0 symbols/min [2025-10-27T17:39:44.371416] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T17:39:44.414923] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-27T17:39:45.510520] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-27T17:39:45.515705] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-27T17:39:46.113164] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-27T17:39:46.116868] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-27T17:39:46.980805] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-27T17:39:46.986897] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-27T17:39:47.644772] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T17:39:47.651847] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-27T17:39:48.638897] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T17:39:48.643844] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-27T17:39:49.252188] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-27T17:39:49.256460] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-27T17:39:50.350376] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T17:39:50.353993] [INFO ] [REMOTE ] BOC: Full fetch complete (25644 records). [2025-10-27T17:39:50.354119] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-27T17:39:50.354573] [FATAL] [VALIDATOR ] BOC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:39:50.354683] [FATAL] [MAIN ] BOC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:39:50.354736] [WARN ] [MAIN ] BOC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:39:50.354801] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-27T17:39:50.354863] [DEBUG] [LOCAL ] BOC: No primary data file found to delete. [2025-10-27T17:39:50.354899] [INFO ] [LOCAL ] BOC: Starting deletion of derivative data. [2025-10-27T17:39:50.355041] [DEBUG] [LOCAL ] BOC: Deleted derivative data file. [2025-10-27T17:39:50.355128] [INFO ] [MAIN ] Update Progress: 320/2366 symbols completed. BOC took 11.9s. Estimated remaining: 4h 14m 24s. Rate: 8.0 symbols/min [2025-10-27T17:39:51.045526] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:39:51.101100] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:39:51.057339] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:39:51.102370] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:39:51.162409] [DEBUG] [LOCAL ] BOE: Loaded 18258 existing records from primary storage. [2025-10-27T17:39:51.163090] [DEBUG] [LOCAL ] BOND: Loaded 32905 existing records from primary storage. [2025-10-27T17:39:51.173025] [INFO ] [MAIN ] BOND: Loaded 32905 existing records. [2025-10-27T17:39:51.173598] [DEBUG] [LOCAL ] BOH: Loaded 31145 existing records from primary storage. [2025-10-27T17:39:51.184509] [INFO ] [MAIN ] BOH: Loaded 31145 existing records. [2025-10-27T17:39:51.218878] [INFO ] [MAIN ] BOE: Loaded 18258 existing records. [2025-10-27T17:39:51.353448] [DEBUG] [LOCAL ] BOOT: Loaded 39928 existing records from primary storage. [2025-10-27T17:39:51.435690] [INFO ] [MAIN ] BOOT: Loaded 39928 existing records. [2025-10-27T17:39:51.679287] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:39:51.843497] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:39:51.853977] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-27T17:39:51.862749] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:39:51.872080] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-27T17:39:51.872260] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-27T17:39:51.872449] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-27T17:39:51.878124] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-27T17:39:51.888804] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-27T17:39:51.883619] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-27T17:39:51.888952] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-27T17:39:51.899370] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-27T17:39:51.918139] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-27T17:39:51.918386] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-27T17:39:51.918223] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-27T17:39:52.038304] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:39:52.152431] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-27T17:39:52.253249] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-27T17:39:52.275900] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-27T17:39:52.417820] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-27T17:39:53.069721] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:39:53.089525] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:39:53.105621] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-27T17:39:53.129581] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-27T17:39:53.270464] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:39:53.313987] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-27T17:39:53.416710] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:39:53.416933] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-27T17:39:53.997804] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T17:39:54.002203] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-27T17:39:54.265583] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T17:39:54.273099] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-27T17:39:54.604142] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T17:39:54.624991] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T17:39:54.646250] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-27T17:39:54.814907] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-27T17:39:55.066490] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T17:39:55.614964] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-27T17:39:55.864174] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-27T17:39:56.414985] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-27T17:39:56.893609] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-27T17:39:57.214932] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-27T17:39:57.764970] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-27T17:39:57.970116] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T17:39:58.014966] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-27T17:39:58.703000] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-27T17:39:58.814911] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-27T17:39:59.614922] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-27T17:40:00.264508] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-27T17:40:00.414982] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-27T17:40:01.129870] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T17:40:01.214904] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-27T17:40:02.014953] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-27T17:40:02.814998] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-27T17:40:03.206778] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T17:40:03.298607] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (2.88 seconds). [2025-10-27T17:40:03.614935] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-27T17:40:03.715515] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-27T17:40:04.414947] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-27T17:40:04.931430] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-27T17:40:05.214985] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-27T17:40:05.314934] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T17:40:05.658759] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T17:40:06.014946] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-27T17:40:06.688498] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T17:40:06.814978] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-27T17:40:07.188682] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T17:40:07.517900] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-27T17:40:07.614963] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-27T17:40:08.414941] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-27T17:40:08.987239] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T17:40:09.214947] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-27T17:40:09.827979] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-27T17:40:10.013288] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-27T17:40:10.018737] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-27T17:40:10.641477] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-27T17:40:10.814948] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-27T17:40:11.614941] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-27T17:40:11.693436] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T17:40:12.414950] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-27T17:40:12.915044] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-27T17:40:13.214981] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-27T17:40:13.448944] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T17:40:14.014940] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-27T17:40:14.386583] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-27T17:40:14.391150] [INFO ] [REMOTE ] BOE: Full fetch complete (26717 records). [2025-10-27T17:40:14.391280] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-27T17:40:14.773688] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-27T17:40:14.773783] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-27T17:40:14.774191] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-27T17:40:14.774253] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-27T17:40:14.774954] [DEBUG] [LOCAL ] BOE: Trimmed 26717 records to 17571 (keeping 200 days of data) [2025-10-27T17:40:14.820006] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-27T17:40:14.884994] [DEBUG] [LOCAL ] BOE: Primary data saved (17571 records). [2025-10-27T17:40:14.885158] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-27T17:40:14.885295] [INFO ] [MAIN ] Update Progress: 321/2366 symbols completed. BOE took 24.5s. Estimated remaining: 4h 16m 6s. Rate: 8.0 symbols/min [2025-10-27T17:40:15.060258] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:40:15.079373] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T17:40:15.128433] [DEBUG] [LOCAL ] BORR: Loaded 51836 existing records from primary storage. [2025-10-27T17:40:15.128752] [INFO ] [MAIN ] BORR: Loaded 51836 existing records. [2025-10-27T17:40:15.303326] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:40:15.303546] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-27T17:40:15.303601] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-27T17:40:15.303854] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-27T17:40:15.303922] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-27T17:40:15.623296] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-27T17:40:15.654500] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:40:16.303308] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T17:40:16.414940] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-27T17:40:16.857676] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-27T17:40:17.214992] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-27T17:40:18.014992] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-27T17:40:18.334684] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-27T17:40:18.341163] [INFO ] [REMOTE ] BOH: Full fetch complete (45513 records). [2025-10-27T17:40:18.341248] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-27T17:40:18.713745] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-27T17:40:18.713826] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-27T17:40:18.714426] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-27T17:40:18.714466] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-27T17:40:18.715385] [DEBUG] [LOCAL ] BOH: Trimmed 45513 records to 30475 (keeping 200 days of data) [2025-10-27T17:40:18.816708] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-27T17:40:18.917968] [DEBUG] [LOCAL ] BOH: Primary data saved (30475 records). [2025-10-27T17:40:18.918408] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-27T17:40:18.918619] [INFO ] [MAIN ] Update Progress: 322/2366 symbols completed. BOH took 28.6s. Estimated remaining: 4h 15m 36s. Rate: 8.0 symbols/min [2025-10-27T17:40:19.087154] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:40:19.109061] [DEBUG] [LOCAL ] BOW: Loaded 23072 existing records from primary storage. [2025-10-27T17:40:19.109313] [INFO ] [MAIN ] BOW: Loaded 23072 existing records. [2025-10-27T17:40:19.292809] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:40:19.293033] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-27T17:40:19.293083] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-27T17:40:19.293246] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-27T17:40:19.293285] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-27T17:40:19.655192] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:40:19.673186] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-27T17:40:19.675847] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T17:40:19.713525] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (3.30 seconds). [2025-10-27T17:40:20.414973] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-27T17:40:20.607773] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-27T17:40:20.624992] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-27T17:40:21.214934] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-27T17:40:21.453735] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-27T17:40:22.014970] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-27T17:40:22.072054] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T17:40:22.814997] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-27T17:40:23.614916] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-27T17:40:23.735574] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-27T17:40:23.821487] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-27T17:40:24.414940] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-27T17:40:24.694717] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T17:40:24.702335] [INFO ] [REMOTE ] BOND: Full fetch complete (46631 records). [2025-10-27T17:40:24.702443] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-27T17:40:25.139180] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-27T17:40:25.139253] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-27T17:40:25.139881] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-27T17:40:25.139945] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-27T17:40:25.141069] [DEBUG] [LOCAL ] BOND: Trimmed 46631 records to 32267 (keeping 200 days of data) [2025-10-27T17:40:25.232917] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-27T17:40:25.348890] [DEBUG] [LOCAL ] BOND: Primary data saved (32267 records). [2025-10-27T17:40:25.349058] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-27T17:40:25.349155] [INFO ] [MAIN ] Update Progress: 323/2366 symbols completed. BOND took 35.0s. Estimated remaining: 4h 15m 22s. Rate: 8.0 symbols/min [2025-10-27T17:40:25.520265] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:40:25.571442] [DEBUG] [LOCAL ] BOX: Loaded 50788 existing records from primary storage. [2025-10-27T17:40:25.571802] [INFO ] [MAIN ] BOX: Loaded 50788 existing records. [2025-10-27T17:40:25.737566] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T17:40:25.782129] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:40:25.782548] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-27T17:40:25.782309] [INFO ] [REMOTE ] BOOT: Full fetch complete (59757 records). [2025-10-27T17:40:25.782754] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-27T17:40:25.782855] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-27T17:40:25.783140] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-27T17:40:25.783222] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-27T17:40:26.021076] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-27T17:40:26.489840] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:40:26.584372] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-27T17:40:26.584510] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-27T17:40:26.585297] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-27T17:40:26.585376] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-27T17:40:26.604284] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T17:40:26.610893] [DEBUG] [LOCAL ] BOOT: Trimmed 59757 records to 39109 (keeping 200 days of data) [2025-10-27T17:40:26.815152] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-27T17:40:26.847418] [DEBUG] [LOCAL ] BOOT: Primary data saved (39109 records). [2025-10-27T17:40:26.847574] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-27T17:40:26.847681] [INFO ] [MAIN ] Update Progress: 324/2366 symbols completed. BOOT took 36.5s. Estimated remaining: 4h 14m 36s. Rate: 8.0 symbols/min [2025-10-27T17:40:27.013800] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:40:27.061292] [DEBUG] [LOCAL ] BP: Loaded 54486 existing records from primary storage. [2025-10-27T17:40:27.061611] [INFO ] [MAIN ] BP: Loaded 54486 existing records. [2025-10-27T17:40:27.236294] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:40:27.236541] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-27T17:40:27.236586] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-27T17:40:27.236863] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-27T17:40:27.236920] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-27T17:40:27.611598] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:40:27.614901] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-27T17:40:27.673515] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-27T17:40:27.932226] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T17:40:28.415023] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-27T17:40:29.214934] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-27T17:40:29.352799] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T17:40:29.653475] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T17:40:30.014934] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-27T17:40:30.571321] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T17:40:30.814951] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-27T17:40:31.527720] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T17:40:31.614897] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-27T17:40:32.414918] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-27T17:40:32.536911] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T17:40:33.214927] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-27T17:40:33.378268] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-27T17:40:33.573867] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-27T17:40:34.015021] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-27T17:40:34.088274] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-27T17:40:34.815018] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-27T17:40:35.299081] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T17:40:35.478144] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-27T17:40:35.614933] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-27T17:40:36.317454] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-27T17:40:36.414926] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-27T17:40:37.220168] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-27T17:40:37.222999] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-27T17:40:38.014971] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-27T17:40:38.814920] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-27T17:40:39.260370] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-27T17:40:39.395167] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T17:40:39.614949] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-27T17:40:40.213581] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T17:40:40.367347] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-27T17:40:40.414979] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-27T17:40:41.214946] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-27T17:40:41.901302] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T17:40:42.014955] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-27T17:40:42.815020] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-27T17:40:43.021164] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-27T17:40:43.174681] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-27T17:40:43.614966] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-27T17:40:44.414960] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-27T17:40:44.519815] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-27T17:40:44.525078] [INFO ] [REMOTE ] BOW: Full fetch complete (32109 records). [2025-10-27T17:40:44.525172] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-27T17:40:44.929317] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-27T17:40:44.929472] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-27T17:40:44.930038] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-27T17:40:44.930114] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-27T17:40:44.931124] [DEBUG] [LOCAL ] BOW: Trimmed 32109 records to 22536 (keeping 200 days of data) [2025-10-27T17:40:45.095006] [DEBUG] [LOCAL ] BOW: Primary data saved (22536 records). [2025-10-27T17:40:45.095938] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-27T17:40:45.098919] [INFO ] [MAIN ] Update Progress: 325/2366 symbols completed. BOW took 26.2s. Estimated remaining: 4h 15m 37s. Rate: 8.0 symbols/min [2025-10-27T17:40:45.098748] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-27T17:40:45.220030] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-27T17:40:45.285074] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:40:45.318303] [DEBUG] [LOCAL ] BR: Loaded 35008 existing records from primary storage. [2025-10-27T17:40:45.318572] [INFO ] [MAIN ] BR: Loaded 35008 existing records. [2025-10-27T17:40:45.490934] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:40:45.491147] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-27T17:40:45.491193] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-27T17:40:45.491542] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-27T17:40:45.491598] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-27T17:40:45.859052] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:40:45.924085] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T17:40:46.014903] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-27T17:40:46.814953] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-27T17:40:47.326596] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-27T17:40:47.614965] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-27T17:40:47.844399] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-27T17:40:48.001918] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-27T17:40:48.414958] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-27T17:40:49.137579] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T17:40:49.214907] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-27T17:40:49.647873] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T17:40:50.014991] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-27T17:40:50.814914] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-27T17:40:51.323111] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-27T17:40:51.448253] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T17:40:51.614947] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-27T17:40:52.067118] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T17:40:52.414993] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-27T17:40:52.862259] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T17:40:53.214966] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-27T17:40:53.908546] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-27T17:40:53.918289] [INFO ] [REMOTE ] BOX: Full fetch complete (72303 records). [2025-10-27T17:40:53.918417] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-27T17:40:54.019253] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-27T17:40:54.313162] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-27T17:40:54.313249] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-27T17:40:54.314046] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-27T17:40:54.314109] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-27T17:40:54.315499] [DEBUG] [LOCAL ] BOX: Trimmed 72303 records to 49989 (keeping 200 days of data) [2025-10-27T17:40:54.598694] [DEBUG] [LOCAL ] BOX: Primary data saved (49989 records). [2025-10-27T17:40:54.598916] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-27T17:40:54.599019] [INFO ] [MAIN ] Update Progress: 326/2366 symbols completed. BOX took 29.2s. Estimated remaining: 4h 15m 41s. Rate: 8.0 symbols/min [2025-10-27T17:40:54.800422] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T17:40:54.802800] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:40:54.814898] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-27T17:40:54.861916] [DEBUG] [LOCAL ] BRBR: Loaded 52567 existing records from primary storage. [2025-10-27T17:40:54.862214] [INFO ] [MAIN ] BRBR: Loaded 52567 existing records. [2025-10-27T17:40:55.056626] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:40:55.056853] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-27T17:40:55.056900] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-27T17:40:55.057082] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-27T17:40:55.057120] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-27T17:40:55.409920] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:40:55.465209] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-27T17:40:55.614978] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-27T17:40:56.414957] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-27T17:40:56.697925] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-27T17:40:56.707971] [INFO ] [REMOTE ] BORR: Full fetch complete (74544 records). [2025-10-27T17:40:56.708163] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-27T17:40:57.104722] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-27T17:40:57.104839] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-27T17:40:57.105786] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-27T17:40:57.105968] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-27T17:40:57.107483] [DEBUG] [LOCAL ] BORR: Trimmed 74544 records to 51047 (keeping 200 days of data) [2025-10-27T17:40:57.219591] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-27T17:40:57.340040] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-27T17:40:57.434962] [DEBUG] [LOCAL ] BORR: Primary data saved (51047 records). [2025-10-27T17:40:57.435108] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-27T17:40:57.436310] [INFO ] [MAIN ] Update Progress: 327/2366 symbols completed. BORR took 42.6s. Estimated remaining: 4h 15m 5s. Rate: 8.0 symbols/min [2025-10-27T17:40:57.615413] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:40:57.633843] [DEBUG] [LOCAL ] BRC: Loaded 18498 existing records from primary storage. [2025-10-27T17:40:57.634081] [INFO ] [MAIN ] BRC: Loaded 18498 existing records. [2025-10-27T17:40:57.811509] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:40:57.811751] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-27T17:40:57.811804] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-27T17:40:57.811969] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-27T17:40:57.812008] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-27T17:40:58.025757] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-27T17:40:58.203076] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:40:58.231441] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-27T17:40:58.814931] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-27T17:40:58.992703] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-27T17:40:59.373334] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T17:40:59.615385] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-27T17:40:59.616075] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T17:41:00.414971] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-27T17:41:01.214967] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-27T17:41:02.014924] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-27T17:41:02.082179] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-27T17:41:02.814983] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-27T17:41:03.337534] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-27T17:41:03.614991] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-27T17:41:04.587948] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-27T17:41:04.594092] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-27T17:41:04.792183] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (2.78 seconds). [2025-10-27T17:41:05.214937] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-27T17:41:05.808417] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (2.99 seconds). [2025-10-27T17:41:06.014912] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-27T17:41:06.150267] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (5.74 seconds). [2025-10-27T17:41:06.166241] [INFO ] [REMOTE ] BP: Full fetch complete (77880 records). [2025-10-27T17:41:06.174136] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-27T17:41:06.174623] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T17:41:06.563584] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-27T17:41:06.563765] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-27T17:41:06.564597] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-27T17:41:06.564689] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-27T17:41:06.566115] [DEBUG] [LOCAL ] BP: Trimmed 77880 records to 53705 (keeping 200 days of data) [2025-10-27T17:41:06.843481] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-27T17:41:06.894956] [DEBUG] [LOCAL ] BP: Primary data saved (53705 records). [2025-10-27T17:41:06.895116] [INFO ] [MAIN ] BP: Full history saved. [2025-10-27T17:41:06.896038] [INFO ] [MAIN ] Update Progress: 328/2366 symbols completed. BP took 40.0s. Estimated remaining: 4h 15m 9s. Rate: 8.0 symbols/min [2025-10-27T17:41:07.037838] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-27T17:41:07.122171] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:41:07.147970] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T17:41:07.193929] [DEBUG] [LOCAL ] BRCC: Loaded 40534 existing records from primary storage. [2025-10-27T17:41:07.194204] [INFO ] [MAIN ] BRCC: Loaded 40534 existing records. [2025-10-27T17:41:07.368948] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:41:07.369219] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-27T17:41:07.369289] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-27T17:41:07.369538] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-27T17:41:07.369637] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-27T17:41:07.622675] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-27T17:41:07.731591] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:41:07.819870] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T17:41:08.414928] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-27T17:41:08.931621] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T17:41:08.938720] [INFO ] [REMOTE ] BR: Full fetch complete (49964 records). [2025-10-27T17:41:08.938868] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-27T17:41:09.218830] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-27T17:41:09.353041] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-27T17:41:09.355718] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-27T17:41:09.360072] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-27T17:41:09.361409] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-27T17:41:09.361844] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-27T17:41:09.362888] [DEBUG] [LOCAL ] BR: Trimmed 49964 records to 34300 (keeping 200 days of data) [2025-10-27T17:41:09.570222] [DEBUG] [LOCAL ] BR: Primary data saved (34300 records). [2025-10-27T17:41:09.570350] [INFO ] [MAIN ] BR: Full history saved. [2025-10-27T17:41:09.570424] [INFO ] [MAIN ] Update Progress: 329/2366 symbols completed. BR took 24.5s. Estimated remaining: 4h 14m 32s. Rate: 8.0 symbols/min [2025-10-27T17:41:09.742039] [INFO ] [MAIN ] BRCE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:41:09.742207] [DEBUG] [LOCAL ] BRCE: No existing data file found in primary storage. [2025-10-27T17:41:09.742243] [WARN ] [MAIN ] BRCE: No existing data found, performing full refresh instead. [2025-10-27T17:41:09.742360] [INFO ] [MAIN ] BRCE: Wiping existing primary data before full refresh. [2025-10-27T17:41:09.742400] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-10-27T17:41:09.742442] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-10-27T17:41:09.742508] [INFO ] [MAIN ] BRCE: Starting full primary refresh. [2025-10-27T17:41:10.022023] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-27T17:41:10.111270] [INFO ] [REMOTE ] BRCE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:41:10.663956] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-27T17:41:10.814979] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-27T17:41:10.838388] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T17:41:11.614960] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-27T17:41:12.127080] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T17:41:12.239303] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-27T17:41:12.414938] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-27T17:41:13.214998] [INFO ] [REMOTE ] BRCE: Fetching primary data for 2025-01. [2025-10-27T17:41:13.418181] [DEBUG] [REMOTE ] BRCE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:41:13.418473] [WARN ] [REMOTE ] BRCE: No data returned for month 2025-01 [2025-10-27T17:41:13.418561] [FATAL] [REMOTE ] BRCE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:41:13.418607] [FATAL] [MAIN ] BRCE: Failed to fetch primary data. [2025-10-27T17:41:13.418690] [WARN ] [MAIN ] BRCE: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:41:13.418761] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-10-27T17:41:13.418822] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-10-27T17:41:13.418860] [INFO ] [LOCAL ] BRCE: Starting deletion of derivative data. [2025-10-27T17:41:13.418900] [DEBUG] [LOCAL ] BRCE: No derivative data file found to delete. [2025-10-27T17:41:13.418946] [INFO ] [MAIN ] Update Progress: 330/2366 symbols completed. BRCE took 3.8s. Estimated remaining: 4h 14m 2s. Rate: 8.0 symbols/min [2025-10-27T17:41:13.592429] [INFO ] [MAIN ] BRIE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:41:13.592588] [DEBUG] [LOCAL ] BRIE: No existing data file found in primary storage. [2025-10-27T17:41:13.592625] [WARN ] [MAIN ] BRIE: No existing data found, performing full refresh instead. [2025-10-27T17:41:13.592761] [INFO ] [MAIN ] BRIE: Wiping existing primary data before full refresh. [2025-10-27T17:41:13.592803] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-10-27T17:41:13.592843] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-10-27T17:41:13.592876] [INFO ] [MAIN ] BRIE: Starting full primary refresh. [2025-10-27T17:41:13.976814] [INFO ] [REMOTE ] BRIE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:41:14.007190] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T17:41:14.016798] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-27T17:41:14.814944] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-27T17:41:15.054171] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-27T17:41:15.614950] [INFO ] [REMOTE ] BRIE: Fetching primary data for 2025-01. [2025-10-27T17:41:15.835269] [DEBUG] [REMOTE ] BRIE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:41:15.835575] [WARN ] [REMOTE ] BRIE: No data returned for month 2025-01 [2025-10-27T17:41:15.835685] [FATAL] [REMOTE ] BRIE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:41:15.835752] [FATAL] [MAIN ] BRIE: Failed to fetch primary data. [2025-10-27T17:41:15.835820] [WARN ] [MAIN ] BRIE: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:41:15.835891] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-10-27T17:41:15.835956] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-10-27T17:41:15.835990] [INFO ] [LOCAL ] BRIE: Starting deletion of derivative data. [2025-10-27T17:41:15.836028] [DEBUG] [LOCAL ] BRIE: No derivative data file found to delete. [2025-10-27T17:41:15.836073] [INFO ] [MAIN ] Update Progress: 331/2366 symbols completed. BRIE took 2.4s. Estimated remaining: 4h 13m 23s. Rate: 8.0 symbols/min [2025-10-27T17:41:16.008511] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:41:16.057493] [DEBUG] [LOCAL ] BRO: Loaded 52866 existing records from primary storage. [2025-10-27T17:41:16.057859] [INFO ] [MAIN ] BRO: Loaded 52866 existing records. [2025-10-27T17:41:16.235924] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:41:16.236202] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-27T17:41:16.236336] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-27T17:41:16.236530] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-27T17:41:16.236572] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-27T17:41:16.416298] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-27T17:41:16.643714] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:41:16.638403] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T17:41:17.215005] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-27T17:41:17.626077] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T17:41:18.014999] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-27T17:41:18.816413] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-27T17:41:18.819925] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-27T17:41:19.101847] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-27T17:41:19.614989] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-27T17:41:20.199609] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T17:41:20.414914] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-27T17:41:20.780272] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-27T17:41:20.783877] [INFO ] [REMOTE ] BRC: Full fetch complete (28229 records). [2025-10-27T17:41:20.783949] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-27T17:41:21.164860] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-27T17:41:21.164925] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-27T17:41:21.165401] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-27T17:41:21.165462] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-27T17:41:21.166301] [DEBUG] [LOCAL ] BRC: Trimmed 28229 records to 17909 (keeping 200 days of data) [2025-10-27T17:41:21.221188] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-27T17:41:21.277553] [DEBUG] [LOCAL ] BRC: Primary data saved (17909 records). [2025-10-27T17:41:21.277701] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-27T17:41:21.277789] [INFO ] [MAIN ] Update Progress: 332/2366 symbols completed. BRC took 23.8s. Estimated remaining: 4h 13m 3s. Rate: 8.0 symbols/min [2025-10-27T17:41:21.452386] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:41:21.503168] [DEBUG] [LOCAL ] BROS: Loaded 54077 existing records from primary storage. [2025-10-27T17:41:21.503506] [INFO ] [MAIN ] BROS: Loaded 54077 existing records. [2025-10-27T17:41:21.686186] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:41:21.686493] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-27T17:41:21.686590] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-27T17:41:21.686881] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-27T17:41:21.686936] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-27T17:41:22.023130] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-27T17:41:22.092215] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:41:22.094343] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-27T17:41:22.814931] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-27T17:41:22.857086] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T17:41:23.263047] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T17:41:23.614940] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-27T17:41:24.414982] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-27T17:41:24.720494] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-27T17:41:25.214926] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-27T17:41:25.442229] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-27T17:41:25.916496] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-27T17:41:26.014951] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-27T17:41:26.814930] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-27T17:41:27.274747] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-27T17:41:27.555484] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-27T17:41:27.614924] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-27T17:41:28.417050] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-27T17:41:28.419730] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T17:41:28.983269] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-27T17:41:29.214933] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-27T17:41:30.014947] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-27T17:41:30.017460] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T17:41:30.814907] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-27T17:41:30.863814] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-27T17:41:31.173313] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-27T17:41:31.614994] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-27T17:41:32.267471] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T17:41:32.414927] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-27T17:41:33.215239] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-27T17:41:33.221406] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T17:41:33.916520] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-27T17:41:34.014916] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-27T17:41:34.814995] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-27T17:41:35.011070] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-27T17:41:35.021169] [INFO ] [REMOTE ] BRBR: Full fetch complete (73305 records). [2025-10-27T17:41:35.021307] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-27T17:41:35.410628] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-27T17:41:35.410744] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-27T17:41:35.411622] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-27T17:41:35.411698] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-27T17:41:35.413164] [DEBUG] [LOCAL ] BRBR: Trimmed 73305 records to 51815 (keeping 200 days of data) [2025-10-27T17:41:35.558320] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T17:41:35.621000] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-27T17:41:35.749077] [DEBUG] [LOCAL ] BRBR: Primary data saved (51815 records). [2025-10-27T17:41:35.749678] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-27T17:41:35.749822] [INFO ] [MAIN ] Update Progress: 333/2366 symbols completed. BRBR took 41.2s. Estimated remaining: 4h 13m 39s. Rate: 8.0 symbols/min [2025-10-27T17:41:35.927007] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:41:35.927226] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-27T17:41:35.927279] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-27T17:41:35.927389] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-27T17:41:35.927448] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-27T17:41:35.927490] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-27T17:41:35.927522] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-27T17:41:36.309593] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:41:36.414913] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-27T17:41:36.518003] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T17:41:37.214980] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-10-27T17:41:37.502515] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T17:41:37.512836] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:41:37.513526] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-10-27T17:41:37.513617] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:41:37.513710] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-27T17:41:37.513815] [INFO ] [REMOTE ] BRCC: Full fetch complete (57311 records). [2025-10-27T17:41:37.513881] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:41:37.514082] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-27T17:41:37.514153] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-27T17:41:37.514455] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-27T17:41:37.514572] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-27T17:41:37.514680] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-27T17:41:37.545797] [INFO ] [MAIN ] Update Progress: 334/2366 symbols completed. BRSL took 1.8s. Estimated remaining: 4h 12m 57s. Rate: 8.0 symbols/min [2025-10-27T17:41:38.013837] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-27T17:41:38.036043] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-27T17:41:38.011999] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:41:38.135787] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-27T17:41:38.135869] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-27T17:41:38.136488] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-27T17:41:38.140520] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-27T17:41:38.142074] [DEBUG] [LOCAL ] BRCC: Trimmed 57311 records to 39939 (keeping 200 days of data) [2025-10-27T17:41:38.271052] [DEBUG] [LOCAL ] BRSP: Loaded 36936 existing records from primary storage. [2025-10-27T17:41:38.273676] [INFO ] [MAIN ] BRSP: Loaded 36936 existing records. [2025-10-27T17:41:38.553270] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:41:38.570607] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-27T17:41:38.580011] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-27T17:41:38.579912] [DEBUG] [LOCAL ] BRCC: Primary data saved (39939 records). [2025-10-27T17:41:38.580192] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-27T17:41:38.580285] [INFO ] [MAIN ] Update Progress: 335/2366 symbols completed. BRCC took 31.7s. Estimated remaining: 4h 12m 10s. Rate: 8.1 symbols/min [2025-10-27T17:41:38.580349] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-27T17:41:38.580440] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-27T17:41:38.819858] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-27T17:41:38.968690] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:41:39.098968] [DEBUG] [LOCAL ] BRT: Loaded 5335 existing records from primary storage. [2025-10-27T17:41:39.118805] [INFO ] [MAIN ] BRT: Loaded 5335 existing records. [2025-10-27T17:41:39.118668] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:41:39.319625] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:41:39.319836] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-27T17:41:39.320049] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-27T17:41:39.320266] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-10-27T17:41:39.320378] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-27T17:41:39.618238] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-27T17:41:39.686660] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:41:39.705804] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T17:41:40.414956] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-27T17:41:40.755368] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-27T17:41:41.169354] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T17:41:41.214928] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-27T17:41:41.872546] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-27T17:41:42.014924] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-27T17:41:42.722071] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T17:41:42.814949] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-27T17:41:43.338096] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T17:41:43.419005] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-27T17:41:43.615007] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-27T17:41:43.924157] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-27T17:41:44.414950] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-27T17:41:45.214984] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-27T17:41:45.920539] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-27T17:41:46.014996] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-27T17:41:46.814984] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-27T17:41:47.183173] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-27T17:41:47.281029] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-27T17:41:47.290796] [INFO ] [REMOTE ] BRO: Full fetch complete (75153 records). [2025-10-27T17:41:47.290905] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-27T17:41:47.623769] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-27T17:41:47.670433] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-27T17:41:47.670494] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-27T17:41:47.671274] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-27T17:41:47.671336] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-27T17:41:47.672625] [DEBUG] [LOCAL ] BRO: Trimmed 75153 records to 52099 (keeping 200 days of data) [2025-10-27T17:41:48.012993] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-27T17:41:48.035081] [DEBUG] [LOCAL ] BRO: Primary data saved (52099 records). [2025-10-27T17:41:48.035228] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-27T17:41:48.035320] [INFO ] [MAIN ] Update Progress: 336/2366 symbols completed. BRO took 32.2s. Estimated remaining: 4h 12m 15s. Rate: 8.0 symbols/min [2025-10-27T17:41:48.199461] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:41:48.219428] [DEBUG] [LOCAL ] BRW: Loaded 21283 existing records from primary storage. [2025-10-27T17:41:48.219685] [INFO ] [MAIN ] BRW: Loaded 21283 existing records. [2025-10-27T17:41:48.391148] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:41:48.391305] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-27T17:41:48.391350] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-27T17:41:48.391506] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-27T17:41:48.391543] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-27T17:41:48.421315] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-27T17:41:48.827266] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:41:48.869940] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-27T17:41:49.129825] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-27T17:41:49.214941] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-27T17:41:50.015002] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-27T17:41:50.451158] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-27T17:41:50.723463] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T17:41:50.814940] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-27T17:41:51.614947] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-27T17:41:52.176580] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T17:41:52.414984] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-27T17:41:52.893542] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-27T17:41:52.976065] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-27T17:41:52.986087] [INFO ] [REMOTE ] BROS: Full fetch complete (77281 records). [2025-10-27T17:41:52.986197] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-27T17:41:53.220112] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-27T17:41:53.370894] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-27T17:41:53.370971] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-27T17:41:53.371769] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-27T17:41:53.371830] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-27T17:41:53.373206] [DEBUG] [LOCAL ] BROS: Trimmed 77281 records to 53298 (keeping 200 days of data) [2025-10-27T17:41:53.677392] [DEBUG] [LOCAL ] BROS: Primary data saved (53298 records). [2025-10-27T17:41:53.677519] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-27T17:41:53.678616] [INFO ] [MAIN ] Update Progress: 337/2366 symbols completed. BROS took 32.4s. Estimated remaining: 4h 11m 56s. Rate: 8.1 symbols/min [2025-10-27T17:41:53.846502] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:41:53.893971] [DEBUG] [LOCAL ] BRX: Loaded 52579 existing records from primary storage. [2025-10-27T17:41:53.894269] [INFO ] [MAIN ] BRX: Loaded 52579 existing records. [2025-10-27T17:41:54.020044] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-27T17:41:54.082732] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-27T17:41:54.082445] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:41:54.083012] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-27T17:41:54.085357] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-27T17:41:54.085747] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-27T17:41:54.085809] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-27T17:41:54.436083] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:41:54.814998] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-27T17:41:55.070814] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T17:41:55.614991] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-27T17:41:56.234846] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-27T17:41:56.279620] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-27T17:41:56.414970] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-27T17:41:57.214940] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-27T17:41:57.741006] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T17:41:57.742899] [INFO ] [REMOTE ] BRT: Full fetch complete (7143 records). [2025-10-27T17:41:57.742967] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-27T17:41:58.031919] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T17:41:58.020580] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-27T17:41:58.138473] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-27T17:41:58.138542] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-27T17:41:58.138738] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-27T17:41:58.138799] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-27T17:41:58.139177] [DEBUG] [LOCAL ] BRT: Trimmed 7143 records to 5162 (keeping 200 days of data) [2025-10-27T17:41:58.170584] [DEBUG] [LOCAL ] BRT: Primary data saved (5162 records). [2025-10-27T17:41:58.170709] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-27T17:41:58.170793] [INFO ] [MAIN ] Update Progress: 338/2366 symbols completed. BRT took 19.6s. Estimated remaining: 4h 11m 31s. Rate: 8.1 symbols/min [2025-10-27T17:41:58.338570] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:41:58.371109] [DEBUG] [LOCAL ] BSAC: Loaded 33212 existing records from primary storage. [2025-10-27T17:41:58.371366] [INFO ] [MAIN ] BSAC: Loaded 33212 existing records. [2025-10-27T17:41:58.577722] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:41:58.577921] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-27T17:41:58.577969] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-27T17:41:58.578143] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-27T17:41:58.578183] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-27T17:41:58.820184] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-27T17:41:58.896558] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-27T17:41:58.976957] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:41:59.614992] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-27T17:41:59.915611] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T17:42:00.414931] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-27T17:42:01.214949] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-27T17:42:01.578393] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-27T17:42:02.015003] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-27T17:42:02.815010] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-27T17:42:03.415286] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (3.00 seconds). [2025-10-27T17:42:03.615036] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-27T17:42:04.179550] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-27T17:42:04.196513] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T17:42:04.414954] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-27T17:42:04.761892] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (3.55 seconds). [2025-10-27T17:42:05.215084] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-27T17:42:05.278771] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T17:42:05.707808] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T17:42:06.015001] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-27T17:42:06.126952] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-27T17:42:06.814994] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-27T17:42:07.460471] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-27T17:42:07.614956] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-27T17:42:07.657613] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-27T17:42:08.414934] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-27T17:42:08.509964] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-27T17:42:09.214993] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-27T17:42:09.815154] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T17:42:10.014918] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-27T17:42:10.125467] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T17:42:10.814938] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-27T17:42:11.355049] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T17:42:11.614968] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-27T17:42:11.794859] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-27T17:42:12.415003] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-27T17:42:12.823038] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T17:42:13.214973] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-27T17:42:13.873428] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-27T17:42:14.014905] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-27T17:42:14.658586] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T17:42:14.665697] [INFO ] [REMOTE ] BRSP: Full fetch complete (53689 records). [2025-10-27T17:42:14.665869] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-27T17:42:14.666555] [FATAL] [VALIDATOR ] BRSP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:42:14.666671] [FATAL] [MAIN ] BRSP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:42:14.666729] [WARN ] [MAIN ] BRSP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:42:14.666795] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-27T17:42:14.666857] [DEBUG] [LOCAL ] BRSP: No primary data file found to delete. [2025-10-27T17:42:14.666892] [INFO ] [LOCAL ] BRSP: Starting deletion of derivative data. [2025-10-27T17:42:14.667013] [DEBUG] [LOCAL ] BRSP: Deleted derivative data file. [2025-10-27T17:42:14.667086] [INFO ] [MAIN ] Update Progress: 339/2366 symbols completed. BRSP took 37.1s. Estimated remaining: 4h 12m 18s. Rate: 8.0 symbols/min [2025-10-27T17:42:14.814966] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-27T17:42:14.834598] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:42:14.865752] [DEBUG] [LOCAL ] BSBR: Loaded 36230 existing records from primary storage. [2025-10-27T17:42:14.866011] [INFO ] [MAIN ] BSBR: Loaded 36230 existing records. [2025-10-27T17:42:15.038213] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:42:15.038389] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-27T17:42:15.038435] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-27T17:42:15.038633] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-27T17:42:15.038716] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-27T17:42:15.390757] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:42:15.514585] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T17:42:15.614918] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-27T17:42:15.734006] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-27T17:42:16.414947] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-27T17:42:16.695345] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T17:42:17.214929] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-27T17:42:17.572006] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T17:42:18.014916] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-27T17:42:18.423485] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-27T17:42:18.814950] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-27T17:42:19.614923] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-27T17:42:19.687872] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T17:42:20.211413] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T17:42:20.315544] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-27T17:42:20.414977] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-27T17:42:21.214941] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-27T17:42:21.490158] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T17:42:21.910052] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-27T17:42:22.014929] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-27T17:42:22.814946] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-27T17:42:23.620042] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-27T17:42:23.634250] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-27T17:42:23.645706] [INFO ] [REMOTE ] BRX: Full fetch complete (75159 records). [2025-10-27T17:42:23.645840] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-27T17:42:24.002025] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-27T17:42:24.035844] [INFO ] [REMOTE ] BRW: Full fetch complete (30161 records). [2025-10-27T17:42:24.062065] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-27T17:42:24.094337] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-27T17:42:24.137605] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-27T17:42:24.170947] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-27T17:42:24.187343] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-27T17:42:24.220236] [DEBUG] [LOCAL ] BRX: Trimmed 75159 records to 51796 (keeping 200 days of data) [2025-10-27T17:42:24.418726] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-27T17:42:24.623928] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-27T17:42:24.624064] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-27T17:42:24.626541] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-27T17:42:24.629098] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-27T17:42:24.632980] [DEBUG] [LOCAL ] BRW: Trimmed 30161 records to 20882 (keeping 200 days of data) [2025-10-27T17:42:24.866159] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T17:42:24.944926] [DEBUG] [LOCAL ] BRW: Primary data saved (20882 records). [2025-10-27T17:42:24.950739] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-27T17:42:24.956054] [INFO ] [MAIN ] Update Progress: 340/2366 symbols completed. BRW took 36.9s. Estimated remaining: 4h 12m 27s. Rate: 8.0 symbols/min [2025-10-27T17:42:25.038175] [DEBUG] [LOCAL ] BRX: Primary data saved (51796 records). [2025-10-27T17:42:25.050918] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-27T17:42:25.056818] [INFO ] [MAIN ] Update Progress: 341/2366 symbols completed. BRX took 31.4s. Estimated remaining: 4h 11m 36s. Rate: 8.0 symbols/min [2025-10-27T17:42:25.256098] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:42:25.229609] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-27T17:42:25.330499] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:42:25.335010] [DEBUG] [LOCAL ] BSL: Loaded 8034 existing records from primary storage. [2025-10-27T17:42:25.335269] [INFO ] [MAIN ] BSL: Loaded 8034 existing records. [2025-10-27T17:42:25.548871] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:42:25.549876] [DEBUG] [LOCAL ] BSM: Loaded 32602 existing records from primary storage. [2025-10-27T17:42:25.550130] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-27T17:42:25.550216] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-27T17:42:25.561773] [INFO ] [MAIN ] BSM: Loaded 32602 existing records. [2025-10-27T17:42:25.582557] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-27T17:42:25.591994] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-27T17:42:25.692368] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-27T17:42:25.898840] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:42:25.909299] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-27T17:42:25.921943] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-27T17:42:25.940954] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-27T17:42:25.957432] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-27T17:42:26.064015] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-27T17:42:26.311041] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:42:26.539744] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T17:42:26.572113] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:42:26.814958] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-27T17:42:27.017818] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T17:42:27.614934] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-27T17:42:27.835376] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T17:42:28.414934] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-27T17:42:28.647011] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T17:42:28.653789] [INFO ] [REMOTE ] BSAC: Full fetch complete (45368 records). [2025-10-27T17:42:28.653902] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-27T17:42:29.062106] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-27T17:42:29.062187] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-27T17:42:29.062861] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-27T17:42:29.062962] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-27T17:42:29.064209] [DEBUG] [LOCAL ] BSAC: Trimmed 45368 records to 32455 (keeping 200 days of data) [2025-10-27T17:42:29.218685] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-27T17:42:29.259360] [DEBUG] [LOCAL ] BSAC: Primary data saved (32455 records). [2025-10-27T17:42:29.259466] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-27T17:42:29.259562] [INFO ] [MAIN ] Update Progress: 342/2366 symbols completed. BSAC took 31.1s. Estimated remaining: 4h 11m 9s. Rate: 8.1 symbols/min [2025-10-27T17:42:29.438959] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:42:29.458235] [DEBUG] [LOCAL ] BST: Loaded 18604 existing records from primary storage. [2025-10-27T17:42:29.458501] [INFO ] [MAIN ] BST: Loaded 18604 existing records. [2025-10-27T17:42:29.636257] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:42:29.636429] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-27T17:42:29.636606] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-27T17:42:29.636825] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-27T17:42:29.636875] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-27T17:42:29.960064] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-27T17:42:30.020121] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-27T17:42:30.024303] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:42:30.692628] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T17:42:30.814941] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-27T17:42:30.886457] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T17:42:31.310090] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-27T17:42:31.614971] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-27T17:42:32.414911] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-27T17:42:32.767710] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T17:42:33.214952] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-27T17:42:33.499974] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T17:42:34.015000] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-27T17:42:34.084525] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-27T17:42:34.814957] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-27T17:42:35.127998] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T17:42:35.334748] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-27T17:42:35.614982] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-27T17:42:36.414961] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-27T17:42:36.904816] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T17:42:37.183496] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-27T17:42:37.214940] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-27T17:42:38.014973] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-27T17:42:38.155461] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T17:42:38.535913] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-27T17:42:38.814951] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-27T17:42:39.614965] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-27T17:42:40.050168] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-27T17:42:40.411913] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-27T17:42:40.419559] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-27T17:42:41.214969] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-27T17:42:41.563036] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T17:42:41.987105] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-27T17:42:42.014926] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-27T17:42:42.814967] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-27T17:42:42.995850] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T17:42:43.002298] [INFO ] [REMOTE ] BSBR: Full fetch complete (50629 records). [2025-10-27T17:42:43.002418] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-27T17:42:43.003095] [FATAL] [VALIDATOR ] BSBR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:42:43.003188] [FATAL] [MAIN ] BSBR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:42:43.003230] [WARN ] [MAIN ] BSBR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:42:43.003312] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-27T17:42:43.003394] [DEBUG] [LOCAL ] BSBR: No primary data file found to delete. [2025-10-27T17:42:43.003443] [INFO ] [LOCAL ] BSBR: Starting deletion of derivative data. [2025-10-27T17:42:43.003788] [DEBUG] [LOCAL ] BSBR: Deleted derivative data file. [2025-10-27T17:42:43.003897] [INFO ] [MAIN ] Update Progress: 343/2366 symbols completed. BSBR took 28.3s. Estimated remaining: 4h 11m 39s. Rate: 8.0 symbols/min [2025-10-27T17:42:43.181345] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:42:43.203917] [DEBUG] [LOCAL ] BSTZ: Loaded 24689 existing records from primary storage. [2025-10-27T17:42:43.204204] [INFO ] [MAIN ] BSTZ: Loaded 24689 existing records. [2025-10-27T17:42:43.388908] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:42:43.389097] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-27T17:42:43.389144] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-27T17:42:43.389327] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-27T17:42:43.389390] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-27T17:42:43.624820] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-27T17:42:43.749051] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:42:43.850496] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-27T17:42:44.295664] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-27T17:42:44.414951] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-27T17:42:45.208773] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-27T17:42:45.214895] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-27T17:42:46.014926] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-27T17:42:46.191792] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T17:42:46.814933] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-27T17:42:46.825082] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T17:42:47.615060] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-27T17:42:48.282541] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T17:42:48.343901] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T17:42:48.346277] [INFO ] [REMOTE ] BSL: Full fetch complete (12907 records). [2025-10-27T17:42:48.346345] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-27T17:42:48.346780] [FATAL] [VALIDATOR ] BSL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:42:48.346862] [FATAL] [MAIN ] BSL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:42:48.346903] [WARN ] [MAIN ] BSL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:42:48.346967] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-27T17:42:48.347028] [DEBUG] [LOCAL ] BSL: No primary data file found to delete. [2025-10-27T17:42:48.347062] [INFO ] [LOCAL ] BSL: Starting deletion of derivative data. [2025-10-27T17:42:48.347217] [DEBUG] [LOCAL ] BSL: Deleted derivative data file. [2025-10-27T17:42:48.347318] [INFO ] [MAIN ] Update Progress: 344/2366 symbols completed. BSL took 23.4s. Estimated remaining: 4h 11m 19s. Rate: 8.0 symbols/min [2025-10-27T17:42:48.420111] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-27T17:42:48.514833] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:42:48.564387] [DEBUG] [LOCAL ] BSX: Loaded 54468 existing records from primary storage. [2025-10-27T17:42:48.564711] [INFO ] [MAIN ] BSX: Loaded 54468 existing records. [2025-10-27T17:42:48.740244] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:42:48.740423] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-27T17:42:48.740466] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-27T17:42:48.740665] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-27T17:42:48.740722] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-27T17:42:49.089134] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:42:49.214926] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-27T17:42:49.801274] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T17:42:50.014944] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-27T17:42:50.814923] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-27T17:42:50.947939] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T17:42:51.010192] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T17:42:51.519526] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-27T17:42:51.615020] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-27T17:42:52.414928] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-27T17:42:52.712875] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T17:42:53.214941] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-27T17:42:53.650844] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T17:42:54.014954] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-27T17:42:54.163447] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T17:42:54.689988] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-27T17:42:54.814974] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-27T17:42:55.614955] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-27T17:42:55.973289] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T17:42:56.375152] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T17:42:56.414955] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-27T17:42:57.142034] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T17:42:57.146099] [INFO ] [REMOTE ] BST: Full fetch complete (28237 records). [2025-10-27T17:42:57.146208] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-27T17:42:57.220036] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-27T17:42:57.531948] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-27T17:42:57.532023] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-27T17:42:57.532410] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-27T17:42:57.532448] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-27T17:42:57.533182] [DEBUG] [LOCAL ] BST: Trimmed 28237 records to 17979 (keeping 200 days of data) [2025-10-27T17:42:57.638195] [DEBUG] [LOCAL ] BST: Primary data saved (17979 records). [2025-10-27T17:42:57.638322] [INFO ] [MAIN ] BST: Full history saved. [2025-10-27T17:42:57.638397] [INFO ] [MAIN ] Update Progress: 345/2366 symbols completed. BST took 28.4s. Estimated remaining: 4h 11m 22s. Rate: 8.0 symbols/min [2025-10-27T17:42:57.809565] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:42:57.816261] [DEBUG] [LOCAL ] BTA: Loaded 5808 existing records from primary storage. [2025-10-27T17:42:57.816441] [INFO ] [MAIN ] BTA: Loaded 5808 existing records. [2025-10-27T17:42:57.988481] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:42:57.988728] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-27T17:42:57.988781] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-27T17:42:57.988909] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-27T17:42:57.988945] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-27T17:42:58.020122] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-27T17:42:58.347679] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:42:58.366392] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T17:42:58.814955] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-27T17:42:59.208834] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T17:42:59.521474] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-27T17:42:59.614917] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-27T17:43:00.415001] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-27T17:43:01.214942] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-27T17:43:01.979302] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-27T17:43:02.014958] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-27T17:43:02.356829] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-27T17:43:02.814941] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-27T17:43:03.615009] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-27T17:43:04.410009] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-27T17:43:04.414887] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-27T17:43:04.632892] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (3.42 seconds). [2025-10-27T17:43:04.757558] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (2.74 seconds). [2025-10-27T17:43:05.096329] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-27T17:43:05.214925] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-27T17:43:05.371823] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T17:43:06.014941] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-27T17:43:06.259220] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T17:43:06.265502] [INFO ] [REMOTE ] BSM: Full fetch complete (46365 records). [2025-10-27T17:43:06.265637] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-27T17:43:06.266359] [FATAL] [VALIDATOR ] BSM: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:43:06.266444] [FATAL] [MAIN ] BSM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:43:06.266486] [WARN ] [MAIN ] BSM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:43:06.266548] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-27T17:43:06.266611] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-10-27T17:43:06.266670] [INFO ] [LOCAL ] BSM: Starting deletion of derivative data. [2025-10-27T17:43:06.266845] [DEBUG] [LOCAL ] BSM: Deleted derivative data file. [2025-10-27T17:43:06.266932] [INFO ] [MAIN ] Update Progress: 346/2366 symbols completed. BSM took 41.2s. Estimated remaining: 4h 11m 22s. Rate: 8.0 symbols/min [2025-10-27T17:43:06.431782] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:43:06.480878] [DEBUG] [LOCAL ] BTE: Loaded 53462 existing records from primary storage. [2025-10-27T17:43:06.481185] [INFO ] [MAIN ] BTE: Loaded 53462 existing records. [2025-10-27T17:43:06.652903] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:43:06.653099] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-27T17:43:06.653145] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-27T17:43:06.653309] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-27T17:43:06.653346] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-27T17:43:06.822405] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-27T17:43:07.005548] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:43:07.371840] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-27T17:43:07.594728] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-27T17:43:07.614915] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-27T17:43:08.415012] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-27T17:43:08.864172] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T17:43:09.214935] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-27T17:43:09.672555] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-27T17:43:09.720219] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-27T17:43:10.014966] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-27T17:43:10.424926] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-27T17:43:10.814991] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-27T17:43:11.614946] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-27T17:43:12.325590] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T17:43:12.326952] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T17:43:12.414918] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-27T17:43:13.214937] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-27T17:43:13.902026] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-27T17:43:13.941738] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T17:43:14.014906] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-27T17:43:14.814963] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-27T17:43:15.095698] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T17:43:15.614987] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-27T17:43:16.389972] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T17:43:16.392536] [INFO ] [REMOTE ] BTA: Full fetch complete (9065 records). [2025-10-27T17:43:16.392672] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-27T17:43:16.416615] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-27T17:43:16.557202] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-27T17:43:16.810897] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-27T17:43:16.810968] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-27T17:43:16.811192] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-27T17:43:16.811231] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-27T17:43:16.811634] [DEBUG] [LOCAL ] BTA: Trimmed 9065 records to 5673 (keeping 200 days of data) [2025-10-27T17:43:16.843773] [DEBUG] [LOCAL ] BTA: Primary data saved (5673 records). [2025-10-27T17:43:16.843879] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-27T17:43:16.843970] [INFO ] [MAIN ] Update Progress: 347/2366 symbols completed. BTA took 19.2s. Estimated remaining: 4h 11m 32s. Rate: 8.0 symbols/min [2025-10-27T17:43:17.014051] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:43:17.063612] [DEBUG] [LOCAL ] BTI: Loaded 54367 existing records from primary storage. [2025-10-27T17:43:17.063922] [INFO ] [MAIN ] BTI: Loaded 54367 existing records. [2025-10-27T17:43:17.238901] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-27T17:43:17.244383] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:43:17.245282] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-27T17:43:17.245353] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-27T17:43:17.245574] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-27T17:43:17.245629] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-27T17:43:17.617951] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:43:17.764780] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T17:43:17.769703] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36236 records). [2025-10-27T17:43:17.769823] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-27T17:43:18.024040] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-27T17:43:18.150404] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-27T17:43:18.150477] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-27T17:43:18.150980] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-27T17:43:18.151053] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-27T17:43:18.151817] [DEBUG] [LOCAL ] BSTZ: Trimmed 36236 records to 24166 (keeping 200 days of data) [2025-10-27T17:43:18.294087] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24166 records). [2025-10-27T17:43:18.294203] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-27T17:43:18.294288] [INFO ] [MAIN ] Update Progress: 348/2366 symbols completed. BSTZ took 35.3s. Estimated remaining: 4h 10m 50s. Rate: 8.0 symbols/min [2025-10-27T17:43:18.463155] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:43:18.472426] [DEBUG] [LOCAL ] BTO: Loaded 8816 existing records from primary storage. [2025-10-27T17:43:18.472616] [INFO ] [MAIN ] BTO: Loaded 8816 existing records. [2025-10-27T17:43:18.646063] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:43:18.646256] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-27T17:43:18.646337] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-27T17:43:18.646586] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-27T17:43:18.646684] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-27T17:43:18.820869] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-27T17:43:19.029151] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:43:19.090100] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-27T17:43:19.620072] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-27T17:43:19.635690] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T17:43:20.243956] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-27T17:43:20.414936] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-27T17:43:20.909670] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-27T17:43:21.141482] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-27T17:43:21.214933] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-27T17:43:21.966115] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T17:43:22.014899] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-27T17:43:22.814930] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-27T17:43:23.223476] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T17:43:23.573343] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-27T17:43:23.614917] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-27T17:43:24.392728] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T17:43:24.414909] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-27T17:43:25.214983] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-27T17:43:26.015546] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-27T17:43:26.066426] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T17:43:26.095780] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-27T17:43:26.814963] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-27T17:43:27.404545] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T17:43:27.614905] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-27T17:43:28.414913] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-27T17:43:28.585397] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-27T17:43:28.884687] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-27T17:43:28.921116] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T17:43:29.214915] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-27T17:43:30.014955] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-27T17:43:30.791815] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-27T17:43:30.814928] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-27T17:43:31.614938] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-27T17:43:31.819877] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T17:43:31.924916] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T17:43:32.414949] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-27T17:43:33.214922] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-27T17:43:33.325461] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-27T17:43:34.014919] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-27T17:43:34.222694] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-27T17:43:34.232781] [INFO ] [REMOTE ] BTE: Full fetch complete (76354 records). [2025-10-27T17:43:34.232923] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-27T17:43:34.623768] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-27T17:43:34.623863] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-27T17:43:34.624689] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-27T17:43:34.624833] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-27T17:43:34.626315] [DEBUG] [LOCAL ] BTE: Trimmed 76354 records to 52671 (keeping 200 days of data) [2025-10-27T17:43:34.833620] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-27T17:43:34.956550] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-27T17:43:34.975490] [DEBUG] [LOCAL ] BTE: Primary data saved (52671 records). [2025-10-27T17:43:34.975606] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-27T17:43:34.977295] [INFO ] [MAIN ] Update Progress: 349/2366 symbols completed. BTE took 28.7s. Estimated remaining: 4h 11m 36s. Rate: 8.0 symbols/min [2025-10-27T17:43:35.148978] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:43:35.166213] [DEBUG] [LOCAL ] BTT: Loaded 15596 existing records from primary storage. [2025-10-27T17:43:35.166450] [INFO ] [MAIN ] BTT: Loaded 15596 existing records. [2025-10-27T17:43:35.339734] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:43:35.339943] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-27T17:43:35.340003] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-27T17:43:35.340156] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-27T17:43:35.340205] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-27T17:43:35.616587] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-27T17:43:35.705108] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:43:35.707725] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-27T17:43:35.785096] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-27T17:43:36.414909] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-27T17:43:37.214906] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-27T17:43:37.261586] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T17:43:37.529901] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-27T17:43:38.014949] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-27T17:43:38.821857] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-27T17:43:38.827389] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T17:43:39.340779] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-27T17:43:39.392212] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-27T17:43:39.614934] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-27T17:43:40.036944] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-27T17:43:40.414942] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-27T17:43:41.214998] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-27T17:43:42.014925] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-27T17:43:42.087241] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T17:43:42.089633] [INFO ] [REMOTE ] BTO: Full fetch complete (13268 records). [2025-10-27T17:43:42.089730] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-27T17:43:42.457616] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-27T17:43:42.457752] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-27T17:43:42.458272] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-27T17:43:42.458355] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-27T17:43:42.459115] [DEBUG] [LOCAL ] BTO: Trimmed 13268 records to 8609 (keeping 200 days of data) [2025-10-27T17:43:42.513660] [DEBUG] [LOCAL ] BTO: Primary data saved (8609 records). [2025-10-27T17:43:42.513896] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-27T17:43:42.514050] [INFO ] [MAIN ] Update Progress: 350/2366 symbols completed. BTO took 24.2s. Estimated remaining: 4h 11m 29s. Rate: 8.0 symbols/min [2025-10-27T17:43:42.719572] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-27T17:43:42.717084] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:43:42.741945] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T17:43:42.792254] [DEBUG] [LOCAL ] BTU: Loaded 54106 existing records from primary storage. [2025-10-27T17:43:42.792546] [INFO ] [MAIN ] BTU: Loaded 54106 existing records. [2025-10-27T17:43:42.821109] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-27T17:43:42.972040] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:43:42.972259] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-27T17:43:42.972314] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-27T17:43:42.972581] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-27T17:43:42.972631] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-27T17:43:43.331770] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:43:43.614983] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-27T17:43:44.414977] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-27T17:43:44.678772] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-27T17:43:45.214963] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-27T17:43:45.467057] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-27T17:43:45.520180] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-27T17:43:46.014938] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-27T17:43:46.814965] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-27T17:43:47.120158] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-27T17:43:47.620440] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-27T17:43:47.641851] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-27T17:43:47.681380] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T17:43:47.691823] [INFO ] [REMOTE ] BSX: Full fetch complete (77865 records). [2025-10-27T17:43:47.691951] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-27T17:43:48.111807] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-27T17:43:48.111886] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-27T17:43:48.112758] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-27T17:43:48.112822] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-27T17:43:48.114234] [DEBUG] [LOCAL ] BSX: Trimmed 77865 records to 53688 (keeping 200 days of data) [2025-10-27T17:43:48.417185] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-27T17:43:48.432729] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-10-27T17:43:48.432841] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-27T17:43:48.432937] [INFO ] [MAIN ] Update Progress: 351/2366 symbols completed. BSX took 1m 0s. Estimated remaining: 4h 11m 12s. Rate: 8.0 symbols/min [2025-10-27T17:43:48.609986] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:43:48.610162] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-27T17:43:48.610217] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-27T17:43:48.610329] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-27T17:43:48.610371] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-27T17:43:48.610414] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-27T17:43:48.610447] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-27T17:43:48.971501] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:43:49.220067] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-27T17:43:49.233147] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-27T17:43:50.014951] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-27T17:43:50.296150] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-27T17:43:50.662296] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-27T17:43:50.672682] [INFO ] [REMOTE ] BTI: Full fetch complete (77658 records). [2025-10-27T17:43:50.672839] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-27T17:43:50.820162] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-27T17:43:51.065907] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-27T17:43:51.065998] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-27T17:43:51.066838] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-27T17:43:51.066905] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-27T17:43:51.068479] [DEBUG] [LOCAL ] BTI: Trimmed 77658 records to 53583 (keeping 200 days of data) [2025-10-27T17:43:51.393710] [DEBUG] [LOCAL ] BTI: Primary data saved (53583 records). [2025-10-27T17:43:51.393880] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-27T17:43:51.394771] [INFO ] [MAIN ] Update Progress: 352/2366 symbols completed. BTI took 34.6s. Estimated remaining: 4h 10m 39s. Rate: 8.0 symbols/min [2025-10-27T17:43:51.584472] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:43:51.608081] [DEBUG] [LOCAL ] BTZ: Loaded 22639 existing records from primary storage. [2025-10-27T17:43:51.608321] [INFO ] [MAIN ] BTZ: Loaded 22639 existing records. [2025-10-27T17:43:51.628687] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-10-27T17:43:51.820247] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-27T17:43:51.823833] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:43:51.845970] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-27T17:43:51.846420] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-27T17:43:51.845871] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T17:43:51.850096] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-27T17:43:51.850242] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-27T17:43:51.914121] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:43:51.930773] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-10-27T17:43:51.952675] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:43:51.954880] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-27T17:43:51.954977] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:43:51.955102] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-27T17:43:51.960911] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-27T17:43:51.966123] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-27T17:43:51.971370] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-27T17:43:51.995152] [INFO ] [MAIN ] Update Progress: 353/2366 symbols completed. BTX took 3.6s. Estimated remaining: 4h 9m 52s. Rate: 8.1 symbols/min [2025-10-27T17:43:52.398131] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:43:52.418161] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-27T17:43:52.418088] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:43:52.469770] [DEBUG] [LOCAL ] BUD: Loaded 53363 existing records from primary storage. [2025-10-27T17:43:52.470138] [INFO ] [MAIN ] BUD: Loaded 53363 existing records. [2025-10-27T17:43:52.658089] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:43:52.658332] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-27T17:43:52.658399] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-27T17:43:52.658742] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-27T17:43:52.658802] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-27T17:43:53.012563] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:43:53.214935] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-27T17:43:53.906942] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-27T17:43:54.014916] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-27T17:43:54.132322] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T17:43:54.814921] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-27T17:43:54.997177] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T17:43:55.614973] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-27T17:43:56.414932] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-27T17:43:56.427611] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T17:43:56.749537] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-27T17:43:57.214935] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-27T17:43:57.259924] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T17:43:58.014998] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-27T17:43:58.814984] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-27T17:43:58.905217] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-27T17:43:59.373110] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T17:43:59.375927] [INFO ] [REMOTE ] BTT: Full fetch complete (22493 records). [2025-10-27T17:43:59.375999] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-27T17:43:59.577737] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T17:43:59.617561] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-27T17:43:59.791553] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-27T17:43:59.791627] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-27T17:43:59.792021] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-27T17:43:59.792071] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-27T17:43:59.792750] [DEBUG] [LOCAL ] BTT: Trimmed 22493 records to 15124 (keeping 200 days of data) [2025-10-27T17:43:59.882177] [DEBUG] [LOCAL ] BTT: Primary data saved (15124 records). [2025-10-27T17:43:59.882310] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-27T17:43:59.882389] [INFO ] [MAIN ] Update Progress: 354/2366 symbols completed. BTT took 24.9s. Estimated remaining: 4h 9m 47s. Rate: 8.1 symbols/min [2025-10-27T17:44:00.046281] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:44:00.058083] [DEBUG] [LOCAL ] BUI: Loaded 11930 existing records from primary storage. [2025-10-27T17:44:00.058376] [INFO ] [MAIN ] BUI: Loaded 11930 existing records. [2025-10-27T17:44:00.231708] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:44:00.232005] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-27T17:44:00.232057] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-27T17:44:00.232212] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-27T17:44:00.232249] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-27T17:44:00.420245] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-27T17:44:00.622614] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:44:01.214931] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-27T17:44:01.998098] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-27T17:44:02.015182] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-27T17:44:02.814975] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-27T17:44:04.038609] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (2.82 seconds). [2025-10-27T17:44:04.041475] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-27T17:44:04.615831] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-27T17:44:04.620734] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-27T17:44:04.797007] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (4.38 seconds). [2025-10-27T17:44:04.978960] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T17:44:05.052882] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (3.04 seconds). [2025-10-27T17:44:05.214944] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-27T17:44:06.015003] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-27T17:44:06.329948] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T17:44:06.650621] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T17:44:06.814985] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-27T17:44:07.326629] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-27T17:44:07.469474] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T17:44:07.614942] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-27T17:44:08.414943] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-27T17:44:08.886850] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-27T17:44:09.120621] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T17:44:09.214934] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-27T17:44:10.014922] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-27T17:44:10.322478] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-27T17:44:10.814990] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-27T17:44:11.614924] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-27T17:44:11.937716] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-27T17:44:11.962523] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T17:44:12.414992] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-27T17:44:12.923035] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-27T17:44:13.037080] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T17:44:13.214945] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-27T17:44:14.014998] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-27T17:44:14.814966] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-27T17:44:14.881391] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T17:44:15.614960] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-27T17:44:15.852357] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T17:44:16.290903] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-27T17:44:16.301755] [INFO ] [REMOTE ] BTU: Full fetch complete (77303 records). [2025-10-27T17:44:16.301907] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-27T17:44:16.420040] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-27T17:44:16.711578] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-27T17:44:16.711674] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-27T17:44:16.712499] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-27T17:44:16.712561] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-27T17:44:16.714159] [DEBUG] [LOCAL ] BTU: Trimmed 77303 records to 53318 (keeping 200 days of data) [2025-10-27T17:44:17.025960] [DEBUG] [LOCAL ] BTU: Primary data saved (53318 records). [2025-10-27T17:44:17.026089] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-27T17:44:17.026165] [INFO ] [MAIN ] Update Progress: 355/2366 symbols completed. BTU took 34.5s. Estimated remaining: 4h 10m 35s. Rate: 8.0 symbols/min [2025-10-27T17:44:17.197034] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:44:17.222794] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-27T17:44:17.248335] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T17:44:17.290945] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-27T17:44:17.296783] [DEBUG] [LOCAL ] BUR: Loaded 46177 existing records from primary storage. [2025-10-27T17:44:17.297616] [INFO ] [MAIN ] BUR: Loaded 46177 existing records. [2025-10-27T17:44:17.470090] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:44:17.470326] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-27T17:44:17.470392] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-27T17:44:17.470622] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-27T17:44:17.470730] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-27T17:44:17.818927] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:44:17.899272] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-27T17:44:18.014953] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-27T17:44:18.765742] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-27T17:44:18.814923] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-27T17:44:19.614967] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-27T17:44:19.770121] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-27T17:44:20.414990] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-27T17:44:21.099112] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T17:44:21.214952] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-27T17:44:21.980514] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T17:44:22.014940] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-27T17:44:22.197630] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-27T17:44:22.814975] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-27T17:44:23.614916] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-27T17:44:23.915882] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T17:44:24.099446] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-27T17:44:24.211632] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-27T17:44:24.214446] [INFO ] [REMOTE ] BUI: Full fetch complete (16479 records). [2025-10-27T17:44:24.214548] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-27T17:44:24.420080] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-27T17:44:24.629768] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-27T17:44:24.629923] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-27T17:44:24.630444] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-27T17:44:24.630490] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-27T17:44:24.631253] [DEBUG] [LOCAL ] BUI: Trimmed 16479 records to 11639 (keeping 200 days of data) [2025-10-27T17:44:24.712083] [DEBUG] [LOCAL ] BUI: Primary data saved (11639 records). [2025-10-27T17:44:24.712294] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-27T17:44:24.712405] [INFO ] [MAIN ] Update Progress: 356/2366 symbols completed. BUI took 24.8s. Estimated remaining: 4h 10m 28s. Rate: 8.0 symbols/min [2025-10-27T17:44:24.889756] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:44:24.938628] [DEBUG] [LOCAL ] BURL: Loaded 45994 existing records from primary storage. [2025-10-27T17:44:24.939095] [INFO ] [MAIN ] BURL: Loaded 45994 existing records. [2025-10-27T17:44:25.120197] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:44:25.120389] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-27T17:44:25.120438] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-27T17:44:25.121028] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-27T17:44:25.121304] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-27T17:44:25.223345] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-27T17:44:25.504036] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:44:25.566232] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T17:44:26.014332] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-27T17:44:26.019793] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-27T17:44:26.814952] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-27T17:44:27.343701] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T17:44:27.353778] [INFO ] [REMOTE ] BUD: Full fetch complete (76483 records). [2025-10-27T17:44:27.353911] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-27T17:44:27.620092] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-27T17:44:27.742351] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-27T17:44:27.742438] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-27T17:44:27.743327] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-27T17:44:27.743390] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-27T17:44:27.744873] [DEBUG] [LOCAL ] BUD: Trimmed 76483 records to 52580 (keeping 200 days of data) [2025-10-27T17:44:27.962288] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T17:44:28.064000] [DEBUG] [LOCAL ] BUD: Primary data saved (52580 records). [2025-10-27T17:44:28.064131] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-27T17:44:28.064207] [INFO ] [MAIN ] Update Progress: 357/2366 symbols completed. BUD took 36.1s. Estimated remaining: 4h 9m 58s. Rate: 8.0 symbols/min [2025-10-27T17:44:28.414915] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-27T17:44:29.214977] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-27T17:44:29.290390] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T17:44:29.341494] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T17:44:29.346135] [INFO ] [REMOTE ] BTZ: Full fetch complete (33191 records). [2025-10-27T17:44:29.346211] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-27T17:44:29.709963] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-27T17:44:29.710044] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-27T17:44:29.710495] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-27T17:44:29.710534] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-27T17:44:29.711428] [DEBUG] [LOCAL ] BTZ: Trimmed 33191 records to 22002 (keeping 200 days of data) [2025-10-27T17:44:29.840851] [DEBUG] [LOCAL ] BTZ: Primary data saved (22002 records). [2025-10-27T17:44:29.840973] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-27T17:44:29.841047] [INFO ] [MAIN ] Update Progress: 358/2366 symbols completed. BTZ took 38.4s. Estimated remaining: 4h 9m 18s. Rate: 8.1 symbols/min [2025-10-27T17:44:30.014944] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-27T17:44:30.238295] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-27T17:44:30.814907] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-27T17:44:31.101190] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-27T17:44:31.614991] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-27T17:44:32.022864] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-27T17:44:32.415035] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-27T17:44:32.856034] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T17:44:33.214932] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-27T17:44:33.892486] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T17:44:34.015000] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-27T17:44:34.677810] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T17:44:34.814973] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-27T17:44:35.507166] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-27T17:44:35.614965] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-27T17:44:36.197305] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T17:44:36.414983] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-27T17:44:36.925330] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T17:44:37.214944] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-27T17:44:37.929967] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T17:44:38.014939] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-27T17:44:38.538709] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T17:44:38.547855] [INFO ] [REMOTE ] BUR: Full fetch complete (64749 records). [2025-10-27T17:44:38.547972] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-27T17:44:38.933704] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-27T17:44:38.933790] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-27T17:44:38.934474] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-27T17:44:38.934516] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-27T17:44:38.935821] [DEBUG] [LOCAL ] BUR: Trimmed 64749 records to 45425 (keeping 200 days of data) [2025-10-27T17:44:39.216782] [DEBUG] [LOCAL ] BUR: Primary data saved (45425 records). [2025-10-27T17:44:39.216929] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-27T17:44:39.217060] [INFO ] [MAIN ] Update Progress: 359/2366 symbols completed. BUR took 22.2s. Estimated remaining: 4h 9m 22s. Rate: 8.0 symbols/min [2025-10-27T17:44:39.732939] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-27T17:44:39.742949] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-27T17:44:41.068098] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T17:44:41.079287] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-27T17:44:42.457894] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T17:44:42.467507] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-27T17:44:43.741856] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T17:44:43.750557] [INFO ] [REMOTE ] BURL: Full fetch complete (65746 records). [2025-10-27T17:44:43.750743] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-27T17:44:44.151951] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-27T17:44:44.152066] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-27T17:44:44.152821] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-27T17:44:44.152940] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-27T17:44:44.154227] [DEBUG] [LOCAL ] BURL: Trimmed 65746 records to 45188 (keeping 200 days of data) [2025-10-27T17:44:44.423910] [DEBUG] [LOCAL ] BURL: Primary data saved (45188 records). [2025-10-27T17:44:44.424047] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-27T17:44:44.424123] [INFO ] [MAIN ] Update Progress: 360/2366 symbols completed. BURL took 19.7s. Estimated remaining: 4h 9m 2s. Rate: 8.1 symbols/min [2025-10-27T17:44:45.099557] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:44:45.104163] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:44:45.156574] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:44:45.155556] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:44:45.173252] [DEBUG] [LOCAL ] BUXX: Loaded 15540 existing records from primary storage. [2025-10-27T17:44:45.173494] [INFO ] [MAIN ] BUXX: Loaded 15540 existing records. [2025-10-27T17:44:45.315858] [DEBUG] [LOCAL ] BV: Loaded 39038 existing records from primary storage. [2025-10-27T17:44:45.316456] [INFO ] [MAIN ] BV: Loaded 39038 existing records. [2025-10-27T17:44:45.550678] [DEBUG] [LOCAL ] BVN: Loaded 45245 existing records from primary storage. [2025-10-27T17:44:45.476132] [DEBUG] [LOCAL ] BW: Loaded 40994 existing records from primary storage. [2025-10-27T17:44:45.551156] [INFO ] [MAIN ] BVN: Loaded 45245 existing records. [2025-10-27T17:44:45.539235] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:44:45.580605] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-27T17:44:45.580496] [INFO ] [MAIN ] BW: Loaded 40994 existing records. [2025-10-27T17:44:45.601910] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-27T17:44:45.655840] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-27T17:44:45.690322] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-27T17:44:45.881280] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:44:45.904740] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-27T17:44:45.940274] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-27T17:44:46.015922] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-27T17:44:46.104244] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-27T17:44:46.079609] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:44:46.162789] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-27T17:44:46.162591] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:44:46.229243] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-27T17:44:46.250373] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-27T17:44:46.265899] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-27T17:44:46.324106] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-27T17:44:46.324219] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-27T17:44:46.349615] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-27T17:44:46.386508] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-27T17:44:46.940947] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:44:46.977978] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-27T17:44:47.358443] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:44:47.383344] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-27T17:44:47.518387] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:44:47.524112] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-27T17:44:47.563438] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:44:47.564139] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-27T17:44:47.759081] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-27T17:44:47.761919] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-27T17:44:48.513148] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T17:44:48.515804] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-27T17:44:48.727798] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T17:44:48.736844] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-27T17:44:48.939363] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T17:44:48.946082] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-27T17:44:49.167692] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-27T17:44:49.175967] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-27T17:44:49.352293] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-27T17:44:49.357062] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-27T17:44:49.792962] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T17:44:49.800684] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-27T17:44:49.938046] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-27T17:44:50.014907] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-27T17:44:50.056205] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-27T17:44:50.493290] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T17:44:50.814932] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-27T17:44:50.872219] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T17:44:50.927610] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-27T17:44:51.614919] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-27T17:44:51.766830] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T17:44:52.414950] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-27T17:44:53.112279] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T17:44:53.214915] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-27T17:44:54.020065] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-27T17:44:54.042761] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-27T17:44:54.205156] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T17:44:54.814971] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-27T17:44:55.119628] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-27T17:44:55.367600] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-27T17:44:55.614981] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-27T17:44:56.186591] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-27T17:44:56.414969] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-27T17:44:57.215067] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-27T17:44:57.236709] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T17:44:58.014933] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-27T17:44:58.348223] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-27T17:44:58.814957] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-27T17:44:59.159838] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-27T17:44:59.614960] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-27T17:45:00.367965] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-27T17:45:00.415068] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-27T17:45:01.138248] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T17:45:01.214952] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-27T17:45:02.015056] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-27T17:45:02.815060] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-27T17:45:03.365603] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (2.95 seconds). [2025-10-27T17:45:03.614963] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-27T17:45:03.795957] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T17:45:04.227893] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (3.01 seconds). [2025-10-27T17:45:04.414936] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-27T17:45:04.483915] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-27T17:45:05.214965] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-27T17:45:05.358816] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-27T17:45:05.444506] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-27T17:45:06.015023] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-27T17:45:06.442045] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T17:45:06.815044] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-27T17:45:07.530152] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T17:45:07.533125] [INFO ] [REMOTE ] BUXX: Full fetch complete (20695 records). [2025-10-27T17:45:07.533199] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-27T17:45:07.534608] [FATAL] [VALIDATOR ] BUXX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:45:07.534906] [FATAL] [MAIN ] BUXX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:45:07.534957] [WARN ] [MAIN ] BUXX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:45:07.535008] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-27T17:45:07.535085] [DEBUG] [LOCAL ] BUXX: No primary data file found to delete. [2025-10-27T17:45:07.535125] [INFO ] [LOCAL ] BUXX: Starting deletion of derivative data. [2025-10-27T17:45:07.535405] [DEBUG] [LOCAL ] BUXX: Deleted derivative data file. [2025-10-27T17:45:07.535543] [INFO ] [MAIN ] Update Progress: 361/2366 symbols completed. BUXX took 23.1s. Estimated remaining: 4h 10m 21s. Rate: 8.0 symbols/min [2025-10-27T17:45:07.615295] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-27T17:45:07.718833] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T17:45:07.754862] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:45:07.756238] [INFO ] [REMOTE ] BV: Full fetch complete (54875 records). [2025-10-27T17:45:07.756528] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-27T17:45:07.757499] [FATAL] [VALIDATOR ] BV: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:45:07.757592] [FATAL] [MAIN ] BV: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:45:07.757636] [WARN ] [MAIN ] BV: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:45:07.757742] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-27T17:45:07.757826] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-10-27T17:45:07.757932] [INFO ] [LOCAL ] BV: Starting deletion of derivative data. [2025-10-27T17:45:07.758176] [DEBUG] [LOCAL ] BV: Deleted derivative data file. [2025-10-27T17:45:07.758276] [INFO ] [MAIN ] Update Progress: 362/2366 symbols completed. BV took 23.3s. Estimated remaining: 4h 9m 33s. Rate: 8.0 symbols/min [2025-10-27T17:45:07.929126] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:45:07.976003] [DEBUG] [LOCAL ] BWA: Loaded 52824 existing records from primary storage. [2025-10-27T17:45:07.976434] [INFO ] [MAIN ] BWA: Loaded 52824 existing records. [2025-10-27T17:45:08.054335] [DEBUG] [LOCAL ] BWG: Loaded 12755 existing records from primary storage. [2025-10-27T17:45:08.075731] [INFO ] [MAIN ] BWG: Loaded 12755 existing records. [2025-10-27T17:45:08.375688] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:45:08.380916] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:45:08.381296] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-27T17:45:08.381515] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-27T17:45:08.381605] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-27T17:45:08.381796] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-27T17:45:08.382106] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-27T17:45:08.382202] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-27T17:45:08.413169] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-27T17:45:08.444630] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-27T17:45:08.444415] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-27T17:45:09.048700] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:45:09.129057] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:45:09.162976] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-27T17:45:09.214905] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-27T17:45:09.840846] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-27T17:45:10.014974] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-27T17:45:10.814956] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-27T17:45:10.854409] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T17:45:11.541612] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-27T17:45:11.614907] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-27T17:45:12.101559] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-27T17:45:12.415009] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-27T17:45:13.214961] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-27T17:45:13.550086] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-27T17:45:13.559121] [INFO ] [REMOTE ] BW: Full fetch complete (59300 records). [2025-10-27T17:45:13.559247] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-27T17:45:13.958365] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-27T17:45:13.958545] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-27T17:45:13.959233] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-27T17:45:13.959324] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-27T17:45:13.960984] [DEBUG] [LOCAL ] BW: Trimmed 59300 records to 40358 (keeping 200 days of data) [2025-10-27T17:45:14.016383] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-27T17:45:14.104337] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-27T17:45:14.226023] [DEBUG] [LOCAL ] BW: Primary data saved (40358 records). [2025-10-27T17:45:14.226144] [INFO ] [MAIN ] BW: Full history saved. [2025-10-27T17:45:14.226216] [INFO ] [MAIN ] Update Progress: 363/2366 symbols completed. BW took 29.8s. Estimated remaining: 4h 9m 20s. Rate: 8.0 symbols/min [2025-10-27T17:45:14.400710] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:45:14.429127] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T17:45:14.472935] [DEBUG] [LOCAL ] BWLP: Loaded 32471 existing records from primary storage. [2025-10-27T17:45:14.473224] [INFO ] [MAIN ] BWLP: Loaded 32471 existing records. [2025-10-27T17:45:14.664053] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T17:45:14.669205] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:45:14.672241] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-27T17:45:14.672297] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-27T17:45:14.672448] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-27T17:45:14.672487] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-27T17:45:14.822866] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-27T17:45:15.035536] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:45:15.386868] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T17:45:15.614972] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-27T17:45:16.401294] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-27T17:45:16.414890] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-27T17:45:17.214942] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-27T17:45:17.471705] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-27T17:45:18.015007] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-27T17:45:18.699413] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T17:45:18.814967] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-27T17:45:19.426498] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T17:45:19.614997] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-27T17:45:20.415008] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-27T17:45:20.626234] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-27T17:45:20.635389] [INFO ] [REMOTE ] BVN: Full fetch complete (63310 records). [2025-10-27T17:45:20.635532] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-27T17:45:20.636262] [FATAL] [VALIDATOR ] BVN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:45:20.636351] [FATAL] [MAIN ] BVN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:45:20.636393] [WARN ] [MAIN ] BVN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:45:20.636431] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-27T17:45:20.636486] [DEBUG] [LOCAL ] BVN: No primary data file found to delete. [2025-10-27T17:45:20.636520] [INFO ] [LOCAL ] BVN: Starting deletion of derivative data. [2025-10-27T17:45:20.636674] [DEBUG] [LOCAL ] BVN: Deleted derivative data file. [2025-10-27T17:45:20.636763] [INFO ] [MAIN ] Update Progress: 364/2366 symbols completed. BVN took 36.2s. Estimated remaining: 4h 9m 7s. Rate: 8.0 symbols/min [2025-10-27T17:45:20.809670] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:45:20.820343] [DEBUG] [LOCAL ] BWMX: Loaded 7964 existing records from primary storage. [2025-10-27T17:45:20.820566] [INFO ] [MAIN ] BWMX: Loaded 7964 existing records. [2025-10-27T17:45:21.004744] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:45:21.005043] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-27T17:45:21.005209] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-27T17:45:21.005425] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-27T17:45:21.005495] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-27T17:45:21.222526] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-27T17:45:21.384910] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-27T17:45:21.422339] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:45:21.956738] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T17:45:21.981757] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T17:45:22.014900] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-27T17:45:22.814967] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-27T17:45:23.055189] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-27T17:45:23.374570] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-27T17:45:23.614981] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-27T17:45:23.947808] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-27T17:45:24.415001] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-27T17:45:25.142825] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T17:45:25.214945] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-27T17:45:26.014955] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-27T17:45:26.459507] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T17:45:26.820221] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-27T17:45:26.833737] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-27T17:45:27.614944] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-27T17:45:28.326540] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-27T17:45:28.414904] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-27T17:45:28.513837] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T17:45:29.214945] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-27T17:45:29.777827] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T17:45:29.817335] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T17:45:30.014935] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-27T17:45:30.603207] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T17:45:30.814903] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-27T17:45:31.614965] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-27T17:45:32.052047] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-27T17:45:32.418288] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-27T17:45:32.424030] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-27T17:45:32.864325] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T17:45:33.214949] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-27T17:45:34.014925] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-27T17:45:34.037883] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-27T17:45:34.040032] [INFO ] [REMOTE ] BWG: Full fetch complete (17581 records). [2025-10-27T17:45:34.040122] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-27T17:45:34.405549] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-27T17:45:34.405631] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-27T17:45:34.406003] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-27T17:45:34.406050] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-27T17:45:34.406745] [DEBUG] [LOCAL ] BWG: Trimmed 17581 records to 12426 (keeping 200 days of data) [2025-10-27T17:45:34.476665] [DEBUG] [LOCAL ] BWG: Primary data saved (12426 records). [2025-10-27T17:45:34.476799] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-27T17:45:34.476875] [INFO ] [MAIN ] Update Progress: 365/2366 symbols completed. BWG took 26.7s. Estimated remaining: 4h 9m 35s. Rate: 8.0 symbols/min [2025-10-27T17:45:34.642510] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:45:34.648136] [DEBUG] [LOCAL ] BWNB: Loaded 4083 existing records from primary storage. [2025-10-27T17:45:34.648323] [INFO ] [MAIN ] BWNB: Loaded 4083 existing records. [2025-10-27T17:45:34.821968] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-27T17:45:34.827066] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:45:34.828143] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-27T17:45:34.828199] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-27T17:45:34.828323] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-27T17:45:34.828360] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-27T17:45:35.194007] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:45:35.483673] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T17:45:35.614986] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-27T17:45:35.918069] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-27T17:45:36.306482] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T17:45:36.414926] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-27T17:45:37.214991] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-27T17:45:37.655981] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T17:45:38.014980] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-27T17:45:38.473156] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T17:45:38.490719] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-27T17:45:38.815008] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-27T17:45:39.614951] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-27T17:45:40.414972] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-27T17:45:40.584993] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T17:45:40.630817] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-27T17:45:40.640745] [INFO ] [REMOTE ] BWA: Full fetch complete (75881 records). [2025-10-27T17:45:40.640879] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-27T17:45:40.838019] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-27T17:45:41.044838] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-27T17:45:41.044925] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-27T17:45:41.045729] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-27T17:45:41.045790] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-27T17:45:41.047107] [DEBUG] [LOCAL ] BWA: Trimmed 75881 records to 52031 (keeping 200 days of data) [2025-10-27T17:45:41.217384] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-27T17:45:41.355882] [DEBUG] [LOCAL ] BWA: Primary data saved (52031 records). [2025-10-27T17:45:41.356014] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-27T17:45:41.356087] [INFO ] [MAIN ] Update Progress: 366/2366 symbols completed. BWA took 33.8s. Estimated remaining: 4h 9m 24s. Rate: 8.0 symbols/min [2025-10-27T17:45:41.522716] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:45:41.528771] [DEBUG] [LOCAL ] BWSN: Loaded 5117 existing records from primary storage. [2025-10-27T17:45:41.528943] [INFO ] [MAIN ] BWSN: Loaded 5117 existing records. [2025-10-27T17:45:41.727002] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:45:41.727220] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-27T17:45:41.727276] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-27T17:45:41.727410] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-27T17:45:41.727446] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-27T17:45:42.020096] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-27T17:45:42.079395] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:45:42.269960] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T17:45:42.748082] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-27T17:45:42.814969] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-27T17:45:43.425549] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-27T17:45:43.614954] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-27T17:45:44.194538] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T17:45:44.414970] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-27T17:45:44.838363] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-27T17:45:45.214941] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-27T17:45:45.713935] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-27T17:45:46.014996] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-27T17:45:46.654620] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T17:45:46.814952] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-27T17:45:47.614992] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-27T17:45:48.283222] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-27T17:45:48.302680] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T17:45:48.414918] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-27T17:45:49.215045] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-27T17:45:49.471489] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T17:45:49.598889] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-27T17:45:50.014992] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-27T17:45:50.814975] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-27T17:45:50.824255] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-27T17:45:50.826157] [INFO ] [REMOTE ] BWMX: Full fetch complete (10000 records). [2025-10-27T17:45:50.826248] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-27T17:45:51.192139] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-27T17:45:51.192218] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-27T17:45:51.192447] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-27T17:45:51.192487] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-27T17:45:51.192925] [DEBUG] [LOCAL ] BWMX: Trimmed 10000 records to 7931 (keeping 200 days of data) [2025-10-27T17:45:51.239916] [DEBUG] [LOCAL ] BWMX: Primary data saved (7931 records). [2025-10-27T17:45:51.240039] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-27T17:45:51.240132] [INFO ] [MAIN ] Update Progress: 367/2366 symbols completed. BWMX took 30.6s. Estimated remaining: 4h 9m 29s. Rate: 8.0 symbols/min [2025-10-27T17:45:51.406177] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:45:51.442807] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-27T17:45:51.458758] [DEBUG] [LOCAL ] BWXT: Loaded 47929 existing records from primary storage. [2025-10-27T17:45:51.459077] [INFO ] [MAIN ] BWXT: Loaded 47929 existing records. [2025-10-27T17:45:51.626435] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-27T17:45:51.631484] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:45:51.632403] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-27T17:45:51.632453] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-27T17:45:51.632756] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-27T17:45:51.632812] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-27T17:45:51.986830] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:45:52.202672] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-27T17:45:52.414928] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-27T17:45:53.214987] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-27T17:45:53.308834] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-27T17:45:53.617440] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-27T17:45:54.014990] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-27T17:45:54.310560] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-27T17:45:54.814946] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-27T17:45:55.614981] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-27T17:45:56.286841] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-27T17:45:56.414987] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-27T17:45:56.500518] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-27T17:45:57.214988] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-27T17:45:57.353773] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-27T17:45:57.360290] [INFO ] [REMOTE ] BWLP: Full fetch complete (47595 records). [2025-10-27T17:45:57.360456] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-27T17:45:57.361169] [FATAL] [VALIDATOR ] BWLP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:45:57.361290] [FATAL] [MAIN ] BWLP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:45:57.361358] [WARN ] [MAIN ] BWLP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:45:57.361405] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-27T17:45:57.361462] [DEBUG] [LOCAL ] BWLP: No primary data file found to delete. [2025-10-27T17:45:57.361719] [INFO ] [LOCAL ] BWLP: Starting deletion of derivative data. [2025-10-27T17:45:57.361870] [DEBUG] [LOCAL ] BWLP: Deleted derivative data file. [2025-10-27T17:45:57.361943] [INFO ] [MAIN ] Update Progress: 368/2366 symbols completed. BWLP took 43.1s. Estimated remaining: 4h 9m 15s. Rate: 8.0 symbols/min [2025-10-27T17:45:57.537705] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:45:57.594782] [DEBUG] [LOCAL ] BX: Loaded 54263 existing records from primary storage. [2025-10-27T17:45:57.595282] [INFO ] [MAIN ] BX: Loaded 54263 existing records. [2025-10-27T17:45:57.741324] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-27T17:45:57.795977] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:45:57.796213] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-27T17:45:57.796259] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-27T17:45:57.796445] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-27T17:45:57.796482] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-27T17:45:58.021442] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-27T17:45:58.146049] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:45:58.814992] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-27T17:45:59.448586] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T17:45:59.614945] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-27T17:46:00.414930] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-27T17:46:00.535388] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-27T17:46:01.214988] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-27T17:46:01.873261] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-27T17:46:02.014967] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-27T17:46:02.815045] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-27T17:46:03.874374] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-27T17:46:03.875882] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-27T17:46:04.043489] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (3.63 seconds). [2025-10-27T17:46:04.415001] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-27T17:46:04.834623] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-27T17:46:05.110171] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (3.10 seconds). [2025-10-27T17:46:05.207351] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-27T17:46:05.217957] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-27T17:46:05.620005] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-27T17:46:05.621350] [INFO ] [REMOTE ] BWNB: Full fetch complete (5587 records). [2025-10-27T17:46:05.621442] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-27T17:46:06.008223] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-27T17:46:06.008344] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-27T17:46:06.008527] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-27T17:46:06.008569] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-27T17:46:06.009008] [DEBUG] [LOCAL ] BWNB: Trimmed 5587 records to 4033 (keeping 200 days of data) [2025-10-27T17:46:06.019287] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-27T17:46:06.034087] [DEBUG] [LOCAL ] BWNB: Primary data saved (4033 records). [2025-10-27T17:46:06.034162] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-27T17:46:06.034235] [INFO ] [MAIN ] Update Progress: 369/2366 symbols completed. BWNB took 31.6s. Estimated remaining: 4h 9m 13s. Rate: 8.0 symbols/min [2025-10-27T17:46:06.211920] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:46:06.213539] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T17:46:06.215834] [INFO ] [REMOTE ] BWSN: Full fetch complete (6430 records). [2025-10-27T17:46:06.215965] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-27T17:46:06.357807] [DEBUG] [LOCAL ] BXC: Loaded 13507 existing records from primary storage. [2025-10-27T17:46:06.368556] [INFO ] [MAIN ] BXC: Loaded 13507 existing records. [2025-10-27T17:46:06.734856] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:46:06.745447] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-27T17:46:06.750722] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-27T17:46:06.784149] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-27T17:46:06.791025] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-27T17:46:06.825356] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-27T17:46:06.825556] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-27T17:46:06.846394] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-27T17:46:06.852770] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-27T17:46:06.879315] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-27T17:46:06.917908] [DEBUG] [LOCAL ] BWSN: Trimmed 6430 records to 5047 (keeping 200 days of data) [2025-10-27T17:46:07.019340] [DEBUG] [LOCAL ] BWSN: Primary data saved (5047 records). [2025-10-27T17:46:07.040540] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-27T17:46:07.071591] [INFO ] [MAIN ] Update Progress: 370/2366 symbols completed. BWSN took 25.7s. Estimated remaining: 4h 8m 31s. Rate: 8.0 symbols/min [2025-10-27T17:46:07.360871] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:46:07.387149] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:46:07.428377] [DEBUG] [LOCAL ] BXMT: Loaded 47958 existing records from primary storage. [2025-10-27T17:46:07.428693] [INFO ] [MAIN ] BXMT: Loaded 47958 existing records. [2025-10-27T17:46:07.606215] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:46:07.606416] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-27T17:46:07.606461] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-27T17:46:07.606722] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-27T17:46:07.606777] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-27T17:46:07.637011] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-27T17:46:07.958397] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:46:08.415010] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-27T17:46:08.558380] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-27T17:46:08.600634] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-27T17:46:08.624050] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-27T17:46:09.214990] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-27T17:46:09.774420] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T17:46:10.014962] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-27T17:46:10.642678] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-27T17:46:10.814988] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-27T17:46:11.252833] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T17:46:11.614999] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-27T17:46:12.176939] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-27T17:46:12.414941] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-27T17:46:12.444825] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-27T17:46:13.214991] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-27T17:46:13.774945] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T17:46:14.014934] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-27T17:46:14.506576] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-27T17:46:14.814978] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-27T17:46:15.614933] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-27T17:46:15.618078] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T17:46:16.415016] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-27T17:46:17.062582] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-27T17:46:17.085247] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-27T17:46:17.220517] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-27T17:46:17.225685] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T17:46:18.014983] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-27T17:46:18.654605] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T17:46:18.814936] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-27T17:46:19.400032] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T17:46:19.614952] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-27T17:46:20.384498] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-27T17:46:20.414906] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-27T17:46:21.028469] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T17:46:21.132125] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-27T17:46:21.214907] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-27T17:46:21.794095] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-27T17:46:22.014932] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-27T17:46:22.815000] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-27T17:46:23.614936] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-27T17:46:23.970615] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-27T17:46:24.179263] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-27T17:46:24.387353] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T17:46:24.396515] [INFO ] [REMOTE ] BWXT: Full fetch complete (67748 records). [2025-10-27T17:46:24.396633] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-27T17:46:24.397391] [FATAL] [VALIDATOR ] BWXT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:46:24.397478] [FATAL] [MAIN ] BWXT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:46:24.397522] [WARN ] [MAIN ] BWXT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:46:24.397599] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-27T17:46:24.397687] [DEBUG] [LOCAL ] BWXT: No primary data file found to delete. [2025-10-27T17:46:24.397761] [INFO ] [LOCAL ] BWXT: Starting deletion of derivative data. [2025-10-27T17:46:24.397947] [DEBUG] [LOCAL ] BWXT: Deleted derivative data file. [2025-10-27T17:46:24.398039] [INFO ] [MAIN ] Update Progress: 371/2366 symbols completed. BWXT took 33.2s. Estimated remaining: 4h 9m 17s. Rate: 8.0 symbols/min [2025-10-27T17:46:24.420055] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-27T17:46:24.577054] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:46:24.596626] [DEBUG] [LOCAL ] BXMX: Loaded 19411 existing records from primary storage. [2025-10-27T17:46:24.596909] [INFO ] [MAIN ] BXMX: Loaded 19411 existing records. [2025-10-27T17:46:24.774126] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:46:24.774292] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-27T17:46:24.774339] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-27T17:46:24.774509] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-27T17:46:24.774549] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-27T17:46:25.123618] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:46:25.214937] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-27T17:46:25.946681] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T17:46:25.980831] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T17:46:26.014904] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-27T17:46:26.814951] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-27T17:46:27.614907] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-27T17:46:27.841559] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T17:46:27.924628] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-27T17:46:28.414959] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-27T17:46:28.846212] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T17:46:29.215001] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-27T17:46:30.018252] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-27T17:46:30.024266] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-27T17:46:30.035121] [INFO ] [REMOTE ] BX: Full fetch complete (77613 records). [2025-10-27T17:46:30.035274] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-27T17:46:30.440790] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-27T17:46:30.440874] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-27T17:46:30.441689] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-27T17:46:30.441753] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-27T17:46:30.443261] [DEBUG] [LOCAL ] BX: Trimmed 77613 records to 53483 (keeping 200 days of data) [2025-10-27T17:46:30.770718] [DEBUG] [LOCAL ] BX: Primary data saved (53483 records). [2025-10-27T17:46:30.770989] [INFO ] [MAIN ] BX: Full history saved. [2025-10-27T17:46:30.771890] [INFO ] [MAIN ] Update Progress: 372/2366 symbols completed. BX took 33.4s. Estimated remaining: 4h 9m 3s. Rate: 8.0 symbols/min [2025-10-27T17:46:30.835263] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-27T17:46:30.944188] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:46:30.956309] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T17:46:30.988943] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-27T17:46:31.037241] [DEBUG] [LOCAL ] BXP: Loaded 50526 existing records from primary storage. [2025-10-27T17:46:31.037544] [INFO ] [MAIN ] BXP: Loaded 50526 existing records. [2025-10-27T17:46:31.219576] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:46:31.219828] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-27T17:46:31.219875] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-27T17:46:31.220109] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-27T17:46:31.220147] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-27T17:46:31.582389] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:46:31.596024] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-27T17:46:31.614903] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-27T17:46:32.414930] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-27T17:46:32.977872] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T17:46:33.220044] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-27T17:46:33.232128] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T17:46:34.014937] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-27T17:46:34.728139] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T17:46:34.814996] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-27T17:46:34.872358] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-27T17:46:35.464896] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-27T17:46:35.614981] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-27T17:46:36.351304] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T17:46:36.354009] [INFO ] [REMOTE ] BXC: Full fetch complete (18227 records). [2025-10-27T17:46:36.354084] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-27T17:46:36.354489] [FATAL] [VALIDATOR ] BXC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:46:36.354592] [FATAL] [MAIN ] BXC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:46:36.354674] [WARN ] [MAIN ] BXC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:46:36.354739] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-27T17:46:36.354797] [DEBUG] [LOCAL ] BXC: No primary data file found to delete. [2025-10-27T17:46:36.354832] [INFO ] [LOCAL ] BXC: Starting deletion of derivative data. [2025-10-27T17:46:36.354968] [DEBUG] [LOCAL ] BXC: Deleted derivative data file. [2025-10-27T17:46:36.355055] [INFO ] [MAIN ] Update Progress: 373/2366 symbols completed. BXC took 30.3s. Estimated remaining: 4h 8m 46s. Rate: 8.0 symbols/min [2025-10-27T17:46:36.425358] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-27T17:46:36.544474] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:46:36.588545] [DEBUG] [LOCAL ] BXSL: Loaded 48967 existing records from primary storage. [2025-10-27T17:46:36.588941] [INFO ] [MAIN ] BXSL: Loaded 48967 existing records. [2025-10-27T17:46:36.786838] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:46:36.787028] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-27T17:46:36.787100] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-27T17:46:36.787322] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-27T17:46:36.787369] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-27T17:46:37.172745] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:46:37.214898] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-27T17:46:38.014923] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-27T17:46:38.165112] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-27T17:46:38.699534] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T17:46:38.814969] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-27T17:46:39.401458] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T17:46:39.614957] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-27T17:46:39.930320] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T17:46:40.414939] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-27T17:46:41.214935] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-27T17:46:41.396746] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-27T17:46:41.961022] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T17:46:42.014900] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-27T17:46:42.439862] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-27T17:46:42.815061] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-27T17:46:43.614923] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-27T17:46:43.839990] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-27T17:46:43.851233] [INFO ] [REMOTE ] BXMT: Full fetch complete (69841 records). [2025-10-27T17:46:43.851395] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-27T17:46:44.339162] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-27T17:46:44.339239] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-27T17:46:44.340109] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-27T17:46:44.340185] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-27T17:46:44.341721] [DEBUG] [LOCAL ] BXMT: Trimmed 69841 records to 47144 (keeping 200 days of data) [2025-10-27T17:46:44.415020] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-27T17:46:44.596397] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-27T17:46:44.673935] [DEBUG] [LOCAL ] BXMT: Primary data saved (47144 records). [2025-10-27T17:46:44.674053] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-27T17:46:44.674126] [INFO ] [MAIN ] Update Progress: 374/2366 symbols completed. BXMT took 37.6s. Estimated remaining: 4h 8m 42s. Rate: 8.0 symbols/min [2025-10-27T17:46:44.839729] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:46:44.860873] [DEBUG] [LOCAL ] BY: Loaded 22005 existing records from primary storage. [2025-10-27T17:46:44.861105] [INFO ] [MAIN ] BY: Loaded 22005 existing records. [2025-10-27T17:46:45.043130] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:46:45.043329] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-27T17:46:45.043377] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-27T17:46:45.043570] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-27T17:46:45.043694] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-27T17:46:45.231576] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-27T17:46:45.410259] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:46:45.438756] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-27T17:46:45.455072] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T17:46:46.014996] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-27T17:46:46.612735] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-27T17:46:46.809221] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-27T17:46:46.814887] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-27T17:46:47.614942] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-27T17:46:47.657927] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-27T17:46:48.414979] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-27T17:46:48.918441] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T17:46:49.214998] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-27T17:46:49.761429] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T17:46:50.014962] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-27T17:46:50.205551] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T17:46:50.814996] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-27T17:46:51.607415] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T17:46:51.616964] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-27T17:46:52.299628] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-27T17:46:52.414944] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-27T17:46:52.643842] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-27T17:46:53.215035] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-27T17:46:53.438570] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-27T17:46:53.858558] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-27T17:46:54.015026] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-27T17:46:54.814989] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-27T17:46:55.240727] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-27T17:46:55.245789] [INFO ] [REMOTE ] BXMX: Full fetch complete (28556 records). [2025-10-27T17:46:55.245939] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-27T17:46:55.448948] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-27T17:46:55.616707] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-27T17:46:55.652454] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-27T17:46:55.652715] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-27T17:46:55.653267] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-27T17:46:55.653328] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-27T17:46:55.654192] [DEBUG] [LOCAL ] BXMX: Trimmed 28556 records to 18764 (keeping 200 days of data) [2025-10-27T17:46:55.766486] [DEBUG] [LOCAL ] BXMX: Primary data saved (18764 records). [2025-10-27T17:46:55.766675] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-27T17:46:55.766779] [INFO ] [MAIN ] Update Progress: 375/2366 symbols completed. BXMX took 31.4s. Estimated remaining: 4h 8m 54s. Rate: 8.0 symbols/min [2025-10-27T17:46:55.934399] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:46:55.975692] [DEBUG] [LOCAL ] BYD: Loaded 45697 existing records from primary storage. [2025-10-27T17:46:55.975977] [INFO ] [MAIN ] BYD: Loaded 45697 existing records. [2025-10-27T17:46:56.161317] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:46:56.161538] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-27T17:46:56.161584] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-27T17:46:56.161847] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-27T17:46:56.161903] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-27T17:46:56.421421] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-27T17:46:56.514990] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:46:56.752609] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-27T17:46:57.214941] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-27T17:46:57.719578] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-27T17:46:58.015018] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-27T17:46:58.814980] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-27T17:46:59.174753] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-27T17:46:59.245525] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T17:46:59.615007] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-27T17:46:59.774586] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-27T17:47:00.414942] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-27T17:47:01.215025] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-27T17:47:02.015034] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-27T17:47:02.043010] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-27T17:47:02.814930] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-27T17:47:03.677202] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (3.26 seconds). [2025-10-27T17:47:03.681902] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-27T17:47:04.186395] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (2.97 seconds). [2025-10-27T17:47:04.197007] [INFO ] [REMOTE ] BXP: Full fetch complete (71851 records). [2025-10-27T17:47:04.197314] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-27T17:47:04.200189] [FATAL] [VALIDATOR ] BXP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:47:04.200401] [FATAL] [MAIN ] BXP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:47:04.200449] [WARN ] [MAIN ] BXP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:47:04.200495] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-27T17:47:04.200561] [DEBUG] [LOCAL ] BXP: No primary data file found to delete. [2025-10-27T17:47:04.200598] [INFO ] [LOCAL ] BXP: Starting deletion of derivative data. [2025-10-27T17:47:04.200760] [DEBUG] [LOCAL ] BXP: Deleted derivative data file. [2025-10-27T17:47:04.201447] [INFO ] [MAIN ] Update Progress: 376/2366 symbols completed. BXP took 33.4s. Estimated remaining: 4h 8m 52s. Rate: 8.0 symbols/min [2025-10-27T17:47:04.466114] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:47:04.485977] [DEBUG] [LOCAL ] BYM: Loaded 11502 existing records from primary storage. [2025-10-27T17:47:04.486345] [INFO ] [MAIN ] BYM: Loaded 11502 existing records. [2025-10-27T17:47:04.745309] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (2.73 seconds). [2025-10-27T17:47:04.792749] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:47:04.793743] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-27T17:47:04.794058] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-27T17:47:04.794885] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-27T17:47:04.795094] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-27T17:47:04.795164] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-27T17:47:05.194732] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:47:05.218311] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-27T17:47:05.223694] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-27T17:47:05.542148] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-27T17:47:05.904738] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T17:47:06.014944] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-27T17:47:06.544856] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-27T17:47:06.545785] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-27T17:47:06.814964] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-27T17:47:07.614938] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-27T17:47:08.414962] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-27T17:47:08.626880] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-27T17:47:08.630973] [INFO ] [REMOTE ] BY: Full fetch complete (29556 records). [2025-10-27T17:47:08.631051] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-27T17:47:08.631529] [FATAL] [VALIDATOR ] BY: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:47:08.631621] [FATAL] [MAIN ] BY: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:47:08.631699] [WARN ] [MAIN ] BY: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:47:08.631749] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-27T17:47:08.631805] [DEBUG] [LOCAL ] BY: No primary data file found to delete. [2025-10-27T17:47:08.631841] [INFO ] [LOCAL ] BY: Starting deletion of derivative data. [2025-10-27T17:47:08.632002] [DEBUG] [LOCAL ] BY: Deleted derivative data file. [2025-10-27T17:47:08.632096] [INFO ] [MAIN ] Update Progress: 377/2366 symbols completed. BY took 24.0s. Estimated remaining: 4h 8m 28s. Rate: 8.0 symbols/min [2025-10-27T17:47:08.811124] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:47:08.840377] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-27T17:47:08.875228] [DEBUG] [LOCAL ] BZH: Loaded 32434 existing records from primary storage. [2025-10-27T17:47:08.875508] [INFO ] [MAIN ] BZH: Loaded 32434 existing records. [2025-10-27T17:47:09.055176] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:47:09.055402] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-27T17:47:09.055451] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-27T17:47:09.055677] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-27T17:47:09.055735] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-27T17:47:09.232208] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-27T17:47:09.352293] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T17:47:09.437823] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:47:10.014985] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-27T17:47:10.540670] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-27T17:47:10.814906] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-27T17:47:10.868710] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T17:47:11.614934] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-27T17:47:12.079799] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T17:47:12.415010] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-27T17:47:12.740134] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T17:47:13.214937] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-27T17:47:14.014939] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-27T17:47:14.467877] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T17:47:14.565677] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-27T17:47:14.575245] [INFO ] [REMOTE ] BXSL: Full fetch complete (69765 records). [2025-10-27T17:47:14.575362] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-27T17:47:14.576111] [FATAL] [VALIDATOR ] BXSL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:47:14.576200] [FATAL] [MAIN ] BXSL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:47:14.576243] [WARN ] [MAIN ] BXSL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:47:14.576314] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-27T17:47:14.576394] [DEBUG] [LOCAL ] BXSL: No primary data file found to delete. [2025-10-27T17:47:14.576441] [INFO ] [LOCAL ] BXSL: Starting deletion of derivative data. [2025-10-27T17:47:14.576699] [DEBUG] [LOCAL ] BXSL: Deleted derivative data file. [2025-10-27T17:47:14.577193] [INFO ] [MAIN ] Update Progress: 378/2366 symbols completed. BXSL took 38.2s. Estimated remaining: 4h 8m 12s. Rate: 8.0 symbols/min [2025-10-27T17:47:14.742927] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:47:14.793695] [DEBUG] [LOCAL ] C: Loaded 54521 existing records from primary storage. [2025-10-27T17:47:14.793992] [INFO ] [MAIN ] C: Loaded 54521 existing records. [2025-10-27T17:47:14.824178] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-27T17:47:14.971480] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:47:14.971714] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-27T17:47:14.971785] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-27T17:47:14.972004] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-27T17:47:14.972060] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-27T17:47:15.356411] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:47:15.381158] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T17:47:15.541030] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-27T17:47:15.614921] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-27T17:47:16.414968] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-27T17:47:16.511065] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-27T17:47:17.214939] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-27T17:47:17.745627] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-27T17:47:18.014932] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-27T17:47:18.363393] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-27T17:47:18.597480] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-27T17:47:18.814945] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-27T17:47:19.615004] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-27T17:47:20.252072] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T17:47:20.414972] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-27T17:47:20.470053] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T17:47:20.472493] [INFO ] [REMOTE ] BYM: Full fetch complete (17196 records). [2025-10-27T17:47:20.472563] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-27T17:47:20.833923] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-27T17:47:20.833999] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-27T17:47:20.834378] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-27T17:47:20.834416] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-27T17:47:20.834949] [DEBUG] [LOCAL ] BYM: Trimmed 17196 records to 11121 (keeping 200 days of data) [2025-10-27T17:47:20.900439] [DEBUG] [LOCAL ] BYM: Primary data saved (11121 records). [2025-10-27T17:47:20.900566] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-27T17:47:20.900660] [INFO ] [MAIN ] Update Progress: 379/2366 symbols completed. BYM took 16.7s. Estimated remaining: 4h 7m 59s. Rate: 8.0 symbols/min [2025-10-27T17:47:21.064548] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:47:21.086279] [DEBUG] [LOCAL ] CAAP: Loaded 20243 existing records from primary storage. [2025-10-27T17:47:21.086520] [INFO ] [MAIN ] CAAP: Loaded 20243 existing records. [2025-10-27T17:47:21.222154] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-27T17:47:21.261953] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:47:21.262151] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-27T17:47:21.262208] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-27T17:47:21.262436] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-27T17:47:21.262492] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-27T17:47:21.605300] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:47:21.839920] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T17:47:22.014958] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-27T17:47:22.814916] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-27T17:47:22.865587] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T17:47:23.597818] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-27T17:47:23.614903] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-27T17:47:23.851214] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-27T17:47:24.414984] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-27T17:47:24.885021] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-27T17:47:25.214944] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-27T17:47:26.014937] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-27T17:47:26.367854] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-27T17:47:26.658843] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T17:47:26.727079] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-27T17:47:26.814920] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-27T17:47:27.614998] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-27T17:47:28.138115] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T17:47:28.293909] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T17:47:28.414939] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-27T17:47:29.214938] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-27T17:47:29.323213] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-27T17:47:30.014977] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-27T17:47:30.106067] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-27T17:47:30.815015] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-27T17:47:31.532035] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-27T17:47:31.614913] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-27T17:47:31.673698] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-27T17:47:32.414985] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-27T17:47:32.653343] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T17:47:33.214991] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-27T17:47:33.767338] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T17:47:33.775636] [INFO ] [REMOTE ] BYD: Full fetch complete (65248 records). [2025-10-27T17:47:33.775781] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-27T17:47:33.776450] [FATAL] [VALIDATOR ] BYD: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:47:33.776531] [FATAL] [MAIN ] BYD: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:47:33.776573] [WARN ] [MAIN ] BYD: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:47:33.776609] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-27T17:47:33.776691] [DEBUG] [LOCAL ] BYD: No primary data file found to delete. [2025-10-27T17:47:33.776744] [INFO ] [LOCAL ] BYD: Starting deletion of derivative data. [2025-10-27T17:47:33.776899] [DEBUG] [LOCAL ] BYD: Deleted derivative data file. [2025-10-27T17:47:33.776981] [INFO ] [MAIN ] Update Progress: 380/2366 symbols completed. BYD took 38.0s. Estimated remaining: 4h 8m 19s. Rate: 8.0 symbols/min [2025-10-27T17:47:33.944567] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:47:33.961021] [DEBUG] [LOCAL ] CABO: Loaded 16835 existing records from primary storage. [2025-10-27T17:47:33.961246] [INFO ] [MAIN ] CABO: Loaded 16835 existing records. [2025-10-27T17:47:34.022414] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-27T17:47:34.140678] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:47:34.140959] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-27T17:47:34.141017] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-27T17:47:34.141199] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-27T17:47:34.141257] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-27T17:47:34.307344] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-27T17:47:34.523153] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:47:34.804938] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-27T17:47:34.814906] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-27T17:47:35.614978] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-27T17:47:35.700151] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-27T17:47:36.414949] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-27T17:47:37.084854] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T17:47:37.215002] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-27T17:47:37.927747] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T17:47:38.014924] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-27T17:47:38.814997] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-27T17:47:39.240807] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T17:47:39.357214] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-27T17:47:39.471695] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-27T17:47:39.614937] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-27T17:47:40.414976] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-27T17:47:41.214933] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-27T17:47:41.333577] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T17:47:41.354920] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T17:47:42.014992] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-27T17:47:42.363497] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T17:47:42.816299] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-27T17:47:42.818472] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-27T17:47:43.614937] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-27T17:47:44.414953] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-27T17:47:44.455150] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-27T17:47:44.459525] [INFO ] [REMOTE ] CAAP: Full fetch complete (27822 records). [2025-10-27T17:47:44.459603] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-27T17:47:44.460073] [FATAL] [VALIDATOR ] CAAP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:47:44.460153] [FATAL] [MAIN ] CAAP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:47:44.460200] [WARN ] [MAIN ] CAAP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:47:44.460254] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-27T17:47:44.460345] [DEBUG] [LOCAL ] CAAP: No primary data file found to delete. [2025-10-27T17:47:44.460393] [INFO ] [LOCAL ] CAAP: Starting deletion of derivative data. [2025-10-27T17:47:44.460583] [DEBUG] [LOCAL ] CAAP: Deleted derivative data file. [2025-10-27T17:47:44.460706] [INFO ] [MAIN ] Update Progress: 381/2366 symbols completed. CAAP took 23.6s. Estimated remaining: 4h 8m 28s. Rate: 8.0 symbols/min [2025-10-27T17:47:44.630694] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:47:44.651687] [DEBUG] [LOCAL ] CACI: Loaded 22875 existing records from primary storage. [2025-10-27T17:47:44.651928] [INFO ] [MAIN ] CACI: Loaded 22875 existing records. [2025-10-27T17:47:44.833885] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:47:44.834229] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-27T17:47:44.834334] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-27T17:47:44.834548] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-27T17:47:44.834754] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-27T17:47:44.988610] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-27T17:47:45.223384] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-27T17:47:45.268245] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:47:45.733992] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T17:47:45.739576] [INFO ] [REMOTE ] BZH: Full fetch complete (47102 records). [2025-10-27T17:47:45.739705] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-27T17:47:46.020629] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-27T17:47:46.115088] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-27T17:47:46.115170] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-27T17:47:46.115791] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-27T17:47:46.115854] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-27T17:47:46.116900] [DEBUG] [LOCAL ] BZH: Trimmed 47102 records to 31712 (keeping 200 days of data) [2025-10-27T17:47:46.293580] [DEBUG] [LOCAL ] BZH: Primary data saved (31712 records). [2025-10-27T17:47:46.293740] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-27T17:47:46.293821] [INFO ] [MAIN ] Update Progress: 382/2366 symbols completed. BZH took 37.7s. Estimated remaining: 4h 7m 51s. Rate: 8.0 symbols/min [2025-10-27T17:47:46.463769] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:47:46.504381] [DEBUG] [LOCAL ] CADE: Loaded 50431 existing records from primary storage. [2025-10-27T17:47:46.504690] [INFO ] [MAIN ] CADE: Loaded 50431 existing records. [2025-10-27T17:47:46.678897] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:47:46.679238] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-27T17:47:46.679358] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-27T17:47:46.679682] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-27T17:47:46.679741] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-27T17:47:46.843268] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-27T17:47:46.876989] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T17:47:47.046503] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:47:47.615000] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-27T17:47:47.664966] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-27T17:47:47.675129] [INFO ] [REMOTE ] C: Full fetch complete (77919 records). [2025-10-27T17:47:47.675253] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-27T17:47:48.068722] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-27T17:47:48.068821] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-27T17:47:48.069703] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-27T17:47:48.069768] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-27T17:47:48.071191] [DEBUG] [LOCAL ] C: Trimmed 77919 records to 53741 (keeping 200 days of data) [2025-10-27T17:47:48.392518] [DEBUG] [LOCAL ] C: Primary data saved (53741 records). [2025-10-27T17:47:48.392667] [INFO ] [MAIN ] C: Full history saved. [2025-10-27T17:47:48.393119] [INFO ] [MAIN ] Update Progress: 383/2366 symbols completed. C took 33.8s. Estimated remaining: 4h 7m 16s. Rate: 8.0 symbols/min [2025-10-27T17:47:48.423584] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-27T17:47:48.520621] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T17:47:48.591784] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:47:48.628463] [DEBUG] [LOCAL ] CAE: Loaded 39531 existing records from primary storage. [2025-10-27T17:47:48.628762] [INFO ] [MAIN ] CAE: Loaded 39531 existing records. [2025-10-27T17:47:48.815240] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:47:48.815506] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-27T17:47:48.815582] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-27T17:47:48.815817] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-27T17:47:48.815944] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-27T17:47:49.007529] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T17:47:49.215900] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:47:49.216050] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-27T17:47:49.567848] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T17:47:50.014960] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-27T17:47:50.758134] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-27T17:47:50.814939] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-27T17:47:51.614929] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-27T17:47:51.847631] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-27T17:47:52.145973] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-27T17:47:52.414949] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-27T17:47:52.598625] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-27T17:47:53.214947] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-27T17:47:54.014931] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-27T17:47:54.046870] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T17:47:54.704102] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-27T17:47:54.744593] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T17:47:54.815004] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-27T17:47:55.614928] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-27T17:47:55.654947] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-27T17:47:56.414951] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-27T17:47:56.845232] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T17:47:57.214985] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-27T17:47:57.975308] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T17:47:58.014907] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-27T17:47:58.169490] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T17:47:58.814983] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-27T17:47:59.056093] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T17:47:59.434131] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-27T17:47:59.614963] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-27T17:48:00.414946] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-27T17:48:01.214954] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-27T17:48:01.315358] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T17:48:02.015009] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-27T17:48:02.731442] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-27T17:48:02.814958] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-27T17:48:03.615000] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-27T17:48:05.354926] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (4.14 seconds). [2025-10-27T17:48:05.359989] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-27T17:48:05.370496] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-27T17:48:05.374546] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-27T17:48:05.491876] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (3.48 seconds). [2025-10-27T17:48:06.015038] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-27T17:48:06.495017] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-27T17:48:06.623307] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T17:48:06.814979] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-27T17:48:06.941291] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (3.33 seconds). [2025-10-27T17:48:07.603062] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T17:48:07.614897] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-27T17:48:08.046344] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T17:48:08.414931] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-27T17:48:08.903001] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T17:48:09.214992] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-27T17:48:09.857356] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T17:48:10.014917] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-27T17:48:10.047087] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T17:48:10.814944] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-27T17:48:11.124777] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T17:48:11.615017] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-27T17:48:11.812316] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T17:48:11.818783] [INFO ] [REMOTE ] CACI: Full fetch complete (38533 records). [2025-10-27T17:48:11.819015] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-27T17:48:12.186745] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-27T17:48:12.186829] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-27T17:48:12.187389] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-27T17:48:12.187451] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-27T17:48:12.188259] [DEBUG] [LOCAL ] CACI: Trimmed 38533 records to 22047 (keeping 200 days of data) [2025-10-27T17:48:12.315968] [DEBUG] [LOCAL ] CACI: Primary data saved (22047 records). [2025-10-27T17:48:12.316088] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-27T17:48:12.316162] [INFO ] [MAIN ] Update Progress: 384/2366 symbols completed. CACI took 27.9s. Estimated remaining: 4h 8m 33s. Rate: 8.0 symbols/min [2025-10-27T17:48:12.418321] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-27T17:48:12.487970] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:48:12.492777] [DEBUG] [LOCAL ] CAF: Loaded 3518 existing records from primary storage. [2025-10-27T17:48:12.492951] [INFO ] [MAIN ] CAF: Loaded 3518 existing records. [2025-10-27T17:48:12.675021] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:48:12.675228] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-27T17:48:12.675273] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-27T17:48:12.675424] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-27T17:48:12.675482] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-27T17:48:13.031254] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:48:13.220000] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-27T17:48:13.238302] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T17:48:13.718606] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-27T17:48:13.945864] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T17:48:13.948296] [INFO ] [REMOTE ] CABO: Full fetch complete (23181 records). [2025-10-27T17:48:13.948366] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-27T17:48:14.020049] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-27T17:48:14.308840] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-27T17:48:14.308917] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-27T17:48:14.309290] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-27T17:48:14.309329] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-27T17:48:14.309968] [DEBUG] [LOCAL ] CABO: Trimmed 23181 records to 16486 (keeping 200 days of data) [2025-10-27T17:48:14.405518] [DEBUG] [LOCAL ] CABO: Primary data saved (16486 records). [2025-10-27T17:48:14.405671] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-27T17:48:14.405768] [INFO ] [MAIN ] Update Progress: 385/2366 symbols completed. CABO took 40.6s. Estimated remaining: 4h 7m 58s. Rate: 8.0 symbols/min [2025-10-27T17:48:14.571133] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:48:14.619780] [DEBUG] [LOCAL ] CAG: Loaded 54446 existing records from primary storage. [2025-10-27T17:48:14.620072] [INFO ] [MAIN ] CAG: Loaded 54446 existing records. [2025-10-27T17:48:14.795515] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:48:14.795732] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-27T17:48:14.795838] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-27T17:48:14.796025] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-27T17:48:14.796064] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-27T17:48:14.826032] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-27T17:48:15.142937] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:48:15.308534] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T17:48:15.316090] [INFO ] [REMOTE ] CAE: Full fetch complete (56564 records). [2025-10-27T17:48:15.316184] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-27T17:48:15.620132] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-27T17:48:15.692732] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-27T17:48:15.692812] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-27T17:48:15.693441] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-27T17:48:15.693534] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-27T17:48:15.695045] [DEBUG] [LOCAL ] CAE: Trimmed 56564 records to 38731 (keeping 200 days of data) [2025-10-27T17:48:15.915348] [DEBUG] [LOCAL ] CAE: Primary data saved (38731 records). [2025-10-27T17:48:15.915484] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-27T17:48:15.915559] [INFO ] [MAIN ] Update Progress: 386/2366 symbols completed. CAE took 27.5s. Estimated remaining: 4h 7m 19s. Rate: 8.0 symbols/min [2025-10-27T17:48:16.080470] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:48:16.130966] [DEBUG] [LOCAL ] CAH: Loaded 52161 existing records from primary storage. [2025-10-27T17:48:16.131390] [INFO ] [MAIN ] CAH: Loaded 52161 existing records. [2025-10-27T17:48:16.308871] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:48:16.309117] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-27T17:48:16.309182] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-27T17:48:16.309503] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-27T17:48:16.309574] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-27T17:48:16.416705] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-27T17:48:16.689855] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:48:16.716815] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-27T17:48:17.175926] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T17:48:17.193048] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-27T17:48:17.214931] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-27T17:48:18.014954] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-27T17:48:18.814978] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-27T17:48:18.889333] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-27T17:48:19.205235] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-27T17:48:19.614975] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-27T17:48:19.688465] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T17:48:20.414948] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-27T17:48:21.004383] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T17:48:21.214936] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-27T17:48:22.014940] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-27T17:48:22.103394] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-27T17:48:22.644548] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-27T17:48:22.814900] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-27T17:48:23.212540] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-27T17:48:23.465988] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-27T17:48:23.614933] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-27T17:48:24.262166] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T17:48:24.414950] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-27T17:48:25.214972] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-27T17:48:25.758840] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-27T17:48:25.769454] [INFO ] [REMOTE ] CADE: Full fetch complete (70822 records). [2025-10-27T17:48:25.769596] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-27T17:48:26.020216] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-27T17:48:26.179443] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-27T17:48:26.179521] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-27T17:48:26.180318] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-27T17:48:26.180379] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-27T17:48:26.181690] [DEBUG] [LOCAL ] CADE: Trimmed 70822 records to 49705 (keeping 200 days of data) [2025-10-27T17:48:26.476323] [DEBUG] [LOCAL ] CADE: Primary data saved (49705 records). [2025-10-27T17:48:26.476624] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-27T17:48:26.476770] [INFO ] [MAIN ] Update Progress: 387/2366 symbols completed. CADE took 40.2s. Estimated remaining: 4h 7m 28s. Rate: 8.0 symbols/min [2025-10-27T17:48:26.648494] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:48:26.678823] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-27T17:48:26.719075] [DEBUG] [LOCAL ] CAL: Loaded 43308 existing records from primary storage. [2025-10-27T17:48:26.719363] [INFO ] [MAIN ] CAL: Loaded 43308 existing records. [2025-10-27T17:48:26.820750] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-27T17:48:26.900120] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:48:26.900286] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-27T17:48:26.900367] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-27T17:48:26.900637] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-27T17:48:26.900726] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-27T17:48:27.260991] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:48:27.376741] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T17:48:27.620035] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-27T17:48:27.641606] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T17:48:27.973190] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-27T17:48:28.414939] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-27T17:48:28.764381] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-27T17:48:29.214964] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-27T17:48:30.014933] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-27T17:48:30.814910] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-27T17:48:31.084324] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-27T17:48:31.268802] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T17:48:31.615007] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-27T17:48:32.420522] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-27T17:48:32.425815] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-27T17:48:32.755982] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-27T17:48:32.954893] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T17:48:33.214943] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-27T17:48:34.014938] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-27T17:48:34.511094] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T17:48:34.735948] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T17:48:34.737391] [INFO ] [REMOTE ] CAF: Full fetch complete (5567 records). [2025-10-27T17:48:34.737462] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-27T17:48:34.820150] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-27T17:48:35.106154] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-27T17:48:35.106229] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-27T17:48:35.106395] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-27T17:48:35.106431] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-27T17:48:35.106829] [DEBUG] [LOCAL ] CAF: Trimmed 5567 records to 3393 (keeping 200 days of data) [2025-10-27T17:48:35.126148] [DEBUG] [LOCAL ] CAF: Primary data saved (3393 records). [2025-10-27T17:48:35.126219] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-27T17:48:35.126288] [INFO ] [MAIN ] Update Progress: 388/2366 symbols completed. CAF took 22.8s. Estimated remaining: 4h 7m 26s. Rate: 8.0 symbols/min [2025-10-27T17:48:35.333450] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:48:35.371606] [DEBUG] [LOCAL ] CALX: Loaded 37702 existing records from primary storage. [2025-10-27T17:48:35.372013] [INFO ] [MAIN ] CALX: Loaded 37702 existing records. [2025-10-27T17:48:35.573949] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:48:35.574139] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-27T17:48:35.574186] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-27T17:48:35.574380] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-27T17:48:35.574438] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-27T17:48:35.620631] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-27T17:48:35.969695] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:48:36.414985] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-27T17:48:36.797549] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-27T17:48:37.214924] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-27T17:48:37.248688] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-27T17:48:37.355243] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-27T17:48:38.014966] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-27T17:48:38.656693] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T17:48:38.814904] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-27T17:48:38.884253] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-27T17:48:39.614943] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-27T17:48:40.414926] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-27T17:48:40.730073] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-27T17:48:41.186673] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T17:48:41.214898] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-27T17:48:41.616884] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-27T17:48:42.014944] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-27T17:48:42.317816] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-27T17:48:42.814937] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-27T17:48:43.614944] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-27T17:48:43.760289] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T17:48:43.770042] [INFO ] [REMOTE ] CAG: Full fetch complete (77437 records). [2025-10-27T17:48:43.770167] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-27T17:48:43.770961] [FATAL] [VALIDATOR ] CAG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:48:43.771051] [FATAL] [MAIN ] CAG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:48:43.771092] [WARN ] [MAIN ] CAG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:48:43.771138] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-27T17:48:43.771193] [DEBUG] [LOCAL ] CAG: No primary data file found to delete. [2025-10-27T17:48:43.771227] [INFO ] [LOCAL ] CAG: Starting deletion of derivative data. [2025-10-27T17:48:43.771346] [DEBUG] [LOCAL ] CAG: Deleted derivative data file. [2025-10-27T17:48:43.771415] [INFO ] [MAIN ] Update Progress: 389/2366 symbols completed. CAG took 29.4s. Estimated remaining: 4h 7m 24s. Rate: 8.0 symbols/min [2025-10-27T17:48:43.948215] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:48:43.974953] [DEBUG] [LOCAL ] CANG: Loaded 27307 existing records from primary storage. [2025-10-27T17:48:43.975211] [INFO ] [MAIN ] CANG: Loaded 27307 existing records. [2025-10-27T17:48:44.180534] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T17:48:44.184435] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:48:44.193617] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-27T17:48:44.193715] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-27T17:48:44.194248] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-27T17:48:44.194310] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-27T17:48:44.425189] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-27T17:48:44.588597] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:48:45.216964] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-27T17:48:45.219747] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T17:48:45.532502] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-27T17:48:46.014954] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-27T17:48:46.619576] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T17:48:46.814963] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-27T17:48:47.614962] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-27T17:48:47.744485] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-27T17:48:47.783034] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-27T17:48:48.415005] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-27T17:48:48.739951] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T17:48:49.215006] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-27T17:48:49.651178] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-27T17:48:50.015004] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-27T17:48:50.318108] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T17:48:50.814950] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-27T17:48:51.169840] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T17:48:51.178304] [INFO ] [REMOTE ] CAL: Full fetch complete (61854 records). [2025-10-27T17:48:51.178449] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-27T17:48:51.601935] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-27T17:48:51.602021] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-27T17:48:51.602840] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-27T17:48:51.602914] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-27T17:48:51.604220] [DEBUG] [LOCAL ] CAL: Trimmed 61854 records to 42457 (keeping 200 days of data) [2025-10-27T17:48:51.657325] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-27T17:48:51.867253] [DEBUG] [LOCAL ] CAL: Primary data saved (42457 records). [2025-10-27T17:48:51.867399] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-27T17:48:51.867484] [INFO ] [MAIN ] Update Progress: 390/2366 symbols completed. CAL took 25.4s. Estimated remaining: 4h 7m 20s. Rate: 8.0 symbols/min [2025-10-27T17:48:52.040361] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:48:52.048303] [DEBUG] [LOCAL ] CAPL: Loaded 5468 existing records from primary storage. [2025-10-27T17:48:52.048498] [INFO ] [MAIN ] CAPL: Loaded 5468 existing records. [2025-10-27T17:48:52.231866] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:48:52.232123] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-27T17:48:52.232200] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-27T17:48:52.232453] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-27T17:48:52.232511] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-27T17:48:52.424348] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-27T17:48:52.626211] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:48:52.633219] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-27T17:48:52.662795] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T17:48:53.214946] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-27T17:48:53.936827] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T17:48:54.014919] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-27T17:48:54.685443] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T17:48:54.814945] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-27T17:48:55.443554] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T17:48:55.614951] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-27T17:48:56.169681] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-27T17:48:56.312454] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-27T17:48:56.414921] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-27T17:48:57.215004] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-27T17:48:58.015032] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-27T17:48:58.053260] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T17:48:58.302104] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-27T17:48:58.814944] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-27T17:48:59.519486] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-27T17:48:59.566033] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T17:48:59.614898] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-27T17:49:00.414994] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-27T17:49:01.215028] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-27T17:49:01.809124] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-27T17:49:02.015005] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-27T17:49:02.815003] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-27T17:49:03.247735] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (2.83 seconds). [2025-10-27T17:49:03.257747] [INFO ] [REMOTE ] CAH: Full fetch complete (74852 records). [2025-10-27T17:49:03.257871] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-27T17:49:03.657981] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-27T17:49:03.658063] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-27T17:49:03.658917] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-27T17:49:03.658981] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-27T17:49:03.660360] [DEBUG] [LOCAL ] CAH: Trimmed 74852 records to 51367 (keeping 200 days of data) [2025-10-27T17:49:03.980348] [DEBUG] [LOCAL ] CAH: Primary data saved (51367 records). [2025-10-27T17:49:03.984713] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-27T17:49:03.986507] [INFO ] [MAIN ] Update Progress: 391/2366 symbols completed. CAH took 48.1s. Estimated remaining: 4h 7m 36s. Rate: 8.0 symbols/min [2025-10-27T17:49:04.018943] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (2.80 seconds). [2025-10-27T17:49:04.060959] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-27T17:49:04.164222] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:49:04.210970] [DEBUG] [LOCAL ] CARR: Loaded 54382 existing records from primary storage. [2025-10-27T17:49:04.211330] [INFO ] [MAIN ] CARR: Loaded 54382 existing records. [2025-10-27T17:49:04.389600] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:49:04.389825] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-27T17:49:04.389874] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-27T17:49:04.390126] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-27T17:49:04.390180] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-27T17:49:04.773434] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-27T17:49:04.778795] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-27T17:49:04.781964] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-27T17:49:04.839954] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:49:04.841826] [INFO ] [REMOTE ] CALX: Full fetch complete (53776 records). [2025-10-27T17:49:04.841595] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-10-27T17:49:04.842765] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-27T17:49:04.850681] [FATAL] [VALIDATOR ] CALX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:49:04.850807] [FATAL] [MAIN ] CALX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:49:04.850878] [WARN ] [MAIN ] CALX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:49:04.850958] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-27T17:49:04.851037] [DEBUG] [LOCAL ] CALX: No primary data file found to delete. [2025-10-27T17:49:04.851080] [INFO ] [LOCAL ] CALX: Starting deletion of derivative data. [2025-10-27T17:49:04.851272] [DEBUG] [LOCAL ] CALX: Deleted derivative data file. [2025-10-27T17:49:04.851387] [INFO ] [MAIN ] Update Progress: 392/2366 symbols completed. CALX took 29.7s. Estimated remaining: 4h 6m 54s. Rate: 8.0 symbols/min [2025-10-27T17:49:05.028917] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:49:05.073534] [DEBUG] [LOCAL ] CARS: Loaded 40381 existing records from primary storage. [2025-10-27T17:49:05.073930] [INFO ] [MAIN ] CARS: Loaded 40381 existing records. [2025-10-27T17:49:05.222925] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-27T17:49:05.254253] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:49:05.254473] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-27T17:49:05.254523] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-27T17:49:05.254773] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-27T17:49:05.254829] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-27T17:49:05.555987] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T17:49:05.644714] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:49:06.014994] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-27T17:49:06.814980] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-27T17:49:06.877503] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-27T17:49:07.149627] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-27T17:49:07.528997] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-27T17:49:07.614945] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-27T17:49:08.415004] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-27T17:49:08.717299] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T17:49:08.861741] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T17:49:09.214947] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-27T17:49:10.014994] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-27T17:49:10.335606] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T17:49:10.814953] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-27T17:49:11.614924] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-27T17:49:11.825970] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-27T17:49:12.217424] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T17:49:12.314571] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-27T17:49:12.414909] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-27T17:49:13.214940] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-27T17:49:13.769159] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T17:49:14.015035] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-27T17:49:14.814963] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-27T17:49:14.958019] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-27T17:49:15.033332] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T17:49:15.038856] [INFO ] [REMOTE ] CANG: Full fetch complete (39170 records). [2025-10-27T17:49:15.038941] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-27T17:49:15.334417] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-27T17:49:15.424093] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-27T17:49:15.424168] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-27T17:49:15.424675] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-27T17:49:15.424736] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-27T17:49:15.425525] [DEBUG] [LOCAL ] CANG: Trimmed 39170 records to 26993 (keeping 200 days of data) [2025-10-27T17:49:15.568177] [DEBUG] [LOCAL ] CANG: Primary data saved (26993 records). [2025-10-27T17:49:15.568291] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-27T17:49:15.568369] [INFO ] [MAIN ] Update Progress: 393/2366 symbols completed. CANG took 31.8s. Estimated remaining: 4h 7m 3s. Rate: 8.0 symbols/min [2025-10-27T17:49:15.620692] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-27T17:49:15.737279] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:49:15.788319] [DEBUG] [LOCAL ] CAT: Loaded 53692 existing records from primary storage. [2025-10-27T17:49:15.788623] [INFO ] [MAIN ] CAT: Loaded 53692 existing records. [2025-10-27T17:49:15.975480] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:49:15.975713] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-27T17:49:15.975769] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-27T17:49:15.975976] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-27T17:49:15.976046] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-27T17:49:16.326932] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:49:16.414905] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-27T17:49:16.961142] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T17:49:17.214947] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-27T17:49:18.014916] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-27T17:49:18.387472] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-27T17:49:18.529462] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-27T17:49:18.814983] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-27T17:49:19.314928] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T17:49:19.614940] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-27T17:49:20.415026] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-27T17:49:20.758719] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-27T17:49:21.105487] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-27T17:49:21.214933] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-27T17:49:22.014986] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-27T17:49:22.524211] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-27T17:49:22.643850] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-27T17:49:22.815002] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-27T17:49:22.866365] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-27T17:49:23.188849] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-27T17:49:23.614998] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-27T17:49:24.414920] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-27T17:49:25.099598] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-27T17:49:25.101136] [INFO ] [REMOTE ] CAPL: Full fetch complete (8700 records). [2025-10-27T17:49:25.101207] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-27T17:49:25.101576] [FATAL] [VALIDATOR ] CAPL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:49:25.101680] [FATAL] [MAIN ] CAPL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:49:25.101734] [WARN ] [MAIN ] CAPL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:49:25.101774] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-27T17:49:25.101825] [DEBUG] [LOCAL ] CAPL: No primary data file found to delete. [2025-10-27T17:49:25.101859] [INFO ] [LOCAL ] CAPL: Starting deletion of derivative data. [2025-10-27T17:49:25.101980] [DEBUG] [LOCAL ] CAPL: Deleted derivative data file. [2025-10-27T17:49:25.102044] [INFO ] [MAIN ] Update Progress: 394/2366 symbols completed. CAPL took 33.2s. Estimated remaining: 4h 7m 6s. Rate: 8.0 symbols/min [2025-10-27T17:49:25.223381] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-27T17:49:25.287917] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:49:25.329300] [DEBUG] [LOCAL ] CATO: Loaded 6701 existing records from primary storage. [2025-10-27T17:49:25.333771] [INFO ] [MAIN ] CATO: Loaded 6701 existing records. [2025-10-27T17:49:25.398597] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T17:49:25.521815] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:49:25.522030] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-27T17:49:25.522095] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-27T17:49:25.522249] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-27T17:49:25.522304] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-27T17:49:25.877894] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:49:26.014938] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-27T17:49:26.373262] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-27T17:49:26.814906] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-27T17:49:26.822014] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T17:49:27.615037] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-27T17:49:28.106189] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T17:49:28.372700] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T17:49:28.414946] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-27T17:49:29.214965] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-27T17:49:29.859008] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T17:49:30.014975] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-27T17:49:30.517623] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-27T17:49:30.814897] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-27T17:49:31.035080] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-27T17:49:31.614940] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-27T17:49:32.088193] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-27T17:49:32.414922] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-27T17:49:32.450709] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-27T17:49:33.214930] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-27T17:49:34.014963] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-27T17:49:34.477801] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-27T17:49:34.487868] [INFO ] [REMOTE ] CARR: Full fetch complete (77381 records). [2025-10-27T17:49:34.488033] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-27T17:49:34.489095] [FATAL] [VALIDATOR ] CARR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:49:34.489255] [FATAL] [MAIN ] CARR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:49:34.489304] [WARN ] [MAIN ] CARR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:49:34.489376] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-27T17:49:34.489451] [DEBUG] [LOCAL ] CARR: No primary data file found to delete. [2025-10-27T17:49:34.489494] [INFO ] [LOCAL ] CARR: Starting deletion of derivative data. [2025-10-27T17:49:34.489699] [DEBUG] [LOCAL ] CARR: Deleted derivative data file. [2025-10-27T17:49:34.489815] [INFO ] [MAIN ] Update Progress: 395/2366 symbols completed. CARR took 30.5s. Estimated remaining: 4h 7m 8s. Rate: 8.0 symbols/min [2025-10-27T17:49:34.658289] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:49:34.709914] [DEBUG] [LOCAL ] CAVA: Loaded 54321 existing records from primary storage. [2025-10-27T17:49:34.710232] [INFO ] [MAIN ] CAVA: Loaded 54321 existing records. [2025-10-27T17:49:34.820183] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-27T17:49:34.889169] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:49:34.889390] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-27T17:49:34.889440] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-27T17:49:34.889634] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-27T17:49:34.889742] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-27T17:49:35.259313] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:49:35.505392] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T17:49:35.575623] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-27T17:49:35.605665] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-27T17:49:35.614901] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-27T17:49:36.246351] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-27T17:49:36.414941] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-27T17:49:37.075275] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T17:49:37.214983] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-27T17:49:38.015010] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-27T17:49:38.426024] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T17:49:38.433908] [INFO ] [REMOTE ] CARS: Full fetch complete (56400 records). [2025-10-27T17:49:38.434031] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-27T17:49:38.434939] [FATAL] [VALIDATOR ] CARS: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:49:38.435029] [FATAL] [MAIN ] CARS: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:49:38.435073] [WARN ] [MAIN ] CARS: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:49:38.435110] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-27T17:49:38.435166] [DEBUG] [LOCAL ] CARS: No primary data file found to delete. [2025-10-27T17:49:38.435201] [INFO ] [LOCAL ] CARS: Starting deletion of derivative data. [2025-10-27T17:49:38.435349] [DEBUG] [LOCAL ] CARS: Deleted derivative data file. [2025-10-27T17:49:38.435449] [INFO ] [MAIN ] Update Progress: 396/2366 symbols completed. CARS took 33.6s. Estimated remaining: 4h 6m 42s. Rate: 8.0 symbols/min [2025-10-27T17:49:38.604429] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:49:38.656860] [DEBUG] [LOCAL ] CB: Loaded 50705 existing records from primary storage. [2025-10-27T17:49:38.657187] [INFO ] [MAIN ] CB: Loaded 50705 existing records. [2025-10-27T17:49:38.816244] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-27T17:49:38.838152] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:49:38.838481] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-27T17:49:38.838534] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-27T17:49:38.838756] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-27T17:49:38.838814] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-27T17:49:39.193312] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:49:39.327346] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-27T17:49:39.532382] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T17:49:39.614975] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-27T17:49:40.414967] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-27T17:49:41.214917] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-27T17:49:41.673230] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-27T17:49:41.936496] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-27T17:49:42.014924] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-27T17:49:42.194442] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-27T17:49:42.814940] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-27T17:49:43.336468] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T17:49:43.338309] [INFO ] [REMOTE ] CATO: Full fetch complete (10547 records). [2025-10-27T17:49:43.338378] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-27T17:49:43.622136] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-27T17:49:43.709743] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-27T17:49:43.709837] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-27T17:49:43.710235] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-27T17:49:43.710314] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-27T17:49:43.711076] [DEBUG] [LOCAL ] CATO: Trimmed 10547 records to 6605 (keeping 200 days of data) [2025-10-27T17:49:43.749260] [DEBUG] [LOCAL ] CATO: Primary data saved (6605 records). [2025-10-27T17:49:43.749406] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-27T17:49:43.749589] [INFO ] [MAIN ] Update Progress: 397/2366 symbols completed. CATO took 18.6s. Estimated remaining: 4h 6m 24s. Rate: 8.0 symbols/min [2025-10-27T17:49:43.837300] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-27T17:49:44.414951] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-27T17:49:45.215008] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-27T17:49:45.569581] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-27T17:49:46.014958] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-27T17:49:46.084809] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T17:49:46.815006] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-27T17:49:47.391281] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-27T17:49:47.614924] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-27T17:49:48.203136] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-27T17:49:48.415138] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-27T17:49:48.449362] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T17:49:49.214980] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-27T17:49:49.550809] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-27T17:49:49.967690] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-27T17:49:50.014911] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-27T17:49:50.611623] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T17:49:50.814978] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-27T17:49:51.614943] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-27T17:49:51.783954] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-27T17:49:52.171485] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-27T17:49:52.414932] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-27T17:49:53.214956] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-27T17:49:53.403790] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-27T17:49:54.014924] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-27T17:49:54.082906] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T17:49:54.814950] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-27T17:49:55.552389] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-27T17:49:55.582521] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-27T17:49:55.592969] [INFO ] [REMOTE ] CAT: Full fetch complete (76860 records). [2025-10-27T17:49:55.593109] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-27T17:49:55.624455] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-27T17:49:55.975725] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-27T17:49:55.975810] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-27T17:49:55.976620] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-27T17:49:55.976694] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-27T17:49:55.978191] [DEBUG] [LOCAL ] CAT: Trimmed 76860 records to 52903 (keeping 200 days of data) [2025-10-27T17:49:56.316334] [DEBUG] [LOCAL ] CAT: Primary data saved (52903 records). [2025-10-27T17:49:56.316484] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-27T17:49:56.317887] [INFO ] [MAIN ] Update Progress: 398/2366 symbols completed. CAT took 40.7s. Estimated remaining: 4h 6m 41s. Rate: 8.0 symbols/min [2025-10-27T17:49:56.345308] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-27T17:49:56.414912] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-27T17:49:57.617444] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-27T17:49:57.631020] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-27T17:49:58.172037] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T17:49:58.184449] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-27T17:49:59.368035] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-27T17:49:59.380149] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-27T17:50:00.181135] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-27T17:50:00.192222] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-27T17:50:02.101151] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (2.72 seconds). [2025-10-27T17:50:02.111573] [INFO ] [REMOTE ] CAVA: Full fetch complete (77457 records). [2025-10-27T17:50:02.111735] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-27T17:50:02.514934] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-27T17:50:02.515021] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-27T17:50:02.515858] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-27T17:50:02.515920] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-27T17:50:02.517525] [DEBUG] [LOCAL ] CAVA: Trimmed 77457 records to 53539 (keeping 200 days of data) [2025-10-27T17:50:02.827942] [DEBUG] [LOCAL ] CAVA: Primary data saved (53539 records). [2025-10-27T17:50:02.828070] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-27T17:50:02.828453] [INFO ] [MAIN ] Update Progress: 399/2366 symbols completed. CAVA took 28.3s. Estimated remaining: 4h 6m 29s. Rate: 8.0 symbols/min [2025-10-27T17:50:04.293518] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (4.10 seconds). [2025-10-27T17:50:04.304529] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-27T17:50:06.724323] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-27T17:50:06.734137] [INFO ] [REMOTE ] CB: Full fetch complete (72857 records). [2025-10-27T17:50:06.734266] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-27T17:50:07.109407] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-27T17:50:07.109505] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-27T17:50:07.110270] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-27T17:50:07.110332] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-27T17:50:07.111712] [DEBUG] [LOCAL ] CB: Trimmed 72857 records to 49917 (keeping 200 days of data) [2025-10-27T17:50:07.413981] [DEBUG] [LOCAL ] CB: Primary data saved (49917 records). [2025-10-27T17:50:07.414119] [INFO ] [MAIN ] CB: Full history saved. [2025-10-27T17:50:07.415320] [INFO ] [MAIN ] Update Progress: 400/2366 symbols completed. CB took 29.0s. Estimated remaining: 4h 6m 7s. Rate: 8.0 symbols/min [2025-10-27T17:50:08.160823] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:08.152565] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:08.135621] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:08.184030] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-27T17:50:08.186818] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-27T17:50:08.187961] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:08.188538] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-27T17:50:08.188912] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-27T17:50:08.189006] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-27T17:50:08.189597] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-27T17:50:08.311015] [DEBUG] [LOCAL ] CBL: Loaded 16198 existing records from primary storage. [2025-10-27T17:50:08.302613] [DEBUG] [LOCAL ] CBAN: Loaded 10315 existing records from primary storage. [2025-10-27T17:50:08.302292] [DEBUG] [LOCAL ] CBNA: Loaded 2868 existing records from primary storage. [2025-10-27T17:50:08.311365] [INFO ] [MAIN ] CBAN: Loaded 10315 existing records. [2025-10-27T17:50:08.316843] [INFO ] [MAIN ] CBNA: Loaded 2868 existing records. [2025-10-27T17:50:08.311474] [INFO ] [MAIN ] CBL: Loaded 16198 existing records. [2025-10-27T17:50:08.993412] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:50:08.997306] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:50:09.021116] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-27T17:50:09.007679] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-27T17:50:09.044776] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-27T17:50:09.066347] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-27T17:50:09.082170] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:50:09.095018] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-27T17:50:09.095066] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-27T17:50:09.134722] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:09.134985] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-27T17:50:09.135250] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-10-27T17:50:09.129718] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-27T17:50:09.135343] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-27T17:50:09.147486] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-27T17:50:09.147587] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-27T17:50:09.147740] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-27T17:50:09.727673] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:50:09.815753] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-10-27T17:50:09.890544] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:50:09.952136] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-27T17:50:09.990763] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:50:10.000928] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-27T17:50:10.014840] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-27T17:50:10.025581] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-27T17:50:10.043459] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-27T17:50:10.081226] [INFO ] [MAIN ] Update Progress: 401/2366 symbols completed. CBO took 2.7s. Estimated remaining: 4h 5m 36s. Rate: 8.0 symbols/min [2025-10-27T17:50:10.130875] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:10.248590] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-27T17:50:10.278718] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:10.298480] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-27T17:50:10.301317] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:10.313021] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-27T17:50:10.407308] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:10.456147] [DEBUG] [LOCAL ] CBRE: Loaded 51042 existing records from primary storage. [2025-10-27T17:50:10.456428] [INFO ] [MAIN ] CBRE: Loaded 51042 existing records. [2025-10-27T17:50:10.626917] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:50:10.627072] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-27T17:50:10.627137] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-27T17:50:10.627424] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-27T17:50:10.627479] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-27T17:50:10.971484] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:10.972152] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-27T17:50:11.009531] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-27T17:50:11.011200] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-27T17:50:11.041958] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T17:50:11.050251] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-27T17:50:11.057191] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T17:50:11.061296] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-27T17:50:11.589000] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T17:50:11.590301] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-27T17:50:11.799504] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T17:50:11.804167] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-27T17:50:11.973897] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-27T17:50:11.974997] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-27T17:50:11.992187] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-27T17:50:11.996258] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-27T17:50:12.335442] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T17:50:12.345547] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-27T17:50:12.471616] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-27T17:50:12.472946] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-27T17:50:12.755386] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-27T17:50:12.759248] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-27T17:50:12.892067] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-27T17:50:12.913343] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T17:50:13.214983] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-27T17:50:13.297583] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-27T17:50:13.370137] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T17:50:14.014910] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-27T17:50:14.187036] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-27T17:50:14.801712] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-27T17:50:14.814908] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-27T17:50:15.398389] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-27T17:50:15.615003] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-27T17:50:15.983221] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-27T17:50:16.414929] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-27T17:50:16.925757] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-27T17:50:17.215023] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-27T17:50:18.014988] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-27T17:50:18.237225] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T17:50:18.814963] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-27T17:50:18.985320] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T17:50:19.589370] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-27T17:50:19.614901] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-27T17:50:20.414923] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-27T17:50:20.511295] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T17:50:21.214909] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-27T17:50:21.434549] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-27T17:50:21.681183] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-27T17:50:22.014930] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-27T17:50:22.814926] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-27T17:50:23.056822] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T17:50:23.294633] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-27T17:50:23.614933] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-27T17:50:24.205585] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-27T17:50:24.208135] [INFO ] [REMOTE ] CBAN: Full fetch complete (16346 records). [2025-10-27T17:50:24.208266] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-27T17:50:24.424014] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-27T17:50:24.603420] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-27T17:50:24.603539] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-27T17:50:24.604069] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-27T17:50:24.604137] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-27T17:50:24.604878] [DEBUG] [LOCAL ] CBAN: Trimmed 16346 records to 10025 (keeping 200 days of data) [2025-10-27T17:50:24.671406] [DEBUG] [LOCAL ] CBAN: Primary data saved (10025 records). [2025-10-27T17:50:24.671609] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-27T17:50:24.671745] [INFO ] [MAIN ] Update Progress: 402/2366 symbols completed. CBAN took 17.3s. Estimated remaining: 4h 6m 3s. Rate: 8.0 symbols/min [2025-10-27T17:50:24.851758] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:24.885706] [DEBUG] [LOCAL ] CBT: Loaded 31300 existing records from primary storage. [2025-10-27T17:50:24.886084] [INFO ] [MAIN ] CBT: Loaded 31300 existing records. [2025-10-27T17:50:25.076969] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:50:25.077346] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-27T17:50:25.077406] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-27T17:50:25.077693] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-27T17:50:25.077754] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-27T17:50:25.219627] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-27T17:50:25.432864] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:25.442873] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-27T17:50:25.544729] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-27T17:50:26.014959] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-27T17:50:26.636472] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-27T17:50:26.639628] [INFO ] [REMOTE ] CBL: Full fetch complete (24620 records). [2025-10-27T17:50:26.639722] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-27T17:50:26.820159] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-27T17:50:26.998858] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-27T17:50:26.998932] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-27T17:50:26.999334] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-27T17:50:26.999373] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-27T17:50:27.000016] [DEBUG] [LOCAL ] CBL: Trimmed 24620 records to 15649 (keeping 200 days of data) [2025-10-27T17:50:27.093698] [DEBUG] [LOCAL ] CBL: Primary data saved (15649 records). [2025-10-27T17:50:27.093834] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-27T17:50:27.093933] [INFO ] [MAIN ] Update Progress: 403/2366 symbols completed. CBL took 19.7s. Estimated remaining: 4h 5m 30s. Rate: 8.0 symbols/min [2025-10-27T17:50:27.259266] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:27.279213] [DEBUG] [LOCAL ] CBU: Loaded 22844 existing records from primary storage. [2025-10-27T17:50:27.279424] [INFO ] [MAIN ] CBU: Loaded 22844 existing records. [2025-10-27T17:50:27.452220] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:50:27.452423] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-27T17:50:27.452471] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-27T17:50:27.452633] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-27T17:50:27.452721] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-27T17:50:27.620123] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-27T17:50:27.809009] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:28.098568] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-27T17:50:28.099730] [INFO ] [REMOTE ] CBNA: Full fetch complete (4194 records). [2025-10-27T17:50:28.099857] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-27T17:50:28.417471] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-27T17:50:28.422791] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T17:50:28.509235] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-27T17:50:28.509318] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-27T17:50:28.509468] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-27T17:50:28.509507] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-27T17:50:28.509895] [DEBUG] [LOCAL ] CBNA: Trimmed 4194 records to 2817 (keeping 200 days of data) [2025-10-27T17:50:28.527027] [DEBUG] [LOCAL ] CBNA: Primary data saved (2817 records). [2025-10-27T17:50:28.527242] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-27T17:50:28.527334] [INFO ] [MAIN ] Update Progress: 404/2366 symbols completed. CBNA took 21.1s. Estimated remaining: 4h 4m 53s. Rate: 8.0 symbols/min [2025-10-27T17:50:28.694589] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:28.694798] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-27T17:50:28.694841] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-27T17:50:28.694960] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-27T17:50:28.695029] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-27T17:50:28.695106] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-27T17:50:28.695153] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-27T17:50:29.041635] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:29.214947] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-27T17:50:29.310463] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-27T17:50:30.014906] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-27T17:50:30.046158] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-27T17:50:30.814934] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-27T17:50:31.059378] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T17:50:31.615006] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-27T17:50:31.921524] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T17:50:32.414984] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-27T17:50:33.214955] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-27T17:50:33.528855] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-27T17:50:33.606019] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-27T17:50:34.014993] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-10-27T17:50:34.198914] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-27T17:50:34.315820] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:50:34.316161] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-10-27T17:50:34.316249] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:50:34.316317] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-27T17:50:34.316384] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:50:34.316455] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-27T17:50:34.316520] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-27T17:50:34.316557] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-27T17:50:34.316597] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-27T17:50:34.316678] [INFO ] [MAIN ] Update Progress: 405/2366 symbols completed. CBX took 5.8s. Estimated remaining: 4h 4m 38s. Rate: 8.0 symbols/min [2025-10-27T17:50:34.496150] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:34.527446] [DEBUG] [LOCAL ] CBZ: Loaded 34714 existing records from primary storage. [2025-10-27T17:50:34.527749] [INFO ] [MAIN ] CBZ: Loaded 34714 existing records. [2025-10-27T17:50:34.712216] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:50:34.712423] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-27T17:50:34.712471] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-27T17:50:34.712718] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-27T17:50:34.712778] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-27T17:50:34.817879] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-27T17:50:35.069137] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:35.614989] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-27T17:50:36.375413] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T17:50:36.414937] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-27T17:50:36.471543] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-27T17:50:37.214941] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-27T17:50:37.267668] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-27T17:50:38.014960] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-27T17:50:38.207053] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T17:50:38.814956] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-27T17:50:39.416562] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-27T17:50:39.614956] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-27T17:50:39.637164] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T17:50:40.414962] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-27T17:50:41.215005] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-27T17:50:41.352208] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-27T17:50:41.755345] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T17:50:42.014980] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-27T17:50:42.377043] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-27T17:50:42.814958] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-27T17:50:43.598087] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T17:50:43.614899] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-27T17:50:44.202082] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-27T17:50:44.414973] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-27T17:50:45.095023] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T17:50:45.215012] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-27T17:50:45.808274] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T17:50:45.814320] [INFO ] [REMOTE ] CBT: Full fetch complete (45765 records). [2025-10-27T17:50:45.814437] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-27T17:50:46.021071] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-27T17:50:46.201116] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-27T17:50:46.201203] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-27T17:50:46.201829] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-27T17:50:46.201895] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-27T17:50:46.203031] [DEBUG] [LOCAL ] CBT: Trimmed 45765 records to 30570 (keeping 200 days of data) [2025-10-27T17:50:46.387802] [DEBUG] [LOCAL ] CBT: Primary data saved (30570 records). [2025-10-27T17:50:46.387973] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-27T17:50:46.388065] [INFO ] [MAIN ] Update Progress: 406/2366 symbols completed. CBT took 21.7s. Estimated remaining: 4h 4m 52s. Rate: 8.0 symbols/min [2025-10-27T17:50:46.560102] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:46.609832] [DEBUG] [LOCAL ] CC: Loaded 53764 existing records from primary storage. [2025-10-27T17:50:46.610214] [INFO ] [MAIN ] CC: Loaded 53764 existing records. [2025-10-27T17:50:46.789751] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:50:46.789945] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-27T17:50:46.789990] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-27T17:50:46.790165] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-27T17:50:46.790202] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-27T17:50:46.820575] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-27T17:50:47.228503] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:47.232483] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-27T17:50:47.564283] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T17:50:47.614949] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-27T17:50:47.808518] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-27T17:50:48.414948] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-27T17:50:49.214989] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-27T17:50:49.333761] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-27T17:50:49.649315] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T17:50:50.014904] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-27T17:50:50.108429] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-27T17:50:50.814938] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-27T17:50:51.166150] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T17:50:51.614934] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-27T17:50:52.019494] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-27T17:50:52.415035] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-27T17:50:52.745463] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-27T17:50:53.197522] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-27T17:50:53.214909] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-27T17:50:54.014950] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-27T17:50:54.208384] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-27T17:50:54.814996] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-27T17:50:55.615025] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-27T17:50:55.716205] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T17:50:55.959394] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-27T17:50:55.969094] [INFO ] [REMOTE ] CBRE: Full fetch complete (73752 records). [2025-10-27T17:50:55.969239] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-27T17:50:56.355371] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-27T17:50:56.355457] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-27T17:50:56.356291] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-27T17:50:56.356352] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-27T17:50:56.357839] [DEBUG] [LOCAL ] CBRE: Trimmed 73752 records to 50256 (keeping 200 days of data) [2025-10-27T17:50:56.416418] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-27T17:50:56.649898] [DEBUG] [LOCAL ] CBRE: Primary data saved (50256 records). [2025-10-27T17:50:56.650022] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-27T17:50:56.650581] [INFO ] [MAIN ] Update Progress: 407/2366 symbols completed. CBRE took 46.5s. Estimated remaining: 4h 4m 58s. Rate: 8.0 symbols/min [2025-10-27T17:50:56.816592] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:56.866849] [DEBUG] [LOCAL ] CCI: Loaded 53881 existing records from primary storage. [2025-10-27T17:50:56.867182] [INFO ] [MAIN ] CCI: Loaded 53881 existing records. [2025-10-27T17:50:57.045844] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:50:57.046059] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-27T17:50:57.046112] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-27T17:50:57.046566] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-27T17:50:57.046623] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-27T17:50:57.215768] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-27T17:50:57.460019] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:57.505793] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-27T17:50:57.849633] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-27T17:50:58.014921] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-27T17:50:58.527483] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T17:50:58.532031] [INFO ] [REMOTE ] CBU: Full fetch complete (32644 records). [2025-10-27T17:50:58.532102] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-27T17:50:58.817158] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-27T17:50:58.902329] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-27T17:50:58.902405] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-27T17:50:58.902868] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-27T17:50:58.902929] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-27T17:50:58.903719] [DEBUG] [LOCAL ] CBU: Trimmed 32644 records to 22333 (keeping 200 days of data) [2025-10-27T17:50:59.035765] [DEBUG] [LOCAL ] CBU: Primary data saved (22333 records). [2025-10-27T17:50:59.035892] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-27T17:50:59.035967] [INFO ] [MAIN ] Update Progress: 408/2366 symbols completed. CBU took 31.9s. Estimated remaining: 4h 4m 26s. Rate: 8.0 symbols/min [2025-10-27T17:50:59.203978] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:59.204142] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-27T17:50:59.204178] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-27T17:50:59.204288] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-27T17:50:59.204328] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-27T17:50:59.204373] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-27T17:50:59.204431] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-27T17:50:59.555859] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:59.614910] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-27T17:51:00.028774] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-27T17:51:00.134978] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-27T17:51:00.210125] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T17:51:00.414940] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-27T17:51:01.214937] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-27T17:51:02.015017] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-27T17:51:02.814996] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-27T17:51:04.406204] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T17:51:04.407493] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-27T17:51:05.028795] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (4.61 seconds). [2025-10-27T17:51:05.039777] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-27T17:51:05.077478] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (3.06 seconds). [2025-10-27T17:51:05.214937] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-27T17:51:05.464548] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-27T17:51:05.665898] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (4.45 seconds). [2025-10-27T17:51:06.014970] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-27T17:51:06.352194] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T17:51:06.636395] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T17:51:06.814951] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-27T17:51:07.437277] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T17:51:07.614947] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-27T17:51:07.876619] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-27T17:51:08.032078] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-27T17:51:08.414956] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-27T17:51:09.214968] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-27T17:51:09.618448] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-27T17:51:09.625844] [INFO ] [REMOTE ] CBZ: Full fetch complete (46632 records). [2025-10-27T17:51:09.625940] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-27T17:51:09.772078] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-27T17:51:10.030033] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-27T17:51:10.050160] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-27T17:51:10.050257] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-27T17:51:10.050971] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-27T17:51:10.051039] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-27T17:51:10.052464] [DEBUG] [LOCAL ] CBZ: Trimmed 46632 records to 34157 (keeping 200 days of data) [2025-10-27T17:51:10.270158] [DEBUG] [LOCAL ] CBZ: Primary data saved (34157 records). [2025-10-27T17:51:10.270304] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-27T17:51:10.270384] [INFO ] [MAIN ] Update Progress: 409/2366 symbols completed. CBZ took 36.0s. Estimated remaining: 4h 4m 37s. Rate: 8.0 symbols/min [2025-10-27T17:51:10.436297] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:51:10.450262] [DEBUG] [LOCAL ] CCIF: Loaded 15444 existing records from primary storage. [2025-10-27T17:51:10.450472] [INFO ] [MAIN ] CCIF: Loaded 15444 existing records. [2025-10-27T17:51:10.637289] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:51:10.637489] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-27T17:51:10.637537] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-27T17:51:10.637736] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-27T17:51:10.637792] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-27T17:51:10.817735] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-27T17:51:10.999135] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:51:11.290126] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-27T17:51:11.614941] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-27T17:51:11.779661] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-27T17:51:12.414940] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-27T17:51:13.214921] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-27T17:51:13.522224] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-27T17:51:13.601341] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-27T17:51:13.602367] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T17:51:14.014947] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-27T17:51:14.814990] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-27T17:51:15.615016] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-27T17:51:15.750309] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-27T17:51:16.121239] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-27T17:51:16.342975] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-27T17:51:16.414926] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-27T17:51:17.214960] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-27T17:51:17.930575] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-27T17:51:18.014913] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-27T17:51:18.221439] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-27T17:51:18.814984] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-27T17:51:19.615003] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-27T17:51:19.834029] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-27T17:51:20.176767] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T17:51:20.414962] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-27T17:51:20.515706] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T17:51:21.214929] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-27T17:51:21.396403] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-27T17:51:22.014934] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-27T17:51:22.814934] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-27T17:51:23.045031] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T17:51:23.161478] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-27T17:51:23.171440] [INFO ] [REMOTE ] CC: Full fetch complete (76204 records). [2025-10-27T17:51:23.171552] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-27T17:51:23.601893] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-27T17:51:23.601988] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-27T17:51:23.602822] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-27T17:51:23.602885] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-27T17:51:23.604279] [DEBUG] [LOCAL ] CC: Trimmed 76204 records to 52972 (keeping 200 days of data) [2025-10-27T17:51:23.655537] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-27T17:51:23.919916] [DEBUG] [LOCAL ] CC: Primary data saved (52972 records). [2025-10-27T17:51:23.920146] [INFO ] [MAIN ] CC: Full history saved. [2025-10-27T17:51:23.920247] [INFO ] [MAIN ] Update Progress: 410/2366 symbols completed. CC took 37.5s. Estimated remaining: 4h 4m 58s. Rate: 8.0 symbols/min [2025-10-27T17:51:24.092929] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:51:24.141919] [DEBUG] [LOCAL ] CCJ: Loaded 54470 existing records from primary storage. [2025-10-27T17:51:24.142288] [INFO ] [MAIN ] CCJ: Loaded 54470 existing records. [2025-10-27T17:51:24.327403] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:51:24.327824] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-27T17:51:24.328028] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-27T17:51:24.338446] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-27T17:51:24.344669] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-27T17:51:24.420917] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T17:51:24.418755] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-27T17:51:24.724369] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:51:24.826942] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-27T17:51:24.829471] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-27T17:51:25.214914] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-27T17:51:26.014986] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-27T17:51:26.536443] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T17:51:26.537445] [INFO ] [REMOTE ] CCIA: Full fetch complete (2189 records). [2025-10-27T17:51:26.537536] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-27T17:51:26.713295] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-27T17:51:26.713473] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:51:26.713517] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:51:26.713578] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-27T17:51:26.713639] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-27T17:51:26.713723] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-27T17:51:26.713769] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-27T17:51:26.713822] [INFO ] [MAIN ] Update Progress: 411/2366 symbols completed. CCIA took 27.7s. Estimated remaining: 4h 4m 28s. Rate: 8.0 symbols/min [2025-10-27T17:51:26.820071] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-27T17:51:26.882908] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:51:26.923972] [DEBUG] [LOCAL ] CCK: Loaded 47246 existing records from primary storage. [2025-10-27T17:51:26.924252] [INFO ] [MAIN ] CCK: Loaded 47246 existing records. [2025-10-27T17:51:27.101620] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:51:27.101871] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-27T17:51:27.101936] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-27T17:51:27.102286] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-27T17:51:27.102453] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-27T17:51:27.462086] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-27T17:51:27.493632] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:51:27.614931] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-27T17:51:28.414923] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-27T17:51:28.655639] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-27T17:51:28.961713] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T17:51:29.215011] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-27T17:51:30.020067] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-27T17:51:30.042043] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T17:51:30.814928] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-27T17:51:30.844876] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T17:51:30.892345] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-27T17:51:31.614999] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-27T17:51:32.226384] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-27T17:51:32.414924] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-27T17:51:32.515410] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-27T17:51:33.214998] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-27T17:51:33.888167] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-27T17:51:34.014957] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-27T17:51:34.291842] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-27T17:51:34.814945] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-27T17:51:35.054799] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T17:51:35.057872] [INFO ] [REMOTE ] CCIF: Full fetch complete (22004 records). [2025-10-27T17:51:35.057943] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-27T17:51:35.408559] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-27T17:51:35.408632] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-27T17:51:35.408996] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-27T17:51:35.409042] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-27T17:51:35.409590] [DEBUG] [LOCAL ] CCIF: Trimmed 22004 records to 15071 (keeping 200 days of data) [2025-10-27T17:51:35.499951] [DEBUG] [LOCAL ] CCIF: Primary data saved (15071 records). [2025-10-27T17:51:35.500140] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-27T17:51:35.500230] [INFO ] [MAIN ] Update Progress: 412/2366 symbols completed. CCIF took 25.2s. Estimated remaining: 4h 4m 27s. Rate: 8.0 symbols/min [2025-10-27T17:51:35.620205] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-27T17:51:35.666199] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:51:35.715701] [DEBUG] [LOCAL ] CCL: Loaded 54580 existing records from primary storage. [2025-10-27T17:51:35.716000] [INFO ] [MAIN ] CCL: Loaded 54580 existing records. [2025-10-27T17:51:35.889595] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:51:35.889811] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-27T17:51:35.889857] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-27T17:51:35.890036] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-27T17:51:35.890073] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-27T17:51:36.233567] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:51:36.414961] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-27T17:51:36.633044] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-27T17:51:37.214937] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-27T17:51:37.416930] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-27T17:51:37.427897] [INFO ] [REMOTE ] CCI: Full fetch complete (77093 records). [2025-10-27T17:51:37.428018] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-27T17:51:37.817367] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-27T17:51:37.817546] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-27T17:51:37.818564] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-27T17:51:37.818681] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-27T17:51:37.820296] [DEBUG] [LOCAL ] CCI: Trimmed 77093 records to 53098 (keeping 200 days of data) [2025-10-27T17:51:38.022739] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-27T17:51:38.085447] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T17:51:38.214141] [DEBUG] [LOCAL ] CCI: Primary data saved (53098 records). [2025-10-27T17:51:38.214304] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-27T17:51:38.215370] [INFO ] [MAIN ] Update Progress: 413/2366 symbols completed. CCI took 41.6s. Estimated remaining: 4h 3m 57s. Rate: 8.0 symbols/min [2025-10-27T17:51:38.390795] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:51:38.437774] [DEBUG] [LOCAL ] CCO: Loaded 49282 existing records from primary storage. [2025-10-27T17:51:38.438115] [INFO ] [MAIN ] CCO: Loaded 49282 existing records. [2025-10-27T17:51:38.617134] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:51:38.617360] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-27T17:51:38.617407] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-27T17:51:38.617576] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-27T17:51:38.617613] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-27T17:51:38.827131] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-27T17:51:38.976589] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:51:39.340395] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-27T17:51:39.475762] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T17:51:39.614938] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-27T17:51:40.414920] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-27T17:51:40.682499] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-27T17:51:41.214983] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-27T17:51:41.725881] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T17:51:41.819947] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-27T17:51:42.014982] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-27T17:51:42.814909] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-27T17:51:43.000711] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-27T17:51:43.614947] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-27T17:51:43.765335] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T17:51:44.076180] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-27T17:51:44.414971] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-27T17:51:45.214927] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-27T17:51:45.598264] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-27T17:51:46.014949] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-27T17:51:46.628801] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T17:51:46.667499] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-27T17:51:46.814951] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-27T17:51:47.236307] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T17:51:47.615036] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-27T17:51:48.420046] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-27T17:51:48.435316] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-27T17:51:49.214941] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-27T17:51:49.815973] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-27T17:51:49.880725] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T17:51:50.014935] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-27T17:51:50.403138] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T17:51:50.814994] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-27T17:51:51.567249] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-27T17:51:51.614901] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-27T17:51:52.414916] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-27T17:51:52.593557] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-27T17:51:53.214987] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-27T17:51:53.348812] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T17:51:53.811398] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T17:51:54.014962] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-27T17:51:54.814944] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-27T17:51:55.310207] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-27T17:51:55.614936] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-27T17:51:56.414938] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-27T17:51:56.454321] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T17:51:56.541768] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.53 seconds). [2025-10-27T17:51:56.551930] [INFO ] [REMOTE ] CCJ: Full fetch complete (77840 records). [2025-10-27T17:51:56.552055] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-27T17:51:56.930908] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-27T17:51:56.930989] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-27T17:51:56.931809] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-27T17:51:56.931873] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-27T17:51:56.933276] [DEBUG] [LOCAL ] CCJ: Trimmed 77840 records to 53690 (keeping 200 days of data) [2025-10-27T17:51:57.220674] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-27T17:51:57.244049] [DEBUG] [LOCAL ] CCJ: Primary data saved (53690 records). [2025-10-27T17:51:57.244178] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-27T17:51:57.244275] [INFO ] [MAIN ] Update Progress: 414/2366 symbols completed. CCJ took 33.3s. Estimated remaining: 4h 4m 44s. Rate: 8.0 symbols/min [2025-10-27T17:51:57.410394] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:51:57.420002] [DEBUG] [LOCAL ] CCRD: Loaded 9672 existing records from primary storage. [2025-10-27T17:51:57.420198] [INFO ] [MAIN ] CCRD: Loaded 9672 existing records. [2025-10-27T17:51:57.600545] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:51:57.601135] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-27T17:51:57.601384] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-27T17:51:57.601638] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-27T17:51:57.601729] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-27T17:51:57.947898] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T17:51:58.024623] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:51:58.025987] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-27T17:51:58.058304] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-27T17:51:58.595256] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-27T17:51:58.604289] [INFO ] [REMOTE ] CCK: Full fetch complete (67870 records). [2025-10-27T17:51:58.604450] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-27T17:51:58.605222] [FATAL] [VALIDATOR ] CCK: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:51:58.605331] [FATAL] [MAIN ] CCK: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:51:58.605400] [WARN ] [MAIN ] CCK: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:51:58.605485] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-27T17:51:58.605564] [DEBUG] [LOCAL ] CCK: No primary data file found to delete. [2025-10-27T17:51:58.605601] [INFO ] [LOCAL ] CCK: Starting deletion of derivative data. [2025-10-27T17:51:58.605762] [DEBUG] [LOCAL ] CCK: Deleted derivative data file. [2025-10-27T17:51:58.605851] [INFO ] [MAIN ] Update Progress: 415/2366 symbols completed. CCK took 31.9s. Estimated remaining: 4h 4m 7s. Rate: 8.0 symbols/min [2025-10-27T17:51:58.774037] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:51:58.806019] [DEBUG] [LOCAL ] CCS: Loaded 30380 existing records from primary storage. [2025-10-27T17:51:58.806972] [INFO ] [MAIN ] CCS: Loaded 30380 existing records. [2025-10-27T17:51:58.820356] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-27T17:51:58.903145] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-27T17:51:58.997634] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:51:58.998076] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-27T17:51:58.998135] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-27T17:51:58.998719] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-27T17:51:58.998779] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-27T17:51:59.340973] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:51:59.614948] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-27T17:52:00.414967] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-27T17:52:00.483962] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T17:52:01.214994] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-27T17:52:01.807376] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-27T17:52:02.015002] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-27T17:52:02.815007] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-27T17:52:03.766795] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-10-27T17:52:03.768415] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-27T17:52:04.438830] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-27T17:52:04.445629] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-27T17:52:05.173420] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (4.76 seconds). [2025-10-27T17:52:05.214904] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-27T17:52:05.410583] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-10-27T17:52:05.513491] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-27T17:52:06.014926] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-27T17:52:06.103211] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T17:52:06.649870] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-27T17:52:06.814940] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-27T17:52:07.329025] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-27T17:52:07.366742] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-27T17:52:07.614941] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-27T17:52:08.414945] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-27T17:52:09.189669] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-27T17:52:09.214939] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-27T17:52:09.829163] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-27T17:52:09.839614] [INFO ] [REMOTE ] CCL: Full fetch complete (77980 records). [2025-10-27T17:52:09.839793] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-27T17:52:10.029568] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-27T17:52:10.251681] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-27T17:52:10.251768] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-27T17:52:10.252579] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-27T17:52:10.252639] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-27T17:52:10.254043] [DEBUG] [LOCAL ] CCL: Trimmed 77980 records to 53800 (keeping 200 days of data) [2025-10-27T17:52:10.476704] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T17:52:10.601251] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-10-27T17:52:10.601385] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-27T17:52:10.601983] [INFO ] [MAIN ] Update Progress: 416/2366 symbols completed. CCL took 35.1s. Estimated remaining: 4h 4m 21s. Rate: 8.0 symbols/min [2025-10-27T17:52:10.768244] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:52:10.788915] [DEBUG] [LOCAL ] CCU: Loaded 21859 existing records from primary storage. [2025-10-27T17:52:10.789149] [INFO ] [MAIN ] CCU: Loaded 21859 existing records. [2025-10-27T17:52:10.820028] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-27T17:52:10.962969] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:52:10.963165] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-27T17:52:10.963213] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-27T17:52:10.963469] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-27T17:52:10.963518] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-27T17:52:11.311356] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:52:11.614941] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-27T17:52:11.766620] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-27T17:52:11.776895] [INFO ] [REMOTE ] CCO: Full fetch complete (67494 records). [2025-10-27T17:52:11.777141] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-27T17:52:12.181497] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-27T17:52:12.191325] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-27T17:52:12.194329] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-27T17:52:12.195137] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-27T17:52:12.196106] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T17:52:12.205617] [DEBUG] [LOCAL ] CCO: Trimmed 67494 records to 48691 (keeping 200 days of data) [2025-10-27T17:52:12.416202] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-27T17:52:12.480165] [DEBUG] [LOCAL ] CCO: Primary data saved (48691 records). [2025-10-27T17:52:12.480466] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-27T17:52:12.480639] [INFO ] [MAIN ] Update Progress: 417/2366 symbols completed. CCO took 34.3s. Estimated remaining: 4h 3m 47s. Rate: 8.0 symbols/min [2025-10-27T17:52:12.644709] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-27T17:52:12.681815] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:52:12.681978] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-27T17:52:12.682015] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-27T17:52:12.682128] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-27T17:52:12.682169] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-27T17:52:12.682210] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-27T17:52:12.682245] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-27T17:52:13.079843] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:52:13.087698] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-27T17:52:13.214985] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-27T17:52:13.535305] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-27T17:52:14.014942] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-27T17:52:14.615398] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T17:52:14.814939] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-27T17:52:15.589712] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-27T17:52:15.614918] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-27T17:52:16.258718] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-27T17:52:16.260787] [INFO ] [REMOTE ] CCRD: Full fetch complete (11713 records). [2025-10-27T17:52:16.260855] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-27T17:52:16.429108] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-27T17:52:16.646798] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-27T17:52:16.646873] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-27T17:52:16.647155] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-27T17:52:16.647213] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-27T17:52:16.647706] [DEBUG] [LOCAL ] CCRD: Trimmed 11713 records to 9616 (keeping 200 days of data) [2025-10-27T17:52:16.701138] [DEBUG] [LOCAL ] CCRD: Primary data saved (9616 records). [2025-10-27T17:52:16.701260] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-27T17:52:16.701334] [INFO ] [MAIN ] Update Progress: 418/2366 symbols completed. CCRD took 19.5s. Estimated remaining: 4h 3m 24s. Rate: 8.0 symbols/min [2025-10-27T17:52:16.864475] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:52:16.912377] [DEBUG] [LOCAL ] CDE: Loaded 54424 existing records from primary storage. [2025-10-27T17:52:16.912700] [INFO ] [MAIN ] CDE: Loaded 54424 existing records. [2025-10-27T17:52:17.085535] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:52:17.085782] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-27T17:52:17.085829] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-27T17:52:17.085996] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-27T17:52:17.086034] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-27T17:52:17.220765] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-27T17:52:17.436910] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:52:17.572149] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T17:52:18.015027] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-27T17:52:18.154251] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-27T17:52:18.317838] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-27T17:52:18.814939] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-27T17:52:19.033205] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-27T17:52:19.614945] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-27T17:52:20.414949] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-27T17:52:20.924783] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T17:52:21.214941] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-27T17:52:21.481077] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T17:52:22.014950] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-27T17:52:22.814931] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-27T17:52:23.042114] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-27T17:52:23.246684] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-27T17:52:23.614942] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-27T17:52:23.997221] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T17:52:24.414951] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-27T17:52:24.529512] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T17:52:25.214948] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-27T17:52:26.014954] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-27T17:52:26.147073] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-27T17:52:26.199040] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T17:52:26.814916] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-27T17:52:26.880186] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-27T17:52:27.614976] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-27T17:52:28.016324] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T17:52:28.414991] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-27T17:52:28.832256] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T17:52:28.837488] [INFO ] [REMOTE ] CCS: Full fetch complete (44749 records). [2025-10-27T17:52:28.837617] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-27T17:52:29.217931] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-27T17:52:29.218163] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-27T17:52:29.218241] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-27T17:52:29.219731] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-27T17:52:29.219815] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-27T17:52:29.220852] [DEBUG] [LOCAL ] CCS: Trimmed 44749 records to 29822 (keeping 200 days of data) [2025-10-27T17:52:29.397549] [DEBUG] [LOCAL ] CCS: Primary data saved (29822 records). [2025-10-27T17:52:29.397700] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-27T17:52:29.397789] [INFO ] [MAIN ] Update Progress: 419/2366 symbols completed. CCS took 30.8s. Estimated remaining: 4h 3m 41s. Rate: 8.0 symbols/min [2025-10-27T17:52:29.566149] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:52:29.577770] [DEBUG] [LOCAL ] CDLR: Loaded 10348 existing records from primary storage. [2025-10-27T17:52:29.577974] [INFO ] [MAIN ] CDLR: Loaded 10348 existing records. [2025-10-27T17:52:29.751019] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:52:29.751213] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-27T17:52:29.751291] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-27T17:52:29.751503] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-27T17:52:29.751568] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-27T17:52:30.019745] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-27T17:52:30.123359] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:52:30.138440] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T17:52:30.362164] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-27T17:52:30.494000] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-27T17:52:30.814920] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-27T17:52:31.614962] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-27T17:52:32.219733] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T17:52:32.391577] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T17:52:32.414905] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-27T17:52:33.214907] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-27T17:52:33.609973] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-27T17:52:33.613603] [INFO ] [REMOTE ] CCU: Full fetch complete (32277 records). [2025-10-27T17:52:33.613713] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-27T17:52:33.747324] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-27T17:52:33.995713] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-27T17:52:33.995806] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-27T17:52:33.996260] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-27T17:52:33.996300] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-27T17:52:33.997007] [DEBUG] [LOCAL ] CCU: Trimmed 32277 records to 21160 (keeping 200 days of data) [2025-10-27T17:52:34.043693] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-27T17:52:34.117915] [DEBUG] [LOCAL ] CCU: Primary data saved (21160 records). [2025-10-27T17:52:34.118018] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-27T17:52:34.118088] [INFO ] [MAIN ] Update Progress: 420/2366 symbols completed. CCU took 23.5s. Estimated remaining: 4h 3m 20s. Rate: 8.0 symbols/min [2025-10-27T17:52:34.291238] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:52:34.330356] [DEBUG] [LOCAL ] CDP: Loaded 42901 existing records from primary storage. [2025-10-27T17:52:34.330636] [INFO ] [MAIN ] CDP: Loaded 42901 existing records. [2025-10-27T17:52:34.505776] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:52:34.505997] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-27T17:52:34.506055] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-27T17:52:34.506227] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-27T17:52:34.506266] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-27T17:52:34.620138] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T17:52:34.820160] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-27T17:52:34.877293] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:52:35.171918] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-27T17:52:35.614942] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-27T17:52:35.926463] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:52:35.926830] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-27T17:52:35.926931] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:52:35.927045] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-27T17:52:35.927148] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:52:35.927230] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-27T17:52:35.927305] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-27T17:52:35.927347] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-27T17:52:35.927396] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-27T17:52:35.927449] [INFO ] [MAIN ] Update Progress: 421/2366 symbols completed. CCZ took 23.4s. Estimated remaining: 4h 2m 47s. Rate: 8.0 symbols/min [2025-10-27T17:52:36.105304] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:52:36.127308] [DEBUG] [LOCAL ] CDRE: Loaded 24976 existing records from primary storage. [2025-10-27T17:52:36.127568] [INFO ] [MAIN ] CDRE: Loaded 24976 existing records. [2025-10-27T17:52:36.301799] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:52:36.301987] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-27T17:52:36.302032] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-27T17:52:36.302221] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-27T17:52:36.302259] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-27T17:52:36.420170] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-27T17:52:36.658004] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:52:37.214945] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-27T17:52:38.015074] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-27T17:52:38.074407] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-27T17:52:38.704322] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-27T17:52:38.794424] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-27T17:52:38.815002] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-27T17:52:39.614984] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-27T17:52:40.369346] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-27T17:52:40.414897] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-27T17:52:41.143923] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T17:52:41.214902] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-27T17:52:41.727748] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T17:52:42.014965] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-27T17:52:42.217990] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-27T17:52:42.814946] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-27T17:52:43.614980] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-27T17:52:43.967518] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-27T17:52:44.177827] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-27T17:52:44.424878] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-27T17:52:44.430023] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T17:52:45.214990] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-27T17:52:45.943616] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-27T17:52:46.014968] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-27T17:52:46.425335] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-27T17:52:46.814949] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-27T17:52:47.253702] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T17:52:47.615031] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-27T17:52:48.415012] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-27T17:52:49.029433] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-27T17:52:49.183777] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-27T17:52:49.214902] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-27T17:52:49.253449] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-27T17:52:49.267336] [INFO ] [REMOTE ] CDE: Full fetch complete (77796 records). [2025-10-27T17:52:49.267489] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-27T17:52:49.651816] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-27T17:52:49.651892] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-27T17:52:49.652702] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-27T17:52:49.652765] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-27T17:52:49.654138] [DEBUG] [LOCAL ] CDE: Trimmed 77796 records to 53644 (keeping 200 days of data) [2025-10-27T17:52:49.965497] [DEBUG] [LOCAL ] CDE: Primary data saved (53644 records). [2025-10-27T17:52:49.965699] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-27T17:52:49.965804] [INFO ] [MAIN ] Update Progress: 422/2366 symbols completed. CDE took 33.3s. Estimated remaining: 4h 3m 9s. Rate: 8.0 symbols/min [2025-10-27T17:52:50.021905] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-27T17:52:50.138672] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:52:50.182966] [DEBUG] [LOCAL ] CE: Loaded 51959 existing records from primary storage. [2025-10-27T17:52:50.183282] [INFO ] [MAIN ] CE: Loaded 51959 existing records. [2025-10-27T17:52:50.362959] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:52:50.363193] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-27T17:52:50.363240] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-27T17:52:50.363501] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-27T17:52:50.363538] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-27T17:52:50.726025] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:52:50.750954] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T17:52:50.814949] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-27T17:52:51.283389] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-27T17:52:51.615000] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-27T17:52:52.053080] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T17:52:52.414928] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-27T17:52:52.924895] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T17:52:53.215001] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-27T17:52:53.567152] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T17:52:53.819738] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T17:52:54.014969] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-27T17:52:54.814947] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-27T17:52:54.836522] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T17:52:55.614940] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-27T17:52:55.645909] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-27T17:52:56.415004] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-27T17:52:56.870585] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-27T17:52:57.034448] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T17:52:57.214943] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-27T17:52:58.014953] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-27T17:52:58.395615] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T17:52:58.814909] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-27T17:52:59.400774] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-27T17:52:59.614982] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-27T17:52:59.663908] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T17:53:00.414960] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-27T17:53:01.214971] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-27T17:53:02.014958] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-27T17:53:02.593212] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (2.98 seconds). [2025-10-27T17:53:02.815009] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-27T17:53:05.212759] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (4.80 seconds). [2025-10-27T17:53:05.221821] [INFO ] [REMOTE ] CDP: Full fetch complete (62217 records). [2025-10-27T17:53:05.221969] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-27T17:53:05.421787] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (4.21 seconds). [2025-10-27T17:53:05.466038] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-27T17:53:05.684874] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-27T17:53:05.684985] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-27T17:53:05.685695] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-27T17:53:05.685899] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-27T17:53:05.687410] [DEBUG] [LOCAL ] CDP: Trimmed 62217 records to 42185 (keeping 200 days of data) [2025-10-27T17:53:05.814547] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (3.00 seconds). [2025-10-27T17:53:05.858124] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-27T17:53:06.004325] [DEBUG] [LOCAL ] CDP: Primary data saved (42185 records). [2025-10-27T17:53:06.013046] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-27T17:53:06.013849] [INFO ] [MAIN ] Update Progress: 423/2366 symbols completed. CDP took 31.9s. Estimated remaining: 4h 3m 41s. Rate: 8.0 symbols/min [2025-10-27T17:53:06.045905] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (4.03 seconds). [2025-10-27T17:53:06.073297] [INFO ] [REMOTE ] CDLR: Full fetch complete (14367 records). [2025-10-27T17:53:06.087626] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-27T17:53:06.352003] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:53:06.495032] [DEBUG] [LOCAL ] CEE: Loaded 5157 existing records from primary storage. [2025-10-27T17:53:06.498404] [INFO ] [MAIN ] CEE: Loaded 5157 existing records. [2025-10-27T17:53:06.741681] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-27T17:53:06.761335] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:53:06.761918] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-27T17:53:06.762006] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-27T17:53:06.761614] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-27T17:53:06.762732] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-27T17:53:06.762819] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-27T17:53:06.763038] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-27T17:53:06.762960] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-27T17:53:06.806992] [DEBUG] [LOCAL ] CDLR: Trimmed 14367 records to 10141 (keeping 200 days of data) [2025-10-27T17:53:06.953075] [DEBUG] [LOCAL ] CDLR: Primary data saved (10141 records). [2025-10-27T17:53:06.963576] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-27T17:53:06.983440] [INFO ] [MAIN ] Update Progress: 424/2366 symbols completed. CDLR took 37.6s. Estimated remaining: 4h 3m 3s. Rate: 8.0 symbols/min [2025-10-27T17:53:07.020164] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-27T17:53:07.111563] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-27T17:53:07.392305] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:53:07.398060] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:53:07.398785] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-27T17:53:07.425881] [DEBUG] [LOCAL ] CEPU: Loaded 27514 existing records from primary storage. [2025-10-27T17:53:07.426196] [INFO ] [MAIN ] CEPU: Loaded 27514 existing records. [2025-10-27T17:53:07.610425] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:53:07.610702] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-27T17:53:07.610773] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-27T17:53:07.610951] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-27T17:53:07.610991] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-27T17:53:07.983454] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:53:07.983902] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-27T17:53:08.124417] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T17:53:08.125993] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-27T17:53:08.233589] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-27T17:53:08.301837] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-27T17:53:08.414909] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-27T17:53:09.013336] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T17:53:09.078621] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-27T17:53:09.214953] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-27T17:53:09.566660] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T17:53:10.014974] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-27T17:53:10.204300] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T17:53:10.665374] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-27T17:53:10.814947] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-27T17:53:11.615044] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-27T17:53:12.050435] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-27T17:53:12.055026] [INFO ] [REMOTE ] CDRE: Full fetch complete (34961 records). [2025-10-27T17:53:12.055115] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-27T17:53:12.346084] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-27T17:53:12.420055] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-27T17:53:12.433262] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-27T17:53:12.433318] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-27T17:53:12.433808] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-27T17:53:12.433873] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-27T17:53:12.434822] [DEBUG] [LOCAL ] CDRE: Trimmed 34961 records to 24420 (keeping 200 days of data) [2025-10-27T17:53:12.575521] [DEBUG] [LOCAL ] CDRE: Primary data saved (24420 records). [2025-10-27T17:53:12.575665] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-27T17:53:12.575761] [INFO ] [MAIN ] Update Progress: 425/2366 symbols completed. CDRE took 36.6s. Estimated remaining: 4h 2m 47s. Rate: 8.0 symbols/min [2025-10-27T17:53:12.760850] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:53:12.805909] [DEBUG] [LOCAL ] CF: Loaded 52842 existing records from primary storage. [2025-10-27T17:53:12.806207] [INFO ] [MAIN ] CF: Loaded 52842 existing records. [2025-10-27T17:53:12.979415] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:53:12.979610] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-27T17:53:12.979682] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-27T17:53:12.979978] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-27T17:53:12.980017] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-27T17:53:13.223791] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-27T17:53:13.351088] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:53:13.545162] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T17:53:14.014939] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-27T17:53:14.472218] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-27T17:53:14.814944] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-27T17:53:15.109192] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-27T17:53:15.615009] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-27T17:53:16.414932] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-27T17:53:16.690742] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-27T17:53:16.740121] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-27T17:53:17.214945] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-27T17:53:17.610370] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-27T17:53:18.011594] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T17:53:18.021541] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-27T17:53:18.782082] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-27T17:53:18.814898] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-27T17:53:19.614977] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-27T17:53:19.637466] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T17:53:20.414942] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-27T17:53:20.801019] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-27T17:53:21.214924] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-27T17:53:21.363568] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-27T17:53:21.633528] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-27T17:53:21.634722] [INFO ] [REMOTE ] CEE: Full fetch complete (10120 records). [2025-10-27T17:53:21.634795] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-27T17:53:22.028882] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-27T17:53:22.020461] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-27T17:53:22.029098] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-27T17:53:22.029616] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-27T17:53:22.030342] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-27T17:53:22.030812] [DEBUG] [LOCAL ] CEE: Trimmed 10120 records to 4934 (keeping 200 days of data) [2025-10-27T17:53:22.060053] [DEBUG] [LOCAL ] CEE: Primary data saved (4934 records). [2025-10-27T17:53:22.060149] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-27T17:53:22.060222] [INFO ] [MAIN ] Update Progress: 426/2366 symbols completed. CEE took 16.0s. Estimated remaining: 4h 2m 49s. Rate: 8.0 symbols/min [2025-10-27T17:53:22.231079] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:53:22.282044] [DEBUG] [LOCAL ] CFG: Loaded 54402 existing records from primary storage. [2025-10-27T17:53:22.282379] [INFO ] [MAIN ] CFG: Loaded 54402 existing records. [2025-10-27T17:53:22.455479] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:53:22.455727] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-27T17:53:22.455781] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-27T17:53:22.455981] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-27T17:53:22.456045] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-27T17:53:22.799157] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:53:22.815115] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-27T17:53:23.220881] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T17:53:23.614992] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-27T17:53:24.396047] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T17:53:24.414917] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-27T17:53:24.979584] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T17:53:25.214951] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-27T17:53:26.014922] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-27T17:53:26.121870] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T17:53:26.132751] [INFO ] [REMOTE ] CE: Full fetch complete (74745 records). [2025-10-27T17:53:26.132923] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-27T17:53:26.494074] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-27T17:53:26.722782] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-27T17:53:26.722888] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-27T17:53:26.723807] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-27T17:53:26.723877] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-27T17:53:26.725538] [DEBUG] [LOCAL ] CE: Trimmed 74745 records to 51167 (keeping 200 days of data) [2025-10-27T17:53:26.822849] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-27T17:53:27.056406] [DEBUG] [LOCAL ] CE: Primary data saved (51167 records). [2025-10-27T17:53:27.056548] [INFO ] [MAIN ] CE: Full history saved. [2025-10-27T17:53:27.056628] [INFO ] [MAIN ] Update Progress: 427/2366 symbols completed. CE took 37.1s. Estimated remaining: 4h 2m 30s. Rate: 8.0 symbols/min [2025-10-27T17:53:27.234179] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:53:27.234362] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-27T17:53:27.234410] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-27T17:53:27.234520] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-27T17:53:27.234564] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-27T17:53:27.234604] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-27T17:53:27.234681] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-27T17:53:27.583481] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:53:27.614897] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-10-27T17:53:27.688076] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-27T17:53:27.805812] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:53:27.806064] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-10-27T17:53:27.806162] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:53:27.806233] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-27T17:53:27.806268] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:53:27.806307] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-27T17:53:27.806362] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-27T17:53:27.806397] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-27T17:53:27.806435] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-27T17:53:27.806481] [INFO ] [MAIN ] Update Progress: 428/2366 symbols completed. CFND took 0.7s. Estimated remaining: 4h 1m 52s. Rate: 8.0 symbols/min [2025-10-27T17:53:27.972803] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:53:28.002999] [DEBUG] [LOCAL ] CFR: Loaded 32889 existing records from primary storage. [2025-10-27T17:53:28.003262] [INFO ] [MAIN ] CFR: Loaded 32889 existing records. [2025-10-27T17:53:28.179731] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:53:28.180112] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-27T17:53:28.180258] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-27T17:53:28.187417] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-27T17:53:28.197200] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-27T17:53:28.262014] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T17:53:28.420233] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-27T17:53:28.557884] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:53:29.214988] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-27T17:53:29.976402] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T17:53:30.014905] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-27T17:53:30.808689] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-27T17:53:30.818492] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-27T17:53:31.274620] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T17:53:31.615029] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-27T17:53:32.290349] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T17:53:32.414930] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-27T17:53:32.548229] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-27T17:53:33.214944] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-27T17:53:34.014976] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-27T17:53:34.268549] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-27T17:53:34.804421] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T17:53:34.815031] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-27T17:53:35.412327] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T17:53:35.614954] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-27T17:53:36.102605] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-27T17:53:36.414927] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-27T17:53:36.811180] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T17:53:37.214947] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-27T17:53:37.834326] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-27T17:53:38.014960] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-27T17:53:38.393575] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T17:53:38.814938] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-27T17:53:39.614949] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-27T17:53:39.996832] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-27T17:53:40.414963] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-27T17:53:40.665352] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-27T17:53:40.726202] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-27T17:53:41.214969] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-27T17:53:41.781363] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T17:53:42.014910] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-27T17:53:42.080545] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T17:53:42.486235] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-27T17:53:42.496629] [INFO ] [REMOTE ] CF: Full fetch complete (75589 records). [2025-10-27T17:53:42.496809] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-27T17:53:42.820042] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-27T17:53:42.905261] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-27T17:53:42.905336] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-27T17:53:42.906132] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-27T17:53:42.906193] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-27T17:53:42.907775] [DEBUG] [LOCAL ] CF: Trimmed 75589 records to 52070 (keeping 200 days of data) [2025-10-27T17:53:43.211889] [DEBUG] [LOCAL ] CF: Primary data saved (52070 records). [2025-10-27T17:53:43.212010] [INFO ] [MAIN ] CF: Full history saved. [2025-10-27T17:53:43.212714] [INFO ] [MAIN ] Update Progress: 429/2366 symbols completed. CF took 30.6s. Estimated remaining: 4h 2m 20s. Rate: 8.0 symbols/min [2025-10-27T17:53:43.377680] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:53:43.418568] [DEBUG] [LOCAL ] CGAU: Loaded 44606 existing records from primary storage. [2025-10-27T17:53:43.418895] [INFO ] [MAIN ] CGAU: Loaded 44606 existing records. [2025-10-27T17:53:43.597160] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:53:43.597366] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-27T17:53:43.597412] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-27T17:53:43.597743] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-27T17:53:43.597798] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-27T17:53:43.620042] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-27T17:53:43.963886] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:53:44.013819] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T17:53:44.414936] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-27T17:53:45.214938] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-27T17:53:45.346217] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-27T17:53:45.413747] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T17:53:46.014998] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-27T17:53:46.291706] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-27T17:53:46.814934] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-27T17:53:47.488930] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T17:53:47.614911] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-27T17:53:47.924162] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T17:53:48.414993] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-27T17:53:49.218074] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-27T17:53:49.233306] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-27T17:53:49.449026] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-27T17:53:50.014956] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-27T17:53:50.132683] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-27T17:53:50.814951] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-27T17:53:51.461257] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T17:53:51.614921] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-27T17:53:52.340293] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T17:53:52.354510] [INFO ] [REMOTE ] CEPU: Full fetch complete (39710 records). [2025-10-27T17:53:52.354776] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-27T17:53:52.420465] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-27T17:53:52.729092] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-27T17:53:52.729164] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-27T17:53:52.729712] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-27T17:53:52.729773] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-27T17:53:52.730569] [DEBUG] [LOCAL ] CEPU: Trimmed 39710 records to 27156 (keeping 200 days of data) [2025-10-27T17:53:52.878520] [DEBUG] [LOCAL ] CEPU: Primary data saved (27156 records). [2025-10-27T17:53:52.878638] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-27T17:53:52.878757] [INFO ] [MAIN ] Update Progress: 430/2366 symbols completed. CEPU took 45.9s. Estimated remaining: 4h 2m 22s. Rate: 8.0 symbols/min [2025-10-27T17:53:53.045557] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:53:53.049262] [DEBUG] [LOCAL ] CGV: Loaded 1374 existing records from primary storage. [2025-10-27T17:53:53.049398] [INFO ] [MAIN ] CGV: Loaded 1374 existing records. [2025-10-27T17:53:53.216700] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-27T17:53:53.236866] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:53:53.237758] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-27T17:53:53.237807] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-27T17:53:53.237916] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-27T17:53:53.237958] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-27T17:53:53.605941] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:53:53.633567] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-27T17:53:53.643835] [INFO ] [REMOTE ] CFG: Full fetch complete (77780 records). [2025-10-27T17:53:53.643958] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-27T17:53:54.021303] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-27T17:53:54.041140] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-27T17:53:54.041222] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-27T17:53:54.042093] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-27T17:53:54.042362] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-27T17:53:54.044310] [DEBUG] [LOCAL ] CFG: Trimmed 77780 records to 53622 (keeping 200 days of data) [2025-10-27T17:53:54.179328] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-27T17:53:54.406982] [DEBUG] [LOCAL ] CFG: Primary data saved (53622 records). [2025-10-27T17:53:54.425068] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-27T17:53:54.425280] [INFO ] [MAIN ] Update Progress: 431/2366 symbols completed. CFG took 32.4s. Estimated remaining: 4h 1m 48s. Rate: 8.0 symbols/min [2025-10-27T17:53:54.426710] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-27T17:53:54.481817] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-27T17:53:54.612873] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:53:54.636557] [DEBUG] [LOCAL ] CHCT: Loaded 24555 existing records from primary storage. [2025-10-27T17:53:54.636849] [INFO ] [MAIN ] CHCT: Loaded 24555 existing records. [2025-10-27T17:53:54.817432] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:53:54.817493] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-27T17:53:54.817851] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-27T17:53:54.818722] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-27T17:53:54.819092] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-27T17:53:54.819150] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-27T17:53:55.177917] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:53:55.411801] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-27T17:53:55.614990] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-27T17:53:56.414916] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-27T17:53:56.713767] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-27T17:53:56.768162] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T17:53:57.214990] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-27T17:53:57.684371] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-27T17:53:58.015000] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-27T17:53:58.814926] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-27T17:53:59.154446] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-27T17:53:59.614952] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-27T17:53:59.655631] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T17:54:00.039440] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-27T17:54:00.414979] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-27T17:54:01.214980] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-27T17:54:02.014977] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-27T17:54:02.815016] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-27T17:54:03.469598] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (3.05 seconds). [2025-10-27T17:54:03.614944] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-27T17:54:05.129936] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (3.91 seconds). [2025-10-27T17:54:05.141174] [INFO ] [REMOTE ] CFR: Full fetch complete (48433 records). [2025-10-27T17:54:05.147848] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-27T17:54:05.148948] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-27T17:54:05.153884] [FATAL] [VALIDATOR ] CFR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:54:05.154678] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-27T17:54:05.154388] [FATAL] [MAIN ] CFR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:54:05.155422] [WARN ] [MAIN ] CFR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:54:05.155510] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-27T17:54:05.155592] [DEBUG] [LOCAL ] CFR: No primary data file found to delete. [2025-10-27T17:54:05.155692] [INFO ] [LOCAL ] CFR: Starting deletion of derivative data. [2025-10-27T17:54:05.155842] [DEBUG] [LOCAL ] CFR: Deleted derivative data file. [2025-10-27T17:54:05.155913] [INFO ] [MAIN ] Update Progress: 432/2366 symbols completed. CFR took 37.3s. Estimated remaining: 4h 1m 55s. Rate: 8.0 symbols/min [2025-10-27T17:54:05.271771] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T17:54:05.273047] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-27T17:54:05.345287] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:54:05.390555] [DEBUG] [LOCAL ] CHD: Loaded 53076 existing records from primary storage. [2025-10-27T17:54:05.390903] [INFO ] [MAIN ] CHD: Loaded 53076 existing records. [2025-10-27T17:54:05.564389] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:54:05.564575] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-27T17:54:05.564622] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-27T17:54:05.564920] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-27T17:54:05.564974] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-27T17:54:05.826951] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-27T17:54:05.914440] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:54:06.014908] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-27T17:54:06.699394] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (4.68 seconds). [2025-10-27T17:54:06.814937] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-27T17:54:07.122228] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-27T17:54:07.614998] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-27T17:54:07.989287] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-27T17:54:08.259856] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T17:54:08.369993] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-27T17:54:08.414966] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-27T17:54:09.214962] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-27T17:54:09.995961] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-27T17:54:10.014903] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-27T17:54:10.814959] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-27T17:54:10.875499] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T17:54:11.337737] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T17:54:11.338575] [INFO ] [REMOTE ] CGV: Full fetch complete (2198 records). [2025-10-27T17:54:11.338667] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-27T17:54:11.619891] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-27T17:54:11.652492] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T17:54:11.772199] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-27T17:54:11.772285] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-27T17:54:11.772415] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-27T17:54:11.772485] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-27T17:54:11.772863] [DEBUG] [LOCAL ] CGV: Trimmed 2198 records to 1306 (keeping 200 days of data) [2025-10-27T17:54:11.781051] [DEBUG] [LOCAL ] CGV: Primary data saved (1306 records). [2025-10-27T17:54:11.781115] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-27T17:54:11.781180] [INFO ] [MAIN ] Update Progress: 433/2366 symbols completed. CGV took 18.9s. Estimated remaining: 4h 1m 43s. Rate: 8.0 symbols/min [2025-10-27T17:54:11.956998] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:54:11.973209] [DEBUG] [LOCAL ] CHE: Loaded 15561 existing records from primary storage. [2025-10-27T17:54:11.973444] [INFO ] [MAIN ] CHE: Loaded 15561 existing records. [2025-10-27T17:54:12.161351] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:54:12.161556] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-27T17:54:12.161617] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-27T17:54:12.161836] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-27T17:54:12.161900] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-27T17:54:12.420187] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-27T17:54:12.611781] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T17:54:12.617121] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:54:13.214964] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-27T17:54:14.020534] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-27T17:54:14.039401] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-27T17:54:14.292679] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T17:54:14.733827] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-27T17:54:14.814948] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-27T17:54:15.614938] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-27T17:54:16.061050] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T17:54:16.415020] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-27T17:54:17.214944] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-27T17:54:17.331860] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T17:54:17.350789] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T17:54:18.014951] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-27T17:54:18.118036] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T17:54:18.586266] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-27T17:54:18.814987] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-27T17:54:19.621181] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-27T17:54:19.623500] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-27T17:54:20.327157] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T17:54:20.414926] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-27T17:54:21.214930] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-27T17:54:21.438569] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T17:54:21.443098] [INFO ] [REMOTE ] CHCT: Full fetch complete (34544 records). [2025-10-27T17:54:21.443185] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-27T17:54:21.443709] [FATAL] [VALIDATOR ] CHCT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:54:21.443794] [FATAL] [MAIN ] CHCT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:54:21.443835] [WARN ] [MAIN ] CHCT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:54:21.443897] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-27T17:54:21.443957] [DEBUG] [LOCAL ] CHCT: No primary data file found to delete. [2025-10-27T17:54:21.443991] [INFO ] [LOCAL ] CHCT: Starting deletion of derivative data. [2025-10-27T17:54:21.444110] [DEBUG] [LOCAL ] CHCT: Deleted derivative data file. [2025-10-27T17:54:21.444173] [INFO ] [MAIN ] Update Progress: 434/2366 symbols completed. CHCT took 27.0s. Estimated remaining: 4h 1m 45s. Rate: 8.0 symbols/min [2025-10-27T17:54:21.607778] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:54:21.649249] [DEBUG] [LOCAL ] CHGG: Loaded 48084 existing records from primary storage. [2025-10-27T17:54:21.649533] [INFO ] [MAIN ] CHGG: Loaded 48084 existing records. [2025-10-27T17:54:21.823041] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:54:21.823236] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-27T17:54:21.823282] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-27T17:54:21.823523] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-27T17:54:21.823560] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-27T17:54:22.026367] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-27T17:54:22.177708] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:54:22.817937] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-27T17:54:22.823133] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-27T17:54:22.833708] [INFO ] [REMOTE ] CGAU: Full fetch complete (62307 records). [2025-10-27T17:54:22.833896] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-27T17:54:23.142476] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T17:54:23.237724] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-27T17:54:23.237815] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-27T17:54:23.238535] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-27T17:54:23.238577] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-27T17:54:23.240348] [DEBUG] [LOCAL ] CGAU: Trimmed 62307 records to 43897 (keeping 200 days of data) [2025-10-27T17:54:23.518252] [DEBUG] [LOCAL ] CGAU: Primary data saved (43897 records). [2025-10-27T17:54:23.518416] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-27T17:54:23.518527] [INFO ] [MAIN ] Update Progress: 435/2366 symbols completed. CGAU took 40.3s. Estimated remaining: 4h 1m 14s. Rate: 8.0 symbols/min [2025-10-27T17:54:23.618931] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-27T17:54:23.690739] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:54:23.724789] [DEBUG] [LOCAL ] CHH: Loaded 32762 existing records from primary storage. [2025-10-27T17:54:23.725043] [INFO ] [MAIN ] CHH: Loaded 32762 existing records. [2025-10-27T17:54:23.900092] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:54:23.900281] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-27T17:54:23.900327] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-27T17:54:23.900626] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-27T17:54:23.900717] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-27T17:54:24.253413] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:54:24.420032] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-27T17:54:24.439091] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-27T17:54:24.489616] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T17:54:25.214968] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-27T17:54:26.014948] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-27T17:54:26.241113] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-27T17:54:26.393485] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T17:54:26.815053] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-27T17:54:27.011923] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T17:54:27.614939] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-27T17:54:28.264618] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T17:54:28.414966] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-27T17:54:29.214971] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-27T17:54:29.267955] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T17:54:29.416244] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-27T17:54:29.857311] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-27T17:54:30.014981] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-27T17:54:30.814981] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-27T17:54:31.349368] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-27T17:54:31.615001] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-27T17:54:32.121065] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T17:54:32.414913] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-27T17:54:32.678551] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-27T17:54:33.214945] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-27T17:54:34.014983] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-27T17:54:34.086121] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T17:54:34.602592] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T17:54:34.606133] [INFO ] [REMOTE ] CHE: Full fetch complete (20653 records). [2025-10-27T17:54:34.606204] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-27T17:54:34.825129] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-27T17:54:35.003078] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-27T17:54:35.003155] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-27T17:54:35.003513] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-27T17:54:35.003551] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-27T17:54:35.004182] [DEBUG] [LOCAL ] CHE: Trimmed 20653 records to 15307 (keeping 200 days of data) [2025-10-27T17:54:35.104633] [DEBUG] [LOCAL ] CHE: Primary data saved (15307 records). [2025-10-27T17:54:35.104801] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-27T17:54:35.104881] [INFO ] [MAIN ] Update Progress: 436/2366 symbols completed. CHE took 23.3s. Estimated remaining: 4h 1m 24s. Rate: 8.0 symbols/min [2025-10-27T17:54:35.272455] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:54:35.294599] [DEBUG] [LOCAL ] CHMI: Loaded 21387 existing records from primary storage. [2025-10-27T17:54:35.294901] [INFO ] [MAIN ] CHMI: Loaded 21387 existing records. [2025-10-27T17:54:35.474956] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:54:35.475218] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-27T17:54:35.475278] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-27T17:54:35.475504] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-27T17:54:35.475607] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-27T17:54:35.620018] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-27T17:54:35.841162] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:54:35.871829] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-27T17:54:36.420956] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-27T17:54:36.425942] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T17:54:36.963368] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T17:54:37.214947] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-27T17:54:37.245607] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-27T17:54:38.014954] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-27T17:54:38.368484] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T17:54:38.814988] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-27T17:54:39.614963] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-27T17:54:39.839385] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-27T17:54:40.196444] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T17:54:40.415018] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-27T17:54:41.062670] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T17:54:41.214925] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-27T17:54:41.331240] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T17:54:42.014999] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-27T17:54:42.755026] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T17:54:42.814987] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-27T17:54:43.614974] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-27T17:54:43.693815] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-27T17:54:43.803393] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-27T17:54:44.414956] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-27T17:54:44.903491] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T17:54:44.912820] [INFO ] [REMOTE ] CHD: Full fetch complete (74625 records). [2025-10-27T17:54:44.912937] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-27T17:54:44.913700] [FATAL] [VALIDATOR ] CHD: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:54:44.913784] [FATAL] [MAIN ] CHD: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:54:44.913825] [WARN ] [MAIN ] CHD: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:54:44.913863] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-27T17:54:44.913918] [DEBUG] [LOCAL ] CHD: No primary data file found to delete. [2025-10-27T17:54:44.913951] [INFO ] [LOCAL ] CHD: Starting deletion of derivative data. [2025-10-27T17:54:44.914098] [DEBUG] [LOCAL ] CHD: Deleted derivative data file. [2025-10-27T17:54:44.914184] [INFO ] [MAIN ] Update Progress: 437/2366 symbols completed. CHD took 39.8s. Estimated remaining: 4h 1m 27s. Rate: 8.0 symbols/min [2025-10-27T17:54:45.214946] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-27T17:54:45.351249] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-27T17:54:46.014993] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-27T17:54:46.488248] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-27T17:54:46.815003] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-27T17:54:47.354718] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T17:54:47.614938] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-27T17:54:47.713286] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T17:54:48.414949] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-27T17:54:48.987930] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T17:54:49.214936] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-27T17:54:49.710433] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T17:54:50.014981] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-27T17:54:50.662437] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-27T17:54:50.669330] [INFO ] [REMOTE ] CHH: Full fetch complete (47668 records). [2025-10-27T17:54:50.669422] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-27T17:54:50.842404] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-27T17:54:51.065313] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-27T17:54:51.065423] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-27T17:54:51.066378] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-27T17:54:51.066476] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-27T17:54:51.067721] [DEBUG] [LOCAL ] CHH: Trimmed 47668 records to 32110 (keeping 200 days of data) [2025-10-27T17:54:51.210187] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-27T17:54:51.303403] [DEBUG] [LOCAL ] CHH: Primary data saved (32110 records). [2025-10-27T17:54:51.303551] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-27T17:54:51.303662] [INFO ] [MAIN ] Update Progress: 438/2366 symbols completed. CHH took 27.8s. Estimated remaining: 4h 1m 15s. Rate: 8.0 symbols/min [2025-10-27T17:54:51.615000] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-27T17:54:52.353308] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T17:54:52.414905] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-27T17:54:52.578551] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-27T17:54:53.214913] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-27T17:54:54.308947] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T17:54:54.314355] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-27T17:54:54.549403] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-27T17:54:54.558119] [INFO ] [REMOTE ] CHGG: Full fetch complete (69759 records). [2025-10-27T17:54:54.558252] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-27T17:54:54.942339] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-27T17:54:54.942416] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-27T17:54:54.943228] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-27T17:54:54.943291] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-27T17:54:54.944591] [DEBUG] [LOCAL ] CHGG: Trimmed 69759 records to 47346 (keeping 200 days of data) [2025-10-27T17:54:55.227786] [DEBUG] [LOCAL ] CHGG: Primary data saved (47346 records). [2025-10-27T17:54:55.227975] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-27T17:54:55.228609] [INFO ] [MAIN ] Update Progress: 439/2366 symbols completed. CHGG took 33.8s. Estimated remaining: 4h 0m 51s. Rate: 8.0 symbols/min [2025-10-27T17:54:55.338697] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-27T17:54:55.343284] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-27T17:54:56.376890] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-27T17:54:56.381958] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-27T17:54:57.181203] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-27T17:54:57.185669] [INFO ] [REMOTE ] CHMI: Full fetch complete (31043 records). [2025-10-27T17:54:57.185812] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-27T17:54:57.186408] [FATAL] [VALIDATOR ] CHMI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:54:57.186501] [FATAL] [MAIN ] CHMI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:54:57.186546] [WARN ] [MAIN ] CHMI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:54:57.186589] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-27T17:54:57.186680] [DEBUG] [LOCAL ] CHMI: No primary data file found to delete. [2025-10-27T17:54:57.186739] [INFO ] [LOCAL ] CHMI: Starting deletion of derivative data. [2025-10-27T17:54:57.186960] [DEBUG] [LOCAL ] CHMI: Deleted derivative data file. [2025-10-27T17:54:57.187074] [INFO ] [MAIN ] Update Progress: 440/2366 symbols completed. CHMI took 22.1s. Estimated remaining: 4h 0m 20s. Rate: 8.0 symbols/min [2025-10-27T17:54:57.873092] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:54:57.919266] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:54:57.968004] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:54:57.989047] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:54:57.997788] [DEBUG] [LOCAL ] CHN: Loaded 5088 existing records from primary storage. [2025-10-27T17:54:57.998270] [INFO ] [MAIN ] CHN: Loaded 5088 existing records. [2025-10-27T17:54:58.119368] [DEBUG] [LOCAL ] CHT: Loaded 19441 existing records from primary storage. [2025-10-27T17:54:58.135218] [INFO ] [MAIN ] CHT: Loaded 19441 existing records. [2025-10-27T17:54:58.301466] [DEBUG] [LOCAL ] CHPT: Loaded 47410 existing records from primary storage. [2025-10-27T17:54:58.299836] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:54:58.332531] [INFO ] [MAIN ] CHPT: Loaded 47410 existing records. [2025-10-27T17:54:58.321135] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-27T17:54:58.360501] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-27T17:54:58.432347] [DEBUG] [LOCAL ] CHWY: Loaded 54434 existing records from primary storage. [2025-10-27T17:54:58.411071] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-27T17:54:58.465912] [INFO ] [MAIN ] CHWY: Loaded 54434 existing records. [2025-10-27T17:54:58.482701] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-27T17:54:58.783026] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:54:58.843354] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:54:58.843855] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-27T17:54:58.843780] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-27T17:54:58.854361] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-27T17:54:58.859667] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-27T17:54:58.875950] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-27T17:54:58.941445] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-27T17:54:58.941550] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-27T17:54:59.047756] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-27T17:54:59.042458] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:54:59.054141] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-27T17:54:59.091382] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-27T17:54:59.166030] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-27T17:54:59.319959] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-27T17:54:59.926982] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:54:59.966294] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-27T17:55:00.218899] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:55:00.272005] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-27T17:55:00.321434] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:55:00.343611] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-27T17:55:00.422143] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:55:00.422427] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-27T17:55:02.401225] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-27T17:55:02.403616] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-27T17:55:03.401778] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (3.06 seconds). [2025-10-27T17:55:03.406031] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-27T17:55:03.477127] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-27T17:55:03.479405] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-27T17:55:03.735622] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (3.31 seconds). [2025-10-27T17:55:03.746186] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-27T17:55:04.360356] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T17:55:04.366449] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-27T17:55:04.568764] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-27T17:55:04.570702] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-27T17:55:04.604734] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (4.33 seconds). [2025-10-27T17:55:04.615219] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-27T17:55:05.610061] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T17:55:05.616369] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-27T17:55:05.765324] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-27T17:55:05.849896] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T17:55:06.014954] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-27T17:55:06.620459] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-27T17:55:06.814968] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-27T17:55:07.168199] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-27T17:55:07.297942] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-27T17:55:07.615011] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-27T17:55:08.157623] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-27T17:55:08.263842] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-27T17:55:08.414966] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-27T17:55:09.214974] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-27T17:55:09.574984] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-27T17:55:10.014980] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-27T17:55:10.608379] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T17:55:10.814945] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-27T17:55:11.614995] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-27T17:55:12.253524] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-27T17:55:12.414988] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-27T17:55:12.460465] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-27T17:55:12.576304] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-27T17:55:13.215344] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-27T17:55:13.250276] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-27T17:55:14.014950] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-27T17:55:14.814941] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-27T17:55:15.073008] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-27T17:55:15.614919] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-27T17:55:15.746345] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-27T17:55:15.830717] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-27T17:55:16.136605] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-27T17:55:16.414929] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-27T17:55:17.214931] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-27T17:55:17.694762] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-27T17:55:18.014941] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-27T17:55:18.121681] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T17:55:18.814942] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-27T17:55:19.205691] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-27T17:55:19.614927] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-27T17:55:19.841256] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-27T17:55:20.414921] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-27T17:55:20.591084] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-27T17:55:21.214937] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-27T17:55:21.990801] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-27T17:55:21.992326] [INFO ] [REMOTE ] CHN: Full fetch complete (7547 records). [2025-10-27T17:55:21.992393] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-27T17:55:21.992799] [FATAL] [VALIDATOR ] CHN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:55:21.992901] [FATAL] [MAIN ] CHN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:55:21.992943] [WARN ] [MAIN ] CHN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:55:21.992979] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-27T17:55:21.993031] [DEBUG] [LOCAL ] CHN: No primary data file found to delete. [2025-10-27T17:55:21.993066] [INFO ] [LOCAL ] CHN: Starting deletion of derivative data. [2025-10-27T17:55:21.993357] [DEBUG] [LOCAL ] CHN: Deleted derivative data file. [2025-10-27T17:55:21.993420] [INFO ] [MAIN ] Update Progress: 441/2366 symbols completed. CHN took 24.8s. Estimated remaining: 4h 1m 28s. Rate: 8.0 symbols/min [2025-10-27T17:55:22.022714] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-27T17:55:22.165839] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:55:22.208614] [DEBUG] [LOCAL ] CI: Loaded 50262 existing records from primary storage. [2025-10-27T17:55:22.208940] [INFO ] [MAIN ] CI: Loaded 50262 existing records. [2025-10-27T17:55:22.352550] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-27T17:55:22.430155] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:55:22.430439] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-27T17:55:22.430508] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-27T17:55:22.430846] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-27T17:55:22.430906] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-27T17:55:22.784460] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:55:22.814903] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-27T17:55:23.238440] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T17:55:23.242263] [INFO ] [REMOTE ] CHT: Full fetch complete (27682 records). [2025-10-27T17:55:23.242412] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-27T17:55:23.620155] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-27T17:55:23.621357] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-27T17:55:23.621439] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-27T17:55:23.621923] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-27T17:55:23.621986] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-27T17:55:23.622695] [DEBUG] [LOCAL ] CHT: Trimmed 27682 records to 19042 (keeping 200 days of data) [2025-10-27T17:55:23.737541] [DEBUG] [LOCAL ] CHT: Primary data saved (19042 records). [2025-10-27T17:55:23.737665] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-27T17:55:23.737762] [INFO ] [MAIN ] Update Progress: 442/2366 symbols completed. CHT took 26.5s. Estimated remaining: 4h 0m 55s. Rate: 8.0 symbols/min [2025-10-27T17:55:23.908438] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:55:23.923730] [DEBUG] [LOCAL ] CIA: Loaded 16617 existing records from primary storage. [2025-10-27T17:55:23.923979] [INFO ] [MAIN ] CIA: Loaded 16617 existing records. [2025-10-27T17:55:24.106788] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:55:24.107117] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-27T17:55:24.107251] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-27T17:55:24.107460] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-27T17:55:24.107502] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-27T17:55:24.418171] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-27T17:55:24.492312] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:55:24.518600] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T17:55:25.163976] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T17:55:25.214925] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-27T17:55:26.015624] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-27T17:55:26.021188] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-27T17:55:26.334006] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T17:55:26.814946] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-27T17:55:26.825710] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T17:55:27.614958] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-27T17:55:28.414955] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-27T17:55:29.054125] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-27T17:55:29.064252] [INFO ] [REMOTE ] CHWY: Full fetch complete (77779 records). [2025-10-27T17:55:29.064372] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-27T17:55:29.216414] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-27T17:55:29.317405] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-27T17:55:29.482759] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-27T17:55:29.482870] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-27T17:55:29.483732] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-27T17:55:29.483815] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-27T17:55:29.485398] [DEBUG] [LOCAL ] CHWY: Trimmed 77779 records to 53654 (keeping 200 days of data) [2025-10-27T17:55:29.601500] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-27T17:55:29.833827] [DEBUG] [LOCAL ] CHWY: Primary data saved (53654 records). [2025-10-27T17:55:29.833955] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-27T17:55:29.834032] [INFO ] [MAIN ] Update Progress: 443/2366 symbols completed. CHWY took 32.6s. Estimated remaining: 4h 0m 41s. Rate: 8.0 symbols/min [2025-10-27T17:55:30.002149] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:55:30.018633] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-27T17:55:30.032042] [DEBUG] [LOCAL ] CIB: Loaded 30705 existing records from primary storage. [2025-10-27T17:55:30.032293] [INFO ] [MAIN ] CIB: Loaded 30705 existing records. [2025-10-27T17:55:30.208991] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:55:30.209263] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-27T17:55:30.209316] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-27T17:55:30.209500] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-27T17:55:30.209555] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-27T17:55:30.550575] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:55:30.814922] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-27T17:55:30.883552] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-27T17:55:31.611183] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T17:55:31.619132] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-27T17:55:31.767968] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-27T17:55:32.414935] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-27T17:55:33.012703] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-27T17:55:33.178957] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T17:55:33.214899] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-27T17:55:34.015007] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-27T17:55:34.709370] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T17:55:34.814968] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-27T17:55:35.013208] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T17:55:35.614953] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-27T17:55:36.238302] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T17:55:36.415007] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-27T17:55:36.510024] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T17:55:37.215023] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-27T17:55:38.014942] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-27T17:55:38.101324] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-27T17:55:38.134349] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T17:55:38.814950] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-27T17:55:39.408846] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T17:55:39.416084] [INFO ] [REMOTE ] CHPT: Full fetch complete (70605 records). [2025-10-27T17:55:39.416197] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-27T17:55:39.624399] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-27T17:55:39.797099] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-27T17:55:39.797195] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-27T17:55:39.798005] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-27T17:55:39.798068] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-27T17:55:39.799464] [DEBUG] [LOCAL ] CHPT: Trimmed 70605 records to 46484 (keeping 200 days of data) [2025-10-27T17:55:40.072171] [DEBUG] [LOCAL ] CHPT: Primary data saved (46484 records). [2025-10-27T17:55:40.072411] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-27T17:55:40.072524] [INFO ] [MAIN ] Update Progress: 444/2366 symbols completed. CHPT took 42.9s. Estimated remaining: 4h 0m 46s. Rate: 8.0 symbols/min [2025-10-27T17:55:40.242835] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:55:40.243034] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-27T17:55:40.243101] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-27T17:55:40.243302] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-27T17:55:40.243388] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-27T17:55:40.243503] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-27T17:55:40.243552] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-27T17:55:40.377306] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T17:55:40.438954] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-27T17:55:40.615124] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-27T17:55:40.679329] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:55:41.215005] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-27T17:55:41.373557] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-27T17:55:41.745847] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-27T17:55:42.014978] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-27T17:55:42.487015] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-27T17:55:42.814969] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-27T17:55:43.223580] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-27T17:55:43.614958] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-27T17:55:44.414938] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-27T17:55:45.074400] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-27T17:55:45.171697] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T17:55:45.214919] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-27T17:55:46.014986] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-27T17:55:46.638776] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-27T17:55:46.706268] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T17:55:46.814914] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-27T17:55:47.614938] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-27T17:55:47.710414] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-27T17:55:47.719896] [INFO ] [REMOTE ] CI: Full fetch complete (72037 records). [2025-10-27T17:55:47.720073] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-27T17:55:48.123052] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-27T17:55:48.123139] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-27T17:55:48.123979] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-27T17:55:48.124044] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-27T17:55:48.125421] [DEBUG] [LOCAL ] CI: Trimmed 72037 records to 49475 (keeping 200 days of data) [2025-10-27T17:55:48.372018] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-27T17:55:48.383324] [INFO ] [REMOTE ] CIA: Full fetch complete (23147 records). [2025-10-27T17:55:48.387754] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-27T17:55:48.420015] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-27T17:55:48.554585] [DEBUG] [LOCAL ] CI: Primary data saved (49475 records). [2025-10-27T17:55:48.555030] [INFO ] [MAIN ] CI: Full history saved. [2025-10-27T17:55:48.560827] [INFO ] [MAIN ] Update Progress: 445/2366 symbols completed. CI took 26.6s. Estimated remaining: 4h 0m 42s. Rate: 8.0 symbols/min [2025-10-27T17:55:48.919317] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:55:49.011680] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-27T17:55:49.011764] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-27T17:55:49.012140] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-27T17:55:49.012178] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-27T17:55:49.012937] [DEBUG] [LOCAL ] CIA: Trimmed 23147 records to 16250 (keeping 200 days of data) [2025-10-27T17:55:49.117455] [DEBUG] [LOCAL ] CIA: Primary data saved (16250 records). [2025-10-27T17:55:49.117668] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-27T17:55:49.117782] [INFO ] [MAIN ] Update Progress: 446/2366 symbols completed. CIA took 25.4s. Estimated remaining: 4h 0m 5s. Rate: 8.0 symbols/min [2025-10-27T17:55:49.230628] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-27T17:55:49.245938] [DEBUG] [LOCAL ] CIEN: Loaded 52880 existing records from primary storage. [2025-10-27T17:55:49.250693] [INFO ] [MAIN ] CIEN: Loaded 52880 existing records. [2025-10-27T17:55:49.419409] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:55:49.488243] [DEBUG] [LOCAL ] CIF: Loaded 4015 existing records from primary storage. [2025-10-27T17:55:49.504932] [INFO ] [MAIN ] CIF: Loaded 4015 existing records. [2025-10-27T17:55:49.549529] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:55:49.575453] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-27T17:55:49.583977] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-27T17:55:49.598004] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-27T17:55:49.609451] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-27T17:55:49.800917] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-27T17:55:49.833979] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:55:49.894007] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-27T17:55:49.917381] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-27T17:55:49.949982] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-27T17:55:49.968377] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-27T17:55:50.025078] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-27T17:55:50.149887] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-27T17:55:50.247716] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:55:50.442856] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-27T17:55:50.529754] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:55:50.814949] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-27T17:55:51.615409] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-27T17:55:51.616875] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T17:55:52.414954] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-27T17:55:52.881909] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-27T17:55:53.106848] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T17:55:53.214945] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-27T17:55:53.636813] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-27T17:55:54.014947] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-27T17:55:54.398900] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-27T17:55:54.814942] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-27T17:55:55.614945] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-27T17:55:56.414919] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-27T17:55:56.787432] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-27T17:55:56.842232] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-27T17:55:56.943283] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T17:55:57.214956] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-27T17:55:58.015002] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-27T17:55:58.123919] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T17:55:58.286588] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-27T17:55:58.814974] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-27T17:55:59.120605] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-27T17:55:59.614943] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-27T17:55:59.932223] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-27T17:56:00.414948] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-27T17:56:01.214952] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-27T17:56:02.015014] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-27T17:56:02.815072] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-27T17:56:02.837980] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-27T17:56:02.838803] [INFO ] [REMOTE ] CICB: Full fetch complete (1911 records). [2025-10-27T17:56:02.838873] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-27T17:56:03.013572] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-27T17:56:03.013799] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:56:03.013869] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:56:03.013943] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-27T17:56:03.014008] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-27T17:56:03.014064] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-27T17:56:03.014105] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-27T17:56:03.014158] [INFO ] [MAIN ] Update Progress: 447/2366 symbols completed. CICB took 22.9s. Estimated remaining: 4h 0m 25s. Rate: 8.0 symbols/min [2025-10-27T17:56:03.177357] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:56:03.216864] [DEBUG] [LOCAL ] CIG: Loaded 45103 existing records from primary storage. [2025-10-27T17:56:03.217192] [INFO ] [MAIN ] CIG: Loaded 45103 existing records. [2025-10-27T17:56:03.394674] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:56:03.394906] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-27T17:56:03.394954] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-27T17:56:03.395204] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-27T17:56:03.395262] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-27T17:56:03.749639] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:56:03.749982] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-27T17:56:04.629354] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (3.41 seconds). [2025-10-27T17:56:04.635228] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-27T17:56:04.778454] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-27T17:56:04.864905] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (2.85 seconds). [2025-10-27T17:56:05.214950] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-27T17:56:05.492950] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T17:56:05.887446] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T17:56:06.014917] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-27T17:56:06.629324] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T17:56:06.814974] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-27T17:56:06.860434] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T17:56:07.219330] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-27T17:56:07.614939] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-27T17:56:08.414943] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-27T17:56:08.597497] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T17:56:08.603199] [INFO ] [REMOTE ] CIB: Full fetch complete (45300 records). [2025-10-27T17:56:08.603286] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-27T17:56:08.603821] [FATAL] [VALIDATOR ] CIB: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:56:08.603901] [FATAL] [MAIN ] CIB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:56:08.603962] [WARN ] [MAIN ] CIB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:56:08.604046] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-27T17:56:08.604150] [DEBUG] [LOCAL ] CIB: No primary data file found to delete. [2025-10-27T17:56:08.604214] [INFO ] [LOCAL ] CIB: Starting deletion of derivative data. [2025-10-27T17:56:08.604383] [DEBUG] [LOCAL ] CIB: Deleted derivative data file. [2025-10-27T17:56:08.604485] [INFO ] [MAIN ] Update Progress: 448/2366 symbols completed. CIB took 38.8s. Estimated remaining: 4h 0m 9s. Rate: 8.0 symbols/min [2025-10-27T17:56:08.782695] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:56:08.798602] [DEBUG] [LOCAL ] CII: Loaded 15310 existing records from primary storage. [2025-10-27T17:56:08.798874] [INFO ] [MAIN ] CII: Loaded 15310 existing records. [2025-10-27T17:56:08.969633] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:56:08.969840] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-27T17:56:08.969885] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-27T17:56:08.970051] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-27T17:56:08.970106] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-27T17:56:09.220195] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-27T17:56:09.314312] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:56:10.014928] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-27T17:56:10.076179] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T17:56:10.102160] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T17:56:10.814935] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-27T17:56:11.363724] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T17:56:11.506932] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-27T17:56:11.614922] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-27T17:56:12.045188] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-27T17:56:12.414953] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-27T17:56:12.943243] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T17:56:12.944434] [INFO ] [REMOTE ] CIF: Full fetch complete (6541 records). [2025-10-27T17:56:12.944503] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-27T17:56:13.220032] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-27T17:56:13.302881] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-27T17:56:13.302952] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-27T17:56:13.303119] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-27T17:56:13.303156] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-27T17:56:13.303525] [DEBUG] [LOCAL ] CIF: Trimmed 6541 records to 3862 (keeping 200 days of data) [2025-10-27T17:56:13.325558] [DEBUG] [LOCAL ] CIF: Primary data saved (3862 records). [2025-10-27T17:56:13.325665] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-27T17:56:13.325767] [INFO ] [MAIN ] Update Progress: 449/2366 symbols completed. CIF took 24.2s. Estimated remaining: 3h 59m 50s. Rate: 8.0 symbols/min [2025-10-27T17:56:13.492065] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:56:13.528029] [DEBUG] [LOCAL ] CIM: Loaded 37903 existing records from primary storage. [2025-10-27T17:56:13.528311] [INFO ] [MAIN ] CIM: Loaded 37903 existing records. [2025-10-27T17:56:13.705681] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:56:13.705899] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-27T17:56:13.705954] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-27T17:56:13.706184] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-27T17:56:13.706244] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-27T17:56:14.020864] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-27T17:56:14.060975] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:56:14.545005] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T17:56:14.717567] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-27T17:56:14.814943] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-27T17:56:15.614950] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-27T17:56:16.414945] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-27T17:56:16.684030] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-27T17:56:16.798614] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-27T17:56:17.215010] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-27T17:56:17.442874] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-27T17:56:18.014986] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-27T17:56:18.753528] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T17:56:18.814974] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-27T17:56:19.275619] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T17:56:19.614944] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-27T17:56:19.943816] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-27T17:56:20.414947] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-27T17:56:21.129789] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T17:56:21.214935] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-27T17:56:21.442941] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T17:56:22.014949] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-27T17:56:22.524717] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T17:56:22.814936] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-27T17:56:23.314954] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-27T17:56:23.614955] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-27T17:56:24.117860] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-27T17:56:24.414973] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-27T17:56:24.912060] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T17:56:25.214947] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-27T17:56:25.947212] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T17:56:26.014965] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-27T17:56:26.080088] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-27T17:56:26.814958] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-27T17:56:27.171344] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T17:56:27.614948] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-27T17:56:28.414973] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-27T17:56:28.518466] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T17:56:28.696630] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-27T17:56:28.706724] [INFO ] [REMOTE ] CIEN: Full fetch complete (75842 records). [2025-10-27T17:56:28.706880] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-27T17:56:29.087925] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-27T17:56:29.088006] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-27T17:56:29.088815] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-27T17:56:29.088879] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-27T17:56:29.090289] [DEBUG] [LOCAL ] CIEN: Trimmed 75842 records to 52090 (keeping 200 days of data) [2025-10-27T17:56:29.252362] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-27T17:56:29.391298] [DEBUG] [LOCAL ] CIEN: Primary data saved (52090 records). [2025-10-27T17:56:29.391414] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-27T17:56:29.391491] [INFO ] [MAIN ] Update Progress: 450/2366 symbols completed. CIEN took 40.8s. Estimated remaining: 4h 0m 19s. Rate: 8.0 symbols/min [2025-10-27T17:56:29.557898] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:56:29.562702] [DEBUG] [LOCAL ] CIMN: Loaded 2724 existing records from primary storage. [2025-10-27T17:56:29.562850] [INFO ] [MAIN ] CIMN: Loaded 2724 existing records. [2025-10-27T17:56:29.743725] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:56:29.744053] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-27T17:56:29.744135] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-27T17:56:29.744624] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-27T17:56:29.744750] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-27T17:56:29.892382] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T17:56:29.980256] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T17:56:30.022734] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-27T17:56:30.172749] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:56:30.814971] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-27T17:56:31.478741] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T17:56:31.507765] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T17:56:31.614906] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-27T17:56:32.202286] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-27T17:56:32.414931] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-27T17:56:32.993244] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-27T17:56:33.214947] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-27T17:56:33.647430] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-27T17:56:34.014943] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-27T17:56:34.540726] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-27T17:56:34.814983] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-27T17:56:35.615009] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-27T17:56:35.931330] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-27T17:56:36.315426] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T17:56:36.414943] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-27T17:56:37.214991] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-27T17:56:37.496027] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-27T17:56:38.015051] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-27T17:56:38.639784] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T17:56:38.649490] [INFO ] [REMOTE ] CIG: Full fetch complete (62908 records). [2025-10-27T17:56:38.649596] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-27T17:56:38.822676] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-27T17:56:39.046510] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-27T17:56:39.047189] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-27T17:56:39.048005] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-27T17:56:39.047063] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T17:56:39.048208] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-27T17:56:39.052549] [INFO ] [REMOTE ] CII: Full fetch complete (22819 records). [2025-10-27T17:56:39.052865] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-27T17:56:39.086777] [DEBUG] [LOCAL ] CIG: Trimmed 62908 records to 44462 (keeping 200 days of data) [2025-10-27T17:56:39.287034] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-27T17:56:39.616496] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-27T17:56:39.695960] [DEBUG] [LOCAL ] CIG: Primary data saved (44462 records). [2025-10-27T17:56:39.696846] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-27T17:56:39.697012] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-27T17:56:39.696952] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-27T17:56:39.697528] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-27T17:56:39.697765] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-27T17:56:39.697715] [INFO ] [MAIN ] Update Progress: 451/2366 symbols completed. CIG took 36.7s. Estimated remaining: 4h 0m 23s. Rate: 8.0 symbols/min [2025-10-27T17:56:39.777256] [DEBUG] [LOCAL ] CII: Trimmed 22819 records to 14625 (keeping 200 days of data) [2025-10-27T17:56:39.942492] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:56:39.955633] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-27T17:56:39.955741] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-27T17:56:39.955884] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-27T17:56:39.955948] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-27T17:56:39.955528] [DEBUG] [LOCAL ] CII: Primary data saved (14625 records). [2025-10-27T17:56:39.956024] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-27T17:56:39.956234] [INFO ] [MAIN ] CII: Full history saved. [2025-10-27T17:56:39.956158] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-27T17:56:39.956385] [INFO ] [MAIN ] Update Progress: 452/2366 symbols completed. CII took 31.4s. Estimated remaining: 3h 59m 45s. Rate: 8.0 symbols/min [2025-10-27T17:56:40.308061] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:56:40.321204] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-27T17:56:40.347708] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-27T17:56:40.379766] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-27T17:56:40.392965] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-27T17:56:40.393060] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-27T17:56:40.408214] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-27T17:56:40.428856] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-27T17:56:40.720750] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:56:40.904016] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:56:40.908708] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-27T17:56:41.167404] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-27T17:56:41.214955] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-27T17:56:41.828435] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-27T17:56:42.014935] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-27T17:56:42.284380] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-27T17:56:42.814946] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-27T17:56:43.312868] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-27T17:56:43.614963] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-27T17:56:44.138469] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-27T17:56:44.414932] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-27T17:56:44.783533] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-27T17:56:45.214946] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-10-27T17:56:45.438351] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:56:45.438737] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-10-27T17:56:45.438846] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:56:45.438943] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-27T17:56:45.439014] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:56:45.439086] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-27T17:56:45.439149] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-27T17:56:45.439186] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-27T17:56:45.439227] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-27T17:56:45.439296] [INFO ] [MAIN ] Update Progress: 453/2366 symbols completed. CIMP took 5.5s. Estimated remaining: 3h 59m 28s. Rate: 8.0 symbols/min [2025-10-27T17:56:45.610879] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:56:45.630332] [DEBUG] [LOCAL ] CINT: Loaded 20869 existing records from primary storage. [2025-10-27T17:56:45.630561] [INFO ] [MAIN ] CINT: Loaded 20869 existing records. [2025-10-27T17:56:45.803778] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:56:45.803977] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-27T17:56:45.804024] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-27T17:56:45.804180] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-27T17:56:45.804219] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-27T17:56:46.020081] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-27T17:56:46.165715] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:56:46.814951] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-27T17:56:47.319075] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T17:56:47.451913] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-27T17:56:47.615003] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-27T17:56:47.956289] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-27T17:56:48.414931] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-27T17:56:49.214958] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-27T17:56:49.473021] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T17:56:49.512534] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-27T17:56:50.014976] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-27T17:56:50.390398] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-27T17:56:50.814941] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-27T17:56:51.614946] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-27T17:56:52.024602] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T17:56:52.414962] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-27T17:56:52.868528] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T17:56:53.177317] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T17:56:53.214896] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-27T17:56:54.014971] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-27T17:56:54.693581] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-27T17:56:54.725019] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T17:56:54.814941] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-27T17:56:55.614952] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-27T17:56:56.217719] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-27T17:56:56.414947] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-27T17:56:56.525353] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T17:56:56.534185] [INFO ] [REMOTE ] CIM: Full fetch complete (54793 records). [2025-10-27T17:56:56.534453] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-27T17:56:56.924482] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-27T17:56:56.924606] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-27T17:56:56.925426] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-27T17:56:56.925491] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-27T17:56:56.926764] [DEBUG] [LOCAL ] CIM: Trimmed 54793 records to 37039 (keeping 200 days of data) [2025-10-27T17:56:56.995965] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-27T17:56:57.156840] [DEBUG] [LOCAL ] CIM: Primary data saved (37039 records). [2025-10-27T17:56:57.156978] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-27T17:56:57.157058] [INFO ] [MAIN ] Update Progress: 454/2366 symbols completed. CIM took 43.8s. Estimated remaining: 3h 59m 39s. Rate: 8.0 symbols/min [2025-10-27T17:56:57.224981] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-27T17:56:57.369404] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:56:57.392285] [DEBUG] [LOCAL ] CIO: Loaded 21650 existing records from primary storage. [2025-10-27T17:56:57.392560] [INFO ] [MAIN ] CIO: Loaded 21650 existing records. [2025-10-27T17:56:57.570200] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:56:57.573887] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-27T17:56:57.573989] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-27T17:56:57.573745] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-27T17:56:57.575671] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-27T17:56:57.575735] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-27T17:56:57.928679] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:56:58.014947] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-27T17:56:58.525703] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T17:56:58.526790] [INFO ] [REMOTE ] CIMN: Full fetch complete (3859 records). [2025-10-27T17:56:58.526860] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-27T17:56:58.527317] [FATAL] [VALIDATOR ] CIMN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:56:58.527398] [FATAL] [MAIN ] CIMN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:56:58.527480] [WARN ] [MAIN ] CIMN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:56:58.527561] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-27T17:56:58.527636] [DEBUG] [LOCAL ] CIMN: No primary data file found to delete. [2025-10-27T17:56:58.527731] [INFO ] [LOCAL ] CIMN: Starting deletion of derivative data. [2025-10-27T17:56:58.527932] [DEBUG] [LOCAL ] CIMN: Deleted derivative data file. [2025-10-27T17:56:58.528034] [INFO ] [MAIN ] Update Progress: 455/2366 symbols completed. CIMN took 29.1s. Estimated remaining: 3h 59m 5s. Rate: 8.0 symbols/min [2025-10-27T17:56:58.697944] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:56:58.722553] [DEBUG] [LOCAL ] CION: Loaded 28391 existing records from primary storage. [2025-10-27T17:56:58.722856] [INFO ] [MAIN ] CION: Loaded 28391 existing records. [2025-10-27T17:56:58.820117] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-27T17:56:58.903064] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:56:58.903275] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-27T17:56:58.903330] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-27T17:56:58.903510] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-10-27T17:56:58.903550] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-27T17:56:59.255768] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:56:59.555105] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T17:56:59.614912] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-27T17:57:00.231776] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-27T17:57:00.414916] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-27T17:57:01.215010] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-27T17:57:02.014974] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-27T17:57:02.815016] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-27T17:57:03.968085] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-27T17:57:03.973573] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-27T17:57:04.028492] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (3.61 seconds). [2025-10-27T17:57:04.071854] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-27T17:57:04.415020] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-27T17:57:04.470288] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-27T17:57:05.123565] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-27T17:57:05.214999] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-27T17:57:05.277065] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T17:57:05.664541] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-27T17:57:05.665665] [INFO ] [REMOTE ] CIMO: Full fetch complete (4519 records). [2025-10-27T17:57:05.665737] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-27T17:57:05.666125] [FATAL] [VALIDATOR ] CIMO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:57:05.666206] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:57:05.666248] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:57:05.666312] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-27T17:57:05.666374] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-27T17:57:05.666409] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-27T17:57:05.666448] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-27T17:57:05.666498] [INFO ] [MAIN ] Update Progress: 456/2366 symbols completed. CIMO took 26.0s. Estimated remaining: 3h 58m 56s. Rate: 8.0 symbols/min [2025-10-27T17:57:05.829518] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:57:05.877561] [DEBUG] [LOCAL ] CIVI: Loaded 53474 existing records from primary storage. [2025-10-27T17:57:05.877889] [INFO ] [MAIN ] CIVI: Loaded 53474 existing records. [2025-10-27T17:57:06.020177] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-27T17:57:06.085924] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:57:06.086140] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-27T17:57:06.086189] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-27T17:57:06.086391] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-27T17:57:06.086448] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-27T17:57:06.490497] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:57:06.814954] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-27T17:57:07.076234] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T17:57:07.614945] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-27T17:57:08.321182] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-27T17:57:08.387492] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T17:57:08.414968] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-27T17:57:09.214949] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-27T17:57:09.412798] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T17:57:09.958420] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-27T17:57:10.014977] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-27T17:57:10.814955] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-27T17:57:11.255077] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T17:57:11.614983] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-27T17:57:12.004996] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-27T17:57:12.392999] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T17:57:12.414907] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-27T17:57:13.214954] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-27T17:57:13.835438] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T17:57:13.842500] [INFO ] [REMOTE ] CINT: Full fetch complete (28809 records). [2025-10-27T17:57:13.842626] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-27T17:57:14.020044] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-27T17:57:14.292730] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T17:57:14.342889] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-27T17:57:14.343014] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-27T17:57:14.343784] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-27T17:57:14.343854] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-27T17:57:14.345176] [DEBUG] [LOCAL ] CINT: Trimmed 28809 records to 20484 (keeping 200 days of data) [2025-10-27T17:57:14.468297] [DEBUG] [LOCAL ] CINT: Primary data saved (20484 records). [2025-10-27T17:57:14.468495] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-27T17:57:14.468628] [INFO ] [MAIN ] Update Progress: 457/2366 symbols completed. CINT took 29.0s. Estimated remaining: 3h 58m 54s. Rate: 8.0 symbols/min [2025-10-27T17:57:14.651200] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:57:14.713216] [DEBUG] [LOCAL ] CL: Loaded 54429 existing records from primary storage. [2025-10-27T17:57:14.713966] [INFO ] [MAIN ] CL: Loaded 54429 existing records. [2025-10-27T17:57:14.820186] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-27T17:57:14.918142] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:57:14.918456] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-27T17:57:14.918509] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-27T17:57:14.918809] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-27T17:57:14.918866] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-27T17:57:15.303541] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:57:15.416857] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T17:57:15.614950] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-27T17:57:15.880481] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T17:57:16.414946] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-27T17:57:17.043529] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T17:57:17.214968] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-27T17:57:17.634927] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-27T17:57:18.014959] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-27T17:57:18.795135] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-27T17:57:18.814925] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-27T17:57:18.841857] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-27T17:57:19.614943] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-27T17:57:20.414976] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-27T17:57:20.460063] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-27T17:57:20.741193] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-27T17:57:21.178783] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T17:57:21.214939] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-27T17:57:22.014982] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-27T17:57:22.478236] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-27T17:57:22.814992] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-27T17:57:23.455036] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T17:57:23.614959] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-27T17:57:24.391172] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T17:57:24.414911] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-27T17:57:25.209034] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T17:57:25.219590] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-27T17:57:25.771785] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-27T17:57:26.014949] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-27T17:57:26.434565] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T17:57:26.814976] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-27T17:57:27.614949] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-27T17:57:27.848402] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-27T17:57:28.015479] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-27T17:57:28.414954] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-27T17:57:28.727130] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-27T17:57:28.732940] [INFO ] [REMOTE ] CIO: Full fetch complete (29925 records). [2025-10-27T17:57:28.733021] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-27T17:57:29.112365] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-27T17:57:29.112439] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-27T17:57:29.112915] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-27T17:57:29.112992] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-27T17:57:29.113750] [DEBUG] [LOCAL ] CIO: Trimmed 29925 records to 21195 (keeping 200 days of data) [2025-10-27T17:57:29.216680] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-27T17:57:29.230760] [DEBUG] [LOCAL ] CIO: Primary data saved (21195 records). [2025-10-27T17:57:29.230851] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-27T17:57:29.230930] [INFO ] [MAIN ] Update Progress: 458/2366 symbols completed. CIO took 32.1s. Estimated remaining: 3h 59m 17s. Rate: 8.0 symbols/min [2025-10-27T17:57:29.405184] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:57:29.442825] [DEBUG] [LOCAL ] CLB: Loaded 34120 existing records from primary storage. [2025-10-27T17:57:29.443089] [INFO ] [MAIN ] CLB: Loaded 34120 existing records. [2025-10-27T17:57:29.661552] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:57:29.671033] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-27T17:57:29.671599] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-27T17:57:29.672143] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T17:57:29.678142] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-27T17:57:29.678419] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-27T17:57:30.024700] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-27T17:57:30.045734] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:57:30.503835] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T17:57:30.814952] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-27T17:57:31.614992] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-27T17:57:31.860402] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T17:57:32.335600] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T17:57:32.414979] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-27T17:57:32.655358] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T17:57:32.660907] [INFO ] [REMOTE ] CION: Full fetch complete (40354 records). [2025-10-27T17:57:32.661061] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-27T17:57:32.661690] [FATAL] [VALIDATOR ] CION: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:57:32.661781] [FATAL] [MAIN ] CION: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:57:32.661827] [WARN ] [MAIN ] CION: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:57:32.661901] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-27T17:57:32.661970] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-27T17:57:32.662005] [INFO ] [LOCAL ] CION: Starting deletion of derivative data. [2025-10-27T17:57:32.662175] [DEBUG] [LOCAL ] CION: Deleted derivative data file. [2025-10-27T17:57:32.662268] [INFO ] [MAIN ] Update Progress: 459/2366 symbols completed. CION took 34.1s. Estimated remaining: 3h 58m 52s. Rate: 8.0 symbols/min [2025-10-27T17:57:32.837108] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:57:32.850976] [DEBUG] [LOCAL ] CLCO: Loaded 13397 existing records from primary storage. [2025-10-27T17:57:32.851177] [INFO ] [MAIN ] CLCO: Loaded 13397 existing records. [2025-10-27T17:57:33.025435] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:57:33.025626] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-27T17:57:33.025703] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-27T17:57:33.025861] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-27T17:57:33.025899] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-27T17:57:33.221600] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-27T17:57:33.384273] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:57:33.403123] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-27T17:57:34.014956] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-27T17:57:34.814998] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-27T17:57:35.372410] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-27T17:57:35.614939] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-27T17:57:35.833888] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-27T17:57:35.921424] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T17:57:36.414922] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-27T17:57:37.214909] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-27T17:57:37.342367] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T17:57:38.015000] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-27T17:57:38.251733] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-27T17:57:38.337421] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T17:57:38.814962] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-27T17:57:39.167449] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-27T17:57:39.614979] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-27T17:57:40.414926] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-27T17:57:40.640699] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-27T17:57:40.650950] [INFO ] [REMOTE ] CIVI: Full fetch complete (76096 records). [2025-10-27T17:57:40.651098] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-27T17:57:40.846923] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T17:57:41.063771] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-27T17:57:41.063854] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-27T17:57:41.064669] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-27T17:57:41.064732] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-27T17:57:41.066199] [DEBUG] [LOCAL ] CIVI: Trimmed 76096 records to 52668 (keeping 200 days of data) [2025-10-27T17:57:41.237761] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-27T17:57:41.380089] [DEBUG] [LOCAL ] CIVI: Primary data saved (52668 records). [2025-10-27T17:57:41.380214] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-27T17:57:41.381029] [INFO ] [MAIN ] Update Progress: 460/2366 symbols completed. CIVI took 35.7s. Estimated remaining: 3h 58m 50s. Rate: 8.0 symbols/min [2025-10-27T17:57:41.546282] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:57:41.573711] [DEBUG] [LOCAL ] CLDT: Loaded 25525 existing records from primary storage. [2025-10-27T17:57:41.573957] [INFO ] [MAIN ] CLDT: Loaded 25525 existing records. [2025-10-27T17:57:41.757973] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:57:41.758207] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-27T17:57:41.758264] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-27T17:57:41.758425] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-27T17:57:41.758464] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-27T17:57:42.018393] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-27T17:57:42.123039] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:57:42.138424] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T17:57:42.218980] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-27T17:57:42.229353] [INFO ] [REMOTE ] CL: Full fetch complete (77818 records). [2025-10-27T17:57:42.229493] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-27T17:57:42.628032] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-27T17:57:42.628133] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-27T17:57:42.629054] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-27T17:57:42.629123] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-27T17:57:42.630566] [DEBUG] [LOCAL ] CL: Trimmed 77818 records to 53649 (keeping 200 days of data) [2025-10-27T17:57:42.839435] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-27T17:57:42.958755] [DEBUG] [LOCAL ] CL: Primary data saved (53649 records). [2025-10-27T17:57:42.958882] [INFO ] [MAIN ] CL: Full history saved. [2025-10-27T17:57:42.958959] [INFO ] [MAIN ] Update Progress: 461/2366 symbols completed. CL took 28.5s. Estimated remaining: 3h 58m 18s. Rate: 8.0 symbols/min [2025-10-27T17:57:43.128318] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:57:43.154242] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T17:57:43.206836] [DEBUG] [LOCAL ] CLF: Loaded 54521 existing records from primary storage. [2025-10-27T17:57:43.207184] [INFO ] [MAIN ] CLF: Loaded 54521 existing records. [2025-10-27T17:57:43.390244] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:57:43.390484] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-27T17:57:43.390543] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-27T17:57:43.390772] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-27T17:57:43.390828] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-27T17:57:43.630321] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-27T17:57:43.751362] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:57:43.764278] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-27T17:57:44.414957] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-27T17:57:44.696359] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-27T17:57:45.214960] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-27T17:57:45.467285] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T17:57:46.014993] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-27T17:57:46.033767] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T17:57:46.815000] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-27T17:57:47.508187] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-27T17:57:47.614922] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-27T17:57:47.905900] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-27T17:57:48.414901] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-27T17:57:48.463675] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-27T17:57:49.185303] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-27T17:57:49.214916] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-27T17:57:50.014958] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-27T17:57:50.496296] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T17:57:50.814949] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-27T17:57:51.615012] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-27T17:57:51.987731] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-27T17:57:52.096263] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-27T17:57:52.184147] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-27T17:57:52.414951] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-27T17:57:53.116669] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-27T17:57:53.214955] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-27T17:57:54.014975] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-27T17:57:54.303267] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-27T17:57:54.645253] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T17:57:54.814942] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-27T17:57:55.615604] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-27T17:57:55.618086] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-27T17:57:56.414956] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-27T17:57:57.215000] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-27T17:57:57.321005] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-27T17:57:57.412148] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T17:57:57.825792] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-27T17:57:58.015008] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-27T17:57:58.717713] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-27T17:57:58.814923] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-27T17:57:59.614948] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-27T17:57:59.835546] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T17:57:59.841154] [INFO ] [REMOTE ] CLDT: Full fetch complete (37709 records). [2025-10-27T17:57:59.841284] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-27T17:58:00.215455] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-27T17:58:00.215538] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-27T17:58:00.216073] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-27T17:58:00.216135] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-27T17:58:00.217001] [DEBUG] [LOCAL ] CLDT: Trimmed 37709 records to 24789 (keeping 200 days of data) [2025-10-27T17:58:00.356225] [DEBUG] [LOCAL ] CLDT: Primary data saved (24789 records). [2025-10-27T17:58:00.356359] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-27T17:58:00.356458] [INFO ] [MAIN ] Update Progress: 462/2366 symbols completed. CLDT took 19.0s. Estimated remaining: 3h 58m 51s. Rate: 8.0 symbols/min [2025-10-27T17:58:00.421861] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-27T17:58:00.541284] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:58:00.568116] [DEBUG] [LOCAL ] CLH: Loaded 28008 existing records from primary storage. [2025-10-27T17:58:00.568395] [INFO ] [MAIN ] CLH: Loaded 28008 existing records. [2025-10-27T17:58:00.745035] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:58:00.745225] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-27T17:58:00.745272] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-27T17:58:00.745471] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-27T17:58:00.745527] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-27T17:58:01.129901] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:58:01.215006] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-27T17:58:01.847913] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-27T17:58:02.014976] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-27T17:58:02.814949] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-27T17:58:03.600033] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-27T17:58:03.604422] [INFO ] [REMOTE ] CLCO: Full fetch complete (22758 records). [2025-10-27T17:58:03.604500] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-27T17:58:03.982548] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-27T17:58:03.982693] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-27T17:58:03.983312] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-27T17:58:03.983396] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-27T17:58:03.984425] [DEBUG] [LOCAL ] CLCO: Trimmed 22758 records to 12926 (keeping 200 days of data) [2025-10-27T17:58:04.058488] [DEBUG] [LOCAL ] CLCO: Primary data saved (12926 records). [2025-10-27T17:58:04.058611] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-27T17:58:04.058714] [INFO ] [MAIN ] Update Progress: 463/2366 symbols completed. CLCO took 31.4s. Estimated remaining: 3h 58m 28s. Rate: 8.0 symbols/min [2025-10-27T17:58:04.222063] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:58:04.233027] [DEBUG] [LOCAL ] CLPR: Loaded 10085 existing records from primary storage. [2025-10-27T17:58:04.233256] [INFO ] [MAIN ] CLPR: Loaded 10085 existing records. [2025-10-27T17:58:04.406217] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:58:04.406415] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-27T17:58:04.406461] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-27T17:58:04.406605] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-10-27T17:58:04.406663] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-27T17:58:04.767946] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:58:04.768763] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-27T17:58:04.789707] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (2.77 seconds). [2025-10-27T17:58:04.796293] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-27T17:58:04.847517] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-27T17:58:04.887274] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (4.47 seconds). [2025-10-27T17:58:05.214994] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-27T17:58:05.400985] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-27T17:58:05.825695] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T17:58:06.014945] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-27T17:58:06.814948] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-27T17:58:06.948307] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-27T17:58:07.355260] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-27T17:58:07.355696] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-27T17:58:07.615042] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-27T17:58:08.414958] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-27T17:58:09.214967] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-27T17:58:09.331631] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T17:58:09.778551] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-27T17:58:10.015005] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-27T17:58:10.230515] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T17:58:10.814942] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-27T17:58:11.615002] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-27T17:58:11.887022] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-27T17:58:11.959160] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T17:58:12.414960] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-27T17:58:13.214961] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-27T17:58:13.305772] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-27T17:58:13.415523] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-27T17:58:13.426373] [INFO ] [REMOTE ] CLB: Full fetch complete (47761 records). [2025-10-27T17:58:13.426632] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-27T17:58:13.807733] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-27T17:58:13.807821] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-27T17:58:13.808440] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-27T17:58:13.808481] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-27T17:58:13.809581] [DEBUG] [LOCAL ] CLB: Trimmed 47761 records to 33471 (keeping 200 days of data) [2025-10-27T17:58:14.004519] [DEBUG] [LOCAL ] CLB: Primary data saved (33471 records). [2025-10-27T17:58:14.004671] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-27T17:58:14.004765] [INFO ] [MAIN ] Update Progress: 464/2366 symbols completed. CLB took 44.8s. Estimated remaining: 3h 58m 30s. Rate: 8.0 symbols/min [2025-10-27T17:58:14.020087] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-27T17:58:14.180385] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:58:14.202342] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T17:58:14.252664] [DEBUG] [LOCAL ] CLS: Loaded 54326 existing records from primary storage. [2025-10-27T17:58:14.253038] [INFO ] [MAIN ] CLS: Loaded 54326 existing records. [2025-10-27T17:58:14.429627] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:58:14.429888] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-27T17:58:14.429943] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-27T17:58:14.430163] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-27T17:58:14.430218] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-27T17:58:14.784381] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:58:14.814898] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-27T17:58:15.614970] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-27T17:58:15.766730] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-27T17:58:16.304069] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-27T17:58:16.414913] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-27T17:58:16.493141] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T17:58:17.220131] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-27T17:58:17.227935] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-27T17:58:18.014994] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-27T17:58:18.814931] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-27T17:58:18.851001] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-27T17:58:19.614910] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-27T17:58:19.658176] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-27T17:58:19.668544] [INFO ] [REMOTE ] CLF: Full fetch complete (77918 records). [2025-10-27T17:58:19.668688] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-27T17:58:20.061490] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-27T17:58:20.061816] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-27T17:58:20.062748] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-27T17:58:20.062812] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-27T17:58:20.064279] [DEBUG] [LOCAL ] CLF: Trimmed 77918 records to 53741 (keeping 200 days of data) [2025-10-27T17:58:20.368701] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-10-27T17:58:20.368823] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-27T17:58:20.368898] [INFO ] [MAIN ] Update Progress: 465/2366 symbols completed. CLF took 37.4s. Estimated remaining: 3h 58m 18s. Rate: 8.0 symbols/min [2025-10-27T17:58:20.422747] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-27T17:58:20.563735] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:58:20.617458] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-27T17:58:20.642918] [DEBUG] [LOCAL ] CLVT: Loaded 52626 existing records from primary storage. [2025-10-27T17:58:20.643193] [INFO ] [MAIN ] CLVT: Loaded 52626 existing records. [2025-10-27T17:58:20.827255] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:58:20.827478] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-27T17:58:20.827592] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-27T17:58:20.827999] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-27T17:58:20.828073] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-27T17:58:20.927013] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T17:58:21.192342] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-27T17:58:21.217169] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-27T17:58:21.220786] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:58:22.014936] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-27T17:58:22.814933] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-27T17:58:23.145057] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-27T17:58:23.388014] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-27T17:58:23.614930] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-27T17:58:23.738500] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-27T17:58:24.414945] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-27T17:58:24.496832] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-27T17:58:25.214969] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-27T17:58:25.506206] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-27T17:58:26.014929] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-27T17:58:26.285940] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-27T17:58:26.291967] [INFO ] [REMOTE ] CLH: Full fetch complete (42233 records). [2025-10-27T17:58:26.292049] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-27T17:58:26.666848] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-27T17:58:26.666923] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-27T17:58:26.667514] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-27T17:58:26.667577] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-27T17:58:26.668443] [DEBUG] [LOCAL ] CLH: Trimmed 42233 records to 27306 (keeping 200 days of data) [2025-10-27T17:58:26.818687] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-27T17:58:26.832473] [DEBUG] [LOCAL ] CLH: Primary data saved (27306 records). [2025-10-27T17:58:26.833997] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-27T17:58:26.834183] [INFO ] [MAIN ] Update Progress: 466/2366 symbols completed. CLH took 26.5s. Estimated remaining: 3h 58m 6s. Rate: 8.0 symbols/min [2025-10-27T17:58:27.026526] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:58:27.023477] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-27T17:58:27.049106] [DEBUG] [LOCAL ] CLW: Loaded 21485 existing records from primary storage. [2025-10-27T17:58:27.049346] [INFO ] [MAIN ] CLW: Loaded 21485 existing records. [2025-10-27T17:58:27.232181] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:58:27.232351] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-27T17:58:27.232400] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-27T17:58:27.232560] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-27T17:58:27.232618] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-27T17:58:27.597937] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:58:27.614900] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-27T17:58:28.414953] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-27T17:58:29.214995] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-27T17:58:29.302611] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-27T17:58:29.400375] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-27T17:58:30.014986] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-27T17:58:30.062422] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-27T17:58:30.095397] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T17:58:30.814993] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-27T17:58:30.873132] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T17:58:31.199432] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-27T17:58:31.614946] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-27T17:58:32.415010] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-27T17:58:33.186111] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-27T17:58:33.214933] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-27T17:58:33.465320] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-27T17:58:34.014948] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-27T17:58:34.442908] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-27T17:58:34.550865] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-27T17:58:34.552674] [INFO ] [REMOTE ] CLPR: Full fetch complete (15731 records). [2025-10-27T17:58:34.552744] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-27T17:58:34.820165] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-27T17:58:34.909088] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-10-27T17:58:34.909157] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-10-27T17:58:34.909485] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-10-27T17:58:34.909523] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-10-27T17:58:34.910004] [DEBUG] [LOCAL ] CLPR: Trimmed 15731 records to 9660 (keeping 200 days of data) [2025-10-27T17:58:34.963570] [DEBUG] [LOCAL ] CLPR: Primary data saved (9660 records). [2025-10-27T17:58:34.963711] [INFO ] [MAIN ] CLPR: Full history saved. [2025-10-27T17:58:34.963799] [INFO ] [MAIN ] Update Progress: 467/2366 symbols completed. CLPR took 30.9s. Estimated remaining: 3h 58m 1s. Rate: 8.0 symbols/min [2025-10-27T17:58:35.127315] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:58:35.174463] [DEBUG] [LOCAL ] CLX: Loaded 52564 existing records from primary storage. [2025-10-27T17:58:35.174799] [INFO ] [MAIN ] CLX: Loaded 52564 existing records. [2025-10-27T17:58:35.346375] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:58:35.346551] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-27T17:58:35.346595] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-27T17:58:35.346856] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-27T17:58:35.346910] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-27T17:58:35.619313] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-27T17:58:35.696955] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:58:36.414968] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-27T17:58:36.667576] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-27T17:58:36.772886] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-27T17:58:37.214957] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-27T17:58:37.852716] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T17:58:38.014977] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-27T17:58:38.186353] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T17:58:38.814992] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-27T17:58:39.614929] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-27T17:58:39.859999] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-27T17:58:40.414971] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-27T17:58:40.502904] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-27T17:58:41.215014] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-27T17:58:41.704628] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-27T17:58:41.785278] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-27T17:58:42.014939] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-27T17:58:42.412898] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-27T17:58:42.814939] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-27T17:58:43.614949] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-27T17:58:43.980708] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-27T17:58:44.284990] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T17:58:44.414945] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-27T17:58:45.208947] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T17:58:45.220419] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-27T17:58:45.686518] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-27T17:58:46.014962] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-27T17:58:46.074477] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T17:58:46.814953] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-27T17:58:47.560336] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-27T17:58:47.614961] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-27T17:58:47.956576] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-27T17:58:48.414972] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-27T17:58:49.220094] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-27T17:58:49.224992] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-27T17:58:49.234916] [INFO ] [REMOTE ] CLVT: Full fetch complete (75369 records). [2025-10-27T17:58:49.235062] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-27T17:58:49.621516] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-27T17:58:49.621597] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-27T17:58:49.622411] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-27T17:58:49.622475] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-27T17:58:49.623872] [DEBUG] [LOCAL ] CLVT: Trimmed 75369 records to 51854 (keeping 200 days of data) [2025-10-27T17:58:49.905193] [DEBUG] [LOCAL ] CLVT: Primary data saved (51854 records). [2025-10-27T17:58:49.905323] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-27T17:58:49.905399] [INFO ] [MAIN ] Update Progress: 468/2366 symbols completed. CLVT took 29.5s. Estimated remaining: 3h 58m 24s. Rate: 8.0 symbols/min [2025-10-27T17:58:50.020091] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-27T17:58:50.082898] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:58:50.128963] [DEBUG] [LOCAL ] CM: Loaded 48983 existing records from primary storage. [2025-10-27T17:58:50.129316] [INFO ] [MAIN ] CM: Loaded 48983 existing records. [2025-10-27T17:58:50.311767] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:58:50.312004] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-27T17:58:50.312090] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-27T17:58:50.312301] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-27T17:58:50.312357] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-27T17:58:50.479060] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-27T17:58:50.700848] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:58:50.820049] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-27T17:58:50.830848] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T17:58:51.626511] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-27T17:58:51.632261] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-27T17:58:52.414910] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-27T17:58:52.504026] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-27T17:58:52.508336] [INFO ] [REMOTE ] CLW: Full fetch complete (33412 records). [2025-10-27T17:58:52.508422] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-27T17:58:52.930118] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-27T17:58:52.930281] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-27T17:58:52.932414] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-27T17:58:52.931344] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-27T17:58:52.932549] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-27T17:58:52.943822] [DEBUG] [LOCAL ] CLW: Trimmed 33412 records to 20956 (keeping 200 days of data) [2025-10-27T17:58:53.074067] [DEBUG] [LOCAL ] CLW: Primary data saved (20956 records). [2025-10-27T17:58:53.074228] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-27T17:58:53.074344] [INFO ] [MAIN ] Update Progress: 469/2366 symbols completed. CLW took 26.2s. Estimated remaining: 3h 57m 58s. Rate: 8.0 symbols/min [2025-10-27T17:58:53.225328] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-27T17:58:53.246325] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:58:53.294247] [DEBUG] [LOCAL ] CMA: Loaded 50940 existing records from primary storage. [2025-10-27T17:58:53.294548] [INFO ] [MAIN ] CMA: Loaded 50940 existing records. [2025-10-27T17:58:53.469288] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:58:53.469487] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-27T17:58:53.469532] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-27T17:58:53.469807] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-27T17:58:53.469863] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-27T17:58:53.831766] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:58:53.856991] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T17:58:54.014943] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-27T17:58:54.710469] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T17:58:54.814977] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-27T17:58:55.499542] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T17:58:55.614948] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-27T17:58:56.414989] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-27T17:58:56.806757] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-27T17:58:57.048029] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-27T17:58:57.214929] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-27T17:58:57.606675] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-27T17:58:58.014927] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-27T17:58:58.814918] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-27T17:58:58.933982] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T17:58:59.614935] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-27T17:59:00.014945] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-27T17:59:00.355535] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-27T17:59:00.365604] [INFO ] [REMOTE ] CLS: Full fetch complete (77704 records). [2025-10-27T17:59:00.365759] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-27T17:59:00.421339] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-27T17:59:00.759077] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-27T17:59:00.759169] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-27T17:59:00.759996] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-27T17:59:00.760060] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-27T17:59:00.761478] [DEBUG] [LOCAL ] CLS: Trimmed 77704 records to 53546 (keeping 200 days of data) [2025-10-27T17:59:01.078365] [DEBUG] [LOCAL ] CLS: Primary data saved (53546 records). [2025-10-27T17:59:01.078496] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-27T17:59:01.079509] [INFO ] [MAIN ] Update Progress: 470/2366 symbols completed. CLS took 47.1s. Estimated remaining: 3h 57m 53s. Rate: 8.0 symbols/min [2025-10-27T17:59:01.226341] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-27T17:59:01.258443] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:59:01.292973] [DEBUG] [LOCAL ] CMBT: Loaded 28286 existing records from primary storage. [2025-10-27T17:59:01.293345] [INFO ] [MAIN ] CMBT: Loaded 28286 existing records. [2025-10-27T17:59:01.489532] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:59:01.489811] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-27T17:59:01.489869] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-27T17:59:01.490045] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-27T17:59:01.490085] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-27T17:59:01.850083] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:59:01.946579] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-27T17:59:02.014937] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-27T17:59:02.814954] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-27T17:59:04.155903] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (3.73 seconds). [2025-10-27T17:59:04.166888] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-27T17:59:04.321680] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T17:59:04.420138] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-27T17:59:04.441529] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-27T17:59:04.885109] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T17:59:04.894610] [INFO ] [REMOTE ] CLX: Full fetch complete (73576 records). [2025-10-27T17:59:04.894765] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-27T17:59:04.895692] [FATAL] [VALIDATOR ] CLX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:59:04.895786] [FATAL] [MAIN ] CLX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:59:04.895861] [WARN ] [MAIN ] CLX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:59:04.895948] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-27T17:59:04.896108] [DEBUG] [LOCAL ] CLX: No primary data file found to delete. [2025-10-27T17:59:04.896176] [INFO ] [LOCAL ] CLX: Starting deletion of derivative data. [2025-10-27T17:59:04.896392] [DEBUG] [LOCAL ] CLX: Deleted derivative data file. [2025-10-27T17:59:04.896508] [INFO ] [MAIN ] Update Progress: 471/2366 symbols completed. CLX took 29.9s. Estimated remaining: 3h 57m 30s. Rate: 8.0 symbols/min [2025-10-27T17:59:05.067014] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:59:05.109557] [DEBUG] [LOCAL ] CMC: Loaded 46265 existing records from primary storage. [2025-10-27T17:59:05.109984] [INFO ] [MAIN ] CMC: Loaded 46265 existing records. [2025-10-27T17:59:05.223471] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-27T17:59:05.305816] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:59:05.306893] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T17:59:05.307152] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-27T17:59:05.310959] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-27T17:59:05.311266] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-27T17:59:05.311322] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-27T17:59:05.679627] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:59:05.708805] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (4.48 seconds). [2025-10-27T17:59:06.014976] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-27T17:59:06.531378] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-27T17:59:06.765231] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T17:59:06.814933] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-27T17:59:07.614932] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-27T17:59:07.628161] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-27T17:59:08.414932] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-27T17:59:09.214940] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-27T17:59:09.615897] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-27T17:59:09.949486] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-27T17:59:09.999102] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T17:59:10.014911] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-27T17:59:10.623780] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T17:59:10.814945] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-27T17:59:11.614953] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-27T17:59:12.313436] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-27T17:59:12.414906] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-27T17:59:12.487218] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-27T17:59:13.214935] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-27T17:59:13.657039] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-27T17:59:14.015001] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-27T17:59:14.544363] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T17:59:14.814962] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-27T17:59:15.614947] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-27T17:59:15.826855] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-27T17:59:16.414911] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-27T17:59:16.513374] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-27T17:59:16.861628] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-27T17:59:17.215009] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-27T17:59:18.014950] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-27T17:59:18.268898] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-27T17:59:18.283240] [INFO ] [REMOTE ] CMBT: Full fetch complete (34737 records). [2025-10-27T17:59:18.283469] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-27T17:59:18.672295] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-27T17:59:18.672381] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-27T17:59:18.672930] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-27T17:59:18.672995] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-27T17:59:18.673854] [DEBUG] [LOCAL ] CMBT: Trimmed 34737 records to 28308 (keeping 200 days of data) [2025-10-27T17:59:18.816546] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-27T17:59:18.846503] [DEBUG] [LOCAL ] CMBT: Primary data saved (28308 records). [2025-10-27T17:59:18.846963] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-27T17:59:18.848133] [INFO ] [MAIN ] Update Progress: 472/2366 symbols completed. CMBT took 17.8s. Estimated remaining: 3h 57m 49s. Rate: 8.0 symbols/min [2025-10-27T17:59:19.020920] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:59:19.066513] [DEBUG] [LOCAL ] CMCM: Loaded 4882 existing records from primary storage. [2025-10-27T17:59:19.063062] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-27T17:59:19.078442] [INFO ] [MAIN ] CMCM: Loaded 4882 existing records. [2025-10-27T17:59:19.254805] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:59:19.255013] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-27T17:59:19.255061] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-27T17:59:19.255187] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-27T17:59:19.255224] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-27T17:59:19.621556] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:59:19.617592] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-27T17:59:19.661384] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-27T17:59:20.008079] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T17:59:20.414966] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-27T17:59:21.214917] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-27T17:59:21.288298] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T17:59:21.886467] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T17:59:22.014911] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-27T17:59:22.672663] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-27T17:59:22.682968] [INFO ] [REMOTE ] CM: Full fetch complete (69717 records). [2025-10-27T17:59:22.683117] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-27T17:59:22.820101] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-27T17:59:23.067394] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-27T17:59:23.067485] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-27T17:59:23.068253] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-27T17:59:23.068315] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-27T17:59:23.069563] [DEBUG] [LOCAL ] CM: Trimmed 69717 records to 48138 (keeping 200 days of data) [2025-10-27T17:59:23.353902] [DEBUG] [LOCAL ] CM: Primary data saved (48138 records). [2025-10-27T17:59:23.354017] [INFO ] [MAIN ] CM: Full history saved. [2025-10-27T17:59:23.354090] [INFO ] [MAIN ] Update Progress: 473/2366 symbols completed. CM took 33.4s. Estimated remaining: 3h 57m 29s. Rate: 8.0 symbols/min [2025-10-27T17:59:23.511207] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T17:59:23.527555] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:59:23.527787] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-27T17:59:23.529138] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-27T17:59:23.529356] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-27T17:59:23.529421] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-27T17:59:23.529598] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-27T17:59:23.529686] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-27T17:59:23.625724] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-27T17:59:23.670351] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T17:59:23.930112] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:59:24.065479] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-27T17:59:24.414952] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-27T17:59:25.214949] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-27T17:59:25.919375] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T17:59:25.938815] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-27T17:59:26.014919] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-27T17:59:26.814964] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-27T17:59:27.567023] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T17:59:27.614959] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-27T17:59:28.250524] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T17:59:28.305909] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-27T17:59:28.414935] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-27T17:59:29.214990] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-27T17:59:29.642410] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-27T17:59:30.014976] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-10-27T17:59:30.256428] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:59:30.256791] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-10-27T17:59:30.256879] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:59:30.256929] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-27T17:59:30.256982] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:59:30.257032] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-27T17:59:30.257125] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-27T17:59:30.257177] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-27T17:59:30.257219] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-27T17:59:30.257266] [INFO ] [MAIN ] Update Progress: 474/2366 symbols completed. CMDB took 6.9s. Estimated remaining: 3h 57m 19s. Rate: 8.0 symbols/min [2025-10-27T17:59:30.423618] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:59:30.471509] [DEBUG] [LOCAL ] CMG: Loaded 54502 existing records from primary storage. [2025-10-27T17:59:30.471874] [INFO ] [MAIN ] CMG: Loaded 54502 existing records. [2025-10-27T17:59:30.643045] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:59:30.643245] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-27T17:59:30.643291] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-27T17:59:30.643567] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-27T17:59:30.643605] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-27T17:59:30.818542] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-27T17:59:31.002082] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:59:31.077691] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-27T17:59:31.088153] [INFO ] [REMOTE ] CMA: Full fetch complete (73530 records). [2025-10-27T17:59:31.088304] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-27T17:59:31.385957] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T17:59:31.496372] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-27T17:59:31.496454] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-27T17:59:31.497446] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-27T17:59:31.497514] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-27T17:59:31.498963] [DEBUG] [LOCAL ] CMA: Trimmed 73530 records to 50157 (keeping 200 days of data) [2025-10-27T17:59:31.618359] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-27T17:59:31.800363] [DEBUG] [LOCAL ] CMA: Primary data saved (50157 records). [2025-10-27T17:59:31.800486] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-27T17:59:31.801323] [INFO ] [MAIN ] Update Progress: 475/2366 symbols completed. CMA took 38.7s. Estimated remaining: 3h 56m 48s. Rate: 8.0 symbols/min [2025-10-27T17:59:31.965340] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:59:32.004462] [DEBUG] [LOCAL ] CMI: Loaded 42162 existing records from primary storage. [2025-10-27T17:59:32.004769] [INFO ] [MAIN ] CMI: Loaded 42162 existing records. [2025-10-27T17:59:32.176606] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:59:32.176847] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-27T17:59:32.176904] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-27T17:59:32.177197] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-27T17:59:32.177267] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-27T17:59:32.420218] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-27T17:59:32.531427] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:59:33.125428] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-27T17:59:33.214966] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-27T17:59:33.527331] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-27T17:59:33.730346] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-27T17:59:34.014938] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-27T17:59:34.815028] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-27T17:59:35.500891] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-27T17:59:35.614925] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-27T17:59:36.415004] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-27T17:59:36.713137] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-27T17:59:36.976540] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-27T17:59:37.214916] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-27T17:59:37.726899] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T17:59:38.014940] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-27T17:59:38.814970] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-27T17:59:39.463733] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-27T17:59:39.535603] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T17:59:39.614948] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-27T17:59:40.414928] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-27T17:59:40.620306] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-27T17:59:40.629612] [INFO ] [REMOTE ] CMC: Full fetch complete (67230 records). [2025-10-27T17:59:40.629789] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-27T17:59:41.022601] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-27T17:59:41.022752] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-27T17:59:41.023560] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-27T17:59:41.023632] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-27T17:59:41.025174] [DEBUG] [LOCAL ] CMC: Trimmed 67230 records to 45505 (keeping 200 days of data) [2025-10-27T17:59:41.157155] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T17:59:41.226260] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-27T17:59:41.322760] [DEBUG] [LOCAL ] CMC: Primary data saved (45505 records). [2025-10-27T17:59:41.322873] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-27T17:59:41.322944] [INFO ] [MAIN ] Update Progress: 476/2366 symbols completed. CMC took 36.4s. Estimated remaining: 3h 56m 48s. Rate: 8.0 symbols/min [2025-10-27T17:59:41.490116] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:59:41.521421] [DEBUG] [LOCAL ] CMP: Loaded 36035 existing records from primary storage. [2025-10-27T17:59:41.521706] [INFO ] [MAIN ] CMP: Loaded 36035 existing records. [2025-10-27T17:59:41.699495] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:59:41.699756] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-27T17:59:41.699814] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-27T17:59:41.699988] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-27T17:59:41.700042] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-27T17:59:42.020208] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-27T17:59:42.058040] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:59:42.231298] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-27T17:59:42.502454] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T17:59:42.677038] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-27T17:59:42.814969] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-27T17:59:43.458118] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-27T17:59:43.614937] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-27T17:59:44.415009] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-27T17:59:44.785040] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T17:59:45.215009] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-27T17:59:45.618464] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T17:59:46.014956] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-27T17:59:46.814922] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-27T17:59:47.387346] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T17:59:47.599558] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-27T17:59:47.614899] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-27T17:59:48.194233] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-27T17:59:48.414972] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-27T17:59:49.058349] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-27T17:59:49.060214] [INFO ] [REMOTE ] CMCM: Full fetch complete (7089 records). [2025-10-27T17:59:49.060341] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-27T17:59:49.240362] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-27T17:59:49.436009] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-27T17:59:49.436109] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-27T17:59:49.436436] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-27T17:59:49.436514] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-27T17:59:49.437274] [DEBUG] [LOCAL ] CMCM: Trimmed 7089 records to 4809 (keeping 200 days of data) [2025-10-27T17:59:49.490847] [DEBUG] [LOCAL ] CMCM: Primary data saved (4809 records). [2025-10-27T17:59:49.490947] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-27T17:59:49.491023] [INFO ] [MAIN ] Update Progress: 477/2366 symbols completed. CMCM took 30.6s. Estimated remaining: 3h 56m 43s. Rate: 8.0 symbols/min [2025-10-27T17:59:49.493702] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-27T17:59:50.014935] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-27T17:59:50.814906] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-27T17:59:50.983860] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T17:59:51.032552] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T17:59:51.614941] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-27T17:59:52.415046] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-27T17:59:53.002741] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T17:59:53.214976] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-27T17:59:53.251637] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-27T17:59:53.648166] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T17:59:54.015040] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-27T17:59:54.818635] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-27T17:59:54.821100] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-27T17:59:55.209943] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T17:59:55.614951] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-27T17:59:56.415018] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-27T17:59:56.743903] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-27T17:59:57.000524] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T17:59:57.013902] [INFO ] [REMOTE ] CMI: Full fetch complete (61172 records). [2025-10-27T17:59:57.014106] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-27T17:59:57.223045] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-27T17:59:57.503485] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-27T17:59:57.503559] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-27T17:59:57.504294] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-27T17:59:57.504355] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-27T17:59:57.505443] [DEBUG] [LOCAL ] CMI: Trimmed 61172 records to 41324 (keeping 200 days of data) [2025-10-27T17:59:57.776972] [DEBUG] [LOCAL ] CMI: Primary data saved (41324 records). [2025-10-27T17:59:57.777116] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-27T17:59:57.777203] [INFO ] [MAIN ] Update Progress: 478/2366 symbols completed. CMI took 26.0s. Estimated remaining: 3h 56m 39s. Rate: 8.0 symbols/min [2025-10-27T17:59:57.978789] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T17:59:58.014910] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-27T17:59:58.966413] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-27T17:59:58.974964] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-27T17:59:59.292280] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-27T17:59:59.614996] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-27T17:59:59.930891] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-27T18:00:00.172484] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T18:00:00.182667] [INFO ] [REMOTE ] CMG: Full fetch complete (77893 records). [2025-10-27T18:00:00.182807] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-27T18:00:00.425451] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-27T18:00:00.578705] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-27T18:00:00.578786] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-27T18:00:00.579616] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-27T18:00:00.579684] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-27T18:00:00.581087] [DEBUG] [LOCAL ] CMG: Trimmed 77893 records to 53723 (keeping 200 days of data) [2025-10-27T18:00:00.899476] [DEBUG] [LOCAL ] CMG: Primary data saved (53723 records). [2025-10-27T18:00:00.899691] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-27T18:00:00.899783] [INFO ] [MAIN ] Update Progress: 479/2366 symbols completed. CMG took 30.6s. Estimated remaining: 3h 56m 14s. Rate: 8.0 symbols/min [2025-10-27T18:00:03.598980] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (3.17 seconds). [2025-10-27T18:00:03.605334] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-27T18:00:06.126738] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-27T18:00:06.132479] [INFO ] [REMOTE ] CMP: Full fetch complete (51381 records). [2025-10-27T18:00:06.132616] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-27T18:00:06.518338] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-27T18:00:06.518440] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-27T18:00:06.519103] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-27T18:00:06.519165] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-27T18:00:06.520377] [DEBUG] [LOCAL ] CMP: Trimmed 51381 records to 35271 (keeping 200 days of data) [2025-10-27T18:00:06.717096] [DEBUG] [LOCAL ] CMP: Primary data saved (35271 records). [2025-10-27T18:00:06.717239] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-27T18:00:06.717333] [INFO ] [MAIN ] Update Progress: 480/2366 symbols completed. CMP took 25.4s. Estimated remaining: 3h 55m 60s. Rate: 8.0 symbols/min [2025-10-27T18:00:07.316964] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:00:07.356171] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:00:07.433258] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:00:07.436703] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:00:07.443013] [DEBUG] [LOCAL ] CMSA: Loaded 3514 existing records from primary storage. [2025-10-27T18:00:07.443186] [INFO ] [MAIN ] CMSA: Loaded 3514 existing records. [2025-10-27T18:00:07.680304] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:00:07.680771] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-27T18:00:07.680849] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-27T18:00:07.681231] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-27T18:00:07.681311] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-27T18:00:07.782566] [DEBUG] [LOCAL ] CMRE: Loaded 36133 existing records from primary storage. [2025-10-27T18:00:07.804032] [DEBUG] [LOCAL ] CMPO: Loaded 38765 existing records from primary storage. [2025-10-27T18:00:07.821272] [INFO ] [MAIN ] CMRE: Loaded 36133 existing records. [2025-10-27T18:00:07.827837] [DEBUG] [LOCAL ] CMS: Loaded 53289 existing records from primary storage. [2025-10-27T18:00:07.821573] [INFO ] [MAIN ] CMPO: Loaded 38765 existing records. [2025-10-27T18:00:07.879137] [INFO ] [MAIN ] CMS: Loaded 53289 existing records. [2025-10-27T18:00:08.382098] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:00:08.484692] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-27T18:00:08.510140] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-27T18:00:08.569148] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-27T18:00:08.596276] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:00:08.599549] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-27T18:00:08.641210] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:00:08.599384] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:00:08.655603] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-27T18:00:08.636043] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-27T18:00:08.655332] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-27T18:00:08.662201] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-27T18:00:08.685518] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-27T18:00:08.720059] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-27T18:00:08.729397] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-27T18:00:08.724106] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-27T18:00:08.739802] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-27T18:00:09.525901] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:00:09.542963] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-27T18:00:09.714810] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:00:09.733980] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:00:09.734249] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-27T18:00:09.734480] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-27T18:00:09.776763] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T18:00:09.778294] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-27T18:00:10.586574] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-27T18:00:10.587802] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-27T18:00:10.811593] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T18:00:10.817929] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-27T18:00:11.979489] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-27T18:00:11.989891] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-27T18:00:12.232359] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T18:00:12.239503] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-27T18:00:12.243243] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T18:00:12.244432] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-27T18:00:12.450377] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-10-27T18:00:12.459477] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-27T18:00:13.373581] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-27T18:00:13.381813] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-27T18:00:13.450033] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-27T18:00:13.451547] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-27T18:00:13.707133] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-27T18:00:13.715532] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-27T18:00:14.073904] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-27T18:00:14.075404] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-27T18:00:14.252258] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-27T18:00:14.262089] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-27T18:00:15.281865] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-27T18:00:15.283547] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-27T18:00:15.543387] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-27T18:00:15.603667] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-27T18:00:15.614900] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-27T18:00:15.677078] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-27T18:00:15.778187] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-27T18:00:15.969828] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-27T18:00:16.414875] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-27T18:00:17.214958] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-27T18:00:17.840182] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T18:00:18.014913] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-27T18:00:18.401609] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T18:00:18.814980] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-27T18:00:19.607453] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T18:00:19.615762] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-27T18:00:20.181256] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T18:00:20.415029] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-27T18:00:21.215030] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-27T18:00:21.343285] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-27T18:00:21.911889] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T18:00:22.014953] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-27T18:00:22.321683] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-27T18:00:22.815003] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-27T18:00:23.218577] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T18:00:23.614966] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-27T18:00:24.414926] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-27T18:00:24.682765] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-27T18:00:25.049365] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T18:00:25.214951] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-27T18:00:25.376379] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-27T18:00:26.014988] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-27T18:00:26.528545] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-27T18:00:26.756289] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-27T18:00:26.814915] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-27T18:00:27.614984] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-27T18:00:28.323910] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T18:00:28.414916] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-27T18:00:28.537218] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T18:00:29.214989] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-27T18:00:29.454958] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T18:00:29.461499] [INFO ] [REMOTE ] CMPO: Full fetch complete (57855 records). [2025-10-27T18:00:29.461603] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-27T18:00:29.868017] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-27T18:00:29.868108] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-27T18:00:29.868854] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-27T18:00:29.868920] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-27T18:00:29.870138] [DEBUG] [LOCAL ] CMPO: Trimmed 57855 records to 37974 (keeping 200 days of data) [2025-10-27T18:00:30.031435] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-27T18:00:30.094216] [DEBUG] [LOCAL ] CMPO: Primary data saved (37974 records). [2025-10-27T18:00:30.094356] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-27T18:00:30.094435] [INFO ] [MAIN ] Update Progress: 481/2366 symbols completed. CMPO took 23.4s. Estimated remaining: 3h 56m 54s. Rate: 8.0 symbols/min [2025-10-27T18:00:30.268622] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:00:30.291076] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T18:00:30.301323] [DEBUG] [LOCAL ] CMSC: Loaded 4846 existing records from primary storage. [2025-10-27T18:00:30.301765] [INFO ] [MAIN ] CMSC: Loaded 4846 existing records. [2025-10-27T18:00:30.301528] [INFO ] [REMOTE ] CMRE: Full fetch complete (51153 records). [2025-10-27T18:00:30.357565] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-27T18:00:30.606439] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:00:30.634671] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-27T18:00:30.590163] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T18:00:30.636040] [INFO ] [REMOTE ] CMSA: Full fetch complete (4788 records). [2025-10-27T18:00:30.636134] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-27T18:00:30.646532] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-27T18:00:30.663888] [FATAL] [VALIDATOR ] CMSA: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:00:30.664037] [FATAL] [MAIN ] CMSA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:00:30.663367] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-27T18:00:30.692684] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-27T18:00:30.692789] [WARN ] [MAIN ] CMSA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:00:30.717853] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-27T18:00:30.820022] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-27T18:00:30.845906] [DEBUG] [LOCAL ] CMSA: No primary data file found to delete. [2025-10-27T18:00:30.857104] [INFO ] [LOCAL ] CMSA: Starting deletion of derivative data. [2025-10-27T18:00:30.885409] [DEBUG] [LOCAL ] CMSA: Deleted derivative data file. [2025-10-27T18:00:30.896321] [INFO ] [MAIN ] Update Progress: 482/2366 symbols completed. CMSA took 24.2s. Estimated remaining: 3h 56m 21s. Rate: 8.0 symbols/min [2025-10-27T18:00:31.325844] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-27T18:00:31.351017] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-27T18:00:31.371541] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-27T18:00:31.370617] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:00:31.376930] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-27T18:00:31.453294] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:00:31.454279] [DEBUG] [LOCAL ] CMRE: Trimmed 51153 records to 35264 (keeping 200 days of data) [2025-10-27T18:00:31.508316] [DEBUG] [LOCAL ] CMSD: Loaded 7687 existing records from primary storage. [2025-10-27T18:00:31.516868] [INFO ] [MAIN ] CMSD: Loaded 7687 existing records. [2025-10-27T18:00:31.622300] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-27T18:00:31.762749] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:00:31.766203] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-27T18:00:31.766316] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-27T18:00:31.766511] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-27T18:00:31.766578] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-27T18:00:32.088279] [DEBUG] [LOCAL ] CMRE: Primary data saved (35264 records). [2025-10-27T18:00:32.114107] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-27T18:00:32.119978] [INFO ] [MAIN ] Update Progress: 483/2366 symbols completed. CMRE took 25.4s. Estimated remaining: 3h 55m 48s. Rate: 8.0 symbols/min [2025-10-27T18:00:32.342622] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:00:32.355363] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T18:00:32.417912] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:00:32.418019] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-27T18:00:32.453570] [DEBUG] [LOCAL ] CMTG: Loaded 35511 existing records from primary storage. [2025-10-27T18:00:32.453912] [INFO ] [MAIN ] CMTG: Loaded 35511 existing records. [2025-10-27T18:00:32.650597] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:00:32.669427] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-27T18:00:32.672895] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-27T18:00:32.673217] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-27T18:00:32.673850] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-27T18:00:32.708748] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-27T18:00:32.965350] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-27T18:00:33.050926] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:00:33.214917] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-27T18:00:34.014986] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-27T18:00:34.363116] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T18:00:34.814918] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-27T18:00:35.615010] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-27T18:00:35.814338] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-27T18:00:35.833179] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T18:00:36.420038] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-27T18:00:36.431055] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-27T18:00:36.826463] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-27T18:00:37.214980] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-27T18:00:37.648233] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-27T18:00:38.014992] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-27T18:00:38.814966] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-27T18:00:39.247875] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-27T18:00:39.432246] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T18:00:39.614927] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-27T18:00:40.414940] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-27T18:00:40.873787] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-27T18:00:40.984201] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T18:00:41.214962] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-27T18:00:41.911267] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-27T18:00:42.015017] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-27T18:00:42.797494] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T18:00:42.814907] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-27T18:00:43.574053] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-27T18:00:43.614996] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-27T18:00:44.415014] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-27T18:00:44.805085] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-27T18:00:45.215007] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-27T18:00:45.296869] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T18:00:45.307739] [INFO ] [REMOTE ] CMS: Full fetch complete (76280 records). [2025-10-27T18:00:45.307936] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-27T18:00:45.653894] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-27T18:00:45.736836] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-27T18:00:45.736921] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-27T18:00:45.737860] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-27T18:00:45.737926] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-27T18:00:45.739357] [DEBUG] [LOCAL ] CMS: Trimmed 76280 records to 52509 (keeping 200 days of data) [2025-10-27T18:00:46.019389] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-27T18:00:46.057391] [DEBUG] [LOCAL ] CMS: Primary data saved (52509 records). [2025-10-27T18:00:46.057687] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-27T18:00:46.057813] [INFO ] [MAIN ] Update Progress: 484/2366 symbols completed. CMS took 39.3s. Estimated remaining: 3h 56m 6s. Rate: 8.0 symbols/min [2025-10-27T18:00:46.227384] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:00:46.235709] [DEBUG] [LOCAL ] CMU: Loaded 6365 existing records from primary storage. [2025-10-27T18:00:46.235911] [INFO ] [MAIN ] CMU: Loaded 6365 existing records. [2025-10-27T18:00:46.412895] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:00:46.413095] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-27T18:00:46.413143] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-27T18:00:46.413282] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-27T18:00:46.413322] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-27T18:00:46.769793] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:00:46.814908] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-27T18:00:47.457927] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-27T18:00:47.587704] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-27T18:00:47.614896] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-27T18:00:48.164668] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-27T18:00:48.414934] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-27T18:00:49.214964] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-27T18:00:49.336298] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-27T18:00:49.803695] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-27T18:00:50.014948] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-27T18:00:50.814990] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-27T18:00:50.848154] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-27T18:00:51.614950] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-27T18:00:52.152780] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T18:00:52.241732] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-27T18:00:52.414925] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-27T18:00:52.853856] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-27T18:00:53.214990] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-27T18:00:53.655974] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-27T18:00:54.014962] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-27T18:00:54.399007] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-27T18:00:54.814945] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-27T18:00:55.614949] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-27T18:00:55.902074] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T18:00:55.955381] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-27T18:00:56.414918] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-27T18:00:57.214978] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-27T18:00:57.622316] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-27T18:00:57.859054] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T18:00:58.014956] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-27T18:00:58.573985] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-27T18:00:58.814924] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-27T18:00:59.472364] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T18:00:59.614964] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-27T18:01:00.158003] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-27T18:01:00.159672] [INFO ] [REMOTE ] CMSD: Full fetch complete (11403 records). [2025-10-27T18:01:00.159746] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-27T18:01:00.420220] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-27T18:01:00.516853] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-27T18:01:00.516929] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-27T18:01:00.517196] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-27T18:01:00.517255] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-27T18:01:00.517717] [DEBUG] [LOCAL ] CMSD: Trimmed 11403 records to 7446 (keeping 200 days of data) [2025-10-27T18:01:00.561298] [DEBUG] [LOCAL ] CMSD: Primary data saved (7446 records). [2025-10-27T18:01:00.561380] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-27T18:01:00.561450] [INFO ] [MAIN ] Update Progress: 485/2366 symbols completed. CMSD took 29.7s. Estimated remaining: 3h 56m 25s. Rate: 8.0 symbols/min [2025-10-27T18:01:00.726118] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:01:00.755987] [DEBUG] [LOCAL ] CNA: Loaded 32892 existing records from primary storage. [2025-10-27T18:01:00.756232] [INFO ] [MAIN ] CNA: Loaded 32892 existing records. [2025-10-27T18:01:00.930639] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:01:00.930862] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-27T18:01:00.930907] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-27T18:01:00.931090] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-27T18:01:00.931144] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-27T18:01:01.220126] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-27T18:01:01.277049] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:01:02.015164] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-27T18:01:02.814995] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-27T18:01:04.876948] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (4.46 seconds). [2025-10-27T18:01:04.879929] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-27T18:01:06.292676] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (4.28 seconds). [2025-10-27T18:01:06.293973] [INFO ] [REMOTE ] CMSC: Full fetch complete (6856 records). [2025-10-27T18:01:06.294042] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-27T18:01:06.294392] [FATAL] [VALIDATOR ] CMSC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:01:06.294471] [FATAL] [MAIN ] CMSC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:01:06.294512] [WARN ] [MAIN ] CMSC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:01:06.294549] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-27T18:01:06.294602] [DEBUG] [LOCAL ] CMSC: No primary data file found to delete. [2025-10-27T18:01:06.294634] [INFO ] [LOCAL ] CMSC: Starting deletion of derivative data. [2025-10-27T18:01:06.294806] [DEBUG] [LOCAL ] CMSC: Deleted derivative data file. [2025-10-27T18:01:06.294874] [INFO ] [MAIN ] Update Progress: 486/2366 symbols completed. CMSC took 36.2s. Estimated remaining: 3h 56m 11s. Rate: 8.0 symbols/min [2025-10-27T18:01:06.414847] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T18:01:06.432912] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-27T18:01:06.500893] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (5.28 seconds). [2025-10-27T18:01:06.499327] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:01:06.509864] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-27T18:01:06.551242] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (3.74 seconds). [2025-10-27T18:01:06.556882] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-27T18:01:06.573823] [DEBUG] [LOCAL ] CNC: Loaded 54559 existing records from primary storage. [2025-10-27T18:01:06.574155] [INFO ] [MAIN ] CNC: Loaded 54559 existing records. [2025-10-27T18:01:06.752069] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:01:06.752270] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-27T18:01:06.752316] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-27T18:01:06.752595] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-27T18:01:06.752632] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-27T18:01:06.909667] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-27T18:01:06.980453] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-27T18:01:07.127456] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:01:07.551516] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-27T18:01:07.552744] [INFO ] [REMOTE ] CMU: Full fetch complete (9443 records). [2025-10-27T18:01:07.552811] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-27T18:01:07.620152] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-27T18:01:07.767725] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-27T18:01:07.831195] [INFO ] [REMOTE ] CMTG: Full fetch complete (52429 records). [2025-10-27T18:01:07.842787] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-27T18:01:07.866623] [FATAL] [VALIDATOR ] CMTG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:01:07.887572] [FATAL] [MAIN ] CMTG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:01:07.926167] [WARN ] [MAIN ] CMTG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:01:07.951363] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-27T18:01:07.951604] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-27T18:01:07.951955] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-27T18:01:07.952155] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-27T18:01:07.943010] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-27T18:01:07.965204] [DEBUG] [LOCAL ] CMTG: No primary data file found to delete. [2025-10-27T18:01:07.952844] [DEBUG] [LOCAL ] CMU: Trimmed 9443 records to 6086 (keeping 200 days of data) [2025-10-27T18:01:07.968002] [INFO ] [LOCAL ] CMTG: Starting deletion of derivative data. [2025-10-27T18:01:07.973298] [DEBUG] [LOCAL ] CMTG: Deleted derivative data file. [2025-10-27T18:01:07.973983] [INFO ] [MAIN ] Update Progress: 487/2366 symbols completed. CMTG took 35.8s. Estimated remaining: 3h 55m 41s. Rate: 8.0 symbols/min [2025-10-27T18:01:08.006739] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T18:01:08.091957] [DEBUG] [LOCAL ] CMU: Primary data saved (6086 records). [2025-10-27T18:01:08.123330] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-27T18:01:08.133714] [INFO ] [MAIN ] Update Progress: 488/2366 symbols completed. CMU took 22.1s. Estimated remaining: 3h 55m 5s. Rate: 8.0 symbols/min [2025-10-27T18:01:08.327544] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:01:08.378418] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:01:08.387248] [DEBUG] [LOCAL ] CNF: Loaded 10649 existing records from primary storage. [2025-10-27T18:01:08.387598] [INFO ] [MAIN ] CNF: Loaded 10649 existing records. [2025-10-27T18:01:08.418690] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-27T18:01:08.588392] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:01:08.588693] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-27T18:01:08.588754] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-27T18:01:08.588896] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-27T18:01:08.588935] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-27T18:01:08.734028] [DEBUG] [LOCAL ] CNH: Loaded 54321 existing records from primary storage. [2025-10-27T18:01:08.750123] [INFO ] [MAIN ] CNH: Loaded 54321 existing records. [2025-10-27T18:01:09.099098] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:01:09.124760] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-27T18:01:09.155019] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-27T18:01:09.192557] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-27T18:01:09.192767] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-27T18:01:09.196359] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:01:09.220013] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-27T18:01:09.603410] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:01:09.606559] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-27T18:01:09.633744] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-27T18:01:09.679325] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-27T18:01:10.014950] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-27T18:01:10.814994] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-27T18:01:11.402302] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T18:01:11.614942] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-27T18:01:12.411934] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T18:01:12.421634] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-27T18:01:13.010051] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-27T18:01:13.214935] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-27T18:01:13.532431] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-27T18:01:14.014919] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-27T18:01:14.739274] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T18:01:14.814913] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-27T18:01:14.901918] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-27T18:01:15.614927] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-27T18:01:16.041622] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-27T18:01:16.216806] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T18:01:16.414966] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-27T18:01:17.214971] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-27T18:01:18.014939] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-27T18:01:18.128152] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T18:01:18.156144] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-27T18:01:18.814974] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-27T18:01:18.837230] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T18:01:19.614940] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-27T18:01:20.018035] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T18:01:20.414984] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-27T18:01:21.026596] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T18:01:21.203552] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T18:01:21.214899] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-27T18:01:22.014885] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-27T18:01:22.598426] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T18:01:22.814948] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-27T18:01:23.584794] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T18:01:23.614901] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-27T18:01:24.124470] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T18:01:24.414939] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-27T18:01:25.214932] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-27T18:01:25.286416] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T18:01:26.014942] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-27T18:01:26.533033] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T18:01:26.814946] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-27T18:01:27.140973] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-27T18:01:27.614920] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-27T18:01:27.737507] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T18:01:27.806639] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T18:01:28.087976] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-27T18:01:28.415001] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-27T18:01:29.215027] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-27T18:01:29.848414] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T18:01:30.015003] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-27T18:01:30.674665] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T18:01:30.814937] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-27T18:01:31.614956] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-27T18:01:31.834171] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-27T18:01:31.862164] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-27T18:01:31.868096] [INFO ] [REMOTE ] CNA: Full fetch complete (46175 records). [2025-10-27T18:01:31.868216] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-27T18:01:32.259130] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-27T18:01:32.259203] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-27T18:01:32.259793] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-27T18:01:32.259854] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-27T18:01:32.260759] [DEBUG] [LOCAL ] CNA: Trimmed 46175 records to 32238 (keeping 200 days of data) [2025-10-27T18:01:32.426606] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-27T18:01:32.447831] [DEBUG] [LOCAL ] CNA: Primary data saved (32238 records). [2025-10-27T18:01:32.447941] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-27T18:01:32.448014] [INFO ] [MAIN ] Update Progress: 489/2366 symbols completed. CNA took 31.9s. Estimated remaining: 3h 56m 2s. Rate: 8.0 symbols/min [2025-10-27T18:01:32.612602] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:01:32.658056] [DEBUG] [LOCAL ] CNI: Loaded 52378 existing records from primary storage. [2025-10-27T18:01:32.658381] [INFO ] [MAIN ] CNI: Loaded 52378 existing records. [2025-10-27T18:01:32.835115] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:01:32.835324] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-27T18:01:32.835379] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-27T18:01:32.835673] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-27T18:01:32.835744] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-27T18:01:33.204017] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:01:33.220039] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-27T18:01:33.240269] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T18:01:33.473310] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-27T18:01:34.014963] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-27T18:01:34.814920] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-27T18:01:34.966375] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-27T18:01:35.614985] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-27T18:01:35.627531] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T18:01:35.906793] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-27T18:01:36.414997] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-27T18:01:37.144338] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T18:01:37.215015] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-27T18:01:37.970941] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-27T18:01:38.014992] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-27T18:01:38.286365] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-27T18:01:38.288893] [INFO ] [REMOTE ] CNF: Full fetch complete (12939 records). [2025-10-27T18:01:38.288996] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-27T18:01:38.664406] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-27T18:01:38.664490] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-27T18:01:38.664797] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-27T18:01:38.664857] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-27T18:01:38.665355] [DEBUG] [LOCAL ] CNF: Trimmed 12939 records to 10606 (keeping 200 days of data) [2025-10-27T18:01:38.721787] [DEBUG] [LOCAL ] CNF: Primary data saved (10606 records). [2025-10-27T18:01:38.721914] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-27T18:01:38.722008] [INFO ] [MAIN ] Update Progress: 490/2366 symbols completed. CNF took 30.7s. Estimated remaining: 3h 55m 49s. Rate: 8.0 symbols/min [2025-10-27T18:01:38.820045] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-27T18:01:38.918899] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:01:38.969129] [DEBUG] [LOCAL ] CNK: Loaded 53674 existing records from primary storage. [2025-10-27T18:01:38.969451] [INFO ] [MAIN ] CNK: Loaded 53674 existing records. [2025-10-27T18:01:39.141894] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:01:39.142062] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-27T18:01:39.142107] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-27T18:01:39.142376] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-27T18:01:39.142440] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-27T18:01:39.561669] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:01:39.619022] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-27T18:01:39.624894] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-27T18:01:39.635920] [INFO ] [REMOTE ] CNC: Full fetch complete (77864 records). [2025-10-27T18:01:39.654050] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-27T18:01:39.702694] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T18:01:40.079198] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-27T18:01:40.079275] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-27T18:01:40.080100] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-27T18:01:40.080170] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-27T18:01:40.081545] [DEBUG] [LOCAL ] CNC: Trimmed 77864 records to 53779 (keeping 200 days of data) [2025-10-27T18:01:40.393557] [DEBUG] [LOCAL ] CNC: Primary data saved (53779 records). [2025-10-27T18:01:40.393732] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-27T18:01:40.393823] [INFO ] [MAIN ] Update Progress: 491/2366 symbols completed. CNC took 34.1s. Estimated remaining: 3h 55m 19s. Rate: 8.0 symbols/min [2025-10-27T18:01:40.424212] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-27T18:01:40.574627] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:01:40.621129] [DEBUG] [LOCAL ] CNM: Loaded 51731 existing records from primary storage. [2025-10-27T18:01:40.621466] [INFO ] [MAIN ] CNM: Loaded 51731 existing records. [2025-10-27T18:01:40.804725] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:01:40.804929] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-27T18:01:40.804979] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-27T18:01:40.805151] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-27T18:01:40.805231] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-27T18:01:41.189053] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:01:41.214919] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-27T18:01:41.246832] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-27T18:01:42.014637] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-27T18:01:42.023430] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-27T18:01:42.025674] [INFO ] [REMOTE ] CNH: Full fetch complete (77313 records). [2025-10-27T18:01:42.025817] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-27T18:01:42.026772] [FATAL] [VALIDATOR ] CNH: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:01:42.026859] [FATAL] [MAIN ] CNH: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:01:42.026945] [WARN ] [MAIN ] CNH: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:01:42.027017] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-27T18:01:42.027127] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-10-27T18:01:42.027178] [INFO ] [LOCAL ] CNH: Starting deletion of derivative data. [2025-10-27T18:01:42.027324] [DEBUG] [LOCAL ] CNH: Deleted derivative data file. [2025-10-27T18:01:42.027416] [INFO ] [MAIN ] Update Progress: 492/2366 symbols completed. CNH took 33.9s. Estimated remaining: 3h 54m 50s. Rate: 8.0 symbols/min [2025-10-27T18:01:42.197007] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:01:42.227563] [DEBUG] [LOCAL ] CNMD: Loaded 32565 existing records from primary storage. [2025-10-27T18:01:42.227905] [INFO ] [MAIN ] CNMD: Loaded 32565 existing records. [2025-10-27T18:01:42.402951] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:01:42.403154] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-27T18:01:42.403202] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-27T18:01:42.403374] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-27T18:01:42.403416] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-27T18:01:42.769398] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:01:42.814926] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-27T18:01:43.038959] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-27T18:01:43.522181] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T18:01:43.614935] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-27T18:01:43.917944] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-27T18:01:44.414932] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-27T18:01:45.214921] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-27T18:01:45.314414] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-27T18:01:45.940105] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T18:01:46.014969] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-27T18:01:46.643129] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T18:01:46.814948] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-27T18:01:47.615475] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-27T18:01:47.618293] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T18:01:48.414970] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-27T18:01:48.661202] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-27T18:01:48.989122] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T18:01:49.215012] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-27T18:01:49.742574] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-27T18:01:50.014954] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-27T18:01:50.524764] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T18:01:50.814931] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-27T18:01:51.614987] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-27T18:01:51.857695] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-27T18:01:52.364187] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-27T18:01:52.414940] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-27T18:01:52.788508] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-27T18:01:53.214915] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-27T18:01:54.014977] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-27T18:01:54.088587] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T18:01:54.814926] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-27T18:01:54.860020] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-27T18:01:55.614917] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-27T18:01:55.941491] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T18:01:56.262668] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T18:01:56.414931] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-27T18:01:56.751061] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-27T18:01:57.214944] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-27T18:01:58.014949] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-27T18:01:58.062829] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-27T18:01:58.072503] [INFO ] [REMOTE ] CNI: Full fetch complete (74844 records). [2025-10-27T18:01:58.072666] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-27T18:01:58.461844] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-27T18:01:58.461986] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-27T18:01:58.462892] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-27T18:01:58.462955] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-27T18:01:58.464383] [DEBUG] [LOCAL ] CNI: Trimmed 74844 records to 51583 (keeping 200 days of data) [2025-10-27T18:01:58.574775] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T18:01:58.795452] [DEBUG] [LOCAL ] CNI: Primary data saved (51583 records). [2025-10-27T18:01:58.795580] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-27T18:01:58.795678] [INFO ] [MAIN ] Update Progress: 493/2366 symbols completed. CNI took 26.3s. Estimated remaining: 3h 55m 17s. Rate: 8.0 symbols/min [2025-10-27T18:01:58.826232] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-27T18:01:58.969276] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:01:59.002813] [DEBUG] [LOCAL ] CNNE: Loaded 36187 existing records from primary storage. [2025-10-27T18:01:59.003123] [INFO ] [MAIN ] CNNE: Loaded 36187 existing records. [2025-10-27T18:01:59.175964] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:01:59.176191] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-27T18:01:59.176236] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-27T18:01:59.176408] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-27T18:01:59.176446] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-27T18:01:59.528253] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:01:59.588404] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-27T18:01:59.614922] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-27T18:02:00.414921] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-27T18:02:00.660410] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-27T18:02:01.214997] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-27T18:02:02.014987] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-27T18:02:02.214057] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-27T18:02:02.814983] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-27T18:02:03.994323] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-10-27T18:02:04.005083] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-27T18:02:04.240759] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (3.83 seconds). [2025-10-27T18:02:04.414952] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-27T18:02:04.988480] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-10-27T18:02:05.214964] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-27T18:02:05.952369] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-27T18:02:06.014901] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-27T18:02:06.058804] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (3.24 seconds). [2025-10-27T18:02:06.175813] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-27T18:02:06.699255] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-27T18:02:06.814946] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-27T18:02:07.614994] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-27T18:02:08.265935] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-27T18:02:08.335520] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T18:02:08.414928] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-27T18:02:08.756365] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T18:02:09.214939] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-27T18:02:09.592046] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-27T18:02:09.598208] [INFO ] [REMOTE ] CNMD: Full fetch complete (47450 records). [2025-10-27T18:02:09.598308] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-27T18:02:09.970521] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-27T18:02:09.970601] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-27T18:02:09.971204] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-27T18:02:09.971267] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-27T18:02:09.972263] [DEBUG] [LOCAL ] CNMD: Trimmed 47450 records to 31736 (keeping 200 days of data) [2025-10-27T18:02:10.023116] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-27T18:02:10.159159] [DEBUG] [LOCAL ] CNMD: Primary data saved (31736 records). [2025-10-27T18:02:10.159293] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-27T18:02:10.159369] [INFO ] [MAIN ] Update Progress: 494/2366 symbols completed. CNMD took 28.1s. Estimated remaining: 3h 55m 24s. Rate: 8.0 symbols/min [2025-10-27T18:02:10.324442] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:02:10.358758] [DEBUG] [LOCAL ] CNO: Loaded 40807 existing records from primary storage. [2025-10-27T18:02:10.359028] [INFO ] [MAIN ] CNO: Loaded 40807 existing records. [2025-10-27T18:02:10.537521] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:02:10.537754] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-27T18:02:10.537826] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-27T18:02:10.538223] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-27T18:02:10.538260] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-27T18:02:10.825057] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-27T18:02:10.929118] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T18:02:10.933009] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:02:11.614917] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-27T18:02:11.816336] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-27T18:02:12.031148] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-27T18:02:12.414991] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-27T18:02:12.500426] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-27T18:02:13.215007] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-27T18:02:13.714680] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-27T18:02:14.014932] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-27T18:02:14.814958] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-27T18:02:14.873095] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T18:02:14.883062] [INFO ] [REMOTE ] CNK: Full fetch complete (76342 records). [2025-10-27T18:02:14.883173] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-27T18:02:15.296919] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-27T18:02:15.297001] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-27T18:02:15.298320] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-27T18:02:15.298384] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-27T18:02:15.299839] [DEBUG] [LOCAL ] CNK: Trimmed 76342 records to 52892 (keeping 200 days of data) [2025-10-27T18:02:15.420939] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T18:02:15.620825] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-27T18:02:15.641826] [DEBUG] [LOCAL ] CNK: Primary data saved (52892 records). [2025-10-27T18:02:15.641905] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-27T18:02:15.642804] [INFO ] [MAIN ] Update Progress: 495/2366 symbols completed. CNK took 36.9s. Estimated remaining: 3h 55m 9s. Rate: 8.0 symbols/min [2025-10-27T18:02:15.811469] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:02:15.860922] [DEBUG] [LOCAL ] CNP: Loaded 54255 existing records from primary storage. [2025-10-27T18:02:15.861283] [INFO ] [MAIN ] CNP: Loaded 54255 existing records. [2025-10-27T18:02:16.037174] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:02:16.037374] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-27T18:02:16.037453] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-27T18:02:16.037758] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-27T18:02:16.037822] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-27T18:02:16.404115] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:02:16.414896] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-27T18:02:16.706074] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-27T18:02:16.715927] [INFO ] [REMOTE ] CNM: Full fetch complete (73761 records). [2025-10-27T18:02:16.716058] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-27T18:02:17.121384] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-27T18:02:17.121494] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-27T18:02:17.122450] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-27T18:02:17.122639] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-27T18:02:17.139466] [DEBUG] [LOCAL ] CNM: Trimmed 73761 records to 50952 (keeping 200 days of data) [2025-10-27T18:02:17.156127] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T18:02:17.219459] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-27T18:02:17.481930] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-27T18:02:17.498130] [DEBUG] [LOCAL ] CNM: Primary data saved (50952 records). [2025-10-27T18:02:17.498230] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-27T18:02:17.499066] [INFO ] [MAIN ] Update Progress: 496/2366 symbols completed. CNM took 37.1s. Estimated remaining: 3h 54m 40s. Rate: 8.0 symbols/min [2025-10-27T18:02:17.668288] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:02:17.717284] [DEBUG] [LOCAL ] CNQ: Loaded 54361 existing records from primary storage. [2025-10-27T18:02:17.717594] [INFO ] [MAIN ] CNQ: Loaded 54361 existing records. [2025-10-27T18:02:17.897613] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:02:17.897992] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-27T18:02:17.898038] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-27T18:02:17.898525] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-27T18:02:17.898562] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-27T18:02:18.020111] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-27T18:02:18.260811] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:02:18.814971] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-27T18:02:18.977820] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-27T18:02:19.062680] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-27T18:02:19.614934] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-27T18:02:20.414914] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-27T18:02:20.750624] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-27T18:02:21.090949] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T18:02:21.215098] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-27T18:02:21.579549] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-27T18:02:22.015022] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-27T18:02:22.326579] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T18:02:22.814943] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-27T18:02:23.614926] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-27T18:02:24.020724] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T18:02:24.209888] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-27T18:02:24.414991] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-27T18:02:24.874979] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T18:02:25.215024] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-27T18:02:25.540952] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T18:02:26.015063] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-27T18:02:26.252635] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T18:02:26.259015] [INFO ] [REMOTE ] CNNE: Full fetch complete (50430 records). [2025-10-27T18:02:26.259124] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-27T18:02:26.259730] [FATAL] [VALIDATOR ] CNNE: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:02:26.259818] [FATAL] [MAIN ] CNNE: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:02:26.259862] [WARN ] [MAIN ] CNNE: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:02:26.259930] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-27T18:02:26.259993] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-10-27T18:02:26.260029] [INFO ] [LOCAL ] CNNE: Starting deletion of derivative data. [2025-10-27T18:02:26.260156] [DEBUG] [LOCAL ] CNNE: Deleted derivative data file. [2025-10-27T18:02:26.260227] [INFO ] [MAIN ] Update Progress: 497/2366 symbols completed. CNNE took 27.5s. Estimated remaining: 3h 54m 37s. Rate: 8.0 symbols/min [2025-10-27T18:02:26.432235] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:02:26.432365] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-27T18:02:26.432403] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-27T18:02:26.432511] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-27T18:02:26.432552] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-27T18:02:26.432594] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-27T18:02:26.432625] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-27T18:02:26.787040] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:02:26.814906] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-10-27T18:02:27.430462] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-27T18:02:27.614937] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-27T18:02:27.770360] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-27T18:02:28.415002] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-27T18:02:29.023931] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T18:02:29.214938] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-10-27T18:02:29.884755] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T18:02:30.014973] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-27T18:02:30.421769] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T18:02:30.814955] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-27T18:02:31.530365] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T18:02:31.614998] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-27T18:02:32.065339] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T18:02:32.414930] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-27T18:02:32.989046] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-27T18:02:33.215028] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-10-27T18:02:33.958739] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T18:02:34.014923] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-27T18:02:34.724781] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-27T18:02:34.814980] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-27T18:02:35.614916] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-27T18:02:35.931418] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-27T18:02:36.363537] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T18:02:36.414904] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-27T18:02:37.075377] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T18:02:37.214959] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-27T18:02:38.014988] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-10-27T18:02:38.049203] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-27T18:02:38.056304] [INFO ] [REMOTE ] CNO: Full fetch complete (60455 records). [2025-10-27T18:02:38.056417] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-27T18:02:38.057097] [FATAL] [VALIDATOR ] CNO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:02:38.057204] [FATAL] [MAIN ] CNO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:02:38.057247] [WARN ] [MAIN ] CNO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:02:38.057285] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-27T18:02:38.057344] [DEBUG] [LOCAL ] CNO: No primary data file found to delete. [2025-10-27T18:02:38.057379] [INFO ] [LOCAL ] CNO: Starting deletion of derivative data. [2025-10-27T18:02:38.057528] [DEBUG] [LOCAL ] CNO: Deleted derivative data file. [2025-10-27T18:02:38.057639] [INFO ] [MAIN ] Update Progress: 498/2366 symbols completed. CNO took 27.9s. Estimated remaining: 3h 54m 45s. Rate: 8.0 symbols/min [2025-10-27T18:02:38.222103] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:02:38.242128] [DEBUG] [LOCAL ] CNS: Loaded 21673 existing records from primary storage. [2025-10-27T18:02:38.242356] [INFO ] [MAIN ] CNS: Loaded 21673 existing records. [2025-10-27T18:02:38.416085] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:02:38.416421] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-27T18:02:38.416474] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-27T18:02:38.416674] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-10-27T18:02:38.416731] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-27T18:02:38.790919] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:02:38.816939] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-27T18:02:38.837718] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-27T18:02:39.614960] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-27T18:02:39.732149] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T18:02:40.414954] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-27T18:02:40.613015] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-27T18:02:40.861585] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T18:02:41.215025] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-27T18:02:41.885918] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-27T18:02:41.997295] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T18:02:42.014900] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-27T18:02:42.814980] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-27T18:02:43.614929] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-27T18:02:43.675122] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T18:02:43.686052] [INFO ] [REMOTE ] CNP: Full fetch complete (77556 records). [2025-10-27T18:02:43.686231] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-27T18:02:44.115009] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-27T18:02:44.115194] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-27T18:02:44.116207] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-27T18:02:44.116330] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-27T18:02:44.132712] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T18:02:44.139619] [DEBUG] [LOCAL ] CNP: Trimmed 77556 records to 53474 (keeping 200 days of data) [2025-10-27T18:02:44.427006] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-10-27T18:02:44.472404] [DEBUG] [LOCAL ] CNP: Primary data saved (53474 records). [2025-10-27T18:02:44.472534] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-27T18:02:44.473147] [INFO ] [MAIN ] Update Progress: 499/2366 symbols completed. CNP took 28.8s. Estimated remaining: 3h 54m 34s. Rate: 8.0 symbols/min [2025-10-27T18:02:44.641531] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:02:44.688986] [DEBUG] [LOCAL ] CNX: Loaded 52059 existing records from primary storage. [2025-10-27T18:02:44.689285] [INFO ] [MAIN ] CNX: Loaded 52059 existing records. [2025-10-27T18:02:44.863971] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:02:44.864170] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-27T18:02:44.864218] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-27T18:02:44.864454] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-27T18:02:44.864493] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-27T18:02:45.241302] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-27T18:02:45.246192] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:02:45.376241] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-27T18:02:46.014941] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-27T18:02:46.164170] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T18:02:46.452886] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-27T18:02:46.814950] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-27T18:02:47.289098] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T18:02:47.614928] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-27T18:02:47.758176] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-27T18:02:48.414925] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-27T18:02:49.177039] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T18:02:49.214935] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-27T18:02:50.014958] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-27T18:02:50.455790] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-27T18:02:50.618762] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-27T18:02:50.814993] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-27T18:02:51.226010] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T18:02:51.614949] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-27T18:02:52.414978] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-27T18:02:52.590012] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-27T18:02:53.128465] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T18:02:53.214910] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-27T18:02:53.328505] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-27T18:02:54.014969] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-27T18:02:54.814982] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-10-27T18:02:54.896634] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-27T18:02:55.615007] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-27T18:02:55.764443] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-27T18:02:56.313608] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-27T18:02:56.371398] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T18:02:56.414908] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-27T18:02:57.214952] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-27T18:02:58.014964] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-10-27T18:02:58.097101] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T18:02:58.108205] [INFO ] [REMOTE ] CNQ: Full fetch complete (77352 records). [2025-10-27T18:02:58.108371] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-27T18:02:58.109319] [FATAL] [VALIDATOR ] CNQ: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:02:58.109416] [FATAL] [MAIN ] CNQ: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:02:58.109467] [WARN ] [MAIN ] CNQ: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:02:58.109530] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-27T18:02:58.109596] [DEBUG] [LOCAL ] CNQ: No primary data file found to delete. [2025-10-27T18:02:58.109632] [INFO ] [LOCAL ] CNQ: Starting deletion of derivative data. [2025-10-27T18:02:58.109897] [DEBUG] [LOCAL ] CNQ: Deleted derivative data file. [2025-10-27T18:02:58.110383] [INFO ] [MAIN ] Update Progress: 500/2366 symbols completed. CNQ took 40.6s. Estimated remaining: 3h 54m 49s. Rate: 7.9 symbols/min [2025-10-27T18:02:58.282138] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:02:58.322375] [DEBUG] [LOCAL ] CODI: Loaded 42561 existing records from primary storage. [2025-10-27T18:02:58.322688] [INFO ] [MAIN ] CODI: Loaded 42561 existing records. [2025-10-27T18:02:58.511246] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:02:58.511695] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-27T18:02:58.511823] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-27T18:02:58.512160] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-27T18:02:58.512248] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-27T18:02:58.815582] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-27T18:02:58.840270] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T18:02:58.927550] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:02:59.250564] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T18:02:59.582941] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-27T18:02:59.614898] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-27T18:03:00.414930] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-27T18:03:01.215046] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-27T18:03:01.996747] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-27T18:03:02.003770] [INFO ] [REMOTE ] CNS: Full fetch complete (31666 records). [2025-10-27T18:03:02.003976] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-27T18:03:02.039090] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-10-27T18:03:02.397235] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-10-27T18:03:02.397329] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-10-27T18:03:02.397972] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-10-27T18:03:02.398036] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-10-27T18:03:02.398966] [DEBUG] [LOCAL ] CNS: Trimmed 31666 records to 21224 (keeping 200 days of data) [2025-10-27T18:03:02.529159] [DEBUG] [LOCAL ] CNS: Primary data saved (21224 records). [2025-10-27T18:03:02.529281] [INFO ] [MAIN ] CNS: Full history saved. [2025-10-27T18:03:02.529356] [INFO ] [MAIN ] Update Progress: 501/2366 symbols completed. CNS took 24.5s. Estimated remaining: 3h 54m 30s. Rate: 8.0 symbols/min [2025-10-27T18:03:02.699468] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:03:02.750162] [DEBUG] [LOCAL ] COF: Loaded 54405 existing records from primary storage. [2025-10-27T18:03:02.750466] [INFO ] [MAIN ] COF: Loaded 54405 existing records. [2025-10-27T18:03:02.926281] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:03:02.926502] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-27T18:03:02.926549] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-27T18:03:02.926777] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-27T18:03:02.926835] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-27T18:03:03.275286] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:03:03.275588] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-27T18:03:06.098701] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (5.68 seconds). [2025-10-27T18:03:06.110129] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-27T18:03:06.139325] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (4.10 seconds). [2025-10-27T18:03:06.148519] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-10-27T18:03:06.652986] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (3.38 seconds). [2025-10-27T18:03:06.663413] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-27T18:03:07.382824] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-27T18:03:07.394802] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-10. [2025-10-27T18:03:07.830356] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T18:03:07.840993] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-27T18:03:08.355875] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-27T18:03:08.365774] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-27T18:03:09.070120] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T18:03:09.078446] [INFO ] [REMOTE ] CNR: Full fetch complete (63485 records). [2025-10-27T18:03:09.078550] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-10-27T18:03:09.079255] [FATAL] [VALIDATOR ] CNR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:03:09.079339] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:03:09.079380] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:03:09.079417] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-27T18:03:09.079471] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-27T18:03:09.079505] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-27T18:03:09.079542] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-27T18:03:09.079594] [INFO ] [MAIN ] Update Progress: 502/2366 symbols completed. CNR took 42.8s. Estimated remaining: 3h 54m 18s. Rate: 8.0 symbols/min [2025-10-27T18:03:09.260361] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:03:09.278004] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (8.06 seconds). [2025-10-27T18:03:09.283558] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-27T18:03:09.338877] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T18:03:09.366257] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-27T18:03:09.369423] [DEBUG] [LOCAL ] COHR: Loaded 54156 existing records from primary storage. [2025-10-27T18:03:09.369912] [INFO ] [MAIN ] COHR: Loaded 54156 existing records. [2025-10-27T18:03:09.555686] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:03:09.555887] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-27T18:03:09.555935] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-27T18:03:09.556123] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-27T18:03:09.556163] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-27T18:03:09.918048] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:03:09.982126] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-27T18:03:10.014928] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-27T18:03:10.194160] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-27T18:03:10.824192] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-27T18:03:10.828447] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T18:03:11.201395] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-27T18:03:11.211092] [INFO ] [REMOTE ] CNX: Full fetch complete (74887 records). [2025-10-27T18:03:11.211208] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-27T18:03:11.602479] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-27T18:03:11.602574] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-27T18:03:11.603560] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-27T18:03:11.603623] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-27T18:03:11.605210] [DEBUG] [LOCAL ] CNX: Trimmed 74887 records to 51282 (keeping 200 days of data) [2025-10-27T18:03:11.652127] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-27T18:03:11.896123] [DEBUG] [LOCAL ] CNX: Primary data saved (51282 records). [2025-10-27T18:03:11.896253] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-27T18:03:11.896926] [INFO ] [MAIN ] Update Progress: 503/2366 symbols completed. CNX took 27.4s. Estimated remaining: 3h 53m 53s. Rate: 8.0 symbols/min [2025-10-27T18:03:12.065434] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:03:12.117725] [DEBUG] [LOCAL ] COLD: Loaded 53264 existing records from primary storage. [2025-10-27T18:03:12.118054] [INFO ] [MAIN ] COLD: Loaded 53264 existing records. [2025-10-27T18:03:12.296095] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:03:12.296314] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-27T18:03:12.296360] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-27T18:03:12.296543] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-27T18:03:12.296582] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-27T18:03:12.420048] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-27T18:03:12.665911] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:03:12.756051] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-27T18:03:13.149039] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T18:03:13.214965] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-27T18:03:14.014967] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-27T18:03:14.360510] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-27T18:03:14.582926] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-27T18:03:14.814925] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-27T18:03:15.627165] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-27T18:03:15.629929] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T18:03:16.414980] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-27T18:03:17.221666] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-27T18:03:17.224196] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-27T18:03:17.434727] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-27T18:03:18.014916] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-27T18:03:18.152045] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-27T18:03:18.530099] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T18:03:18.814963] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-27T18:03:19.442967] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-27T18:03:19.614954] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-27T18:03:20.414966] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-27T18:03:20.765684] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-27T18:03:21.214918] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-27T18:03:21.274271] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T18:03:22.014940] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-27T18:03:22.113062] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T18:03:22.814959] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-27T18:03:23.061486] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-27T18:03:23.614907] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-27T18:03:23.879314] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T18:03:24.236359] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T18:03:24.415002] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-27T18:03:25.214985] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-27T18:03:25.685956] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-27T18:03:25.845978] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T18:03:26.014929] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-27T18:03:26.421310] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T18:03:26.814926] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-27T18:03:27.143844] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T18:03:27.154076] [INFO ] [REMOTE ] COF: Full fetch complete (77718 records). [2025-10-27T18:03:27.154263] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-27T18:03:27.551920] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-27T18:03:27.552050] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-27T18:03:27.553022] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-27T18:03:27.553096] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-27T18:03:27.554689] [DEBUG] [LOCAL ] COF: Trimmed 77718 records to 53625 (keeping 200 days of data) [2025-10-27T18:03:27.621753] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-27T18:03:27.888980] [DEBUG] [LOCAL ] COF: Primary data saved (53625 records). [2025-10-27T18:03:27.889118] [INFO ] [MAIN ] COF: Full history saved. [2025-10-27T18:03:27.889867] [INFO ] [MAIN ] Update Progress: 504/2366 symbols completed. COF took 25.4s. Estimated remaining: 3h 54m 17s. Rate: 7.9 symbols/min [2025-10-27T18:03:28.068063] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:03:28.121891] [DEBUG] [LOCAL ] COMP: Loaded 54183 existing records from primary storage. [2025-10-27T18:03:28.122224] [INFO ] [MAIN ] COMP: Loaded 54183 existing records. [2025-10-27T18:03:28.307497] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:03:28.307965] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-27T18:03:28.308104] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-27T18:03:28.308418] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-27T18:03:28.308479] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-27T18:03:28.439312] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-27T18:03:28.436090] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T18:03:28.699751] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:03:29.084409] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T18:03:29.214916] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-27T18:03:30.014915] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-27T18:03:30.227033] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-27T18:03:30.450812] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T18:03:30.814977] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-27T18:03:31.260348] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T18:03:31.615036] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-27T18:03:32.348830] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T18:03:32.357711] [INFO ] [REMOTE ] CODI: Full fetch complete (54332 records). [2025-10-27T18:03:32.357842] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-27T18:03:32.420219] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-27T18:03:32.748591] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-27T18:03:32.748710] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-27T18:03:32.749361] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-27T18:03:32.749403] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-27T18:03:32.750564] [DEBUG] [LOCAL ] CODI: Trimmed 54332 records to 41978 (keeping 200 days of data) [2025-10-27T18:03:33.017723] [DEBUG] [LOCAL ] CODI: Primary data saved (41978 records). [2025-10-27T18:03:33.018283] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-27T18:03:33.019543] [INFO ] [MAIN ] Update Progress: 505/2366 symbols completed. CODI took 34.9s. Estimated remaining: 3h 54m 1s. Rate: 8.0 symbols/min [2025-10-27T18:03:33.019358] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T18:03:33.205154] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:03:33.215015] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-27T18:03:33.244562] [DEBUG] [LOCAL ] CON: Loaded 39266 existing records from primary storage. [2025-10-27T18:03:33.244871] [INFO ] [MAIN ] CON: Loaded 39266 existing records. [2025-10-27T18:03:33.433543] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:03:33.433761] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-27T18:03:33.433809] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-27T18:03:33.434051] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-27T18:03:33.434115] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-27T18:03:33.798326] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:03:34.014946] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-27T18:03:34.133057] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T18:03:34.815011] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-27T18:03:34.877573] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T18:03:35.311814] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-27T18:03:35.615027] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-27T18:03:36.414962] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-27T18:03:36.735530] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-27T18:03:36.824303] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T18:03:37.214935] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-27T18:03:37.819155] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T18:03:38.014985] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-27T18:03:38.764397] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T18:03:38.814933] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-27T18:03:39.167771] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T18:03:39.614946] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-27T18:03:40.414999] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-27T18:03:41.103009] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T18:03:41.214966] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-27T18:03:41.272998] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-27T18:03:41.283379] [INFO ] [REMOTE ] COHR: Full fetch complete (77475 records). [2025-10-27T18:03:41.283546] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-27T18:03:41.671987] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-27T18:03:41.672069] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-27T18:03:41.672939] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-27T18:03:41.673001] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-27T18:03:41.674354] [DEBUG] [LOCAL ] COHR: Trimmed 77475 records to 53376 (keeping 200 days of data) [2025-10-27T18:03:41.986946] [DEBUG] [LOCAL ] COHR: Primary data saved (53376 records). [2025-10-27T18:03:41.987140] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-27T18:03:41.987278] [INFO ] [MAIN ] Update Progress: 506/2366 symbols completed. COHR took 32.9s. Estimated remaining: 3h 53m 58s. Rate: 7.9 symbols/min [2025-10-27T18:03:42.029714] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-27T18:03:42.193727] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-27T18:03:42.191954] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:03:42.226617] [DEBUG] [LOCAL ] COOK: Loaded 25105 existing records from primary storage. [2025-10-27T18:03:42.226892] [INFO ] [MAIN ] COOK: Loaded 25105 existing records. [2025-10-27T18:03:42.400299] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:03:42.400487] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-27T18:03:42.400532] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-27T18:03:42.400744] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-27T18:03:42.400799] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-27T18:03:42.777931] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:03:42.800558] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T18:03:42.814903] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-27T18:03:43.614961] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-27T18:03:44.149436] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-27T18:03:44.415037] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-27T18:03:44.561839] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-27T18:03:45.215026] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-27T18:03:45.804792] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-27T18:03:45.815097] [INFO ] [REMOTE ] COLD: Full fetch complete (75002 records). [2025-10-27T18:03:45.815219] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-27T18:03:46.020203] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-27T18:03:46.161307] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-27T18:03:46.236035] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-27T18:03:46.236166] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-27T18:03:46.237011] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-27T18:03:46.237104] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-27T18:03:46.238794] [DEBUG] [LOCAL ] COLD: Trimmed 75002 records to 52495 (keeping 200 days of data) [2025-10-27T18:03:46.473550] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T18:03:46.592390] [DEBUG] [LOCAL ] COLD: Primary data saved (52495 records). [2025-10-27T18:03:46.592530] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-27T18:03:46.593246] [INFO ] [MAIN ] Update Progress: 507/2366 symbols completed. COLD took 34.7s. Estimated remaining: 3h 53m 40s. Rate: 8.0 symbols/min [2025-10-27T18:03:46.769306] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:03:46.818137] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-27T18:03:46.820264] [DEBUG] [LOCAL ] COP: Loaded 54507 existing records from primary storage. [2025-10-27T18:03:46.820749] [INFO ] [MAIN ] COP: Loaded 54507 existing records. [2025-10-27T18:03:47.007886] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:03:47.008091] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-27T18:03:47.008142] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-27T18:03:47.008446] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-27T18:03:47.008507] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-27T18:03:47.374623] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:03:47.614936] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-27T18:03:47.902535] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-27T18:03:48.087785] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T18:03:48.414936] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-27T18:03:49.214942] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-27T18:03:49.501740] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-27T18:03:49.721009] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T18:03:50.014991] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-27T18:03:50.814906] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-27T18:03:50.914215] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T18:03:51.339313] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-27T18:03:51.614914] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-27T18:03:51.823922] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-27T18:03:52.414913] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-27T18:03:52.866949] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T18:03:53.214945] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-27T18:03:54.014940] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-27T18:03:54.132150] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T18:03:54.242212] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-27T18:03:54.814998] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-27T18:03:55.556241] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-27T18:03:55.614947] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-27T18:03:55.926847] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-27T18:03:56.414933] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-27T18:03:57.214981] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-27T18:03:57.254181] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-27T18:03:57.261534] [INFO ] [REMOTE ] CON: Full fetch complete (56596 records). [2025-10-27T18:03:57.261667] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-27T18:03:57.633041] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-27T18:03:57.633127] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-27T18:03:57.633924] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-27T18:03:57.633989] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-27T18:03:57.635197] [DEBUG] [LOCAL ] CON: Trimmed 56596 records to 38586 (keeping 200 days of data) [2025-10-27T18:03:57.862350] [DEBUG] [LOCAL ] CON: Primary data saved (38586 records). [2025-10-27T18:03:57.862522] [INFO ] [MAIN ] CON: Full history saved. [2025-10-27T18:03:57.862631] [INFO ] [MAIN ] Update Progress: 508/2366 symbols completed. CON took 24.8s. Estimated remaining: 3h 53m 46s. Rate: 7.9 symbols/min [2025-10-27T18:03:58.019865] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-27T18:03:58.050839] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:03:58.068560] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T18:03:58.122033] [DEBUG] [LOCAL ] COR: Loaded 46834 existing records from primary storage. [2025-10-27T18:03:58.122364] [INFO ] [MAIN ] COR: Loaded 46834 existing records. [2025-10-27T18:03:58.299299] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:03:58.299498] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-27T18:03:58.299544] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-27T18:03:58.299873] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-27T18:03:58.299929] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-27T18:03:58.630470] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T18:03:58.674947] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:03:58.814910] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-27T18:03:59.614941] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-27T18:04:00.113277] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-27T18:04:00.258213] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T18:04:00.414916] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-27T18:04:01.215024] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-27T18:04:02.015147] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-27T18:04:02.095514] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-27T18:04:02.814980] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-27T18:04:05.493029] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-27T18:04:05.499272] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-27T18:04:05.647210] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (5.23 seconds). [2025-10-27T18:04:05.659530] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-27T18:04:06.168930] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (4.15 seconds). [2025-10-27T18:04:06.180221] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-27T18:04:06.314701] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (5.10 seconds). [2025-10-27T18:04:06.323986] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-27T18:04:07.694564] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-27T18:04:07.706115] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-27T18:04:07.926164] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-27T18:04:07.938563] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-27T18:04:07.966790] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T18:04:08.414969] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-27T18:04:08.567417] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-27T18:04:08.705533] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-27T18:04:09.214953] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-27T18:04:09.948391] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T18:04:10.014953] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-27T18:04:10.116819] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-27T18:04:10.814949] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-27T18:04:10.945750] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T18:04:10.956334] [INFO ] [REMOTE ] COMP: Full fetch complete (77413 records). [2025-10-27T18:04:10.956475] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-27T18:04:11.344055] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-27T18:04:11.344134] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-27T18:04:11.344966] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-27T18:04:11.345029] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-27T18:04:11.346512] [DEBUG] [LOCAL ] COMP: Trimmed 77413 records to 53399 (keeping 200 days of data) [2025-10-27T18:04:11.626032] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-27T18:04:11.649234] [DEBUG] [LOCAL ] COMP: Primary data saved (53399 records). [2025-10-27T18:04:11.650727] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-27T18:04:11.650833] [INFO ] [MAIN ] Update Progress: 509/2366 symbols completed. COMP took 43.8s. Estimated remaining: 3h 54m 1s. Rate: 7.9 symbols/min [2025-10-27T18:04:11.825452] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:04:11.902459] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-27T18:04:11.904746] [DEBUG] [LOCAL ] COTY: Loaded 54031 existing records from primary storage. [2025-10-27T18:04:11.915162] [INFO ] [MAIN ] COTY: Loaded 54031 existing records. [2025-10-27T18:04:12.093853] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:04:12.094056] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-27T18:04:12.094104] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-27T18:04:12.094304] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-27T18:04:12.094358] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-27T18:04:12.423165] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-27T18:04:12.446872] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:04:12.769058] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T18:04:12.773840] [INFO ] [REMOTE ] COOK: Full fetch complete (32999 records). [2025-10-27T18:04:12.773919] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-27T18:04:12.774398] [FATAL] [VALIDATOR ] COOK: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:04:12.774479] [FATAL] [MAIN ] COOK: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:04:12.774521] [WARN ] [MAIN ] COOK: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:04:12.774558] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-27T18:04:12.774612] [DEBUG] [LOCAL ] COOK: No primary data file found to delete. [2025-10-27T18:04:12.774668] [INFO ] [LOCAL ] COOK: Starting deletion of derivative data. [2025-10-27T18:04:12.774816] [DEBUG] [LOCAL ] COOK: Deleted derivative data file. [2025-10-27T18:04:12.774882] [INFO ] [MAIN ] Update Progress: 510/2366 symbols completed. COOK took 30.8s. Estimated remaining: 3h 53m 30s. Rate: 7.9 symbols/min [2025-10-27T18:04:12.944096] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:04:12.976125] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-27T18:04:13.025308] [DEBUG] [LOCAL ] COUR: Loaded 50179 existing records from primary storage. [2025-10-27T18:04:13.025622] [INFO ] [MAIN ] COUR: Loaded 50179 existing records. [2025-10-27T18:04:13.201103] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:04:13.201299] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-27T18:04:13.201345] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-27T18:04:13.201520] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-27T18:04:13.201560] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-27T18:04:13.221541] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-27T18:04:13.553044] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:04:14.014971] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-27T18:04:14.163106] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-27T18:04:14.814974] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-27T18:04:15.296554] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-27T18:04:15.615167] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-27T18:04:15.618045] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T18:04:16.332304] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T18:04:16.414952] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-27T18:04:17.214919] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-27T18:04:17.406450] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-27T18:04:17.776810] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T18:04:17.789842] [INFO ] [REMOTE ] COP: Full fetch complete (77516 records). [2025-10-27T18:04:17.790013] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-27T18:04:17.790940] [FATAL] [VALIDATOR ] COP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:04:17.791057] [FATAL] [MAIN ] COP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:04:17.791150] [WARN ] [MAIN ] COP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:04:17.791241] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-27T18:04:17.791325] [DEBUG] [LOCAL ] COP: No primary data file found to delete. [2025-10-27T18:04:17.791362] [INFO ] [LOCAL ] COP: Starting deletion of derivative data. [2025-10-27T18:04:17.791478] [DEBUG] [LOCAL ] COP: Deleted derivative data file. [2025-10-27T18:04:17.791972] [INFO ] [MAIN ] Update Progress: 511/2366 symbols completed. COP took 31.2s. Estimated remaining: 3h 53m 14s. Rate: 8.0 symbols/min [2025-10-27T18:04:17.983984] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:04:18.014951] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-27T18:04:18.037373] [DEBUG] [LOCAL ] CP: Loaded 53992 existing records from primary storage. [2025-10-27T18:04:18.037769] [INFO ] [MAIN ] CP: Loaded 53992 existing records. [2025-10-27T18:04:18.221203] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:04:18.221587] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-27T18:04:18.221710] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-27T18:04:18.222046] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-27T18:04:18.222104] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-27T18:04:18.487937] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-27T18:04:18.642724] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:04:18.814918] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-27T18:04:19.257842] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T18:04:19.614993] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-27T18:04:20.307556] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T18:04:20.414928] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-27T18:04:21.188451] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T18:04:21.214902] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-27T18:04:21.840351] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T18:04:22.014938] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-27T18:04:22.675768] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T18:04:22.814963] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-27T18:04:23.614978] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-27T18:04:23.672857] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T18:04:24.196887] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T18:04:24.414931] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-27T18:04:25.214926] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-27T18:04:25.278712] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T18:04:26.015027] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-27T18:04:26.821322] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-27T18:04:26.827748] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-27T18:04:27.447485] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (3.03 seconds). [2025-10-27T18:04:27.533006] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T18:04:27.615009] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-27T18:04:28.267823] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T18:04:28.414951] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-27T18:04:29.215000] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-27T18:04:29.441331] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-27T18:04:29.512413] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T18:04:30.015010] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-27T18:04:30.815003] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-27T18:04:31.191325] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-27T18:04:31.613030] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-27T18:04:31.616955] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-27T18:04:32.085229] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T18:04:32.093995] [INFO ] [REMOTE ] COR: Full fetch complete (68235 records). [2025-10-27T18:04:32.094187] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-27T18:04:32.420192] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-27T18:04:32.503636] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-27T18:04:32.503797] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-27T18:04:32.504891] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-27T18:04:32.504965] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-27T18:04:32.507080] [DEBUG] [LOCAL ] COR: Trimmed 68235 records to 45968 (keeping 200 days of data) [2025-10-27T18:04:32.846472] [DEBUG] [LOCAL ] COR: Primary data saved (45968 records). [2025-10-27T18:04:32.846931] [INFO ] [MAIN ] COR: Full history saved. [2025-10-27T18:04:32.847843] [INFO ] [MAIN ] Update Progress: 512/2366 symbols completed. COR took 35.0s. Estimated remaining: 3h 53m 33s. Rate: 7.9 symbols/min [2025-10-27T18:04:33.007358] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T18:04:33.090240] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:04:33.121855] [DEBUG] [LOCAL ] CPA: Loaded 28029 existing records from primary storage. [2025-10-27T18:04:33.122212] [INFO ] [MAIN ] CPA: Loaded 28029 existing records. [2025-10-27T18:04:33.224046] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-27T18:04:33.311869] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:04:33.312210] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-27T18:04:33.312263] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-27T18:04:33.312705] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-27T18:04:33.312766] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-27T18:04:33.690131] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:04:34.014921] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-27T18:04:34.267193] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-27T18:04:34.671419] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T18:04:34.814939] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-27T18:04:35.614933] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-27T18:04:35.843471] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-27T18:04:36.204771] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-27T18:04:36.414983] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-27T18:04:37.214915] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-27T18:04:37.543566] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-27T18:04:37.971761] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-27T18:04:38.014908] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-27T18:04:38.682849] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T18:04:38.814928] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-27T18:04:39.553707] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-27T18:04:39.563289] [INFO ] [REMOTE ] CP: Full fetch complete (76900 records). [2025-10-27T18:04:39.563404] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-27T18:04:39.564190] [FATAL] [VALIDATOR ] CP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:04:39.564279] [FATAL] [MAIN ] CP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:04:39.564320] [WARN ] [MAIN ] CP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:04:39.564383] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-27T18:04:39.564446] [DEBUG] [LOCAL ] CP: No primary data file found to delete. [2025-10-27T18:04:39.564480] [INFO ] [LOCAL ] CP: Starting deletion of derivative data. [2025-10-27T18:04:39.564633] [DEBUG] [LOCAL ] CP: Deleted derivative data file. [2025-10-27T18:04:39.565130] [INFO ] [MAIN ] Update Progress: 513/2366 symbols completed. CP took 21.8s. Estimated remaining: 3h 53m 23s. Rate: 7.9 symbols/min [2025-10-27T18:04:39.627013] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-27T18:04:39.733104] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:04:39.733260] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-27T18:04:39.733296] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-27T18:04:39.733402] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-27T18:04:39.733441] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-27T18:04:39.733480] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-27T18:04:39.733511] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-27T18:04:40.079508] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:04:40.414970] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-27T18:04:40.828989] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-27T18:04:40.839601] [INFO ] [REMOTE ] COUR: Full fetch complete (71310 records). [2025-10-27T18:04:40.839806] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-27T18:04:41.216239] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-27T18:04:41.237892] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-27T18:04:41.237978] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-27T18:04:41.238807] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-27T18:04:41.238972] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-27T18:04:41.240444] [DEBUG] [LOCAL ] COUR: Trimmed 71310 records to 49420 (keeping 200 days of data) [2025-10-27T18:04:41.426939] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T18:04:41.543349] [DEBUG] [LOCAL ] COUR: Primary data saved (49420 records). [2025-10-27T18:04:41.543491] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-27T18:04:41.543574] [INFO ] [MAIN ] Update Progress: 514/2366 symbols completed. COUR took 28.8s. Estimated remaining: 3h 52m 55s. Rate: 8.0 symbols/min [2025-10-27T18:04:41.717619] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:04:41.747763] [DEBUG] [LOCAL ] CPAY: Loaded 30364 existing records from primary storage. [2025-10-27T18:04:41.748313] [INFO ] [MAIN ] CPAY: Loaded 30364 existing records. [2025-10-27T18:04:41.793452] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T18:04:41.933406] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:04:41.933989] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-27T18:04:41.934263] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-27T18:04:41.935224] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-27T18:04:41.935283] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-27T18:04:42.020075] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-27T18:04:42.073751] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-27T18:04:42.330586] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:04:42.470018] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-27T18:04:42.814974] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-27T18:04:43.614968] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-27T18:04:43.902296] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-27T18:04:44.415003] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-27T18:04:44.776734] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-27T18:04:45.057633] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T18:04:45.214913] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-27T18:04:46.014998] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-27T18:04:46.782419] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T18:04:46.794260] [INFO ] [REMOTE ] COTY: Full fetch complete (77278 records). [2025-10-27T18:04:46.794422] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-27T18:04:46.825255] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-27T18:04:47.194570] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-27T18:04:47.194691] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-27T18:04:47.195603] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-27T18:04:47.195746] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-27T18:04:47.213207] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-27T18:04:47.219941] [DEBUG] [LOCAL ] COTY: Trimmed 77278 records to 53247 (keeping 200 days of data) [2025-10-27T18:04:47.506000] [DEBUG] [LOCAL ] COTY: Primary data saved (53247 records). [2025-10-27T18:04:47.506130] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-27T18:04:47.506207] [INFO ] [MAIN ] Update Progress: 515/2366 symbols completed. COTY took 35.9s. Estimated remaining: 3h 52m 42s. Rate: 8.0 symbols/min [2025-10-27T18:04:47.620109] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-27T18:04:47.685507] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:04:47.700256] [DEBUG] [LOCAL ] CPF: Loaded 15344 existing records from primary storage. [2025-10-27T18:04:47.700499] [INFO ] [MAIN ] CPF: Loaded 15344 existing records. [2025-10-27T18:04:47.918961] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:04:47.919519] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-27T18:04:47.919747] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-27T18:04:47.920115] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-27T18:04:47.920181] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-27T18:04:48.094730] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T18:04:48.292167] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:04:48.414949] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-27T18:04:48.841293] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-27T18:04:49.012275] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T18:04:49.214944] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-27T18:04:50.014988] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-27T18:04:50.379570] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T18:04:50.814958] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-27T18:04:51.372719] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-27T18:04:51.390969] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T18:04:51.614956] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-27T18:04:52.414985] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-27T18:04:52.632982] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-27T18:04:52.869566] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T18:04:53.214956] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-27T18:04:54.015000] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-27T18:04:54.339847] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-27T18:04:54.381719] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T18:04:54.814992] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-27T18:04:55.417218] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T18:04:55.614997] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-27T18:04:56.414990] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-27T18:04:56.443114] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-27T18:04:57.214937] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-27T18:04:57.559704] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-27T18:04:57.560857] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T18:04:58.014961] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-27T18:04:58.814948] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-27T18:04:59.374079] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-27T18:04:59.555124] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-27T18:04:59.614937] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-27T18:05:00.414978] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-27T18:05:01.214924] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-27T18:05:01.526975] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-27T18:05:02.014955] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-27T18:05:02.814991] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-27T18:05:02.934667] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-27T18:05:02.935565] [INFO ] [REMOTE ] CPAC: Full fetch complete (1799 records). [2025-10-27T18:05:02.935633] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-27T18:05:03.134239] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-27T18:05:03.134430] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:05:03.134498] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:05:03.134569] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-27T18:05:03.134633] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-27T18:05:03.134716] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-27T18:05:03.134806] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-27T18:05:03.134898] [INFO ] [MAIN ] Update Progress: 516/2366 symbols completed. CPAC took 23.6s. Estimated remaining: 3h 53m 3s. Rate: 7.9 symbols/min [2025-10-27T18:05:03.321602] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:05:03.338859] [DEBUG] [LOCAL ] CPK: Loaded 14093 existing records from primary storage. [2025-10-27T18:05:03.339100] [INFO ] [MAIN ] CPK: Loaded 14093 existing records. [2025-10-27T18:05:03.518263] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:05:03.518466] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-27T18:05:03.518511] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-27T18:05:03.518703] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-27T18:05:03.518758] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-27T18:05:03.874137] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:05:03.874470] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-27T18:05:04.085264] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-10-27T18:05:04.102929] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-27T18:05:04.414948] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-27T18:05:04.978596] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-27T18:05:05.214953] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-27T18:05:05.558318] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-27T18:05:05.583673] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T18:05:06.014986] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-27T18:05:06.606611] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-27T18:05:06.814963] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-27T18:05:07.493707] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T18:05:07.507239] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-27T18:05:07.614936] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-27T18:05:08.414950] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-27T18:05:08.665879] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-27T18:05:09.214909] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-27T18:05:09.283563] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-27T18:05:10.014910] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-27T18:05:10.178446] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-27T18:05:10.785606] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-27T18:05:10.814898] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-27T18:05:11.614915] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-27T18:05:11.758952] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-27T18:05:12.414905] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-27T18:05:12.507726] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-27T18:05:13.214930] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-27T18:05:13.426329] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-27T18:05:13.431111] [INFO ] [REMOTE ] CPA: Full fetch complete (40990 records). [2025-10-27T18:05:13.431207] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-27T18:05:13.820758] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-27T18:05:13.820834] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-27T18:05:13.821362] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-27T18:05:13.821401] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-27T18:05:13.822339] [DEBUG] [LOCAL ] CPA: Trimmed 40990 records to 27383 (keeping 200 days of data) [2025-10-27T18:05:13.990099] [DEBUG] [LOCAL ] CPA: Primary data saved (27383 records). [2025-10-27T18:05:13.990284] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-27T18:05:13.990373] [INFO ] [MAIN ] Update Progress: 517/2366 symbols completed. CPA took 41.1s. Estimated remaining: 3h 53m 7s. Rate: 7.9 symbols/min [2025-10-27T18:05:14.014998] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-27T18:05:14.122251] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T18:05:14.723637] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T18:05:14.814990] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-27T18:05:15.476089] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T18:05:15.614956] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-27T18:05:16.139251] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-27T18:05:16.415013] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-27T18:05:17.214954] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-27T18:05:17.783981] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-27T18:05:17.822128] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T18:05:18.014905] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-27T18:05:18.814930] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-27T18:05:19.035377] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-27T18:05:19.614899] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-27T18:05:19.897511] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T18:05:19.900939] [INFO ] [REMOTE ] CPF: Full fetch complete (23129 records). [2025-10-27T18:05:19.901011] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-27T18:05:20.256588] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-27T18:05:20.256712] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-27T18:05:20.257119] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-27T18:05:20.257177] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-27T18:05:20.257758] [DEBUG] [LOCAL ] CPF: Trimmed 23129 records to 14882 (keeping 200 days of data) [2025-10-27T18:05:20.343286] [DEBUG] [LOCAL ] CPF: Primary data saved (14882 records). [2025-10-27T18:05:20.343417] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-27T18:05:20.343495] [INFO ] [MAIN ] Update Progress: 518/2366 symbols completed. CPF took 32.8s. Estimated remaining: 3h 52m 55s. Rate: 7.9 symbols/min [2025-10-27T18:05:20.414984] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-27T18:05:20.480691] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T18:05:20.484235] [INFO ] [REMOTE ] CPK: Full fetch complete (18867 records). [2025-10-27T18:05:20.484305] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-27T18:05:20.834779] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-27T18:05:20.834851] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-27T18:05:20.835163] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-27T18:05:20.835200] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-27T18:05:20.835729] [DEBUG] [LOCAL ] CPK: Trimmed 18867 records to 13687 (keeping 200 days of data) [2025-10-27T18:05:20.917442] [DEBUG] [LOCAL ] CPK: Primary data saved (13687 records). [2025-10-27T18:05:20.917566] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-27T18:05:20.917639] [INFO ] [MAIN ] Update Progress: 519/2366 symbols completed. CPK took 17.8s. Estimated remaining: 3h 52m 23s. Rate: 7.9 symbols/min [2025-10-27T18:05:21.835675] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T18:05:21.842489] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-27T18:05:23.178235] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-27T18:05:23.183599] [INFO ] [REMOTE ] CPAY: Full fetch complete (44488 records). [2025-10-27T18:05:23.183718] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-27T18:05:23.566778] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-27T18:05:23.566851] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-27T18:05:23.567438] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-27T18:05:23.567499] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-27T18:05:23.568370] [DEBUG] [LOCAL ] CPAY: Trimmed 44488 records to 29565 (keeping 200 days of data) [2025-10-27T18:05:23.738145] [DEBUG] [LOCAL ] CPAY: Primary data saved (29565 records). [2025-10-27T18:05:23.738269] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-27T18:05:23.738344] [INFO ] [MAIN ] Update Progress: 520/2366 symbols completed. CPAY took 42.2s. Estimated remaining: 3h 51m 59s. Rate: 8.0 symbols/min [2025-10-27T18:05:24.310592] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:05:24.439185] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:05:24.436355] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:05:24.440618] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:05:24.467168] [DEBUG] [LOCAL ] CPS: Loaded 25186 existing records from primary storage. [2025-10-27T18:05:24.467587] [INFO ] [MAIN ] CPS: Loaded 25186 existing records. [2025-10-27T18:05:24.630141] [DEBUG] [LOCAL ] CPRI: Loaded 53146 existing records from primary storage. [2025-10-27T18:05:24.682194] [INFO ] [MAIN ] CPRI: Loaded 53146 existing records. [2025-10-27T18:05:24.706061] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:05:24.718249] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-27T18:05:24.738610] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-27T18:05:24.780635] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-27T18:05:24.787031] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-27T18:05:24.862760] [DEBUG] [LOCAL ] CPNG: Loaded 54459 existing records from primary storage. [2025-10-27T18:05:24.899457] [INFO ] [MAIN ] CPNG: Loaded 54459 existing records. [2025-10-27T18:05:24.894163] [DEBUG] [LOCAL ] CPT: Loaded 45157 existing records from primary storage. [2025-10-27T18:05:24.968266] [INFO ] [MAIN ] CPT: Loaded 45157 existing records. [2025-10-27T18:05:25.293129] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:05:25.397838] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-27T18:05:25.428038] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:05:25.428168] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-27T18:05:25.445496] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-27T18:05:25.459535] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-27T18:05:25.459619] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-27T18:05:25.480434] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-27T18:05:25.501125] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-27T18:05:25.522494] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-27T18:05:25.693034] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:05:25.771755] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-27T18:05:25.803772] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-27T18:05:25.841924] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-27T18:05:25.899468] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-27T18:05:26.097869] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:05:26.158808] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-27T18:05:26.722250] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:05:26.727897] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-27T18:05:26.794219] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:05:26.852009] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:05:26.852511] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-27T18:05:26.846836] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-27T18:05:27.578308] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T18:05:27.583365] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-27T18:05:28.119622] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T18:05:28.128253] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-27T18:05:28.418410] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T18:05:28.429404] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-27T18:05:28.445370] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T18:05:28.451157] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-27T18:05:28.590374] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-27T18:05:28.600507] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-27T18:05:29.301397] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-27T18:05:29.307557] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-27T18:05:29.824087] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-27T18:05:30.014964] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-27T18:05:30.140818] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-27T18:05:30.206252] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-27T18:05:30.677549] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-27T18:05:30.814914] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-27T18:05:31.614922] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-27T18:05:31.657731] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T18:05:32.206954] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T18:05:32.414949] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-27T18:05:32.708161] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-27T18:05:33.214946] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-27T18:05:34.014920] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-27T18:05:34.339110] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-27T18:05:34.377920] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-27T18:05:34.814954] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-27T18:05:35.536172] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T18:05:35.559681] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-27T18:05:35.614920] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-27T18:05:36.414946] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-27T18:05:37.150462] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-27T18:05:37.214903] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-27T18:05:37.270336] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-27T18:05:38.015245] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-27T18:05:38.020042] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T18:05:38.814994] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-27T18:05:39.621462] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-27T18:05:39.626219] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-27T18:05:40.319789] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T18:05:40.414912] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-27T18:05:41.214994] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-27T18:05:41.706932] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T18:05:41.711184] [INFO ] [REMOTE ] CPS: Full fetch complete (36476 records). [2025-10-27T18:05:41.711264] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-27T18:05:42.029494] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-27T18:05:42.138742] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-27T18:05:42.138873] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-27T18:05:42.149583] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-27T18:05:42.151305] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-27T18:05:42.151859] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-27T18:05:42.153512] [DEBUG] [LOCAL ] CPS: Trimmed 36476 records to 24342 (keeping 200 days of data) [2025-10-27T18:05:42.320923] [DEBUG] [LOCAL ] CPS: Primary data saved (24342 records). [2025-10-27T18:05:42.321070] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-27T18:05:42.321154] [INFO ] [MAIN ] Update Progress: 521/2366 symbols completed. CPS took 18.6s. Estimated remaining: 3h 52m 30s. Rate: 7.9 symbols/min [2025-10-27T18:05:42.497840] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:05:42.516428] [DEBUG] [LOCAL ] CQP: Loaded 18984 existing records from primary storage. [2025-10-27T18:05:42.516706] [INFO ] [MAIN ] CQP: Loaded 18984 existing records. [2025-10-27T18:05:42.705329] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T18:05:42.738956] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:05:42.739719] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-27T18:05:42.739798] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-27T18:05:42.740184] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-27T18:05:42.740252] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-27T18:05:42.820030] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-27T18:05:43.106482] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:05:43.615023] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-27T18:05:43.657540] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T18:05:44.414972] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-27T18:05:44.705333] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-27T18:05:45.040592] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T18:05:45.214957] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-27T18:05:45.764925] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T18:05:46.014926] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-27T18:05:46.814992] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-27T18:05:47.367344] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-27T18:05:47.469775] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T18:05:47.614907] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-27T18:05:48.180523] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T18:05:48.414946] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-27T18:05:49.084386] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T18:05:49.214988] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-27T18:05:49.483674] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-27T18:05:50.015019] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-27T18:05:50.815553] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-27T18:05:51.022605] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-27T18:05:51.031007] [INFO ] [REMOTE ] CPT: Full fetch complete (64737 records). [2025-10-27T18:05:51.031113] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-27T18:05:51.413541] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-27T18:05:51.413629] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-27T18:05:51.414429] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-27T18:05:51.414484] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-27T18:05:51.415806] [DEBUG] [LOCAL ] CPT: Trimmed 64737 records to 44324 (keeping 200 days of data) [2025-10-27T18:05:51.623417] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-27T18:05:51.684757] [DEBUG] [LOCAL ] CPT: Primary data saved (44324 records). [2025-10-27T18:05:51.684886] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-27T18:05:51.684966] [INFO ] [MAIN ] Update Progress: 522/2366 symbols completed. CPT took 27.9s. Estimated remaining: 3h 52m 29s. Rate: 7.9 symbols/min [2025-10-27T18:05:51.856429] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:05:51.878463] [DEBUG] [LOCAL ] CR: Loaded 24331 existing records from primary storage. [2025-10-27T18:05:51.878729] [INFO ] [MAIN ] CR: Loaded 24331 existing records. [2025-10-27T18:05:52.057267] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:05:52.057584] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-27T18:05:52.057687] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-27T18:05:52.057896] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-27T18:05:52.057940] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-27T18:05:52.451325] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:05:52.451714] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-27T18:05:52.455102] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-10-27T18:05:52.545614] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T18:05:52.914451] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T18:05:53.215010] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-27T18:05:53.342677] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-27T18:05:54.014961] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-27T18:05:54.640426] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T18:05:54.650933] [INFO ] [REMOTE ] CPRI: Full fetch complete (76197 records). [2025-10-27T18:05:54.651056] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-27T18:05:54.815164] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-27T18:05:54.998950] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-27T18:05:55.096535] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-27T18:05:55.096616] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-27T18:05:55.097502] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-27T18:05:55.097565] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-27T18:05:55.098978] [DEBUG] [LOCAL ] CPRI: Trimmed 76197 records to 52365 (keeping 200 days of data) [2025-10-27T18:05:55.391828] [DEBUG] [LOCAL ] CPRI: Primary data saved (52365 records). [2025-10-27T18:05:55.391953] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-27T18:05:55.392028] [INFO ] [MAIN ] Update Progress: 523/2366 symbols completed. CPRI took 31.7s. Estimated remaining: 3h 52m 8s. Rate: 7.9 symbols/min [2025-10-27T18:05:55.556632] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:05:55.567239] [DEBUG] [LOCAL ] CRBD: Loaded 8822 existing records from primary storage. [2025-10-27T18:05:55.567439] [INFO ] [MAIN ] CRBD: Loaded 8822 existing records. [2025-10-27T18:05:55.627944] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-27T18:05:55.742712] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:05:55.742902] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-27T18:05:55.742947] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-27T18:05:55.743125] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-27T18:05:55.743182] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-27T18:05:56.092226] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:05:56.102897] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-27T18:05:56.414990] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-27T18:05:56.622479] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T18:05:57.214976] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-27T18:05:57.284133] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T18:05:58.014921] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-27T18:05:58.328371] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-27T18:05:58.814999] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-27T18:05:59.614927] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-27T18:05:59.654939] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-27T18:06:00.098174] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-27T18:06:00.131385] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-27T18:06:00.414933] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-27T18:06:01.215005] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-27T18:06:02.014954] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-27T18:06:02.815020] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-27T18:06:05.258401] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (4.84 seconds). [2025-10-27T18:06:05.263928] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-27T18:06:05.917028] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (3.90 seconds). [2025-10-27T18:06:05.919476] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-27T18:06:06.655807] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (5.44 seconds). [2025-10-27T18:06:06.662300] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-27T18:06:07.050775] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-27T18:06:07.054185] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-27T18:06:07.590630] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T18:06:07.593192] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-27T18:06:08.041330] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-27T18:06:08.044574] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-27T18:06:08.094177] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (5.28 seconds). [2025-10-27T18:06:08.342916] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-27T18:06:08.414957] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-27T18:06:08.739180] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-27T18:06:08.848612] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-27T18:06:08.851957] [INFO ] [REMOTE ] CQP: Full fetch complete (29388 records). [2025-10-27T18:06:08.852074] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-27T18:06:08.852570] [FATAL] [VALIDATOR ] CQP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:06:08.852690] [FATAL] [MAIN ] CQP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:06:08.852745] [WARN ] [MAIN ] CQP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:06:08.852813] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-27T18:06:08.852876] [DEBUG] [LOCAL ] CQP: No primary data file found to delete. [2025-10-27T18:06:08.852911] [INFO ] [LOCAL ] CQP: Starting deletion of derivative data. [2025-10-27T18:06:08.853031] [DEBUG] [LOCAL ] CQP: Deleted derivative data file. [2025-10-27T18:06:08.853096] [INFO ] [MAIN ] Update Progress: 524/2366 symbols completed. CQP took 26.5s. Estimated remaining: 3h 52m 21s. Rate: 7.9 symbols/min [2025-10-27T18:06:09.034574] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:06:09.082986] [DEBUG] [LOCAL ] CRBG: Loaded 53347 existing records from primary storage. [2025-10-27T18:06:09.083336] [INFO ] [MAIN ] CRBG: Loaded 53347 existing records. [2025-10-27T18:06:09.220118] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-27T18:06:09.258267] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:06:09.258445] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-27T18:06:09.258509] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-27T18:06:09.258755] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-27T18:06:09.258814] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-27T18:06:09.608022] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:06:10.014946] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-27T18:06:10.253672] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T18:06:10.570868] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-27T18:06:10.774062] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-27T18:06:10.814911] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-27T18:06:11.594854] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-27T18:06:11.614903] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-27T18:06:12.153500] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-27T18:06:12.414940] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-27T18:06:12.875318] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-27T18:06:13.214937] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-27T18:06:14.015008] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-27T18:06:14.814967] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-27T18:06:15.183155] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-27T18:06:15.437606] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-27T18:06:15.447398] [INFO ] [REMOTE ] CPNG: Full fetch complete (77402 records). [2025-10-27T18:06:15.447558] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-27T18:06:15.448442] [FATAL] [VALIDATOR ] CPNG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:06:15.448543] [FATAL] [MAIN ] CPNG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:06:15.448585] [WARN ] [MAIN ] CPNG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:06:15.448622] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-27T18:06:15.448731] [DEBUG] [LOCAL ] CPNG: No primary data file found to delete. [2025-10-27T18:06:15.448785] [INFO ] [LOCAL ] CPNG: Starting deletion of derivative data. [2025-10-27T18:06:15.448914] [DEBUG] [LOCAL ] CPNG: Deleted derivative data file. [2025-10-27T18:06:15.449464] [INFO ] [MAIN ] Update Progress: 525/2366 symbols completed. CPNG took 51.7s. Estimated remaining: 3h 52m 10s. Rate: 7.9 symbols/min [2025-10-27T18:06:15.624477] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:06:15.620745] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-27T18:06:15.668301] [DEBUG] [LOCAL ] CRC: Loaded 44669 existing records from primary storage. [2025-10-27T18:06:15.668582] [INFO ] [MAIN ] CRC: Loaded 44669 existing records. [2025-10-27T18:06:15.844996] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:06:15.845193] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-27T18:06:15.845241] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-27T18:06:15.845416] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-27T18:06:15.845456] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-27T18:06:16.226413] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:06:16.256945] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T18:06:16.415849] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-27T18:06:16.417753] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-27T18:06:16.420677] [INFO ] [REMOTE ] CRBD: Full fetch complete (12865 records). [2025-10-27T18:06:16.420767] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-27T18:06:16.772155] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-27T18:06:16.772238] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-27T18:06:16.772566] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-27T18:06:16.772682] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-27T18:06:16.773144] [DEBUG] [LOCAL ] CRBD: Trimmed 12865 records to 8602 (keeping 200 days of data) [2025-10-27T18:06:16.823015] [DEBUG] [LOCAL ] CRBD: Primary data saved (8602 records). [2025-10-27T18:06:16.823128] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-27T18:06:16.823207] [INFO ] [MAIN ] Update Progress: 526/2366 symbols completed. CRBD took 21.4s. Estimated remaining: 3h 51m 41s. Rate: 7.9 symbols/min [2025-10-27T18:06:16.986623] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:06:16.986819] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-27T18:06:16.986861] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-27T18:06:16.986965] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-27T18:06:16.987025] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-27T18:06:16.987107] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-27T18:06:16.987146] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-27T18:06:17.221786] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-27T18:06:17.334526] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:06:17.804953] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T18:06:18.014915] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-27T18:06:18.268993] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-27T18:06:18.814942] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-27T18:06:19.614922] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-27T18:06:19.668833] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T18:06:20.192880] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T18:06:20.414940] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-27T18:06:21.214939] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-27T18:06:21.531474] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-27T18:06:22.014995] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-27T18:06:22.223928] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-27T18:06:22.228805] [INFO ] [REMOTE ] CR: Full fetch complete (34917 records). [2025-10-27T18:06:22.228887] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-27T18:06:22.435249] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-27T18:06:22.647952] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-27T18:06:22.648037] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-27T18:06:22.648543] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-27T18:06:22.648603] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-27T18:06:22.649339] [DEBUG] [LOCAL ] CR: Trimmed 34917 records to 23894 (keeping 200 days of data) [2025-10-27T18:06:22.790326] [DEBUG] [LOCAL ] CR: Primary data saved (23894 records). [2025-10-27T18:06:22.790455] [INFO ] [MAIN ] CR: Full history saved. [2025-10-27T18:06:22.790531] [INFO ] [MAIN ] Update Progress: 527/2366 symbols completed. CR took 31.1s. Estimated remaining: 3h 51m 28s. Rate: 7.9 symbols/min [2025-10-27T18:06:22.820786] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-27T18:06:22.960685] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:06:23.004671] [DEBUG] [LOCAL ] CRGY: Loaded 53270 existing records from primary storage. [2025-10-27T18:06:23.004969] [INFO ] [MAIN ] CRGY: Loaded 53270 existing records. [2025-10-27T18:06:23.185719] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:06:23.186032] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-27T18:06:23.186209] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-27T18:06:23.186720] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-27T18:06:23.186856] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-27T18:06:23.584859] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:06:23.580690] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T18:06:23.614895] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-27T18:06:24.336103] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T18:06:24.414901] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-27T18:06:25.047610] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T18:06:25.214914] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-10-27T18:06:25.520568] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T18:06:25.520993] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-10-27T18:06:25.521106] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T18:06:25.521190] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-27T18:06:25.521270] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T18:06:25.521357] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-27T18:06:25.521440] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-27T18:06:25.521499] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-27T18:06:25.521562] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-27T18:06:25.521630] [INFO ] [MAIN ] Update Progress: 528/2366 symbols completed. CRCL took 8.7s. Estimated remaining: 3h 51m 4s. Rate: 8.0 symbols/min [2025-10-27T18:06:25.704335] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:06:25.758322] [DEBUG] [LOCAL ] CRH: Loaded 54172 existing records from primary storage. [2025-10-27T18:06:25.758684] [INFO ] [MAIN ] CRH: Loaded 54172 existing records. [2025-10-27T18:06:25.944956] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:06:25.945257] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-27T18:06:25.955832] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-27T18:06:25.973235] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-27T18:06:25.973389] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-27T18:06:26.019377] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-27T18:06:26.051130] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T18:06:26.345567] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:06:26.814941] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-27T18:06:27.614933] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-27T18:06:27.821025] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-27T18:06:28.391797] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T18:06:28.414902] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-27T18:06:29.177322] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T18:06:29.214896] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-27T18:06:29.931104] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T18:06:30.014947] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-27T18:06:30.814910] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-27T18:06:31.160797] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-27T18:06:31.313900] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T18:06:31.615003] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-27T18:06:32.089608] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T18:06:32.414981] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-27T18:06:33.214918] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-27T18:06:33.508503] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-27T18:06:34.014911] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-27T18:06:34.487900] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T18:06:34.530782] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-27T18:06:34.814941] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-27T18:06:35.415473] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T18:06:35.614945] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-27T18:06:36.414931] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-27T18:06:36.535412] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T18:06:37.214930] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-27T18:06:37.298902] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T18:06:38.014919] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-27T18:06:38.066933] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-27T18:06:38.490259] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-27T18:06:38.814941] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-27T18:06:39.628879] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-27T18:06:39.631586] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T18:06:40.105067] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T18:06:40.414922] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-27T18:06:41.214946] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-27T18:06:41.676457] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T18:06:41.749161] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-27T18:06:42.014954] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-27T18:06:42.814943] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-27T18:06:42.884607] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-27T18:06:43.404994] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-27T18:06:43.615001] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-27T18:06:44.178556] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T18:06:44.414952] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-27T18:06:45.214930] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-27T18:06:45.569171] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-27T18:06:46.014935] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-27T18:06:46.159277] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-27T18:06:46.639150] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T18:06:46.647525] [INFO ] [REMOTE ] CRC: Full fetch complete (62938 records). [2025-10-27T18:06:46.647676] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-27T18:06:46.820920] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-27T18:06:47.060827] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-27T18:06:47.060923] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-27T18:06:47.061693] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-27T18:06:47.061757] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-27T18:06:47.063170] [DEBUG] [LOCAL ] CRC: Trimmed 62938 records to 43808 (keeping 200 days of data) [2025-10-27T18:06:47.319327] [DEBUG] [LOCAL ] CRC: Primary data saved (43808 records). [2025-10-27T18:06:47.319477] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-27T18:06:47.319586] [INFO ] [MAIN ] Update Progress: 529/2366 symbols completed. CRC took 31.9s. Estimated remaining: 3h 51m 45s. Rate: 7.9 symbols/min [2025-10-27T18:06:47.510054] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:06:47.556311] [DEBUG] [LOCAL ] CRI: Loaded 50239 existing records from primary storage. [2025-10-27T18:06:47.556608] [INFO ] [MAIN ] CRI: Loaded 50239 existing records. [2025-10-27T18:06:47.630819] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-27T18:06:47.763916] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T18:06:47.767523] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:06:47.777083] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-27T18:06:47.777352] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-27T18:06:47.777679] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-27T18:06:47.777738] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-27T18:06:47.809501] [INFO ] [REMOTE ] CRBG: Full fetch complete (76048 records). [2025-10-27T18:06:47.841021] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-27T18:06:48.456228] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:06:48.483310] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-27T18:06:48.568302] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-27T18:06:48.568445] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-27T18:06:48.569534] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-27T18:06:48.569677] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-27T18:06:48.571816] [DEBUG] [LOCAL ] CRBG: Trimmed 76048 records to 52566 (keeping 200 days of data) [2025-10-27T18:06:48.719378] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-27T18:06:48.934173] [DEBUG] [LOCAL ] CRBG: Primary data saved (52566 records). [2025-10-27T18:06:48.934302] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-27T18:06:48.935328] [INFO ] [MAIN ] Update Progress: 530/2366 symbols completed. CRBG took 40.1s. Estimated remaining: 3h 51m 17s. Rate: 7.9 symbols/min [2025-10-27T18:06:49.099664] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:06:49.150377] [DEBUG] [LOCAL ] CRK: Loaded 52984 existing records from primary storage. [2025-10-27T18:06:49.150713] [INFO ] [MAIN ] CRK: Loaded 52984 existing records. [2025-10-27T18:06:49.219140] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-27T18:06:49.331691] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:06:49.331996] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-27T18:06:49.332138] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-27T18:06:49.332520] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-27T18:06:49.332596] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-27T18:06:49.705368] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-27T18:06:49.726726] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:06:49.768303] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-27T18:06:50.014974] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-27T18:06:50.814954] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-27T18:06:51.000538] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-27T18:06:51.010865] [INFO ] [REMOTE ] CRGY: Full fetch complete (76165 records). [2025-10-27T18:06:51.011009] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-27T18:06:51.406833] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-27T18:06:51.406949] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-27T18:06:51.408160] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-27T18:06:51.408244] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-27T18:06:51.409735] [DEBUG] [LOCAL ] CRGY: Trimmed 76165 records to 52486 (keeping 200 days of data) [2025-10-27T18:06:51.641177] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-27T18:06:51.649116] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T18:06:51.771003] [DEBUG] [LOCAL ] CRGY: Primary data saved (52486 records). [2025-10-27T18:06:51.771221] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-27T18:06:51.771333] [INFO ] [MAIN ] Update Progress: 531/2366 symbols completed. CRGY took 29.0s. Estimated remaining: 3h 50m 53s. Rate: 7.9 symbols/min [2025-10-27T18:06:51.958633] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:06:52.004288] [DEBUG] [LOCAL ] CRL: Loaded 43277 existing records from primary storage. [2025-10-27T18:06:52.004741] [INFO ] [MAIN ] CRL: Loaded 43277 existing records. [2025-10-27T18:06:52.200737] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:06:52.201018] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-27T18:06:52.201071] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-27T18:06:52.201309] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-27T18:06:52.201368] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-27T18:06:52.428309] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-27T18:06:52.592124] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:06:52.814150] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-27T18:06:53.214951] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-27T18:06:53.507629] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-27T18:06:54.015021] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-27T18:06:54.244337] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-27T18:06:54.815008] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-27T18:06:55.065238] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-27T18:06:55.364587] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T18:06:55.614936] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-27T18:06:56.414909] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-27T18:06:56.544696] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T18:06:56.554919] [INFO ] [REMOTE ] CRH: Full fetch complete (77518 records). [2025-10-27T18:06:56.555056] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-27T18:06:56.939631] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-27T18:06:56.939754] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-27T18:06:56.940693] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-27T18:06:56.940757] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-27T18:06:56.942280] [DEBUG] [LOCAL ] CRH: Trimmed 77518 records to 53392 (keeping 200 days of data) [2025-10-27T18:06:57.219948] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-27T18:06:57.266116] [DEBUG] [LOCAL ] CRH: Primary data saved (53392 records). [2025-10-27T18:06:57.266267] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-27T18:06:57.266377] [INFO ] [MAIN ] Update Progress: 532/2366 symbols completed. CRH took 31.7s. Estimated remaining: 3h 50m 39s. Rate: 8.0 symbols/min [2025-10-27T18:06:57.440058] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:06:57.488763] [DEBUG] [LOCAL ] CRM: Loaded 54550 existing records from primary storage. [2025-10-27T18:06:57.489201] [INFO ] [MAIN ] CRM: Loaded 54550 existing records. [2025-10-27T18:06:57.670996] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-27T18:06:57.700505] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:06:57.711854] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-27T18:06:57.711917] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-27T18:06:57.712202] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-27T18:06:57.712241] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-27T18:06:58.024231] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-27T18:06:58.065884] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:06:58.191777] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-27T18:06:58.784178] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T18:06:58.814899] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-27T18:06:59.370990] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T18:06:59.614941] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-27T18:07:00.056221] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T18:07:00.415012] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-27T18:07:01.214963] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-27T18:07:01.769481] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-27T18:07:02.014968] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-27T18:07:02.815004] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-27T18:07:03.074927] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-10-27T18:07:03.434723] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-27T18:07:03.614930] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-27T18:07:04.414978] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-27T18:07:04.551270] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-27T18:07:04.718843] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-10-27T18:07:05.114557] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T18:07:05.214922] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-27T18:07:05.668605] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T18:07:06.014945] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-27T18:07:06.781795] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-27T18:07:06.814911] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-27T18:07:07.466518] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T18:07:07.614917] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-27T18:07:08.168485] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T18:07:08.414994] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-27T18:07:09.214933] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-27T18:07:09.491981] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-27T18:07:10.014992] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-27T18:07:10.513889] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-27T18:07:10.814922] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-27T18:07:11.170318] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-27T18:07:11.536038] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T18:07:11.614923] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-27T18:07:12.414913] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-27T18:07:12.866572] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-27T18:07:13.214931] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-27T18:07:13.361030] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T18:07:13.370083] [INFO ] [REMOTE ] CRI: Full fetch complete (71070 records). [2025-10-27T18:07:13.370256] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-27T18:07:13.844369] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-27T18:07:13.844555] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-27T18:07:13.846145] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-27T18:07:13.846380] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-27T18:07:13.879850] [DEBUG] [LOCAL ] CRI: Trimmed 71070 records to 49480 (keeping 200 days of data) [2025-10-27T18:07:13.882971] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T18:07:14.017730] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-27T18:07:14.318606] [DEBUG] [LOCAL ] CRI: Primary data saved (49480 records). [2025-10-27T18:07:14.318810] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-27T18:07:14.319313] [INFO ] [MAIN ] Update Progress: 533/2366 symbols completed. CRI took 27.0s. Estimated remaining: 3h 51m 4s. Rate: 7.9 symbols/min [2025-10-27T18:07:14.551747] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:07:14.599636] [DEBUG] [LOCAL ] CRS: Loaded 43864 existing records from primary storage. [2025-10-27T18:07:14.600467] [INFO ] [MAIN ] CRS: Loaded 43864 existing records. [2025-10-27T18:07:14.772804] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-27T18:07:14.829007] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-27T18:07:14.869986] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:07:14.870171] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-27T18:07:14.870219] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-27T18:07:14.870414] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-27T18:07:14.870455] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-27T18:07:15.223171] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:07:15.614942] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-27T18:07:16.075716] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-27T18:07:16.263448] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T18:07:16.414977] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-27T18:07:17.214973] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-27T18:07:17.306566] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-27T18:07:17.316474] [INFO ] [REMOTE ] CRK: Full fetch complete (75758 records). [2025-10-27T18:07:17.316586] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-27T18:07:17.704217] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-27T18:07:17.704296] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-27T18:07:17.705110] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-27T18:07:17.705171] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-27T18:07:17.706469] [DEBUG] [LOCAL ] CRK: Trimmed 75758 records to 52167 (keeping 200 days of data) [2025-10-27T18:07:18.010728] [DEBUG] [LOCAL ] CRK: Primary data saved (52167 records). [2025-10-27T18:07:18.010864] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-27T18:07:18.010982] [INFO ] [MAIN ] Update Progress: 534/2366 symbols completed. CRK took 29.1s. Estimated remaining: 3h 50m 43s. Rate: 7.9 symbols/min [2025-10-27T18:07:18.022721] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-27T18:07:18.187393] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:07:18.213584] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-27T18:07:18.225070] [DEBUG] [LOCAL ] CRT: Loaded 4898 existing records from primary storage. [2025-10-27T18:07:18.225813] [INFO ] [MAIN ] CRT: Loaded 4898 existing records. [2025-10-27T18:07:18.414498] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:07:18.414768] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-27T18:07:18.414821] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-27T18:07:18.414959] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-27T18:07:18.414996] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-27T18:07:18.769002] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:07:18.814963] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-27T18:07:19.015312] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-27T18:07:19.420525] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T18:07:19.610979] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T18:07:19.614891] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-27T18:07:20.415030] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-27T18:07:20.875479] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-27T18:07:21.214981] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-27T18:07:22.014980] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-27T18:07:22.245187] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-10-27T18:07:22.440194] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T18:07:22.815008] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-27T18:07:23.362176] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T18:07:23.370399] [INFO ] [REMOTE ] CRL: Full fetch complete (63742 records). [2025-10-27T18:07:23.370502] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-27T18:07:23.492355] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T18:07:23.620131] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-27T18:07:23.783130] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-27T18:07:23.783211] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-27T18:07:23.783954] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-27T18:07:23.784017] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-27T18:07:23.785283] [DEBUG] [LOCAL ] CRL: Trimmed 63742 records to 42476 (keeping 200 days of data) [2025-10-27T18:07:24.026740] [DEBUG] [LOCAL ] CRL: Primary data saved (42476 records). [2025-10-27T18:07:24.026856] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-27T18:07:24.026928] [INFO ] [MAIN ] Update Progress: 535/2366 symbols completed. CRL took 32.3s. Estimated remaining: 3h 50m 30s. Rate: 7.9 symbols/min [2025-10-27T18:07:24.195193] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:07:24.232025] [DEBUG] [LOCAL ] CSAN: Loaded 42874 existing records from primary storage. [2025-10-27T18:07:24.232296] [INFO ] [MAIN ] CSAN: Loaded 42874 existing records. [2025-10-27T18:07:24.404960] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:07:24.405113] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-27T18:07:24.405159] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-27T18:07:24.405315] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-27T18:07:24.405353] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-27T18:07:24.425547] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-27T18:07:24.753520] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:07:24.931787] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-27T18:07:25.214923] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-27T18:07:25.430170] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-27T18:07:26.014924] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-27T18:07:26.814963] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-27T18:07:26.851352] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-27T18:07:27.614917] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-27T18:07:27.661726] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T18:07:28.414995] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-27T18:07:28.644455] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T18:07:28.822605] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-27T18:07:29.214984] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-27T18:07:29.916509] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T18:07:30.014917] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-27T18:07:30.815011] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-27T18:07:31.252537] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-27T18:07:31.614970] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-27T18:07:31.813061] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T18:07:31.848515] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-27T18:07:32.415019] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-27T18:07:33.214976] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-27T18:07:33.316953] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T18:07:33.993021] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-27T18:07:34.014919] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-27T18:07:34.547486] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T18:07:34.558676] [INFO ] [REMOTE ] CRM: Full fetch complete (77947 records). [2025-10-27T18:07:34.558934] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-27T18:07:34.697059] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T18:07:34.820048] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-27T18:07:34.992235] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-27T18:07:34.992312] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-27T18:07:34.993161] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-27T18:07:34.993224] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-27T18:07:34.994630] [DEBUG] [LOCAL ] CRM: Trimmed 77947 records to 53770 (keeping 200 days of data) [2025-10-27T18:07:35.323598] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-27T18:07:35.336399] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-10-27T18:07:35.336535] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-27T18:07:35.337550] [INFO ] [MAIN ] Update Progress: 536/2366 symbols completed. CRM took 38.1s. Estimated remaining: 3h 50m 36s. Rate: 7.9 symbols/min [2025-10-27T18:07:35.507326] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:07:35.541334] [DEBUG] [LOCAL ] CSL: Loaded 31561 existing records from primary storage. [2025-10-27T18:07:35.541592] [INFO ] [MAIN ] CSL: Loaded 31561 existing records. [2025-10-27T18:07:35.620137] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-27T18:07:35.720178] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:07:35.720379] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-27T18:07:35.720456] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-27T18:07:35.720824] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-27T18:07:35.720885] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-27T18:07:36.066616] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:07:36.265584] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-27T18:07:36.414972] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-27T18:07:37.214938] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-27T18:07:37.884526] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T18:07:38.014931] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-27T18:07:38.462374] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T18:07:38.703208] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-27T18:07:38.814988] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-27T18:07:39.614951] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-27T18:07:40.156126] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T18:07:40.167558] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-27T18:07:40.414952] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-27T18:07:41.214955] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-27T18:07:41.717563] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-27T18:07:42.014961] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-27T18:07:42.733771] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T18:07:42.766594] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-27T18:07:42.768326] [INFO ] [REMOTE ] CRT: Full fetch complete (7427 records). [2025-10-27T18:07:42.768397] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-27T18:07:42.824317] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-27T18:07:43.162418] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-27T18:07:43.162493] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-27T18:07:43.162745] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-27T18:07:43.162829] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-27T18:07:43.163261] [DEBUG] [LOCAL ] CRT: Trimmed 7427 records to 4799 (keeping 200 days of data) [2025-10-27T18:07:43.192739] [DEBUG] [LOCAL ] CRT: Primary data saved (4799 records). [2025-10-27T18:07:43.192840] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-27T18:07:43.192932] [INFO ] [MAIN ] Update Progress: 537/2366 symbols completed. CRT took 25.2s. Estimated remaining: 3h 50m 29s. Rate: 7.9 symbols/min [2025-10-27T18:07:43.362340] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:07:43.377387] [DEBUG] [LOCAL ] CSR: Loaded 13551 existing records from primary storage. [2025-10-27T18:07:43.377618] [INFO ] [MAIN ] CSR: Loaded 13551 existing records. [2025-10-27T18:07:43.570615] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:07:43.570827] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-27T18:07:43.570873] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-27T18:07:43.571051] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-27T18:07:43.571107] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-27T18:07:43.620273] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-27T18:07:43.943434] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:07:44.121019] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-27T18:07:44.129216] [INFO ] [REMOTE ] CRS: Full fetch complete (62830 records). [2025-10-27T18:07:44.129337] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-27T18:07:44.420052] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-27T18:07:44.503292] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-27T18:07:44.503372] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-27T18:07:44.504103] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-27T18:07:44.504164] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-27T18:07:44.505383] [DEBUG] [LOCAL ] CRS: Trimmed 62830 records to 43082 (keeping 200 days of data) [2025-10-27T18:07:44.768969] [DEBUG] [LOCAL ] CRS: Primary data saved (43082 records). [2025-10-27T18:07:44.769164] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-27T18:07:44.769344] [INFO ] [MAIN ] Update Progress: 538/2366 symbols completed. CRS took 30.4s. Estimated remaining: 3h 50m 1s. Rate: 7.9 symbols/min [2025-10-27T18:07:44.928771] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T18:07:44.985428] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:07:45.030575] [DEBUG] [LOCAL ] CSTM: Loaded 48134 existing records from primary storage. [2025-10-27T18:07:45.030907] [INFO ] [MAIN ] CSTM: Loaded 48134 existing records. [2025-10-27T18:07:45.219447] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:07:45.215060] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T18:07:45.215881] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-27T18:07:45.219816] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-27T18:07:45.219902] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-27T18:07:45.223844] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-27T18:07:45.223905] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-27T18:07:45.568899] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:07:46.014987] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-27T18:07:46.325925] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-27T18:07:46.784316] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T18:07:46.814916] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-27T18:07:47.493688] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T18:07:47.614936] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-27T18:07:48.414948] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-27T18:07:48.984328] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T18:07:49.214961] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-27T18:07:49.824083] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T18:07:50.014987] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-27T18:07:50.231823] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T18:07:50.815005] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-27T18:07:51.379616] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-27T18:07:51.614953] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-27T18:07:52.000752] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T18:07:52.415008] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-27T18:07:52.983721] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T18:07:53.214947] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-27T18:07:53.693038] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-27T18:07:54.014926] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-27T18:07:54.466074] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T18:07:54.814984] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-27T18:07:55.011567] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T18:07:55.614966] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-27T18:07:56.185095] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-27T18:07:56.389565] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-27T18:07:56.414902] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-27T18:07:57.214998] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-27T18:07:57.602460] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T18:07:58.014991] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-27T18:07:58.587547] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T18:07:58.814952] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-27T18:07:59.402913] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-27T18:07:59.614960] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-27T18:07:59.713488] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-27T18:08:00.414941] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-27T18:08:01.215071] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-27T18:08:01.406008] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-27T18:08:02.015026] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-27T18:08:02.678884] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-27T18:08:02.814960] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-27T18:08:03.531126] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-27T18:08:03.614951] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-27T18:08:03.903107] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-27T18:08:03.910866] [INFO ] [REMOTE ] CSAN: Full fetch complete (60322 records). [2025-10-27T18:08:03.910972] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-27T18:08:04.279190] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T18:08:04.301607] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-27T18:08:04.302059] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-27T18:08:04.302902] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-27T18:08:04.302995] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-27T18:08:04.304166] [DEBUG] [LOCAL ] CSAN: Trimmed 60322 records to 42109 (keeping 200 days of data) [2025-10-27T18:08:04.452545] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-27T18:08:04.531745] [DEBUG] [LOCAL ] CSAN: Primary data saved (42109 records). [2025-10-27T18:08:04.531870] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-27T18:08:04.531950] [INFO ] [MAIN ] Update Progress: 539/2366 symbols completed. CSAN took 40.5s. Estimated remaining: 3h 50m 35s. Rate: 7.9 symbols/min [2025-10-27T18:08:04.694110] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:08:04.707102] [DEBUG] [LOCAL ] CSV: Loaded 12542 existing records from primary storage. [2025-10-27T18:08:04.707313] [INFO ] [MAIN ] CSV: Loaded 12542 existing records. [2025-10-27T18:08:04.885742] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:08:04.885982] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-27T18:08:04.886084] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-27T18:08:04.886318] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-27T18:08:04.886427] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-27T18:08:05.026871] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-27T18:08:05.065706] [INFO ] [REMOTE ] CSL: Full fetch complete (45764 records). [2025-10-27T18:08:05.089199] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-27T18:08:05.215470] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-27T18:08:05.423549] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:08:05.531355] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T18:08:05.683812] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-27T18:08:05.683905] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-27T18:08:05.684616] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-27T18:08:05.684688] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-27T18:08:05.685847] [DEBUG] [LOCAL ] CSL: Trimmed 45764 records to 30902 (keeping 200 days of data) [2025-10-27T18:08:05.882616] [DEBUG] [LOCAL ] CSL: Primary data saved (30902 records). [2025-10-27T18:08:05.882809] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-27T18:08:05.882902] [INFO ] [MAIN ] Update Progress: 540/2366 symbols completed. CSL took 30.5s. Estimated remaining: 3h 50m 6s. Rate: 7.9 symbols/min [2025-10-27T18:08:06.027950] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-27T18:08:06.061840] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:08:06.062020] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-27T18:08:06.062108] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-27T18:08:06.062192] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-27T18:08:06.062231] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-27T18:08:06.062272] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-27T18:08:06.062304] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-27T18:08:06.433541] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:08:06.805998] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-27T18:08:06.814936] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-27T18:08:06.880223] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-27T18:08:07.501975] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-27T18:08:07.614952] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-10-27T18:08:07.823145] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T18:08:07.823400] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-10-27T18:08:07.823488] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T18:08:07.823535] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-27T18:08:07.823569] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T18:08:07.823632] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-27T18:08:07.823739] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-27T18:08:07.823778] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-27T18:08:07.823822] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-27T18:08:07.823865] [INFO ] [MAIN ] Update Progress: 541/2366 symbols completed. CSW took 1.9s. Estimated remaining: 3h 49m 40s. Rate: 7.9 symbols/min [2025-10-27T18:08:07.997142] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:08:08.005917] [DEBUG] [LOCAL ] CTBB: Loaded 6473 existing records from primary storage. [2025-10-27T18:08:08.006111] [INFO ] [MAIN ] CTBB: Loaded 6473 existing records. [2025-10-27T18:08:08.179042] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:08:08.179220] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-27T18:08:08.179266] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-27T18:08:08.179404] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-27T18:08:08.179441] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-27T18:08:08.420261] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-27T18:08:08.524780] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:08:09.215003] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-27T18:08:09.278039] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T18:08:09.281443] [INFO ] [REMOTE ] CSR: Full fetch complete (17965 records). [2025-10-27T18:08:09.281518] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-27T18:08:09.647217] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-27T18:08:09.647310] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-27T18:08:09.647757] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-27T18:08:09.647820] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-27T18:08:09.648450] [DEBUG] [LOCAL ] CSR: Trimmed 17965 records to 13284 (keeping 200 days of data) [2025-10-27T18:08:09.730258] [DEBUG] [LOCAL ] CSR: Primary data saved (13284 records). [2025-10-27T18:08:09.730393] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-27T18:08:09.730473] [INFO ] [MAIN ] Update Progress: 542/2366 symbols completed. CSR took 26.5s. Estimated remaining: 3h 49m 13s. Rate: 8.0 symbols/min [2025-10-27T18:08:09.900083] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:08:09.906623] [DEBUG] [LOCAL ] CTDD: Loaded 5184 existing records from primary storage. [2025-10-27T18:08:09.906827] [INFO ] [MAIN ] CTDD: Loaded 5184 existing records. [2025-10-27T18:08:10.020016] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-27T18:08:10.083673] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:08:10.083815] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-27T18:08:10.083864] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-27T18:08:10.083999] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-27T18:08:10.084038] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-27T18:08:10.440233] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:08:10.498983] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T18:08:10.615382] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-27T18:08:10.814920] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-27T18:08:11.614994] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-27T18:08:12.415502] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-27T18:08:12.416263] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T18:08:12.494466] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-27T18:08:13.214923] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-27T18:08:13.225796] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T18:08:13.797219] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T18:08:14.014927] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-27T18:08:14.528948] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-27T18:08:14.814937] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-27T18:08:15.614957] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-27T18:08:16.053014] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-27T18:08:16.318553] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-27T18:08:16.414932] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-27T18:08:17.214998] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-27T18:08:17.721502] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-27T18:08:18.015000] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-27T18:08:18.489167] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-27T18:08:18.614611] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T18:08:18.814930] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-27T18:08:19.395610] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T18:08:19.614927] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-27T18:08:20.007539] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-27T18:08:20.414948] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-27T18:08:21.214947] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-27T18:08:21.547084] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-27T18:08:21.643148] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-27T18:08:22.014930] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-27T18:08:22.814987] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-27T18:08:22.861760] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T18:08:23.614926] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-27T18:08:23.896906] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-27T18:08:23.975744] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-27T18:08:24.414948] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-27T18:08:24.820418] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-27T18:08:25.214979] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-27T18:08:26.014916] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-27T18:08:26.503037] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-27T18:08:26.814990] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-27T18:08:26.929227] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T18:08:26.939217] [INFO ] [REMOTE ] CSTM: Full fetch complete (69579 records). [2025-10-27T18:08:26.939393] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-27T18:08:27.326278] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-27T18:08:27.326391] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-27T18:08:27.327228] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-27T18:08:27.327290] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-27T18:08:27.328626] [DEBUG] [LOCAL ] CSTM: Trimmed 69579 records to 47323 (keeping 200 days of data) [2025-10-27T18:08:27.433501] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-27T18:08:27.602195] [DEBUG] [LOCAL ] CSTM: Primary data saved (47323 records). [2025-10-27T18:08:27.602319] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-27T18:08:27.602393] [INFO ] [MAIN ] Update Progress: 543/2366 symbols completed. CSTM took 42.8s. Estimated remaining: 3h 49m 40s. Rate: 7.9 symbols/min [2025-10-27T18:08:27.620130] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-27T18:08:27.769776] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:08:27.769901] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-27T18:08:27.769937] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-27T18:08:27.770055] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-27T18:08:27.770095] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-27T18:08:27.770136] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-27T18:08:27.770167] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-27T18:08:28.110349] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:08:28.414894] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-10-27T18:08:28.622728] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T18:08:28.631791] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T18:08:28.632409] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-10-27T18:08:28.632527] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T18:08:28.632606] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-27T18:08:28.632703] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T18:08:28.632783] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-27T18:08:28.632861] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-27T18:08:28.632904] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-27T18:08:28.632947] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-27T18:08:28.633001] [INFO ] [MAIN ] Update Progress: 544/2366 symbols completed. CTEV took 1.0s. Estimated remaining: 3h 49m 11s. Rate: 7.9 symbols/min [2025-10-27T18:08:28.817995] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:08:28.847363] [DEBUG] [LOCAL ] CTO: Loaded 27737 existing records from primary storage. [2025-10-27T18:08:28.847753] [INFO ] [MAIN ] CTO: Loaded 27737 existing records. [2025-10-27T18:08:29.040557] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:08:29.040870] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-27T18:08:29.040923] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-27T18:08:29.041203] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-27T18:08:29.041259] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-27T18:08:29.226299] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-27T18:08:29.488287] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:08:29.832710] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T18:08:29.834263] [INFO ] [REMOTE ] CTBB: Full fetch complete (10052 records). [2025-10-27T18:08:29.834335] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-27T18:08:30.020014] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-27T18:08:30.199132] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-27T18:08:30.199207] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-27T18:08:30.199492] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-27T18:08:30.199544] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-27T18:08:30.199986] [DEBUG] [LOCAL ] CTBB: Trimmed 10052 records to 6201 (keeping 200 days of data) [2025-10-27T18:08:30.236317] [DEBUG] [LOCAL ] CTBB: Primary data saved (6201 records). [2025-10-27T18:08:30.236419] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-27T18:08:30.236502] [INFO ] [MAIN ] Update Progress: 545/2366 symbols completed. CTBB took 22.4s. Estimated remaining: 3h 48m 44s. Rate: 8.0 symbols/min [2025-10-27T18:08:30.404845] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:08:30.443474] [DEBUG] [LOCAL ] CTOS: Loaded 37815 existing records from primary storage. [2025-10-27T18:08:30.443791] [INFO ] [MAIN ] CTOS: Loaded 37815 existing records. [2025-10-27T18:08:30.621399] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:08:30.621594] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-27T18:08:30.621659] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-27T18:08:30.621893] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-27T18:08:30.621949] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-27T18:08:30.790480] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-27T18:08:30.822560] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-27T18:08:30.986779] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:08:31.526548] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-27T18:08:31.614959] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-27T18:08:32.116765] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-27T18:08:32.414936] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-27T18:08:33.214937] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-27T18:08:33.313784] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T18:08:33.667588] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-27T18:08:34.014947] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-27T18:08:34.814965] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-27T18:08:35.509100] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-27T18:08:35.584134] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T18:08:35.614907] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-27T18:08:36.414992] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-27T18:08:36.922402] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T18:08:37.214969] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-27T18:08:37.387244] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-27T18:08:37.389695] [INFO ] [REMOTE ] CSV: Full fetch complete (18888 records). [2025-10-27T18:08:37.389768] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-27T18:08:37.752733] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-27T18:08:37.752811] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-27T18:08:37.753189] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-27T18:08:37.753227] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-27T18:08:37.753764] [DEBUG] [LOCAL ] CSV: Trimmed 18888 records to 12119 (keeping 200 days of data) [2025-10-27T18:08:37.829297] [DEBUG] [LOCAL ] CSV: Primary data saved (12119 records). [2025-10-27T18:08:37.829708] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-27T18:08:37.829812] [INFO ] [MAIN ] Update Progress: 546/2366 symbols completed. CSV took 33.3s. Estimated remaining: 3h 48m 36s. Rate: 8.0 symbols/min [2025-10-27T18:08:37.999604] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:08:38.025082] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-27T18:08:38.047634] [DEBUG] [LOCAL ] CTRA: Loaded 54427 existing records from primary storage. [2025-10-27T18:08:38.047970] [INFO ] [MAIN ] CTRA: Loaded 54427 existing records. [2025-10-27T18:08:38.224681] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:08:38.225023] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-27T18:08:38.225097] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-27T18:08:38.225777] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-27T18:08:38.225838] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-27T18:08:38.560373] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-27T18:08:38.629520] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:08:38.814953] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-27T18:08:39.210359] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T18:08:39.615000] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-27T18:08:40.245899] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T18:08:40.247220] [INFO ] [REMOTE ] CTDD: Full fetch complete (7919 records). [2025-10-27T18:08:40.247290] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-27T18:08:40.423501] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-27T18:08:40.618582] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-27T18:08:40.618723] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-27T18:08:40.619086] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-27T18:08:40.619150] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-27T18:08:40.619549] [DEBUG] [LOCAL ] CTDD: Trimmed 7919 records to 5011 (keeping 200 days of data) [2025-10-27T18:08:40.648832] [DEBUG] [LOCAL ] CTDD: Primary data saved (5011 records). [2025-10-27T18:08:40.648910] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-27T18:08:40.648981] [INFO ] [MAIN ] Update Progress: 547/2366 symbols completed. CTDD took 30.9s. Estimated remaining: 3h 48m 13s. Rate: 8.0 symbols/min [2025-10-27T18:08:40.819174] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:08:40.849385] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-27T18:08:40.899832] [DEBUG] [LOCAL ] CTRE: Loaded 50162 existing records from primary storage. [2025-10-27T18:08:40.900140] [INFO ] [MAIN ] CTRE: Loaded 50162 existing records. [2025-10-27T18:08:41.079286] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:08:41.079497] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-27T18:08:41.079555] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-27T18:08:41.079773] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-27T18:08:41.079835] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-27T18:08:41.220066] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-27T18:08:41.443525] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:08:42.014996] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-27T18:08:42.061660] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T18:08:42.540412] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T18:08:42.814983] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-27T18:08:43.614940] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-27T18:08:43.705626] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-27T18:08:43.882089] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T18:08:44.414939] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-27T18:08:44.661048] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-27T18:08:45.214948] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-27T18:08:45.711100] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-27T18:08:46.014985] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-27T18:08:46.809683] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T18:08:46.820184] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-27T18:08:47.330143] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-27T18:08:47.614936] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-27T18:08:47.762582] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-27T18:08:48.414967] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-27T18:08:49.188487] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T18:08:49.214941] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-27T18:08:49.366427] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T18:08:50.014997] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-27T18:08:50.767282] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T18:08:50.814898] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-27T18:08:50.899965] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T18:08:51.614968] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-27T18:08:52.164767] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T18:08:52.414965] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-27T18:08:52.877203] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T18:08:53.214938] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-27T18:08:53.953728] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T18:08:54.014905] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-27T18:08:54.647399] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T18:08:54.815009] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-27T18:08:55.351621] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T18:08:55.615001] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-27T18:08:56.414949] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-27T18:08:56.462170] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T18:08:57.143980] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-27T18:08:57.214927] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-27T18:08:57.326188] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T18:08:58.014982] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-27T18:08:58.585783] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T18:08:58.814940] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-27T18:08:59.153157] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T18:08:59.614984] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-27T18:09:00.311399] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-27T18:09:00.317316] [INFO ] [REMOTE ] CTO: Full fetch complete (41456 records). [2025-10-27T18:09:00.317396] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-27T18:09:00.420171] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-27T18:09:00.686088] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-27T18:09:00.686161] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-27T18:09:00.686704] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-27T18:09:00.686765] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-27T18:09:00.687578] [DEBUG] [LOCAL ] CTO: Trimmed 41456 records to 27078 (keeping 200 days of data) [2025-10-27T18:09:00.841919] [DEBUG] [LOCAL ] CTO: Primary data saved (27078 records). [2025-10-27T18:09:00.842038] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-27T18:09:00.842112] [INFO ] [MAIN ] Update Progress: 548/2366 symbols completed. CTO took 32.2s. Estimated remaining: 3h 48m 47s. Rate: 7.9 symbols/min [2025-10-27T18:09:01.011054] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:09:01.053105] [DEBUG] [LOCAL ] CTRI: Loaded 41493 existing records from primary storage. [2025-10-27T18:09:01.053421] [INFO ] [MAIN ] CTRI: Loaded 41493 existing records. [2025-10-27T18:09:01.230987] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-27T18:09:01.237707] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:09:01.238001] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-27T18:09:01.238049] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-27T18:09:01.238253] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-27T18:09:01.238308] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-27T18:09:01.598305] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:09:01.726378] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-27T18:09:02.015008] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-27T18:09:02.815060] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-27T18:09:03.851247] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (3.43 seconds). [2025-10-27T18:09:03.862335] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-27T18:09:04.341157] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (3.11 seconds). [2025-10-27T18:09:04.414930] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-27T18:09:05.386616] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (3.37 seconds). [2025-10-27T18:09:05.392899] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-27T18:09:05.422056] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-27T18:09:05.513214] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-27T18:09:05.521125] [INFO ] [REMOTE ] CTOS: Full fetch complete (53978 records). [2025-10-27T18:09:05.521205] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-27T18:09:05.900149] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-27T18:09:05.900221] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-27T18:09:05.900881] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-27T18:09:05.900942] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-27T18:09:05.901960] [DEBUG] [LOCAL ] CTOS: Trimmed 53978 records to 37098 (keeping 200 days of data) [2025-10-27T18:09:06.015139] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-27T18:09:06.110008] [DEBUG] [LOCAL ] CTOS: Primary data saved (37098 records). [2025-10-27T18:09:06.110228] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-27T18:09:06.110337] [INFO ] [MAIN ] Update Progress: 549/2366 symbols completed. CTOS took 35.9s. Estimated remaining: 3h 48m 32s. Rate: 8.0 symbols/min [2025-10-27T18:09:06.280541] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:09:06.298995] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-27T18:09:06.318246] [DEBUG] [LOCAL ] CTS: Loaded 19809 existing records from primary storage. [2025-10-27T18:09:06.318450] [INFO ] [MAIN ] CTS: Loaded 19809 existing records. [2025-10-27T18:09:06.509395] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:09:06.521680] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-27T18:09:06.521744] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-27T18:09:06.522251] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-27T18:09:06.523229] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-27T18:09:06.523275] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-27T18:09:06.820035] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-27T18:09:06.882679] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:09:07.614987] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-27T18:09:07.755882] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-27T18:09:07.765452] [INFO ] [REMOTE ] CTRE: Full fetch complete (71353 records). [2025-10-27T18:09:07.765577] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-27T18:09:08.152301] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-27T18:09:08.152380] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-27T18:09:08.153182] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-27T18:09:08.153244] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-27T18:09:08.154594] [DEBUG] [LOCAL ] CTRE: Trimmed 71353 records to 49379 (keeping 200 days of data) [2025-10-27T18:09:08.424478] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-27T18:09:08.454775] [DEBUG] [LOCAL ] CTRE: Primary data saved (49379 records). [2025-10-27T18:09:08.454915] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-27T18:09:08.455416] [INFO ] [MAIN ] Update Progress: 550/2366 symbols completed. CTRE took 27.8s. Estimated remaining: 3h 48m 8s. Rate: 8.0 symbols/min [2025-10-27T18:09:08.633171] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:09:08.684254] [DEBUG] [LOCAL ] CTVA: Loaded 54078 existing records from primary storage. [2025-10-27T18:09:08.684679] [INFO ] [MAIN ] CTVA: Loaded 54078 existing records. [2025-10-27T18:09:08.899831] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:09:08.902367] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-27T18:09:08.902583] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-27T18:09:08.913734] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-27T18:09:08.919617] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-27T18:09:08.922828] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-27T18:09:08.970019] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T18:09:09.220009] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-27T18:09:09.283224] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:09:09.391746] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-27T18:09:10.015002] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-27T18:09:10.717316] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-27T18:09:10.814914] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-27T18:09:11.272521] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-27T18:09:11.614909] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-27T18:09:11.836136] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T18:09:12.414956] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-27T18:09:13.214976] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-27T18:09:13.311357] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T18:09:13.625823] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-27T18:09:14.014929] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-27T18:09:14.343787] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-27T18:09:14.814999] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-27T18:09:15.615012] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-27T18:09:16.007373] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-27T18:09:16.017430] [INFO ] [REMOTE ] CTRA: Full fetch complete (77820 records). [2025-10-27T18:09:16.017534] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-27T18:09:16.204630] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T18:09:16.424464] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-27T18:09:16.429189] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-27T18:09:16.429262] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-27T18:09:16.430230] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-27T18:09:16.430439] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-27T18:09:16.431940] [DEBUG] [LOCAL ] CTRA: Trimmed 77820 records to 53647 (keeping 200 days of data) [2025-10-27T18:09:16.767755] [DEBUG] [LOCAL ] CTRA: Primary data saved (53647 records). [2025-10-27T18:09:16.767915] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-27T18:09:16.768001] [INFO ] [MAIN ] Update Progress: 551/2366 symbols completed. CTRA took 38.9s. Estimated remaining: 3h 48m 3s. Rate: 8.0 symbols/min [2025-10-27T18:09:16.957400] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:09:16.957621] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-27T18:09:16.957725] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-27T18:09:16.957865] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-27T18:09:16.957997] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-27T18:09:16.958151] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-27T18:09:16.958223] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-27T18:09:17.128368] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T18:09:17.225804] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-27T18:09:17.393517] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:09:18.014977] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-27T18:09:18.070727] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T18:09:18.427160] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-27T18:09:18.511088] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-27T18:09:18.814973] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-27T18:09:19.485226] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-27T18:09:19.614937] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-27T18:09:19.872462] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-27T18:09:20.414959] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-27T18:09:21.214942] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-27T18:09:22.014950] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-27T18:09:22.275602] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T18:09:22.650041] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T18:09:22.814917] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-27T18:09:23.052617] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-27T18:09:23.614914] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-27T18:09:23.778283] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-27T18:09:24.414918] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-27T18:09:24.658539] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T18:09:24.668159] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-27T18:09:25.214935] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-27T18:09:26.014938] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-27T18:09:26.433888] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-27T18:09:26.814921] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-27T18:09:26.889992] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T18:09:27.614945] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-27T18:09:27.906522] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-27T18:09:27.996467] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T18:09:28.414933] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-27T18:09:29.214970] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-27T18:09:29.762638] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T18:09:30.014956] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-27T18:09:30.474384] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T18:09:30.815004] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-27T18:09:31.203146] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-27T18:09:31.588397] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T18:09:31.597855] [INFO ] [REMOTE ] CTRI: Full fetch complete (54979 records). [2025-10-27T18:09:31.597966] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-27T18:09:31.620195] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-27T18:09:31.969390] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-27T18:09:31.989071] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-10-27T18:09:31.989127] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-10-27T18:09:31.989804] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-10-27T18:09:31.989866] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-10-27T18:09:31.990938] [DEBUG] [LOCAL ] CTRI: Trimmed 54979 records to 41068 (keeping 200 days of data) [2025-10-27T18:09:32.222676] [DEBUG] [LOCAL ] CTRI: Primary data saved (41068 records). [2025-10-27T18:09:32.222805] [INFO ] [MAIN ] CTRI: Full history saved. [2025-10-27T18:09:32.222879] [INFO ] [MAIN ] Update Progress: 552/2366 symbols completed. CTRI took 31.4s. Estimated remaining: 3h 48m 21s. Rate: 7.9 symbols/min [2025-10-27T18:09:32.397757] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:09:32.422861] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-27T18:09:32.443977] [DEBUG] [LOCAL ] CUBE: Loaded 51622 existing records from primary storage. [2025-10-27T18:09:32.444295] [INFO ] [MAIN ] CUBE: Loaded 51622 existing records. [2025-10-27T18:09:32.624251] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:09:32.624467] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-27T18:09:32.624515] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-27T18:09:32.624899] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-27T18:09:32.624957] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-27T18:09:32.977482] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:09:33.214937] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-27T18:09:33.292355] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-27T18:09:34.014944] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-27T18:09:34.784508] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T18:09:34.788829] [INFO ] [REMOTE ] CTS: Full fetch complete (27466 records). [2025-10-27T18:09:34.788918] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-27T18:09:34.819921] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-27T18:09:35.176765] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-27T18:09:35.198232] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-27T18:09:35.198339] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-27T18:09:35.198555] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-27T18:09:35.200324] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-27T18:09:35.200373] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-27T18:09:35.201023] [DEBUG] [LOCAL ] CTS: Trimmed 27466 records to 19302 (keeping 200 days of data) [2025-10-27T18:09:35.316133] [DEBUG] [LOCAL ] CTS: Primary data saved (19302 records). [2025-10-27T18:09:35.316290] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-27T18:09:35.316375] [INFO ] [MAIN ] Update Progress: 553/2366 symbols completed. CTS took 29.2s. Estimated remaining: 3h 47m 59s. Rate: 8.0 symbols/min [2025-10-27T18:09:35.481696] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:09:35.505890] [DEBUG] [LOCAL ] CUBI: Loaded 27498 existing records from primary storage. [2025-10-27T18:09:35.506144] [INFO ] [MAIN ] CUBI: Loaded 27498 existing records. [2025-10-27T18:09:35.620022] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-27T18:09:35.679871] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:09:35.680482] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-27T18:09:35.680529] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-27T18:09:35.680699] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-27T18:09:35.680755] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-27T18:09:36.027785] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:09:36.414981] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-27T18:09:36.846829] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T18:09:37.214998] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-27T18:09:37.741889] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-27T18:09:38.015022] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-27T18:09:38.276317] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-27T18:09:38.446223] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T18:09:38.814927] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-27T18:09:39.159925] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-27T18:09:39.160670] [INFO ] [REMOTE ] CUBB: Full fetch complete (963 records). [2025-10-27T18:09:39.160761] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-27T18:09:39.333664] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-10-27T18:09:39.333837] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:09:39.333882] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:09:39.333954] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-27T18:09:39.334014] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-27T18:09:39.334048] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-27T18:09:39.334086] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-27T18:09:39.334139] [INFO ] [MAIN ] Update Progress: 554/2366 symbols completed. CUBB took 22.6s. Estimated remaining: 3h 47m 40s. Rate: 8.0 symbols/min [2025-10-27T18:09:39.499980] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:09:39.546076] [DEBUG] [LOCAL ] CUK: Loaded 51820 existing records from primary storage. [2025-10-27T18:09:39.546393] [INFO ] [MAIN ] CUK: Loaded 51820 existing records. [2025-10-27T18:09:39.620078] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-27T18:09:39.721274] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:09:39.721468] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-27T18:09:39.721515] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-27T18:09:39.721732] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-27T18:09:39.721787] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-27T18:09:40.065170] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:09:40.414955] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-27T18:09:40.744375] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T18:09:41.214931] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-27T18:09:41.769781] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T18:09:41.988627] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-27T18:09:42.014918] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-27T18:09:42.815004] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-27T18:09:43.394791] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T18:09:43.615003] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-27T18:09:44.414912] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-27T18:09:44.489873] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-27T18:09:44.640253] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T18:09:45.215006] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-27T18:09:45.989614] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-27T18:09:46.014916] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-27T18:09:46.667538] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-27T18:09:46.814926] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-27T18:09:47.444582] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T18:09:47.614939] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-27T18:09:48.369362] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-27T18:09:48.414951] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-27T18:09:49.115753] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T18:09:49.214975] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-27T18:09:49.837074] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T18:09:50.014953] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-27T18:09:50.502371] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T18:09:50.814907] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-27T18:09:51.318368] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T18:09:51.547997] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T18:09:51.614932] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-27T18:09:52.415001] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-27T18:09:52.919127] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T18:09:53.214955] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-27T18:09:54.014915] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-27T18:09:54.375232] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-27T18:09:54.814935] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-27T18:09:54.934526] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T18:09:55.472378] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-27T18:09:55.614942] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-27T18:09:56.185694] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-27T18:09:56.414936] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-27T18:09:56.860423] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T18:09:57.214931] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-27T18:09:57.905688] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T18:09:57.978729] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-27T18:09:58.014903] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-27T18:09:58.814996] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-27T18:09:59.322404] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T18:09:59.614955] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-27T18:10:00.196680] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-27T18:10:00.414994] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-27T18:10:01.214974] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-27T18:10:02.014950] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-27T18:10:02.083715] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-27T18:10:02.095117] [INFO ] [REMOTE ] CTVA: Full fetch complete (77237 records). [2025-10-27T18:10:02.095294] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-27T18:10:02.517024] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-27T18:10:02.517116] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-27T18:10:02.518022] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-27T18:10:02.518087] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-27T18:10:02.519527] [DEBUG] [LOCAL ] CTVA: Trimmed 77237 records to 53299 (keeping 200 days of data) [2025-10-27T18:10:02.845811] [DEBUG] [LOCAL ] CTVA: Primary data saved (53299 records). [2025-10-27T18:10:02.845910] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-27T18:10:02.846746] [INFO ] [MAIN ] Update Progress: 555/2366 symbols completed. CTVA took 54.4s. Estimated remaining: 3h 48m 24s. Rate: 7.9 symbols/min [2025-10-27T18:10:03.019351] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:10:03.024062] [DEBUG] [LOCAL ] CULP: Loaded 2867 existing records from primary storage. [2025-10-27T18:10:03.024233] [INFO ] [MAIN ] CULP: Loaded 2867 existing records. [2025-10-27T18:10:03.197122] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:10:03.197307] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-27T18:10:03.197353] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-27T18:10:03.197503] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-27T18:10:03.197560] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-27T18:10:03.547851] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (3.13 seconds). [2025-10-27T18:10:03.567214] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:10:03.572385] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-27T18:10:03.573452] [INFO ] [REMOTE ] CUBI: Full fetch complete (39222 records). [2025-10-27T18:10:03.573526] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-27T18:10:03.982814] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-27T18:10:03.982888] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-27T18:10:03.983412] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-27T18:10:03.983450] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-27T18:10:03.984241] [DEBUG] [LOCAL ] CUBI: Trimmed 39222 records to 26871 (keeping 200 days of data) [2025-10-27T18:10:04.138987] [DEBUG] [LOCAL ] CUBI: Primary data saved (26871 records). [2025-10-27T18:10:04.139111] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-27T18:10:04.139189] [INFO ] [MAIN ] Update Progress: 556/2366 symbols completed. CUBI took 28.8s. Estimated remaining: 3h 47m 56s. Rate: 7.9 symbols/min [2025-10-27T18:10:04.267198] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T18:10:04.279311] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-27T18:10:04.324702] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:10:04.356750] [DEBUG] [LOCAL ] CURB: Loaded 33391 existing records from primary storage. [2025-10-27T18:10:04.357035] [INFO ] [MAIN ] CURB: Loaded 33391 existing records. [2025-10-27T18:10:04.536605] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:10:04.536876] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-27T18:10:04.536949] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-27T18:10:04.537197] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-27T18:10:04.537263] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-27T18:10:04.868135] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-27T18:10:04.869606] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-27T18:10:04.883449] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (3.67 seconds). [2025-10-27T18:10:04.934202] [INFO ] [REMOTE ] CUBE: Full fetch complete (72956 records). [2025-10-27T18:10:04.940117] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-27T18:10:04.961124] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:10:04.957582] [FATAL] [VALIDATOR ] CUBE: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:10:04.961838] [FATAL] [MAIN ] CUBE: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:10:04.962059] [WARN ] [MAIN ] CUBE: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:10:04.962401] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-27T18:10:04.962529] [DEBUG] [LOCAL ] CUBE: No primary data file found to delete. [2025-10-27T18:10:04.962575] [INFO ] [LOCAL ] CUBE: Starting deletion of derivative data. [2025-10-27T18:10:04.962726] [DEBUG] [LOCAL ] CUBE: Deleted derivative data file. [2025-10-27T18:10:04.963153] [INFO ] [MAIN ] Update Progress: 557/2366 symbols completed. CUBE took 32.7s. Estimated remaining: 3h 47m 27s. Rate: 8.0 symbols/min [2025-10-27T18:10:05.067057] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (3.05 seconds). [2025-10-27T18:10:05.214945] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-27T18:10:05.320185] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-27T18:10:06.014935] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-27T18:10:06.814941] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-27T18:10:07.213432] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-27T18:10:07.249307] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-27T18:10:07.278912] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T18:10:07.614924] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-27T18:10:08.412425] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T18:10:08.418147] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-27T18:10:08.968288] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-27T18:10:09.214951] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-27T18:10:10.015023] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-27T18:10:10.511848] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T18:10:10.630532] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-27T18:10:10.814960] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-27T18:10:11.614960] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-27T18:10:11.821206] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-27T18:10:12.415011] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-27T18:10:12.847723] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-27T18:10:13.214942] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-27T18:10:13.680042] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-27T18:10:13.689899] [INFO ] [REMOTE ] CUK: Full fetch complete (74390 records). [2025-10-27T18:10:13.690059] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-27T18:10:13.922934] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-27T18:10:14.030017] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-27T18:10:14.086671] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-27T18:10:14.086844] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-27T18:10:14.087706] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-27T18:10:14.087776] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-27T18:10:14.089166] [DEBUG] [LOCAL ] CUK: Trimmed 74390 records to 51033 (keeping 200 days of data) [2025-10-27T18:10:14.377311] [DEBUG] [LOCAL ] CUK: Primary data saved (51033 records). [2025-10-27T18:10:14.377447] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-27T18:10:14.377524] [INFO ] [MAIN ] Update Progress: 558/2366 symbols completed. CUK took 35.0s. Estimated remaining: 3h 47m 26s. Rate: 7.9 symbols/min [2025-10-27T18:10:14.814976] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-27T18:10:14.868065] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-27T18:10:15.615008] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-27T18:10:16.026794] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T18:10:16.154948] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-27T18:10:16.155951] [INFO ] [REMOTE ] CULP: Full fetch complete (4426 records). [2025-10-27T18:10:16.156049] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-27T18:10:16.428461] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-27T18:10:16.522558] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-27T18:10:16.522628] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-27T18:10:16.522815] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-27T18:10:16.522862] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-27T18:10:16.523208] [DEBUG] [LOCAL ] CULP: Trimmed 4426 records to 2757 (keeping 200 days of data) [2025-10-27T18:10:16.538112] [DEBUG] [LOCAL ] CULP: Primary data saved (2757 records). [2025-10-27T18:10:16.538176] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-27T18:10:16.538244] [INFO ] [MAIN ] Update Progress: 559/2366 symbols completed. CULP took 13.7s. Estimated remaining: 3h 47m 1s. Rate: 8.0 symbols/min [2025-10-27T18:10:19.735930] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (3.31 seconds). [2025-10-27T18:10:19.743094] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-27T18:10:20.671481] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-27T18:10:20.678761] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-27T18:10:22.144390] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T18:10:22.151938] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-27T18:10:23.530052] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T18:10:23.537751] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-27T18:10:24.801611] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-27T18:10:24.809295] [INFO ] [REMOTE ] CURB: Full fetch complete (47699 records). [2025-10-27T18:10:24.809411] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-27T18:10:25.234423] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-27T18:10:25.234501] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-27T18:10:25.235188] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-27T18:10:25.235253] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-27T18:10:25.236275] [DEBUG] [LOCAL ] CURB: Trimmed 47699 records to 32698 (keeping 200 days of data) [2025-10-27T18:10:25.439170] [DEBUG] [LOCAL ] CURB: Primary data saved (32698 records). [2025-10-27T18:10:25.439382] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-27T18:10:25.439491] [INFO ] [MAIN ] Update Progress: 560/2366 symbols completed. CURB took 21.3s. Estimated remaining: 3h 46m 57s. Rate: 8.0 symbols/min [2025-10-27T18:10:26.129107] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:10:26.121708] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:10:26.167044] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:10:26.187167] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:10:26.202809] [DEBUG] [LOCAL ] CVEO: Loaded 15335 existing records from primary storage. [2025-10-27T18:10:26.207243] [INFO ] [MAIN ] CVEO: Loaded 15335 existing records. [2025-10-27T18:10:26.352313] [DEBUG] [LOCAL ] CURV: Loaded 27627 existing records from primary storage. [2025-10-27T18:10:26.397100] [INFO ] [MAIN ] CURV: Loaded 27627 existing records. [2025-10-27T18:10:26.558438] [DEBUG] [LOCAL ] CUZ: Loaded 50093 existing records from primary storage. [2025-10-27T18:10:26.539250] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:10:26.580965] [INFO ] [MAIN ] CUZ: Loaded 50093 existing records. [2025-10-27T18:10:26.581242] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-27T18:10:26.582239] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-27T18:10:26.582108] [DEBUG] [LOCAL ] CVE: Loaded 54346 existing records from primary storage. [2025-10-27T18:10:26.612094] [INFO ] [MAIN ] CVE: Loaded 54346 existing records. [2025-10-27T18:10:26.648794] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-27T18:10:26.754420] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-27T18:10:26.847242] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:10:26.905140] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-27T18:10:26.910616] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-27T18:10:26.959776] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-27T18:10:26.986175] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-27T18:10:27.193057] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:10:27.363334] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-27T18:10:27.490029] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-27T18:10:27.564277] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-27T18:10:27.550977] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:10:27.569808] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-27T18:10:27.632010] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-27T18:10:27.694463] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-27T18:10:27.841554] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-27T18:10:27.933790] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-27T18:10:27.964772] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:10:27.987376] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-27T18:10:28.278666] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:10:28.300992] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-27T18:10:28.588919] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:10:28.589300] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-27T18:10:28.669564] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:10:28.669943] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-27T18:10:28.791964] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T18:10:28.794156] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-27T18:10:29.276453] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T18:10:29.282061] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-27T18:10:29.586495] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T18:10:29.589563] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-27T18:10:30.201524] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T18:10:30.212454] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-27T18:10:30.292684] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T18:10:30.325613] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T18:10:30.324676] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-27T18:10:30.327629] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T18:10:30.343835] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-27T18:10:30.343606] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-27T18:10:31.055713] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-27T18:10:31.061767] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-27T18:10:31.240559] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-27T18:10:31.244165] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-27T18:10:31.479346] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T18:10:31.489537] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-27T18:10:31.922848] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-27T18:10:31.932426] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-27T18:10:32.101715] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-27T18:10:32.201224] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-27T18:10:32.414913] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-27T18:10:33.210770] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-27T18:10:33.221178] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-27T18:10:33.399523] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T18:10:33.575012] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T18:10:33.869976] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T18:10:34.015009] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-27T18:10:34.814969] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-27T18:10:35.238668] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-27T18:10:35.614940] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-27T18:10:36.414915] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-27T18:10:36.636452] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-27T18:10:36.704448] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-27T18:10:37.214934] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-27T18:10:37.940414] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-27T18:10:38.014905] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-27T18:10:38.744464] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-27T18:10:38.814906] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-27T18:10:39.330195] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-27T18:10:39.614930] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-27T18:10:40.155525] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T18:10:40.414943] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-27T18:10:40.946007] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-27T18:10:41.101131] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-27T18:10:41.214930] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-27T18:10:42.014938] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-27T18:10:42.064494] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T18:10:42.814941] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-27T18:10:43.614948] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-27T18:10:43.775158] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T18:10:43.778694] [INFO ] [REMOTE ] CVEO: Full fetch complete (20966 records). [2025-10-27T18:10:43.778778] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-27T18:10:44.131074] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-27T18:10:44.201255] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-27T18:10:44.201327] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-27T18:10:44.201942] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-27T18:10:44.202010] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-27T18:10:44.202596] [DEBUG] [LOCAL ] CVEO: Trimmed 20966 records to 15001 (keeping 200 days of data) [2025-10-27T18:10:44.286811] [DEBUG] [LOCAL ] CVEO: Primary data saved (15001 records). [2025-10-27T18:10:44.286947] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-27T18:10:44.287084] [INFO ] [MAIN ] Update Progress: 561/2366 symbols completed. CVEO took 18.8s. Estimated remaining: 3h 47m 26s. Rate: 7.9 symbols/min [2025-10-27T18:10:44.425537] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-27T18:10:44.458010] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:10:44.498038] [DEBUG] [LOCAL ] CVI: Loaded 47376 existing records from primary storage. [2025-10-27T18:10:44.498827] [INFO ] [MAIN ] CVI: Loaded 47376 existing records. [2025-10-27T18:10:44.681127] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:10:44.681357] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-27T18:10:44.681564] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-27T18:10:44.681921] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-27T18:10:44.681982] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-27T18:10:44.806797] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T18:10:45.068550] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:10:45.214919] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-27T18:10:45.732532] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T18:10:46.014941] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-27T18:10:46.814946] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-27T18:10:46.914048] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T18:10:46.951197] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T18:10:47.614951] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-27T18:10:48.414926] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-27T18:10:48.675832] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-27T18:10:48.989613] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T18:10:49.214954] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-27T18:10:49.498735] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T18:10:50.014957] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-27T18:10:50.213569] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T18:10:50.219967] [INFO ] [REMOTE ] CURV: Full fetch complete (39108 records). [2025-10-27T18:10:50.220065] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-27T18:10:50.587050] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-27T18:10:50.587130] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-27T18:10:50.587706] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-27T18:10:50.587766] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-27T18:10:50.588563] [DEBUG] [LOCAL ] CURV: Trimmed 39108 records to 27358 (keeping 200 days of data) [2025-10-27T18:10:50.734932] [DEBUG] [LOCAL ] CURV: Primary data saved (27358 records). [2025-10-27T18:10:50.735056] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-27T18:10:50.735131] [INFO ] [MAIN ] Update Progress: 562/2366 symbols completed. CURV took 25.3s. Estimated remaining: 3h 47m 15s. Rate: 7.9 symbols/min [2025-10-27T18:10:50.824340] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-27T18:10:50.904590] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:10:50.919560] [DEBUG] [LOCAL ] CVLG: Loaded 15515 existing records from primary storage. [2025-10-27T18:10:50.919826] [INFO ] [MAIN ] CVLG: Loaded 15515 existing records. [2025-10-27T18:10:51.092844] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:10:51.093034] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-27T18:10:51.093079] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-27T18:10:51.093374] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-27T18:10:51.093430] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-27T18:10:51.459779] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:10:51.521464] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T18:10:51.614904] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-27T18:10:52.230198] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T18:10:52.415028] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-27T18:10:53.215020] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-27T18:10:53.336552] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T18:10:53.798387] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T18:10:53.900054] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T18:10:54.015027] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-27T18:10:54.565577] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-27T18:10:54.814938] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-27T18:10:55.614939] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-27T18:10:56.155767] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-27T18:10:56.414935] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-27T18:10:56.990497] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-27T18:10:57.000551] [INFO ] [REMOTE ] CVE: Full fetch complete (77712 records). [2025-10-27T18:10:57.000699] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-27T18:10:57.222953] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-27T18:10:57.413520] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-27T18:10:57.414545] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-27T18:10:57.414089] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-27T18:10:57.420380] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-27T18:10:57.420739] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-27T18:10:57.422000] [DEBUG] [LOCAL ] CVE: Trimmed 77712 records to 53560 (keeping 200 days of data) [2025-10-27T18:10:57.735158] [DEBUG] [LOCAL ] CVE: Primary data saved (53560 records). [2025-10-27T18:10:57.735280] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-27T18:10:57.736200] [INFO ] [MAIN ] Update Progress: 563/2366 symbols completed. CVE took 32.3s. Estimated remaining: 3h 47m 6s. Rate: 7.9 symbols/min [2025-10-27T18:10:57.904412] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:10:57.955490] [DEBUG] [LOCAL ] CVNA: Loaded 53603 existing records from primary storage. [2025-10-27T18:10:57.955808] [INFO ] [MAIN ] CVNA: Loaded 53603 existing records. [2025-10-27T18:10:58.020153] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-27T18:10:58.130570] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:10:58.130746] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-27T18:10:58.130793] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-27T18:10:58.130973] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-27T18:10:58.131009] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-27T18:10:58.475268] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:10:58.814964] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-27T18:10:59.029503] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-27T18:10:59.111893] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-27T18:10:59.121155] [INFO ] [REMOTE ] CUZ: Full fetch complete (70802 records). [2025-10-27T18:10:59.121272] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-27T18:10:59.512872] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-27T18:10:59.512950] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-27T18:10:59.513757] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-27T18:10:59.513823] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-27T18:10:59.515239] [DEBUG] [LOCAL ] CUZ: Trimmed 70802 records to 49312 (keeping 200 days of data) [2025-10-27T18:10:59.618477] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-27T18:10:59.806306] [DEBUG] [LOCAL ] CUZ: Primary data saved (49312 records). [2025-10-27T18:10:59.806429] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-27T18:10:59.806503] [INFO ] [MAIN ] Update Progress: 564/2366 symbols completed. CUZ took 34.3s. Estimated remaining: 3h 46m 41s. Rate: 7.9 symbols/min [2025-10-27T18:10:59.976350] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:11:00.023960] [DEBUG] [LOCAL ] CVS: Loaded 54474 existing records from primary storage. [2025-10-27T18:11:00.024257] [INFO ] [MAIN ] CVS: Loaded 54474 existing records. [2025-10-27T18:11:00.198442] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:11:00.198692] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-27T18:11:00.198755] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-27T18:11:00.198934] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-27T18:11:00.198992] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-27T18:11:00.422529] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-27T18:11:00.560662] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:11:01.099494] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-27T18:11:01.214917] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-27T18:11:01.980549] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-27T18:11:02.014949] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-27T18:11:02.815002] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-27T18:11:03.850879] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (3.43 seconds). [2025-10-27T18:11:03.854994] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-27T18:11:04.046001] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-27T18:11:04.152330] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (2.94 seconds). [2025-10-27T18:11:04.414928] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-27T18:11:04.514542] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T18:11:04.774687] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-27T18:11:05.214937] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-27T18:11:06.014958] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-27T18:11:06.341590] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T18:11:06.505767] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-27T18:11:06.669488] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-27T18:11:06.814942] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-27T18:11:07.614933] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-27T18:11:08.414971] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-27T18:11:08.725281] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-27T18:11:08.905058] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-27T18:11:09.214937] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-27T18:11:10.014942] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-27T18:11:10.396125] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T18:11:10.433523] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-27T18:11:10.814964] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-27T18:11:10.872597] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T18:11:11.614935] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-27T18:11:12.338056] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T18:11:12.341086] [INFO ] [REMOTE ] CVLG: Full fetch complete (21371 records). [2025-10-27T18:11:12.341186] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-27T18:11:12.420035] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-27T18:11:12.699170] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-27T18:11:12.699245] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-27T18:11:12.699717] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-27T18:11:12.699777] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-27T18:11:12.700334] [DEBUG] [LOCAL ] CVLG: Trimmed 21371 records to 15185 (keeping 200 days of data) [2025-10-27T18:11:12.791270] [DEBUG] [LOCAL ] CVLG: Primary data saved (15185 records). [2025-10-27T18:11:12.791414] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-27T18:11:12.791490] [INFO ] [MAIN ] Update Progress: 565/2366 symbols completed. CVLG took 22.1s. Estimated remaining: 3h 46m 51s. Rate: 7.9 symbols/min [2025-10-27T18:11:12.957710] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:11:13.009615] [DEBUG] [LOCAL ] CVX: Loaded 54540 existing records from primary storage. [2025-10-27T18:11:13.010031] [INFO ] [MAIN ] CVX: Loaded 54540 existing records. [2025-10-27T18:11:13.197901] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:11:13.198235] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-27T18:11:13.198400] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-27T18:11:13.198625] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-27T18:11:13.198719] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-27T18:11:13.230981] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-27T18:11:13.541469] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-10-27T18:11:13.628440] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:11:13.883404] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T18:11:14.014917] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-27T18:11:14.648932] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T18:11:14.814983] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-27T18:11:15.614973] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-27T18:11:15.941182] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T18:11:16.415022] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-27T18:11:16.698681] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-27T18:11:17.214943] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-27T18:11:17.436350] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-27T18:11:17.447020] [INFO ] [REMOTE ] CVI: Full fetch complete (67183 records). [2025-10-27T18:11:17.447201] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-27T18:11:17.880156] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-10-27T18:11:17.880271] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-10-27T18:11:17.881146] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-10-27T18:11:17.881215] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-10-27T18:11:17.882677] [DEBUG] [LOCAL ] CVI: Trimmed 67183 records to 46550 (keeping 200 days of data) [2025-10-27T18:11:18.060145] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-27T18:11:18.177986] [DEBUG] [LOCAL ] CVI: Primary data saved (46550 records). [2025-10-27T18:11:18.178184] [INFO ] [MAIN ] CVI: Full history saved. [2025-10-27T18:11:18.178301] [INFO ] [MAIN ] Update Progress: 566/2366 symbols completed. CVI took 33.9s. Estimated remaining: 3h 46m 36s. Rate: 7.9 symbols/min [2025-10-27T18:11:18.372087] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:11:18.393693] [DEBUG] [LOCAL ] CW: Loaded 22175 existing records from primary storage. [2025-10-27T18:11:18.393968] [INFO ] [MAIN ] CW: Loaded 22175 existing records. [2025-10-27T18:11:18.566908] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-27T18:11:18.644209] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:11:18.644476] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-27T18:11:18.644548] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-27T18:11:18.644782] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-27T18:11:18.644839] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-27T18:11:18.824928] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-27T18:11:19.032195] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:11:19.100467] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-27T18:11:19.614943] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-27T18:11:19.695677] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-27T18:11:20.414920] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-27T18:11:20.482024] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T18:11:21.144056] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-27T18:11:21.214966] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-27T18:11:21.993010] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T18:11:22.014905] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-27T18:11:22.328358] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T18:11:22.814994] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-27T18:11:23.614988] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-27T18:11:24.178436] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-27T18:11:24.414953] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-27T18:11:25.029039] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-27T18:11:25.214921] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-27T18:11:25.726049] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T18:11:25.854509] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-27T18:11:26.014941] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-27T18:11:26.814921] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-27T18:11:27.306902] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-27T18:11:27.614940] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-27T18:11:28.336039] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-27T18:11:28.414907] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-27T18:11:28.996226] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-27T18:11:29.220318] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-27T18:11:29.236923] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T18:11:30.014973] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-27T18:11:30.416349] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-27T18:11:30.428906] [INFO ] [REMOTE ] CVNA: Full fetch complete (76711 records). [2025-10-27T18:11:30.429105] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-27T18:11:30.822779] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-27T18:11:30.877696] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-27T18:11:30.877904] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-27T18:11:30.878850] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-27T18:11:30.878915] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-27T18:11:30.880309] [DEBUG] [LOCAL ] CVNA: Trimmed 76711 records to 52806 (keeping 200 days of data) [2025-10-27T18:11:31.104696] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-27T18:11:31.216563] [DEBUG] [LOCAL ] CVNA: Primary data saved (52806 records). [2025-10-27T18:11:31.216743] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-27T18:11:31.216829] [INFO ] [MAIN ] Update Progress: 567/2366 symbols completed. CVNA took 33.5s. Estimated remaining: 3h 46m 46s. Rate: 7.9 symbols/min [2025-10-27T18:11:31.393998] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:11:31.442945] [DEBUG] [LOCAL ] CWAN: Loaded 53447 existing records from primary storage. [2025-10-27T18:11:31.443251] [INFO ] [MAIN ] CWAN: Loaded 53447 existing records. [2025-10-27T18:11:31.625928] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-27T18:11:31.631597] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:11:31.632563] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-27T18:11:31.632620] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-27T18:11:31.632946] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-27T18:11:31.632994] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-27T18:11:31.994976] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:11:32.036832] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T18:11:32.047792] [INFO ] [REMOTE ] CVS: Full fetch complete (77874 records). [2025-10-27T18:11:32.048145] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-27T18:11:32.179506] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.96 seconds). [2025-10-27T18:11:32.421891] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-27T18:11:32.481889] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-27T18:11:32.481965] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-27T18:11:32.482883] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-27T18:11:32.482945] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-27T18:11:32.484356] [DEBUG] [LOCAL ] CVS: Trimmed 77874 records to 53694 (keeping 200 days of data) [2025-10-27T18:11:32.810141] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T18:11:32.830124] [DEBUG] [LOCAL ] CVS: Primary data saved (53694 records). [2025-10-27T18:11:32.830212] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-27T18:11:32.830280] [INFO ] [MAIN ] Update Progress: 568/2366 symbols completed. CVS took 33.0s. Estimated remaining: 3h 46m 20s. Rate: 7.9 symbols/min [2025-10-27T18:11:32.996201] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:11:33.032978] [DEBUG] [LOCAL ] CWEN: Loaded 45920 existing records from primary storage. [2025-10-27T18:11:33.033253] [INFO ] [MAIN ] CWEN: Loaded 45920 existing records. [2025-10-27T18:11:33.209169] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:11:33.209395] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-27T18:11:33.209447] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-27T18:11:33.209761] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-27T18:11:33.209830] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-27T18:11:33.220739] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-27T18:11:33.557791] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:11:34.014960] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-27T18:11:34.661062] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-27T18:11:34.814900] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-27T18:11:34.878987] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T18:11:35.394004] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-27T18:11:35.614940] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-27T18:11:36.414941] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-27T18:11:36.803940] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-27T18:11:37.114895] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-27T18:11:37.214910] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-27T18:11:37.517310] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T18:11:38.014958] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-27T18:11:38.815058] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-27T18:11:39.004820] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-27T18:11:39.614915] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-27T18:11:39.688743] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T18:11:39.922105] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T18:11:40.415017] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-27T18:11:41.214995] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-27T18:11:41.660896] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-27T18:11:41.746520] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-27T18:11:42.014995] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-27T18:11:42.814947] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-27T18:11:43.339315] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T18:11:43.390126] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-27T18:11:43.614899] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-27T18:11:43.699199] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-27T18:11:44.414996] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-27T18:11:44.878919] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T18:11:45.214963] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-27T18:11:46.014942] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-27T18:11:46.815016] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-27T18:11:46.921763] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-27T18:11:46.933052] [INFO ] [REMOTE ] CVX: Full fetch complete (77940 records). [2025-10-27T18:11:46.933211] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-27T18:11:47.236209] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-27T18:11:47.379375] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-27T18:11:47.379504] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-27T18:11:47.380433] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-27T18:11:47.380626] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-27T18:11:47.382143] [DEBUG] [LOCAL ] CVX: Trimmed 77940 records to 53760 (keeping 200 days of data) [2025-10-27T18:11:47.510127] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T18:11:47.616884] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-27T18:11:47.762750] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-10-27T18:11:47.762894] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-27T18:11:47.763469] [INFO ] [MAIN ] Update Progress: 569/2366 symbols completed. CVX took 35.0s. Estimated remaining: 3h 46m 35s. Rate: 7.9 symbols/min [2025-10-27T18:11:47.934913] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:11:47.988838] [DEBUG] [LOCAL ] CWH: Loaded 52001 existing records from primary storage. [2025-10-27T18:11:47.989192] [INFO ] [MAIN ] CWH: Loaded 52001 existing records. [2025-10-27T18:11:48.173130] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:11:48.178634] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-27T18:11:48.178744] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-27T18:11:48.185137] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-27T18:11:48.185205] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-27T18:11:48.218003] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-27T18:11:48.272258] [INFO ] [REMOTE ] CW: Full fetch complete (32830 records). [2025-10-27T18:11:48.293315] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-27T18:11:48.427841] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-27T18:11:48.820504] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:11:48.941243] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-27T18:11:48.941348] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-27T18:11:48.942060] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-27T18:11:48.942145] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-27T18:11:48.943154] [DEBUG] [LOCAL ] CW: Trimmed 32830 records to 21509 (keeping 200 days of data) [2025-10-27T18:11:49.056853] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T18:11:49.110500] [DEBUG] [LOCAL ] CW: Primary data saved (21509 records). [2025-10-27T18:11:49.110622] [INFO ] [MAIN ] CW: Full history saved. [2025-10-27T18:11:49.110731] [INFO ] [MAIN ] Update Progress: 570/2366 symbols completed. CW took 30.9s. Estimated remaining: 3h 46m 8s. Rate: 7.9 symbols/min [2025-10-27T18:11:49.220112] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-27T18:11:49.280504] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:11:49.326194] [DEBUG] [LOCAL ] CWK: Loaded 50403 existing records from primary storage. [2025-10-27T18:11:49.326484] [INFO ] [MAIN ] CWK: Loaded 50403 existing records. [2025-10-27T18:11:49.499661] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:11:49.499853] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-27T18:11:49.499899] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-27T18:11:49.500065] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-27T18:11:49.500128] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-27T18:11:49.852951] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:11:49.881832] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T18:11:50.014967] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-27T18:11:50.656122] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T18:11:50.814940] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-27T18:11:51.614917] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-27T18:11:51.878726] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-27T18:11:52.044302] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-27T18:11:52.414982] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-27T18:11:52.976791] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T18:11:53.214941] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-27T18:11:53.625931] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T18:11:54.014952] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-27T18:11:54.490130] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-27T18:11:54.814926] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-27T18:11:55.156789] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T18:11:55.614985] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-27T18:11:56.175443] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-27T18:11:56.414984] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-27T18:11:57.002165] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T18:11:57.214979] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-27T18:11:57.946326] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-27T18:11:58.014924] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-27T18:11:58.352730] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T18:11:58.814937] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-27T18:11:59.378746] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-27T18:11:59.387947] [INFO ] [REMOTE ] CWEN: Full fetch complete (65719 records). [2025-10-27T18:11:59.388056] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-27T18:11:59.621845] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-27T18:11:59.772924] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-27T18:11:59.773003] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-27T18:11:59.773772] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-27T18:11:59.773836] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-27T18:11:59.775122] [DEBUG] [LOCAL ] CWEN: Trimmed 65719 records to 45119 (keeping 200 days of data) [2025-10-27T18:12:00.040060] [DEBUG] [LOCAL ] CWEN: Primary data saved (45119 records). [2025-10-27T18:12:00.040205] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-27T18:12:00.040290] [INFO ] [MAIN ] Update Progress: 571/2366 symbols completed. CWEN took 27.2s. Estimated remaining: 3h 46m 11s. Rate: 7.9 symbols/min [2025-10-27T18:12:00.211520] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:12:00.240860] [DEBUG] [LOCAL ] CWT: Loaded 28471 existing records from primary storage. [2025-10-27T18:12:00.241161] [INFO ] [MAIN ] CWT: Loaded 28471 existing records. [2025-10-27T18:12:00.417740] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-27T18:12:00.424838] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:12:00.425205] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-27T18:12:00.425300] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-27T18:12:00.425549] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-27T18:12:00.425837] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-27T18:12:00.714224] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-27T18:12:00.881094] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:12:01.214946] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-27T18:12:02.015007] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-27T18:12:02.247786] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-27T18:12:02.814933] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-27T18:12:04.479114] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (3.26 seconds). [2025-10-27T18:12:04.490421] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-27T18:12:04.588420] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-27T18:12:04.594406] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-27T18:12:05.175954] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (4.76 seconds). [2025-10-27T18:12:05.214895] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-27T18:12:05.253111] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-27T18:12:06.015191] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-27T18:12:06.454308] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-27T18:12:06.814939] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-27T18:12:07.010015] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-27T18:12:07.160535] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T18:12:07.438213] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-27T18:12:07.448797] [INFO ] [REMOTE ] CWAN: Full fetch complete (75647 records). [2025-10-27T18:12:07.448934] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-27T18:12:07.633253] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-27T18:12:07.850318] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-27T18:12:07.850393] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-27T18:12:07.851242] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-27T18:12:07.851305] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-27T18:12:07.852741] [DEBUG] [LOCAL ] CWAN: Trimmed 75647 records to 52664 (keeping 200 days of data) [2025-10-27T18:12:08.166095] [DEBUG] [LOCAL ] CWAN: Primary data saved (52664 records). [2025-10-27T18:12:08.166285] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-27T18:12:08.167923] [INFO ] [MAIN ] Update Progress: 572/2366 symbols completed. CWAN took 37.0s. Estimated remaining: 3h 46m 5s. Rate: 7.9 symbols/min [2025-10-27T18:12:08.344266] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:12:08.371409] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T18:12:08.422257] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-27T18:12:08.425178] [DEBUG] [LOCAL ] CX: Loaded 53576 existing records from primary storage. [2025-10-27T18:12:08.425577] [INFO ] [MAIN ] CX: Loaded 53576 existing records. [2025-10-27T18:12:08.607281] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:12:08.607682] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-27T18:12:08.607802] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-27T18:12:08.608163] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-27T18:12:08.608240] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-27T18:12:08.879616] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T18:12:08.990099] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:12:09.214959] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-27T18:12:10.014932] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-27T18:12:10.084072] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T18:12:10.634865] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T18:12:10.814972] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-27T18:12:11.336504] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T18:12:11.615035] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-27T18:12:12.095733] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-27T18:12:12.414983] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-27T18:12:12.670616] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T18:12:13.214955] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-27T18:12:13.719077] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T18:12:14.014999] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-27T18:12:14.814986] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-27T18:12:15.158627] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-27T18:12:15.614979] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-27T18:12:15.649568] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-27T18:12:16.303134] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T18:12:16.414939] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-27T18:12:17.014213] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T18:12:17.214941] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-27T18:12:17.845194] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T18:12:18.014994] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-27T18:12:18.814915] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-27T18:12:19.027274] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-27T18:12:19.036882] [INFO ] [REMOTE ] CWK: Full fetch complete (71398 records). [2025-10-27T18:12:19.037022] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-27T18:12:19.426459] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-27T18:12:19.426552] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-27T18:12:19.427598] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-27T18:12:19.427707] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-27T18:12:19.429057] [DEBUG] [LOCAL ] CWK: Trimmed 71398 records to 49600 (keeping 200 days of data) [2025-10-27T18:12:19.625240] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-27T18:12:19.738254] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-27T18:12:19.754991] [DEBUG] [LOCAL ] CWK: Primary data saved (49600 records). [2025-10-27T18:12:19.755203] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-27T18:12:19.755285] [INFO ] [MAIN ] Update Progress: 573/2366 symbols completed. CWK took 30.6s. Estimated remaining: 3h 46m 10s. Rate: 7.9 symbols/min [2025-10-27T18:12:19.766542] [INFO ] [REMOTE ] CWH: Full fetch complete (73261 records). [2025-10-27T18:12:19.785863] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-27T18:12:20.027709] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:12:20.231178] [DEBUG] [LOCAL ] CXE: Loaded 6478 existing records from primary storage. [2025-10-27T18:12:20.248033] [INFO ] [MAIN ] CXE: Loaded 6478 existing records. [2025-10-27T18:12:20.249006] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T18:12:20.415830] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-27T18:12:20.470520] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-27T18:12:20.475790] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-27T18:12:20.496969] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-27T18:12:20.514734] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-27T18:12:20.538079] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:12:20.538367] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-27T18:12:20.538536] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-27T18:12:20.538908] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-27T18:12:20.538979] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-27T18:12:20.553161] [DEBUG] [LOCAL ] CWH: Trimmed 73261 records to 51204 (keeping 200 days of data) [2025-10-27T18:12:21.113744] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:12:21.207485] [DEBUG] [LOCAL ] CWH: Primary data saved (51204 records). [2025-10-27T18:12:21.207610] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-27T18:12:21.208118] [INFO ] [MAIN ] Update Progress: 574/2366 symbols completed. CWH took 33.4s. Estimated remaining: 3h 45m 44s. Rate: 7.9 symbols/min [2025-10-27T18:12:21.228448] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-27T18:12:21.403585] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:12:21.421879] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-27T18:12:21.450077] [DEBUG] [LOCAL ] CXH: Loaded 4406 existing records from primary storage. [2025-10-27T18:12:21.451814] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T18:12:21.451106] [INFO ] [MAIN ] CXH: Loaded 4406 existing records. [2025-10-27T18:12:21.633979] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:12:21.634166] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-27T18:12:21.634214] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-27T18:12:21.634340] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-27T18:12:21.634377] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-27T18:12:22.000701] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:12:22.014904] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-27T18:12:22.189855] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-27T18:12:22.814943] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-27T18:12:23.027113] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T18:12:23.614948] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-27T18:12:24.414947] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-27T18:12:24.511893] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T18:12:24.942939] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-27T18:12:25.079751] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T18:12:25.214931] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-27T18:12:26.014919] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-27T18:12:26.322461] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T18:12:26.455239] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-27T18:12:26.814971] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-27T18:12:27.332569] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-27T18:12:27.614961] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-27T18:12:28.414918] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-27T18:12:28.761581] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T18:12:28.778162] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-27T18:12:29.214966] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-27T18:12:29.734922] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-27T18:12:30.014942] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-27T18:12:30.814955] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-27T18:12:31.071956] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-27T18:12:31.077754] [INFO ] [REMOTE ] CWT: Full fetch complete (41331 records). [2025-10-27T18:12:31.077867] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-27T18:12:31.447335] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-27T18:12:31.447420] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-27T18:12:31.448006] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-27T18:12:31.448068] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-27T18:12:31.448963] [DEBUG] [LOCAL ] CWT: Trimmed 41331 records to 27782 (keeping 200 days of data) [2025-10-27T18:12:31.607747] [DEBUG] [LOCAL ] CWT: Primary data saved (27782 records). [2025-10-27T18:12:31.607875] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-27T18:12:31.607967] [INFO ] [MAIN ] Update Progress: 575/2366 symbols completed. CWT took 31.6s. Estimated remaining: 3h 45m 45s. Rate: 7.9 symbols/min [2025-10-27T18:12:31.620806] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-27T18:12:31.781688] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:12:31.821601] [DEBUG] [LOCAL ] CXM: Loaded 47965 existing records from primary storage. [2025-10-27T18:12:31.821915] [INFO ] [MAIN ] CXM: Loaded 47965 existing records. [2025-10-27T18:12:32.004527] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:12:32.004760] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-27T18:12:32.004811] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-27T18:12:32.005004] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-27T18:12:32.005062] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-27T18:12:32.289773] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-27T18:12:32.369211] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:12:32.414899] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-27T18:12:32.703842] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-27T18:12:33.214985] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-27T18:12:33.490589] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-27T18:12:33.763536] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-27T18:12:34.014966] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-27T18:12:34.432259] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-27T18:12:34.814943] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-27T18:12:35.615026] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-27T18:12:35.966592] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-27T18:12:36.414976] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-27T18:12:36.446634] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-27T18:12:37.115874] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-27T18:12:37.214968] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-27T18:12:38.014969] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-27T18:12:38.498230] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-27T18:12:38.708580] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-27T18:12:38.815004] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-27T18:12:39.614936] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-27T18:12:39.900545] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-27T18:12:40.415000] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-27T18:12:41.038116] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-27T18:12:41.214962] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-27T18:12:41.584421] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-27T18:12:42.014996] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-27T18:12:42.500051] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-27T18:12:42.814995] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-27T18:12:43.205708] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-27T18:12:43.614925] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-27T18:12:43.949412] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-27T18:12:43.959604] [INFO ] [REMOTE ] CX: Full fetch complete (76553 records). [2025-10-27T18:12:43.959767] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-27T18:12:44.352782] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-27T18:12:44.352865] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-27T18:12:44.353835] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-27T18:12:44.353900] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-27T18:12:44.355380] [DEBUG] [LOCAL ] CX: Trimmed 76553 records to 52770 (keeping 200 days of data) [2025-10-27T18:12:44.449787] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-27T18:12:44.494588] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-27T18:12:44.694353] [DEBUG] [LOCAL ] CX: Primary data saved (52770 records). [2025-10-27T18:12:44.694502] [INFO ] [MAIN ] CX: Full history saved. [2025-10-27T18:12:44.695266] [INFO ] [MAIN ] Update Progress: 576/2366 symbols completed. CX took 36.5s. Estimated remaining: 3h 45m 55s. Rate: 7.9 symbols/min [2025-10-27T18:12:44.863701] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:12:44.896201] [DEBUG] [LOCAL ] CXT: Loaded 31071 existing records from primary storage. [2025-10-27T18:12:44.896500] [INFO ] [MAIN ] CXT: Loaded 31071 existing records. [2025-10-27T18:12:45.077148] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:12:45.077338] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-27T18:12:45.077385] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-27T18:12:45.077584] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-27T18:12:45.077664] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-27T18:12:45.220131] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-27T18:12:45.274284] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T18:12:45.442104] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:12:45.849595] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T18:12:45.851329] [INFO ] [REMOTE ] CXE: Full fetch complete (11016 records). [2025-10-27T18:12:45.851397] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-27T18:12:46.020828] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-27T18:12:46.204138] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-27T18:12:46.204209] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-27T18:12:46.204459] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-27T18:12:46.204495] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-27T18:12:46.204928] [DEBUG] [LOCAL ] CXE: Trimmed 11016 records to 6300 (keeping 200 days of data) [2025-10-27T18:12:46.239741] [DEBUG] [LOCAL ] CXE: Primary data saved (6300 records). [2025-10-27T18:12:46.239821] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-27T18:12:46.239892] [INFO ] [MAIN ] Update Progress: 577/2366 symbols completed. CXE took 26.5s. Estimated remaining: 3h 45m 28s. Rate: 7.9 symbols/min [2025-10-27T18:12:46.408180] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:12:46.447274] [DEBUG] [LOCAL ] CXW: Loaded 44181 existing records from primary storage. [2025-10-27T18:12:46.447580] [INFO ] [MAIN ] CXW: Loaded 44181 existing records. [2025-10-27T18:12:46.621039] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:12:46.621245] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-27T18:12:46.621339] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-27T18:12:46.621517] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-27T18:12:46.621554] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-27T18:12:46.822345] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-27T18:12:46.968089] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:12:47.572363] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T18:12:47.614895] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-27T18:12:47.960193] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-27T18:12:48.414947] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-27T18:12:48.509134] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T18:12:49.214954] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-27T18:12:49.463206] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T18:12:50.014953] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-27T18:12:50.437929] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-27T18:12:50.814956] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-27T18:12:51.179941] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-27T18:12:51.220444] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-27T18:12:51.615000] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-27T18:12:52.415002] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-27T18:12:52.957749] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T18:12:53.214920] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-27T18:12:53.484621] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T18:12:54.014939] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-27T18:12:54.698863] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-27T18:12:54.814927] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-27T18:12:55.294090] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T18:12:55.294196] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-27T18:12:55.301952] [INFO ] [REMOTE ] CXH: Full fetch complete (5303 records). [2025-10-27T18:12:55.302147] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-27T18:12:55.620096] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-27T18:12:55.661381] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-27T18:12:55.661454] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-27T18:12:55.661625] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-27T18:12:55.661710] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-27T18:12:55.662107] [DEBUG] [LOCAL ] CXH: Trimmed 5303 records to 4349 (keeping 200 days of data) [2025-10-27T18:12:55.687081] [DEBUG] [LOCAL ] CXH: Primary data saved (4349 records). [2025-10-27T18:12:55.687194] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-27T18:12:55.687273] [INFO ] [MAIN ] Update Progress: 578/2366 symbols completed. CXH took 34.5s. Estimated remaining: 3h 45m 27s. Rate: 7.9 symbols/min [2025-10-27T18:12:55.858298] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:12:55.884152] [DEBUG] [LOCAL ] CYD: Loaded 27715 existing records from primary storage. [2025-10-27T18:12:55.884406] [INFO ] [MAIN ] CYD: Loaded 27715 existing records. [2025-10-27T18:12:56.066825] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:12:56.067046] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-27T18:12:56.067104] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-27T18:12:56.067288] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-27T18:12:56.067326] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-27T18:12:56.421272] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:12:56.417720] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-27T18:12:56.940461] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T18:12:57.214940] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-27T18:12:57.585954] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T18:12:58.014941] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-27T18:12:58.384269] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-27T18:12:58.392821] [INFO ] [REMOTE ] CXM: Full fetch complete (68382 records). [2025-10-27T18:12:58.392957] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-27T18:12:58.770301] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-27T18:12:58.770377] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-27T18:12:58.771169] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-27T18:12:58.771230] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-27T18:12:58.772499] [DEBUG] [LOCAL ] CXM: Trimmed 68382 records to 47108 (keeping 200 days of data) [2025-10-27T18:12:58.817324] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-27T18:12:59.035076] [DEBUG] [LOCAL ] CXM: Primary data saved (47108 records). [2025-10-27T18:12:59.035197] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-27T18:12:59.035283] [INFO ] [MAIN ] Update Progress: 579/2366 symbols completed. CXM took 27.4s. Estimated remaining: 3h 45m 6s. Rate: 7.9 symbols/min [2025-10-27T18:12:59.203307] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:12:59.242229] [DEBUG] [LOCAL ] CYH: Loaded 48377 existing records from primary storage. [2025-10-27T18:12:59.242518] [INFO ] [MAIN ] CYH: Loaded 48377 existing records. [2025-10-27T18:12:59.446352] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:12:59.446675] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-27T18:12:59.446805] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-27T18:12:59.447217] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-27T18:12:59.447326] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-27T18:12:59.556826] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T18:12:59.577212] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-27T18:12:59.622243] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-27T18:12:59.842164] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:13:00.414939] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-27T18:13:01.214954] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-27T18:13:01.595424] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-27T18:13:02.014949] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-27T18:13:02.814974] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-27T18:13:04.412867] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-27T18:13:04.420096] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-27T18:13:04.829460] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-27T18:13:04.834490] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-27T18:13:04.874972] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (3.66 seconds). [2025-10-27T18:13:04.916552] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (4.50 seconds). [2025-10-27T18:13:05.214953] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-27T18:13:05.804442] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T18:13:06.010475] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-27T18:13:06.016789] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-27T18:13:06.409165] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T18:13:06.814962] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-27T18:13:07.356959] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T18:13:07.614983] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-27T18:13:08.414959] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-27T18:13:08.518759] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T18:13:09.182017] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T18:13:09.188638] [INFO ] [REMOTE ] CXT: Full fetch complete (45576 records). [2025-10-27T18:13:09.188862] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-27T18:13:09.221172] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-27T18:13:09.591523] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-27T18:13:09.601398] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-27T18:13:09.603304] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T18:13:09.602472] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-27T18:13:09.608993] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-27T18:13:09.610556] [DEBUG] [LOCAL ] CXT: Trimmed 45576 records to 30425 (keeping 200 days of data) [2025-10-27T18:13:09.791886] [DEBUG] [LOCAL ] CXT: Primary data saved (30425 records). [2025-10-27T18:13:09.792031] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-27T18:13:09.792111] [INFO ] [MAIN ] Update Progress: 580/2366 symbols completed. CXT took 25.1s. Estimated remaining: 3h 45m 8s. Rate: 7.9 symbols/min [2025-10-27T18:13:09.957688] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:13:10.009884] [DEBUG] [LOCAL ] D: Loaded 54429 existing records from primary storage. [2025-10-27T18:13:10.010247] [INFO ] [MAIN ] D: Loaded 54429 existing records. [2025-10-27T18:13:10.021357] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-27T18:13:10.206857] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:13:10.207103] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-27T18:13:10.207163] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-27T18:13:10.207351] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-27T18:13:10.207390] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-27T18:13:10.564062] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:13:10.814952] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-27T18:13:10.860381] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T18:13:11.614980] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-27T18:13:11.711269] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T18:13:11.933991] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T18:13:12.414969] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-27T18:13:13.214961] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-27T18:13:13.282411] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T18:13:13.753408] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T18:13:14.014966] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-27T18:13:14.814970] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-27T18:13:14.915819] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T18:13:15.521489] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T18:13:15.615117] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-27T18:13:15.662687] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-27T18:13:16.414971] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-27T18:13:16.822443] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T18:13:17.214974] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-27T18:13:17.797198] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T18:13:18.015017] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-27T18:13:18.484068] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T18:13:18.814994] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-27T18:13:19.382384] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T18:13:19.614973] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-27T18:13:19.960312] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T18:13:20.414992] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-27T18:13:21.215005] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-27T18:13:21.334274] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-27T18:13:21.595440] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T18:13:22.015055] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-27T18:13:22.814948] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-27T18:13:22.838240] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-27T18:13:22.846462] [INFO ] [REMOTE ] CXW: Full fetch complete (64636 records). [2025-10-27T18:13:22.846581] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-27T18:13:23.275866] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T18:13:23.279365] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-27T18:13:23.285533] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-27T18:13:23.287019] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-27T18:13:23.287098] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-27T18:13:23.289015] [DEBUG] [LOCAL ] CXW: Trimmed 64636 records to 43394 (keeping 200 days of data) [2025-10-27T18:13:23.535484] [DEBUG] [LOCAL ] CXW: Primary data saved (43394 records). [2025-10-27T18:13:23.535603] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-27T18:13:23.535699] [INFO ] [MAIN ] Update Progress: 581/2366 symbols completed. CXW took 37.3s. Estimated remaining: 3h 45m 20s. Rate: 7.9 symbols/min [2025-10-27T18:13:23.620137] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-27T18:13:23.706942] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:13:23.719200] [DEBUG] [LOCAL ] DAC: Loaded 12491 existing records from primary storage. [2025-10-27T18:13:23.719436] [INFO ] [MAIN ] DAC: Loaded 12491 existing records. [2025-10-27T18:13:23.900175] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:13:23.900404] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-27T18:13:23.900471] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-27T18:13:23.900634] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-27T18:13:23.900720] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-27T18:13:24.261743] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:13:24.414948] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-27T18:13:24.822206] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T18:13:25.058165] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-27T18:13:25.214958] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-27T18:13:25.338127] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-27T18:13:26.014950] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-27T18:13:26.656724] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T18:13:26.814931] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-27T18:13:26.891603] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-27T18:13:27.614978] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-27T18:13:27.928113] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-27T18:13:27.934264] [INFO ] [REMOTE ] CYD: Full fetch complete (36512 records). [2025-10-27T18:13:27.934341] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-27T18:13:28.311363] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-27T18:13:28.311440] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-27T18:13:28.312024] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-27T18:13:28.312089] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-27T18:13:28.312944] [DEBUG] [LOCAL ] CYD: Trimmed 36512 records to 27069 (keeping 200 days of data) [2025-10-27T18:13:28.416379] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-27T18:13:28.476398] [DEBUG] [LOCAL ] CYD: Primary data saved (27069 records). [2025-10-27T18:13:28.476548] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-27T18:13:28.476672] [INFO ] [MAIN ] Update Progress: 582/2366 symbols completed. CYD took 32.8s. Estimated remaining: 3h 45m 4s. Rate: 7.9 symbols/min [2025-10-27T18:13:28.650810] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:13:28.703115] [DEBUG] [LOCAL ] DAL: Loaded 54533 existing records from primary storage. [2025-10-27T18:13:28.703443] [INFO ] [MAIN ] DAL: Loaded 54533 existing records. [2025-10-27T18:13:28.882562] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:13:28.882774] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-27T18:13:28.882823] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-27T18:13:28.883011] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-27T18:13:28.883051] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-27T18:13:29.220634] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-27T18:13:29.251776] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:13:29.454862] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T18:13:29.887124] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-27T18:13:30.015001] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-27T18:13:30.152390] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T18:13:30.674730] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-27T18:13:30.814936] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-27T18:13:31.614941] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-27T18:13:32.414925] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-27T18:13:32.476353] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T18:13:33.214931] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-27T18:13:33.465026] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-27T18:13:33.465378] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-27T18:13:34.014955] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-27T18:13:34.533697] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-27T18:13:34.814931] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-27T18:13:35.580778] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T18:13:35.614949] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-27T18:13:35.904108] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T18:13:36.414931] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-27T18:13:36.557449] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-27T18:13:37.214967] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-27T18:13:37.603899] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-27T18:13:37.615486] [INFO ] [REMOTE ] CYH: Full fetch complete (69881 records). [2025-10-27T18:13:37.615638] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-27T18:13:38.016030] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-27T18:13:38.055625] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-27T18:13:38.055744] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-27T18:13:38.056606] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-27T18:13:38.056817] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-27T18:13:38.058152] [DEBUG] [LOCAL ] CYH: Trimmed 69881 records to 47628 (keeping 200 days of data) [2025-10-27T18:13:38.324366] [DEBUG] [LOCAL ] CYH: Primary data saved (47628 records). [2025-10-27T18:13:38.324604] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-27T18:13:38.324736] [INFO ] [MAIN ] Update Progress: 583/2366 symbols completed. CYH took 39.3s. Estimated remaining: 3h 45m 4s. Rate: 7.9 symbols/min [2025-10-27T18:13:38.498359] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:13:38.539740] [DEBUG] [LOCAL ] DAN: Loaded 50100 existing records from primary storage. [2025-10-27T18:13:38.540037] [INFO ] [MAIN ] DAN: Loaded 50100 existing records. [2025-10-27T18:13:38.713554] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:13:38.713890] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-27T18:13:38.713976] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-27T18:13:38.714448] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-27T18:13:38.714561] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-27T18:13:38.819691] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-27T18:13:39.003201] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-27T18:13:39.083527] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:13:39.113300] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-27T18:13:39.614987] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-27T18:13:40.415018] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-27T18:13:40.629484] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-27T18:13:40.893039] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-27T18:13:40.902536] [INFO ] [REMOTE ] D: Full fetch complete (77422 records). [2025-10-27T18:13:40.902664] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-27T18:13:40.903418] [FATAL] [VALIDATOR ] D: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:13:40.903504] [FATAL] [MAIN ] D: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:13:40.903546] [WARN ] [MAIN ] D: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:13:40.903610] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-27T18:13:40.903707] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-10-27T18:13:40.903768] [INFO ] [LOCAL ] D: Starting deletion of derivative data. [2025-10-27T18:13:40.903896] [DEBUG] [LOCAL ] D: Deleted derivative data file. [2025-10-27T18:13:40.904551] [INFO ] [MAIN ] Update Progress: 584/2366 symbols completed. D took 31.1s. Estimated remaining: 3h 44m 41s. Rate: 7.9 symbols/min [2025-10-27T18:13:41.077449] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:13:41.096182] [DEBUG] [LOCAL ] DAO: Loaded 20203 existing records from primary storage. [2025-10-27T18:13:41.096406] [INFO ] [MAIN ] DAO: Loaded 20203 existing records. [2025-10-27T18:13:41.217707] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-27T18:13:41.275588] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:13:41.275955] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-27T18:13:41.276092] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-27T18:13:41.276275] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-27T18:13:41.276331] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-27T18:13:41.477197] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-27T18:13:41.663274] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:13:41.813592] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T18:13:42.014954] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-27T18:13:42.814938] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-27T18:13:43.102764] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-27T18:13:43.614923] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-27T18:13:43.667559] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T18:13:44.414943] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-27T18:13:45.214959] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-27T18:13:45.274683] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T18:13:45.277801] [INFO ] [REMOTE ] DAC: Full fetch complete (18950 records). [2025-10-27T18:13:45.277885] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-27T18:13:45.422520] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-27T18:13:45.672632] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-27T18:13:45.672751] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-27T18:13:45.673138] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-27T18:13:45.673177] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-27T18:13:45.673715] [DEBUG] [LOCAL ] DAC: Trimmed 18950 records to 11984 (keeping 200 days of data) [2025-10-27T18:13:45.743600] [DEBUG] [LOCAL ] DAC: Primary data saved (11984 records). [2025-10-27T18:13:45.743754] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-27T18:13:45.743836] [INFO ] [MAIN ] Update Progress: 585/2366 symbols completed. DAC took 22.2s. Estimated remaining: 3h 44m 25s. Rate: 7.9 symbols/min [2025-10-27T18:13:45.907105] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:13:45.951918] [DEBUG] [LOCAL ] DAR: Loaded 52770 existing records from primary storage. [2025-10-27T18:13:45.952212] [INFO ] [MAIN ] DAR: Loaded 52770 existing records. [2025-10-27T18:13:46.024620] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-27T18:13:46.128896] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:13:46.129067] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-27T18:13:46.129112] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-27T18:13:46.129358] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-27T18:13:46.129396] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-27T18:13:46.492551] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-27T18:13:46.492081] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:13:46.814992] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-27T18:13:47.626465] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-27T18:13:47.629462] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T18:13:48.414975] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-27T18:13:48.469446] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T18:13:48.663735] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T18:13:49.214947] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-27T18:13:50.014969] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-27T18:13:50.205197] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T18:13:50.231202] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T18:13:50.814941] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-27T18:13:51.182081] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T18:13:51.614980] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-27T18:13:52.381367] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-27T18:13:52.414897] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-27T18:13:52.662528] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-27T18:13:53.214940] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-27T18:13:53.942223] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-27T18:13:54.014900] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-27T18:13:54.098876] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T18:13:54.814947] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-27T18:13:55.324478] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T18:13:55.614918] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-27T18:13:56.162364] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T18:13:56.414994] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-27T18:13:57.118365] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-27T18:13:57.214937] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-27T18:13:57.753249] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-27T18:13:57.781515] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-27T18:13:58.014950] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-27T18:13:58.814922] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-27T18:13:59.055710] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T18:13:59.614940] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-27T18:14:00.165741] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-27T18:14:00.414951] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-27T18:14:01.214942] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-27T18:14:02.014953] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-27T18:14:02.263228] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-27T18:14:02.814969] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-27T18:14:04.386082] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-27T18:14:04.391318] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-27T18:14:04.869789] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (4.45 seconds). [2025-10-27T18:14:04.882255] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-27T18:14:05.619902] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-10-27T18:14:05.630372] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-27T18:14:06.274023] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (5.06 seconds). [2025-10-27T18:14:06.285072] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-27T18:14:06.371553] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T18:14:06.376055] [INFO ] [REMOTE ] DAO: Full fetch complete (32700 records). [2025-10-27T18:14:06.376131] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-27T18:14:06.770093] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-27T18:14:06.770171] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-27T18:14:06.770668] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-27T18:14:06.770732] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-27T18:14:06.771409] [DEBUG] [LOCAL ] DAO: Trimmed 32700 records to 19588 (keeping 200 days of data) [2025-10-27T18:14:06.896455] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-27T18:14:06.916084] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-27T18:14:06.920832] [DEBUG] [LOCAL ] DAO: Primary data saved (19588 records). [2025-10-27T18:14:06.921076] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-27T18:14:06.921225] [INFO ] [MAIN ] Update Progress: 586/2366 symbols completed. DAO took 26.0s. Estimated remaining: 3h 44m 59s. Rate: 7.9 symbols/min [2025-10-27T18:14:07.100713] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:14:07.138862] [DEBUG] [LOCAL ] DAVA: Loaded 42531 existing records from primary storage. [2025-10-27T18:14:07.139279] [INFO ] [MAIN ] DAVA: Loaded 42531 existing records. [2025-10-27T18:14:07.282252] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-27T18:14:07.369871] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:14:07.370065] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-27T18:14:07.370111] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-27T18:14:07.370328] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-27T18:14:07.370365] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-27T18:14:07.621458] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-27T18:14:07.733612] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:14:08.417246] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-27T18:14:08.420562] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-27T18:14:08.661223] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-27T18:14:09.184918] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-27T18:14:09.194388] [INFO ] [REMOTE ] DAN: Full fetch complete (71396 records). [2025-10-27T18:14:09.194499] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-27T18:14:09.225757] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-27T18:14:09.623294] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-27T18:14:09.623456] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-27T18:14:09.624364] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-27T18:14:09.624451] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-27T18:14:09.645769] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T18:14:09.652286] [DEBUG] [LOCAL ] DAN: Trimmed 71396 records to 49315 (keeping 200 days of data) [2025-10-27T18:14:09.936402] [DEBUG] [LOCAL ] DAN: Primary data saved (49315 records). [2025-10-27T18:14:09.936525] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-27T18:14:09.936597] [INFO ] [MAIN ] Update Progress: 587/2366 symbols completed. DAN took 31.6s. Estimated remaining: 3h 44m 37s. Rate: 7.9 symbols/min [2025-10-27T18:14:10.020094] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-27T18:14:10.108853] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:14:10.151422] [DEBUG] [LOCAL ] DAY: Loaded 49840 existing records from primary storage. [2025-10-27T18:14:10.151760] [INFO ] [MAIN ] DAY: Loaded 49840 existing records. [2025-10-27T18:14:10.329820] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:14:10.330033] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-27T18:14:10.330082] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-27T18:14:10.330289] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-27T18:14:10.330345] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-27T18:14:10.699046] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:14:10.814932] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-27T18:14:11.081531] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-27T18:14:11.599303] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T18:14:11.614919] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-27T18:14:12.414947] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-27T18:14:12.482284] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T18:14:13.214958] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-27T18:14:13.933898] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T18:14:14.014935] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-27T18:14:14.114553] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-27T18:14:14.124464] [INFO ] [REMOTE ] DAR: Full fetch complete (75206 records). [2025-10-27T18:14:14.124604] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-27T18:14:14.539029] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-27T18:14:14.539155] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-27T18:14:14.540085] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-27T18:14:14.540161] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-27T18:14:14.541906] [DEBUG] [LOCAL ] DAR: Trimmed 75206 records to 51980 (keeping 200 days of data) [2025-10-27T18:14:14.676716] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-27T18:14:14.696728] [INFO ] [REMOTE ] DAL: Full fetch complete (77541 records). [2025-10-27T18:14:14.696899] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-27T18:14:14.698293] [FATAL] [VALIDATOR ] DAL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:14:14.761414] [FATAL] [MAIN ] DAL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:14:14.796867] [WARN ] [MAIN ] DAL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:14:14.810817] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-27T18:14:14.811520] [DEBUG] [LOCAL ] DAL: No primary data file found to delete. [2025-10-27T18:14:14.813231] [INFO ] [LOCAL ] DAL: Starting deletion of derivative data. [2025-10-27T18:14:14.813712] [DEBUG] [LOCAL ] DAL: Deleted derivative data file. [2025-10-27T18:14:14.817380] [INFO ] [MAIN ] Update Progress: 588/2366 symbols completed. DAL took 46.3s. Estimated remaining: 3h 44m 22s. Rate: 7.9 symbols/min [2025-10-27T18:14:14.816662] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-27T18:14:15.101577] [DEBUG] [LOCAL ] DAR: Primary data saved (51980 records). [2025-10-27T18:14:15.096757] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:14:15.101956] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-27T18:14:15.102536] [INFO ] [MAIN ] Update Progress: 589/2366 symbols completed. DAR took 29.4s. Estimated remaining: 3h 43m 52s. Rate: 7.9 symbols/min [2025-10-27T18:14:15.124931] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-27T18:14:15.288169] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:14:15.328149] [DEBUG] [LOCAL ] DB: Loaded 53198 existing records from primary storage. [2025-10-27T18:14:15.328522] [INFO ] [MAIN ] DB: Loaded 53198 existing records. [2025-10-27T18:14:15.439543] [DEBUG] [LOCAL ] DBD: Loaded 24906 existing records from primary storage. [2025-10-27T18:14:15.440088] [INFO ] [MAIN ] DBD: Loaded 24906 existing records. [2025-10-27T18:14:15.621088] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-27T18:14:15.624383] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:14:15.629855] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-27T18:14:15.640995] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-27T18:14:15.665708] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-27T18:14:15.679625] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-27T18:14:15.740766] [WARN ] [MAIN ] DBD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:14:15.783084] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-27T18:14:15.806496] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-27T18:14:15.823931] [DEBUG] [LOCAL ] DBD: Deleted primary data file. [2025-10-27T18:14:15.834355] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-27T18:14:16.379959] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:14:16.417765] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-27T18:14:16.471215] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:14:16.490593] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-27T18:14:16.993812] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T18:14:17.214964] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-27T18:14:17.944881] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T18:14:18.014911] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-27T18:14:18.063455] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-27T18:14:18.814963] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-27T18:14:19.453817] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T18:14:19.477815] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T18:14:19.614923] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-27T18:14:20.414979] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-27T18:14:20.661107] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-27T18:14:21.214965] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-27T18:14:21.750155] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T18:14:22.020236] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-27T18:14:22.028585] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-27T18:14:22.814942] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-27T18:14:23.248701] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-27T18:14:23.614969] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-27T18:14:24.275220] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-27T18:14:24.326942] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T18:14:24.414980] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-27T18:14:25.214945] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-27T18:14:25.883597] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T18:14:26.014953] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-27T18:14:26.804700] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T18:14:26.814899] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-27T18:14:27.597511] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T18:14:27.614894] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-27T18:14:28.394310] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T18:14:28.414901] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-27T18:14:28.541620] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-27T18:14:29.214976] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-27T18:14:30.014923] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-27T18:14:30.278397] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-27T18:14:30.583859] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T18:14:30.815230] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-27T18:14:31.032238] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-27T18:14:31.615039] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-27T18:14:32.155027] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T18:14:32.414987] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-27T18:14:32.672530] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T18:14:33.215017] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-27T18:14:33.829873] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T18:14:34.014933] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-27T18:14:34.775325] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T18:14:34.814968] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-27T18:14:34.941761] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-27T18:14:35.614954] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-27T18:14:36.414920] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-27T18:14:36.602682] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-27T18:14:36.702368] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-27T18:14:37.214936] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-27T18:14:37.648249] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T18:14:38.014913] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-27T18:14:38.261683] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-27T18:14:38.814965] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-27T18:14:39.360262] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T18:14:39.614931] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-27T18:14:40.414944] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-27T18:14:40.632601] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-27T18:14:40.980785] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-27T18:14:40.989785] [INFO ] [REMOTE ] DAVA: Full fetch complete (57407 records). [2025-10-27T18:14:40.989932] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-27T18:14:41.220026] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-27T18:14:41.341630] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T18:14:41.381831] [INFO ] [REMOTE ] DBD: Full fetch complete (32137 records). [2025-10-27T18:14:41.398301] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-27T18:14:41.417618] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-27T18:14:41.418099] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-27T18:14:41.418015] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:14:41.418937] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-27T18:14:41.419018] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-27T18:14:41.419193] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:14:41.419264] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:14:41.419333] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-27T18:14:41.419555] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-27T18:14:41.419663] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-27T18:14:41.419910] [DEBUG] [LOCAL ] DBD: Deleted derivative data file. [2025-10-27T18:14:41.420030] [INFO ] [MAIN ] Update Progress: 590/2366 symbols completed. DBD took 26.3s. Estimated remaining: 3h 44m 41s. Rate: 7.9 symbols/min [2025-10-27T18:14:41.451870] [DEBUG] [LOCAL ] DAVA: Trimmed 57407 records to 41895 (keeping 200 days of data) [2025-10-27T18:14:41.712295] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:14:41.862946] [DEBUG] [LOCAL ] DAVA: Primary data saved (41895 records). [2025-10-27T18:14:41.863072] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-27T18:14:41.863964] [INFO ] [MAIN ] Update Progress: 591/2366 symbols completed. DAVA took 34.9s. Estimated remaining: 3h 44m 12s. Rate: 7.9 symbols/min [2025-10-27T18:14:41.896312] [DEBUG] [LOCAL ] DBI: Loaded 43873 existing records from primary storage. [2025-10-27T18:14:41.933822] [INFO ] [MAIN ] DBI: Loaded 43873 existing records. [2025-10-27T18:14:42.029117] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-27T18:14:42.195749] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:14:42.225159] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:14:42.225431] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-27T18:14:42.225478] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-27T18:14:42.225729] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-27T18:14:42.225785] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-27T18:14:42.332151] [DEBUG] [LOCAL ] DBL: Loaded 9473 existing records from primary storage. [2025-10-27T18:14:42.343081] [INFO ] [MAIN ] DBL: Loaded 9473 existing records. [2025-10-27T18:14:42.693999] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:14:42.694430] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-27T18:14:42.694511] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-27T18:14:42.705161] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-10-27T18:14:42.715421] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-27T18:14:42.895434] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:14:42.900879] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-27T18:14:43.135329] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:14:43.285112] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-27T18:14:43.295101] [INFO ] [REMOTE ] DB: Full fetch complete (75710 records). [2025-10-27T18:14:43.295222] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-27T18:14:43.621748] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-27T18:14:43.678830] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-27T18:14:43.679066] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-27T18:14:43.680042] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-27T18:14:43.680105] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-27T18:14:43.681463] [DEBUG] [LOCAL ] DB: Trimmed 75710 records to 52404 (keeping 200 days of data) [2025-10-27T18:14:43.988167] [DEBUG] [LOCAL ] DB: Primary data saved (52404 records). [2025-10-27T18:14:43.988282] [INFO ] [MAIN ] DB: Full history saved. [2025-10-27T18:14:43.988770] [INFO ] [MAIN ] Update Progress: 592/2366 symbols completed. DB took 29.2s. Estimated remaining: 3h 43m 48s. Rate: 7.9 symbols/min [2025-10-27T18:14:44.168300] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-27T18:14:44.197259] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:14:44.247229] [DEBUG] [LOCAL ] DBRG: Loaded 50733 existing records from primary storage. [2025-10-27T18:14:44.247512] [INFO ] [MAIN ] DBRG: Loaded 50733 existing records. [2025-10-27T18:14:44.426816] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:14:44.427341] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-27T18:14:44.427402] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-27T18:14:44.423777] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-27T18:14:44.428174] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-27T18:14:44.428232] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-27T18:14:44.532409] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-27T18:14:44.754932] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-27T18:14:44.846984] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:14:45.214993] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-27T18:14:45.706114] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T18:14:45.744756] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T18:14:46.014934] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-27T18:14:46.814998] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-27T18:14:47.325768] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-27T18:14:47.614973] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-27T18:14:47.909585] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-27T18:14:47.918521] [INFO ] [REMOTE ] DAY: Full fetch complete (71898 records). [2025-10-27T18:14:47.918628] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-27T18:14:48.290977] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-27T18:14:48.315418] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-27T18:14:48.315489] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-27T18:14:48.316291] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-27T18:14:48.316353] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-27T18:14:48.317625] [DEBUG] [LOCAL ] DAY: Trimmed 71898 records to 49047 (keeping 200 days of data) [2025-10-27T18:14:48.414922] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-27T18:14:48.597381] [DEBUG] [LOCAL ] DAY: Primary data saved (49047 records). [2025-10-27T18:14:48.597516] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-27T18:14:48.597614] [INFO ] [MAIN ] Update Progress: 593/2366 symbols completed. DAY took 38.7s. Estimated remaining: 3h 43m 31s. Rate: 7.9 symbols/min [2025-10-27T18:14:48.764510] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:14:48.798351] [DEBUG] [LOCAL ] DCI: Loaded 37402 existing records from primary storage. [2025-10-27T18:14:48.798623] [INFO ] [MAIN ] DCI: Loaded 37402 existing records. [2025-10-27T18:14:48.988370] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:14:48.988571] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-27T18:14:48.988617] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-27T18:14:48.988814] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-27T18:14:48.988863] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-27T18:14:49.220128] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-27T18:14:49.349216] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:14:50.014904] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-27T18:14:50.103968] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-27T18:14:50.679030] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-27T18:14:50.814946] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-27T18:14:51.279749] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T18:14:51.614992] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-27T18:14:52.225723] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-27T18:14:52.414997] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-27T18:14:52.670486] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T18:14:53.149609] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T18:14:53.214917] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-27T18:14:53.848383] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-27T18:14:54.014905] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-27T18:14:54.814932] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-27T18:14:55.156828] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T18:14:55.347446] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-27T18:14:55.614924] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-27T18:14:56.414941] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-27T18:14:56.885676] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-27T18:14:57.121279] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T18:14:57.214929] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-27T18:14:58.014946] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-27T18:14:58.073544] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T18:14:58.075666] [INFO ] [REMOTE ] DBL: Full fetch complete (12810 records). [2025-10-27T18:14:58.075739] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-27T18:14:58.430110] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-27T18:14:58.430185] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-27T18:14:58.430475] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-27T18:14:58.430512] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-27T18:14:58.430987] [DEBUG] [LOCAL ] DBL: Trimmed 12810 records to 9267 (keeping 200 days of data) [2025-10-27T18:14:58.486411] [DEBUG] [LOCAL ] DBL: Primary data saved (9267 records). [2025-10-27T18:14:58.486533] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-27T18:14:58.486607] [INFO ] [MAIN ] Update Progress: 594/2366 symbols completed. DBL took 16.6s. Estimated remaining: 3h 43m 31s. Rate: 7.9 symbols/min [2025-10-27T18:14:58.652538] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:14:58.670693] [DEBUG] [LOCAL ] DCO: Loaded 15231 existing records from primary storage. [2025-10-27T18:14:58.670930] [INFO ] [MAIN ] DCO: Loaded 15231 existing records. [2025-10-27T18:14:58.820087] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-27T18:14:58.848438] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:14:58.848780] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-27T18:14:58.848839] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-27T18:14:58.848995] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-10-27T18:14:58.849034] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-27T18:14:59.229908] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:14:59.290372] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T18:14:59.614984] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-27T18:15:00.414991] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-27T18:15:00.501436] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T18:15:01.214935] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-27T18:15:01.601051] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-27T18:15:02.014925] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-27T18:15:02.814959] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-27T18:15:03.936024] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (3.52 seconds). [2025-10-27T18:15:03.938625] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-27T18:15:04.886932] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (3.67 seconds). [2025-10-27T18:15:04.898371] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-27T18:15:04.982084] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T18:15:05.214979] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-27T18:15:05.554560] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (3.54 seconds). [2025-10-27T18:15:06.014946] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-27T18:15:06.129614] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (3.31 seconds). [2025-10-27T18:15:06.504926] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-27T18:15:06.522246] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T18:15:06.814952] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-27T18:15:07.379879] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-27T18:15:07.614937] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-27T18:15:08.311171] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-27T18:15:08.414904] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-27T18:15:09.214930] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-27T18:15:09.269987] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T18:15:09.888896] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T18:15:10.014955] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-27T18:15:10.353511] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T18:15:10.814944] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-27T18:15:11.348551] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T18:15:11.615009] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-27T18:15:12.414980] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-27T18:15:12.495136] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-27T18:15:13.214957] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-27T18:15:13.292286] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T18:15:13.411196] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T18:15:14.014988] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-27T18:15:14.134326] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-27T18:15:14.814953] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-27T18:15:15.491688] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T18:15:15.614939] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-27T18:15:16.034042] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T18:15:16.041272] [INFO ] [REMOTE ] DBI: Full fetch complete (64528 records). [2025-10-27T18:15:16.041439] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-27T18:15:16.424606] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-27T18:15:16.445831] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-27T18:15:16.445911] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-27T18:15:16.446729] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-27T18:15:16.446793] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-27T18:15:16.448062] [DEBUG] [LOCAL ] DBI: Trimmed 64528 records to 43009 (keeping 200 days of data) [2025-10-27T18:15:16.689768] [DEBUG] [LOCAL ] DBI: Primary data saved (43009 records). [2025-10-27T18:15:16.689893] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-27T18:15:16.689969] [INFO ] [MAIN ] Update Progress: 595/2366 symbols completed. DBI took 35.3s. Estimated remaining: 3h 43m 55s. Rate: 7.9 symbols/min [2025-10-27T18:15:16.864010] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:15:16.931819] [DEBUG] [LOCAL ] DD: Loaded 53685 existing records from primary storage. [2025-10-27T18:15:16.932618] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T18:15:16.940680] [INFO ] [MAIN ] DD: Loaded 53685 existing records. [2025-10-27T18:15:17.112480] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:15:17.112705] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-27T18:15:17.112761] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-27T18:15:17.112968] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-27T18:15:17.113023] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-27T18:15:17.220131] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-27T18:15:17.464703] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:15:17.570894] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T18:15:18.014978] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-27T18:15:18.232889] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-27T18:15:18.815023] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-27T18:15:19.480106] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T18:15:19.614939] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-27T18:15:20.192559] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T18:15:20.414949] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-27T18:15:21.218562] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-27T18:15:21.221354] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-27T18:15:22.007954] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T18:15:22.017685] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-27T18:15:22.265180] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-27T18:15:22.814935] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-27T18:15:23.371713] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T18:15:23.378429] [INFO ] [REMOTE ] DCI: Full fetch complete (53773 records). [2025-10-27T18:15:23.378514] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-27T18:15:23.620182] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-27T18:15:23.756999] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-27T18:15:23.757100] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-27T18:15:23.757857] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-27T18:15:23.757918] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-27T18:15:23.758951] [DEBUG] [LOCAL ] DCI: Trimmed 53773 records to 36620 (keeping 200 days of data) [2025-10-27T18:15:23.965754] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-27T18:15:23.990081] [DEBUG] [LOCAL ] DCI: Primary data saved (36620 records). [2025-10-27T18:15:23.990544] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-27T18:15:23.990632] [INFO ] [MAIN ] Update Progress: 596/2366 symbols completed. DCI took 35.4s. Estimated remaining: 3h 43m 47s. Rate: 7.9 symbols/min [2025-10-27T18:15:24.153256] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:15:24.198635] [DEBUG] [LOCAL ] DDD: Loaded 51686 existing records from primary storage. [2025-10-27T18:15:24.198947] [INFO ] [MAIN ] DDD: Loaded 51686 existing records. [2025-10-27T18:15:24.374340] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:15:24.374552] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-27T18:15:24.374607] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-27T18:15:24.374808] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-27T18:15:24.374861] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-27T18:15:24.420136] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-27T18:15:24.720574] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:15:25.214936] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-27T18:15:25.565845] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T18:15:25.717546] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-27T18:15:25.727463] [INFO ] [REMOTE ] DBRG: Full fetch complete (72626 records). [2025-10-27T18:15:25.727591] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-27T18:15:26.020059] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-27T18:15:26.119179] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-27T18:15:26.119266] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-27T18:15:26.120168] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-27T18:15:26.120239] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-27T18:15:26.121807] [DEBUG] [LOCAL ] DBRG: Trimmed 72626 records to 49964 (keeping 200 days of data) [2025-10-27T18:15:26.413862] [DEBUG] [LOCAL ] DBRG: Primary data saved (49964 records). [2025-10-27T18:15:26.413983] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-27T18:15:26.414412] [INFO ] [MAIN ] Update Progress: 597/2366 symbols completed. DBRG took 42.4s. Estimated remaining: 3h 43m 24s. Rate: 7.9 symbols/min [2025-10-27T18:15:26.814943] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-27T18:15:26.854328] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T18:15:27.361691] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-27T18:15:27.365597] [INFO ] [REMOTE ] DCO: Full fetch complete (19739 records). [2025-10-27T18:15:27.365731] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-27T18:15:27.366167] [FATAL] [VALIDATOR ] DCO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:15:27.366249] [FATAL] [MAIN ] DCO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:15:27.366290] [WARN ] [MAIN ] DCO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:15:27.366355] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-27T18:15:27.366418] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-27T18:15:27.366452] [INFO ] [LOCAL ] DCO: Starting deletion of derivative data. [2025-10-27T18:15:27.366613] [DEBUG] [LOCAL ] DCO: Deleted derivative data file. [2025-10-27T18:15:27.366737] [INFO ] [MAIN ] Update Progress: 598/2366 symbols completed. DCO took 28.9s. Estimated remaining: 3h 42m 56s. Rate: 7.9 symbols/min [2025-10-27T18:15:27.614934] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-27T18:15:28.814821] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-27T18:15:28.824576] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-27T18:15:29.185253] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T18:15:29.214988] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-27T18:15:30.460263] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-27T18:15:30.469710] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-27T18:15:30.647939] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T18:15:30.814998] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-27T18:15:31.938547] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T18:15:31.949432] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-27T18:15:32.108381] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T18:15:32.415056] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-27T18:15:33.472225] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T18:15:33.482729] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-27T18:15:33.878830] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T18:15:34.014989] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-27T18:15:35.305668] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T18:15:35.316871] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-27T18:15:35.877534] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-27T18:15:35.888682] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-27T18:15:36.672976] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T18:15:36.683276] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-27T18:15:37.836277] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-27T18:15:37.847603] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-27T18:15:38.167230] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T18:15:38.178047] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-27T18:15:38.378806] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T18:15:38.389603] [INFO ] [REMOTE ] DD: Full fetch complete (76619 records). [2025-10-27T18:15:38.389813] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-27T18:15:38.792196] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-27T18:15:38.792290] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-27T18:15:38.793216] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-27T18:15:38.793310] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-27T18:15:38.794860] [DEBUG] [LOCAL ] DD: Trimmed 76619 records to 52906 (keeping 200 days of data) [2025-10-27T18:15:39.109739] [DEBUG] [LOCAL ] DD: Primary data saved (52906 records). [2025-10-27T18:15:39.109875] [INFO ] [MAIN ] DD: Full history saved. [2025-10-27T18:15:39.109952] [INFO ] [MAIN ] Update Progress: 599/2366 symbols completed. DD took 22.4s. Estimated remaining: 3h 43m 1s. Rate: 7.9 symbols/min [2025-10-27T18:15:39.839790] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T18:15:39.850288] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-27T18:15:41.156606] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T18:15:41.167432] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-27T18:15:43.011361] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-27T18:15:43.021549] [INFO ] [REMOTE ] DDD: Full fetch complete (74003 records). [2025-10-27T18:15:43.021761] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-27T18:15:43.409096] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-27T18:15:43.409180] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-27T18:15:43.409999] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-27T18:15:43.410067] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-27T18:15:43.411473] [DEBUG] [LOCAL ] DDD: Trimmed 74003 records to 50909 (keeping 200 days of data) [2025-10-27T18:15:43.692955] [DEBUG] [LOCAL ] DDD: Primary data saved (50909 records). [2025-10-27T18:15:43.693124] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-27T18:15:43.693215] [INFO ] [MAIN ] Update Progress: 600/2366 symbols completed. DDD took 19.7s. Estimated remaining: 3h 42m 45s. Rate: 7.9 symbols/min [2025-10-27T18:15:44.288308] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:15:44.375125] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:15:44.384169] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:15:44.415290] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:15:44.422435] [DEBUG] [LOCAL ] DDT: Loaded 1881 existing records from primary storage. [2025-10-27T18:15:44.422721] [INFO ] [MAIN ] DDT: Loaded 1881 existing records. [2025-10-27T18:15:44.458543] [DEBUG] [LOCAL ] DDS: Loaded 12448 existing records from primary storage. [2025-10-27T18:15:44.468094] [INFO ] [MAIN ] DDS: Loaded 12448 existing records. [2025-10-27T18:15:44.821092] [DEBUG] [LOCAL ] DDL: Loaded 37701 existing records from primary storage. [2025-10-27T18:15:44.851751] [INFO ] [MAIN ] DDL: Loaded 37701 existing records. [2025-10-27T18:15:44.915679] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:15:44.889845] [DEBUG] [LOCAL ] DE: Loaded 48206 existing records from primary storage. [2025-10-27T18:15:44.943551] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-27T18:15:44.943482] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:15:44.954343] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-27T18:15:44.943693] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-27T18:15:44.954562] [INFO ] [MAIN ] DE: Loaded 48206 existing records. [2025-10-27T18:15:44.959913] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-27T18:15:44.975877] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-10-27T18:15:44.981067] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-27T18:15:45.004436] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-27T18:15:44.999105] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-27T18:15:45.385306] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:15:45.418051] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-27T18:15:45.537283] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-27T18:15:45.597067] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:15:45.621319] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-27T18:15:45.631413] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-27T18:15:45.670091] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-27T18:15:45.678168] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-27T18:15:45.813313] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-27T18:15:45.956999] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-27T18:15:46.202983] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:15:46.222437] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-27T18:15:46.278111] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:15:46.348766] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-27T18:15:46.714841] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:15:46.730774] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-27T18:15:46.761913] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-27T18:15:46.773161] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-27T18:15:46.794572] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:15:46.795151] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-27T18:15:47.110003] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-27T18:15:47.111108] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-27T18:15:47.132303] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-27T18:15:47.135220] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-27T18:15:47.625949] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-27T18:15:47.627227] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-27T18:15:47.654864] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-27T18:15:47.661701] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-27T18:15:47.760249] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T18:15:47.764967] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-27T18:15:48.203943] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T18:15:48.407335] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T18:15:48.414897] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-27T18:15:48.521021] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T18:15:48.814989] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T18:15:49.120320] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-27T18:15:49.214977] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-27T18:15:49.775607] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-27T18:15:50.014944] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-27T18:15:50.533483] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-27T18:15:50.814953] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-27T18:15:51.614934] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-27T18:15:51.967798] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-27T18:15:52.338798] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T18:15:52.414954] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-27T18:15:53.214987] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-27T18:15:53.970892] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-27T18:15:54.014902] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-27T18:15:54.113480] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T18:15:54.462543] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-27T18:15:54.814986] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-27T18:15:55.614949] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-27T18:15:56.050226] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-27T18:15:56.377639] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T18:15:56.414915] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-27T18:15:57.214968] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-27T18:15:57.818231] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T18:15:58.013492] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-27T18:15:58.016716] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-27T18:15:58.625135] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T18:15:58.626032] [INFO ] [REMOTE ] DDT: Full fetch complete (2819 records). [2025-10-27T18:15:58.626099] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-27T18:15:58.820942] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-27T18:15:59.020158] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-27T18:15:59.020250] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-27T18:15:59.020375] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-27T18:15:59.020417] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-27T18:15:59.020783] [DEBUG] [LOCAL ] DDT: Trimmed 2819 records to 1794 (keeping 200 days of data) [2025-10-27T18:15:59.031815] [DEBUG] [LOCAL ] DDT: Primary data saved (1794 records). [2025-10-27T18:15:59.031876] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-27T18:15:59.031945] [INFO ] [MAIN ] Update Progress: 601/2366 symbols completed. DDT took 15.3s. Estimated remaining: 3h 43m 0s. Rate: 7.9 symbols/min [2025-10-27T18:15:59.209856] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:15:59.245557] [DEBUG] [LOCAL ] DEA: Loaded 40577 existing records from primary storage. [2025-10-27T18:15:59.245872] [INFO ] [MAIN ] DEA: Loaded 40577 existing records. [2025-10-27T18:15:59.424508] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:15:59.424737] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-27T18:15:59.424791] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-27T18:15:59.425038] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-10-27T18:15:59.425095] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-27T18:15:59.624267] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-27T18:15:59.779435] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:16:00.415163] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-27T18:16:00.656113] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-27T18:16:01.214967] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-27T18:16:02.014942] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-27T18:16:02.204310] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-27T18:16:02.814949] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-27T18:16:03.175597] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-10-27T18:16:03.614945] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-27T18:16:04.753522] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-27T18:16:04.756833] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-27T18:16:05.242672] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (3.23 seconds). [2025-10-27T18:16:05.254027] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-27T18:16:05.279890] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-27T18:16:05.320428] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (4.11 seconds). [2025-10-27T18:16:05.350712] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-27T18:16:06.014933] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-27T18:16:06.711465] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T18:16:06.814913] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-27T18:16:06.872714] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T18:16:07.614932] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-27T18:16:08.348872] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-27T18:16:08.414911] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-27T18:16:08.764992] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T18:16:09.214931] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-27T18:16:10.014953] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-27T18:16:10.149152] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T18:16:10.158481] [INFO ] [REMOTE ] DE: Full fetch complete (69915 records). [2025-10-27T18:16:10.158637] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-27T18:16:10.564331] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-27T18:16:10.564416] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-27T18:16:10.565199] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-27T18:16:10.565261] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-27T18:16:10.566563] [DEBUG] [LOCAL ] DE: Trimmed 69915 records to 47383 (keeping 200 days of data) [2025-10-27T18:16:10.815905] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-27T18:16:10.870187] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-27T18:16:10.965060] [DEBUG] [LOCAL ] DE: Primary data saved (47383 records). [2025-10-27T18:16:10.965499] [INFO ] [MAIN ] DE: Full history saved. [2025-10-27T18:16:10.965686] [INFO ] [MAIN ] Update Progress: 602/2366 symbols completed. DE took 27.3s. Estimated remaining: 3h 43m 5s. Rate: 7.9 symbols/min [2025-10-27T18:16:11.159317] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-27T18:16:11.241050] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:16:11.281997] [DEBUG] [LOCAL ] DEC: Loaded 30623 existing records from primary storage. [2025-10-27T18:16:11.282377] [INFO ] [MAIN ] DEC: Loaded 30623 existing records. [2025-10-27T18:16:11.544730] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:16:11.544972] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-27T18:16:11.545024] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-27T18:16:11.545293] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-27T18:16:11.545353] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-27T18:16:11.620211] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-27T18:16:11.775574] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T18:16:11.819066] [INFO ] [REMOTE ] DDS: Full fetch complete (18297 records). [2025-10-27T18:16:11.840851] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-27T18:16:12.311179] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:16:12.420157] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-27T18:16:12.534773] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-27T18:16:12.534866] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-27T18:16:12.535286] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-27T18:16:12.535328] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-27T18:16:12.535926] [DEBUG] [LOCAL ] DDS: Trimmed 18297 records to 11957 (keeping 200 days of data) [2025-10-27T18:16:12.611100] [DEBUG] [LOCAL ] DDS: Primary data saved (11957 records). [2025-10-27T18:16:12.611228] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-27T18:16:12.611308] [INFO ] [MAIN ] Update Progress: 603/2366 symbols completed. DDS took 28.9s. Estimated remaining: 3h 42m 40s. Rate: 7.9 symbols/min [2025-10-27T18:16:12.791175] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:16:12.844843] [DEBUG] [LOCAL ] DECK: Loaded 54081 existing records from primary storage. [2025-10-27T18:16:12.845180] [INFO ] [MAIN ] DECK: Loaded 54081 existing records. [2025-10-27T18:16:13.036005] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:16:13.036205] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-27T18:16:13.036279] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-27T18:16:13.036489] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-10-27T18:16:13.036531] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-27T18:16:13.222722] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-27T18:16:13.411772] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:16:13.448831] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-27T18:16:13.997310] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-27T18:16:14.014905] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-27T18:16:14.129252] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-27T18:16:14.814953] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-27T18:16:15.582528] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-27T18:16:15.614905] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-27T18:16:16.414999] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-27T18:16:16.791457] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-27T18:16:16.799445] [INFO ] [REMOTE ] DDL: Full fetch complete (53298 records). [2025-10-27T18:16:16.799574] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-27T18:16:16.800285] [FATAL] [VALIDATOR ] DDL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:16:16.800372] [FATAL] [MAIN ] DDL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:16:16.800414] [WARN ] [MAIN ] DDL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:16:16.800481] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-27T18:16:16.800544] [DEBUG] [LOCAL ] DDL: No primary data file found to delete. [2025-10-27T18:16:16.800579] [INFO ] [LOCAL ] DDL: Starting deletion of derivative data. [2025-10-27T18:16:16.800723] [DEBUG] [LOCAL ] DDL: Deleted derivative data file. [2025-10-27T18:16:16.800837] [INFO ] [MAIN ] Update Progress: 604/2366 symbols completed. DDL took 33.1s. Estimated remaining: 3h 42m 23s. Rate: 7.9 symbols/min [2025-10-27T18:16:16.934721] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-27T18:16:17.008364] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:16:17.050937] [DEBUG] [LOCAL ] DEI: Loaded 48983 existing records from primary storage. [2025-10-27T18:16:17.051237] [INFO ] [MAIN ] DEI: Loaded 48983 existing records. [2025-10-27T18:16:17.221934] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-27T18:16:17.227119] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:16:17.228207] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-27T18:16:17.228266] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-27T18:16:17.228500] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-27T18:16:17.228549] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-27T18:16:17.590886] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:16:17.639495] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T18:16:18.014931] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-27T18:16:18.814998] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-27T18:16:19.361381] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-27T18:16:19.614989] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-27T18:16:19.826563] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-27T18:16:20.346093] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T18:16:20.414919] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-27T18:16:21.214929] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-27T18:16:21.449444] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T18:16:21.621347] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-27T18:16:22.014971] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-27T18:16:22.745210] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T18:16:22.814958] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-27T18:16:23.401375] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T18:16:23.614935] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-27T18:16:23.771487] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T18:16:24.414966] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-27T18:16:24.672223] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T18:16:25.214995] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-27T18:16:26.014948] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-27T18:16:26.114267] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-27T18:16:26.331107] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-27T18:16:26.814958] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-27T18:16:27.365452] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-27T18:16:27.614972] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-27T18:16:28.414946] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-27T18:16:28.887915] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-27T18:16:29.220825] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-27T18:16:29.232673] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T18:16:30.015000] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-27T18:16:30.107211] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-27T18:16:30.825144] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-27T18:16:30.830368] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-27T18:16:31.614961] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-27T18:16:31.764130] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-27T18:16:31.803563] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-27T18:16:31.811164] [INFO ] [REMOTE ] DEA: Full fetch complete (61500 records). [2025-10-27T18:16:31.811270] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-27T18:16:32.204091] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-10-27T18:16:32.204170] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-10-27T18:16:32.204933] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-10-27T18:16:32.204994] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-10-27T18:16:32.206133] [DEBUG] [LOCAL ] DEA: Trimmed 61500 records to 39763 (keeping 200 days of data) [2025-10-27T18:16:32.415134] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-27T18:16:32.440587] [DEBUG] [LOCAL ] DEA: Primary data saved (39763 records). [2025-10-27T18:16:32.440716] [INFO ] [MAIN ] DEA: Full history saved. [2025-10-27T18:16:32.440800] [INFO ] [MAIN ] Update Progress: 605/2366 symbols completed. DEA took 33.4s. Estimated remaining: 3h 42m 39s. Rate: 7.9 symbols/min [2025-10-27T18:16:32.608810] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:16:32.666739] [DEBUG] [LOCAL ] DELL: Loaded 54516 existing records from primary storage. [2025-10-27T18:16:32.667078] [INFO ] [MAIN ] DELL: Loaded 54516 existing records. [2025-10-27T18:16:32.852850] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:16:32.853174] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-27T18:16:32.853311] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-27T18:16:32.853700] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-27T18:16:32.853828] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-27T18:16:33.152469] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T18:16:33.221695] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-27T18:16:33.252238] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:16:33.451490] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-27T18:16:34.015041] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-27T18:16:34.548104] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T18:16:34.815006] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-27T18:16:35.614976] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-27T18:16:36.149461] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-27T18:16:36.414978] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-27T18:16:36.529207] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-27T18:16:36.622772] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-27T18:16:37.214967] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-27T18:16:38.014926] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-27T18:16:38.288894] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-27T18:16:38.814923] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-27T18:16:39.423338] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-27T18:16:39.614937] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-27T18:16:40.013926] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T18:16:40.060958] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-27T18:16:40.414985] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-27T18:16:40.639812] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-27T18:16:41.214950] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-27T18:16:42.015000] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-27T18:16:42.339737] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-27T18:16:42.346493] [INFO ] [REMOTE ] DEC: Full fetch complete (44644 records). [2025-10-27T18:16:42.346711] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-27T18:16:42.594115] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-27T18:16:42.791821] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-27T18:16:42.791903] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-27T18:16:42.792535] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-27T18:16:42.792596] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-27T18:16:42.793548] [DEBUG] [LOCAL ] DEC: Trimmed 44644 records to 29884 (keeping 200 days of data) [2025-10-27T18:16:42.844065] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-27T18:16:42.968291] [DEBUG] [LOCAL ] DEC: Primary data saved (29884 records). [2025-10-27T18:16:42.968417] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-27T18:16:42.968503] [INFO ] [MAIN ] Update Progress: 606/2366 symbols completed. DEC took 32.0s. Estimated remaining: 3h 42m 40s. Rate: 7.9 symbols/min [2025-10-27T18:16:43.132695] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:16:43.177289] [DEBUG] [LOCAL ] DEO: Loaded 49926 existing records from primary storage. [2025-10-27T18:16:43.177576] [INFO ] [MAIN ] DEO: Loaded 49926 existing records. [2025-10-27T18:16:43.352170] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:16:43.352387] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-27T18:16:43.352441] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-27T18:16:43.352630] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-10-27T18:16:43.352729] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-27T18:16:43.615889] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-27T18:16:43.720712] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:16:43.749378] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-27T18:16:44.414935] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-27T18:16:44.926269] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-27T18:16:45.215003] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-27T18:16:45.402391] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-27T18:16:45.416556] [INFO ] [REMOTE ] DECK: Full fetch complete (76832 records). [2025-10-27T18:16:45.417574] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-27T18:16:45.418502] [FATAL] [VALIDATOR ] DECK: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:16:45.418627] [FATAL] [MAIN ] DECK: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:16:45.418732] [WARN ] [MAIN ] DECK: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:16:45.418781] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-27T18:16:45.418854] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-10-27T18:16:45.418911] [INFO ] [LOCAL ] DECK: Starting deletion of derivative data. [2025-10-27T18:16:45.419712] [DEBUG] [LOCAL ] DECK: Deleted derivative data file. [2025-10-27T18:16:45.420538] [INFO ] [MAIN ] Update Progress: 607/2366 symbols completed. DECK took 32.8s. Estimated remaining: 3h 42m 17s. Rate: 7.9 symbols/min [2025-10-27T18:16:45.593804] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:16:45.627966] [DEBUG] [LOCAL ] DFH: Loaded 31992 existing records from primary storage. [2025-10-27T18:16:45.628239] [INFO ] [MAIN ] DFH: Loaded 31992 existing records. [2025-10-27T18:16:45.810881] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:16:45.811202] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-27T18:16:45.811357] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-27T18:16:45.811555] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-27T18:16:45.811595] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-27T18:16:46.029115] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-27T18:16:46.192999] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-27T18:16:46.235484] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:16:46.814954] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-27T18:16:47.347242] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-27T18:16:47.615000] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-27T18:16:47.932500] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T18:16:48.054782] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-27T18:16:48.414943] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-27T18:16:49.214984] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-27T18:16:49.593325] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-27T18:16:49.758847] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T18:16:50.014999] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-27T18:16:50.626635] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T18:16:50.814921] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-27T18:16:51.614973] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-27T18:16:51.974301] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-27T18:16:52.310676] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-27T18:16:52.322861] [INFO ] [REMOTE ] DEI: Full fetch complete (69911 records). [2025-10-27T18:16:52.322999] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-27T18:16:52.421033] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-27T18:16:52.702406] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-27T18:16:52.702492] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-27T18:16:52.703293] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-27T18:16:52.703355] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-27T18:16:52.704749] [DEBUG] [LOCAL ] DEI: Trimmed 69911 records to 48162 (keeping 200 days of data) [2025-10-27T18:16:52.985888] [DEBUG] [LOCAL ] DEI: Primary data saved (48162 records). [2025-10-27T18:16:52.985999] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-27T18:16:52.986077] [INFO ] [MAIN ] Update Progress: 608/2366 symbols completed. DEI took 36.2s. Estimated remaining: 3h 42m 10s. Rate: 7.9 symbols/min [2025-10-27T18:16:53.154690] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:16:53.175899] [DEBUG] [LOCAL ] DFIN: Loaded 22669 existing records from primary storage. [2025-10-27T18:16:53.176159] [INFO ] [MAIN ] DFIN: Loaded 22669 existing records. [2025-10-27T18:16:53.238636] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-27T18:16:53.358081] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:16:53.358268] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-27T18:16:53.358315] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-27T18:16:53.358461] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-27T18:16:53.358500] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-27T18:16:53.714812] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:16:53.774343] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-27T18:16:53.951499] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T18:16:54.014904] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-27T18:16:54.475403] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T18:16:54.814982] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-27T18:16:55.614975] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-27T18:16:55.629353] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T18:16:55.684623] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T18:16:56.414994] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-27T18:16:57.051490] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T18:16:57.214916] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-27T18:16:57.477935] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T18:16:58.014976] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-27T18:16:58.416441] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T18:16:58.814958] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-27T18:16:58.907370] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-27T18:16:59.614947] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-27T18:17:00.415001] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-27T18:17:01.215017] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-27T18:17:01.759004] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-27T18:17:01.905899] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (3.09 seconds). [2025-10-27T18:17:02.014963] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-27T18:17:02.814919] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-27T18:17:03.859035] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (3.44 seconds). [2025-10-27T18:17:03.867202] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-27T18:17:05.200058] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-27T18:17:05.205231] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-27T18:17:05.367549] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (4.15 seconds). [2025-10-27T18:17:05.378117] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-27T18:17:05.448019] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (3.43 seconds). [2025-10-27T18:17:06.014945] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-27T18:17:06.141963] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-27T18:17:06.486408] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T18:17:06.814949] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-27T18:17:07.068723] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T18:17:07.614949] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-27T18:17:07.841303] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-27T18:17:07.969601] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-27T18:17:08.414994] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-27T18:17:08.628338] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-27T18:17:09.214360] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T18:17:09.218866] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-27T18:17:10.014930] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-27T18:17:10.726451] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T18:17:10.814962] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-27T18:17:11.184909] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T18:17:11.614942] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-27T18:17:12.414940] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-27T18:17:12.889545] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-27T18:17:13.215000] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-27T18:17:13.264955] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-27T18:17:13.269748] [INFO ] [REMOTE ] DFIN: Full fetch complete (33497 records). [2025-10-27T18:17:13.269864] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-27T18:17:13.661173] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-27T18:17:13.661250] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-27T18:17:13.661764] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-27T18:17:13.661825] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-27T18:17:13.662573] [DEBUG] [LOCAL ] DFIN: Trimmed 33497 records to 22124 (keeping 200 days of data) [2025-10-27T18:17:13.818487] [DEBUG] [LOCAL ] DFIN: Primary data saved (22124 records). [2025-10-27T18:17:13.820449] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (3.01 seconds). [2025-10-27T18:17:13.819103] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-27T18:17:13.820616] [INFO ] [MAIN ] Update Progress: 609/2366 symbols completed. DFIN took 20.8s. Estimated remaining: 3h 42m 40s. Rate: 7.9 symbols/min [2025-10-27T18:17:13.887627] [INFO ] [REMOTE ] DELL: Full fetch complete (77915 records). [2025-10-27T18:17:13.902014] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-27T18:17:14.020029] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-27T18:17:14.149835] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:17:14.298145] [DEBUG] [LOCAL ] DFP: Loaded 11137 existing records from primary storage. [2025-10-27T18:17:14.354452] [INFO ] [MAIN ] DFP: Loaded 11137 existing records. [2025-10-27T18:17:14.604201] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-27T18:17:14.722877] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-27T18:17:14.726021] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-27T18:17:14.730159] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-27T18:17:14.730286] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-27T18:17:14.753495] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:17:14.753837] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-27T18:17:14.754065] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-27T18:17:14.754572] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-27T18:17:14.754636] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-27T18:17:14.786137] [DEBUG] [LOCAL ] DELL: Trimmed 77915 records to 53736 (keeping 200 days of data) [2025-10-27T18:17:14.819220] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-27T18:17:15.517148] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:17:15.530639] [DEBUG] [LOCAL ] DELL: Primary data saved (53736 records). [2025-10-27T18:17:15.530848] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-27T18:17:15.530945] [INFO ] [MAIN ] Update Progress: 610/2366 symbols completed. DELL took 43.1s. Estimated remaining: 3h 42m 16s. Rate: 7.9 symbols/min [2025-10-27T18:17:15.621309] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-27T18:17:15.701210] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:17:15.754975] [DEBUG] [LOCAL ] DG: Loaded 54007 existing records from primary storage. [2025-10-27T18:17:15.755359] [INFO ] [MAIN ] DG: Loaded 54007 existing records. [2025-10-27T18:17:15.935904] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:17:15.936469] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-27T18:17:15.936752] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-27T18:17:15.937326] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-27T18:17:15.937454] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-27T18:17:16.246034] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T18:17:16.268490] [INFO ] [REMOTE ] DFH: Full fetch complete (47151 records). [2025-10-27T18:17:16.293137] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-27T18:17:16.402584] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:17:16.437623] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-27T18:17:16.433403] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-27T18:17:16.712075] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-27T18:17:16.816886] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-27T18:17:16.817018] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-27T18:17:16.818135] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-27T18:17:16.818203] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-27T18:17:16.819462] [DEBUG] [LOCAL ] DFH: Trimmed 47151 records to 31185 (keeping 200 days of data) [2025-10-27T18:17:17.017831] [DEBUG] [LOCAL ] DFH: Primary data saved (31185 records). [2025-10-27T18:17:17.018052] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-27T18:17:17.018162] [INFO ] [MAIN ] Update Progress: 611/2366 symbols completed. DFH took 31.6s. Estimated remaining: 3h 41m 51s. Rate: 7.9 symbols/min [2025-10-27T18:17:17.191124] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:17:17.222444] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-27T18:17:17.244925] [DEBUG] [LOCAL ] DGX: Loaded 45266 existing records from primary storage. [2025-10-27T18:17:17.245409] [INFO ] [MAIN ] DGX: Loaded 45266 existing records. [2025-10-27T18:17:17.429983] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:17:17.430351] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-27T18:17:17.430408] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-27T18:17:17.430758] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-10-27T18:17:17.430836] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-27T18:17:17.817864] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:17:18.014928] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-27T18:17:18.067573] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-27T18:17:18.814940] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-27T18:17:18.837949] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-27T18:17:19.264334] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-27T18:17:19.275880] [INFO ] [REMOTE ] DEO: Full fetch complete (71748 records). [2025-10-27T18:17:19.276130] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-27T18:17:19.620211] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-27T18:17:19.706094] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-10-27T18:17:19.706274] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-10-27T18:17:19.707746] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-10-27T18:17:19.707875] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-10-27T18:17:19.709857] [DEBUG] [LOCAL ] DEO: Trimmed 71748 records to 49158 (keeping 200 days of data) [2025-10-27T18:17:20.045315] [DEBUG] [LOCAL ] DEO: Primary data saved (49158 records). [2025-10-27T18:17:20.045740] [INFO ] [MAIN ] DEO: Full history saved. [2025-10-27T18:17:20.045889] [INFO ] [MAIN ] Update Progress: 612/2366 symbols completed. DEO took 37.1s. Estimated remaining: 3h 41m 30s. Rate: 7.9 symbols/min [2025-10-27T18:17:20.230614] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:17:20.270535] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-27T18:17:20.287872] [DEBUG] [LOCAL ] DHF: Loaded 21021 existing records from primary storage. [2025-10-27T18:17:20.288221] [INFO ] [MAIN ] DHF: Loaded 21021 existing records. [2025-10-27T18:17:20.420118] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-27T18:17:20.476183] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:17:20.476498] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-27T18:17:20.476553] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-27T18:17:20.476841] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-27T18:17:20.476900] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-27T18:17:20.862931] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:17:21.108034] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-27T18:17:21.214946] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-27T18:17:22.014925] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-27T18:17:22.102803] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-27T18:17:22.129227] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-27T18:17:22.536227] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-27T18:17:22.814950] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-27T18:17:23.614989] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-27T18:17:24.190131] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T18:17:24.414956] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-27T18:17:24.737879] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-27T18:17:25.214991] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-27T18:17:25.567074] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-27T18:17:26.014989] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-27T18:17:26.814939] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-27T18:17:27.466542] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-27T18:17:27.504829] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-27T18:17:27.614920] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-27T18:17:27.952463] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-27T18:17:28.414944] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-27T18:17:29.208060] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-27T18:17:29.214888] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-27T18:17:29.256511] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T18:17:30.014931] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-27T18:17:30.256929] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T18:17:30.814943] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-27T18:17:31.060206] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-27T18:17:31.504920] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-27T18:17:31.614979] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-27T18:17:32.410434] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-27T18:17:32.414894] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-27T18:17:32.928804] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-27T18:17:33.214941] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-27T18:17:33.833993] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-27T18:17:34.014939] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-27T18:17:34.815005] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-27T18:17:35.615543] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-27T18:17:35.615007] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-27T18:17:35.779570] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-27T18:17:36.215158] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T18:17:36.414986] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-27T18:17:37.214923] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-27T18:17:37.598765] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T18:17:38.014950] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-27T18:17:38.820232] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-27T18:17:38.832273] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-27T18:17:38.961448] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-27T18:17:39.614946] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-27T18:17:40.237158] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T18:17:40.332029] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T18:17:40.335614] [INFO ] [REMOTE ] DHF: Full fetch complete (29963 records). [2025-10-27T18:17:40.335711] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-27T18:17:40.420064] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-27T18:17:40.711583] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-27T18:17:40.711717] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-27T18:17:40.712471] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-27T18:17:40.712537] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-27T18:17:40.713393] [DEBUG] [LOCAL ] DHF: Trimmed 29963 records to 20579 (keeping 200 days of data) [2025-10-27T18:17:40.832716] [DEBUG] [LOCAL ] DHF: Primary data saved (20579 records). [2025-10-27T18:17:40.832879] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-27T18:17:40.832975] [INFO ] [MAIN ] Update Progress: 613/2366 symbols completed. DHF took 20.8s. Estimated remaining: 3h 42m 0s. Rate: 7.9 symbols/min [2025-10-27T18:17:41.000548] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:17:41.050498] [DEBUG] [LOCAL ] DHI: Loaded 54132 existing records from primary storage. [2025-10-27T18:17:41.050827] [INFO ] [MAIN ] DHI: Loaded 54132 existing records. [2025-10-27T18:17:41.219213] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-27T18:17:41.222872] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:17:41.224146] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-27T18:17:41.224208] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-27T18:17:41.224406] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-27T18:17:41.224461] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-27T18:17:41.586779] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:17:42.014926] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-27T18:17:42.104877] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-27T18:17:42.685073] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-27T18:17:42.814921] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-27T18:17:42.858554] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-27T18:17:43.614963] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-27T18:17:44.414987] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-27T18:17:44.793999] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-27T18:17:45.023143] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T18:17:45.214929] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-27T18:17:46.014929] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-27T18:17:46.213370] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-27T18:17:46.743178] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-27T18:17:46.814952] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-27T18:17:47.540836] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-27T18:17:47.614991] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-27T18:17:48.240265] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T18:17:48.414961] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-27T18:17:48.455807] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-27T18:17:48.458118] [INFO ] [REMOTE ] DFP: Full fetch complete (15803 records). [2025-10-27T18:17:48.458193] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-27T18:17:48.838096] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-27T18:17:48.838178] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-27T18:17:48.838659] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-27T18:17:48.838722] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-27T18:17:48.839222] [DEBUG] [LOCAL ] DFP: Trimmed 15803 records to 10752 (keeping 200 days of data) [2025-10-27T18:17:48.902891] [DEBUG] [LOCAL ] DFP: Primary data saved (10752 records). [2025-10-27T18:17:48.903035] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-27T18:17:48.903117] [INFO ] [MAIN ] Update Progress: 614/2366 symbols completed. DFP took 35.1s. Estimated remaining: 3h 41m 54s. Rate: 7.9 symbols/min [2025-10-27T18:17:49.070469] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:17:49.127898] [DEBUG] [LOCAL ] DHR: Loaded 54150 existing records from primary storage. [2025-10-27T18:17:49.128253] [INFO ] [MAIN ] DHR: Loaded 54150 existing records. [2025-10-27T18:17:49.222510] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-27T18:17:49.311314] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:17:49.311523] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-27T18:17:49.311568] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-27T18:17:49.311828] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-27T18:17:49.311884] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-27T18:17:49.665035] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:17:49.693081] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-27T18:17:49.702021] [INFO ] [REMOTE ] DGX: Full fetch complete (65729 records). [2025-10-27T18:17:49.702167] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-27T18:17:50.020201] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-27T18:17:50.105532] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-27T18:17:50.105629] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-27T18:17:50.106511] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-27T18:17:50.106564] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-27T18:17:50.108079] [DEBUG] [LOCAL ] DGX: Trimmed 65729 records to 44445 (keeping 200 days of data) [2025-10-27T18:17:50.390428] [DEBUG] [LOCAL ] DGX: Primary data saved (44445 records). [2025-10-27T18:17:50.390592] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-27T18:17:50.391614] [INFO ] [MAIN ] Update Progress: 615/2366 symbols completed. DGX took 33.4s. Estimated remaining: 3h 41m 29s. Rate: 7.9 symbols/min [2025-10-27T18:17:50.563812] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:17:50.614841] [DEBUG] [LOCAL ] DHT: Loaded 48572 existing records from primary storage. [2025-10-27T18:17:50.615199] [INFO ] [MAIN ] DHT: Loaded 48572 existing records. [2025-10-27T18:17:50.820962] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-27T18:17:50.826615] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:17:50.829794] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T18:17:50.829978] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-27T18:17:50.840384] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-27T18:17:50.841351] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-27T18:17:50.841410] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-27T18:17:51.206784] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:17:51.548110] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T18:17:51.614914] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-27T18:17:51.876692] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-27T18:17:51.887354] [INFO ] [REMOTE ] DG: Full fetch complete (77301 records). [2025-10-27T18:17:51.887537] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-27T18:17:52.276404] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-27T18:17:52.276489] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-27T18:17:52.277381] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-27T18:17:52.277446] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-27T18:17:52.278913] [DEBUG] [LOCAL ] DG: Trimmed 77301 records to 53220 (keeping 200 days of data) [2025-10-27T18:17:52.464727] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-27T18:17:52.626537] [DEBUG] [LOCAL ] DG: Primary data saved (53220 records). [2025-10-27T18:17:52.626879] [INFO ] [MAIN ] DG: Full history saved. [2025-10-27T18:17:52.627587] [INFO ] [MAIN ] Update Progress: 616/2366 symbols completed. DG took 37.1s. Estimated remaining: 3h 41m 6s. Rate: 7.9 symbols/min [2025-10-27T18:17:52.798438] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:17:52.814820] [DEBUG] [LOCAL ] DHX: Loaded 13435 existing records from primary storage. [2025-10-27T18:17:52.815044] [INFO ] [MAIN ] DHX: Loaded 13435 existing records. [2025-10-27T18:17:52.997874] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:17:52.998158] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-27T18:17:52.998206] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-27T18:17:52.998375] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-27T18:17:52.998430] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-27T18:17:53.217795] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-27T18:17:53.355788] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:17:53.387699] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-27T18:17:54.020478] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-27T18:17:54.050339] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T18:17:54.641181] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T18:17:54.815012] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-27T18:17:55.614979] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-27T18:17:55.974263] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-27T18:17:56.414926] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-27T18:17:56.697463] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-27T18:17:57.144553] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T18:17:57.214897] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-27T18:17:57.346417] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T18:17:58.014959] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-27T18:17:58.735051] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-27T18:17:58.814918] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-27T18:17:58.862341] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-27T18:17:59.614952] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-27T18:18:00.414950] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-27T18:18:00.622432] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-27T18:18:01.215039] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-27T18:18:01.798006] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-27T18:18:02.014944] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-27T18:18:02.378565] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-27T18:18:02.814987] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-27T18:18:03.614942] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-27T18:18:04.082531] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (2.87 seconds). [2025-10-27T18:18:04.174427] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-27T18:18:04.414913] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-27T18:18:04.490059] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-27T18:18:05.061204] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T18:18:05.215001] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-27T18:18:05.634195] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-27T18:18:05.830319] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-27T18:18:06.014948] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-27T18:18:06.814945] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-27T18:18:07.614940] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-27T18:18:08.067500] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-27T18:18:08.326273] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T18:18:08.414949] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-27T18:18:08.543961] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-27T18:18:09.214944] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-27T18:18:09.684895] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T18:18:10.011148] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T18:18:10.014892] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-27T18:18:10.815021] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-27T18:18:10.991229] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-27T18:18:11.614987] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-27T18:18:11.989839] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T18:18:12.289583] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-27T18:18:12.295124] [INFO ] [REMOTE ] DHX: Full fetch complete (21485 records). [2025-10-27T18:18:12.295269] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-27T18:18:12.420032] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-27T18:18:12.675036] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-27T18:18:12.675117] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-27T18:18:12.675529] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-27T18:18:12.675570] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-27T18:18:12.676196] [DEBUG] [LOCAL ] DHX: Trimmed 21485 records to 13037 (keeping 200 days of data) [2025-10-27T18:18:12.744664] [DEBUG] [LOCAL ] DHX: Primary data saved (13037 records). [2025-10-27T18:18:12.744793] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-27T18:18:12.744870] [INFO ] [MAIN ] Update Progress: 617/2366 symbols completed. DHX took 20.1s. Estimated remaining: 3h 41m 34s. Rate: 7.9 symbols/min [2025-10-27T18:18:12.910115] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:18:12.924526] [DEBUG] [LOCAL ] DIAX: Loaded 12871 existing records from primary storage. [2025-10-27T18:18:12.924794] [INFO ] [MAIN ] DIAX: Loaded 12871 existing records. [2025-10-27T18:18:13.108019] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:18:13.108254] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-27T18:18:13.108314] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-27T18:18:13.108484] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-27T18:18:13.108539] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-27T18:18:13.220122] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-27T18:18:13.455139] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:18:14.014974] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-27T18:18:14.125543] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-27T18:18:14.814966] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-27T18:18:14.916058] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-27T18:18:15.326802] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T18:18:15.615000] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-27T18:18:16.414998] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-27T18:18:16.547507] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T18:18:16.558032] [INFO ] [REMOTE ] DHT: Full fetch complete (70341 records). [2025-10-27T18:18:16.558206] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-27T18:18:16.858456] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T18:18:16.978000] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-27T18:18:16.978088] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-27T18:18:16.978915] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-27T18:18:16.978979] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-27T18:18:16.980357] [DEBUG] [LOCAL ] DHT: Trimmed 70341 records to 47756 (keeping 200 days of data) [2025-10-27T18:18:17.231018] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-27T18:18:17.259633] [DEBUG] [LOCAL ] DHT: Primary data saved (47756 records). [2025-10-27T18:18:17.259838] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-27T18:18:17.260514] [INFO ] [MAIN ] Update Progress: 618/2366 symbols completed. DHT took 26.9s. Estimated remaining: 3h 41m 18s. Rate: 7.9 symbols/min [2025-10-27T18:18:17.434215] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:18:17.469465] [DEBUG] [LOCAL ] DIN: Loaded 37212 existing records from primary storage. [2025-10-27T18:18:17.469756] [INFO ] [MAIN ] DIN: Loaded 37212 existing records. [2025-10-27T18:18:17.642389] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:18:17.642584] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-27T18:18:17.642629] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-27T18:18:17.642896] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-27T18:18:17.642952] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-27T18:18:17.777357] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-27T18:18:18.008985] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:18:18.014905] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-27T18:18:18.205501] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-27T18:18:18.814940] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-27T18:18:19.558887] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-27T18:18:19.614910] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-27T18:18:19.684596] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T18:18:20.194843] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T18:18:20.414935] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-27T18:18:21.214970] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-27T18:18:21.923177] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T18:18:22.014977] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-27T18:18:22.814977] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-27T18:18:23.165106] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-27T18:18:23.547611] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T18:18:23.614967] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-27T18:18:23.705225] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-27T18:18:24.414954] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-27T18:18:25.214978] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-27T18:18:25.565801] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T18:18:25.841166] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-27T18:18:25.851072] [INFO ] [REMOTE ] DHI: Full fetch complete (77018 records). [2025-10-27T18:18:25.851235] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-27T18:18:25.851950] [FATAL] [VALIDATOR ] DHI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:18:25.852037] [FATAL] [MAIN ] DHI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:18:25.852078] [WARN ] [MAIN ] DHI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:18:25.852116] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-27T18:18:25.852173] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-10-27T18:18:25.852206] [INFO ] [LOCAL ] DHI: Starting deletion of derivative data. [2025-10-27T18:18:25.852338] [DEBUG] [LOCAL ] DHI: Deleted derivative data file. [2025-10-27T18:18:25.852422] [INFO ] [MAIN ] Update Progress: 619/2366 symbols completed. DHI took 45.0s. Estimated remaining: 3h 41m 13s. Rate: 7.9 symbols/min [2025-10-27T18:18:26.020169] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-27T18:18:26.023793] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:18:26.073479] [DEBUG] [LOCAL ] DINO: Loaded 53591 existing records from primary storage. [2025-10-27T18:18:26.073846] [INFO ] [MAIN ] DINO: Loaded 53591 existing records. [2025-10-27T18:18:26.258467] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:18:26.258874] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-27T18:18:26.258946] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-27T18:18:26.259346] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-27T18:18:26.259433] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-27T18:18:26.609161] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:18:26.814999] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-27T18:18:27.183921] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-27T18:18:27.472506] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T18:18:27.614993] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-27T18:18:28.210491] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T18:18:28.414969] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-27T18:18:28.628964] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-27T18:18:29.214928] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-27T18:18:29.289351] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T18:18:30.014942] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-27T18:18:30.580012] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-27T18:18:30.811828] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-27T18:18:30.821845] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-27T18:18:31.338563] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-27T18:18:31.614942] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-27T18:18:32.414952] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-27T18:18:33.051390] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T18:18:33.072332] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T18:18:33.214920] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-27T18:18:34.014964] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-27T18:18:34.730238] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-27T18:18:34.814940] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-27T18:18:35.103090] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T18:18:35.614931] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-27T18:18:36.394703] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T18:18:36.414905] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-27T18:18:36.659735] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T18:18:36.663032] [INFO ] [REMOTE ] DIAX: Full fetch complete (17551 records). [2025-10-27T18:18:36.663173] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-27T18:18:36.663625] [FATAL] [VALIDATOR ] DIAX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:18:36.663733] [FATAL] [MAIN ] DIAX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:18:36.663774] [WARN ] [MAIN ] DIAX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:18:36.663811] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-27T18:18:36.663864] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-10-27T18:18:36.663898] [INFO ] [LOCAL ] DIAX: Starting deletion of derivative data. [2025-10-27T18:18:36.664042] [DEBUG] [LOCAL ] DIAX: Deleted derivative data file. [2025-10-27T18:18:36.664130] [INFO ] [MAIN ] Update Progress: 620/2366 symbols completed. DIAX took 23.9s. Estimated remaining: 3h 41m 14s. Rate: 7.9 symbols/min [2025-10-27T18:18:36.835288] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:18:36.889176] [DEBUG] [LOCAL ] DIS: Loaded 54568 existing records from primary storage. [2025-10-27T18:18:36.889503] [INFO ] [MAIN ] DIS: Loaded 54568 existing records. [2025-10-27T18:18:37.070959] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:18:37.071170] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-27T18:18:37.071216] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-27T18:18:37.071501] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-27T18:18:37.071538] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-27T18:18:37.221772] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-27T18:18:37.434482] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:18:37.824912] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-27T18:18:37.835322] [INFO ] [REMOTE ] DHR: Full fetch complete (77442 records). [2025-10-27T18:18:37.835483] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-27T18:18:38.031423] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-27T18:18:38.224567] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-27T18:18:38.224736] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-27T18:18:38.225609] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-27T18:18:38.225712] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-27T18:18:38.227305] [DEBUG] [LOCAL ] DHR: Trimmed 77442 records to 53369 (keeping 200 days of data) [2025-10-27T18:18:38.383783] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-27T18:18:38.599050] [DEBUG] [LOCAL ] DHR: Primary data saved (53369 records). [2025-10-27T18:18:38.599190] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-27T18:18:38.599725] [INFO ] [MAIN ] Update Progress: 621/2366 symbols completed. DHR took 49.7s. Estimated remaining: 3h 40m 51s. Rate: 7.9 symbols/min [2025-10-27T18:18:38.766083] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:18:38.766230] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-27T18:18:38.766266] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-27T18:18:38.766370] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-27T18:18:38.766409] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-27T18:18:38.766449] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-27T18:18:38.766498] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-27T18:18:38.827446] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-27T18:18:39.117049] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:18:39.210914] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T18:18:39.614968] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-27T18:18:40.213830] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-27T18:18:40.258999] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-27T18:18:40.414976] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-27T18:18:40.699156] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-27T18:18:41.214992] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-27T18:18:42.014975] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-27T18:18:42.718697] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T18:18:42.814999] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-27T18:18:43.615005] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-27T18:18:43.880971] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-27T18:18:44.007780] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-27T18:18:44.015775] [INFO ] [REMOTE ] DIN: Full fetch complete (54455 records). [2025-10-27T18:18:44.015953] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-27T18:18:44.420923] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-27T18:18:44.435271] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-27T18:18:44.436369] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-27T18:18:44.437447] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-27T18:18:44.437526] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-27T18:18:44.439442] [DEBUG] [LOCAL ] DIN: Trimmed 54455 records to 36358 (keeping 200 days of data) [2025-10-27T18:18:44.684078] [DEBUG] [LOCAL ] DIN: Primary data saved (36358 records). [2025-10-27T18:18:44.684292] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-27T18:18:44.684397] [INFO ] [MAIN ] Update Progress: 622/2366 symbols completed. DIN took 27.4s. Estimated remaining: 3h 40m 39s. Rate: 7.9 symbols/min [2025-10-27T18:18:44.885710] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:18:44.939950] [DEBUG] [LOCAL ] DK: Loaded 49930 existing records from primary storage. [2025-10-27T18:18:44.940182] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-27T18:18:44.940738] [INFO ] [MAIN ] DK: Loaded 49930 existing records. [2025-10-27T18:18:45.136915] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:18:45.137374] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-27T18:18:45.137572] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-27T18:18:45.150322] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-27T18:18:45.167719] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-27T18:18:45.230808] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-27T18:18:45.220300] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-27T18:18:45.571802] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:18:46.014940] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-27T18:18:46.425742] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-27T18:18:46.814990] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-27T18:18:47.056597] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-27T18:18:47.132514] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-27T18:18:47.614949] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-27T18:18:48.414991] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-27T18:18:49.214998] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-27T18:18:49.812959] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T18:18:50.014916] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-27T18:18:50.148966] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-27T18:18:50.587616] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-27T18:18:50.814953] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-27T18:18:51.085524] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-27T18:18:51.614929] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-27T18:18:51.943026] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-27T18:18:52.414947] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-27T18:18:52.934077] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-27T18:18:53.017118] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-27T18:18:53.214914] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-27T18:18:54.014946] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-27T18:18:54.617117] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T18:18:54.815003] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-27T18:18:55.614953] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-27T18:18:55.902359] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-27T18:18:56.030294] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-27T18:18:56.156570] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T18:18:56.414931] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-27T18:18:57.214973] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-27T18:18:58.015035] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-27T18:18:58.522360] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T18:18:58.523228] [INFO ] [REMOTE ] DIVY: Full fetch complete (1672 records). [2025-10-27T18:18:58.523302] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-27T18:18:58.748113] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-27T18:18:58.748856] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:18:58.750999] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-27T18:18:58.751491] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:18:58.762515] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-27T18:18:58.762907] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-27T18:18:58.762986] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-27T18:18:58.763101] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-27T18:18:58.763434] [INFO ] [MAIN ] Update Progress: 623/2366 symbols completed. DIVY took 20.2s. Estimated remaining: 3h 40m 50s. Rate: 7.9 symbols/min [2025-10-27T18:18:58.820175] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-27T18:18:58.951165] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:18:58.972419] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-27T18:18:58.997839] [DEBUG] [LOCAL ] DKL: Loaded 16962 existing records from primary storage. [2025-10-27T18:18:58.998123] [INFO ] [MAIN ] DKL: Loaded 16962 existing records. [2025-10-27T18:18:59.173049] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:18:59.173248] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-27T18:18:59.173293] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-27T18:18:59.173498] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-27T18:18:59.173555] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-27T18:18:59.528784] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:18:59.614934] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-27T18:19:00.414927] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-27T18:19:01.214986] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-27T18:19:01.299330] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T18:19:01.948064] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (3.13 seconds). [2025-10-27T18:19:02.014939] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-27T18:19:02.815000] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-27T18:19:03.594433] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T18:19:03.614925] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-27T18:19:04.158416] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (2.94 seconds). [2025-10-27T18:19:04.414918] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-27T18:19:04.463929] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (4.05 seconds). [2025-10-27T18:19:05.214988] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-27T18:19:05.451340] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T18:19:05.550018] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (3.54 seconds). [2025-10-27T18:19:06.014899] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-27T18:19:06.100408] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-27T18:19:06.110298] [INFO ] [REMOTE ] DINO: Full fetch complete (76693 records). [2025-10-27T18:19:06.110412] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-27T18:19:06.517759] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-27T18:19:06.517891] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-27T18:19:06.518845] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-27T18:19:06.518910] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-27T18:19:06.520335] [DEBUG] [LOCAL ] DINO: Trimmed 76693 records to 52788 (keeping 200 days of data) [2025-10-27T18:19:06.764404] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-27T18:19:06.827951] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-27T18:19:06.873098] [DEBUG] [LOCAL ] DINO: Primary data saved (52788 records). [2025-10-27T18:19:06.873233] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-27T18:19:06.873342] [INFO ] [MAIN ] Update Progress: 624/2366 symbols completed. DINO took 41.0s. Estimated remaining: 3h 40m 43s. Rate: 7.9 symbols/min [2025-10-27T18:19:07.047881] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:19:07.093663] [DEBUG] [LOCAL ] DKS: Loaded 49852 existing records from primary storage. [2025-10-27T18:19:07.093976] [INFO ] [MAIN ] DKS: Loaded 49852 existing records. [2025-10-27T18:19:07.293063] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:19:07.293257] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-27T18:19:07.293303] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-27T18:19:07.293487] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-27T18:19:07.293542] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-27T18:19:07.620732] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-27T18:19:07.652552] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:19:07.853294] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-27T18:19:08.019167] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-27T18:19:08.414962] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-27T18:19:08.907607] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-27T18:19:09.214940] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-27T18:19:09.976716] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T18:19:10.014892] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-27T18:19:10.277763] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-27T18:19:10.814968] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-27T18:19:11.164337] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-27T18:19:11.614977] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-27T18:19:12.318634] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-27T18:19:12.414963] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-27T18:19:12.929500] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-27T18:19:12.940561] [INFO ] [REMOTE ] DIS: Full fetch complete (77967 records). [2025-10-27T18:19:12.940735] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-27T18:19:13.222149] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-27T18:19:13.385591] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-27T18:19:13.395308] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-27T18:19:13.395024] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-27T18:19:13.396377] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-27T18:19:13.399855] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-27T18:19:13.401327] [DEBUG] [LOCAL ] DIS: Trimmed 77967 records to 53788 (keeping 200 days of data) [2025-10-27T18:19:13.733488] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-10-27T18:19:13.733619] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-27T18:19:13.734469] [INFO ] [MAIN ] Update Progress: 625/2366 symbols completed. DIS took 37.1s. Estimated remaining: 3h 40m 34s. Rate: 7.9 symbols/min [2025-10-27T18:19:13.897574] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:19:13.929877] [DEBUG] [LOCAL ] DLB: Loaded 32686 existing records from primary storage. [2025-10-27T18:19:13.930163] [INFO ] [MAIN ] DLB: Loaded 32686 existing records. [2025-10-27T18:19:14.023684] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-27T18:19:14.108708] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:19:14.108935] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-27T18:19:14.108997] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-27T18:19:14.109192] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-27T18:19:14.109249] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-27T18:19:14.457009] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:19:14.814923] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-27T18:19:15.090690] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-27T18:19:15.518278] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-27T18:19:15.604052] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T18:19:15.614889] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-27T18:19:16.414971] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-27T18:19:17.086479] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T18:19:17.095591] [INFO ] [REMOTE ] DK: Full fetch complete (70802 records). [2025-10-27T18:19:17.095791] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-27T18:19:17.220072] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-27T18:19:17.513910] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-27T18:19:17.514099] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-27T18:19:17.515212] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-27T18:19:17.515292] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-27T18:19:17.516874] [DEBUG] [LOCAL ] DK: Trimmed 70802 records to 49105 (keeping 200 days of data) [2025-10-27T18:19:17.827675] [DEBUG] [LOCAL ] DK: Primary data saved (49105 records). [2025-10-27T18:19:17.827973] [INFO ] [MAIN ] DK: Full history saved. [2025-10-27T18:19:17.828939] [INFO ] [MAIN ] Update Progress: 626/2366 symbols completed. DK took 33.1s. Estimated remaining: 3h 40m 16s. Rate: 7.9 symbols/min [2025-10-27T18:19:18.017358] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-27T18:19:18.020685] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T18:19:18.050427] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:19:18.069199] [DEBUG] [LOCAL ] DLNG: Loaded 6143 existing records from primary storage. [2025-10-27T18:19:18.069446] [INFO ] [MAIN ] DLNG: Loaded 6143 existing records. [2025-10-27T18:19:18.261589] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:19:18.261865] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-27T18:19:18.261913] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-27T18:19:18.262059] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-27T18:19:18.262105] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-27T18:19:18.553588] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T18:19:18.627153] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:19:18.814927] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-27T18:19:19.620162] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-27T18:19:19.637669] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T18:19:19.816738] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T18:19:20.414973] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-27T18:19:20.515198] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-27T18:19:20.517763] [INFO ] [REMOTE ] DKL: Full fetch complete (27385 records). [2025-10-27T18:19:20.517852] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-27T18:19:20.518375] [FATAL] [VALIDATOR ] DKL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:19:20.518456] [FATAL] [MAIN ] DKL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:19:20.518498] [WARN ] [MAIN ] DKL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:19:20.518537] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-27T18:19:20.518590] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-10-27T18:19:20.518623] [INFO ] [LOCAL ] DKL: Starting deletion of derivative data. [2025-10-27T18:19:20.518794] [DEBUG] [LOCAL ] DKL: Deleted derivative data file. [2025-10-27T18:19:20.518881] [INFO ] [MAIN ] Update Progress: 627/2366 symbols completed. DKL took 21.8s. Estimated remaining: 3h 39m 55s. Rate: 7.9 symbols/min [2025-10-27T18:19:20.688047] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:19:20.737531] [DEBUG] [LOCAL ] DLR: Loaded 51364 existing records from primary storage. [2025-10-27T18:19:20.737895] [INFO ] [MAIN ] DLR: Loaded 51364 existing records. [2025-10-27T18:19:20.911667] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:19:20.911853] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-27T18:19:20.911897] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-27T18:19:20.912107] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-27T18:19:20.912174] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-27T18:19:21.215535] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-27T18:19:21.274046] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:19:21.275340] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T18:19:22.014948] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-27T18:19:22.727450] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-27T18:19:22.814956] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-27T18:19:23.116515] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-27T18:19:23.615016] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-27T18:19:23.783718] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-27T18:19:24.415022] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-27T18:19:25.144134] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T18:19:25.214905] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-27T18:19:25.234939] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T18:19:26.014990] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-27T18:19:26.698073] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T18:19:26.814938] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-27T18:19:27.614974] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-27T18:19:27.644708] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-27T18:19:28.254954] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T18:19:28.399016] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T18:19:28.414895] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-27T18:19:28.888268] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-27T18:19:29.214987] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-27T18:19:30.014961] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-27T18:19:30.814921] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-27T18:19:31.498290] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-27T18:19:31.513276] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-27T18:19:31.614905] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-27T18:19:31.780154] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-27T18:19:32.414954] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-27T18:19:33.214935] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-27T18:19:33.503110] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-27T18:19:33.531884] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T18:19:33.579279] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-27T18:19:34.014928] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-27T18:19:34.814934] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-27T18:19:35.496059] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T18:19:35.614903] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-27T18:19:36.414973] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-27T18:19:36.558686] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-27T18:19:37.214992] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-27T18:19:37.504071] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-27T18:19:37.952902] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T18:19:38.014921] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-27T18:19:38.814914] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-27T18:19:38.865168] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-27T18:19:38.906220] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T18:19:39.212891] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-27T18:19:39.615019] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-27T18:19:40.414989] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-27T18:19:41.215004] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-27T18:19:41.439222] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-27T18:19:41.914785] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-27T18:19:41.916418] [INFO ] [REMOTE ] DLNG: Full fetch complete (11016 records). [2025-10-27T18:19:41.916491] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-27T18:19:42.016914] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-27T18:19:42.279119] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-27T18:19:42.279269] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-27T18:19:42.279543] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-27T18:19:42.279613] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-27T18:19:42.280340] [DEBUG] [LOCAL ] DLNG: Trimmed 11016 records to 5896 (keeping 200 days of data) [2025-10-27T18:19:42.335414] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-27T18:19:42.354289] [DEBUG] [LOCAL ] DLNG: Primary data saved (5896 records). [2025-10-27T18:19:42.354483] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-27T18:19:42.354579] [INFO ] [MAIN ] Update Progress: 628/2366 symbols completed. DLNG took 24.5s. Estimated remaining: 3h 40m 27s. Rate: 7.9 symbols/min [2025-10-27T18:19:42.520925] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:19:42.549824] [DEBUG] [LOCAL ] DLX: Loaded 28400 existing records from primary storage. [2025-10-27T18:19:42.550100] [INFO ] [MAIN ] DLX: Loaded 28400 existing records. [2025-10-27T18:19:42.723410] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:19:42.723613] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-27T18:19:42.723686] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-27T18:19:42.723901] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-27T18:19:42.723956] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-27T18:19:42.820346] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-27T18:19:43.082735] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:19:43.100015] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-27T18:19:43.614986] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-27T18:19:44.226279] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T18:19:44.414935] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-27T18:19:44.996897] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T18:19:45.214912] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-27T18:19:45.772032] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T18:19:45.781619] [INFO ] [REMOTE ] DLR: Full fetch complete (74187 records). [2025-10-27T18:19:45.781806] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-27T18:19:46.024108] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-27T18:19:46.189702] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-27T18:19:46.189858] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-27T18:19:46.190892] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-27T18:19:46.190968] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-27T18:19:46.192503] [DEBUG] [LOCAL ] DLR: Trimmed 74187 records to 50574 (keeping 200 days of data) [2025-10-27T18:19:46.328083] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-27T18:19:46.342730] [INFO ] [REMOTE ] DKS: Full fetch complete (71393 records). [2025-10-27T18:19:46.348966] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-27T18:19:46.822314] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-27T18:19:46.877584] [DEBUG] [LOCAL ] DLR: Primary data saved (50574 records). [2025-10-27T18:19:46.929548] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-27T18:19:46.952717] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-27T18:19:46.953357] [INFO ] [MAIN ] Update Progress: 629/2366 symbols completed. DLR took 26.4s. Estimated remaining: 3h 40m 11s. Rate: 7.9 symbols/min [2025-10-27T18:19:46.953853] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-27T18:19:46.960317] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-27T18:19:46.967729] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-27T18:19:47.061177] [DEBUG] [LOCAL ] DKS: Trimmed 71393 records to 49014 (keeping 200 days of data) [2025-10-27T18:19:47.150672] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T18:19:47.256863] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:19:47.402002] [DEBUG] [LOCAL ] DLY: Loaded 21112 existing records from primary storage. [2025-10-27T18:19:47.405376] [INFO ] [MAIN ] DLY: Loaded 21112 existing records. [2025-10-27T18:19:47.655369] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:19:47.656163] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-27T18:19:47.656035] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-27T18:19:47.657364] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-27T18:19:47.661960] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-27T18:19:47.662050] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-27T18:19:47.781230] [DEBUG] [LOCAL ] DKS: Primary data saved (49014 records). [2025-10-27T18:19:47.787126] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-27T18:19:47.797496] [INFO ] [MAIN ] Update Progress: 630/2366 symbols completed. DKS took 40.9s. Estimated remaining: 3h 39m 45s. Rate: 7.9 symbols/min [2025-10-27T18:19:48.150128] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:19:48.228948] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:19:48.252681] [DEBUG] [LOCAL ] DMA: Loaded 4751 existing records from primary storage. [2025-10-27T18:19:48.250153] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T18:19:48.259273] [INFO ] [MAIN ] DMA: Loaded 4751 existing records. [2025-10-27T18:19:48.429780] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-27T18:19:48.434406] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:19:48.435268] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-27T18:19:48.435319] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-27T18:19:48.435471] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-27T18:19:48.435526] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-27T18:19:48.794084] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:19:48.812251] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-27T18:19:49.214954] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-27T18:19:49.643231] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-27T18:19:50.014966] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-27T18:19:50.212836] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-27T18:19:50.687617] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-27T18:19:50.815013] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-27T18:19:51.428169] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-27T18:19:51.614995] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-27T18:19:52.190458] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T18:19:52.414946] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-27T18:19:53.214948] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-27T18:19:53.915921] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-27T18:19:53.922466] [INFO ] [REMOTE ] DLB: Full fetch complete (47582 records). [2025-10-27T18:19:53.922585] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-27T18:19:54.020189] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-27T18:19:54.305141] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-27T18:19:54.305222] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-27T18:19:54.305900] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-27T18:19:54.305962] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-27T18:19:54.307013] [DEBUG] [LOCAL ] DLB: Trimmed 47582 records to 32098 (keeping 200 days of data) [2025-10-27T18:19:54.508706] [DEBUG] [LOCAL ] DLB: Primary data saved (32098 records). [2025-10-27T18:19:54.508910] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-27T18:19:54.509011] [INFO ] [MAIN ] Update Progress: 631/2366 symbols completed. DLB took 40.8s. Estimated remaining: 3h 39m 35s. Rate: 7.9 symbols/min [2025-10-27T18:19:54.646964] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T18:19:54.654508] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-27T18:19:54.733544] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:19:54.746169] [DEBUG] [LOCAL ] DMB: Loaded 10587 existing records from primary storage. [2025-10-27T18:19:54.746387] [INFO ] [MAIN ] DMB: Loaded 10587 existing records. [2025-10-27T18:19:54.820139] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-27T18:19:54.926192] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:19:54.926418] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-27T18:19:54.926469] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-27T18:19:54.926759] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-27T18:19:54.926819] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-27T18:19:55.262353] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-27T18:19:55.331917] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:19:55.614958] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-27T18:19:56.205383] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-27T18:19:56.414940] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-27T18:19:56.820341] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-27T18:19:57.214942] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-27T18:19:57.563307] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-27T18:19:58.015059] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-27T18:19:58.814992] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-27T18:19:59.410228] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T18:19:59.614955] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-27T18:19:59.786707] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-27T18:19:59.966579] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-27T18:20:00.414942] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-27T18:20:01.214947] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-27T18:20:02.014994] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-27T18:20:02.249902] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-27T18:20:02.382420] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T18:20:02.814953] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-27T18:20:03.293887] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-27T18:20:03.614949] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-27T18:20:03.797252] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-27T18:20:04.360514] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-27T18:20:04.414901] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-27T18:20:05.036595] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-27T18:20:05.214956] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-27T18:20:05.989940] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-27T18:20:06.014971] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-27T18:20:06.548454] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-27T18:20:06.814935] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-27T18:20:07.603689] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T18:20:07.605072] [INFO ] [REMOTE ] DMA: Full fetch complete (6584 records). [2025-10-27T18:20:07.605139] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-27T18:20:07.620018] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-27T18:20:07.980509] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-27T18:20:07.980592] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-27T18:20:07.980795] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-27T18:20:07.980858] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-27T18:20:07.981253] [DEBUG] [LOCAL ] DMA: Trimmed 6584 records to 4689 (keeping 200 days of data) [2025-10-27T18:20:08.011346] [DEBUG] [LOCAL ] DMA: Primary data saved (4689 records). [2025-10-27T18:20:08.011457] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-27T18:20:08.011537] [INFO ] [MAIN ] Update Progress: 632/2366 symbols completed. DMA took 20.2s. Estimated remaining: 3h 39m 43s. Rate: 7.9 symbols/min [2025-10-27T18:20:08.183787] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:20:08.195148] [DEBUG] [LOCAL ] DMO: Loaded 9879 existing records from primary storage. [2025-10-27T18:20:08.195328] [INFO ] [MAIN ] DMO: Loaded 9879 existing records. [2025-10-27T18:20:08.373236] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:20:08.373421] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-27T18:20:08.373469] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-27T18:20:08.373610] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-27T18:20:08.373682] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-27T18:20:08.426035] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-27T18:20:08.833966] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:20:08.851927] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-27T18:20:09.214970] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-27T18:20:09.695503] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T18:20:10.014922] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-27T18:20:10.300511] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-27T18:20:10.814951] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-27T18:20:10.962676] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-27T18:20:11.614933] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-27T18:20:12.384255] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T18:20:12.414908] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-27T18:20:13.214921] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-27T18:20:13.287032] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-27T18:20:13.302170] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-27T18:20:14.014931] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-27T18:20:14.279296] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T18:20:14.814908] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-27T18:20:15.179546] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T18:20:15.359254] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-27T18:20:15.614927] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-27T18:20:16.414933] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-27T18:20:16.764671] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T18:20:17.173551] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-27T18:20:17.214895] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-27T18:20:18.014929] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-27T18:20:18.066462] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T18:20:18.512690] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-27T18:20:18.814947] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-27T18:20:19.614917] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-27T18:20:19.908247] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T18:20:20.134834] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-27T18:20:20.415006] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-27T18:20:21.214943] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-27T18:20:21.548543] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T18:20:21.554202] [INFO ] [REMOTE ] DLY: Full fetch complete (28868 records). [2025-10-27T18:20:21.554291] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-27T18:20:21.878978] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-27T18:20:21.960572] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-27T18:20:21.960699] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-27T18:20:21.961590] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-27T18:20:21.961680] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-27T18:20:21.962885] [DEBUG] [LOCAL ] DLY: Trimmed 28868 records to 20602 (keeping 200 days of data) [2025-10-27T18:20:22.016818] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-27T18:20:22.094878] [DEBUG] [LOCAL ] DLY: Primary data saved (20602 records). [2025-10-27T18:20:22.095017] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-27T18:20:22.095097] [INFO ] [MAIN ] Update Progress: 633/2366 symbols completed. DLY took 35.1s. Estimated remaining: 3h 39m 54s. Rate: 7.9 symbols/min [2025-10-27T18:20:22.280731] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:20:22.327418] [DEBUG] [LOCAL ] DNA: Loaded 49222 existing records from primary storage. [2025-10-27T18:20:22.327782] [INFO ] [MAIN ] DNA: Loaded 49222 existing records. [2025-10-27T18:20:22.526847] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:20:22.527127] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-27T18:20:22.527191] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-27T18:20:22.527462] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-27T18:20:22.527518] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-27T18:20:22.816376] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-27T18:20:22.887516] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T18:20:22.945278] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:20:23.614933] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-27T18:20:24.398556] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T18:20:24.403220] [INFO ] [REMOTE ] DLX: Full fetch complete (41227 records). [2025-10-27T18:20:24.403325] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-27T18:20:24.404150] [FATAL] [VALIDATOR ] DLX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:20:24.404233] [FATAL] [MAIN ] DLX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:20:24.404275] [WARN ] [MAIN ] DLX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:20:24.404348] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-27T18:20:24.404409] [DEBUG] [LOCAL ] DLX: No primary data file found to delete. [2025-10-27T18:20:24.404444] [INFO ] [LOCAL ] DLX: Starting deletion of derivative data. [2025-10-27T18:20:24.404562] [DEBUG] [LOCAL ] DLX: Deleted derivative data file. [2025-10-27T18:20:24.404662] [INFO ] [MAIN ] Update Progress: 634/2366 symbols completed. DLX took 42.0s. Estimated remaining: 3h 39m 31s. Rate: 7.9 symbols/min [2025-10-27T18:20:24.425034] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-27T18:20:24.564930] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T18:20:24.590388] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:20:24.630840] [DEBUG] [LOCAL ] DNOW: Loaded 44389 existing records from primary storage. [2025-10-27T18:20:24.631126] [INFO ] [MAIN ] DNOW: Loaded 44389 existing records. [2025-10-27T18:20:24.803786] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:20:24.804017] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-27T18:20:24.804063] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-27T18:20:24.804288] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-27T18:20:24.804325] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-27T18:20:25.157766] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:20:25.214901] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-27T18:20:26.014991] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-27T18:20:26.207717] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T18:20:26.210280] [INFO ] [REMOTE ] DMB: Full fetch complete (14513 records). [2025-10-27T18:20:26.210363] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-27T18:20:26.537034] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-27T18:20:26.616767] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-10-27T18:20:26.616851] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-10-27T18:20:26.617184] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-10-27T18:20:26.617244] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-10-27T18:20:26.617922] [DEBUG] [LOCAL ] DMB: Trimmed 14513 records to 10487 (keeping 200 days of data) [2025-10-27T18:20:26.679320] [DEBUG] [LOCAL ] DMB: Primary data saved (10487 records). [2025-10-27T18:20:26.679453] [INFO ] [MAIN ] DMB: Full history saved. [2025-10-27T18:20:26.679531] [INFO ] [MAIN ] Update Progress: 635/2366 symbols completed. DMB took 32.2s. Estimated remaining: 3h 39m 9s. Rate: 7.9 symbols/min [2025-10-27T18:20:26.821436] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-27T18:20:26.847081] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:20:26.879055] [DEBUG] [LOCAL ] DNP: Loaded 33548 existing records from primary storage. [2025-10-27T18:20:26.879362] [INFO ] [MAIN ] DNP: Loaded 33548 existing records. [2025-10-27T18:20:27.090333] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:20:27.090734] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-27T18:20:27.090810] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-27T18:20:27.091105] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-27T18:20:27.091238] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-27T18:20:27.290467] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-27T18:20:27.478745] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:20:27.614931] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-27T18:20:28.414911] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-27T18:20:28.544188] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-27T18:20:29.069894] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-27T18:20:29.116872] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-27T18:20:29.214988] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-27T18:20:30.014950] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-27T18:20:30.412971] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-27T18:20:30.814995] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-27T18:20:30.968047] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T18:20:31.305921] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-27T18:20:31.614971] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-27T18:20:32.415010] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-27T18:20:32.912945] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T18:20:33.214939] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-27T18:20:33.430011] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-27T18:20:34.014992] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-27T18:20:34.382956] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-27T18:20:34.814954] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-27T18:20:35.385961] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T18:20:35.614987] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-27T18:20:35.938598] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T18:20:36.415010] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-27T18:20:37.214918] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-27T18:20:37.476778] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T18:20:37.990300] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-27T18:20:37.992469] [INFO ] [REMOTE ] DMO: Full fetch complete (14330 records). [2025-10-27T18:20:37.992542] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-27T18:20:38.023800] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-27T18:20:38.418055] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-27T18:20:38.462847] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-27T18:20:38.462953] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-27T18:20:38.463738] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-27T18:20:38.463804] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-27T18:20:38.464453] [DEBUG] [LOCAL ] DMO: Trimmed 14330 records to 9505 (keeping 200 days of data) [2025-10-27T18:20:38.536135] [DEBUG] [LOCAL ] DMO: Primary data saved (9505 records). [2025-10-27T18:20:38.536321] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-27T18:20:38.536446] [INFO ] [MAIN ] Update Progress: 636/2366 symbols completed. DMO took 30.5s. Estimated remaining: 3h 39m 13s. Rate: 7.9 symbols/min [2025-10-27T18:20:38.780127] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:20:38.817767] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-27T18:20:38.853050] [DEBUG] [LOCAL ] DOC: Loaded 54334 existing records from primary storage. [2025-10-27T18:20:38.853924] [INFO ] [MAIN ] DOC: Loaded 54334 existing records. [2025-10-27T18:20:39.080776] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:20:39.081068] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-27T18:20:39.081128] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-27T18:20:39.081468] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-27T18:20:39.081532] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-27T18:20:39.509145] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:20:39.614973] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-27T18:20:39.777978] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-27T18:20:39.904213] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-27T18:20:40.414940] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-27T18:20:41.005028] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-27T18:20:41.214962] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-27T18:20:42.014976] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-27T18:20:42.157682] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T18:20:42.536065] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T18:20:42.814952] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-27T18:20:42.958878] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-27T18:20:43.614934] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-27T18:20:43.965763] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-27T18:20:44.414937] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-27T18:20:44.581216] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-27T18:20:45.214965] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-27T18:20:45.860479] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T18:20:46.014944] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-27T18:20:46.582373] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-27T18:20:46.814980] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-27T18:20:47.434102] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T18:20:47.614929] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-27T18:20:48.397466] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T18:20:48.414905] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-27T18:20:48.503556] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T18:20:49.215018] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-27T18:20:49.565310] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T18:20:49.571809] [INFO ] [REMOTE ] DNP: Full fetch complete (48469 records). [2025-10-27T18:20:49.571914] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-27T18:20:49.943416] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-27T18:20:49.943491] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-27T18:20:49.944147] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-27T18:20:49.944208] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-27T18:20:49.945156] [DEBUG] [LOCAL ] DNP: Trimmed 48469 records to 32861 (keeping 200 days of data) [2025-10-27T18:20:50.030396] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-27T18:20:50.147856] [DEBUG] [LOCAL ] DNP: Primary data saved (32861 records). [2025-10-27T18:20:50.148286] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-27T18:20:50.148403] [INFO ] [MAIN ] Update Progress: 637/2366 symbols completed. DNP took 23.5s. Estimated remaining: 3h 39m 17s. Rate: 7.9 symbols/min [2025-10-27T18:20:50.469611] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T18:20:50.814994] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-27T18:20:51.521192] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T18:20:51.614951] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-27T18:20:52.325019] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T18:20:52.414905] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-27T18:20:53.214988] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-27T18:20:53.387864] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-27T18:20:53.396277] [INFO ] [REMOTE ] DNOW: Full fetch complete (63501 records). [2025-10-27T18:20:53.396415] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-27T18:20:53.397394] [FATAL] [VALIDATOR ] DNOW: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:20:53.397501] [FATAL] [MAIN ] DNOW: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:20:53.397552] [WARN ] [MAIN ] DNOW: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:20:53.397618] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-27T18:20:53.397721] [DEBUG] [LOCAL ] DNOW: No primary data file found to delete. [2025-10-27T18:20:53.397770] [INFO ] [LOCAL ] DNOW: Starting deletion of derivative data. [2025-10-27T18:20:53.398095] [DEBUG] [LOCAL ] DNOW: Deleted derivative data file. [2025-10-27T18:20:53.398778] [INFO ] [MAIN ] Update Progress: 638/2366 symbols completed. DNOW took 29.0s. Estimated remaining: 3h 38m 57s. Rate: 7.9 symbols/min [2025-10-27T18:20:54.176819] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-27T18:20:54.187899] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-27T18:20:55.087688] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-27T18:20:55.098525] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-27T18:20:55.915336] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-27T18:20:55.925891] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-27T18:20:57.051067] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-27T18:20:57.061173] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-27T18:20:57.462496] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-27T18:20:57.474093] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-27T18:20:58.584728] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T18:20:58.595224] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-27T18:20:59.315072] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-27T18:20:59.326236] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-27T18:21:00.923267] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-27T18:21:00.932731] [INFO ] [REMOTE ] DNA: Full fetch complete (71120 records). [2025-10-27T18:21:00.932851] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-27T18:21:01.318746] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-27T18:21:01.318830] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-27T18:21:01.319723] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-27T18:21:01.319787] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-27T18:21:01.321201] [DEBUG] [LOCAL ] DNA: Trimmed 71120 records to 48413 (keeping 200 days of data) [2025-10-27T18:21:01.593378] [DEBUG] [LOCAL ] DNA: Primary data saved (48413 records). [2025-10-27T18:21:01.593501] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-27T18:21:01.594028] [INFO ] [MAIN ] Update Progress: 639/2366 symbols completed. DNA took 39.5s. Estimated remaining: 3h 38m 51s. Rate: 7.9 symbols/min [2025-10-27T18:21:01.973500] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-27T18:21:01.985041] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-27T18:21:04.342267] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-27T18:21:04.352516] [INFO ] [REMOTE ] DOC: Full fetch complete (77599 records). [2025-10-27T18:21:04.352669] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-27T18:21:04.743175] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-27T18:21:04.743257] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-27T18:21:04.744110] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-27T18:21:04.744195] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-27T18:21:04.745697] [DEBUG] [LOCAL ] DOC: Trimmed 77599 records to 53554 (keeping 200 days of data) [2025-10-27T18:21:05.066212] [DEBUG] [LOCAL ] DOC: Primary data saved (53554 records). [2025-10-27T18:21:05.066345] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-27T18:21:05.066453] [INFO ] [MAIN ] Update Progress: 640/2366 symbols completed. DOC took 26.5s. Estimated remaining: 3h 38m 32s. Rate: 7.9 symbols/min [2025-10-27T18:21:05.681098] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:21:05.709213] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:21:05.752185] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:21:05.797419] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:21:05.869264] [DEBUG] [LOCAL ] DOUG: Loaded 34109 existing records from primary storage. [2025-10-27T18:21:05.869777] [INFO ] [MAIN ] DOUG: Loaded 34109 existing records. [2025-10-27T18:21:05.918180] [DEBUG] [LOCAL ] DOCS: Loaded 50950 existing records from primary storage. [2025-10-27T18:21:05.918700] [INFO ] [MAIN ] DOCS: Loaded 50950 existing records. [2025-10-27T18:21:06.068968] [DEBUG] [LOCAL ] DOLE: Loaded 39659 existing records from primary storage. [2025-10-27T18:21:06.079696] [INFO ] [MAIN ] DOLE: Loaded 39659 existing records. [2025-10-27T18:21:06.107108] [DEBUG] [LOCAL ] DOCN: Loaded 51866 existing records from primary storage. [2025-10-27T18:21:06.135362] [INFO ] [MAIN ] DOCN: Loaded 51866 existing records. [2025-10-27T18:21:06.468428] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:21:06.481236] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:21:06.538425] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-27T18:21:06.569094] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-27T18:21:06.582223] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-27T18:21:06.619062] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-27T18:21:06.624259] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-27T18:21:06.618947] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:21:06.653706] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-27T18:21:06.653832] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-27T18:21:06.653626] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-27T18:21:06.702385] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-27T18:21:06.740732] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-27T18:21:06.771975] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-27T18:21:06.760311] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:21:06.791181] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-27T18:21:06.806479] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-27T18:21:06.806528] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-27T18:21:06.881281] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-27T18:21:06.893669] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-27T18:21:07.948219] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:21:07.969455] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-27T18:21:08.008108] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:21:08.038333] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-27T18:21:08.110191] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:21:08.136032] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-27T18:21:08.179312] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:21:08.179778] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-27T18:21:09.603309] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T18:21:09.610979] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-27T18:21:09.699120] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T18:21:09.707544] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-27T18:21:09.736898] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-27T18:21:09.746621] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-27T18:21:09.793698] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T18:21:09.803302] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-27T18:21:10.518818] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-27T18:21:10.526425] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-27T18:21:11.012362] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T18:21:11.018714] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-27T18:21:11.199320] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T18:21:11.209685] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-27T18:21:11.682145] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-27T18:21:11.691571] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-27T18:21:11.750955] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-27T18:21:11.758444] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-27T18:21:12.433810] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T18:21:12.441116] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-27T18:21:12.708635] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T18:21:12.716005] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-27T18:21:12.779817] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T18:21:12.790825] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-27T18:21:13.279439] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T18:21:13.289464] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-27T18:21:13.505460] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T18:21:14.014928] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-27T18:21:14.174244] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-27T18:21:14.248937] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T18:21:14.814977] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-27T18:21:14.944141] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T18:21:15.113420] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-27T18:21:15.614929] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-27T18:21:16.410877] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-27T18:21:16.420839] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-27T18:21:16.633311] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T18:21:17.214945] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-27T18:21:17.760470] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T18:21:18.015021] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-27T18:21:18.558704] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T18:21:18.814948] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-27T18:21:19.483239] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T18:21:19.614919] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-27T18:21:20.414979] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-27T18:21:20.626181] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-27T18:21:20.888580] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T18:21:21.214955] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-27T18:21:21.911752] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T18:21:22.014982] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-27T18:21:22.814979] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-27T18:21:23.088736] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-27T18:21:23.474380] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T18:21:23.614935] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-27T18:21:24.300503] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-27T18:21:24.414949] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-27T18:21:25.214969] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-27T18:21:25.591375] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-27T18:21:25.963222] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-27T18:21:26.014903] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-27T18:21:26.700941] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T18:21:26.814913] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-27T18:21:26.951745] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T18:21:27.614927] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-27T18:21:28.414956] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-27T18:21:28.463316] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T18:21:28.554380] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-27T18:21:29.215007] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-27T18:21:29.665891] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-27T18:21:29.673830] [INFO ] [REMOTE ] DOLE: Full fetch complete (54382 records). [2025-10-27T18:21:29.673967] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-27T18:21:29.674840] [FATAL] [VALIDATOR ] DOLE: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:21:29.674960] [FATAL] [MAIN ] DOLE: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:21:29.675021] [WARN ] [MAIN ] DOLE: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:21:29.675065] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-27T18:21:29.675122] [DEBUG] [LOCAL ] DOLE: No primary data file found to delete. [2025-10-27T18:21:29.675159] [INFO ] [LOCAL ] DOLE: Starting deletion of derivative data. [2025-10-27T18:21:29.675322] [DEBUG] [LOCAL ] DOLE: Deleted derivative data file. [2025-10-27T18:21:29.675399] [INFO ] [MAIN ] Update Progress: 641/2366 symbols completed. DOLE took 24.6s. Estimated remaining: 3h 39m 11s. Rate: 7.9 symbols/min [2025-10-27T18:21:29.854389] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:21:29.899467] [DEBUG] [LOCAL ] DOV: Loaded 46328 existing records from primary storage. [2025-10-27T18:21:29.899837] [INFO ] [MAIN ] DOV: Loaded 46328 existing records. [2025-10-27T18:21:30.020212] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-27T18:21:30.081611] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:21:30.081787] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-27T18:21:30.081831] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-27T18:21:30.082004] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-27T18:21:30.082041] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-27T18:21:30.439830] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:21:30.571619] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-27T18:21:30.577083] [INFO ] [REMOTE ] DOUG: Full fetch complete (49593 records). [2025-10-27T18:21:30.577170] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-27T18:21:30.824593] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-27T18:21:30.951741] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-27T18:21:30.951913] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-27T18:21:30.952596] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-27T18:21:30.952638] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-27T18:21:30.953714] [DEBUG] [LOCAL ] DOUG: Trimmed 49593 records to 33433 (keeping 200 days of data) [2025-10-27T18:21:31.132026] [DEBUG] [LOCAL ] DOUG: Primary data saved (33433 records). [2025-10-27T18:21:31.132155] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-27T18:21:31.132659] [INFO ] [MAIN ] Update Progress: 642/2366 symbols completed. DOUG took 26.1s. Estimated remaining: 3h 38m 46s. Rate: 7.9 symbols/min [2025-10-27T18:21:31.301480] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:21:31.348807] [DEBUG] [LOCAL ] DOW: Loaded 54513 existing records from primary storage. [2025-10-27T18:21:31.349107] [INFO ] [MAIN ] DOW: Loaded 54513 existing records. [2025-10-27T18:21:31.523214] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:21:31.523347] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-27T18:21:31.523389] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-27T18:21:31.523630] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-27T18:21:31.523739] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-27T18:21:31.620222] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-27T18:21:31.895638] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:21:32.064901] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-27T18:21:32.073888] [INFO ] [REMOTE ] DOCS: Full fetch complete (73634 records). [2025-10-27T18:21:32.074004] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-27T18:21:32.437265] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-27T18:21:32.459450] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-27T18:21:32.459561] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-27T18:21:32.460511] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-27T18:21:32.460729] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-27T18:21:32.462776] [DEBUG] [LOCAL ] DOCS: Trimmed 73634 records to 50150 (keeping 200 days of data) [2025-10-27T18:21:32.688992] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-27T18:21:32.789823] [DEBUG] [LOCAL ] DOCS: Primary data saved (50150 records). [2025-10-27T18:21:32.789946] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-27T18:21:32.790020] [INFO ] [MAIN ] Update Progress: 643/2366 symbols completed. DOCS took 27.7s. Estimated remaining: 3h 38m 23s. Rate: 7.9 symbols/min [2025-10-27T18:21:32.963934] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:21:32.978758] [DEBUG] [LOCAL ] DPG: Loaded 13476 existing records from primary storage. [2025-10-27T18:21:32.978978] [INFO ] [MAIN ] DPG: Loaded 13476 existing records. [2025-10-27T18:21:33.123266] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T18:21:33.197375] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:21:33.197571] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-27T18:21:33.197617] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-27T18:21:33.197809] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-27T18:21:33.197858] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-27T18:21:33.220125] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-27T18:21:33.556365] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:21:34.014951] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-27T18:21:34.584632] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-27T18:21:34.814957] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-27T18:21:35.356242] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-27T18:21:35.367638] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T18:21:35.375938] [INFO ] [REMOTE ] DOCN: Full fetch complete (73125 records). [2025-10-27T18:21:35.376418] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-27T18:21:35.560138] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-27T18:21:35.617179] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-27T18:21:35.783382] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-27T18:21:35.783478] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-27T18:21:35.784329] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-27T18:21:35.784403] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-27T18:21:35.785952] [DEBUG] [LOCAL ] DOCN: Trimmed 73125 records to 51095 (keeping 200 days of data) [2025-10-27T18:21:36.077442] [DEBUG] [LOCAL ] DOCN: Primary data saved (51095 records). [2025-10-27T18:21:36.077574] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-27T18:21:36.077691] [INFO ] [MAIN ] Update Progress: 644/2366 symbols completed. DOCN took 31.0s. Estimated remaining: 3h 38m 4s. Rate: 7.9 symbols/min [2025-10-27T18:21:36.243606] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:21:36.282798] [DEBUG] [LOCAL ] DQ: Loaded 44422 existing records from primary storage. [2025-10-27T18:21:36.283203] [INFO ] [MAIN ] DQ: Loaded 44422 existing records. [2025-10-27T18:21:36.425715] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-27T18:21:36.462082] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:21:36.469440] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-27T18:21:36.469546] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-27T18:21:36.472452] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-27T18:21:36.472638] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-27T18:21:36.472737] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-27T18:21:36.825157] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:21:37.214941] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-27T18:21:37.894056] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T18:21:38.014938] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-27T18:21:38.679978] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T18:21:38.814922] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-27T18:21:39.351436] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T18:21:39.614913] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-27T18:21:40.414952] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-27T18:21:40.596104] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-27T18:21:40.746259] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T18:21:41.214986] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-27T18:21:41.358986] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T18:21:42.015004] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-27T18:21:42.704949] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T18:21:42.814926] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-27T18:21:43.548466] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T18:21:43.614899] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-27T18:21:43.787985] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-27T18:21:44.414981] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-27T18:21:45.055021] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-27T18:21:45.214964] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-27T18:21:45.720364] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-27T18:21:46.014937] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-27T18:21:46.814987] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-27T18:21:47.167953] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-27T18:21:47.399585] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-27T18:21:47.614907] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-27T18:21:47.680169] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T18:21:48.414962] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-27T18:21:48.556615] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-27T18:21:49.214943] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-27T18:21:49.781624] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T18:21:50.015016] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-27T18:21:50.427827] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-27T18:21:50.814951] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-27T18:21:51.614999] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-27T18:21:52.212849] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-27T18:21:52.277359] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-27T18:21:52.293289] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-27T18:21:52.414932] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-27T18:21:53.214973] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-27T18:21:53.321523] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T18:21:54.014996] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-27T18:21:54.640356] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-27T18:21:54.814944] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-27T18:21:55.614955] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-27T18:21:55.890973] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-27T18:21:56.320914] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T18:21:56.414920] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-27T18:21:56.965154] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T18:21:57.214948] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-27T18:21:57.952763] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-27T18:21:58.014931] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-27T18:21:58.814919] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-27T18:21:59.067109] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-27T18:21:59.300878] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-27T18:21:59.614937] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-27T18:21:59.994876] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T18:22:00.414953] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-27T18:22:00.658038] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-27T18:22:01.214969] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-27T18:22:02.014993] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-27T18:22:02.176445] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T18:22:02.180231] [INFO ] [REMOTE ] DPG: Full fetch complete (19001 records). [2025-10-27T18:22:02.180393] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-27T18:22:02.579584] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-27T18:22:02.646288] [INFO ] [REMOTE ] DQ: Full fetch complete (63693 records). [2025-10-27T18:22:02.655069] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-27T18:22:02.655286] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-27T18:22:02.655242] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-27T18:22:02.655900] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-27T18:22:02.655986] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-27T18:22:02.721828] [DEBUG] [LOCAL ] DPG: Trimmed 19001 records to 13105 (keeping 200 days of data) [2025-10-27T18:22:02.819761] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-27T18:22:03.044630] [DEBUG] [LOCAL ] DPG: Primary data saved (13105 records). [2025-10-27T18:22:03.055256] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-27T18:22:03.060496] [INFO ] [MAIN ] Update Progress: 645/2366 symbols completed. DPG took 30.3s. Estimated remaining: 3h 38m 48s. Rate: 7.9 symbols/min [2025-10-27T18:22:03.216786] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-27T18:22:03.230078] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-27T18:22:03.249828] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-27T18:22:03.262702] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-27T18:22:03.308207] [DEBUG] [LOCAL ] DQ: Trimmed 63693 records to 43643 (keeping 200 days of data) [2025-10-27T18:22:03.342583] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:22:03.587147] [DEBUG] [LOCAL ] DRD: Loaded 38484 existing records from primary storage. [2025-10-27T18:22:03.588162] [INFO ] [MAIN ] DRD: Loaded 38484 existing records. [2025-10-27T18:22:03.733132] [DEBUG] [LOCAL ] DQ: Primary data saved (43643 records). [2025-10-27T18:22:03.748575] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-27T18:22:03.754389] [INFO ] [MAIN ] Update Progress: 646/2366 symbols completed. DQ took 27.7s. Estimated remaining: 3h 38m 22s. Rate: 7.9 symbols/min [2025-10-27T18:22:03.856629] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:22:03.868873] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-27T18:22:03.882763] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-27T18:22:03.904601] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-27T18:22:03.915123] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-27T18:22:04.069810] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:22:04.430931] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:22:04.445639] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-27T18:22:04.476404] [DEBUG] [LOCAL ] DRH: Loaded 50932 existing records from primary storage. [2025-10-27T18:22:04.477018] [INFO ] [MAIN ] DRH: Loaded 50932 existing records. [2025-10-27T18:22:04.491046] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-27T18:22:04.577758] [INFO ] [REMOTE ] DOW: Full fetch complete (77910 records). [2025-10-27T18:22:04.590138] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-27T18:22:04.746098] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-27T18:22:04.810692] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:22:04.826863] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-27T18:22:04.837522] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-27T18:22:04.838000] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-27T18:22:04.839222] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-27T18:22:04.844779] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-27T18:22:05.414943] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-27T18:22:05.429048] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-27T18:22:05.435325] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-27T18:22:05.443757] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-27T18:22:05.545881] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:22:05.546086] [DEBUG] [LOCAL ] DOW: Trimmed 77910 records to 53733 (keeping 200 days of data) [2025-10-27T18:22:05.546550] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-27T18:22:05.566933] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T18:22:05.900354] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-10-27T18:22:05.900484] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-27T18:22:05.900561] [INFO ] [MAIN ] Update Progress: 647/2366 symbols completed. DOW took 34.8s. Estimated remaining: 3h 37m 60s. Rate: 7.9 symbols/min [2025-10-27T18:22:06.020165] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-27T18:22:06.071419] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:22:06.115089] [DEBUG] [LOCAL ] DRI: Loaded 48148 existing records from primary storage. [2025-10-27T18:22:06.115409] [INFO ] [MAIN ] DRI: Loaded 48148 existing records. [2025-10-27T18:22:06.289054] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:22:06.289260] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-27T18:22:06.289308] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-27T18:22:06.289502] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-27T18:22:06.289559] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-27T18:22:06.637349] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:22:06.705365] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-27T18:22:06.714310] [INFO ] [REMOTE ] DOV: Full fetch complete (66001 records). [2025-10-27T18:22:06.714450] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-27T18:22:06.715199] [FATAL] [VALIDATOR ] DOV: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:22:06.715291] [FATAL] [MAIN ] DOV: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:22:06.715363] [WARN ] [MAIN ] DOV: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:22:06.715449] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-27T18:22:06.715527] [DEBUG] [LOCAL ] DOV: No primary data file found to delete. [2025-10-27T18:22:06.715566] [INFO ] [LOCAL ] DOV: Starting deletion of derivative data. [2025-10-27T18:22:06.715732] [DEBUG] [LOCAL ] DOV: Deleted derivative data file. [2025-10-27T18:22:06.716046] [INFO ] [MAIN ] Update Progress: 648/2366 symbols completed. DOV took 37.0s. Estimated remaining: 3h 37m 34s. Rate: 7.9 symbols/min [2025-10-27T18:22:06.815432] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-27T18:22:06.885496] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:22:06.897285] [DEBUG] [LOCAL ] DRLL: Loaded 8701 existing records from primary storage. [2025-10-27T18:22:06.897504] [INFO ] [MAIN ] DRLL: Loaded 8701 existing records. [2025-10-27T18:22:07.082784] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:22:07.083273] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-27T18:22:07.083375] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-27T18:22:07.083745] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-27T18:22:07.083872] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-27T18:22:07.281459] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T18:22:07.471638] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-27T18:22:07.509534] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:22:07.614899] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-27T18:22:08.260733] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-27T18:22:08.414945] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-27T18:22:08.621424] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-27T18:22:09.214940] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-27T18:22:09.449984] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T18:22:10.014945] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-27T18:22:10.573427] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T18:22:10.814967] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-27T18:22:11.332267] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T18:22:11.614940] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-27T18:22:12.404388] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T18:22:12.414904] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-27T18:22:13.205768] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T18:22:13.214828] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-27T18:22:13.859015] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T18:22:14.014948] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-27T18:22:14.551978] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-27T18:22:14.745763] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T18:22:14.814907] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-27T18:22:15.614980] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-27T18:22:16.414992] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-27T18:22:16.469502] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T18:22:16.950582] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T18:22:17.215119] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-27T18:22:17.872997] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T18:22:18.014928] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-27T18:22:18.808876] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T18:22:18.818921] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-27T18:22:19.534342] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T18:22:19.614931] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-27T18:22:19.971403] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-27T18:22:20.414970] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-27T18:22:20.909477] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T18:22:21.214953] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-27T18:22:21.548263] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-27T18:22:22.014951] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-27T18:22:22.616387] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-27T18:22:22.814985] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-27T18:22:23.458981] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T18:22:23.521399] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-27T18:22:23.614939] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-27T18:22:24.414970] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-27T18:22:24.852069] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-27T18:22:25.214951] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-27T18:22:26.014921] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-27T18:22:26.272793] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-27T18:22:26.281490] [INFO ] [REMOTE ] DRD: Full fetch complete (52539 records). [2025-10-27T18:22:26.281600] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-27T18:22:26.680005] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-27T18:22:26.680223] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-27T18:22:26.682189] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-27T18:22:26.683164] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-27T18:22:26.683747] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-27T18:22:26.689298] [DEBUG] [LOCAL ] DRD: Trimmed 52539 records to 37947 (keeping 200 days of data) [2025-10-27T18:22:26.816100] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-27T18:22:26.829839] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-27T18:22:26.969437] [DEBUG] [LOCAL ] DRD: Primary data saved (37947 records). [2025-10-27T18:22:26.969621] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-27T18:22:26.969751] [INFO ] [MAIN ] Update Progress: 649/2366 symbols completed. DRD took 23.9s. Estimated remaining: 3h 37m 60s. Rate: 7.9 symbols/min [2025-10-27T18:22:27.133195] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:22:27.162885] [DEBUG] [LOCAL ] DSL: Loaded 29390 existing records from primary storage. [2025-10-27T18:22:27.163144] [INFO ] [MAIN ] DSL: Loaded 29390 existing records. [2025-10-27T18:22:27.333938] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:22:27.334163] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-27T18:22:27.334211] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-27T18:22:27.334394] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-27T18:22:27.334431] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-27T18:22:27.620153] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-27T18:22:27.682772] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:22:27.733160] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-27T18:22:28.414998] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-27T18:22:29.024929] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T18:22:29.214948] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-27T18:22:29.688004] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T18:22:30.015095] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-27T18:22:30.819458] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-27T18:22:30.822400] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-27T18:22:30.984440] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-27T18:22:31.614957] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-27T18:22:31.646559] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-27T18:22:32.414938] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-27T18:22:33.214944] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-27T18:22:33.282839] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-27T18:22:33.313308] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T18:22:33.802697] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-27T18:22:34.014993] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-27T18:22:34.814951] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-27T18:22:34.937427] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-27T18:22:35.614986] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-27T18:22:36.414955] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-27T18:22:36.519399] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T18:22:36.803614] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-27T18:22:36.812495] [INFO ] [REMOTE ] DRI: Full fetch complete (69424 records). [2025-10-27T18:22:36.812601] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-27T18:22:37.023387] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-27T18:22:37.211614] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-27T18:22:37.211714] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-27T18:22:37.212485] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-27T18:22:37.212525] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-27T18:22:37.213812] [DEBUG] [LOCAL ] DRI: Trimmed 69424 records to 47373 (keeping 200 days of data) [2025-10-27T18:22:37.215007] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-27T18:22:37.515172] [DEBUG] [LOCAL ] DRI: Primary data saved (47373 records). [2025-10-27T18:22:37.515351] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-27T18:22:37.515444] [INFO ] [MAIN ] Update Progress: 650/2366 symbols completed. DRI took 31.6s. Estimated remaining: 3h 38m 0s. Rate: 7.9 symbols/min [2025-10-27T18:22:37.766277] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:22:37.788391] [DEBUG] [LOCAL ] DSM: Loaded 14316 existing records from primary storage. [2025-10-27T18:22:37.788784] [INFO ] [MAIN ] DSM: Loaded 14316 existing records. [2025-10-27T18:22:37.993899] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T18:22:38.036554] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-27T18:22:38.097049] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:22:38.099031] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-27T18:22:38.099143] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-27T18:22:38.099400] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-27T18:22:38.099473] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-27T18:22:38.598318] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:22:38.815004] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-27T18:22:38.831532] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T18:22:38.833478] [INFO ] [REMOTE ] DRLL: Full fetch complete (14432 records). [2025-10-27T18:22:38.833557] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-27T18:22:39.250658] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-27T18:22:39.250742] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-27T18:22:39.251050] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-27T18:22:39.251085] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-27T18:22:39.251529] [DEBUG] [LOCAL ] DRLL: Trimmed 14432 records to 8444 (keeping 200 days of data) [2025-10-27T18:22:39.302516] [DEBUG] [LOCAL ] DRLL: Primary data saved (8444 records). [2025-10-27T18:22:39.302618] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-27T18:22:39.302721] [INFO ] [MAIN ] Update Progress: 651/2366 symbols completed. DRLL took 32.6s. Estimated remaining: 3h 37m 37s. Rate: 7.9 symbols/min [2025-10-27T18:22:39.467487] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:22:39.470735] [DEBUG] [LOCAL ] DSMC: Loaded 1800 existing records from primary storage. [2025-10-27T18:22:39.470875] [INFO ] [MAIN ] DSMC: Loaded 1800 existing records. [2025-10-27T18:22:39.620255] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-27T18:22:39.649887] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:22:39.650066] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-27T18:22:39.650111] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-27T18:22:39.650241] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-10-27T18:22:39.650279] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-27T18:22:40.002087] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:22:40.018243] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T18:22:40.414964] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-27T18:22:40.879556] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T18:22:41.214966] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-27T18:22:41.738593] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T18:22:42.014963] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-27T18:22:42.701508] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T18:22:42.814910] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-27T18:22:42.932869] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-27T18:22:42.942158] [INFO ] [REMOTE ] DRH: Full fetch complete (71895 records). [2025-10-27T18:22:42.942284] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-27T18:22:43.323897] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-27T18:22:43.323984] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-27T18:22:43.324867] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-27T18:22:43.324965] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-27T18:22:43.326843] [DEBUG] [LOCAL ] DRH: Trimmed 71895 records to 50096 (keeping 200 days of data) [2025-10-27T18:22:43.612332] [DEBUG] [LOCAL ] DRH: Primary data saved (50096 records). [2025-10-27T18:22:43.612466] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-27T18:22:43.612557] [INFO ] [MAIN ] Update Progress: 652/2366 symbols completed. DRH took 39.8s. Estimated remaining: 3h 37m 21s. Rate: 7.9 symbols/min [2025-10-27T18:22:43.623610] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-27T18:22:43.784727] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:22:43.801849] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T18:22:43.826570] [DEBUG] [LOCAL ] DSU: Loaded 23142 existing records from primary storage. [2025-10-27T18:22:43.826837] [INFO ] [MAIN ] DSU: Loaded 23142 existing records. [2025-10-27T18:22:44.009692] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:22:44.009907] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-27T18:22:44.009971] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-27T18:22:44.010190] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-27T18:22:44.010237] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-27T18:22:44.274672] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-27T18:22:44.370401] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:22:44.414925] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-27T18:22:45.214941] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-27T18:22:45.721587] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T18:22:46.014964] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-27T18:22:46.311999] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T18:22:46.390473] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-27T18:22:46.814996] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-27T18:22:47.614991] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-27T18:22:47.912410] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-27T18:22:48.159015] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-27T18:22:48.415000] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-27T18:22:49.130162] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-27T18:22:49.214907] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-27T18:22:50.014921] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-27T18:22:50.082638] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-27T18:22:50.802511] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T18:22:50.814917] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-27T18:22:51.614944] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-27T18:22:51.962777] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T18:22:51.965702] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-27T18:22:51.973842] [INFO ] [REMOTE ] DSL: Full fetch complete (41908 records). [2025-10-27T18:22:51.973923] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-27T18:22:52.344824] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-27T18:22:52.344900] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-27T18:22:52.345479] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-27T18:22:52.345519] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-27T18:22:52.346362] [DEBUG] [LOCAL ] DSL: Trimmed 41908 records to 28643 (keeping 200 days of data) [2025-10-27T18:22:52.431363] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-27T18:22:52.523898] [DEBUG] [LOCAL ] DSL: Primary data saved (28643 records). [2025-10-27T18:22:52.524041] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-27T18:22:52.524125] [INFO ] [MAIN ] Update Progress: 653/2366 symbols completed. DSL took 25.6s. Estimated remaining: 3h 37m 17s. Rate: 7.9 symbols/min [2025-10-27T18:22:52.696038] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:22:52.717274] [DEBUG] [LOCAL ] DSX: Loaded 23770 existing records from primary storage. [2025-10-27T18:22:52.717529] [INFO ] [MAIN ] DSX: Loaded 23770 existing records. [2025-10-27T18:22:52.896200] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-27T18:22:52.901531] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:22:52.903777] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-27T18:22:52.903827] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-27T18:22:52.904077] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-27T18:22:52.904136] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-27T18:22:53.218608] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-27T18:22:53.254210] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:22:53.932501] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T18:22:54.015003] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-27T18:22:54.814951] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-27T18:22:55.009036] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-27T18:22:55.205465] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-27T18:22:55.614935] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-27T18:22:56.414992] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-27T18:22:56.590280] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T18:22:56.750339] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-27T18:22:57.214933] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-27T18:22:57.954546] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-27T18:22:58.014953] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-27T18:22:58.537697] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-27T18:22:58.814939] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-27T18:22:59.614957] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-27T18:23:00.414952] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-27T18:23:01.214981] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-27T18:23:04.099844] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (3.68 seconds). [2025-10-27T18:23:04.101382] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-27T18:23:04.927082] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (5.31 seconds). [2025-10-27T18:23:04.932823] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-27T18:23:05.651333] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (6.84 seconds). [2025-10-27T18:23:05.654736] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-27T18:23:05.977379] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-27T18:23:05.984985] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-27T18:23:06.108305] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-27T18:23:06.109580] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-27T18:23:06.200428] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-27T18:23:06.204108] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-27T18:23:06.351495] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (5.14 seconds). [2025-10-27T18:23:06.814897] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-27T18:23:06.922540] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-27T18:23:07.118663] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-27T18:23:07.121194] [INFO ] [REMOTE ] DSM: Full fetch complete (23854 records). [2025-10-27T18:23:07.121278] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-27T18:23:07.121841] [FATAL] [VALIDATOR ] DSM: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:23:07.121943] [FATAL] [MAIN ] DSM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:23:07.121985] [WARN ] [MAIN ] DSM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:23:07.122023] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-27T18:23:07.122091] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-10-27T18:23:07.122145] [INFO ] [LOCAL ] DSM: Starting deletion of derivative data. [2025-10-27T18:23:07.122613] [DEBUG] [LOCAL ] DSM: Deleted derivative data file. [2025-10-27T18:23:07.122734] [INFO ] [MAIN ] Update Progress: 654/2366 symbols completed. DSM took 29.6s. Estimated remaining: 3h 37m 27s. Rate: 7.9 symbols/min [2025-10-27T18:23:07.291370] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:23:07.339471] [DEBUG] [LOCAL ] DT: Loaded 53703 existing records from primary storage. [2025-10-27T18:23:07.339792] [INFO ] [MAIN ] DT: Loaded 53703 existing records. [2025-10-27T18:23:07.518159] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:23:07.518327] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-27T18:23:07.518372] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-27T18:23:07.519047] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-27T18:23:07.519198] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-27T18:23:07.616401] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-27T18:23:07.706614] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-27T18:23:07.723813] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T18:23:07.737976] [INFO ] [REMOTE ] DSMC: Full fetch complete (2884 records). [2025-10-27T18:23:07.760290] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-27T18:23:08.108759] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:23:08.254003] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-10-27T18:23:08.254071] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-10-27T18:23:08.254165] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-10-27T18:23:08.254221] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-10-27T18:23:08.254591] [DEBUG] [LOCAL ] DSMC: Trimmed 2884 records to 1704 (keeping 200 days of data) [2025-10-27T18:23:08.265344] [DEBUG] [LOCAL ] DSMC: Primary data saved (1704 records). [2025-10-27T18:23:08.265421] [INFO ] [MAIN ] DSMC: Full history saved. [2025-10-27T18:23:08.265494] [INFO ] [MAIN ] Update Progress: 655/2366 symbols completed. DSMC took 29.0s. Estimated remaining: 3h 37m 3s. Rate: 7.9 symbols/min [2025-10-27T18:23:08.433354] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-27T18:23:08.437173] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:23:08.445398] [DEBUG] [LOCAL ] DTB: Loaded 4934 existing records from primary storage. [2025-10-27T18:23:08.445593] [INFO ] [MAIN ] DTB: Loaded 4934 existing records. [2025-10-27T18:23:08.627522] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:23:08.627789] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-27T18:23:08.627839] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-27T18:23:08.627969] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-10-27T18:23:08.628006] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-27T18:23:08.768639] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T18:23:09.000893] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:23:09.214917] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-27T18:23:09.704912] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T18:23:10.014913] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-27T18:23:10.316263] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T18:23:10.814947] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-27T18:23:11.172033] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-27T18:23:11.614950] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-27T18:23:12.275306] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-27T18:23:12.311033] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T18:23:12.414943] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-27T18:23:13.214949] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-27T18:23:13.616709] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T18:23:13.673962] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-27T18:23:14.015000] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-27T18:23:14.814961] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-27T18:23:15.342475] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-27T18:23:15.614914] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-27T18:23:15.804971] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T18:23:16.414937] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-27T18:23:17.214912] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-27T18:23:17.451295] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T18:23:17.494577] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T18:23:18.014939] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-27T18:23:18.120686] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-27T18:23:18.636317] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T18:23:18.814999] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-27T18:23:19.493352] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-27T18:23:19.614906] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-27T18:23:20.414931] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-27T18:23:20.881818] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T18:23:20.886236] [INFO ] [REMOTE ] DSX: Full fetch complete (35223 records). [2025-10-27T18:23:20.886326] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-27T18:23:21.071685] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-27T18:23:21.221081] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-27T18:23:21.269450] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-27T18:23:21.269529] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-27T18:23:21.270117] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-27T18:23:21.270182] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-27T18:23:21.271022] [DEBUG] [LOCAL ] DSX: Trimmed 35223 records to 23205 (keeping 200 days of data) [2025-10-27T18:23:21.404878] [DEBUG] [LOCAL ] DSX: Primary data saved (23205 records). [2025-10-27T18:23:21.405000] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-27T18:23:21.405073] [INFO ] [MAIN ] Update Progress: 656/2366 symbols completed. DSX took 28.9s. Estimated remaining: 3h 37m 9s. Rate: 7.9 symbols/min [2025-10-27T18:23:21.572811] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:23:21.619252] [DEBUG] [LOCAL ] DTE: Loaded 47740 existing records from primary storage. [2025-10-27T18:23:21.619553] [INFO ] [MAIN ] DTE: Loaded 47740 existing records. [2025-10-27T18:23:21.801072] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:23:21.801331] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-27T18:23:21.801386] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-27T18:23:21.801560] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-27T18:23:21.801601] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-27T18:23:22.020049] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-27T18:23:22.156210] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:23:22.191894] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-27T18:23:22.196332] [INFO ] [REMOTE ] DSU: Full fetch complete (32790 records). [2025-10-27T18:23:22.196406] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-27T18:23:22.196978] [FATAL] [VALIDATOR ] DSU: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:23:22.197061] [FATAL] [MAIN ] DSU: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:23:22.197104] [WARN ] [MAIN ] DSU: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:23:22.197166] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-27T18:23:22.197227] [DEBUG] [LOCAL ] DSU: No primary data file found to delete. [2025-10-27T18:23:22.197263] [INFO ] [LOCAL ] DSU: Starting deletion of derivative data. [2025-10-27T18:23:22.197392] [DEBUG] [LOCAL ] DSU: Deleted derivative data file. [2025-10-27T18:23:22.197476] [INFO ] [MAIN ] Update Progress: 657/2366 symbols completed. DSU took 38.6s. Estimated remaining: 3h 36m 44s. Rate: 7.9 symbols/min [2025-10-27T18:23:22.362192] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:23:22.362347] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-27T18:23:22.362384] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-27T18:23:22.362491] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-27T18:23:22.362533] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-27T18:23:22.362573] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-27T18:23:22.362605] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-27T18:23:22.641835] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-27T18:23:22.718781] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:23:22.814946] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-27T18:23:23.144502] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-27T18:23:23.614946] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-27T18:23:24.414957] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-27T18:23:25.214978] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-27T18:23:25.289807] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T18:23:25.641891] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-27T18:23:26.015111] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-27T18:23:26.285074] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-27T18:23:26.814942] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-27T18:23:27.174150] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-27T18:23:27.515475] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T18:23:27.614983] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-27T18:23:28.067302] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-27T18:23:28.414987] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-27T18:23:29.215004] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-27T18:23:29.778993] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T18:23:30.014985] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-27T18:23:30.521351] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-27T18:23:30.815017] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-27T18:23:31.374030] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T18:23:31.620065] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-27T18:23:31.640492] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T18:23:32.138630] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-27T18:23:32.414997] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-27T18:23:33.194724] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-27T18:23:33.214897] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-27T18:23:33.846445] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T18:23:34.015042] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-27T18:23:34.814947] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-27T18:23:35.464161] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T18:23:35.614961] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-27T18:23:36.065979] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-27T18:23:36.157134] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T18:23:36.414961] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-27T18:23:37.214952] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-27T18:23:37.769887] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T18:23:38.007525] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T18:23:38.008758] [INFO ] [REMOTE ] DTB: Full fetch complete (6481 records). [2025-10-27T18:23:38.008828] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-27T18:23:38.009254] [FATAL] [VALIDATOR ] DTB: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:23:38.009337] [FATAL] [MAIN ] DTB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:23:38.009379] [WARN ] [MAIN ] DTB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:23:38.009417] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-27T18:23:38.009472] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-27T18:23:38.009508] [INFO ] [LOCAL ] DTB: Starting deletion of derivative data. [2025-10-27T18:23:38.009661] [DEBUG] [LOCAL ] DTB: Deleted derivative data file. [2025-10-27T18:23:38.009750] [INFO ] [MAIN ] Update Progress: 658/2366 symbols completed. DTB took 29.7s. Estimated remaining: 3h 36m 58s. Rate: 7.9 symbols/min [2025-10-27T18:23:38.020128] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-27T18:23:38.179182] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:23:38.186313] [DEBUG] [LOCAL ] DTG: Loaded 5731 existing records from primary storage. [2025-10-27T18:23:38.187117] [INFO ] [MAIN ] DTG: Loaded 5731 existing records. [2025-10-27T18:23:38.359055] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:23:38.359263] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-27T18:23:38.359312] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-27T18:23:38.359448] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-10-27T18:23:38.359484] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-27T18:23:38.543942] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-27T18:23:38.731682] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:23:38.814926] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-27T18:23:39.146521] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-27T18:23:39.614991] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-27T18:23:40.073831] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-27T18:23:40.414960] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-27T18:23:41.104698] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T18:23:41.214962] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-27T18:23:42.014941] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-27T18:23:42.386047] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-27T18:23:42.814998] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-27T18:23:42.990544] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T18:23:43.256686] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-27T18:23:43.614948] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-27T18:23:44.415022] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-27T18:23:44.918393] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-27T18:23:45.101622] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-27T18:23:45.214913] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-27T18:23:46.014997] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-27T18:23:46.814922] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-27T18:23:46.895256] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T18:23:47.384969] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-27T18:23:47.385784] [INFO ] [REMOTE ] DTF: Full fetch complete (1734 records). [2025-10-27T18:23:47.385872] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-27T18:23:47.580538] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-27T18:23:47.580819] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:23:47.580905] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:23:47.581020] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-27T18:23:47.581085] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-27T18:23:47.581122] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-27T18:23:47.581162] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-27T18:23:47.581219] [INFO ] [MAIN ] Update Progress: 659/2366 symbols completed. DTF took 25.4s. Estimated remaining: 3h 36m 55s. Rate: 7.9 symbols/min [2025-10-27T18:23:47.620055] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-27T18:23:47.766309] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:23:47.766490] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-27T18:23:47.766629] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-27T18:23:47.766940] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-27T18:23:47.766999] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-27T18:23:47.767044] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-27T18:23:47.767078] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-27T18:23:48.134628] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:23:48.165362] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-27T18:23:48.414953] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-01. [2025-10-27T18:23:48.610171] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T18:23:48.610468] [WARN ] [REMOTE ] DTK: No data returned for month 2025-01 [2025-10-27T18:23:48.610554] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T18:23:48.610598] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-27T18:23:48.610678] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T18:23:48.610748] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-27T18:23:48.610809] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-27T18:23:48.610877] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-27T18:23:48.610938] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-27T18:23:48.610985] [INFO ] [MAIN ] Update Progress: 660/2366 symbols completed. DTK took 1.0s. Estimated remaining: 3h 36m 31s. Rate: 7.9 symbols/min [2025-10-27T18:23:48.783880] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:23:48.827560] [DEBUG] [LOCAL ] DTM: Loaded 44410 existing records from primary storage. [2025-10-27T18:23:48.827907] [INFO ] [MAIN ] DTM: Loaded 44410 existing records. [2025-10-27T18:23:49.014600] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:23:49.014957] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-27T18:23:49.015055] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-27T18:23:49.015441] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-27T18:23:49.015518] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-27T18:23:49.223297] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-27T18:23:49.296824] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T18:23:49.366236] [INFO ] [REMOTE ] DTE: Full fetch complete (68848 records). [2025-10-27T18:23:49.369608] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-27T18:23:49.556203] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:23:49.837237] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-27T18:23:49.837313] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-27T18:23:49.838144] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-27T18:23:49.838207] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-27T18:23:49.839531] [DEBUG] [LOCAL ] DTE: Trimmed 68848 records to 46946 (keeping 200 days of data) [2025-10-27T18:23:50.022301] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-27T18:23:50.123736] [DEBUG] [LOCAL ] DTE: Primary data saved (46946 records). [2025-10-27T18:23:50.123874] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-27T18:23:50.124629] [INFO ] [MAIN ] Update Progress: 661/2366 symbols completed. DTE took 28.7s. Estimated remaining: 3h 36m 7s. Rate: 7.9 symbols/min [2025-10-27T18:23:50.289385] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:23:50.296995] [DEBUG] [LOCAL ] DTW: Loaded 4751 existing records from primary storage. [2025-10-27T18:23:50.297239] [INFO ] [MAIN ] DTW: Loaded 4751 existing records. [2025-10-27T18:23:50.471832] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:23:50.472020] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-27T18:23:50.472067] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-27T18:23:50.472198] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-10-27T18:23:50.472235] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-27T18:23:50.838837] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:23:50.834111] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-27T18:23:50.913415] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-27T18:23:51.398633] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T18:23:51.413788] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T18:23:51.614944] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-27T18:23:52.414946] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-27T18:23:52.641082] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T18:23:53.057172] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-27T18:23:53.214980] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-27T18:23:54.014951] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-27T18:23:54.594047] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T18:23:54.814923] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-27T18:23:55.350669] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-27T18:23:55.614967] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-27T18:23:55.713224] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-27T18:23:56.016123] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-27T18:23:56.414973] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-27T18:23:56.790073] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-27T18:23:57.214926] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-27T18:23:57.806073] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-27T18:23:58.015016] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-27T18:23:58.687810] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-27T18:23:58.814954] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-27T18:23:59.265796] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-27T18:23:59.614941] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-27T18:24:00.259275] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-27T18:24:00.414953] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-27T18:24:01.214954] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-27T18:24:02.014952] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-27T18:24:02.185245] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-27T18:24:02.186871] [INFO ] [REMOTE ] DTG: Full fetch complete (8495 records). [2025-10-27T18:24:02.186989] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-27T18:24:02.546508] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-27T18:24:02.546589] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-27T18:24:02.546828] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-27T18:24:02.546888] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-27T18:24:02.547334] [DEBUG] [LOCAL ] DTG: Trimmed 8495 records to 5634 (keeping 200 days of data) [2025-10-27T18:24:02.580144] [DEBUG] [LOCAL ] DTG: Primary data saved (5634 records). [2025-10-27T18:24:02.580239] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-27T18:24:02.580317] [INFO ] [MAIN ] Update Progress: 662/2366 symbols completed. DTG took 24.6s. Estimated remaining: 3h 36m 12s. Rate: 7.9 symbols/min [2025-10-27T18:24:02.692242] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-27T18:24:02.757467] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:24:02.808070] [DEBUG] [LOCAL ] DUK: Loaded 54202 existing records from primary storage. [2025-10-27T18:24:02.808384] [INFO ] [MAIN ] DUK: Loaded 54202 existing records. [2025-10-27T18:24:02.820830] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-27T18:24:02.987284] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:24:02.987506] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-27T18:24:02.987554] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-27T18:24:02.987765] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-27T18:24:02.987820] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-27T18:24:03.346990] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:24:03.354117] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-27T18:24:03.524097] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-27T18:24:03.614921] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-27T18:24:04.414984] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-27T18:24:05.214973] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-27T18:24:05.697080] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-27T18:24:05.706971] [INFO ] [REMOTE ] DT: Full fetch complete (76876 records). [2025-10-27T18:24:05.707079] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-27T18:24:06.017291] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-27T18:24:06.116851] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-27T18:24:06.117000] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-27T18:24:06.117896] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-27T18:24:06.117969] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-27T18:24:06.119474] [DEBUG] [LOCAL ] DT: Trimmed 76876 records to 52910 (keeping 200 days of data) [2025-10-27T18:24:06.259841] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-27T18:24:06.451452] [DEBUG] [LOCAL ] DT: Primary data saved (52910 records). [2025-10-27T18:24:06.451584] [INFO ] [MAIN ] DT: Full history saved. [2025-10-27T18:24:06.451686] [INFO ] [MAIN ] Update Progress: 663/2366 symbols completed. DT took 59.3s. Estimated remaining: 3h 35m 55s. Rate: 7.9 symbols/min [2025-10-27T18:24:06.583692] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-27T18:24:06.631574] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:24:06.639170] [DEBUG] [LOCAL ] DUKB: Loaded 6185 existing records from primary storage. [2025-10-27T18:24:06.639358] [INFO ] [MAIN ] DUKB: Loaded 6185 existing records. [2025-10-27T18:24:06.815869] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-27T18:24:06.819255] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:24:06.820172] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-27T18:24:06.820235] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-27T18:24:06.820400] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-10-27T18:24:06.820457] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-27T18:24:07.182866] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:24:07.211132] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-27T18:24:07.614927] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-27T18:24:08.175311] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T18:24:08.239095] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-27T18:24:08.414931] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-27T18:24:09.214984] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-27T18:24:09.804638] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-27T18:24:09.832264] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T18:24:10.015003] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-27T18:24:10.672508] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T18:24:10.814940] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-27T18:24:11.169735] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-27T18:24:11.614938] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-27T18:24:12.414980] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-27T18:24:12.830726] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-27T18:24:13.214946] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-27T18:24:13.994196] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-27T18:24:14.014898] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-27T18:24:14.370907] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-27T18:24:14.427726] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-27T18:24:14.814935] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-27T18:24:15.477156] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T18:24:15.614940] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-27T18:24:16.414950] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-27T18:24:17.226549] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-27T18:24:17.229254] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-27T18:24:17.950683] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-27T18:24:18.015003] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-27T18:24:18.416288] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-27T18:24:18.558101] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-27T18:24:18.815027] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-27T18:24:19.614966] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-27T18:24:20.100598] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-27T18:24:20.101902] [INFO ] [REMOTE ] DTW: Full fetch complete (6913 records). [2025-10-27T18:24:20.101971] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-27T18:24:20.426353] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-27T18:24:20.470360] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-10-27T18:24:20.470460] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-10-27T18:24:20.470715] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-10-27T18:24:20.470874] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-10-27T18:24:20.471276] [DEBUG] [LOCAL ] DTW: Trimmed 6913 records to 4638 (keeping 200 days of data) [2025-10-27T18:24:20.499720] [DEBUG] [LOCAL ] DTW: Primary data saved (4638 records). [2025-10-27T18:24:20.499817] [INFO ] [MAIN ] DTW: Full history saved. [2025-10-27T18:24:20.499893] [INFO ] [MAIN ] Update Progress: 664/2366 symbols completed. DTW took 30.4s. Estimated remaining: 3h 36m 4s. Rate: 7.9 symbols/min [2025-10-27T18:24:20.673838] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:24:20.724364] [DEBUG] [LOCAL ] DV: Loaded 52001 existing records from primary storage. [2025-10-27T18:24:20.735836] [INFO ] [MAIN ] DV: Loaded 52001 existing records. [2025-10-27T18:24:20.872672] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-27T18:24:20.959238] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:24:20.960018] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-27T18:24:20.960071] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-27T18:24:20.960274] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-27T18:24:20.960330] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-27T18:24:21.220226] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-27T18:24:21.319935] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:24:22.014966] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-27T18:24:22.244875] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-27T18:24:22.253992] [INFO ] [REMOTE ] DTM: Full fetch complete (65291 records). [2025-10-27T18:24:22.254143] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-27T18:24:22.688079] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-27T18:24:22.688168] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-27T18:24:22.689010] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-27T18:24:22.689074] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-27T18:24:22.690403] [DEBUG] [LOCAL ] DTM: Trimmed 65291 records to 43642 (keeping 200 days of data) [2025-10-27T18:24:22.814949] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-27T18:24:22.960255] [DEBUG] [LOCAL ] DTM: Primary data saved (43642 records). [2025-10-27T18:24:22.960533] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-27T18:24:22.960672] [INFO ] [MAIN ] Update Progress: 665/2366 symbols completed. DTM took 34.3s. Estimated remaining: 3h 35m 43s. Rate: 7.9 symbols/min [2025-10-27T18:24:23.133351] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:24:23.172120] [DEBUG] [LOCAL ] DVA: Loaded 41227 existing records from primary storage. [2025-10-27T18:24:23.172442] [INFO ] [MAIN ] DVA: Loaded 41227 existing records. [2025-10-27T18:24:23.388036] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:24:23.389057] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-27T18:24:23.389574] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-27T18:24:23.391534] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-27T18:24:23.402057] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-27T18:24:23.402723] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-27T18:24:23.601021] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-27T18:24:23.617316] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-27T18:24:23.794245] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-27T18:24:23.835699] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:24:24.414931] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-27T18:24:25.214925] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-27T18:24:25.423815] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T18:24:25.533762] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-27T18:24:26.014952] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-27T18:24:26.322857] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T18:24:26.814924] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-27T18:24:27.574493] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T18:24:27.614917] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-27T18:24:28.013093] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-27T18:24:28.414988] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-27T18:24:29.108208] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T18:24:29.214920] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-27T18:24:29.784901] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-27T18:24:30.014945] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-27T18:24:30.814960] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-27T18:24:30.901850] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T18:24:31.340300] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T18:24:31.536362] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-27T18:24:31.615020] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-27T18:24:31.998792] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-27T18:24:32.414984] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-27T18:24:33.215013] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-27T18:24:33.971935] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T18:24:34.014908] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-27T18:24:34.711173] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T18:24:34.814931] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-27T18:24:35.607775] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T18:24:35.620539] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-27T18:24:36.123050] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-27T18:24:36.124374] [INFO ] [REMOTE ] DUKB: Full fetch complete (8916 records). [2025-10-27T18:24:36.124445] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-27T18:24:36.125342] [FATAL] [VALIDATOR ] DUKB: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:24:36.125426] [FATAL] [MAIN ] DUKB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:24:36.125492] [WARN ] [MAIN ] DUKB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:24:36.125562] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-27T18:24:36.125629] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-10-27T18:24:36.125700] [INFO ] [LOCAL ] DUKB: Starting deletion of derivative data. [2025-10-27T18:24:36.125847] [DEBUG] [LOCAL ] DUKB: Deleted derivative data file. [2025-10-27T18:24:36.125933] [INFO ] [MAIN ] Update Progress: 666/2366 symbols completed. DUKB took 29.7s. Estimated remaining: 3h 35m 49s. Rate: 7.9 symbols/min [2025-10-27T18:24:36.291769] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:24:36.341033] [DEBUG] [LOCAL ] DVN: Loaded 54479 existing records from primary storage. [2025-10-27T18:24:36.341351] [INFO ] [MAIN ] DVN: Loaded 54479 existing records. [2025-10-27T18:24:36.415050] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-27T18:24:36.521594] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:24:36.521880] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-27T18:24:36.522045] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-27T18:24:36.522310] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-10-27T18:24:36.522401] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-27T18:24:36.844625] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-27T18:24:36.892163] [INFO ] [REMOTE ] DUK: Full fetch complete (77170 records). [2025-10-27T18:24:36.906705] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-27T18:24:36.911262] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:24:36.912138] [FATAL] [VALIDATOR ] DUK: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:24:36.912241] [FATAL] [MAIN ] DUK: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:24:36.912283] [WARN ] [MAIN ] DUK: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:24:36.912323] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-27T18:24:36.912375] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-10-27T18:24:36.912409] [INFO ] [LOCAL ] DUK: Starting deletion of derivative data. [2025-10-27T18:24:36.912529] [DEBUG] [LOCAL ] DUK: Deleted derivative data file. [2025-10-27T18:24:36.912595] [INFO ] [MAIN ] Update Progress: 667/2366 symbols completed. DUK took 34.3s. Estimated remaining: 3h 35m 24s. Rate: 7.9 symbols/min [2025-10-27T18:24:37.078396] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:24:37.129085] [DEBUG] [LOCAL ] DX: Loaded 53303 existing records from primary storage. [2025-10-27T18:24:37.129375] [INFO ] [MAIN ] DX: Loaded 53303 existing records. [2025-10-27T18:24:37.224504] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-27T18:24:37.304408] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:24:37.304576] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-27T18:24:37.304629] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-27T18:24:37.304864] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-10-27T18:24:37.304909] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-27T18:24:37.658698] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:24:38.014922] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-27T18:24:38.087750] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T18:24:38.814976] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-27T18:24:39.082104] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-27T18:24:39.614949] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-27T18:24:40.279494] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-27T18:24:40.414908] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-27T18:24:40.598860] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-27T18:24:40.956527] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-27T18:24:41.214958] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-27T18:24:42.014917] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-27T18:24:42.122300] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-27T18:24:42.601216] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-27T18:24:42.815016] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-27T18:24:43.362468] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T18:24:43.614935] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-27T18:24:44.372637] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T18:24:44.414909] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-27T18:24:44.859888] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T18:24:45.215075] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-27T18:24:46.014945] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-27T18:24:46.614203] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-27T18:24:46.814899] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-27T18:24:47.078616] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-27T18:24:47.506711] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T18:24:47.614906] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-27T18:24:48.414926] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-27T18:24:48.528252] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T18:24:49.214921] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-27T18:24:49.342115] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-27T18:24:49.582907] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T18:24:50.014934] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-27T18:24:50.814911] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-27T18:24:50.866085] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-27T18:24:50.876025] [INFO ] [REMOTE ] DV: Full fetch complete (73906 records). [2025-10-27T18:24:50.876144] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-27T18:24:51.257097] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-27T18:24:51.257175] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-27T18:24:51.258097] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-27T18:24:51.258163] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-27T18:24:51.259490] [DEBUG] [LOCAL ] DV: Trimmed 73906 records to 51235 (keeping 200 days of data) [2025-10-27T18:24:51.557008] [DEBUG] [LOCAL ] DV: Primary data saved (51235 records). [2025-10-27T18:24:51.557167] [INFO ] [MAIN ] DV: Full history saved. [2025-10-27T18:24:51.557958] [INFO ] [MAIN ] Update Progress: 668/2366 symbols completed. DV took 31.1s. Estimated remaining: 3h 35m 35s. Rate: 7.9 symbols/min [2025-10-27T18:24:51.620252] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-27T18:24:51.739812] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:24:51.801003] [DEBUG] [LOCAL ] DXC: Loaded 50620 existing records from primary storage. [2025-10-27T18:24:51.801389] [INFO ] [MAIN ] DXC: Loaded 50620 existing records. [2025-10-27T18:24:51.990826] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:24:51.991206] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-27T18:24:51.991318] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-27T18:24:51.991599] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-27T18:24:51.991759] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-27T18:24:52.143476] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-27T18:24:52.389357] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:24:52.414901] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-27T18:24:52.696262] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T18:24:53.055330] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-27T18:24:53.214943] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-27T18:24:53.452150] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-27T18:24:54.014961] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-27T18:24:54.748199] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T18:24:54.755125] [INFO ] [REMOTE ] DVA: Full fetch complete (59341 records). [2025-10-27T18:24:54.755213] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-27T18:24:54.755864] [FATAL] [VALIDATOR ] DVA: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:24:54.755944] [FATAL] [MAIN ] DVA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:24:54.755986] [WARN ] [MAIN ] DVA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:24:54.756022] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-27T18:24:54.756077] [DEBUG] [LOCAL ] DVA: No primary data file found to delete. [2025-10-27T18:24:54.756111] [INFO ] [LOCAL ] DVA: Starting deletion of derivative data. [2025-10-27T18:24:54.756229] [DEBUG] [LOCAL ] DVA: Deleted derivative data file. [2025-10-27T18:24:54.756309] [INFO ] [MAIN ] Update Progress: 669/2366 symbols completed. DVA took 31.8s. Estimated remaining: 3h 35m 16s. Rate: 7.9 symbols/min [2025-10-27T18:24:54.820069] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-27T18:24:54.923630] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:24:54.959537] [DEBUG] [LOCAL ] DXYZ: Loaded 37529 existing records from primary storage. [2025-10-27T18:24:54.959867] [INFO ] [MAIN ] DXYZ: Loaded 37529 existing records. [2025-10-27T18:24:55.143957] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:24:55.144168] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-27T18:24:55.144216] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-27T18:24:55.144397] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-27T18:24:55.144436] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-27T18:24:55.512880] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:24:55.614924] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-27T18:24:55.717092] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T18:24:56.351208] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T18:24:56.414956] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-27T18:24:57.214949] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-27T18:24:57.721796] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-27T18:24:57.786287] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T18:24:58.014927] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-27T18:24:58.814917] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-27T18:24:59.319522] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-27T18:24:59.391396] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T18:24:59.614937] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-27T18:25:00.414924] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-27T18:25:00.830853] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-27T18:25:01.214923] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-27T18:25:01.258142] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T18:25:02.015005] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-27T18:25:02.391918] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-27T18:25:02.814957] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-27T18:25:03.130854] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-27T18:25:03.442188] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-27T18:25:03.614930] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-27T18:25:04.414920] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-27T18:25:04.670865] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T18:25:05.104190] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T18:25:05.214937] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-27T18:25:06.014961] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-27T18:25:06.194780] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T18:25:06.814927] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-27T18:25:06.860404] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T18:25:07.614932] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-27T18:25:07.735788] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T18:25:08.414911] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-27T18:25:08.736291] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-27T18:25:08.917804] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-27T18:25:09.214925] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-27T18:25:10.014943] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-27T18:25:10.522711] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-27T18:25:10.533013] [INFO ] [REMOTE ] DVN: Full fetch complete (77879 records). [2025-10-27T18:25:10.533139] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-27T18:25:10.821378] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-27T18:25:10.936330] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-10-27T18:25:10.936677] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-10-27T18:25:10.938199] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-10-27T18:25:10.938353] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-10-27T18:25:10.968494] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-27T18:25:10.979370] [DEBUG] [LOCAL ] DVN: Trimmed 77879 records to 53699 (keeping 200 days of data) [2025-10-27T18:25:11.329568] [DEBUG] [LOCAL ] DVN: Primary data saved (53699 records). [2025-10-27T18:25:11.329805] [INFO ] [MAIN ] DVN: Full history saved. [2025-10-27T18:25:11.329991] [INFO ] [MAIN ] Update Progress: 670/2366 symbols completed. DVN took 35.2s. Estimated remaining: 3h 35m 31s. Rate: 7.9 symbols/min [2025-10-27T18:25:11.522441] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:25:11.548006] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T18:25:11.557804] [INFO ] [REMOTE ] DXC: Full fetch complete (70454 records). [2025-10-27T18:25:11.557943] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-27T18:25:11.620073] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-27T18:25:11.739745] [DEBUG] [LOCAL ] DY: Loaded 28284 existing records from primary storage. [2025-10-27T18:25:11.774682] [INFO ] [MAIN ] DY: Loaded 28284 existing records. [2025-10-27T18:25:12.156456] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:25:12.159965] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-27T18:25:12.160092] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-27T18:25:12.160043] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-27T18:25:12.160998] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-27T18:25:12.160175] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-27T18:25:12.161120] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-27T18:25:12.161300] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-27T18:25:12.161356] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-27T18:25:12.263079] [DEBUG] [LOCAL ] DXC: Trimmed 70454 records to 49831 (keeping 200 days of data) [2025-10-27T18:25:12.690798] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:25:12.717026] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-27T18:25:12.805600] [DEBUG] [LOCAL ] DXC: Primary data saved (49831 records). [2025-10-27T18:25:12.805751] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-27T18:25:12.806382] [INFO ] [MAIN ] Update Progress: 671/2366 symbols completed. DXC took 21.2s. Estimated remaining: 3h 35m 8s. Rate: 7.9 symbols/min [2025-10-27T18:25:12.974777] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:25:13.006635] [DEBUG] [LOCAL ] E: Loaded 33700 existing records from primary storage. [2025-10-27T18:25:13.006932] [INFO ] [MAIN ] E: Loaded 33700 existing records. [2025-10-27T18:25:13.166432] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-27T18:25:13.213245] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:25:13.213683] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-27T18:25:13.213740] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-27T18:25:13.213947] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-27T18:25:13.213984] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-27T18:25:13.244710] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-27T18:25:13.562099] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:25:13.807997] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-27T18:25:13.817962] [INFO ] [REMOTE ] DX: Full fetch complete (75562 records). [2025-10-27T18:25:13.818120] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-27T18:25:13.818995] [FATAL] [VALIDATOR ] DX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:25:13.819110] [FATAL] [MAIN ] DX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:25:13.819153] [WARN ] [MAIN ] DX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:25:13.819190] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-27T18:25:13.819246] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-27T18:25:13.819281] [INFO ] [LOCAL ] DX: Starting deletion of derivative data. [2025-10-27T18:25:13.819402] [DEBUG] [LOCAL ] DX: Deleted derivative data file. [2025-10-27T18:25:13.819866] [INFO ] [MAIN ] Update Progress: 672/2366 symbols completed. DX took 36.9s. Estimated remaining: 3h 34m 44s. Rate: 7.9 symbols/min [2025-10-27T18:25:13.986591] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:25:14.014957] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-27T18:25:14.028921] [DEBUG] [LOCAL ] EAF: Loaded 41299 existing records from primary storage. [2025-10-27T18:25:14.029217] [INFO ] [MAIN ] EAF: Loaded 41299 existing records. [2025-10-27T18:25:14.230355] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:25:14.230718] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-27T18:25:14.230780] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-27T18:25:14.230947] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-27T18:25:14.230984] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-27T18:25:14.423418] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T18:25:14.605790] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:25:14.814897] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-27T18:25:15.012237] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-27T18:25:15.238592] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-27T18:25:15.615014] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-27T18:25:16.338072] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T18:25:16.414950] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-27T18:25:16.464722] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-27T18:25:17.214995] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-27T18:25:17.557431] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T18:25:18.015003] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-27T18:25:18.631355] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T18:25:18.814994] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-27T18:25:19.198806] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-27T18:25:19.614932] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-27T18:25:20.360524] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-27T18:25:20.414973] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-27T18:25:21.214967] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-27T18:25:21.566555] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-27T18:25:21.743366] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T18:25:22.014964] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-27T18:25:22.218712] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T18:25:22.814976] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-27T18:25:23.099533] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T18:25:23.615027] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-27T18:25:24.414954] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-27T18:25:24.580419] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-27T18:25:25.035598] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T18:25:25.214961] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-27T18:25:25.555331] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T18:25:26.014954] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-27T18:25:26.763399] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-27T18:25:26.814901] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-27T18:25:27.136132] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T18:25:27.614953] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-27T18:25:28.093475] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-27T18:25:28.415009] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-27T18:25:29.020831] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-27T18:25:29.214946] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-27T18:25:29.387571] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-27T18:25:29.995067] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-27T18:25:30.014973] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-27T18:25:30.815000] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-27T18:25:31.532502] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T18:25:31.614966] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-27T18:25:32.079507] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T18:25:32.414960] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-27T18:25:33.214991] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-27T18:25:33.493160] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T18:25:33.941215] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T18:25:33.947364] [INFO ] [REMOTE ] E: Full fetch complete (47634 records). [2025-10-27T18:25:33.947462] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-27T18:25:34.016853] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-27T18:25:34.334738] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-27T18:25:34.357768] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-27T18:25:34.358185] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-27T18:25:34.358956] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-27T18:25:34.359025] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-27T18:25:34.360266] [DEBUG] [LOCAL ] E: Trimmed 47634 records to 32833 (keeping 200 days of data) [2025-10-27T18:25:34.557246] [DEBUG] [LOCAL ] E: Primary data saved (32833 records). [2025-10-27T18:25:34.557380] [INFO ] [MAIN ] E: Full history saved. [2025-10-27T18:25:34.557456] [INFO ] [MAIN ] Update Progress: 673/2366 symbols completed. E took 21.8s. Estimated remaining: 3h 35m 9s. Rate: 7.9 symbols/min [2025-10-27T18:25:34.724590] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:25:34.730022] [DEBUG] [LOCAL ] EAI: Loaded 3971 existing records from primary storage. [2025-10-27T18:25:34.730211] [INFO ] [MAIN ] EAI: Loaded 3971 existing records. [2025-10-27T18:25:34.821893] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-27T18:25:34.910986] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:25:34.911190] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-27T18:25:34.911235] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-27T18:25:34.911435] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-27T18:25:34.911492] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-27T18:25:35.262060] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:25:35.288216] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T18:25:35.614918] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-27T18:25:35.940080] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-27T18:25:36.123101] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-27T18:25:36.414917] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-27T18:25:37.214946] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-27T18:25:37.566015] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-27T18:25:38.014924] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-27T18:25:38.050526] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-27T18:25:38.814996] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-27T18:25:39.352246] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-27T18:25:39.614932] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-27T18:25:39.982239] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-27T18:25:40.414950] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-27T18:25:40.444053] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T18:25:40.828427] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-27T18:25:41.214941] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-27T18:25:41.895940] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-27T18:25:42.014915] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-27T18:25:42.814915] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-27T18:25:43.221939] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T18:25:43.226336] [INFO ] [REMOTE ] DY: Full fetch complete (43228 records). [2025-10-27T18:25:43.226422] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-27T18:25:43.590559] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-27T18:25:43.590634] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-27T18:25:43.591267] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-27T18:25:43.591312] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-27T18:25:43.592186] [DEBUG] [LOCAL ] DY: Trimmed 43228 records to 27690 (keeping 200 days of data) [2025-10-27T18:25:43.640537] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-27T18:25:43.754884] [DEBUG] [LOCAL ] DY: Primary data saved (27690 records). [2025-10-27T18:25:43.755002] [INFO ] [MAIN ] DY: Full history saved. [2025-10-27T18:25:43.755076] [INFO ] [MAIN ] Update Progress: 674/2366 symbols completed. DY took 32.4s. Estimated remaining: 3h 35m 5s. Rate: 7.9 symbols/min [2025-10-27T18:25:43.919909] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:25:43.945734] [DEBUG] [LOCAL ] EARN: Loaded 28066 existing records from primary storage. [2025-10-27T18:25:43.946077] [INFO ] [MAIN ] EARN: Loaded 28066 existing records. [2025-10-27T18:25:44.054500] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-27T18:25:44.135544] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:25:44.135933] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-27T18:25:44.136098] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-27T18:25:44.136497] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-27T18:25:44.136556] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-27T18:25:44.253717] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T18:25:44.420156] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-27T18:25:44.514686] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:25:45.214941] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-27T18:25:46.014946] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-27T18:25:46.404424] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T18:25:46.412174] [INFO ] [REMOTE ] DXYZ: Full fetch complete (56371 records). [2025-10-27T18:25:46.412289] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-27T18:25:46.699057] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-27T18:25:46.793300] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-27T18:25:46.793450] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-27T18:25:46.794182] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-27T18:25:46.794244] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-27T18:25:46.795317] [DEBUG] [LOCAL ] DXYZ: Trimmed 56371 records to 36706 (keeping 200 days of data) [2025-10-27T18:25:46.842824] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-27T18:25:47.006634] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-27T18:25:47.036987] [DEBUG] [LOCAL ] DXYZ: Primary data saved (36706 records). [2025-10-27T18:25:47.037086] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-27T18:25:47.037155] [INFO ] [MAIN ] Update Progress: 675/2366 symbols completed. DXYZ took 52.3s. Estimated remaining: 3h 34m 47s. Rate: 7.9 symbols/min [2025-10-27T18:25:47.204672] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:25:47.250458] [DEBUG] [LOCAL ] EAT: Loaded 50437 existing records from primary storage. [2025-10-27T18:25:47.255048] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-27T18:25:47.257087] [INFO ] [MAIN ] EAT: Loaded 50437 existing records. [2025-10-27T18:25:47.428168] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:25:47.428353] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-27T18:25:47.428397] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-27T18:25:47.428583] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-27T18:25:47.428637] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-27T18:25:47.625479] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-27T18:25:47.770932] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:25:48.414958] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-27T18:25:49.154902] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T18:25:49.214899] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-27T18:25:50.014916] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-27T18:25:50.275609] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-27T18:25:50.814914] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-27T18:25:50.882962] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-27T18:25:51.183780] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-27T18:25:51.366748] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T18:25:51.375548] [INFO ] [REMOTE ] EAF: Full fetch complete (61676 records). [2025-10-27T18:25:51.375736] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-27T18:25:51.624571] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-27T18:25:51.765789] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-27T18:25:51.765870] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-27T18:25:51.766608] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-27T18:25:51.766674] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-27T18:25:51.767904] [DEBUG] [LOCAL ] EAF: Trimmed 61676 records to 40545 (keeping 200 days of data) [2025-10-27T18:25:51.988184] [DEBUG] [LOCAL ] EAF: Primary data saved (40545 records). [2025-10-27T18:25:51.988302] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-27T18:25:51.988375] [INFO ] [MAIN ] Update Progress: 676/2366 symbols completed. EAF took 38.2s. Estimated remaining: 3h 34m 33s. Rate: 7.9 symbols/min [2025-10-27T18:25:52.155971] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:25:52.187447] [DEBUG] [LOCAL ] EB: Loaded 36579 existing records from primary storage. [2025-10-27T18:25:52.187773] [INFO ] [MAIN ] EB: Loaded 36579 existing records. [2025-10-27T18:25:52.359231] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:25:52.359424] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-27T18:25:52.359497] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-27T18:25:52.359788] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-27T18:25:52.359858] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-27T18:25:52.421451] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-27T18:25:52.709038] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:25:53.214931] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-27T18:25:53.299877] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-27T18:25:53.301518] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T18:25:53.303228] [INFO ] [REMOTE ] EAI: Full fetch complete (5771 records). [2025-10-27T18:25:53.311729] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-27T18:25:53.670212] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-10-27T18:25:53.670298] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-10-27T18:25:53.670456] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-10-27T18:25:53.670494] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-10-27T18:25:53.670931] [DEBUG] [LOCAL ] EAI: Trimmed 5771 records to 3807 (keeping 200 days of data) [2025-10-27T18:25:53.693595] [DEBUG] [LOCAL ] EAI: Primary data saved (3807 records). [2025-10-27T18:25:53.693737] [INFO ] [MAIN ] EAI: Full history saved. [2025-10-27T18:25:53.693839] [INFO ] [MAIN ] Update Progress: 677/2366 symbols completed. EAI took 19.1s. Estimated remaining: 3h 34m 10s. Rate: 7.9 symbols/min [2025-10-27T18:25:54.015007] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-27T18:25:54.774759] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T18:25:54.814903] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-27T18:25:55.461554] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T18:25:55.614957] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-27T18:25:56.285951] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T18:25:56.414952] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-27T18:25:56.608719] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T18:25:57.214943] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-27T18:25:57.874142] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T18:25:57.948190] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T18:25:58.014935] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-27T18:25:58.814915] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-27T18:25:59.194205] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T18:25:59.614950] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-27T18:26:00.414974] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-27T18:26:00.650870] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T18:26:01.102601] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T18:26:01.214909] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-27T18:26:01.719718] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T18:26:02.014946] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-27T18:26:02.654688] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T18:26:02.814957] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-27T18:26:03.614921] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-27T18:26:03.818217] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-27T18:26:03.848142] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T18:26:04.366428] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-27T18:26:04.414919] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-27T18:26:05.215008] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-27T18:26:05.692243] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-27T18:26:05.697786] [INFO ] [REMOTE ] EARN: Full fetch complete (45017 records). [2025-10-27T18:26:05.697877] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-27T18:26:06.024213] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-27T18:26:06.076162] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-27T18:26:06.076240] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-27T18:26:06.076945] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-27T18:26:06.077009] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-27T18:26:06.078019] [DEBUG] [LOCAL ] EARN: Trimmed 45017 records to 27168 (keeping 200 days of data) [2025-10-27T18:26:06.247458] [DEBUG] [LOCAL ] EARN: Primary data saved (27168 records). [2025-10-27T18:26:06.247626] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-27T18:26:06.247769] [INFO ] [MAIN ] Update Progress: 678/2366 symbols completed. EARN took 22.5s. Estimated remaining: 3h 34m 15s. Rate: 7.9 symbols/min [2025-10-27T18:26:06.679963] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-27T18:26:06.814899] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-27T18:26:07.697140] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-27T18:26:07.705723] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-27T18:26:08.262968] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T18:26:08.414954] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-27T18:26:08.765134] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T18:26:09.214937] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-27T18:26:10.255781] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T18:26:10.266879] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-27T18:26:10.532615] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T18:26:10.815000] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-27T18:26:12.064539] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-27T18:26:12.070936] [INFO ] [REMOTE ] EB: Full fetch complete (54656 records). [2025-10-27T18:26:12.071040] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-27T18:26:12.460720] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-27T18:26:12.487429] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-27T18:26:12.487508] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-27T18:26:12.488464] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-27T18:26:12.488542] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-27T18:26:12.489480] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-27T18:26:12.490795] [DEBUG] [LOCAL ] EB: Trimmed 54656 records to 35786 (keeping 200 days of data) [2025-10-27T18:26:12.682854] [DEBUG] [LOCAL ] EB: Primary data saved (35786 records). [2025-10-27T18:26:12.683017] [INFO ] [MAIN ] EB: Full history saved. [2025-10-27T18:26:12.683137] [INFO ] [MAIN ] Update Progress: 679/2366 symbols completed. EB took 20.7s. Estimated remaining: 3h 34m 4s. Rate: 7.9 symbols/min [2025-10-27T18:26:13.925600] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T18:26:13.936363] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-27T18:26:15.852429] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-27T18:26:15.863755] [INFO ] [REMOTE ] EAT: Full fetch complete (72457 records). [2025-10-27T18:26:15.863931] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-27T18:26:16.390774] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-27T18:26:16.390895] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-27T18:26:16.392443] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-27T18:26:16.392533] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-27T18:26:16.394479] [DEBUG] [LOCAL ] EAT: Trimmed 72457 records to 49667 (keeping 200 days of data) [2025-10-27T18:26:16.724590] [DEBUG] [LOCAL ] EAT: Primary data saved (49667 records). [2025-10-27T18:26:16.724771] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-27T18:26:16.724862] [INFO ] [MAIN ] Update Progress: 680/2366 symbols completed. EAT took 29.7s. Estimated remaining: 3h 33m 48s. Rate: 7.9 symbols/min [2025-10-27T18:26:17.373588] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:26:17.367530] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:26:17.451318] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:26:17.452364] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:26:17.489988] [DEBUG] [LOCAL ] EBF: Loaded 19579 existing records from primary storage. [2025-10-27T18:26:17.509298] [INFO ] [MAIN ] EBF: Loaded 19579 existing records. [2025-10-27T18:26:17.653956] [DEBUG] [LOCAL ] EBS: Loaded 47237 existing records from primary storage. [2025-10-27T18:26:17.654599] [DEBUG] [LOCAL ] EBR: Loaded 43984 existing records from primary storage. [2025-10-27T18:26:17.655559] [DEBUG] [LOCAL ] EC: Loaded 49596 existing records from primary storage. [2025-10-27T18:26:17.666591] [INFO ] [MAIN ] EBS: Loaded 47237 existing records. [2025-10-27T18:26:17.672235] [INFO ] [MAIN ] EBR: Loaded 43984 existing records. [2025-10-27T18:26:17.762368] [INFO ] [MAIN ] EC: Loaded 49596 existing records. [2025-10-27T18:26:17.891342] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:26:18.002686] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-27T18:26:18.052234] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-27T18:26:18.100027] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-27T18:26:18.145319] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-27T18:26:18.295517] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:26:18.258326] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:26:18.329819] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-27T18:26:18.340805] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-27T18:26:18.365146] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-27T18:26:18.387491] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:26:18.403494] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-27T18:26:18.378379] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-27T18:26:18.412592] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-27T18:26:18.412882] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-27T18:26:18.424274] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-27T18:26:18.424417] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-27T18:26:18.442862] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-27T18:26:18.453574] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-27T18:26:18.579272] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-27T18:26:19.461375] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:26:19.555888] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-27T18:26:19.820167] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:26:19.842453] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-27T18:26:19.845538] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:26:19.846753] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-27T18:26:19.931730] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:26:19.932133] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-27T18:26:20.869189] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T18:26:20.872931] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-27T18:26:20.998804] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T18:26:21.007619] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-27T18:26:21.243423] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T18:26:21.252387] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-27T18:26:21.545700] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-27T18:26:21.550063] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-27T18:26:21.869775] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-27T18:26:21.879494] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-27T18:26:22.011100] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-27T18:26:22.018691] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-27T18:26:22.385182] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-27T18:26:22.391150] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-27T18:26:22.447664] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-27T18:26:22.458634] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-27T18:26:23.131180] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T18:26:23.141419] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-27T18:26:23.243480] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T18:26:23.270420] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-27T18:26:23.615005] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-27T18:26:23.674182] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-27T18:26:24.414956] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-27T18:26:24.674142] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T18:26:25.129163] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-27T18:26:25.214901] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-27T18:26:25.385723] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T18:26:26.014972] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-27T18:26:26.731715] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T18:26:26.814942] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-27T18:26:27.053582] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T18:26:27.614986] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-27T18:26:28.191039] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T18:26:28.414914] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-27T18:26:28.711908] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T18:26:29.214951] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-27T18:26:29.920421] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T18:26:30.014919] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-27T18:26:30.376727] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T18:26:30.814982] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-27T18:26:31.113027] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T18:26:31.614959] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-27T18:26:32.335288] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T18:26:32.414903] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-27T18:26:32.604265] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-27T18:26:33.214981] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-27T18:26:34.014928] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-27T18:26:34.057200] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-27T18:26:34.383806] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-27T18:26:34.388597] [INFO ] [REMOTE ] EBF: Full fetch complete (28459 records). [2025-10-27T18:26:34.388734] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-27T18:26:34.756544] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-27T18:26:34.756623] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-27T18:26:34.757196] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-27T18:26:34.757257] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-27T18:26:34.757995] [DEBUG] [LOCAL ] EBF: Trimmed 28459 records to 19197 (keeping 200 days of data) [2025-10-27T18:26:34.840038] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-27T18:26:34.876087] [DEBUG] [LOCAL ] EBF: Primary data saved (19197 records). [2025-10-27T18:26:34.876239] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-27T18:26:34.876322] [INFO ] [MAIN ] Update Progress: 681/2366 symbols completed. EBF took 18.2s. Estimated remaining: 3h 34m 6s. Rate: 7.9 symbols/min [2025-10-27T18:26:35.072332] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:26:35.112972] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T18:26:35.132381] [DEBUG] [LOCAL ] ECAT: Loaded 29468 existing records from primary storage. [2025-10-27T18:26:35.132682] [INFO ] [MAIN ] ECAT: Loaded 29468 existing records. [2025-10-27T18:26:35.307274] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:26:35.307485] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-27T18:26:35.307532] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-27T18:26:35.307775] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-27T18:26:35.307831] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-27T18:26:35.621121] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-27T18:26:35.662468] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:26:36.414929] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-27T18:26:36.550123] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T18:26:37.214968] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-27T18:26:37.323595] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-27T18:26:38.014934] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-27T18:26:38.248833] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-27T18:26:38.338117] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-27T18:26:38.814998] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-27T18:26:39.614919] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-27T18:26:39.678096] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T18:26:39.974778] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-27T18:26:40.415020] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-27T18:26:41.175316] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T18:26:41.214901] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-27T18:26:41.900787] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T18:26:42.014983] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-27T18:26:42.629839] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T18:26:42.814915] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-27T18:26:43.315549] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T18:26:43.614929] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-27T18:26:44.423669] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-27T18:26:44.427371] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-27T18:26:44.580483] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-27T18:26:44.588923] [INFO ] [REMOTE ] EBR: Full fetch complete (62078 records). [2025-10-27T18:26:44.589025] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-27T18:26:44.589704] [FATAL] [VALIDATOR ] EBR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:26:44.589790] [FATAL] [MAIN ] EBR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:26:44.589832] [WARN ] [MAIN ] EBR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:26:44.589870] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-27T18:26:44.589933] [DEBUG] [LOCAL ] EBR: No primary data file found to delete. [2025-10-27T18:26:44.589973] [INFO ] [LOCAL ] EBR: Starting deletion of derivative data. [2025-10-27T18:26:44.590126] [DEBUG] [LOCAL ] EBR: Deleted derivative data file. [2025-10-27T18:26:44.590212] [INFO ] [MAIN ] Update Progress: 682/2366 symbols completed. EBR took 27.9s. Estimated remaining: 3h 34m 4s. Rate: 7.9 symbols/min [2025-10-27T18:26:44.756489] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:26:44.794393] [DEBUG] [LOCAL ] ECC: Loaded 43956 existing records from primary storage. [2025-10-27T18:26:44.794695] [INFO ] [MAIN ] ECC: Loaded 43956 existing records. [2025-10-27T18:26:44.974054] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:26:44.974294] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-27T18:26:44.974358] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-27T18:26:44.974539] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-27T18:26:44.974578] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-27T18:26:45.220048] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-27T18:26:45.320691] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:26:46.014916] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-27T18:26:46.324401] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-27T18:26:46.333706] [INFO ] [REMOTE ] EC: Full fetch complete (71873 records). [2025-10-27T18:26:46.333839] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-27T18:26:46.755521] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-27T18:26:46.755628] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-27T18:26:46.756578] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-27T18:26:46.756686] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-27T18:26:46.785282] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-27T18:26:46.794995] [DEBUG] [LOCAL ] EC: Trimmed 71873 records to 48770 (keeping 200 days of data) [2025-10-27T18:26:46.847336] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-27T18:26:46.994970] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T18:26:47.110212] [DEBUG] [LOCAL ] EC: Primary data saved (48770 records). [2025-10-27T18:26:47.110367] [INFO ] [MAIN ] EC: Full history saved. [2025-10-27T18:26:47.110462] [INFO ] [MAIN ] Update Progress: 683/2366 symbols completed. EC took 30.4s. Estimated remaining: 3h 33m 44s. Rate: 7.9 symbols/min [2025-10-27T18:26:47.277365] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:26:47.277529] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-27T18:26:47.277567] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-27T18:26:47.277673] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-27T18:26:47.277730] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-27T18:26:47.277775] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-27T18:26:47.277840] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-27T18:26:47.620055] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-27T18:26:47.624417] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:26:47.911512] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-27T18:26:48.415000] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-27T18:26:49.019353] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T18:26:49.214932] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-27T18:26:49.333583] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T18:26:50.015002] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-27T18:26:50.296265] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-10-27T18:26:50.297576] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T18:26:50.814935] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-27T18:26:51.614942] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-27T18:26:51.789669] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T18:26:51.946235] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-27T18:26:52.414949] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-27T18:26:52.786371] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-27T18:26:53.214932] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-27T18:26:53.508390] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-27T18:26:54.014955] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-27T18:26:54.814946] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-27T18:26:55.257772] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T18:26:55.279456] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-27T18:26:55.614959] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-27T18:26:55.972960] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-27T18:26:56.414936] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-27T18:26:57.214996] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-27T18:26:57.695639] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T18:26:58.014938] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-27T18:26:58.544636] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-27T18:26:58.553327] [INFO ] [REMOTE ] EBS: Full fetch complete (67394 records). [2025-10-27T18:26:58.553459] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-27T18:26:58.820089] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-27T18:26:58.946154] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-27T18:26:58.946346] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-27T18:26:58.947243] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-27T18:26:58.947310] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-27T18:26:58.948576] [DEBUG] [LOCAL ] EBS: Trimmed 67394 records to 46495 (keeping 200 days of data) [2025-10-27T18:26:59.163451] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-27T18:26:59.205465] [DEBUG] [LOCAL ] EBS: Primary data saved (46495 records). [2025-10-27T18:26:59.205575] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-27T18:26:59.205673] [INFO ] [MAIN ] Update Progress: 684/2366 symbols completed. EBS took 42.5s. Estimated remaining: 3h 33m 47s. Rate: 7.9 symbols/min [2025-10-27T18:26:59.375659] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:26:59.379925] [DEBUG] [LOCAL ] ECCU: Loaded 2170 existing records from primary storage. [2025-10-27T18:26:59.380063] [INFO ] [MAIN ] ECCU: Loaded 2170 existing records. [2025-10-27T18:26:59.559130] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:26:59.559489] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-27T18:26:59.559670] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-27T18:26:59.559819] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-10-27T18:26:59.559861] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-27T18:26:59.620162] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-27T18:26:59.969168] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:26:59.972385] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-27T18:26:59.974213] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-27T18:27:00.414940] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-27T18:27:01.214939] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-27T18:27:02.014943] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-27T18:27:02.298742] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-27T18:27:02.384713] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-27T18:27:02.447287] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T18:27:02.815001] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-27T18:27:03.614942] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-27T18:27:04.362461] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-27T18:27:04.414902] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-27T18:27:04.533685] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T18:27:05.214952] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-27T18:27:06.014942] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-27T18:27:06.219706] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-27T18:27:06.242972] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T18:27:06.248398] [INFO ] [REMOTE ] ECAT: Full fetch complete (42872 records). [2025-10-27T18:27:06.248475] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-27T18:27:06.409751] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-27T18:27:06.631575] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-27T18:27:06.631674] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-27T18:27:06.632340] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-27T18:27:06.632395] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-27T18:27:06.633363] [DEBUG] [LOCAL ] ECAT: Trimmed 42872 records to 28876 (keeping 200 days of data) [2025-10-27T18:27:06.802165] [DEBUG] [LOCAL ] ECAT: Primary data saved (28876 records). [2025-10-27T18:27:06.802285] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-27T18:27:06.802360] [INFO ] [MAIN ] Update Progress: 685/2366 symbols completed. ECAT took 31.9s. Estimated remaining: 3h 33m 39s. Rate: 7.9 symbols/min [2025-10-27T18:27:06.820114] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-27T18:27:06.971467] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:27:06.971589] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-27T18:27:06.971679] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-27T18:27:06.971790] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-27T18:27:06.971831] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-27T18:27:06.971871] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-27T18:27:06.971903] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-27T18:27:07.316520] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:27:07.324754] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-27T18:27:07.325428] [INFO ] [REMOTE ] ECCC: Full fetch complete (1311 records). [2025-10-27T18:27:07.325493] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-27T18:27:07.502998] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-27T18:27:07.503181] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:27:07.503230] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:27:07.503269] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-27T18:27:07.503329] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-27T18:27:07.503365] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-27T18:27:07.503406] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-27T18:27:07.503459] [INFO ] [MAIN ] Update Progress: 686/2366 symbols completed. ECCC took 20.4s. Estimated remaining: 3h 33m 15s. Rate: 7.9 symbols/min [2025-10-27T18:27:07.620156] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-27T18:27:07.672835] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:27:07.672953] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-27T18:27:07.672991] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-27T18:27:07.673094] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-27T18:27:07.673136] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-27T18:27:07.673178] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-27T18:27:07.673210] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-27T18:27:08.028729] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:27:08.268109] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-27T18:27:08.414939] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-27T18:27:08.924112] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-27T18:27:09.215008] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-27T18:27:09.559255] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-27T18:27:10.014999] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-27T18:27:10.389342] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-27T18:27:10.814996] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-27T18:27:11.614948] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-27T18:27:12.055038] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-27T18:27:12.387016] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T18:27:12.414899] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-27T18:27:13.214949] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-27T18:27:13.658778] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-27T18:27:14.014961] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-27T18:27:14.057297] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T18:27:14.460911] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-27T18:27:14.815001] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-27T18:27:15.614999] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-27T18:27:15.992871] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-27T18:27:16.414973] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-27T18:27:16.718684] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-27T18:27:16.726928] [INFO ] [REMOTE ] ECC: Full fetch complete (61363 records). [2025-10-27T18:27:16.727051] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-27T18:27:16.727803] [FATAL] [VALIDATOR ] ECC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:27:16.727886] [FATAL] [MAIN ] ECC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:27:16.727928] [WARN ] [MAIN ] ECC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:27:16.727989] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-27T18:27:16.728051] [DEBUG] [LOCAL ] ECC: No primary data file found to delete. [2025-10-27T18:27:16.728084] [INFO ] [LOCAL ] ECC: Starting deletion of derivative data. [2025-10-27T18:27:16.728348] [DEBUG] [LOCAL ] ECC: Deleted derivative data file. [2025-10-27T18:27:16.728436] [INFO ] [MAIN ] Update Progress: 687/2366 symbols completed. ECC took 32.1s. Estimated remaining: 3h 33m 11s. Rate: 7.9 symbols/min [2025-10-27T18:27:16.901736] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-27T18:27:16.903883] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:27:16.934427] [DEBUG] [LOCAL ] ECG: Loaded 33239 existing records from primary storage. [2025-10-27T18:27:16.934700] [INFO ] [MAIN ] ECG: Loaded 33239 existing records. [2025-10-27T18:27:17.116973] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:27:17.117150] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-27T18:27:17.117197] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-27T18:27:17.117412] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-27T18:27:17.117466] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-27T18:27:17.217537] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-27T18:27:17.478790] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:27:17.579239] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-27T18:27:18.014976] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-27T18:27:18.336054] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-27T18:27:18.814980] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-27T18:27:19.336546] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-27T18:27:19.614946] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-27T18:27:20.028363] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-27T18:27:20.414950] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-27T18:27:20.855740] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-27T18:27:21.214945] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-27T18:27:21.562247] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-27T18:27:22.014911] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-27T18:27:22.316857] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-27T18:27:22.814948] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-27T18:27:23.240072] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-27T18:27:23.614949] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-27T18:27:24.027060] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-27T18:27:24.414987] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-27T18:27:25.214998] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-27T18:27:25.624878] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-27T18:27:25.625633] [INFO ] [REMOTE ] ECCW: Full fetch complete (1424 records). [2025-10-27T18:27:25.625735] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-27T18:27:25.805709] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-27T18:27:25.805901] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:27:25.805981] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:27:25.806041] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-27T18:27:25.806114] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-27T18:27:25.806149] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-27T18:27:25.806186] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-27T18:27:25.806238] [INFO ] [MAIN ] Update Progress: 688/2366 symbols completed. ECCW took 19.0s. Estimated remaining: 3h 33m 7s. Rate: 7.9 symbols/min [2025-10-27T18:27:25.978932] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:27:26.022685] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-27T18:27:26.025430] [DEBUG] [LOCAL ] ECL: Loaded 47402 existing records from primary storage. [2025-10-27T18:27:26.025769] [INFO ] [MAIN ] ECL: Loaded 47402 existing records. [2025-10-27T18:27:26.147572] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T18:27:26.230298] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:27:26.230520] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-27T18:27:26.230577] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-27T18:27:26.230770] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-27T18:27:26.230826] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-27T18:27:26.578935] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:27:26.630458] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-27T18:27:26.814946] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-27T18:27:27.252509] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-27T18:27:27.614948] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-27T18:27:28.268495] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-27T18:27:28.415028] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-27T18:27:29.214969] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-27T18:27:29.502028] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-27T18:27:29.942415] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T18:27:30.014940] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-27T18:27:30.814990] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-27T18:27:31.529770] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-27T18:27:31.561687] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T18:27:31.614898] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-27T18:27:32.414945] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-27T18:27:32.719587] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-27T18:27:32.861178] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-27T18:27:33.214969] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-27T18:27:33.695337] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-27T18:27:34.014941] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-27T18:27:34.433161] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-27T18:27:34.815009] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-27T18:27:35.250314] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-27T18:27:35.251083] [INFO ] [REMOTE ] ECCX: Full fetch complete (1442 records). [2025-10-27T18:27:35.251171] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-27T18:27:35.429384] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-27T18:27:35.429554] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:27:35.429599] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:27:35.429638] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-27T18:27:35.429734] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-27T18:27:35.429771] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-27T18:27:35.429812] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-27T18:27:35.429918] [INFO ] [MAIN ] Update Progress: 689/2366 symbols completed. ECCX took 27.9s. Estimated remaining: 3h 33m 4s. Rate: 7.9 symbols/min [2025-10-27T18:27:35.606300] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:27:35.615132] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-27T18:27:35.623815] [DEBUG] [LOCAL ] ECO: Loaded 18336 existing records from primary storage. [2025-10-27T18:27:35.624059] [INFO ] [MAIN ] ECO: Loaded 18336 existing records. [2025-10-27T18:27:35.829603] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:27:35.829854] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-27T18:27:35.829901] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-27T18:27:35.830098] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-27T18:27:35.830154] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-27T18:27:36.128590] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T18:27:36.145367] [INFO ] [REMOTE ] ECCU: Full fetch complete (4021 records). [2025-10-27T18:27:36.166402] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-27T18:27:36.309577] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:27:36.420233] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-27T18:27:36.578679] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-10-27T18:27:36.578761] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-10-27T18:27:36.578886] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-10-27T18:27:36.578922] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-10-27T18:27:36.579247] [DEBUG] [LOCAL ] ECCU: Trimmed 4021 records to 2087 (keeping 200 days of data) [2025-10-27T18:27:36.591751] [DEBUG] [LOCAL ] ECCU: Primary data saved (2087 records). [2025-10-27T18:27:36.591809] [INFO ] [MAIN ] ECCU: Full history saved. [2025-10-27T18:27:36.591873] [INFO ] [MAIN ] Update Progress: 690/2366 symbols completed. ECCU took 37.4s. Estimated remaining: 3h 32m 41s. Rate: 7.9 symbols/min [2025-10-27T18:27:36.756262] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:27:36.792261] [DEBUG] [LOCAL ] ECVT: Loaded 43610 existing records from primary storage. [2025-10-27T18:27:36.792539] [INFO ] [MAIN ] ECVT: Loaded 43610 existing records. [2025-10-27T18:27:36.967224] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:27:36.967406] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-27T18:27:36.967450] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-27T18:27:36.967698] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-27T18:27:36.967765] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-27T18:27:37.219998] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-27T18:27:37.319443] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:27:37.893176] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T18:27:38.014931] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-27T18:27:38.814923] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-27T18:27:38.940694] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T18:27:38.972371] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-27T18:27:39.614987] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-27T18:27:39.888726] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-27T18:27:40.414942] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-27T18:27:40.780632] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T18:27:41.214991] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-27T18:27:41.484124] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-27T18:27:42.015010] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-27T18:27:42.498944] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-27T18:27:42.786377] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-27T18:27:42.814901] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-27T18:27:43.614931] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-27T18:27:44.096849] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-27T18:27:44.414950] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-27T18:27:45.012587] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T18:27:45.118827] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T18:27:45.214943] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-27T18:27:46.014956] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-27T18:27:46.612381] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T18:27:46.814958] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-27T18:27:47.622233] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-27T18:27:47.627984] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T18:27:47.904441] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-27T18:27:48.385607] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-27T18:27:48.414961] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-27T18:27:49.214942] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-27T18:27:49.348346] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-27T18:27:50.014943] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-27T18:27:50.700095] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-27T18:27:50.814972] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-27T18:27:51.112857] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-27T18:27:51.614953] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-27T18:27:51.680919] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T18:27:52.414930] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-27T18:27:53.215000] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-27T18:27:53.444429] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-27T18:27:53.452569] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-27T18:27:53.930692] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T18:27:54.014900] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-27T18:27:54.815006] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-27T18:27:55.123949] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T18:27:55.614977] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-27T18:27:55.858320] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T18:27:56.414940] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-27T18:27:56.757422] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-27T18:27:57.215030] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-27T18:27:57.638196] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T18:27:58.014995] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-27T18:27:58.653529] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T18:27:58.659885] [INFO ] [REMOTE ] ECG: Full fetch complete (50798 records). [2025-10-27T18:27:58.659995] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-27T18:27:58.818355] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-27T18:27:59.050600] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-27T18:27:59.051205] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-27T18:27:59.051885] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-27T18:27:59.052267] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T18:27:59.052367] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-27T18:27:59.056735] [INFO ] [REMOTE ] ECO: Full fetch complete (28191 records). [2025-10-27T18:27:59.056834] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-27T18:27:59.130955] [DEBUG] [LOCAL ] ECG: Trimmed 50798 records to 32450 (keeping 200 days of data) [2025-10-27T18:27:59.633713] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-27T18:27:59.646926] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-27T18:27:59.647438] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-27T18:27:59.647995] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-27T18:27:59.653892] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-27T18:27:59.670716] [DEBUG] [LOCAL ] ECO: Trimmed 28191 records to 17789 (keeping 200 days of data) [2025-10-27T18:27:59.670579] [DEBUG] [LOCAL ] ECG: Primary data saved (32450 records). [2025-10-27T18:27:59.670889] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-27T18:27:59.671204] [INFO ] [MAIN ] Update Progress: 691/2366 symbols completed. ECG took 42.9s. Estimated remaining: 3h 33m 11s. Rate: 7.9 symbols/min [2025-10-27T18:27:59.928849] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:27:59.954577] [DEBUG] [LOCAL ] ECO: Primary data saved (17789 records). [2025-10-27T18:27:59.954921] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-27T18:27:59.955042] [INFO ] [MAIN ] Update Progress: 692/2366 symbols completed. ECO took 24.5s. Estimated remaining: 3h 32m 45s. Rate: 7.9 symbols/min [2025-10-27T18:28:00.150192] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T18:28:00.165897] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:28:00.196358] [DEBUG] [LOCAL ] ED: Loaded 53298 existing records from primary storage. [2025-10-27T18:28:00.196750] [INFO ] [MAIN ] ED: Loaded 53298 existing records. [2025-10-27T18:28:00.327881] [DEBUG] [LOCAL ] EDD: Loaded 27595 existing records from primary storage. [2025-10-27T18:28:00.343455] [INFO ] [MAIN ] EDD: Loaded 27595 existing records. [2025-10-27T18:28:00.428902] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-27T18:28:00.472987] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:28:00.473374] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-27T18:28:00.489691] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-27T18:28:00.500203] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-27T18:28:00.505565] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-27T18:28:00.682887] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:28:00.683108] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-27T18:28:00.683388] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-27T18:28:00.699126] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-27T18:28:00.709429] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-27T18:28:01.166213] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:28:01.220024] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-27T18:28:01.341255] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:28:01.491080] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-27T18:28:02.014920] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-27T18:28:02.242556] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-27T18:28:02.803289] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T18:28:02.814895] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-27T18:28:02.865227] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-27T18:28:03.614957] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-27T18:28:04.414957] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-27T18:28:04.487874] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-27T18:28:04.856689] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-27T18:28:04.867887] [INFO ] [REMOTE ] ECVT: Full fetch complete (60404 records). [2025-10-27T18:28:04.868024] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-27T18:28:05.220089] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-27T18:28:05.271079] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-27T18:28:05.271164] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-27T18:28:05.271901] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-27T18:28:05.271963] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-27T18:28:05.273169] [DEBUG] [LOCAL ] ECVT: Trimmed 60404 records to 42785 (keeping 200 days of data) [2025-10-27T18:28:05.511253] [DEBUG] [LOCAL ] ECVT: Primary data saved (42785 records). [2025-10-27T18:28:05.511373] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-27T18:28:05.511473] [INFO ] [MAIN ] Update Progress: 693/2366 symbols completed. ECVT took 28.9s. Estimated remaining: 3h 32m 33s. Rate: 7.9 symbols/min [2025-10-27T18:28:05.676722] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:28:05.689107] [DEBUG] [LOCAL ] EDF: Loaded 12935 existing records from primary storage. [2025-10-27T18:28:05.689306] [INFO ] [MAIN ] EDF: Loaded 12935 existing records. [2025-10-27T18:28:05.866074] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:28:05.866318] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-27T18:28:05.866391] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-27T18:28:05.866704] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-27T18:28:05.866806] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-27T18:28:06.015330] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-27T18:28:06.251809] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:28:06.263695] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-27T18:28:06.814915] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-27T18:28:07.182376] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-27T18:28:07.282599] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T18:28:07.614977] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-27T18:28:08.414966] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-27T18:28:08.749715] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-27T18:28:08.799245] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-27T18:28:09.214972] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-27T18:28:09.947745] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T18:28:09.983384] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T18:28:10.014932] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-27T18:28:10.669238] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-27T18:28:10.814928] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-27T18:28:11.614946] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-27T18:28:11.779185] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-27T18:28:12.301232] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-27T18:28:12.414961] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-27T18:28:13.214954] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-27T18:28:13.772561] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T18:28:14.014965] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-27T18:28:14.315210] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-27T18:28:14.814978] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-27T18:28:15.003954] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T18:28:15.614952] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-27T18:28:16.262693] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-27T18:28:16.271743] [INFO ] [REMOTE ] ECL: Full fetch complete (68443 records). [2025-10-27T18:28:16.271868] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-27T18:28:16.420097] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-27T18:28:16.671951] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-27T18:28:16.672060] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-27T18:28:16.672892] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-27T18:28:16.672960] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-27T18:28:16.674341] [DEBUG] [LOCAL ] ECL: Trimmed 68443 records to 46631 (keeping 200 days of data) [2025-10-27T18:28:16.975393] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T18:28:17.012304] [DEBUG] [LOCAL ] ECL: Primary data saved (46631 records). [2025-10-27T18:28:17.013341] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-27T18:28:17.014128] [INFO ] [MAIN ] Update Progress: 694/2366 symbols completed. ECL took 51.2s. Estimated remaining: 3h 32m 35s. Rate: 7.9 symbols/min [2025-10-27T18:28:17.205077] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:28:17.217682] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-27T18:28:17.227901] [DEBUG] [LOCAL ] EDN: Loaded 19648 existing records from primary storage. [2025-10-27T18:28:17.228171] [INFO ] [MAIN ] EDN: Loaded 19648 existing records. [2025-10-27T18:28:17.407709] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:28:17.407925] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-27T18:28:17.407973] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-27T18:28:17.408147] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-27T18:28:17.408202] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-27T18:28:17.770454] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:28:18.014914] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-27T18:28:18.225517] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-27T18:28:18.246384] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T18:28:18.814945] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-27T18:28:19.328273] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-27T18:28:19.365966] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T18:28:19.614977] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-27T18:28:20.298911] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-27T18:28:20.414933] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-27T18:28:21.214926] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-27T18:28:21.232063] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T18:28:22.014912] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-27T18:28:22.353811] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T18:28:22.814923] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-27T18:28:22.835966] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-27T18:28:23.614939] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-27T18:28:24.171169] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T18:28:24.414908] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-27T18:28:24.527905] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-27T18:28:24.530195] [INFO ] [REMOTE ] EDF: Full fetch complete (19707 records). [2025-10-27T18:28:24.530268] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-27T18:28:24.530726] [FATAL] [VALIDATOR ] EDF: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:28:24.530822] [FATAL] [MAIN ] EDF: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:28:24.530887] [WARN ] [MAIN ] EDF: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:28:24.530956] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-27T18:28:24.531030] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-10-27T18:28:24.531109] [INFO ] [LOCAL ] EDF: Starting deletion of derivative data. [2025-10-27T18:28:24.531255] [DEBUG] [LOCAL ] EDF: Deleted derivative data file. [2025-10-27T18:28:24.531338] [INFO ] [MAIN ] Update Progress: 695/2366 symbols completed. EDF took 19.0s. Estimated remaining: 3h 32m 27s. Rate: 7.9 symbols/min [2025-10-27T18:28:24.699286] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:28:24.736619] [DEBUG] [LOCAL ] EDU: Loaded 45389 existing records from primary storage. [2025-10-27T18:28:24.736945] [INFO ] [MAIN ] EDU: Loaded 45389 existing records. [2025-10-27T18:28:24.911479] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:28:24.911682] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-27T18:28:24.911738] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-27T18:28:24.911952] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-27T18:28:24.911989] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-27T18:28:25.225582] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-27T18:28:25.271376] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:28:25.700301] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-27T18:28:26.014999] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-27T18:28:26.655894] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T18:28:26.814952] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-27T18:28:26.990022] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-27T18:28:27.614960] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-27T18:28:28.414985] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-27T18:28:28.673489] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-27T18:28:29.121060] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T18:28:29.214977] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-27T18:28:29.281285] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-27T18:28:30.014955] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-27T18:28:30.621812] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T18:28:30.814937] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-27T18:28:31.189300] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T18:28:31.614974] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-27T18:28:32.296201] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-27T18:28:32.306059] [INFO ] [REMOTE ] ED: Full fetch complete (76321 records). [2025-10-27T18:28:32.306197] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-27T18:28:32.417138] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-27T18:28:32.718378] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-27T18:28:32.719018] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-27T18:28:32.720605] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-27T18:28:32.719537] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-27T18:28:32.724520] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-27T18:28:32.726607] [DEBUG] [LOCAL ] ED: Trimmed 76321 records to 52504 (keeping 200 days of data) [2025-10-27T18:28:33.049176] [DEBUG] [LOCAL ] ED: Primary data saved (52504 records). [2025-10-27T18:28:33.049307] [INFO ] [MAIN ] ED: Full history saved. [2025-10-27T18:28:33.049383] [INFO ] [MAIN ] Update Progress: 696/2366 symbols completed. ED took 33.4s. Estimated remaining: 3h 32m 21s. Rate: 7.9 symbols/min [2025-10-27T18:28:33.217079] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-27T18:28:33.216966] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:28:33.249554] [DEBUG] [LOCAL ] EE: Loaded 32959 existing records from primary storage. [2025-10-27T18:28:33.249848] [INFO ] [MAIN ] EE: Loaded 32959 existing records. [2025-10-27T18:28:33.425123] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:28:33.425331] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-27T18:28:33.425377] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-27T18:28:33.425617] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-27T18:28:33.425707] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-27T18:28:33.771868] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:28:33.829536] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T18:28:33.899195] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T18:28:34.014949] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-27T18:28:34.814923] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-27T18:28:35.077952] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T18:28:35.615012] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-27T18:28:36.414905] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-27T18:28:36.603507] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-27T18:28:36.810451] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T18:28:37.207039] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-27T18:28:37.214896] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-27T18:28:38.014976] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-27T18:28:38.343461] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T18:28:38.349727] [INFO ] [REMOTE ] EDD: Full fetch complete (38939 records). [2025-10-27T18:28:38.349901] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-27T18:28:38.350454] [FATAL] [VALIDATOR ] EDD: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:28:38.350540] [FATAL] [MAIN ] EDD: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:28:38.350582] [WARN ] [MAIN ] EDD: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:28:38.350619] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-27T18:28:38.350704] [DEBUG] [LOCAL ] EDD: No primary data file found to delete. [2025-10-27T18:28:38.350754] [INFO ] [LOCAL ] EDD: Starting deletion of derivative data. [2025-10-27T18:28:38.350919] [DEBUG] [LOCAL ] EDD: Deleted derivative data file. [2025-10-27T18:28:38.351009] [INFO ] [MAIN ] Update Progress: 697/2366 symbols completed. EDD took 38.4s. Estimated remaining: 3h 32m 8s. Rate: 7.9 symbols/min [2025-10-27T18:28:38.518220] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:28:38.518388] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-27T18:28:38.518423] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-27T18:28:38.518536] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-27T18:28:38.518585] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-27T18:28:38.518636] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-27T18:28:38.518741] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-27T18:28:38.817486] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-27T18:28:38.901311] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-27T18:28:38.900361] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:28:39.614994] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-27T18:28:40.359088] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-27T18:28:40.414935] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-27T18:28:40.593032] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-27T18:28:41.214962] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-27T18:28:41.520081] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-27T18:28:41.867215] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-27T18:28:42.014949] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-27T18:28:42.809263] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T18:28:42.814888] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-27T18:28:43.614928] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-27T18:28:43.716546] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T18:28:44.414935] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-27T18:28:45.167431] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-27T18:28:45.214923] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-27T18:28:45.304535] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-27T18:28:45.309820] [INFO ] [REMOTE ] EDN: Full fetch complete (29665 records). [2025-10-27T18:28:45.309946] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-27T18:28:45.603879] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-27T18:28:45.709841] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-27T18:28:45.709920] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-27T18:28:45.710395] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-27T18:28:45.710435] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-27T18:28:45.711240] [DEBUG] [LOCAL ] EDN: Trimmed 29665 records to 19576 (keeping 200 days of data) [2025-10-27T18:28:45.824896] [DEBUG] [LOCAL ] EDN: Primary data saved (19576 records). [2025-10-27T18:28:45.825064] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-27T18:28:45.825173] [INFO ] [MAIN ] Update Progress: 698/2366 symbols completed. EDN took 28.8s. Estimated remaining: 3h 31m 60s. Rate: 7.9 symbols/min [2025-10-27T18:28:45.990515] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:28:46.001904] [DEBUG] [LOCAL ] EEX: Loaded 9933 existing records from primary storage. [2025-10-27T18:28:46.002106] [INFO ] [MAIN ] EEX: Loaded 9933 existing records. [2025-10-27T18:28:46.022533] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-27T18:28:46.179836] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:28:46.180057] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-27T18:28:46.180103] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-27T18:28:46.180265] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-27T18:28:46.180321] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-27T18:28:46.544962] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:28:46.814966] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-27T18:28:47.621611] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-27T18:28:47.624079] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T18:28:48.282967] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-27T18:28:48.414968] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-27T18:28:48.527285] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T18:28:49.214962] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-27T18:28:49.324072] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-27T18:28:49.638523] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-27T18:28:50.015008] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-27T18:28:50.814962] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-27T18:28:51.339974] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-27T18:28:51.560762] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T18:28:51.614902] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-27T18:28:52.414934] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-27T18:28:52.427860] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-27T18:28:53.214995] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-27T18:28:53.718892] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-27T18:28:53.906723] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-27T18:28:54.014963] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-27T18:28:54.516619] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-27T18:28:54.814948] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-27T18:28:55.441980] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-27T18:28:55.614984] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-27T18:28:56.100323] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-27T18:28:56.414964] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-27T18:28:56.914124] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-27T18:28:57.214950] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-27T18:28:58.014958] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-27T18:28:58.617131] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T18:28:58.814927] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-27T18:28:59.025308] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-27T18:28:59.614972] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-27T18:29:00.249864] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T18:29:00.277580] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-27T18:29:00.414953] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-27T18:29:01.214975] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-27T18:29:01.268913] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T18:29:01.855515] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-27T18:29:02.014922] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-27T18:29:02.369953] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-27T18:29:02.814936] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-27T18:29:03.614945] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-27T18:29:04.337018] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T18:29:04.414990] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-27T18:29:05.066317] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T18:29:05.214956] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-27T18:29:05.378563] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T18:29:05.380563] [INFO ] [REMOTE ] EEX: Full fetch complete (18113 records). [2025-10-27T18:29:05.380632] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-27T18:29:05.381053] [FATAL] [VALIDATOR ] EEX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:29:05.381136] [FATAL] [MAIN ] EEX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:29:05.381180] [WARN ] [MAIN ] EEX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:29:05.381218] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-27T18:29:05.381272] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-10-27T18:29:05.381306] [INFO ] [LOCAL ] EEX: Starting deletion of derivative data. [2025-10-27T18:29:05.381425] [DEBUG] [LOCAL ] EEX: Deleted derivative data file. [2025-10-27T18:29:05.381489] [INFO ] [MAIN ] Update Progress: 699/2366 symbols completed. EEX took 19.6s. Estimated remaining: 3h 32m 21s. Rate: 7.9 symbols/min [2025-10-27T18:29:05.550614] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:29:05.594512] [DEBUG] [LOCAL ] EFC: Loaded 46971 existing records from primary storage. [2025-10-27T18:29:05.594819] [INFO ] [MAIN ] EFC: Loaded 46971 existing records. [2025-10-27T18:29:05.768551] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:29:05.768769] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-27T18:29:05.768820] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-27T18:29:05.768998] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-27T18:29:05.769036] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-27T18:29:06.020079] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-27T18:29:06.137475] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:29:06.591500] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T18:29:06.815002] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-27T18:29:07.421708] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-27T18:29:07.614987] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-27T18:29:07.770750] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T18:29:07.779774] [INFO ] [REMOTE ] EDU: Full fetch complete (67167 records). [2025-10-27T18:29:07.779870] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-27T18:29:08.155713] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-27T18:29:08.155791] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-27T18:29:08.156550] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-27T18:29:08.156589] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-27T18:29:08.157836] [DEBUG] [LOCAL ] EDU: Trimmed 67167 records to 44629 (keeping 200 days of data) [2025-10-27T18:29:08.403812] [DEBUG] [LOCAL ] EDU: Primary data saved (44629 records). [2025-10-27T18:29:08.403932] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-27T18:29:08.404009] [INFO ] [MAIN ] Update Progress: 700/2366 symbols completed. EDU took 43.9s. Estimated remaining: 3h 32m 2s. Rate: 7.9 symbols/min [2025-10-27T18:29:08.424345] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-27T18:29:08.578975] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:29:08.594361] [DEBUG] [LOCAL ] EFR: Loaded 15254 existing records from primary storage. [2025-10-27T18:29:08.594589] [INFO ] [MAIN ] EFR: Loaded 15254 existing records. [2025-10-27T18:29:08.784692] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:29:08.784912] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-27T18:29:08.784959] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-27T18:29:08.785118] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-27T18:29:08.785155] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-27T18:29:09.017438] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-27T18:29:09.057237] [INFO ] [REMOTE ] EEA: Full fetch complete (3713 records). [2025-10-27T18:29:09.068377] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-27T18:29:09.231503] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-27T18:29:09.305158] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:29:09.392520] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-27T18:29:09.393707] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:29:09.395257] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-27T18:29:09.395368] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:29:09.402102] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-27T18:29:09.402602] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-27T18:29:09.402693] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-27T18:29:09.402870] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-27T18:29:09.402808] [INFO ] [REMOTE ] EE: Full fetch complete (44597 records). [2025-10-27T18:29:09.403036] [INFO ] [MAIN ] Update Progress: 701/2366 symbols completed. EEA took 31.1s. Estimated remaining: 3h 31m 39s. Rate: 7.9 symbols/min [2025-10-27T18:29:09.403182] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-27T18:29:09.748239] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:29:09.928758] [DEBUG] [LOCAL ] EFT: Loaded 13039 existing records from primary storage. [2025-10-27T18:29:09.950950] [INFO ] [MAIN ] EFT: Loaded 13039 existing records. [2025-10-27T18:29:10.020181] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-27T18:29:10.119540] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-27T18:29:10.120059] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-27T18:29:10.121094] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-27T18:29:10.126707] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-27T18:29:10.205247] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:29:10.205379] [DEBUG] [LOCAL ] EE: Trimmed 44597 records to 32366 (keeping 200 days of data) [2025-10-27T18:29:10.206014] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-27T18:29:10.206099] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-27T18:29:10.206528] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-27T18:29:10.206590] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-27T18:29:10.681072] [DEBUG] [LOCAL ] EE: Primary data saved (32366 records). [2025-10-27T18:29:10.708704] [INFO ] [MAIN ] EE: Full history saved. [2025-10-27T18:29:10.708888] [INFO ] [MAIN ] Update Progress: 702/2366 symbols completed. EE took 37.7s. Estimated remaining: 3h 31m 16s. Rate: 7.9 symbols/min [2025-10-27T18:29:10.920847] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:29:10.932128] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-27T18:29:10.976399] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-27T18:29:11.026229] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:29:11.028624] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-27T18:29:11.072736] [DEBUG] [LOCAL ] EFX: Loaded 45341 existing records from primary storage. [2025-10-27T18:29:11.073017] [INFO ] [MAIN ] EFX: Loaded 45341 existing records. [2025-10-27T18:29:11.246305] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:29:11.246547] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-27T18:29:11.246599] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-27T18:29:11.246871] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-27T18:29:11.246948] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-27T18:29:11.594633] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:29:11.614901] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-27T18:29:11.931586] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T18:29:12.414931] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-27T18:29:12.525449] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-27T18:29:13.214939] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-27T18:29:14.014971] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-27T18:29:14.049610] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T18:29:14.066589] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-27T18:29:14.814928] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-27T18:29:15.521898] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T18:29:15.614943] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-27T18:29:16.414976] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-27T18:29:16.490632] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T18:29:16.781991] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T18:29:17.008414] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-27T18:29:17.214956] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-27T18:29:18.014946] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-27T18:29:18.620763] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T18:29:18.794023] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T18:29:18.814914] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-27T18:29:19.572877] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-27T18:29:19.614908] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-27T18:29:20.134026] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-27T18:29:20.414992] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-27T18:29:21.215005] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-27T18:29:21.797860] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T18:29:21.859290] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-27T18:29:22.014966] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-27T18:29:22.724514] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T18:29:22.814921] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-27T18:29:23.614953] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-27T18:29:24.414962] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-27T18:29:24.550947] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-27T18:29:24.576836] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-27T18:29:25.214997] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-27T18:29:25.937131] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T18:29:26.014916] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-27T18:29:26.814982] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-27T18:29:26.954305] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T18:29:27.142540] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T18:29:27.380414] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-27T18:29:27.614942] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-27T18:29:28.217450] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T18:29:28.414927] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-27T18:29:29.059061] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-27T18:29:29.214929] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-27T18:29:29.895907] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-27T18:29:30.014979] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-27T18:29:30.763325] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-27T18:29:30.767036] [INFO ] [REMOTE ] EFR: Full fetch complete (19792 records). [2025-10-27T18:29:30.767119] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-27T18:29:30.820145] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-27T18:29:31.128697] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-27T18:29:31.128782] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-27T18:29:31.129207] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-27T18:29:31.129245] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-27T18:29:31.129801] [DEBUG] [LOCAL ] EFR: Trimmed 19792 records to 14825 (keeping 200 days of data) [2025-10-27T18:29:31.216552] [DEBUG] [LOCAL ] EFR: Primary data saved (14825 records). [2025-10-27T18:29:31.216738] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-27T18:29:31.216844] [INFO ] [MAIN ] Update Progress: 703/2366 symbols completed. EFR took 22.8s. Estimated remaining: 3h 31m 39s. Rate: 7.9 symbols/min [2025-10-27T18:29:31.385412] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:29:31.413770] [DEBUG] [LOCAL ] EFXT: Loaded 30013 existing records from primary storage. [2025-10-27T18:29:31.414025] [INFO ] [MAIN ] EFXT: Loaded 30013 existing records. [2025-10-27T18:29:31.592789] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:29:31.593009] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-27T18:29:31.593064] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-27T18:29:31.593245] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-27T18:29:31.593284] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-27T18:29:31.623923] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-27T18:29:31.966218] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:29:32.414939] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-27T18:29:32.506608] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T18:29:33.214919] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-27T18:29:33.241718] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T18:29:33.435070] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T18:29:34.014937] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-27T18:29:34.814940] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-27T18:29:35.008815] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-27T18:29:35.419124] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T18:29:35.614914] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-27T18:29:35.675158] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T18:29:36.120669] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-27T18:29:36.414986] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-27T18:29:37.214918] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-27T18:29:37.331119] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T18:29:37.991192] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T18:29:38.014905] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-27T18:29:38.701075] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-27T18:29:38.703989] [INFO ] [REMOTE ] EFT: Full fetch complete (17775 records). [2025-10-27T18:29:38.704061] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-27T18:29:38.820153] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-27T18:29:39.066355] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-27T18:29:39.066429] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-27T18:29:39.066842] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-27T18:29:39.066921] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-27T18:29:39.067435] [DEBUG] [LOCAL ] EFT: Trimmed 17775 records to 12689 (keeping 200 days of data) [2025-10-27T18:29:39.144111] [DEBUG] [LOCAL ] EFT: Primary data saved (12689 records). [2025-10-27T18:29:39.144250] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-27T18:29:39.144330] [INFO ] [MAIN ] Update Progress: 704/2366 symbols completed. EFT took 29.7s. Estimated remaining: 3h 31m 32s. Rate: 7.9 symbols/min [2025-10-27T18:29:39.316622] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:29:39.343940] [DEBUG] [LOCAL ] EG: Loaded 27743 existing records from primary storage. [2025-10-27T18:29:39.344191] [INFO ] [MAIN ] EG: Loaded 27743 existing records. [2025-10-27T18:29:39.520180] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:29:39.520380] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-27T18:29:39.520427] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-27T18:29:39.520741] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-27T18:29:39.520799] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-27T18:29:39.618841] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-27T18:29:39.864888] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:29:40.312420] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-27T18:29:40.415041] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-27T18:29:40.914435] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-27T18:29:41.214993] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-27T18:29:41.861280] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T18:29:42.014991] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-27T18:29:42.394937] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-27T18:29:42.814939] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-27T18:29:43.547479] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T18:29:43.556468] [INFO ] [REMOTE ] EFC: Full fetch complete (66799 records). [2025-10-27T18:29:43.556598] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-27T18:29:43.620048] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-27T18:29:43.951336] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-27T18:29:43.951418] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-27T18:29:43.952238] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-27T18:29:43.952303] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-27T18:29:43.953625] [DEBUG] [LOCAL ] EFC: Trimmed 66799 records to 46165 (keeping 200 days of data) [2025-10-27T18:29:44.243521] [DEBUG] [LOCAL ] EFC: Primary data saved (46165 records). [2025-10-27T18:29:44.243732] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-27T18:29:44.244582] [INFO ] [MAIN ] Update Progress: 705/2366 symbols completed. EFC took 38.9s. Estimated remaining: 3h 31m 18s. Rate: 7.9 symbols/min [2025-10-27T18:29:44.414531] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:29:44.415208] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-27T18:29:44.486194] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-27T18:29:44.496509] [DEBUG] [LOCAL ] EGO: Loaded 52493 existing records from primary storage. [2025-10-27T18:29:44.497088] [INFO ] [MAIN ] EGO: Loaded 52493 existing records. [2025-10-27T18:29:44.497226] [INFO ] [REMOTE ] EFX: Full fetch complete (65092 records). [2025-10-27T18:29:44.530202] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-27T18:29:44.864783] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:29:44.957463] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-27T18:29:44.977874] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-27T18:29:44.993850] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-27T18:29:45.004678] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-27T18:29:45.225511] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-27T18:29:45.226728] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T18:29:45.226939] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-27T18:29:45.228219] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-27T18:29:45.245045] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-27T18:29:45.274213] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-27T18:29:45.384467] [DEBUG] [LOCAL ] EFX: Trimmed 65092 records to 44559 (keeping 200 days of data) [2025-10-27T18:29:45.595964] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:29:45.791615] [DEBUG] [LOCAL ] EFX: Primary data saved (44559 records). [2025-10-27T18:29:45.791784] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-27T18:29:45.791868] [INFO ] [MAIN ] Update Progress: 706/2366 symbols completed. EFX took 35.1s. Estimated remaining: 3h 30m 56s. Rate: 7.9 symbols/min [2025-10-27T18:29:45.943475] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T18:29:45.998493] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:29:46.017491] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-27T18:29:46.031495] [DEBUG] [LOCAL ] EGP: Loaded 30745 existing records from primary storage. [2025-10-27T18:29:46.031776] [INFO ] [MAIN ] EGP: Loaded 30745 existing records. [2025-10-27T18:29:46.208006] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:29:46.208259] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-27T18:29:46.208312] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-27T18:29:46.208493] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-27T18:29:46.208530] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-27T18:29:46.592035] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:29:46.595817] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T18:29:46.814949] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-27T18:29:47.452237] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T18:29:47.614916] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-27T18:29:47.954500] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-27T18:29:48.414958] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-27T18:29:49.092037] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T18:29:49.214938] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-27T18:29:49.309105] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-27T18:29:50.014932] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-27T18:29:50.814957] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-27T18:29:51.400029] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-27T18:29:51.503106] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T18:29:51.614940] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-27T18:29:52.414968] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-27T18:29:52.479567] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T18:29:53.134630] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T18:29:53.214909] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-27T18:29:54.014997] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-27T18:29:54.170714] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-27T18:29:54.815016] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-27T18:29:55.421336] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-27T18:29:55.460241] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T18:29:55.614939] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-27T18:29:56.300070] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T18:29:56.414915] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-27T18:29:57.193223] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T18:29:57.214905] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-27T18:29:57.895675] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T18:29:58.014943] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-27T18:29:58.814943] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-27T18:29:58.960262] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-27T18:29:59.150590] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-27T18:29:59.614911] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-27T18:29:59.680502] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-27T18:30:00.414931] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-27T18:30:01.214960] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-27T18:30:01.283257] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T18:30:02.014951] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-27T18:30:02.064415] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T18:30:02.814964] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-27T18:30:02.861199] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T18:30:03.614936] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-27T18:30:03.691438] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-27T18:30:04.286454] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T18:30:04.414948] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-27T18:30:04.802950] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-27T18:30:05.214943] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-27T18:30:05.644533] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-27T18:30:06.014970] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-27T18:30:06.137467] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T18:30:06.814988] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-27T18:30:07.338597] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T18:30:07.615134] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-27T18:30:08.020035] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T18:30:08.027053] [INFO ] [REMOTE ] EFXT: Full fetch complete (44317 records). [2025-10-27T18:30:08.027187] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-27T18:30:08.417190] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-27T18:30:08.432043] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-27T18:30:08.432914] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-27T18:30:08.433623] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-27T18:30:08.433839] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-27T18:30:08.434903] [DEBUG] [LOCAL ] EFXT: Trimmed 44317 records to 29414 (keeping 200 days of data) [2025-10-27T18:30:08.614037] [DEBUG] [LOCAL ] EFXT: Primary data saved (29414 records). [2025-10-27T18:30:08.619697] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-27T18:30:08.629467] [INFO ] [MAIN ] Update Progress: 707/2366 symbols completed. EFXT took 37.4s. Estimated remaining: 3h 31m 25s. Rate: 7.8 symbols/min [2025-10-27T18:30:08.631032] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T18:30:08.812135] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:30:08.850319] [DEBUG] [LOCAL ] EGY: Loaded 41776 existing records from primary storage. [2025-10-27T18:30:08.850617] [INFO ] [MAIN ] EGY: Loaded 41776 existing records. [2025-10-27T18:30:09.032036] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:30:09.032252] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-27T18:30:09.032316] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-27T18:30:09.032576] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-27T18:30:09.032635] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-27T18:30:09.216478] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-27T18:30:09.411127] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:30:10.020061] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-27T18:30:10.029041] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-27T18:30:10.034550] [INFO ] [REMOTE ] EG: Full fetch complete (42515 records). [2025-10-27T18:30:10.034725] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-27T18:30:10.416861] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-27T18:30:10.417176] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-27T18:30:10.418007] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-27T18:30:10.418125] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-27T18:30:10.419371] [DEBUG] [LOCAL ] EG: Trimmed 42515 records to 27095 (keeping 200 days of data) [2025-10-27T18:30:10.605051] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-27T18:30:10.627355] [DEBUG] [LOCAL ] EG: Primary data saved (27095 records). [2025-10-27T18:30:10.628203] [INFO ] [MAIN ] EG: Full history saved. [2025-10-27T18:30:10.628333] [INFO ] [MAIN ] Update Progress: 708/2366 symbols completed. EG took 31.5s. Estimated remaining: 3h 31m 4s. Rate: 7.9 symbols/min [2025-10-27T18:30:10.792124] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:30:10.817274] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-27T18:30:10.817978] [DEBUG] [LOCAL ] EHAB: Loaded 29631 existing records from primary storage. [2025-10-27T18:30:10.819073] [INFO ] [MAIN ] EHAB: Loaded 29631 existing records. [2025-10-27T18:30:10.998544] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:30:10.998769] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-27T18:30:10.998827] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-27T18:30:10.999035] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-27T18:30:10.999090] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-27T18:30:11.367234] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:30:11.614961] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-27T18:30:11.766424] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T18:30:11.777690] [INFO ] [REMOTE ] EGO: Full fetch complete (74332 records). [2025-10-27T18:30:11.777882] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-27T18:30:11.779156] [FATAL] [VALIDATOR ] EGO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:30:11.779249] [FATAL] [MAIN ] EGO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:30:11.779291] [WARN ] [MAIN ] EGO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:30:11.779335] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-27T18:30:11.779403] [DEBUG] [LOCAL ] EGO: No primary data file found to delete. [2025-10-27T18:30:11.779440] [INFO ] [LOCAL ] EGO: Starting deletion of derivative data. [2025-10-27T18:30:11.779679] [DEBUG] [LOCAL ] EGO: Deleted derivative data file. [2025-10-27T18:30:11.780219] [INFO ] [MAIN ] Update Progress: 709/2366 symbols completed. EGO took 27.5s. Estimated remaining: 3h 30m 41s. Rate: 7.9 symbols/min [2025-10-27T18:30:11.950358] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:30:11.998030] [DEBUG] [LOCAL ] EHC: Loaded 41478 existing records from primary storage. [2025-10-27T18:30:11.998439] [INFO ] [MAIN ] EHC: Loaded 41478 existing records. [2025-10-27T18:30:12.185769] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:30:12.186908] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-27T18:30:12.186990] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-27T18:30:12.187297] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-27T18:30:12.187344] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-27T18:30:12.419519] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-27T18:30:12.536451] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-27T18:30:12.625602] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:30:12.647112] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-27T18:30:13.215028] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-27T18:30:13.854111] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T18:30:14.014987] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-27T18:30:14.814996] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-27T18:30:15.281378] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T18:30:15.614970] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-27T18:30:16.415012] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-27T18:30:17.824035] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T18:30:17.831926] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-27T18:30:17.941899] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (4.73 seconds). [2025-10-27T18:30:18.014916] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-27T18:30:18.330102] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-10-27T18:30:18.360823] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (3.55 seconds). [2025-10-27T18:30:18.814958] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-27T18:30:19.158741] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-27T18:30:19.509895] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-27T18:30:19.614918] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-27T18:30:20.414940] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-27T18:30:20.800594] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-27T18:30:20.806111] [INFO ] [REMOTE ] EGP: Full fetch complete (45390 records). [2025-10-27T18:30:20.806211] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-27T18:30:20.806930] [FATAL] [VALIDATOR ] EGP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:30:20.807018] [FATAL] [MAIN ] EGP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:30:20.807061] [WARN ] [MAIN ] EGP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:30:20.807098] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-27T18:30:20.807153] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-10-27T18:30:20.807187] [INFO ] [LOCAL ] EGP: Starting deletion of derivative data. [2025-10-27T18:30:20.807303] [DEBUG] [LOCAL ] EGP: Deleted derivative data file. [2025-10-27T18:30:20.807372] [INFO ] [MAIN ] Update Progress: 710/2366 symbols completed. EGP took 35.0s. Estimated remaining: 3h 30m 37s. Rate: 7.9 symbols/min [2025-10-27T18:30:20.978485] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:30:20.990207] [DEBUG] [LOCAL ] EHI: Loaded 10648 existing records from primary storage. [2025-10-27T18:30:20.990434] [INFO ] [MAIN ] EHI: Loaded 10648 existing records. [2025-10-27T18:30:21.171203] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:30:21.171551] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-27T18:30:21.171670] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-27T18:30:21.180420] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-27T18:30:21.193007] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-27T18:30:21.226095] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-27T18:30:21.269776] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T18:30:21.565636] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:30:21.859784] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-27T18:30:22.015012] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-27T18:30:22.814932] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-27T18:30:22.847612] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-27T18:30:22.915464] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T18:30:23.614971] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-27T18:30:24.191497] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T18:30:24.414904] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-27T18:30:24.523052] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-27T18:30:25.214936] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-27T18:30:25.891186] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-27T18:30:26.014997] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-27T18:30:26.815043] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-27T18:30:26.969129] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T18:30:27.007859] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-27T18:30:27.614978] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-27T18:30:28.414960] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-27T18:30:28.449693] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-27T18:30:28.711513] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-27T18:30:29.214956] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-27T18:30:29.706917] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-27T18:30:30.014923] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-27T18:30:30.061098] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T18:30:30.814956] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-27T18:30:31.249189] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T18:30:31.614917] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-27T18:30:31.680176] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-27T18:30:32.414942] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-27T18:30:33.054423] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T18:30:33.214932] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-27T18:30:33.476168] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T18:30:34.014963] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-27T18:30:34.409008] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-27T18:30:34.814957] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-27T18:30:35.348780] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-27T18:30:35.426002] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T18:30:35.614927] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-27T18:30:36.414985] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-27T18:30:36.915580] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T18:30:37.215007] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-27T18:30:37.322795] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-27T18:30:38.014996] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-27T18:30:38.727274] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T18:30:38.814950] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-27T18:30:39.578922] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T18:30:39.614920] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-27T18:30:40.414968] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-27T18:30:40.760452] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-27T18:30:40.768015] [INFO ] [REMOTE ] EGY: Full fetch complete (60614 records). [2025-10-27T18:30:40.768130] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-27T18:30:41.161174] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-27T18:30:41.172899] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-27T18:30:41.173687] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-27T18:30:41.173788] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-27T18:30:41.175963] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-27T18:30:41.184164] [DEBUG] [LOCAL ] EGY: Trimmed 60614 records to 40974 (keeping 200 days of data) [2025-10-27T18:30:41.232194] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-27T18:30:41.421949] [DEBUG] [LOCAL ] EGY: Primary data saved (40974 records). [2025-10-27T18:30:41.422112] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-27T18:30:41.422200] [INFO ] [MAIN ] Update Progress: 711/2366 symbols completed. EGY took 32.8s. Estimated remaining: 3h 30m 59s. Rate: 7.8 symbols/min [2025-10-27T18:30:41.607220] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:30:41.626818] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T18:30:41.634398] [INFO ] [REMOTE ] EHAB: Full fetch complete (41124 records). [2025-10-27T18:30:41.634508] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-27T18:30:41.785162] [DEBUG] [LOCAL ] EIC: Loaded 22653 existing records from primary storage. [2025-10-27T18:30:41.806175] [INFO ] [MAIN ] EIC: Loaded 22653 existing records. [2025-10-27T18:30:42.028265] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-27T18:30:42.143570] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:30:42.154295] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-27T18:30:42.154430] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-27T18:30:42.167990] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-27T18:30:42.168289] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-27T18:30:42.354470] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-27T18:30:42.392741] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-27T18:30:42.393210] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-27T18:30:42.394127] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-27T18:30:42.394208] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-27T18:30:42.450716] [DEBUG] [LOCAL ] EHAB: Trimmed 41124 records to 29072 (keeping 200 days of data) [2025-10-27T18:30:42.844411] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:30:42.820466] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-27T18:30:42.865260] [DEBUG] [LOCAL ] EHAB: Primary data saved (29072 records). [2025-10-27T18:30:42.865422] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-27T18:30:42.865530] [INFO ] [MAIN ] Update Progress: 712/2366 symbols completed. EHAB took 32.2s. Estimated remaining: 3h 30m 37s. Rate: 7.9 symbols/min [2025-10-27T18:30:43.041871] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:30:43.042080] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-27T18:30:43.042134] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-27T18:30:43.042246] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-27T18:30:43.042287] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-27T18:30:43.042328] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-27T18:30:43.042367] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-27T18:30:43.390735] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:30:43.443593] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-27T18:30:43.523548] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-27T18:30:43.531592] [INFO ] [REMOTE ] EHC: Full fetch complete (58687 records). [2025-10-27T18:30:43.531805] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-27T18:30:43.620121] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-27T18:30:43.951498] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-27T18:30:43.951601] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-27T18:30:43.952525] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-27T18:30:43.952596] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-27T18:30:43.954308] [DEBUG] [LOCAL ] EHC: Trimmed 58687 records to 40655 (keeping 200 days of data) [2025-10-27T18:30:44.220585] [DEBUG] [LOCAL ] EHC: Primary data saved (40655 records). [2025-10-27T18:30:44.220793] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-27T18:30:44.221621] [INFO ] [MAIN ] Update Progress: 713/2366 symbols completed. EHC took 32.4s. Estimated remaining: 3h 30m 15s. Rate: 7.9 symbols/min [2025-10-27T18:30:44.398489] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:30:44.398774] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-27T18:30:44.398825] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-27T18:30:44.398958] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-27T18:30:44.399003] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-27T18:30:44.399044] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-27T18:30:44.399079] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-27T18:30:44.421166] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-27T18:30:44.818552] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T18:30:44.823437] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:30:45.018116] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-27T18:30:45.214984] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-27T18:30:45.615830] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-27T18:30:46.014945] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-27T18:30:46.284457] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-27T18:30:46.814969] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-27T18:30:47.300769] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T18:30:47.614935] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-27T18:30:48.142744] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-27T18:30:48.415047] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-27T18:30:48.883317] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-27T18:30:49.214945] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-27T18:30:49.660331] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-27T18:30:50.014942] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-27T18:30:50.814959] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-27T18:30:51.071276] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-27T18:30:51.094054] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-27T18:30:51.614953] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-27T18:30:51.966544] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-27T18:30:52.414949] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-27T18:30:53.220066] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-27T18:30:53.229397] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-27T18:30:53.525898] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-27T18:30:54.014970] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-27T18:30:54.281853] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-27T18:30:54.814943] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-27T18:30:55.235153] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-27T18:30:55.614938] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-27T18:30:55.904324] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-27T18:30:56.414942] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-27T18:30:57.072554] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T18:30:57.214945] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-27T18:30:57.530804] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-27T18:30:58.014931] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-27T18:30:58.814943] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-27T18:30:59.190285] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-27T18:30:59.193568] [INFO ] [REMOTE ] EHI: Full fetch complete (15721 records). [2025-10-27T18:30:59.193746] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-27T18:30:59.289805] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-27T18:30:59.568939] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-27T18:30:59.569018] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-27T18:30:59.569369] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-27T18:30:59.569408] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-27T18:30:59.569930] [DEBUG] [LOCAL ] EHI: Trimmed 15721 records to 10481 (keeping 200 days of data) [2025-10-27T18:30:59.615687] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-27T18:30:59.630792] [DEBUG] [LOCAL ] EHI: Primary data saved (10481 records). [2025-10-27T18:30:59.630877] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-27T18:30:59.630950] [INFO ] [MAIN ] Update Progress: 714/2366 symbols completed. EHI took 38.8s. Estimated remaining: 3h 30m 25s. Rate: 7.9 symbols/min [2025-10-27T18:30:59.817849] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:30:59.825575] [DEBUG] [LOCAL ] EICC: Loaded 6243 existing records from primary storage. [2025-10-27T18:30:59.825795] [INFO ] [MAIN ] EICC: Loaded 6243 existing records. [2025-10-27T18:30:59.954364] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-27T18:31:00.005244] [WARN ] [MAIN ] EICC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:31:00.005458] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-27T18:31:00.005513] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-27T18:31:00.005691] [DEBUG] [LOCAL ] EICC: Deleted primary data file. [2025-10-27T18:31:00.005750] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-27T18:31:00.356069] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:31:00.414913] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-27T18:31:00.923902] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-27T18:31:01.214996] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-27T18:31:01.833155] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-27T18:31:02.014954] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-27T18:31:02.535243] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T18:31:02.536435] [INFO ] [REMOTE ] EICB: Full fetch complete (2623 records). [2025-10-27T18:31:02.536514] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-27T18:31:02.537040] [FATAL] [VALIDATOR ] EICB: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:31:02.537139] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:31:02.537213] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:31:02.537298] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-27T18:31:02.537377] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-27T18:31:02.537427] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-27T18:31:02.537483] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-27T18:31:02.537554] [INFO ] [MAIN ] Update Progress: 715/2366 symbols completed. EICB took 18.3s. Estimated remaining: 3h 30m 7s. Rate: 7.9 symbols/min [2025-10-27T18:31:02.717747] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:31:02.738052] [DEBUG] [LOCAL ] EIG: Loaded 20281 existing records from primary storage. [2025-10-27T18:31:02.738263] [INFO ] [MAIN ] EIG: Loaded 20281 existing records. [2025-10-27T18:31:02.820038] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-27T18:31:02.921592] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:31:02.921794] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-27T18:31:02.921848] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-27T18:31:02.922012] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-27T18:31:02.922050] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-27T18:31:03.268320] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:31:03.614952] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-27T18:31:03.830711] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T18:31:04.414929] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-27T18:31:04.696300] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-27T18:31:04.976113] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-27T18:31:05.214941] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-27T18:31:06.014946] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-27T18:31:06.051302] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-27T18:31:06.420989] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-27T18:31:06.814975] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-27T18:31:07.614979] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-27T18:31:07.920979] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T18:31:08.415046] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-27T18:31:08.756576] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T18:31:08.910777] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-27T18:31:09.214971] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-27T18:31:09.774274] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T18:31:09.775084] [INFO ] [REMOTE ] EICA: Full fetch complete (1174 records). [2025-10-27T18:31:09.775173] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-27T18:31:09.775530] [FATAL] [VALIDATOR ] EICA: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:31:09.775626] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:31:09.775727] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:31:09.775804] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-27T18:31:09.775890] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-27T18:31:09.775937] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-27T18:31:09.775979] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-27T18:31:09.776033] [INFO ] [MAIN ] Update Progress: 716/2366 symbols completed. EICA took 26.9s. Estimated remaining: 3h 29m 58s. Rate: 7.9 symbols/min [2025-10-27T18:31:09.946472] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:31:09.997203] [DEBUG] [LOCAL ] EIX: Loaded 54119 existing records from primary storage. [2025-10-27T18:31:09.997529] [INFO ] [MAIN ] EIX: Loaded 54119 existing records. [2025-10-27T18:31:10.020097] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-27T18:31:10.179165] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:31:10.179378] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-27T18:31:10.179426] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-27T18:31:10.179632] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-27T18:31:10.179737] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-27T18:31:10.540333] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:31:10.545829] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-27T18:31:10.814984] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-27T18:31:11.614956] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-27T18:31:11.963268] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-27T18:31:12.414949] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-27T18:31:12.982083] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-27T18:31:13.214952] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-27T18:31:13.608986] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T18:31:14.014954] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-27T18:31:14.291858] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-27T18:31:14.814926] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-27T18:31:15.018951] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T18:31:15.614976] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-27T18:31:16.100026] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-27T18:31:16.414989] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-27T18:31:16.894134] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-27T18:31:17.215026] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-27T18:31:17.476856] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-27T18:31:18.014975] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-27T18:31:18.061553] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T18:31:18.814993] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-27T18:31:19.548689] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-27T18:31:19.626220] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-27T18:31:19.635198] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T18:31:20.414915] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-27T18:31:20.674295] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T18:31:21.214965] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-27T18:31:21.797103] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T18:31:22.014906] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-27T18:31:22.300108] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T18:31:22.814933] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-27T18:31:23.614910] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-27T18:31:23.730426] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-27T18:31:23.918237] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-27T18:31:24.322085] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T18:31:24.414930] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-27T18:31:25.214905] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-27T18:31:25.250930] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-27T18:31:26.014938] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-27T18:31:26.294698] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T18:31:26.814947] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-27T18:31:27.614924] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-27T18:31:27.813081] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-27T18:31:28.091386] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-27T18:31:28.343434] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T18:31:28.347051] [INFO ] [REMOTE ] EIC: Full fetch complete (33816 records). [2025-10-27T18:31:28.347126] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-27T18:31:28.347692] [FATAL] [VALIDATOR ] EIC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:31:28.347767] [FATAL] [MAIN ] EIC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:31:28.347832] [WARN ] [MAIN ] EIC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:31:28.347898] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-27T18:31:28.347961] [DEBUG] [LOCAL ] EIC: No primary data file found to delete. [2025-10-27T18:31:28.347995] [INFO ] [LOCAL ] EIC: Starting deletion of derivative data. [2025-10-27T18:31:28.348110] [DEBUG] [LOCAL ] EIC: Deleted derivative data file. [2025-10-27T18:31:28.348174] [INFO ] [MAIN ] Update Progress: 717/2366 symbols completed. EIC took 46.9s. Estimated remaining: 3h 30m 16s. Rate: 7.8 symbols/min [2025-10-27T18:31:28.414908] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-27T18:31:29.214981] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-27T18:31:30.014920] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-27T18:31:30.103402] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T18:31:30.418847] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-27T18:31:30.422303] [INFO ] [REMOTE ] EIG: Full fetch complete (27324 records). [2025-10-27T18:31:30.422383] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-27T18:31:30.712521] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-27T18:31:30.735462] [INFO ] [REMOTE ] EICC: Full fetch complete (8438 records). [2025-10-27T18:31:30.754380] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-27T18:31:30.773488] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:31:30.799631] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:31:30.801336] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-27T18:31:30.801409] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-27T18:31:30.802000] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-27T18:31:30.802080] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-27T18:31:30.801461] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:31:30.802258] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-27T18:31:30.802324] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-27T18:31:30.802637] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-27T18:31:30.803059] [DEBUG] [LOCAL ] EIG: Trimmed 27324 records to 19836 (keeping 200 days of data) [2025-10-27T18:31:30.802986] [DEBUG] [LOCAL ] EICC: Deleted derivative data file. [2025-10-27T18:31:30.803197] [INFO ] [MAIN ] Update Progress: 718/2366 symbols completed. EICC took 31.2s. Estimated remaining: 3h 29m 56s. Rate: 7.9 symbols/min [2025-10-27T18:31:30.852439] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-27T18:31:30.921297] [DEBUG] [LOCAL ] EIG: Primary data saved (19836 records). [2025-10-27T18:31:30.921579] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-27T18:31:30.921758] [INFO ] [MAIN ] Update Progress: 719/2366 symbols completed. EIG took 28.4s. Estimated remaining: 3h 29m 31s. Rate: 7.9 symbols/min [2025-10-27T18:31:32.249404] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T18:31:32.262181] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-27T18:31:34.424042] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-27T18:31:34.436224] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-27T18:31:35.572110] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T18:31:35.583961] [INFO ] [REMOTE ] EIX: Full fetch complete (77450 records). [2025-10-27T18:31:35.584253] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-27T18:31:36.164011] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-27T18:31:36.164128] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-27T18:31:36.165608] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-27T18:31:36.165722] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-27T18:31:36.167800] [DEBUG] [LOCAL ] EIX: Trimmed 77450 records to 53339 (keeping 200 days of data) [2025-10-27T18:31:36.515551] [DEBUG] [LOCAL ] EIX: Primary data saved (53339 records). [2025-10-27T18:31:36.515735] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-27T18:31:36.515849] [INFO ] [MAIN ] Update Progress: 720/2366 symbols completed. EIX took 26.7s. Estimated remaining: 3h 29m 19s. Rate: 7.9 symbols/min [2025-10-27T18:31:37.102937] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:31:37.209266] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:31:37.232971] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:31:37.263974] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:31:37.266801] [DEBUG] [LOCAL ] ELC: Loaded 3490 existing records from primary storage. [2025-10-27T18:31:37.267740] [INFO ] [MAIN ] ELC: Loaded 3490 existing records. [2025-10-27T18:31:37.485583] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:31:37.514007] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-27T18:31:37.515256] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-27T18:31:37.515563] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-27T18:31:37.515624] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-27T18:31:37.517131] [DEBUG] [LOCAL ] ELF: Loaded 52556 existing records from primary storage. [2025-10-27T18:31:37.547384] [INFO ] [MAIN ] ELF: Loaded 52556 existing records. [2025-10-27T18:31:37.626285] [DEBUG] [LOCAL ] EL: Loaded 54154 existing records from primary storage. [2025-10-27T18:31:37.671636] [INFO ] [MAIN ] EL: Loaded 54154 existing records. [2025-10-27T18:31:37.749513] [DEBUG] [LOCAL ] ELAN: Loaded 54089 existing records from primary storage. [2025-10-27T18:31:37.808546] [INFO ] [MAIN ] ELAN: Loaded 54089 existing records. [2025-10-27T18:31:38.319187] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:31:38.360714] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:31:38.376587] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-27T18:31:38.400800] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-27T18:31:38.433877] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-27T18:31:38.439274] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:31:38.434117] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-27T18:31:38.440230] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-27T18:31:38.460978] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-27T18:31:38.455791] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-27T18:31:38.466505] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-27T18:31:38.478571] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-27T18:31:38.461120] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-27T18:31:38.528697] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-27T18:31:38.528549] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-27T18:31:38.582470] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:31:38.641713] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-27T18:31:39.538097] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-27T18:31:39.554800] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:31:39.576398] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-27T18:31:39.578069] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-27T18:31:39.588955] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:31:39.609020] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-27T18:31:39.649720] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:31:39.649959] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-27T18:31:40.172537] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-27T18:31:40.173836] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-27T18:31:40.607446] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-27T18:31:40.608909] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-27T18:31:41.035832] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T18:31:41.045946] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-27T18:31:41.186295] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T18:31:41.187971] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-27T18:31:41.449915] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-27T18:31:41.459946] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-27T18:31:41.540229] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-27T18:31:41.541700] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-27T18:31:41.585962] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-27T18:31:41.943572] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-27T18:31:42.014911] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-27T18:31:42.388501] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-27T18:31:42.563340] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T18:31:42.814953] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-27T18:31:43.041100] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-27T18:31:43.544906] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-27T18:31:43.614924] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-27T18:31:44.414958] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-27T18:31:44.656851] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-27T18:31:45.214943] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-27T18:31:46.015264] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-27T18:31:46.155450] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-27T18:31:46.814946] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-27T18:31:47.424288] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T18:31:47.447451] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-27T18:31:47.614933] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-27T18:31:48.414971] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-27T18:31:48.902994] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-27T18:31:49.214917] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-27T18:31:49.404710] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-27T18:31:49.833790] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-27T18:31:49.834979] [INFO ] [REMOTE ] ELC: Full fetch complete (4906 records). [2025-10-27T18:31:49.835050] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-27T18:31:50.020044] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-27T18:31:50.199897] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-27T18:31:50.199975] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-27T18:31:50.200129] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-27T18:31:50.200168] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-27T18:31:50.200534] [DEBUG] [LOCAL ] ELC: Trimmed 4906 records to 3391 (keeping 200 days of data) [2025-10-27T18:31:50.224097] [DEBUG] [LOCAL ] ELC: Primary data saved (3391 records). [2025-10-27T18:31:50.224209] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-27T18:31:50.224315] [INFO ] [MAIN ] Update Progress: 721/2366 symbols completed. ELC took 13.7s. Estimated remaining: 3h 29m 25s. Rate: 7.9 symbols/min [2025-10-27T18:31:50.397875] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:31:50.443025] [DEBUG] [LOCAL ] ELME: Loaded 39892 existing records from primary storage. [2025-10-27T18:31:50.443300] [INFO ] [MAIN ] ELME: Loaded 39892 existing records. [2025-10-27T18:31:50.633158] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:31:50.633471] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-27T18:31:50.633548] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-27T18:31:50.633890] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-27T18:31:50.633946] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-27T18:31:50.819696] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-27T18:31:50.928440] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-27T18:31:51.061732] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:31:51.614912] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-27T18:31:51.972245] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-27T18:31:52.414957] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-27T18:31:53.110524] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T18:31:53.164109] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-27T18:31:53.214946] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-27T18:31:54.014918] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-27T18:31:54.089041] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T18:31:54.165012] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T18:31:54.815004] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-27T18:31:55.583848] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-27T18:31:55.614907] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-27T18:31:56.272184] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T18:31:56.414941] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-27T18:31:57.214940] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-27T18:31:57.641148] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-27T18:31:58.014985] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-27T18:31:58.564576] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-27T18:31:58.814933] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-27T18:31:58.895286] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-27T18:31:59.250035] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T18:31:59.614963] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-27T18:32:00.415018] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-27T18:32:00.577454] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-27T18:32:01.214968] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-27T18:32:02.019928] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-27T18:32:02.023256] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-27T18:32:02.349042] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-27T18:32:02.814988] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-27T18:32:02.882816] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-27T18:32:03.389055] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T18:32:03.614977] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-27T18:32:04.414971] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-27T18:32:04.867829] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T18:32:05.035287] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-27T18:32:05.214952] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-27T18:32:06.014936] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-27T18:32:06.125999] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T18:32:06.136517] [INFO ] [REMOTE ] ELAN: Full fetch complete (77092 records). [2025-10-27T18:32:06.136718] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-27T18:32:06.539074] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-27T18:32:06.539218] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-27T18:32:06.540171] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-27T18:32:06.540250] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-27T18:32:06.542168] [DEBUG] [LOCAL ] ELAN: Trimmed 77092 records to 53308 (keeping 200 days of data) [2025-10-27T18:32:06.782490] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-27T18:32:06.815770] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-27T18:32:06.895157] [DEBUG] [LOCAL ] ELAN: Primary data saved (53308 records). [2025-10-27T18:32:06.895308] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-27T18:32:06.895996] [INFO ] [MAIN ] Update Progress: 722/2366 symbols completed. ELAN took 30.4s. Estimated remaining: 3h 29m 38s. Rate: 7.8 symbols/min [2025-10-27T18:32:07.075059] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:32:07.099030] [DEBUG] [LOCAL ] ELP: Loaded 25883 existing records from primary storage. [2025-10-27T18:32:07.099339] [INFO ] [MAIN ] ELP: Loaded 25883 existing records. [2025-10-27T18:32:07.276457] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:32:07.276716] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-27T18:32:07.276773] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-27T18:32:07.277015] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-27T18:32:07.277073] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-27T18:32:07.619918] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-27T18:32:07.650527] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:32:08.007244] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-27T18:32:08.291731] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T18:32:08.414940] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-27T18:32:09.214911] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-27T18:32:09.407486] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T18:32:09.418929] [INFO ] [REMOTE ] EL: Full fetch complete (77428 records). [2025-10-27T18:32:09.419076] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-27T18:32:09.898093] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-27T18:32:09.900996] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-27T18:32:09.901947] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-27T18:32:09.902181] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-27T18:32:09.904345] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-27T18:32:09.915995] [DEBUG] [LOCAL ] EL: Trimmed 77428 records to 53370 (keeping 200 days of data) [2025-10-27T18:32:10.015735] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-27T18:32:10.251727] [DEBUG] [LOCAL ] EL: Primary data saved (53370 records). [2025-10-27T18:32:10.251861] [INFO ] [MAIN ] EL: Full history saved. [2025-10-27T18:32:10.252454] [INFO ] [MAIN ] Update Progress: 723/2366 symbols completed. EL took 33.7s. Estimated remaining: 3h 29m 21s. Rate: 7.8 symbols/min [2025-10-27T18:32:10.424779] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:32:10.424934] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-27T18:32:10.424972] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-27T18:32:10.425081] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-27T18:32:10.425122] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-27T18:32:10.425165] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-27T18:32:10.425215] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-27T18:32:10.780773] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:32:10.805060] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T18:32:10.814905] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-27T18:32:11.044365] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-27T18:32:11.614922] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-27T18:32:11.974618] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-27T18:32:11.989874] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-27T18:32:12.414990] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-27T18:32:13.214975] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-27T18:32:14.014971] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-27T18:32:14.127246] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T18:32:14.134869] [INFO ] [REMOTE ] ELME: Full fetch complete (55823 records). [2025-10-27T18:32:14.135008] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-27T18:32:14.135714] [FATAL] [VALIDATOR ] ELME: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:32:14.135801] [FATAL] [MAIN ] ELME: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:32:14.135877] [WARN ] [MAIN ] ELME: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:32:14.135961] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-27T18:32:14.136036] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-10-27T18:32:14.136087] [INFO ] [LOCAL ] ELME: Starting deletion of derivative data. [2025-10-27T18:32:14.136264] [DEBUG] [LOCAL ] ELME: Deleted derivative data file. [2025-10-27T18:32:14.136374] [INFO ] [MAIN ] Update Progress: 724/2366 symbols completed. ELME took 23.9s. Estimated remaining: 3h 29m 4s. Rate: 7.9 symbols/min [2025-10-27T18:32:14.307334] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:32:14.311748] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-27T18:32:14.355946] [DEBUG] [LOCAL ] ELS: Loaded 50613 existing records from primary storage. [2025-10-27T18:32:14.356247] [INFO ] [MAIN ] ELS: Loaded 50613 existing records. [2025-10-27T18:32:14.528171] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:32:14.528364] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-27T18:32:14.528410] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-27T18:32:14.528674] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-27T18:32:14.528730] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-27T18:32:14.823073] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-27T18:32:14.879533] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:32:14.916080] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-27T18:32:15.615000] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-27T18:32:15.971978] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T18:32:16.415014] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-27T18:32:16.769779] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-27T18:32:17.214917] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-27T18:32:17.711551] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-27T18:32:17.721056] [INFO ] [REMOTE ] ELF: Full fetch complete (75465 records). [2025-10-27T18:32:17.721176] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-27T18:32:18.019992] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-27T18:32:18.135565] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T18:32:18.135782] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-27T18:32:18.135916] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-27T18:32:18.141989] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-27T18:32:18.142070] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-27T18:32:18.143362] [DEBUG] [LOCAL ] ELF: Trimmed 75465 records to 51744 (keeping 200 days of data) [2025-10-27T18:32:18.460511] [DEBUG] [LOCAL ] ELF: Primary data saved (51744 records). [2025-10-27T18:32:18.460666] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-27T18:32:18.460775] [INFO ] [MAIN ] Update Progress: 725/2366 symbols completed. ELF took 41.9s. Estimated remaining: 3h 28m 49s. Rate: 7.9 symbols/min [2025-10-27T18:32:18.571332] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-27T18:32:18.633865] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:32:18.679345] [DEBUG] [LOCAL ] ELV: Loaded 51485 existing records from primary storage. [2025-10-27T18:32:18.679660] [INFO ] [MAIN ] ELV: Loaded 51485 existing records. [2025-10-27T18:32:18.820055] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-27T18:32:18.858727] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:32:18.858928] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-27T18:32:18.858983] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-27T18:32:18.859245] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-27T18:32:18.859283] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-27T18:32:19.206300] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:32:19.614908] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-27T18:32:19.660522] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-27T18:32:20.414981] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-27T18:32:21.214972] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-27T18:32:21.396398] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-27T18:32:21.574371] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-27T18:32:22.014993] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-27T18:32:22.445435] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-27T18:32:22.787543] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T18:32:22.814909] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-27T18:32:23.614959] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-27T18:32:23.842741] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T18:32:23.946130] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-27T18:32:24.414971] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-27T18:32:25.214947] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-27T18:32:25.538082] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-27T18:32:25.687380] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T18:32:26.014939] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-27T18:32:26.815000] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-27T18:32:27.076198] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-27T18:32:27.614950] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-27T18:32:27.774479] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-27T18:32:27.870474] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-27T18:32:28.414968] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-27T18:32:29.214993] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-27T18:32:29.570586] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-27T18:32:29.571528] [INFO ] [REMOTE ] ELPC: Full fetch complete (1285 records). [2025-10-27T18:32:29.571604] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-27T18:32:29.761122] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-27T18:32:29.761297] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:32:29.761364] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:32:29.761436] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-27T18:32:29.761499] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-27T18:32:29.761535] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-27T18:32:29.761576] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-27T18:32:29.761632] [INFO ] [MAIN ] Update Progress: 726/2366 symbols completed. ELPC took 19.5s. Estimated remaining: 3h 28m 50s. Rate: 7.9 symbols/min [2025-10-27T18:32:29.932133] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:32:29.932476] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-27T18:32:29.932552] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-27T18:32:29.932765] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-27T18:32:29.932863] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-27T18:32:29.933009] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-27T18:32:29.933063] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-27T18:32:30.020202] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-27T18:32:30.321419] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:32:30.356445] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-27T18:32:30.814933] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-27T18:32:31.468038] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-27T18:32:31.614922] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-27T18:32:32.414922] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-10-27T18:32:32.461677] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-27T18:32:32.620172] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T18:32:32.620488] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-10-27T18:32:32.620622] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T18:32:32.620725] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-27T18:32:32.620794] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T18:32:32.620852] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-27T18:32:32.620912] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-27T18:32:32.620953] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-27T18:32:32.620992] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-27T18:32:32.621042] [INFO ] [MAIN ] Update Progress: 727/2366 symbols completed. EMA took 2.9s. Estimated remaining: 3h 28m 32s. Rate: 7.9 symbols/min [2025-10-27T18:32:32.810288] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:32:32.831123] [DEBUG] [LOCAL ] EMD: Loaded 20980 existing records from primary storage. [2025-10-27T18:32:32.831365] [INFO ] [MAIN ] EMD: Loaded 20980 existing records. [2025-10-27T18:32:33.063049] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:32:33.063250] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-27T18:32:33.063316] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-27T18:32:33.063498] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-27T18:32:33.063554] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-27T18:32:33.223234] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-27T18:32:33.473971] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:32:33.503786] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-27T18:32:34.014995] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-27T18:32:34.223402] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T18:32:34.815060] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-27T18:32:35.492381] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T18:32:35.614926] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-27T18:32:35.700066] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-27T18:32:36.414907] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-27T18:32:36.714682] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T18:32:37.214963] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-27T18:32:37.619126] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-27T18:32:38.014926] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-27T18:32:38.236798] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T18:32:38.814949] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-27T18:32:39.310859] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T18:32:39.615008] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-27T18:32:39.905514] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T18:32:40.414951] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-27T18:32:41.199554] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T18:32:41.214899] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-27T18:32:42.012069] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-27T18:32:42.021631] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-27T18:32:42.814948] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-27T18:32:43.046628] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T18:32:43.051145] [INFO ] [REMOTE ] ELP: Full fetch complete (36554 records). [2025-10-27T18:32:43.051234] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-27T18:32:43.051813] [FATAL] [VALIDATOR ] ELP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:32:43.051898] [FATAL] [MAIN ] ELP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:32:43.051963] [WARN ] [MAIN ] ELP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:32:43.052046] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-27T18:32:43.052124] [DEBUG] [LOCAL ] ELP: No primary data file found to delete. [2025-10-27T18:32:43.052174] [INFO ] [LOCAL ] ELP: Starting deletion of derivative data. [2025-10-27T18:32:43.052335] [DEBUG] [LOCAL ] ELP: Deleted derivative data file. [2025-10-27T18:32:43.052437] [INFO ] [MAIN ] Update Progress: 728/2366 symbols completed. ELP took 36.2s. Estimated remaining: 3h 28m 30s. Rate: 7.9 symbols/min [2025-10-27T18:32:43.235070] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:32:43.268037] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-27T18:32:43.307748] [DEBUG] [LOCAL ] EME: Loaded 31222 existing records from primary storage. [2025-10-27T18:32:43.308097] [INFO ] [MAIN ] EME: Loaded 31222 existing records. [2025-10-27T18:32:43.486718] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:32:43.486938] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-27T18:32:43.487003] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-27T18:32:43.487217] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-27T18:32:43.487275] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-27T18:32:43.631787] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-27T18:32:43.810499] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-27T18:32:43.883498] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:32:44.414933] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-27T18:32:45.215008] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-27T18:32:45.464995] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-27T18:32:45.698556] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-27T18:32:46.014988] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-27T18:32:46.815029] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-27T18:32:47.136326] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-27T18:32:47.384322] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T18:32:47.614971] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-27T18:32:48.380438] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T18:32:48.414971] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-27T18:32:49.215033] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-27T18:32:49.364237] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-27T18:32:50.015008] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-27T18:32:50.280049] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-27T18:32:50.290751] [INFO ] [REMOTE ] ELS: Full fetch complete (71392 records). [2025-10-27T18:32:50.291040] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-27T18:32:50.719951] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-27T18:32:50.720077] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-27T18:32:50.721183] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-27T18:32:50.721254] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-27T18:32:50.723298] [DEBUG] [LOCAL ] ELS: Trimmed 71392 records to 49837 (keeping 200 days of data) [2025-10-27T18:32:50.826517] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-27T18:32:51.076472] [DEBUG] [LOCAL ] ELS: Primary data saved (49837 records). [2025-10-27T18:32:51.076726] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-27T18:32:51.077526] [INFO ] [MAIN ] Update Progress: 729/2366 symbols completed. ELS took 36.9s. Estimated remaining: 3h 28m 23s. Rate: 7.9 symbols/min [2025-10-27T18:32:51.261024] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:32:51.267376] [DEBUG] [LOCAL ] EMF: Loaded 3134 existing records from primary storage. [2025-10-27T18:32:51.267622] [INFO ] [MAIN ] EMF: Loaded 3134 existing records. [2025-10-27T18:32:51.447378] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:32:51.447679] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-27T18:32:51.447746] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-27T18:32:51.447931] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-27T18:32:51.447990] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-27T18:32:51.871134] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:32:51.873633] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-27T18:32:51.874117] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-27T18:32:52.094750] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (2.88 seconds). [2025-10-27T18:32:52.414994] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-27T18:32:53.214939] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-27T18:32:53.449154] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-27T18:32:53.892717] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T18:32:54.014930] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-27T18:32:54.119969] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-27T18:32:54.320454] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-27T18:32:54.750822] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-27T18:32:54.814908] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-27T18:32:55.614943] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-27T18:32:55.994298] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T18:32:56.414945] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-27T18:32:56.811228] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-27T18:32:57.214912] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-27T18:32:57.504997] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T18:32:57.758018] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-27T18:32:58.014942] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-27T18:32:58.814944] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-27T18:32:59.423174] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-27T18:32:59.614982] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-27T18:32:59.818535] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-27T18:32:59.829153] [INFO ] [REMOTE ] ELV: Full fetch complete (72991 records). [2025-10-27T18:32:59.829292] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-27T18:32:59.830128] [FATAL] [VALIDATOR ] ELV: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:32:59.830234] [FATAL] [MAIN ] ELV: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:32:59.830278] [WARN ] [MAIN ] ELV: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:32:59.830346] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-27T18:32:59.830410] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-10-27T18:32:59.830445] [INFO ] [LOCAL ] ELV: Starting deletion of derivative data. [2025-10-27T18:32:59.830605] [DEBUG] [LOCAL ] ELV: Deleted derivative data file. [2025-10-27T18:32:59.830860] [INFO ] [MAIN ] Update Progress: 730/2366 symbols completed. ELV took 41.4s. Estimated remaining: 3h 28m 18s. Rate: 7.9 symbols/min [2025-10-27T18:33:00.030546] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:33:00.075910] [DEBUG] [LOCAL ] EMN: Loaded 51587 existing records from primary storage. [2025-10-27T18:33:00.076277] [INFO ] [MAIN ] EMN: Loaded 51587 existing records. [2025-10-27T18:33:00.256977] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:33:00.257218] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-27T18:33:00.257291] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-27T18:33:00.257581] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-27T18:33:00.257638] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-27T18:33:00.427422] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-27T18:33:00.624117] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:33:00.634534] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T18:33:00.638397] [INFO ] [REMOTE ] EMD: Full fetch complete (31675 records). [2025-10-27T18:33:00.638469] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-27T18:33:00.638961] [FATAL] [VALIDATOR ] EMD: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:33:00.639042] [FATAL] [MAIN ] EMD: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:33:00.639113] [WARN ] [MAIN ] EMD: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:33:00.639197] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-27T18:33:00.639271] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-10-27T18:33:00.639324] [INFO ] [LOCAL ] EMD: Starting deletion of derivative data. [2025-10-27T18:33:00.639517] [DEBUG] [LOCAL ] EMD: Deleted derivative data file. [2025-10-27T18:33:00.639604] [INFO ] [MAIN ] Update Progress: 731/2366 symbols completed. EMD took 28.0s. Estimated remaining: 3h 27m 55s. Rate: 7.9 symbols/min [2025-10-27T18:33:00.806264] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:33:00.819948] [DEBUG] [LOCAL ] EMO: Loaded 13551 existing records from primary storage. [2025-10-27T18:33:00.820182] [INFO ] [MAIN ] EMO: Loaded 13551 existing records. [2025-10-27T18:33:00.995717] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:33:00.995909] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-27T18:33:00.995959] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-27T18:33:00.996111] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-27T18:33:00.996151] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-27T18:33:01.224200] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-27T18:33:01.346270] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:33:02.014938] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-27T18:33:02.150356] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T18:33:02.504276] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-27T18:33:02.814962] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-27T18:33:02.951406] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T18:33:03.155359] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-27T18:33:03.614910] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-27T18:33:04.414937] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-27T18:33:04.898234] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-27T18:33:05.214999] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-27T18:33:05.756060] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-27T18:33:06.014962] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-27T18:33:06.110472] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-27T18:33:06.814988] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-27T18:33:07.392137] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T18:33:07.615016] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-27T18:33:07.697006] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-27T18:33:08.415012] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-27T18:33:09.200965] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T18:33:09.214921] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-27T18:33:09.386017] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-27T18:33:09.822270] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-27T18:33:10.015011] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-27T18:33:10.639030] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-27T18:33:10.814981] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-27T18:33:11.416597] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T18:33:11.614924] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-27T18:33:12.090562] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-27T18:33:12.414972] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-27T18:33:12.740134] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-27T18:33:13.214943] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-27T18:33:14.014932] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-27T18:33:14.213592] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-27T18:33:14.814947] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-27T18:33:15.286587] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-27T18:33:15.615002] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-27T18:33:15.782403] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-27T18:33:16.163527] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-27T18:33:16.164691] [INFO ] [REMOTE ] EMF: Full fetch complete (5961 records). [2025-10-27T18:33:16.164759] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-27T18:33:16.420252] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-27T18:33:16.513303] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-27T18:33:16.513381] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-27T18:33:16.513537] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-27T18:33:16.513574] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-27T18:33:16.513948] [DEBUG] [LOCAL ] EMF: Trimmed 5961 records to 3001 (keeping 200 days of data) [2025-10-27T18:33:16.532162] [DEBUG] [LOCAL ] EMF: Primary data saved (3001 records). [2025-10-27T18:33:16.532228] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-27T18:33:16.532295] [INFO ] [MAIN ] Update Progress: 732/2366 symbols completed. EMF took 25.5s. Estimated remaining: 3h 28m 6s. Rate: 7.9 symbols/min [2025-10-27T18:33:16.696052] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:33:16.700204] [DEBUG] [LOCAL ] EMP: Loaded 2902 existing records from primary storage. [2025-10-27T18:33:16.700385] [INFO ] [MAIN ] EMP: Loaded 2902 existing records. [2025-10-27T18:33:16.873259] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:33:16.873457] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-27T18:33:16.873503] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-27T18:33:16.873700] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-27T18:33:16.873757] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-27T18:33:17.219351] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:33:17.216393] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-27T18:33:17.818028] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T18:33:18.014911] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-27T18:33:18.128430] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-27T18:33:18.407321] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-27T18:33:18.814980] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-27T18:33:19.350677] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-27T18:33:19.614933] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-27T18:33:20.414923] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-27T18:33:20.507713] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-27T18:33:21.214987] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-27T18:33:21.649231] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T18:33:21.793579] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-27T18:33:22.014954] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-27T18:33:22.815029] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-27T18:33:23.014067] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-27T18:33:23.614998] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-27T18:33:24.415539] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-27T18:33:24.415627] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-27T18:33:24.833187] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T18:33:24.836438] [INFO ] [REMOTE ] EMO: Full fetch complete (17654 records). [2025-10-27T18:33:24.836507] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-27T18:33:24.836982] [FATAL] [VALIDATOR ] EMO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:33:24.837061] [FATAL] [MAIN ] EMO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:33:24.837101] [WARN ] [MAIN ] EMO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:33:24.837137] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-27T18:33:24.837189] [DEBUG] [LOCAL ] EMO: No primary data file found to delete. [2025-10-27T18:33:24.837222] [INFO ] [LOCAL ] EMO: Starting deletion of derivative data. [2025-10-27T18:33:24.837332] [DEBUG] [LOCAL ] EMO: Deleted derivative data file. [2025-10-27T18:33:24.837394] [INFO ] [MAIN ] Update Progress: 733/2366 symbols completed. EMO took 24.2s. Estimated remaining: 3h 28m 0s. Rate: 7.9 symbols/min [2025-10-27T18:33:24.940326] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-27T18:33:25.012422] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:33:25.061485] [DEBUG] [LOCAL ] EMR: Loaded 53907 existing records from primary storage. [2025-10-27T18:33:25.061817] [INFO ] [MAIN ] EMR: Loaded 53907 existing records. [2025-10-27T18:33:25.218505] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-27T18:33:25.238392] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:33:25.239336] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-27T18:33:25.239386] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-27T18:33:25.239627] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-27T18:33:25.239714] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-27T18:33:25.582695] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:33:26.014936] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-27T18:33:26.814909] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-27T18:33:27.152110] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-27T18:33:27.226757] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-27T18:33:27.614955] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-27T18:33:27.706089] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-27T18:33:27.712207] [INFO ] [REMOTE ] EME: Full fetch complete (47098 records). [2025-10-27T18:33:27.712301] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-27T18:33:28.077373] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-27T18:33:28.077543] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-27T18:33:28.078229] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-27T18:33:28.078298] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-27T18:33:28.079263] [DEBUG] [LOCAL ] EME: Trimmed 47098 records to 30529 (keeping 200 days of data) [2025-10-27T18:33:28.257565] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-27T18:33:28.274246] [DEBUG] [LOCAL ] EME: Primary data saved (30529 records). [2025-10-27T18:33:28.274328] [INFO ] [MAIN ] EME: Full history saved. [2025-10-27T18:33:28.274394] [INFO ] [MAIN ] Update Progress: 734/2366 symbols completed. EME took 45.2s. Estimated remaining: 3h 27m 43s. Rate: 7.9 symbols/min [2025-10-27T18:33:28.416301] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-27T18:33:28.438966] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:33:28.485909] [DEBUG] [LOCAL ] ENB: Loaded 54291 existing records from primary storage. [2025-10-27T18:33:28.486210] [INFO ] [MAIN ] ENB: Loaded 54291 existing records. [2025-10-27T18:33:28.658550] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:33:28.658746] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-27T18:33:28.658795] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-27T18:33:28.659044] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-27T18:33:28.659081] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-27T18:33:29.005064] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:33:29.214902] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-27T18:33:30.014979] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-27T18:33:30.097093] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T18:33:30.419429] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-27T18:33:30.630103] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T18:33:30.814906] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-27T18:33:31.614953] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-27T18:33:32.173892] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-27T18:33:32.414912] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-27T18:33:32.674409] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-27T18:33:32.752605] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-27T18:33:33.215041] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-27T18:33:34.015069] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-27T18:33:34.613181] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-27T18:33:34.814978] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-27T18:33:34.867281] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T18:33:35.367536] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-27T18:33:35.368486] [INFO ] [REMOTE ] EMP: Full fetch complete (4046 records). [2025-10-27T18:33:35.368554] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-27T18:33:35.620087] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-27T18:33:35.741337] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-27T18:33:35.741413] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-27T18:33:35.741560] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-27T18:33:35.741616] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-27T18:33:35.742021] [DEBUG] [LOCAL ] EMP: Trimmed 4046 records to 2836 (keeping 200 days of data) [2025-10-27T18:33:35.760399] [DEBUG] [LOCAL ] EMP: Primary data saved (2836 records). [2025-10-27T18:33:35.760508] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-27T18:33:35.760582] [INFO ] [MAIN ] Update Progress: 735/2366 symbols completed. EMP took 19.2s. Estimated remaining: 3h 27m 35s. Rate: 7.9 symbols/min [2025-10-27T18:33:35.943113] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:33:35.977097] [DEBUG] [LOCAL ] ENIC: Loaded 36940 existing records from primary storage. [2025-10-27T18:33:35.977363] [INFO ] [MAIN ] ENIC: Loaded 36940 existing records. [2025-10-27T18:33:36.149025] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:33:36.149226] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-27T18:33:36.149272] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-27T18:33:36.149429] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-27T18:33:36.149465] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-27T18:33:36.416664] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-27T18:33:36.493607] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:33:37.214941] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-27T18:33:37.573760] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-27T18:33:37.584036] [INFO ] [REMOTE ] EMN: Full fetch complete (72457 records). [2025-10-27T18:33:37.584201] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-27T18:33:38.027967] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-27T18:33:38.033558] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-27T18:33:38.033765] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-27T18:33:38.034899] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-27T18:33:38.035111] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-27T18:33:38.037016] [DEBUG] [LOCAL ] EMN: Trimmed 72457 records to 50796 (keeping 200 days of data) [2025-10-27T18:33:38.383599] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-27T18:33:38.414130] [DEBUG] [LOCAL ] EMN: Primary data saved (50796 records). [2025-10-27T18:33:38.414597] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-27T18:33:38.414736] [INFO ] [MAIN ] Update Progress: 736/2366 symbols completed. EMN took 38.6s. Estimated remaining: 3h 27m 16s. Rate: 7.9 symbols/min [2025-10-27T18:33:38.590099] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:33:38.594374] [DEBUG] [LOCAL ] ENO: Loaded 1752 existing records from primary storage. [2025-10-27T18:33:38.594546] [INFO ] [MAIN ] ENO: Loaded 1752 existing records. [2025-10-27T18:33:38.772631] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:33:38.773364] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-27T18:33:38.773483] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-27T18:33:38.773735] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-10-27T18:33:38.773830] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-27T18:33:38.835755] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-27T18:33:38.954968] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T18:33:39.155585] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:33:39.614950] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-27T18:33:39.844963] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-27T18:33:40.414975] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-27T18:33:40.742866] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-27T18:33:40.847313] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T18:33:41.214933] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-27T18:33:42.014924] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-27T18:33:42.138824] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T18:33:42.443257] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-27T18:33:42.814940] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-27T18:33:43.614913] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-27T18:33:43.693533] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T18:33:44.054616] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-27T18:33:44.314260] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T18:33:44.414920] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-27T18:33:45.214974] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-27T18:33:46.014960] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-27T18:33:46.566682] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-27T18:33:46.581681] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-27T18:33:46.814925] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-27T18:33:46.901507] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T18:33:47.275717] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-27T18:33:47.614973] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-27T18:33:48.414942] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-27T18:33:48.888110] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-27T18:33:49.214951] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-27T18:33:49.566395] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-27T18:33:50.014992] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-27T18:33:50.814927] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-27T18:33:51.152119] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-27T18:33:51.169202] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-27T18:33:51.412062] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T18:33:51.614948] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-27T18:33:52.414998] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-27T18:33:52.822835] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T18:33:53.214970] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-27T18:33:53.651264] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-27T18:33:54.013752] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-27T18:33:54.021361] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-27T18:33:54.397537] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-27T18:33:54.814943] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-27T18:33:55.615006] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-27T18:33:56.060265] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-27T18:33:56.414933] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-27T18:33:56.621560] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-27T18:33:57.214990] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-27T18:33:57.413297] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T18:33:57.518111] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-27T18:33:58.014926] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-27T18:33:58.814944] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-27T18:33:59.469719] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T18:33:59.614952] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-27T18:34:00.414948] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-27T18:34:01.214988] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-27T18:34:01.381674] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-27T18:34:01.724153] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-27T18:34:02.014968] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-27T18:34:02.137354] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-27T18:34:02.138259] [INFO ] [REMOTE ] ENO: Full fetch complete (2964 records). [2025-10-27T18:34:02.138330] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-27T18:34:02.138711] [FATAL] [VALIDATOR ] ENO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:34:02.138803] [FATAL] [MAIN ] ENO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:34:02.138845] [WARN ] [MAIN ] ENO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:34:02.138908] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-27T18:34:02.138968] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-10-27T18:34:02.139003] [INFO ] [LOCAL ] ENO: Starting deletion of derivative data. [2025-10-27T18:34:02.139150] [DEBUG] [LOCAL ] ENO: Deleted derivative data file. [2025-10-27T18:34:02.139233] [INFO ] [MAIN ] Update Progress: 737/2366 symbols completed. ENO took 23.7s. Estimated remaining: 3h 27m 44s. Rate: 7.8 symbols/min [2025-10-27T18:34:02.323977] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:34:02.364898] [DEBUG] [LOCAL ] ENOV: Loaded 45142 existing records from primary storage. [2025-10-27T18:34:02.365213] [INFO ] [MAIN ] ENOV: Loaded 45142 existing records. [2025-10-27T18:34:02.535630] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-27T18:34:02.587198] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:34:02.587502] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-27T18:34:02.587562] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-27T18:34:02.588208] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-27T18:34:02.588269] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-27T18:34:02.823769] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-27T18:34:02.950593] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:34:03.614916] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-27T18:34:03.691946] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T18:34:04.415001] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-27T18:34:04.797899] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-27T18:34:04.809090] [INFO ] [REMOTE ] EMR: Full fetch complete (77178 records). [2025-10-27T18:34:04.809268] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-27T18:34:05.246675] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-27T18:34:05.268905] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-27T18:34:05.269001] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-27T18:34:05.288990] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-27T18:34:05.290412] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T18:34:05.290527] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-27T18:34:05.298764] [DEBUG] [LOCAL ] EMR: Trimmed 77178 records to 53121 (keeping 200 days of data) [2025-10-27T18:34:05.626668] [DEBUG] [LOCAL ] EMR: Primary data saved (53121 records). [2025-10-27T18:34:05.626817] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-27T18:34:05.626917] [INFO ] [MAIN ] Update Progress: 738/2366 symbols completed. EMR took 40.8s. Estimated remaining: 3h 27m 27s. Rate: 7.8 symbols/min [2025-10-27T18:34:05.791796] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:34:05.830607] [DEBUG] [LOCAL ] ENR: Loaded 44363 existing records from primary storage. [2025-10-27T18:34:05.830916] [INFO ] [MAIN ] ENR: Loaded 44363 existing records. [2025-10-27T18:34:06.002998] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:34:06.003284] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-27T18:34:06.003347] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-27T18:34:06.003611] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-27T18:34:06.003726] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-27T18:34:06.020018] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-27T18:34:06.382975] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:34:06.442570] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-27T18:34:06.452904] [INFO ] [REMOTE ] ENB: Full fetch complete (77663 records). [2025-10-27T18:34:06.453033] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-27T18:34:06.817405] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-27T18:34:06.840752] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-27T18:34:06.840821] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-27T18:34:06.841732] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-27T18:34:06.841892] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-27T18:34:06.843282] [DEBUG] [LOCAL ] ENB: Trimmed 77663 records to 53511 (keeping 200 days of data) [2025-10-27T18:34:07.160319] [DEBUG] [LOCAL ] ENB: Primary data saved (53511 records). [2025-10-27T18:34:07.160440] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-27T18:34:07.160512] [INFO ] [MAIN ] Update Progress: 739/2366 symbols completed. ENB took 38.9s. Estimated remaining: 3h 27m 6s. Rate: 7.9 symbols/min [2025-10-27T18:34:07.335325] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:34:07.364845] [DEBUG] [LOCAL ] ENS: Loaded 30030 existing records from primary storage. [2025-10-27T18:34:07.373376] [INFO ] [MAIN ] ENS: Loaded 30030 existing records. [2025-10-27T18:34:07.491800] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-27T18:34:07.584839] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-27T18:34:07.604080] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:34:07.610128] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-27T18:34:07.610184] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-27T18:34:07.610303] [INFO ] [REMOTE ] ENIC: Full fetch complete (51016 records). [2025-10-27T18:34:07.610405] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-27T18:34:07.610477] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-27T18:34:07.610377] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-27T18:34:07.621520] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-27T18:34:07.646979] [FATAL] [VALIDATOR ] ENIC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:34:07.666775] [FATAL] [MAIN ] ENIC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:34:07.681492] [WARN ] [MAIN ] ENIC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:34:07.702863] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-27T18:34:07.713304] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-10-27T18:34:07.713359] [INFO ] [LOCAL ] ENIC: Starting deletion of derivative data. [2025-10-27T18:34:07.729367] [DEBUG] [LOCAL ] ENIC: Deleted derivative data file. [2025-10-27T18:34:07.734581] [INFO ] [MAIN ] Update Progress: 740/2366 symbols completed. ENIC took 32.0s. Estimated remaining: 3h 26m 43s. Rate: 7.9 symbols/min [2025-10-27T18:34:08.079464] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:34:08.136400] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:34:08.157883] [DEBUG] [LOCAL ] ENVA: Loaded 25717 existing records from primary storage. [2025-10-27T18:34:08.158158] [INFO ] [MAIN ] ENVA: Loaded 25717 existing records. [2025-10-27T18:34:08.337482] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:34:08.337795] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-27T18:34:08.337903] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-27T18:34:08.338192] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-27T18:34:08.338321] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-27T18:34:08.419030] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-27T18:34:08.538776] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-27T18:34:08.733904] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:34:08.896130] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T18:34:09.214953] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-27T18:34:10.014957] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-27T18:34:10.153102] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T18:34:10.156342] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T18:34:10.814933] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-27T18:34:11.315812] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-27T18:34:11.614966] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-27T18:34:11.856462] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T18:34:12.414987] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-27T18:34:13.056360] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T18:34:13.214916] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-27T18:34:13.697704] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T18:34:14.014969] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-27T18:34:14.813877] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T18:34:14.822750] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-27T18:34:14.925237] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-27T18:34:15.614993] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-27T18:34:16.104236] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T18:34:16.414928] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-27T18:34:17.215170] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-27T18:34:17.609881] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-27T18:34:18.014968] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-27T18:34:18.038920] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-27T18:34:18.689450] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T18:34:18.814923] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-27T18:34:19.614912] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-27T18:34:19.683197] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T18:34:20.133380] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-27T18:34:20.414958] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-27T18:34:20.602423] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T18:34:21.214988] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-27T18:34:21.983428] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-27T18:34:22.007450] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-27T18:34:22.014892] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-27T18:34:22.742908] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T18:34:22.814905] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-27T18:34:23.615000] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-27T18:34:24.249075] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T18:34:24.414935] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-27T18:34:25.198894] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T18:34:25.215058] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-27T18:34:25.264158] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-27T18:34:26.015030] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-27T18:34:26.814976] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-27T18:34:26.912777] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T18:34:26.954456] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-27T18:34:27.614935] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-27T18:34:28.266362] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T18:34:28.414980] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-27T18:34:29.214941] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-27T18:34:29.374261] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-27T18:34:29.463506] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-27T18:34:30.015010] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-27T18:34:30.619735] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T18:34:30.814992] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-27T18:34:31.373586] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-27T18:34:31.614987] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-27T18:34:31.845758] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-27T18:34:32.414997] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-27T18:34:32.721846] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T18:34:33.214957] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-27T18:34:33.380473] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-27T18:34:34.014941] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-27T18:34:34.449816] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-27T18:34:34.457728] [INFO ] [REMOTE ] ENR: Full fetch complete (59701 records). [2025-10-27T18:34:34.457866] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-27T18:34:34.816679] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-27T18:34:34.854049] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-27T18:34:34.854296] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-27T18:34:34.855220] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-27T18:34:34.855289] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-27T18:34:34.856522] [DEBUG] [LOCAL ] ENR: Trimmed 59701 records to 43645 (keeping 200 days of data) [2025-10-27T18:34:35.114412] [DEBUG] [LOCAL ] ENR: Primary data saved (43645 records). [2025-10-27T18:34:35.114529] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-27T18:34:35.115064] [INFO ] [MAIN ] Update Progress: 741/2366 symbols completed. ENR took 29.5s. Estimated remaining: 3h 27m 19s. Rate: 7.8 symbols/min [2025-10-27T18:34:35.288107] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:34:35.303861] [DEBUG] [LOCAL ] EOD: Loaded 15043 existing records from primary storage. [2025-10-27T18:34:35.304083] [INFO ] [MAIN ] EOD: Loaded 15043 existing records. [2025-10-27T18:34:35.447117] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T18:34:35.508883] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:34:35.509070] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-27T18:34:35.509117] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-27T18:34:35.509293] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-27T18:34:35.509348] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-27T18:34:35.616907] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-27T18:34:35.877270] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:34:36.069569] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-27T18:34:36.076892] [INFO ] [REMOTE ] ENOV: Full fetch complete (62954 records). [2025-10-27T18:34:36.077000] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-27T18:34:36.077736] [FATAL] [VALIDATOR ] ENOV: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:34:36.077824] [FATAL] [MAIN ] ENOV: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:34:36.077867] [WARN ] [MAIN ] ENOV: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:34:36.077906] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-27T18:34:36.077976] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-10-27T18:34:36.078022] [INFO ] [LOCAL ] ENOV: Starting deletion of derivative data. [2025-10-27T18:34:36.078200] [DEBUG] [LOCAL ] ENOV: Deleted derivative data file. [2025-10-27T18:34:36.078299] [INFO ] [MAIN ] Update Progress: 742/2366 symbols completed. ENOV took 33.9s. Estimated remaining: 3h 26m 57s. Rate: 7.8 symbols/min [2025-10-27T18:34:36.246249] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:34:36.295070] [DEBUG] [LOCAL ] EOG: Loaded 54170 existing records from primary storage. [2025-10-27T18:34:36.295371] [INFO ] [MAIN ] EOG: Loaded 54170 existing records. [2025-10-27T18:34:36.430341] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-27T18:34:36.470375] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:34:36.471086] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-27T18:34:36.471189] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-27T18:34:36.471529] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-27T18:34:36.471568] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-27T18:34:36.839003] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-27T18:34:36.838149] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:34:37.214983] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-27T18:34:37.689972] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-27T18:34:37.696335] [INFO ] [REMOTE ] ENS: Full fetch complete (42862 records). [2025-10-27T18:34:37.696421] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-27T18:34:38.023723] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-27T18:34:38.072747] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-27T18:34:38.072837] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-27T18:34:38.073460] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-27T18:34:38.073500] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-27T18:34:38.074397] [DEBUG] [LOCAL ] ENS: Trimmed 42862 records to 29376 (keeping 200 days of data) [2025-10-27T18:34:38.248903] [DEBUG] [LOCAL ] ENS: Primary data saved (29376 records). [2025-10-27T18:34:38.249032] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-27T18:34:38.249105] [INFO ] [MAIN ] Update Progress: 743/2366 symbols completed. ENS took 31.1s. Estimated remaining: 3h 26m 37s. Rate: 7.9 symbols/min [2025-10-27T18:34:38.426735] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T18:34:38.428183] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:34:38.441782] [DEBUG] [LOCAL ] EOI: Loaded 10514 existing records from primary storage. [2025-10-27T18:34:38.441985] [INFO ] [MAIN ] EOI: Loaded 10514 existing records. [2025-10-27T18:34:38.618956] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:34:38.619157] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-27T18:34:38.619213] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-27T18:34:38.619358] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-27T18:34:38.619394] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-27T18:34:38.820389] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-27T18:34:38.966505] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:34:39.614969] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-27T18:34:39.777533] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-27T18:34:40.101592] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-27T18:34:40.414928] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-27T18:34:40.984344] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-27T18:34:40.989162] [INFO ] [REMOTE ] ENVA: Full fetch complete (36835 records). [2025-10-27T18:34:40.989257] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-27T18:34:41.222305] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-27T18:34:41.357634] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-27T18:34:41.357746] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-27T18:34:41.358335] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-27T18:34:41.358375] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-27T18:34:41.359258] [DEBUG] [LOCAL ] ENVA: Trimmed 36835 records to 25041 (keeping 200 days of data) [2025-10-27T18:34:41.509466] [DEBUG] [LOCAL ] ENVA: Primary data saved (25041 records). [2025-10-27T18:34:41.509597] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-27T18:34:41.509708] [INFO ] [MAIN ] Update Progress: 744/2366 symbols completed. ENVA took 33.8s. Estimated remaining: 3h 26m 20s. Rate: 7.9 symbols/min [2025-10-27T18:34:41.694228] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:34:41.697482] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-27T18:34:41.716962] [DEBUG] [LOCAL ] EOS: Loaded 14871 existing records from primary storage. [2025-10-27T18:34:41.717216] [INFO ] [MAIN ] EOS: Loaded 14871 existing records. [2025-10-27T18:34:41.846068] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T18:34:41.911819] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:34:41.912097] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-27T18:34:41.912160] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-27T18:34:41.912321] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-27T18:34:41.912360] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-27T18:34:42.020071] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-27T18:34:42.270341] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:34:42.814999] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-27T18:34:43.614934] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-27T18:34:43.717312] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-27T18:34:43.737800] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-27T18:34:44.253574] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-27T18:34:44.414962] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-27T18:34:45.214952] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-27T18:34:45.360202] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T18:34:46.015013] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-27T18:34:46.778412] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T18:34:46.814909] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-27T18:34:46.982845] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-27T18:34:47.354768] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-27T18:34:47.615009] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-27T18:34:48.414913] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-27T18:34:48.563930] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T18:34:49.214941] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-27T18:34:49.388623] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-27T18:34:50.014944] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-27T18:34:50.583514] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T18:34:50.781136] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T18:34:50.814943] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-27T18:34:51.614952] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-27T18:34:52.155284] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T18:34:52.414950] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-27T18:34:52.596078] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T18:34:53.214996] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-27T18:34:54.014952] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-27T18:34:54.428445] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-27T18:34:54.587276] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-27T18:34:54.814948] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-27T18:34:55.449621] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T18:34:55.598849] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-27T18:34:55.614897] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-27T18:34:56.414948] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-27T18:34:56.562447] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T18:34:57.215001] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-27T18:34:57.850779] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-27T18:34:58.015016] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-27T18:34:58.558145] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-27T18:34:58.814962] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-27T18:34:58.874037] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-27T18:34:59.614984] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-27T18:35:00.120022] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T18:35:00.411419] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T18:35:00.416526] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-27T18:35:01.215085] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-27T18:35:01.481181] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-27T18:35:02.014940] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-27T18:35:02.814925] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-27T18:35:03.046774] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-27T18:35:03.098155] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T18:35:03.614928] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-27T18:35:03.641844] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-27T18:35:04.321785] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T18:35:04.414913] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-27T18:35:05.214996] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-27T18:35:05.549076] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T18:35:05.551615] [INFO ] [REMOTE ] EOI: Full fetch complete (15906 records). [2025-10-27T18:35:05.551716] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-27T18:35:05.938036] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-27T18:35:05.938115] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-27T18:35:05.938454] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-27T18:35:05.938495] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-27T18:35:05.939110] [DEBUG] [LOCAL ] EOI: Trimmed 15906 records to 9956 (keeping 200 days of data) [2025-10-27T18:35:06.000740] [DEBUG] [LOCAL ] EOI: Primary data saved (9956 records). [2025-10-27T18:35:06.000879] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-27T18:35:06.000957] [INFO ] [MAIN ] Update Progress: 745/2366 symbols completed. EOI took 27.8s. Estimated remaining: 3h 26m 49s. Rate: 7.8 symbols/min [2025-10-27T18:35:06.021483] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-27T18:35:06.174380] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:35:06.183308] [DEBUG] [LOCAL ] EOT: Loaded 7118 existing records from primary storage. [2025-10-27T18:35:06.183484] [INFO ] [MAIN ] EOT: Loaded 7118 existing records. [2025-10-27T18:35:06.361046] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:35:06.361271] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-27T18:35:06.361328] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-27T18:35:06.361473] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-27T18:35:06.361528] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-27T18:35:06.709787] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:35:06.814939] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-27T18:35:07.163757] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-27T18:35:07.174197] [INFO ] [REMOTE ] EOG: Full fetch complete (77471 records). [2025-10-27T18:35:07.174370] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-27T18:35:07.284196] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-27T18:35:07.300634] [INFO ] [REMOTE ] EOD: Full fetch complete (20737 records). [2025-10-27T18:35:07.316106] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-27T18:35:07.638957] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-27T18:35:07.909791] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-27T18:35:07.930482] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-27T18:35:07.982685] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-27T18:35:07.985780] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-27T18:35:07.994958] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-27T18:35:07.995429] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-27T18:35:08.005767] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-27T18:35:08.006052] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-27T18:35:08.007421] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T18:35:08.006792] [DEBUG] [LOCAL ] EOG: Trimmed 77471 records to 53389 (keeping 200 days of data) [2025-10-27T18:35:08.013141] [DEBUG] [LOCAL ] EOD: Trimmed 20737 records to 14650 (keeping 200 days of data) [2025-10-27T18:35:08.315939] [DEBUG] [LOCAL ] EOD: Primary data saved (14650 records). [2025-10-27T18:35:08.319135] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-27T18:35:08.319282] [INFO ] [MAIN ] Update Progress: 746/2366 symbols completed. EOD took 33.2s. Estimated remaining: 3h 26m 30s. Rate: 7.8 symbols/min [2025-10-27T18:35:08.421389] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-27T18:35:08.537897] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:35:08.633937] [DEBUG] [LOCAL ] EOG: Primary data saved (53389 records). [2025-10-27T18:35:08.634161] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-27T18:35:08.635025] [INFO ] [MAIN ] Update Progress: 747/2366 symbols completed. EOG took 32.6s. Estimated remaining: 3h 26m 6s. Rate: 7.9 symbols/min [2025-10-27T18:35:08.744914] [DEBUG] [LOCAL ] EPAC: Loaded 26742 existing records from primary storage. [2025-10-27T18:35:08.745381] [INFO ] [MAIN ] EPAC: Loaded 26742 existing records. [2025-10-27T18:35:08.909188] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:35:08.900781] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T18:35:09.002322] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:35:09.002639] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-27T18:35:09.002732] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-27T18:35:09.002930] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-27T18:35:09.002969] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-27T18:35:09.233196] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-27T18:35:09.239810] [DEBUG] [LOCAL ] EPAM: Loaded 39889 existing records from primary storage. [2025-10-27T18:35:09.250480] [INFO ] [MAIN ] EPAM: Loaded 39889 existing records. [2025-10-27T18:35:09.370490] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-27T18:35:09.556176] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:35:09.583638] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:35:09.583820] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-27T18:35:09.583865] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-27T18:35:09.584122] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-27T18:35:09.584191] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-27T18:35:09.929507] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:35:10.014906] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-27T18:35:10.119082] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T18:35:10.814984] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-27T18:35:11.215165] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T18:35:11.615003] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-27T18:35:12.183807] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T18:35:12.414942] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-27T18:35:13.142490] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T18:35:13.215044] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-27T18:35:13.429243] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-27T18:35:14.014963] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-27T18:35:14.024236] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T18:35:14.815000] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-27T18:35:15.299824] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-27T18:35:15.357858] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T18:35:15.615027] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-27T18:35:16.272379] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-27T18:35:16.414949] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-27T18:35:16.818663] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-27T18:35:17.214945] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-27T18:35:18.014961] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-27T18:35:18.550819] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T18:35:18.814918] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-27T18:35:18.956159] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T18:35:19.614921] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-27T18:35:20.052800] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-27T18:35:20.056213] [INFO ] [REMOTE ] EOS: Full fetch complete (22797 records). [2025-10-27T18:35:20.056286] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-27T18:35:20.421986] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-27T18:35:20.423590] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-27T18:35:20.423699] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-27T18:35:20.424211] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-27T18:35:20.424254] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-27T18:35:20.424898] [DEBUG] [LOCAL ] EOS: Trimmed 22797 records to 14302 (keeping 200 days of data) [2025-10-27T18:35:20.514414] [DEBUG] [LOCAL ] EOS: Primary data saved (14302 records). [2025-10-27T18:35:20.514701] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-27T18:35:20.514820] [INFO ] [MAIN ] Update Progress: 748/2366 symbols completed. EOS took 39.0s. Estimated remaining: 3h 26m 8s. Rate: 7.8 symbols/min [2025-10-27T18:35:20.680561] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:35:20.716824] [DEBUG] [LOCAL ] EPC: Loaded 40224 existing records from primary storage. [2025-10-27T18:35:20.717213] [INFO ] [MAIN ] EPC: Loaded 40224 existing records. [2025-10-27T18:35:20.889668] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:35:20.889920] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-27T18:35:20.889968] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-27T18:35:20.890190] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-27T18:35:20.890228] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-27T18:35:21.216210] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-27T18:35:21.239506] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:35:21.298587] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-27T18:35:21.544796] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-27T18:35:22.014989] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-27T18:35:22.271210] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T18:35:22.814996] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-27T18:35:23.522180] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T18:35:23.614969] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-27T18:35:24.414941] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-27T18:35:24.579026] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-27T18:35:24.977993] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T18:35:25.214961] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-27T18:35:25.473007] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-27T18:35:26.015010] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-27T18:35:26.317044] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T18:35:26.815054] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-27T18:35:27.149011] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T18:35:27.305288] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-27T18:35:27.614949] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-27T18:35:28.414935] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-27T18:35:28.469161] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T18:35:29.214977] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-27T18:35:29.736322] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T18:35:29.738431] [INFO ] [REMOTE ] EOT: Full fetch complete (10646 records). [2025-10-27T18:35:29.738499] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-27T18:35:29.738911] [FATAL] [VALIDATOR ] EOT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:35:29.739004] [FATAL] [MAIN ] EOT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:35:29.739076] [WARN ] [MAIN ] EOT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:35:29.739162] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-27T18:35:29.739240] [DEBUG] [LOCAL ] EOT: No primary data file found to delete. [2025-10-27T18:35:29.739277] [INFO ] [LOCAL ] EOT: Starting deletion of derivative data. [2025-10-27T18:35:29.739406] [DEBUG] [LOCAL ] EOT: Deleted derivative data file. [2025-10-27T18:35:29.739473] [INFO ] [MAIN ] Update Progress: 749/2366 symbols completed. EOT took 23.7s. Estimated remaining: 3h 26m 3s. Rate: 7.8 symbols/min [2025-10-27T18:35:29.880496] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T18:35:29.941850] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:35:29.988863] [DEBUG] [LOCAL ] EPD: Loaded 54387 existing records from primary storage. [2025-10-27T18:35:29.989165] [INFO ] [MAIN ] EPD: Loaded 54387 existing records. [2025-10-27T18:35:30.020058] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-27T18:35:30.175035] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:35:30.175316] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-27T18:35:30.175386] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-27T18:35:30.175719] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-27T18:35:30.175775] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-27T18:35:30.522829] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:35:30.814928] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-27T18:35:31.614919] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-27T18:35:31.875827] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-27T18:35:31.956564] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T18:35:32.414954] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-27T18:35:33.214988] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-27T18:35:33.592638] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-27T18:35:33.702991] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-27T18:35:34.015000] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-27T18:35:34.319502] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T18:35:34.814936] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-27T18:35:35.353619] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-27T18:35:35.360735] [INFO ] [REMOTE ] EPAM: Full fetch complete (56470 records). [2025-10-27T18:35:35.360873] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-27T18:35:35.361539] [FATAL] [VALIDATOR ] EPAM: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:35:35.361621] [FATAL] [MAIN ] EPAM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:35:35.361703] [WARN ] [MAIN ] EPAM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:35:35.361776] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-27T18:35:35.361842] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-10-27T18:35:35.361876] [INFO ] [LOCAL ] EPAM: Starting deletion of derivative data. [2025-10-27T18:35:35.362022] [DEBUG] [LOCAL ] EPAM: Deleted derivative data file. [2025-10-27T18:35:35.362110] [INFO ] [MAIN ] Update Progress: 750/2366 symbols completed. EPAM took 26.7s. Estimated remaining: 3h 25m 51s. Rate: 7.9 symbols/min [2025-10-27T18:35:35.527847] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:35:35.568578] [DEBUG] [LOCAL ] EPR: Loaded 44288 existing records from primary storage. [2025-10-27T18:35:35.568872] [INFO ] [MAIN ] EPR: Loaded 44288 existing records. [2025-10-27T18:35:35.621710] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-27T18:35:35.748167] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:35:35.748399] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-27T18:35:35.748448] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-27T18:35:35.748633] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-27T18:35:35.748726] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-27T18:35:36.142183] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:35:36.414911] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-27T18:35:36.498638] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T18:35:36.800879] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T18:35:37.214939] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-27T18:35:38.014959] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-27T18:35:38.163431] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-27T18:35:38.814936] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-27T18:35:39.001393] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T18:35:39.009313] [INFO ] [REMOTE ] EPAC: Full fetch complete (38822 records). [2025-10-27T18:35:39.009451] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-27T18:35:39.435577] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-27T18:35:39.435964] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-27T18:35:39.436554] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-27T18:35:39.439540] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-27T18:35:39.449044] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-27T18:35:39.450549] [DEBUG] [LOCAL ] EPAC: Trimmed 38822 records to 26063 (keeping 200 days of data) [2025-10-27T18:35:39.610700] [DEBUG] [LOCAL ] EPAC: Primary data saved (26063 records). [2025-10-27T18:35:39.610872] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-27T18:35:39.610983] [INFO ] [MAIN ] Update Progress: 751/2366 symbols completed. EPAC took 31.3s. Estimated remaining: 3h 25m 36s. Rate: 7.9 symbols/min [2025-10-27T18:35:39.622178] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-27T18:35:39.798858] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:35:39.821989] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-27T18:35:39.869901] [DEBUG] [LOCAL ] EPRT: Loaded 49234 existing records from primary storage. [2025-10-27T18:35:39.870212] [INFO ] [MAIN ] EPRT: Loaded 49234 existing records. [2025-10-27T18:35:40.059564] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:35:40.059794] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-27T18:35:40.059843] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-27T18:35:40.060038] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-27T18:35:40.060102] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-27T18:35:40.441156] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:35:40.435638] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-27T18:35:41.155798] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T18:35:41.214956] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-27T18:35:41.521686] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-27T18:35:42.014944] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-27T18:35:42.785545] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T18:35:42.814913] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-27T18:35:42.956578] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-27T18:35:43.614944] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-27T18:35:44.414936] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-27T18:35:44.498964] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T18:35:44.978793] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T18:35:45.214936] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-27T18:35:45.544467] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-27T18:35:46.014939] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-27T18:35:46.803321] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T18:35:46.816086] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-27T18:35:47.347382] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T18:35:47.614938] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-27T18:35:48.414955] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-27T18:35:48.485079] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T18:35:49.013629] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T18:35:49.214934] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-27T18:35:49.546237] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T18:35:50.014934] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-27T18:35:50.810835] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T18:35:50.820541] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-27T18:35:51.095348] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-27T18:35:51.614991] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-27T18:35:52.414951] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-27T18:35:52.775981] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-27T18:35:52.997264] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-27T18:35:53.215006] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-27T18:35:53.677494] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T18:35:54.014990] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-27T18:35:54.797575] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T18:35:54.814897] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-27T18:35:55.620150] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-27T18:35:55.622832] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-27T18:35:55.630526] [INFO ] [REMOTE ] EPC: Full fetch complete (57087 records). [2025-10-27T18:35:55.630709] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-27T18:35:55.631483] [FATAL] [VALIDATOR ] EPC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:35:55.631616] [FATAL] [MAIN ] EPC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:35:55.631709] [WARN ] [MAIN ] EPC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:35:55.631782] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-27T18:35:55.631848] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-10-27T18:35:55.631884] [INFO ] [LOCAL ] EPC: Starting deletion of derivative data. [2025-10-27T18:35:55.632008] [DEBUG] [LOCAL ] EPC: Deleted derivative data file. [2025-10-27T18:35:55.632092] [INFO ] [MAIN ] Update Progress: 752/2366 symbols completed. EPC took 35.1s. Estimated remaining: 3h 25m 47s. Rate: 7.8 symbols/min [2025-10-27T18:35:55.816561] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:35:55.828585] [DEBUG] [LOCAL ] EQBK: Loaded 11444 existing records from primary storage. [2025-10-27T18:35:55.828805] [INFO ] [MAIN ] EQBK: Loaded 11444 existing records. [2025-10-27T18:35:55.999615] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:35:55.999838] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-27T18:35:55.999884] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-27T18:35:56.000042] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-10-27T18:35:56.000078] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-27T18:35:56.372361] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:35:56.414906] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-27T18:35:56.463617] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-27T18:35:56.970043] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T18:35:57.214957] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-27T18:35:57.805748] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T18:35:58.014944] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-27T18:35:58.814936] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-27T18:35:58.848801] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T18:35:58.880290] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T18:35:59.614946] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-27T18:36:00.414947] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-27T18:36:00.675871] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-27T18:36:01.214946] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-27T18:36:01.606670] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-27T18:36:02.014956] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-27T18:36:02.815079] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-27T18:36:03.142689] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-27T18:36:03.162092] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T18:36:03.326611] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-27T18:36:03.614993] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-27T18:36:04.061684] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-27T18:36:04.069628] [INFO ] [REMOTE ] EPR: Full fetch complete (62963 records). [2025-10-27T18:36:04.069756] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-27T18:36:04.070454] [FATAL] [VALIDATOR ] EPR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:36:04.070537] [FATAL] [MAIN ] EPR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:36:04.070579] [WARN ] [MAIN ] EPR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:36:04.070615] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-27T18:36:04.070702] [DEBUG] [LOCAL ] EPR: No primary data file found to delete. [2025-10-27T18:36:04.070752] [INFO ] [LOCAL ] EPR: Starting deletion of derivative data. [2025-10-27T18:36:04.070897] [DEBUG] [LOCAL ] EPR: Deleted derivative data file. [2025-10-27T18:36:04.070983] [INFO ] [MAIN ] Update Progress: 753/2366 symbols completed. EPR took 28.7s. Estimated remaining: 3h 25m 41s. Rate: 7.8 symbols/min [2025-10-27T18:36:04.176070] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T18:36:04.246208] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:36:04.293912] [DEBUG] [LOCAL ] EQH: Loaded 53446 existing records from primary storage. [2025-10-27T18:36:04.294210] [INFO ] [MAIN ] EQH: Loaded 53446 existing records. [2025-10-27T18:36:04.420149] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-27T18:36:04.472215] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:36:04.472386] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-27T18:36:04.472431] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-27T18:36:04.472603] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-27T18:36:04.472675] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-27T18:36:04.815782] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:36:05.214989] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-27T18:36:06.013842] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T18:36:06.018980] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-27T18:36:06.735341] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T18:36:06.814957] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-27T18:36:07.491037] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T18:36:07.615006] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-27T18:36:08.414953] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-27T18:36:08.524976] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-27T18:36:09.152952] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-27T18:36:09.214902] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-27T18:36:09.590490] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T18:36:09.601287] [INFO ] [REMOTE ] EPRT: Full fetch complete (69674 records). [2025-10-27T18:36:09.601453] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-27T18:36:10.015015] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-27T18:36:10.014178] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-27T18:36:10.036254] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-27T18:36:10.038538] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-27T18:36:10.039701] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-27T18:36:10.039764] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-27T18:36:10.040947] [DEBUG] [LOCAL ] EPRT: Trimmed 69674 records to 48434 (keeping 200 days of data) [2025-10-27T18:36:10.321508] [DEBUG] [LOCAL ] EPRT: Primary data saved (48434 records). [2025-10-27T18:36:10.321634] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-27T18:36:10.322049] [INFO ] [MAIN ] Update Progress: 754/2366 symbols completed. EPRT took 30.7s. Estimated remaining: 3h 25m 30s. Rate: 7.8 symbols/min [2025-10-27T18:36:10.494750] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:36:10.544932] [DEBUG] [LOCAL ] EQNR: Loaded 53824 existing records from primary storage. [2025-10-27T18:36:10.545223] [INFO ] [MAIN ] EQNR: Loaded 53824 existing records. [2025-10-27T18:36:10.718807] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:36:10.718981] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-27T18:36:10.719028] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-27T18:36:10.719297] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-27T18:36:10.719353] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-27T18:36:10.816310] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-27T18:36:11.064589] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:36:11.614935] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-27T18:36:11.978481] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-27T18:36:11.988753] [INFO ] [REMOTE ] EPD: Full fetch complete (77775 records). [2025-10-27T18:36:11.988870] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-27T18:36:12.386256] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-27T18:36:12.386373] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-27T18:36:12.387448] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-27T18:36:12.387533] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-27T18:36:12.389121] [DEBUG] [LOCAL ] EPD: Trimmed 77775 records to 53606 (keeping 200 days of data) [2025-10-27T18:36:12.442934] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-27T18:36:12.527846] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-27T18:36:12.760533] [DEBUG] [LOCAL ] EPD: Primary data saved (53606 records). [2025-10-27T18:36:12.760847] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-27T18:36:12.760965] [INFO ] [MAIN ] Update Progress: 755/2366 symbols completed. EPD took 43.0s. Estimated remaining: 3h 25m 11s. Rate: 7.9 symbols/min [2025-10-27T18:36:12.936743] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:36:12.947779] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-27T18:36:12.999058] [DEBUG] [LOCAL ] EQR: Loaded 52563 existing records from primary storage. [2025-10-27T18:36:12.999383] [INFO ] [MAIN ] EQR: Loaded 52563 existing records. [2025-10-27T18:36:13.177056] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:36:13.177253] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-27T18:36:13.177300] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-27T18:36:13.177699] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-27T18:36:13.177754] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-27T18:36:13.219998] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-27T18:36:13.539986] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:36:13.818472] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-27T18:36:14.014914] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-27T18:36:14.604292] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T18:36:14.815010] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-27T18:36:15.413557] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T18:36:15.432586] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-27T18:36:15.614922] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-27T18:36:16.414938] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-27T18:36:16.644376] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-27T18:36:17.214969] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-27T18:36:17.842528] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T18:36:18.014949] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-27T18:36:18.395484] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T18:36:18.814953] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-27T18:36:19.614927] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-27T18:36:19.746888] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-27T18:36:20.414947] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-27T18:36:20.545423] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-27T18:36:21.071806] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T18:36:21.160078] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-27T18:36:21.214922] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-27T18:36:22.014972] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-27T18:36:22.651304] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T18:36:22.814942] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-27T18:36:23.614941] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-27T18:36:23.829999] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-27T18:36:24.414912] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-27T18:36:24.473431] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T18:36:25.122443] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T18:36:25.214990] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-27T18:36:25.865058] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T18:36:26.014925] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-27T18:36:26.516091] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T18:36:26.716006] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-27T18:36:26.718877] [INFO ] [REMOTE ] EQBK: Full fetch complete (15561 records). [2025-10-27T18:36:26.718994] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-27T18:36:26.719502] [FATAL] [VALIDATOR ] EQBK: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:36:26.719603] [FATAL] [MAIN ] EQBK: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:36:26.719698] [WARN ] [MAIN ] EQBK: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:36:26.719774] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-27T18:36:26.719835] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-27T18:36:26.719872] [INFO ] [LOCAL ] EQBK: Starting deletion of derivative data. [2025-10-27T18:36:26.720027] [DEBUG] [LOCAL ] EQBK: Deleted derivative data file. [2025-10-27T18:36:26.720115] [INFO ] [MAIN ] Update Progress: 756/2366 symbols completed. EQBK took 31.1s. Estimated remaining: 3h 25m 17s. Rate: 7.8 symbols/min [2025-10-27T18:36:26.820213] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-27T18:36:26.891271] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:36:26.891868] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-27T18:36:26.891923] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-27T18:36:26.892032] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-27T18:36:26.892076] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-27T18:36:26.892118] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-27T18:36:26.892151] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-27T18:36:27.257914] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:36:27.614951] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-27T18:36:28.414951] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-27T18:36:28.576942] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-27T18:36:29.214971] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-27T18:36:29.426937] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-27T18:36:29.651661] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-27T18:36:29.939596] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-27T18:36:30.014911] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-27T18:36:30.814949] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-27T18:36:31.614974] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-27T18:36:31.903557] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-27T18:36:31.996563] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-27T18:36:32.414921] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-27T18:36:32.536245] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-27T18:36:32.546247] [INFO ] [REMOTE ] EQH: Full fetch complete (76599 records). [2025-10-27T18:36:32.546386] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-27T18:36:32.942046] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-27T18:36:32.942160] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-27T18:36:32.943046] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-27T18:36:32.943110] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-27T18:36:32.944497] [DEBUG] [LOCAL ] EQH: Trimmed 76599 records to 52653 (keeping 200 days of data) [2025-10-27T18:36:33.232869] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-27T18:36:33.283980] [DEBUG] [LOCAL ] EQH: Primary data saved (52653 records). [2025-10-27T18:36:33.284141] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-27T18:36:33.284247] [INFO ] [MAIN ] Update Progress: 757/2366 symbols completed. EQH took 29.2s. Estimated remaining: 3h 25m 7s. Rate: 7.8 symbols/min [2025-10-27T18:36:33.519065] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-27T18:36:34.014926] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-27T18:36:34.334000] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-27T18:36:34.814954] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-27T18:36:35.057550] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-27T18:36:35.363176] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T18:36:35.615003] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-27T18:36:36.414975] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-27T18:36:36.761894] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-27T18:36:37.214964] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-27T18:36:37.375770] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T18:36:37.492006] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-27T18:36:38.014967] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-27T18:36:38.321072] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-27T18:36:38.814953] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-27T18:36:39.212899] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-27T18:36:39.614960] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-27T18:36:40.148094] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-27T18:36:40.414971] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-27T18:36:41.080508] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-27T18:36:41.081455] [INFO ] [REMOTE ] EQS: Full fetch complete (2370 records). [2025-10-27T18:36:41.081524] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-27T18:36:41.225404] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-27T18:36:41.266425] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-27T18:36:41.266608] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:36:41.266695] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:36:41.266764] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-27T18:36:41.266826] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-27T18:36:41.266888] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-27T18:36:41.266942] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-27T18:36:41.266998] [INFO ] [MAIN ] Update Progress: 758/2366 symbols completed. EQS took 14.5s. Estimated remaining: 3h 25m 0s. Rate: 7.8 symbols/min [2025-10-27T18:36:42.014988] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-27T18:36:42.868616] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-27T18:36:42.879738] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-27T18:36:43.942868] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-27T18:36:43.954012] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-27T18:36:44.598733] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T18:36:44.610371] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-27T18:36:45.872900] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-27T18:36:45.884615] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-27T18:36:46.050633] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T18:36:46.060596] [INFO ] [REMOTE ] EQR: Full fetch complete (74640 records). [2025-10-27T18:36:46.060747] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-27T18:36:46.451818] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-27T18:36:46.451902] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-27T18:36:46.452752] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-27T18:36:46.452813] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-27T18:36:46.454184] [DEBUG] [LOCAL ] EQR: Trimmed 74640 records to 51787 (keeping 200 days of data) [2025-10-27T18:36:46.763666] [DEBUG] [LOCAL ] EQR: Primary data saved (51787 records). [2025-10-27T18:36:46.763803] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-27T18:36:46.763892] [INFO ] [MAIN ] Update Progress: 759/2366 symbols completed. EQR took 34.0s. Estimated remaining: 3h 24m 48s. Rate: 7.8 symbols/min [2025-10-27T18:36:47.639160] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T18:36:47.650806] [INFO ] [REMOTE ] EQNR: Full fetch complete (77018 records). [2025-10-27T18:36:47.650970] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-27T18:36:48.054928] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-27T18:36:48.055006] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-27T18:36:48.055972] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-27T18:36:48.056037] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-27T18:36:48.057487] [DEBUG] [LOCAL ] EQNR: Trimmed 77018 records to 53043 (keeping 200 days of data) [2025-10-27T18:36:48.376666] [DEBUG] [LOCAL ] EQNR: Primary data saved (53043 records). [2025-10-27T18:36:48.376798] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-27T18:36:48.377230] [INFO ] [MAIN ] Update Progress: 760/2366 symbols completed. EQNR took 38.1s. Estimated remaining: 3h 24m 28s. Rate: 7.9 symbols/min [2025-10-27T18:36:49.056405] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:36:49.086295] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:36:49.112308] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:36:49.092778] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:36:49.119784] [DEBUG] [LOCAL ] EQV: Loaded 2822 existing records from primary storage. [2025-10-27T18:36:49.120105] [INFO ] [MAIN ] EQV: Loaded 2822 existing records. [2025-10-27T18:36:49.353245] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:36:49.354734] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-27T18:36:49.354836] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-27T18:36:49.355966] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-27T18:36:49.356021] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-27T18:36:49.355530] [DEBUG] [LOCAL ] ERO: Loaded 42780 existing records from primary storage. [2025-10-27T18:36:49.392086] [INFO ] [MAIN ] ERO: Loaded 42780 existing records. [2025-10-27T18:36:49.543884] [DEBUG] [LOCAL ] ERJ: Loaded 51023 existing records from primary storage. [2025-10-27T18:36:49.578311] [DEBUG] [LOCAL ] EQT: Loaded 54464 existing records from primary storage. [2025-10-27T18:36:49.566608] [INFO ] [MAIN ] ERJ: Loaded 51023 existing records. [2025-10-27T18:36:49.704993] [INFO ] [MAIN ] EQT: Loaded 54464 existing records. [2025-10-27T18:36:50.054055] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:36:50.107849] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-27T18:36:50.118333] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-27T18:36:50.164202] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-27T18:36:50.183536] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-27T18:36:50.303372] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:36:50.398912] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-27T18:36:50.406698] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-27T18:36:50.424470] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-27T18:36:50.410606] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:36:50.440186] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-27T18:36:50.419045] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:36:50.468202] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-27T18:36:50.493115] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-27T18:36:50.498547] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-27T18:36:50.570877] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-27T18:36:50.637666] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-27T18:36:51.217766] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:36:51.279260] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-27T18:36:51.462389] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:36:51.463781] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-27T18:36:51.491212] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T18:36:51.494672] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-27T18:36:51.490753] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:36:51.495915] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-27T18:36:52.138825] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T18:36:52.140503] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-27T18:36:52.483550] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-27T18:36:52.484982] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-27T18:36:52.787175] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T18:36:52.794912] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-27T18:36:53.007706] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-27T18:36:53.009044] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-27T18:36:53.197020] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T18:36:53.214892] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-27T18:36:53.311999] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-27T18:36:53.332132] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-27T18:36:53.926007] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T18:36:54.014909] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-27T18:36:54.610182] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T18:36:54.814926] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-27T18:36:55.605842] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T18:36:55.615112] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-27T18:36:56.414909] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-27T18:36:56.522856] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-27T18:36:57.191852] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T18:36:57.214899] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-27T18:36:57.843865] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-27T18:36:58.014942] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-27T18:36:58.271281] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-27T18:36:58.814983] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-27T18:36:59.614953] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-27T18:36:59.879482] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T18:37:00.155734] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-27T18:37:00.199543] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T18:37:00.414996] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-27T18:37:01.214953] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-27T18:37:02.015007] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-27T18:37:02.634048] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-27T18:37:02.814931] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-27T18:37:03.297866] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T18:37:03.627258] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-27T18:37:03.636560] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-27T18:37:04.261610] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-27T18:37:04.414969] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-27T18:37:04.512186] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T18:37:04.849699] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-27T18:37:05.214942] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-27T18:37:06.014991] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-27T18:37:06.814919] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-27T18:37:06.870912] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-27T18:37:07.340683] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-27T18:37:07.569302] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-27T18:37:07.614905] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-27T18:37:08.414911] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-27T18:37:09.155499] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-27T18:37:09.214915] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-27T18:37:09.570486] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T18:37:10.014989] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-27T18:37:10.816695] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-27T18:37:10.821590] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-27T18:37:11.614996] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-27T18:37:11.845068] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-27T18:37:12.415017] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-27T18:37:12.616561] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-27T18:37:13.052548] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T18:37:13.067168] [INFO ] [REMOTE ] ERO: Full fetch complete (60720 records). [2025-10-27T18:37:13.067324] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-27T18:37:13.125971] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-27T18:37:13.191712] [INFO ] [REMOTE ] EQV: Full fetch complete (4805 records). [2025-10-27T18:37:13.220081] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-27T18:37:13.220324] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-27T18:37:13.934733] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-27T18:37:13.939987] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-27T18:37:13.959186] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-27T18:37:13.980090] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-27T18:37:14.004112] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-27T18:37:14.004196] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-27T18:37:14.004297] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-27T18:37:14.004724] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-27T18:37:14.005762] [DEBUG] [LOCAL ] EQV: Trimmed 4805 records to 2764 (keeping 200 days of data) [2025-10-27T18:37:14.014288] [DEBUG] [LOCAL ] ERO: Trimmed 60720 records to 42023 (keeping 200 days of data) [2025-10-27T18:37:14.016309] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-27T18:37:14.077358] [DEBUG] [LOCAL ] EQV: Primary data saved (2764 records). [2025-10-27T18:37:14.077990] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-27T18:37:14.087089] [INFO ] [MAIN ] Update Progress: 761/2366 symbols completed. EQV took 25.7s. Estimated remaining: 3h 24m 58s. Rate: 7.8 symbols/min [2025-10-27T18:37:14.428093] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:37:14.474486] [DEBUG] [LOCAL ] ERO: Primary data saved (42023 records). [2025-10-27T18:37:14.474781] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-27T18:37:14.474884] [INFO ] [MAIN ] Update Progress: 762/2366 symbols completed. ERO took 26.1s. Estimated remaining: 3h 24m 35s. Rate: 7.8 symbols/min [2025-10-27T18:37:14.673133] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:37:14.675441] [DEBUG] [LOCAL ] ES: Loaded 53468 existing records from primary storage. [2025-10-27T18:37:14.675906] [INFO ] [MAIN ] ES: Loaded 53468 existing records. [2025-10-27T18:37:14.878828] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:37:14.879281] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-27T18:37:14.879434] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-27T18:37:14.879769] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-27T18:37:14.879830] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-27T18:37:14.982526] [DEBUG] [LOCAL ] ESAB: Loaded 26338 existing records from primary storage. [2025-10-27T18:37:14.993389] [INFO ] [MAIN ] ESAB: Loaded 26338 existing records. [2025-10-27T18:37:15.361805] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:37:15.372794] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-27T18:37:15.372891] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-27T18:37:15.411300] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-27T18:37:15.414185] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-27T18:37:15.481164] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:37:15.528034] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-27T18:37:15.579965] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-27T18:37:15.644432] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-27T18:37:15.889851] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:37:15.920594] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-27T18:37:16.414953] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-27T18:37:17.044803] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T18:37:17.138083] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T18:37:17.214944] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-27T18:37:17.312338] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-27T18:37:18.014977] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-27T18:37:18.814955] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-27T18:37:19.096975] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T18:37:19.120978] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T18:37:19.615003] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-27T18:37:20.414958] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-27T18:37:20.443334] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-27T18:37:20.456279] [INFO ] [REMOTE ] ERJ: Full fetch complete (73121 records). [2025-10-27T18:37:20.456427] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-27T18:37:20.826107] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T18:37:20.929916] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-27T18:37:20.929992] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-27T18:37:20.930887] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-27T18:37:20.930952] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-27T18:37:20.932255] [DEBUG] [LOCAL ] ERJ: Trimmed 73121 records to 50207 (keeping 200 days of data) [2025-10-27T18:37:21.215725] [DEBUG] [LOCAL ] ERJ: Primary data saved (50207 records). [2025-10-27T18:37:21.215958] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-27T18:37:21.215800] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-27T18:37:21.216093] [INFO ] [MAIN ] Update Progress: 763/2366 symbols completed. ERJ took 32.8s. Estimated remaining: 3h 24m 26s. Rate: 7.8 symbols/min [2025-10-27T18:37:21.400276] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:37:21.417586] [DEBUG] [LOCAL ] ESE: Loaded 16609 existing records from primary storage. [2025-10-27T18:37:21.417857] [INFO ] [MAIN ] ESE: Loaded 16609 existing records. [2025-10-27T18:37:21.613841] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:37:21.614050] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-27T18:37:21.614118] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-27T18:37:21.614274] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-27T18:37:21.614310] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-27T18:37:21.972087] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:37:22.014932] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-27T18:37:22.479142] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T18:37:22.594285] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-27T18:37:22.604853] [INFO ] [REMOTE ] EQT: Full fetch complete (77859 records). [2025-10-27T18:37:22.604978] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-27T18:37:22.825531] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-27T18:37:22.990995] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-27T18:37:22.991082] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-27T18:37:22.991968] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-27T18:37:22.992031] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-27T18:37:22.993455] [DEBUG] [LOCAL ] EQT: Trimmed 77859 records to 53684 (keeping 200 days of data) [2025-10-27T18:37:23.307584] [DEBUG] [LOCAL ] EQT: Primary data saved (53684 records). [2025-10-27T18:37:23.307751] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-27T18:37:23.307837] [INFO ] [MAIN ] Update Progress: 764/2366 symbols completed. EQT took 34.9s. Estimated remaining: 3h 24m 6s. Rate: 7.8 symbols/min [2025-10-27T18:37:23.425008] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T18:37:23.494237] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:37:23.541852] [DEBUG] [LOCAL ] ESI: Loaded 51368 existing records from primary storage. [2025-10-27T18:37:23.542171] [INFO ] [MAIN ] ESI: Loaded 51368 existing records. [2025-10-27T18:37:23.620162] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-27T18:37:23.735438] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:37:23.735682] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-27T18:37:23.735741] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-27T18:37:23.735925] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-27T18:37:23.735966] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-27T18:37:24.141563] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:37:24.174087] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T18:37:24.414922] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-27T18:37:24.825216] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T18:37:25.215002] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-27T18:37:25.805493] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T18:37:26.014967] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-27T18:37:26.789299] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T18:37:26.814931] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-27T18:37:27.251630] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T18:37:27.615015] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-27T18:37:28.035369] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T18:37:28.414937] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-27T18:37:28.736337] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T18:37:29.214939] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-27T18:37:30.014906] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-27T18:37:30.122157] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T18:37:30.353887] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T18:37:30.814955] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-27T18:37:31.618145] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-27T18:37:31.624237] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-27T18:37:31.812217] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T18:37:32.292078] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-27T18:37:32.414938] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-27T18:37:33.161306] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-27T18:37:33.214911] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-27T18:37:34.014948] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-27T18:37:34.799965] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-27T18:37:34.814909] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-27T18:37:34.851315] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T18:37:35.614911] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-27T18:37:35.844839] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T18:37:36.414937] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-27T18:37:37.061428] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T18:37:37.214980] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-27T18:37:37.501983] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T18:37:38.014971] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-27T18:37:38.567150] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T18:37:38.814928] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-27T18:37:39.301889] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T18:37:39.614975] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-27T18:37:40.414924] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-27T18:37:40.603597] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T18:37:40.668233] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-27T18:37:41.214964] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-27T18:37:41.231791] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T18:37:42.015014] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-27T18:37:42.696139] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T18:37:42.814905] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-27T18:37:42.837747] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-27T18:37:43.615023] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-27T18:37:44.082730] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T18:37:44.088006] [INFO ] [REMOTE ] ESAB: Full fetch complete (36496 records). [2025-10-27T18:37:44.088103] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-27T18:37:44.419284] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-27T18:37:44.469742] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-27T18:37:44.469987] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-27T18:37:44.470736] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-27T18:37:44.470821] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-27T18:37:44.480522] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T18:37:44.483833] [DEBUG] [LOCAL ] ESAB: Trimmed 36496 records to 25775 (keeping 200 days of data) [2025-10-27T18:37:44.484331] [INFO ] [REMOTE ] ESE: Full fetch complete (22980 records). [2025-10-27T18:37:44.484847] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-27T18:37:44.833220] [DEBUG] [LOCAL ] ESAB: Primary data saved (25775 records). [2025-10-27T18:37:44.851184] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-27T18:37:44.851305] [INFO ] [MAIN ] Update Progress: 765/2366 symbols completed. ESAB took 30.4s. Estimated remaining: 3h 24m 28s. Rate: 7.8 symbols/min [2025-10-27T18:37:45.195557] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:37:45.238872] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-27T18:37:45.240982] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-27T18:37:45.241953] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-27T18:37:45.242537] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-27T18:37:45.242755] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-27T18:37:45.243514] [DEBUG] [LOCAL ] ESE: Trimmed 22980 records to 16199 (keeping 200 days of data) [2025-10-27T18:37:45.363283] [DEBUG] [LOCAL ] ESE: Primary data saved (16199 records). [2025-10-27T18:37:45.373785] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-27T18:37:45.373941] [INFO ] [MAIN ] Update Progress: 766/2366 symbols completed. ESE took 24.2s. Estimated remaining: 3h 24m 5s. Rate: 7.8 symbols/min [2025-10-27T18:37:45.409707] [DEBUG] [LOCAL ] ESNT: Loaded 38439 existing records from primary storage. [2025-10-27T18:37:45.448622] [INFO ] [MAIN ] ESNT: Loaded 38439 existing records. [2025-10-27T18:37:45.740888] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:37:45.763758] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:37:45.764159] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-27T18:37:45.764215] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-27T18:37:45.764436] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-27T18:37:45.764475] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-27T18:37:46.073876] [DEBUG] [LOCAL ] ESRT: Loaded 47236 existing records from primary storage. [2025-10-27T18:37:46.074912] [INFO ] [MAIN ] ESRT: Loaded 47236 existing records. [2025-10-27T18:37:46.242805] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:37:46.253577] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-27T18:37:46.337238] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:37:46.337720] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-27T18:37:46.337778] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-27T18:37:46.354691] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-27T18:37:46.368147] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-27T18:37:46.439066] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-27T18:37:46.732212] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:37:46.814911] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-27T18:37:46.906628] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T18:37:47.512911] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T18:37:47.614933] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-27T18:37:48.415002] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-27T18:37:48.467477] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T18:37:48.730791] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T18:37:49.214956] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-27T18:37:50.012096] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-27T18:37:50.022417] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-27T18:37:50.814917] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-27T18:37:51.130373] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T18:37:51.166447] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-27T18:37:51.614941] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-27T18:37:52.415005] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-27T18:37:52.736289] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-27T18:37:52.872564] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-27T18:37:52.882859] [INFO ] [REMOTE ] ES: Full fetch complete (76476 records). [2025-10-27T18:37:52.883006] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-27T18:37:53.220185] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-27T18:37:53.328360] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-27T18:37:53.328477] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-27T18:37:53.329940] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-27T18:37:53.330019] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-27T18:37:53.332116] [DEBUG] [LOCAL ] ES: Trimmed 76476 records to 52682 (keeping 200 days of data) [2025-10-27T18:37:53.677305] [DEBUG] [LOCAL ] ES: Primary data saved (52682 records). [2025-10-27T18:37:53.677515] [INFO ] [MAIN ] ES: Full history saved. [2025-10-27T18:37:53.678257] [INFO ] [MAIN ] Update Progress: 767/2366 symbols completed. ES took 39.6s. Estimated remaining: 3h 23m 59s. Rate: 7.8 symbols/min [2025-10-27T18:37:53.897339] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:37:53.923007] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-27T18:37:53.959048] [DEBUG] [LOCAL ] ESS: Loaded 30589 existing records from primary storage. [2025-10-27T18:37:53.959362] [INFO ] [MAIN ] ESS: Loaded 30589 existing records. [2025-10-27T18:37:54.023857] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-27T18:37:54.146541] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:37:54.146950] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-27T18:37:54.147021] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-27T18:37:54.147364] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-27T18:37:54.147454] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-27T18:37:54.497764] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:37:54.525137] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T18:37:54.814929] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-27T18:37:55.444553] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T18:37:55.454327] [INFO ] [REMOTE ] ESI: Full fetch complete (73268 records). [2025-10-27T18:37:55.454476] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-27T18:37:55.615810] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-27T18:37:55.853326] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-27T18:37:55.853401] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-27T18:37:55.854246] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-27T18:37:55.854307] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-27T18:37:55.855701] [DEBUG] [LOCAL ] ESI: Trimmed 73268 records to 50575 (keeping 200 days of data) [2025-10-27T18:37:56.151246] [DEBUG] [LOCAL ] ESI: Primary data saved (50575 records). [2025-10-27T18:37:56.151370] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-27T18:37:56.151444] [INFO ] [MAIN ] Update Progress: 768/2366 symbols completed. ESI took 32.8s. Estimated remaining: 3h 23m 41s. Rate: 7.8 symbols/min [2025-10-27T18:37:56.318962] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:37:56.363039] [DEBUG] [LOCAL ] ESTC: Loaded 50954 existing records from primary storage. [2025-10-27T18:37:56.363353] [INFO ] [MAIN ] ESTC: Loaded 50954 existing records. [2025-10-27T18:37:56.425134] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-27T18:37:56.559552] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:37:56.577368] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-27T18:37:56.577746] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-27T18:37:56.579585] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-27T18:37:56.579638] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-27T18:37:56.589337] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-27T18:37:56.966235] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:37:57.014721] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T18:37:57.214957] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-27T18:37:58.014928] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-27T18:37:58.120960] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-27T18:37:58.560135] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T18:37:58.814977] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-27T18:37:59.603150] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T18:37:59.614908] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-27T18:37:59.721750] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T18:38:00.414966] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-27T18:38:01.037121] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T18:38:01.214985] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-27T18:38:02.015001] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-27T18:38:02.045609] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T18:38:02.432907] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T18:38:02.814944] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-27T18:38:03.615000] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-27T18:38:03.667894] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T18:38:04.035777] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T18:38:04.414954] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-27T18:38:05.199706] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-27T18:38:05.214896] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-27T18:38:05.409035] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T18:38:06.014990] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-27T18:38:06.409040] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T18:38:06.814936] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-27T18:38:07.500446] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-27T18:38:07.614904] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-27T18:38:08.414950] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-27T18:38:08.720445] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-27T18:38:09.214987] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-27T18:38:09.378344] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-27T18:38:09.702259] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-27T18:38:10.014961] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-27T18:38:10.814982] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-27T18:38:11.194623] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-27T18:38:11.614975] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-27T18:38:11.942704] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-27T18:38:11.951853] [INFO ] [REMOTE ] ESRT: Full fetch complete (66817 records). [2025-10-27T18:38:11.951968] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-27T18:38:12.287692] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T18:38:12.368175] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-27T18:38:12.368253] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-27T18:38:12.369161] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-27T18:38:12.369243] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-27T18:38:12.370705] [DEBUG] [LOCAL ] ESRT: Trimmed 66817 records to 46460 (keeping 200 days of data) [2025-10-27T18:38:12.418944] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-27T18:38:12.668521] [DEBUG] [LOCAL ] ESRT: Primary data saved (46460 records). [2025-10-27T18:38:12.668684] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-27T18:38:12.668792] [INFO ] [MAIN ] Update Progress: 769/2366 symbols completed. ESRT took 27.3s. Estimated remaining: 3h 23m 51s. Rate: 7.8 symbols/min [2025-10-27T18:38:12.832119] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:38:12.890864] [DEBUG] [LOCAL ] ET: Loaded 54569 existing records from primary storage. [2025-10-27T18:38:12.892021] [INFO ] [MAIN ] ET: Loaded 54569 existing records. [2025-10-27T18:38:13.063484] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:38:13.063808] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-27T18:38:13.063868] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-27T18:38:13.064489] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-27T18:38:13.064547] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-27T18:38:13.216559] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-27T18:38:13.415408] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:38:13.447479] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-27T18:38:14.014936] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-27T18:38:14.310301] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-27T18:38:14.379528] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-27T18:38:14.814936] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-27T18:38:15.550158] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-27T18:38:15.614906] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-27T18:38:16.011578] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-27T18:38:16.414976] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-27T18:38:17.042497] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T18:38:17.214956] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-27T18:38:17.400116] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-27T18:38:18.014941] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-27T18:38:18.306122] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T18:38:18.814964] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-27T18:38:19.615028] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-27T18:38:19.849710] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-27T18:38:19.860291] [INFO ] [REMOTE ] ESTC: Full fetch complete (72494 records). [2025-10-27T18:38:19.860506] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-27T18:38:20.264497] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-27T18:38:20.264583] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-27T18:38:20.265606] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-27T18:38:20.265694] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-27T18:38:20.267242] [DEBUG] [LOCAL ] ESTC: Trimmed 72494 records to 50185 (keeping 200 days of data) [2025-10-27T18:38:20.432218] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-27T18:38:20.558484] [DEBUG] [LOCAL ] ESTC: Primary data saved (50185 records). [2025-10-27T18:38:20.558623] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-27T18:38:20.558738] [INFO ] [MAIN ] Update Progress: 770/2366 symbols completed. ESTC took 24.4s. Estimated remaining: 3h 23m 44s. Rate: 7.8 symbols/min [2025-10-27T18:38:20.726692] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:38:20.740420] [DEBUG] [LOCAL ] ETB: Loaded 11883 existing records from primary storage. [2025-10-27T18:38:20.740755] [INFO ] [MAIN ] ETB: Loaded 11883 existing records. [2025-10-27T18:38:20.929028] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:38:20.929307] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-27T18:38:20.929447] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-27T18:38:20.929694] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-27T18:38:20.929761] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-27T18:38:21.194512] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-27T18:38:21.250516] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-27T18:38:21.320203] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:38:21.352825] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-27T18:38:21.699127] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T18:38:21.706568] [INFO ] [REMOTE ] ESNT: Full fetch complete (57002 records). [2025-10-27T18:38:21.706707] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-27T18:38:22.020009] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-27T18:38:22.097694] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-27T18:38:22.097780] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-27T18:38:22.098497] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-27T18:38:22.098741] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-27T18:38:22.099906] [DEBUG] [LOCAL ] ESNT: Trimmed 57002 records to 37618 (keeping 200 days of data) [2025-10-27T18:38:22.318127] [DEBUG] [LOCAL ] ESNT: Primary data saved (37618 records). [2025-10-27T18:38:22.318350] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-27T18:38:22.318466] [INFO ] [MAIN ] Update Progress: 771/2366 symbols completed. ESNT took 37.5s. Estimated remaining: 3h 23m 24s. Rate: 7.8 symbols/min [2025-10-27T18:38:22.486773] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:38:22.503629] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T18:38:22.530696] [DEBUG] [LOCAL ] ETD: Loaded 27368 existing records from primary storage. [2025-10-27T18:38:22.530938] [INFO ] [MAIN ] ETD: Loaded 27368 existing records. [2025-10-27T18:38:22.706250] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:38:22.706440] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-27T18:38:22.706484] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-27T18:38:22.706957] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-27T18:38:22.707012] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-27T18:38:22.819998] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-27T18:38:23.055956] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:38:23.615004] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-27T18:38:23.629772] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T18:38:24.257603] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-27T18:38:24.414945] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-27T18:38:25.140438] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T18:38:25.214920] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-27T18:38:25.360836] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T18:38:26.014924] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-27T18:38:26.313676] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T18:38:26.814931] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-27T18:38:27.523306] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-27T18:38:27.614921] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-27T18:38:28.396050] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-27T18:38:28.414889] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-27T18:38:28.686338] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-27T18:38:29.214941] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-27T18:38:29.754788] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-27T18:38:30.014933] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-27T18:38:30.806952] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-27T18:38:30.814887] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-27T18:38:30.871103] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-27T18:38:31.537485] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T18:38:31.614916] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-27T18:38:32.415005] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-27T18:38:32.917111] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-27T18:38:33.214982] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-27T18:38:33.441780] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-27T18:38:34.014943] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-27T18:38:34.057784] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-27T18:38:34.815003] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-27T18:38:35.262118] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-27T18:38:35.268987] [INFO ] [REMOTE ] ESS: Full fetch complete (43888 records). [2025-10-27T18:38:35.269138] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-27T18:38:35.619391] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-27T18:38:35.652168] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-27T18:38:35.652245] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-27T18:38:35.652922] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-27T18:38:35.652984] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-27T18:38:35.653924] [DEBUG] [LOCAL ] ESS: Trimmed 43888 records to 29996 (keeping 200 days of data) [2025-10-27T18:38:35.842157] [DEBUG] [LOCAL ] ESS: Primary data saved (29996 records). [2025-10-27T18:38:35.842307] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-27T18:38:35.843040] [INFO ] [MAIN ] Update Progress: 772/2366 symbols completed. ESS took 42.2s. Estimated remaining: 3h 23m 29s. Rate: 7.8 symbols/min [2025-10-27T18:38:36.015369] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:38:36.032821] [DEBUG] [LOCAL ] ETG: Loaded 16714 existing records from primary storage. [2025-10-27T18:38:36.033061] [INFO ] [MAIN ] ETG: Loaded 16714 existing records. [2025-10-27T18:38:36.232112] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:38:36.233612] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T18:38:36.239448] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-27T18:38:36.239546] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-27T18:38:36.240311] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-27T18:38:36.240384] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-27T18:38:36.425019] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-27T18:38:36.596730] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:38:37.214928] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-27T18:38:37.311449] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-27T18:38:37.314363] [INFO ] [REMOTE ] ETB: Full fetch complete (18492 records). [2025-10-27T18:38:37.314447] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-27T18:38:37.674329] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-27T18:38:37.674404] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-27T18:38:37.674847] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-27T18:38:37.674915] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-27T18:38:37.675458] [DEBUG] [LOCAL ] ETB: Trimmed 18492 records to 11479 (keeping 200 days of data) [2025-10-27T18:38:37.745438] [DEBUG] [LOCAL ] ETB: Primary data saved (11479 records). [2025-10-27T18:38:37.745566] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-27T18:38:37.745697] [INFO ] [MAIN ] Update Progress: 773/2366 symbols completed. ETB took 17.2s. Estimated remaining: 3h 23m 9s. Rate: 7.8 symbols/min [2025-10-27T18:38:37.923961] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:38:37.967519] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-27T18:38:37.983658] [DEBUG] [LOCAL ] ETJ: Loaded 16575 existing records from primary storage. [2025-10-27T18:38:37.984109] [INFO ] [MAIN ] ETJ: Loaded 16575 existing records. [2025-10-27T18:38:38.020055] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-27T18:38:38.166166] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:38:38.166820] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-27T18:38:38.166956] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-27T18:38:38.167311] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-27T18:38:38.167400] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-27T18:38:38.278297] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-27T18:38:38.553307] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:38:38.814922] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-27T18:38:39.165834] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T18:38:39.615014] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-27T18:38:40.088412] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T18:38:40.414914] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-27T18:38:40.561919] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T18:38:41.214951] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-27T18:38:42.014947] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-27T18:38:42.192464] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-27T18:38:42.814937] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-27T18:38:42.917545] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T18:38:43.081120] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-27T18:38:43.614942] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-27T18:38:44.111158] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T18:38:44.370836] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-27T18:38:44.414907] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-27T18:38:45.175022] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-27T18:38:45.214936] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-27T18:38:46.014943] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-27T18:38:46.534151] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-27T18:38:46.651097] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T18:38:46.814933] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-27T18:38:47.614945] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-27T18:38:47.748503] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-27T18:38:48.414918] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-27T18:38:48.466578] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-27T18:38:49.214938] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-27T18:38:50.014949] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-27T18:38:50.225879] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-27T18:38:50.527052] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-27T18:38:50.648855] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-27T18:38:50.814931] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-27T18:38:51.614952] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-27T18:38:51.724840] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T18:38:52.414950] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-27T18:38:52.465056] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T18:38:53.045926] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-27T18:38:53.214973] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-27T18:38:53.847865] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T18:38:54.014999] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-27T18:38:54.814929] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-27T18:38:55.614954] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-27T18:38:56.016475] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-27T18:38:56.391983] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-27T18:38:56.414898] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-27T18:38:56.511596] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T18:38:57.214966] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-27T18:38:58.014990] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-27T18:38:58.500558] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-27T18:38:58.774406] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T18:38:58.814927] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-27T18:38:58.853167] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-27T18:38:58.863332] [INFO ] [REMOTE ] ET: Full fetch complete (77969 records). [2025-10-27T18:38:58.863471] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-27T18:38:59.280336] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-27T18:38:59.280425] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-27T18:38:59.281350] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-27T18:38:59.281413] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-27T18:38:59.282818] [DEBUG] [LOCAL ] ET: Trimmed 77969 records to 53789 (keeping 200 days of data) [2025-10-27T18:38:59.602576] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-10-27T18:38:59.602736] [INFO ] [MAIN ] ET: Full history saved. [2025-10-27T18:38:59.602825] [INFO ] [MAIN ] Update Progress: 774/2366 symbols completed. ET took 46.9s. Estimated remaining: 3h 23m 31s. Rate: 7.8 symbols/min [2025-10-27T18:38:59.624789] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-27T18:38:59.780590] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:38:59.831304] [DEBUG] [LOCAL ] ETN: Loaded 53313 existing records from primary storage. [2025-10-27T18:38:59.831730] [INFO ] [MAIN ] ETN: Loaded 53313 existing records. [2025-10-27T18:39:00.010623] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:39:00.010899] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-27T18:39:00.010948] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-27T18:39:00.011822] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-27T18:39:00.011880] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-27T18:39:00.147705] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T18:39:00.385098] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:39:00.414912] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-27T18:39:01.163033] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-27T18:39:01.167878] [INFO ] [REMOTE ] ETD: Full fetch complete (38415 records). [2025-10-27T18:39:01.167974] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-27T18:39:01.216676] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-27T18:39:01.533517] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-27T18:39:01.533589] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-27T18:39:01.534175] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-27T18:39:01.534235] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-27T18:39:01.535032] [DEBUG] [LOCAL ] ETD: Trimmed 38415 records to 26664 (keeping 200 days of data) [2025-10-27T18:39:01.703916] [DEBUG] [LOCAL ] ETD: Primary data saved (26664 records). [2025-10-27T18:39:01.704064] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-27T18:39:01.704153] [INFO ] [MAIN ] Update Progress: 775/2366 symbols completed. ETD took 39.4s. Estimated remaining: 3h 23m 12s. Rate: 7.8 symbols/min [2025-10-27T18:39:01.899153] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:39:01.907308] [DEBUG] [LOCAL ] ETO: Loaded 6954 existing records from primary storage. [2025-10-27T18:39:01.907522] [INFO ] [MAIN ] ETO: Loaded 6954 existing records. [2025-10-27T18:39:02.020018] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-27T18:39:02.093064] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:39:02.093312] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-27T18:39:02.093369] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-27T18:39:02.093699] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-27T18:39:02.093765] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-27T18:39:02.450944] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:39:02.460853] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-27T18:39:02.464254] [INFO ] [REMOTE ] ETJ: Full fetch complete (25230 records). [2025-10-27T18:39:02.464353] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-27T18:39:02.815529] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-27T18:39:02.825752] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-27T18:39:02.826514] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-27T18:39:02.827089] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-27T18:39:02.827150] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-27T18:39:02.827898] [DEBUG] [LOCAL ] ETJ: Trimmed 25230 records to 15848 (keeping 200 days of data) [2025-10-27T18:39:02.921473] [DEBUG] [LOCAL ] ETJ: Primary data saved (15848 records). [2025-10-27T18:39:02.921736] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-27T18:39:02.921912] [INFO ] [MAIN ] Update Progress: 776/2366 symbols completed. ETJ took 25.2s. Estimated remaining: 3h 22m 51s. Rate: 7.8 symbols/min [2025-10-27T18:39:03.096568] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:39:03.129204] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-10-27T18:39:03.182115] [DEBUG] [LOCAL ] ETR: Loaded 53955 existing records from primary storage. [2025-10-27T18:39:03.182405] [INFO ] [MAIN ] ETR: Loaded 53955 existing records. [2025-10-27T18:39:03.371808] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T18:39:03.375495] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:39:03.376821] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-27T18:39:03.376931] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-27T18:39:03.379405] [INFO ] [REMOTE ] ETG: Full fetch complete (24407 records). [2025-10-27T18:39:03.379475] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-27T18:39:03.410277] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-27T18:39:03.448020] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-27T18:39:03.622545] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-27T18:39:03.998390] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-27T18:39:04.120341] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-27T18:39:04.142965] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-27T18:39:04.148490] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:39:04.145269] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-27T18:39:04.148606] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-27T18:39:04.149485] [DEBUG] [LOCAL ] ETG: Trimmed 24407 records to 16250 (keeping 200 days of data) [2025-10-27T18:39:04.246133] [DEBUG] [LOCAL ] ETG: Primary data saved (16250 records). [2025-10-27T18:39:04.246265] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-27T18:39:04.246340] [INFO ] [MAIN ] Update Progress: 777/2366 symbols completed. ETG took 28.4s. Estimated remaining: 3h 22m 30s. Rate: 7.8 symbols/min [2025-10-27T18:39:04.414734] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:39:04.415220] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-27T18:39:04.464117] [DEBUG] [LOCAL ] ETSY: Loaded 54338 existing records from primary storage. [2025-10-27T18:39:04.464484] [INFO ] [MAIN ] ETSY: Loaded 54338 existing records. [2025-10-27T18:39:04.646271] [WARN ] [MAIN ] ETSY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:39:04.646478] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-10-27T18:39:04.646523] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-27T18:39:04.647438] [DEBUG] [LOCAL ] ETSY: Deleted primary data file. [2025-10-27T18:39:04.647495] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-10-27T18:39:05.016918] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:39:05.125961] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-27T18:39:05.215005] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-10-27T18:39:05.846212] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-27T18:39:06.014971] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-27T18:39:06.637947] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T18:39:06.814956] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-27T18:39:06.964230] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-27T18:39:07.614950] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-10-27T18:39:08.414922] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-27T18:39:08.533828] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-27T18:39:09.214915] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-27T18:39:09.340910] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-27T18:39:09.500282] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-27T18:39:10.014992] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-27T18:39:10.814924] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-27T18:39:10.948721] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-27T18:39:10.964228] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T18:39:11.614966] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-10-27T18:39:12.414979] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-27T18:39:12.521734] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T18:39:13.117616] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-27T18:39:13.148412] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T18:39:13.214900] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-10-27T18:39:14.015000] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-27T18:39:14.713080] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T18:39:14.814999] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-27T18:39:15.614984] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-10-27T18:39:15.838441] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-27T18:39:15.871406] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T18:39:16.414996] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-27T18:39:17.029948] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-27T18:39:17.214937] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-27T18:39:17.308362] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-27T18:39:18.014982] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-27T18:39:18.710065] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-27T18:39:18.814931] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-10-27T18:39:18.893818] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T18:39:19.614981] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-27T18:39:20.408318] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T18:39:20.418469] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-27T18:39:21.214993] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-27T18:39:21.390383] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-27T18:39:21.738467] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T18:39:21.740541] [INFO ] [REMOTE ] ETO: Full fetch complete (9677 records). [2025-10-27T18:39:21.740608] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-27T18:39:22.020943] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-10-27T18:39:22.105912] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-27T18:39:22.105991] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-27T18:39:22.106217] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-27T18:39:22.106255] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-27T18:39:22.106686] [DEBUG] [LOCAL ] ETO: Trimmed 9677 records to 6726 (keeping 200 days of data) [2025-10-27T18:39:22.147805] [DEBUG] [LOCAL ] ETO: Primary data saved (6726 records). [2025-10-27T18:39:22.147924] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-27T18:39:22.148070] [INFO ] [MAIN ] Update Progress: 778/2366 symbols completed. ETO took 20.4s. Estimated remaining: 3h 22m 43s. Rate: 7.8 symbols/min [2025-10-27T18:39:22.329132] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-27T18:39:22.358473] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:39:22.378786] [DEBUG] [LOCAL ] ETV: Loaded 22125 existing records from primary storage. [2025-10-27T18:39:22.379026] [INFO ] [MAIN ] ETV: Loaded 22125 existing records. [2025-10-27T18:39:22.550871] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:39:22.551050] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-27T18:39:22.551095] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-27T18:39:22.551541] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-27T18:39:22.551599] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-27T18:39:22.820365] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-27T18:39:22.897312] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:39:23.614964] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-27T18:39:23.658347] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-27T18:39:24.114923] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T18:39:24.414931] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-10-27T18:39:25.214912] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-27T18:39:25.292493] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-27T18:39:25.963516] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-27T18:39:26.014898] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-10-27T18:39:26.342393] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T18:39:26.814987] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-27T18:39:27.614998] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-27T18:39:27.749167] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T18:39:28.423145] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-27T18:39:28.442164] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T18:39:29.049034] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T18:39:29.214975] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-10-27T18:39:29.356412] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-27T18:39:30.014944] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-27T18:39:30.814930] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-27T18:39:31.118458] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-27T18:39:31.128782] [INFO ] [REMOTE ] ETSY: Full fetch complete (77655 records). [2025-10-27T18:39:31.128909] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-10-27T18:39:31.536284] [DEBUG] [VALIDATOR ] ETSY: All expected trading days are present. [2025-10-27T18:39:31.536545] [DEBUG] [VALIDATOR ] ETSY: Primary data validation passed. [2025-10-27T18:39:31.537571] [INFO ] [MAIN ] ETSY: Fetched primary data is valid. [2025-10-27T18:39:31.537699] [DEBUG] [LOCAL ] ETSY: Saving primary data. [2025-10-27T18:39:31.539251] [DEBUG] [LOCAL ] ETSY: Trimmed 77655 records to 53555 (keeping 200 days of data) [2025-10-27T18:39:31.621978] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-27T18:39:31.879626] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-27T18:39:31.909394] [DEBUG] [LOCAL ] ETSY: Primary data saved (53555 records). [2025-10-27T18:39:31.909686] [INFO ] [MAIN ] ETSY: Full history saved. [2025-10-27T18:39:31.910529] [INFO ] [MAIN ] Update Progress: 779/2366 symbols completed. ETSY took 27.7s. Estimated remaining: 3h 22m 40s. Rate: 7.8 symbols/min [2025-10-27T18:39:32.090740] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:39:32.116111] [DEBUG] [LOCAL ] ETW: Loaded 25508 existing records from primary storage. [2025-10-27T18:39:32.116353] [INFO ] [MAIN ] ETW: Loaded 25508 existing records. [2025-10-27T18:39:32.318372] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:39:32.331609] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-27T18:39:32.331838] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-27T18:39:32.333305] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T18:39:32.333349] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-27T18:39:32.343549] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-27T18:39:32.422753] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-27T18:39:32.722342] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:39:32.735955] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T18:39:33.215004] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-27T18:39:34.014953] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-27T18:39:34.460583] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-27T18:39:34.752151] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-27T18:39:34.814910] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-27T18:39:34.909049] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-27T18:39:35.614977] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-27T18:39:35.726766] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-27T18:39:36.414924] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-27T18:39:37.214922] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-27T18:39:37.439804] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-27T18:39:37.953903] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-27T18:39:38.014915] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-27T18:39:38.193485] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-27T18:39:38.814943] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-27T18:39:39.614919] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-27T18:39:40.030145] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-27T18:39:40.058735] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T18:39:40.057878] [INFO ] [REMOTE ] ETN: Full fetch complete (76606 records). [2025-10-27T18:39:40.065394] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-27T18:39:40.418797] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-27T18:39:40.461240] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-27T18:39:40.461319] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-27T18:39:40.462207] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-27T18:39:40.462270] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-27T18:39:40.463917] [DEBUG] [LOCAL ] ETN: Trimmed 76606 records to 52514 (keeping 200 days of data) [2025-10-27T18:39:40.567334] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T18:39:40.794888] [DEBUG] [LOCAL ] ETN: Primary data saved (52514 records). [2025-10-27T18:39:40.795014] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-27T18:39:40.795090] [INFO ] [MAIN ] Update Progress: 780/2366 symbols completed. ETN took 41.2s. Estimated remaining: 3h 22m 35s. Rate: 7.8 symbols/min [2025-10-27T18:39:40.960305] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:39:40.966372] [DEBUG] [LOCAL ] ETX: Loaded 5378 existing records from primary storage. [2025-10-27T18:39:40.966548] [INFO ] [MAIN ] ETX: Loaded 5378 existing records. [2025-10-27T18:39:41.143371] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:39:41.143564] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-27T18:39:41.143609] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-27T18:39:41.143842] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-27T18:39:41.143899] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-27T18:39:41.220019] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-27T18:39:41.491515] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:39:41.676347] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T18:39:42.014950] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-27T18:39:42.814906] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-27T18:39:42.975254] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-27T18:39:43.060900] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-27T18:39:43.455553] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-27T18:39:43.614996] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-27T18:39:44.414998] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-27T18:39:45.214947] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-27T18:39:45.696288] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-27T18:39:45.706410] [INFO ] [REMOTE ] ETR: Full fetch complete (77265 records). [2025-10-27T18:39:45.706533] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-27T18:39:45.958445] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T18:39:46.024430] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-27T18:39:46.134542] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-27T18:39:46.134752] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-27T18:39:46.135854] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-27T18:39:46.135921] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-27T18:39:46.137507] [DEBUG] [LOCAL ] ETR: Trimmed 77265 records to 53171 (keeping 200 days of data) [2025-10-27T18:39:46.454819] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-27T18:39:46.480863] [DEBUG] [LOCAL ] ETR: Primary data saved (53171 records). [2025-10-27T18:39:46.480948] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-27T18:39:46.481017] [INFO ] [MAIN ] Update Progress: 781/2366 symbols completed. ETR took 43.6s. Estimated remaining: 3h 22m 23s. Rate: 7.8 symbols/min [2025-10-27T18:39:46.645177] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:39:46.665488] [DEBUG] [LOCAL ] ETY: Loaded 22603 existing records from primary storage. [2025-10-27T18:39:46.665755] [INFO ] [MAIN ] ETY: Loaded 22603 existing records. [2025-10-27T18:39:46.771125] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T18:39:46.821607] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-27T18:39:46.852325] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:39:46.852550] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-27T18:39:46.852603] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-27T18:39:46.853024] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-27T18:39:46.853079] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-27T18:39:47.205080] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:39:47.614951] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-27T18:39:47.737549] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-27T18:39:48.414969] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-27T18:39:48.737435] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-27T18:39:49.106903] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T18:39:49.214941] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-27T18:39:50.014926] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-27T18:39:50.265133] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-27T18:39:50.814928] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-27T18:39:51.411897] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T18:39:51.422628] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-27T18:39:51.614941] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-27T18:39:52.414927] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-27T18:39:52.598751] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-27T18:39:53.214922] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-27T18:39:53.590638] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T18:39:54.014936] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-27T18:39:54.149038] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-27T18:39:54.534050] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-27T18:39:54.814931] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-27T18:39:55.614953] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-27T18:39:55.901378] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-27T18:39:56.012028] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-27T18:39:56.414981] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-27T18:39:56.743466] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-27T18:39:57.215004] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-27T18:39:58.014915] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-27T18:39:58.032302] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-27T18:39:58.037272] [INFO ] [REMOTE ] ETV: Full fetch complete (32099 records). [2025-10-27T18:39:58.037347] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-27T18:39:58.406797] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-27T18:39:58.406905] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-27T18:39:58.407494] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-27T18:39:58.407536] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-27T18:39:58.408302] [DEBUG] [LOCAL ] ETV: Trimmed 32099 records to 21341 (keeping 200 days of data) [2025-10-27T18:39:58.533033] [DEBUG] [LOCAL ] ETV: Primary data saved (21341 records). [2025-10-27T18:39:58.533235] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-27T18:39:58.533322] [INFO ] [MAIN ] Update Progress: 782/2366 symbols completed. ETV took 36.4s. Estimated remaining: 3h 22m 24s. Rate: 7.8 symbols/min [2025-10-27T18:39:58.642402] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T18:39:58.714086] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:39:58.734213] [DEBUG] [LOCAL ] EVC: Loaded 18007 existing records from primary storage. [2025-10-27T18:39:58.734456] [INFO ] [MAIN ] EVC: Loaded 18007 existing records. [2025-10-27T18:39:58.820192] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-27T18:39:58.919907] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:39:58.920129] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-27T18:39:58.920185] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-27T18:39:58.920606] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-27T18:39:58.920711] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-27T18:39:59.291563] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:39:59.614987] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-27T18:40:00.118434] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T18:40:00.414972] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-27T18:40:01.142158] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T18:40:01.147226] [INFO ] [REMOTE ] ETW: Full fetch complete (36252 records). [2025-10-27T18:40:01.147307] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-27T18:40:01.147796] [FATAL] [VALIDATOR ] ETW: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:40:01.147877] [FATAL] [MAIN ] ETW: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:40:01.147919] [WARN ] [MAIN ] ETW: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:40:01.147983] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-27T18:40:01.148045] [DEBUG] [LOCAL ] ETW: No primary data file found to delete. [2025-10-27T18:40:01.148077] [INFO ] [LOCAL ] ETW: Starting deletion of derivative data. [2025-10-27T18:40:01.148190] [DEBUG] [LOCAL ] ETW: Deleted derivative data file. [2025-10-27T18:40:01.148253] [INFO ] [MAIN ] Update Progress: 783/2366 symbols completed. ETW took 29.2s. Estimated remaining: 3h 22m 7s. Rate: 7.8 symbols/min [2025-10-27T18:40:01.220955] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-27T18:40:01.315070] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:40:01.345677] [DEBUG] [LOCAL ] EVEX: Loaded 33639 existing records from primary storage. [2025-10-27T18:40:01.345985] [INFO ] [MAIN ] EVEX: Loaded 33639 existing records. [2025-10-27T18:40:01.522603] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:40:01.522841] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-27T18:40:01.522905] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-27T18:40:01.523460] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-27T18:40:01.523523] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-27T18:40:01.891048] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T18:40:01.913896] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:40:02.010818] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-27T18:40:02.014897] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-27T18:40:02.815471] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-27T18:40:03.048044] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T18:40:03.050023] [INFO ] [REMOTE ] ETX: Full fetch complete (6747 records). [2025-10-27T18:40:03.050155] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-27T18:40:03.050702] [FATAL] [VALIDATOR ] ETX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:40:03.051623] [FATAL] [MAIN ] ETX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:40:03.051810] [WARN ] [MAIN ] ETX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:40:03.051900] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-27T18:40:03.051993] [DEBUG] [LOCAL ] ETX: No primary data file found to delete. [2025-10-27T18:40:03.052044] [INFO ] [LOCAL ] ETX: Starting deletion of derivative data. [2025-10-27T18:40:03.052294] [DEBUG] [LOCAL ] ETX: Deleted derivative data file. [2025-10-27T18:40:03.052434] [INFO ] [MAIN ] Update Progress: 784/2366 symbols completed. ETX took 22.3s. Estimated remaining: 3h 21m 47s. Rate: 7.8 symbols/min [2025-10-27T18:40:03.328284] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:40:03.338805] [DEBUG] [LOCAL ] EVF: Loaded 9816 existing records from primary storage. [2025-10-27T18:40:03.339046] [INFO ] [MAIN ] EVF: Loaded 9816 existing records. [2025-10-27T18:40:03.546252] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:40:03.546524] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-27T18:40:03.546579] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-27T18:40:03.546898] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-27T18:40:03.546956] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-27T18:40:03.620686] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-27T18:40:03.965911] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:40:04.414922] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-27T18:40:04.684037] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T18:40:04.725860] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-27T18:40:05.214910] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-27T18:40:05.221745] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T18:40:06.014964] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-27T18:40:06.072912] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T18:40:06.814943] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-27T18:40:07.034399] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T18:40:07.614964] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-27T18:40:07.883803] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T18:40:08.225485] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-27T18:40:08.414981] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-27T18:40:09.214942] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-27T18:40:09.546097] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-27T18:40:09.885111] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-27T18:40:10.014950] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-27T18:40:10.814952] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-27T18:40:11.227026] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T18:40:11.614998] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-27T18:40:12.142443] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T18:40:12.399359] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-27T18:40:12.414906] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-27T18:40:13.214967] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-27T18:40:13.488373] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T18:40:14.014912] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-27T18:40:14.069674] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-27T18:40:14.814961] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-27T18:40:14.935199] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-27T18:40:15.614920] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-27T18:40:15.722076] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-27T18:40:16.414963] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-27T18:40:16.867900] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-27T18:40:17.214940] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-27T18:40:17.303027] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-27T18:40:18.014973] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-27T18:40:18.313792] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T18:40:18.815000] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-27T18:40:18.999192] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T18:40:19.614964] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-27T18:40:19.634379] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T18:40:20.414999] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-27T18:40:20.723379] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-27T18:40:21.038370] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-27T18:40:21.215013] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-27T18:40:22.014987] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-27T18:40:22.814993] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-27T18:40:22.860932] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-27T18:40:23.092623] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T18:40:23.262464] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-27T18:40:23.614957] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-27T18:40:24.371810] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T18:40:24.414912] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-27T18:40:25.214940] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-27T18:40:25.358858] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-27T18:40:25.361484] [INFO ] [REMOTE ] EVF: Full fetch complete (12891 records). [2025-10-27T18:40:25.361553] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-27T18:40:25.708409] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-27T18:40:25.708484] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-27T18:40:25.708778] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-27T18:40:25.708840] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-27T18:40:25.709354] [DEBUG] [LOCAL ] EVF: Trimmed 12891 records to 9436 (keeping 200 days of data) [2025-10-27T18:40:25.761302] [DEBUG] [LOCAL ] EVF: Primary data saved (9436 records). [2025-10-27T18:40:25.761411] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-27T18:40:25.761488] [INFO ] [MAIN ] Update Progress: 785/2366 symbols completed. EVF took 22.7s. Estimated remaining: 3h 22m 10s. Rate: 7.8 symbols/min [2025-10-27T18:40:25.930066] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:40:25.936734] [DEBUG] [LOCAL ] EVG: Loaded 5823 existing records from primary storage. [2025-10-27T18:40:25.936930] [INFO ] [MAIN ] EVG: Loaded 5823 existing records. [2025-10-27T18:40:26.023864] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-27T18:40:26.111373] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:40:26.111543] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-27T18:40:26.111589] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-27T18:40:26.111863] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-27T18:40:26.111921] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-27T18:40:26.453128] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:40:26.660348] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-27T18:40:26.664520] [INFO ] [REMOTE ] ETY: Full fetch complete (33610 records). [2025-10-27T18:40:26.664592] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-27T18:40:26.665062] [FATAL] [VALIDATOR ] ETY: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:40:26.665146] [FATAL] [MAIN ] ETY: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:40:26.665187] [WARN ] [MAIN ] ETY: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:40:26.665223] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-27T18:40:26.665277] [DEBUG] [LOCAL ] ETY: No primary data file found to delete. [2025-10-27T18:40:26.665310] [INFO ] [LOCAL ] ETY: Starting deletion of derivative data. [2025-10-27T18:40:26.665523] [DEBUG] [LOCAL ] ETY: Deleted derivative data file. [2025-10-27T18:40:26.665608] [INFO ] [MAIN ] Update Progress: 786/2366 symbols completed. ETY took 40.2s. Estimated remaining: 3h 21m 49s. Rate: 7.8 symbols/min [2025-10-27T18:40:26.830198] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:40:26.827685] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-27T18:40:26.872007] [DEBUG] [LOCAL ] EVH: Loaded 50344 existing records from primary storage. [2025-10-27T18:40:26.872306] [INFO ] [MAIN ] EVH: Loaded 50344 existing records. [2025-10-27T18:40:27.043870] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:40:27.044086] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-27T18:40:27.044131] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-27T18:40:27.044891] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-27T18:40:27.044948] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-27T18:40:27.390435] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:40:27.614954] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-27T18:40:27.746157] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-27T18:40:27.924437] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-27T18:40:27.933192] [INFO ] [REMOTE ] EVEX: Full fetch complete (44240 records). [2025-10-27T18:40:27.933281] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-27T18:40:28.304180] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-27T18:40:28.304251] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-27T18:40:28.304864] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-27T18:40:28.304924] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-27T18:40:28.305817] [DEBUG] [LOCAL ] EVEX: Trimmed 44240 records to 33243 (keeping 200 days of data) [2025-10-27T18:40:28.441506] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-27T18:40:28.488093] [DEBUG] [LOCAL ] EVEX: Primary data saved (33243 records). [2025-10-27T18:40:28.488200] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-27T18:40:28.488282] [INFO ] [MAIN ] Update Progress: 787/2366 symbols completed. EVEX took 27.3s. Estimated remaining: 3h 21m 29s. Rate: 7.8 symbols/min [2025-10-27T18:40:28.653322] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:40:28.664291] [DEBUG] [LOCAL ] EVN: Loaded 11048 existing records from primary storage. [2025-10-27T18:40:28.664484] [INFO ] [MAIN ] EVN: Loaded 11048 existing records. [2025-10-27T18:40:28.836898] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:40:28.837068] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-27T18:40:28.837112] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-27T18:40:28.837369] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-27T18:40:28.837410] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-27T18:40:28.953079] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-27T18:40:29.199619] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:40:29.214896] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-27T18:40:29.410859] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-27T18:40:30.014979] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-27T18:40:30.238184] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T18:40:30.615835] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-27T18:40:30.814916] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-27T18:40:31.317842] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-27T18:40:31.614947] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-27T18:40:32.130093] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-27T18:40:32.414963] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-27T18:40:33.214922] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-27T18:40:33.582055] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-27T18:40:34.014951] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-27T18:40:34.624132] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T18:40:34.814973] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-27T18:40:35.238010] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-27T18:40:35.614943] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-27T18:40:35.716421] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T18:40:36.415635] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-27T18:40:36.417601] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-27T18:40:37.214922] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-27T18:40:37.237021] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-27T18:40:37.788482] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-27T18:40:38.014925] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-27T18:40:38.726577] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T18:40:38.814916] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-27T18:40:39.338356] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-27T18:40:39.614942] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-27T18:40:40.198913] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-27T18:40:40.415007] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-27T18:40:41.214926] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-27T18:40:41.391301] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T18:40:41.394439] [INFO ] [REMOTE ] EVC: Full fetch complete (28367 records). [2025-10-27T18:40:41.394533] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-27T18:40:41.757916] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-27T18:40:41.757988] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-27T18:40:41.758468] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-27T18:40:41.758506] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-27T18:40:41.759225] [DEBUG] [LOCAL ] EVC: Trimmed 28367 records to 17464 (keeping 200 days of data) [2025-10-27T18:40:41.858323] [DEBUG] [LOCAL ] EVC: Primary data saved (17464 records). [2025-10-27T18:40:41.858444] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-27T18:40:41.858518] [INFO ] [MAIN ] Update Progress: 788/2366 symbols completed. EVC took 43.3s. Estimated remaining: 3h 21m 33s. Rate: 7.8 symbols/min [2025-10-27T18:40:42.016871] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-27T18:40:42.027471] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:40:42.058735] [DEBUG] [LOCAL ] EVR: Loaded 33926 existing records from primary storage. [2025-10-27T18:40:42.058990] [INFO ] [MAIN ] EVR: Loaded 33926 existing records. [2025-10-27T18:40:42.168981] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-27T18:40:42.247104] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:40:42.247280] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-27T18:40:42.247325] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-27T18:40:42.247993] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-27T18:40:42.248050] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-27T18:40:42.550317] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-27T18:40:42.609826] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:40:42.814922] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-27T18:40:43.445547] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T18:40:43.614957] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-27T18:40:44.037224] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-27T18:40:44.414969] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-27T18:40:45.214997] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-27T18:40:45.670880] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T18:40:45.803207] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T18:40:46.014945] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-27T18:40:46.814946] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-27T18:40:47.520602] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T18:40:47.588421] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T18:40:47.590128] [INFO ] [REMOTE ] EVG: Full fetch complete (8131 records). [2025-10-27T18:40:47.590195] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-27T18:40:47.620162] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-27T18:40:47.954143] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-27T18:40:47.954217] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-27T18:40:47.954409] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-27T18:40:47.954446] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-27T18:40:47.954865] [DEBUG] [LOCAL ] EVG: Trimmed 8131 records to 5652 (keeping 200 days of data) [2025-10-27T18:40:47.987863] [DEBUG] [LOCAL ] EVG: Primary data saved (5652 records). [2025-10-27T18:40:47.987935] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-27T18:40:47.988046] [INFO ] [MAIN ] Update Progress: 789/2366 symbols completed. EVG took 22.2s. Estimated remaining: 3h 21m 22s. Rate: 7.8 symbols/min [2025-10-27T18:40:48.152397] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:40:48.167822] [DEBUG] [LOCAL ] EVT: Loaded 16696 existing records from primary storage. [2025-10-27T18:40:48.168044] [INFO ] [MAIN ] EVT: Loaded 16696 existing records. [2025-10-27T18:40:48.352760] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:40:48.353000] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-27T18:40:48.353061] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-27T18:40:48.353442] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-27T18:40:48.353498] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-27T18:40:48.420168] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-27T18:40:48.700921] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:40:49.061062] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T18:40:49.214936] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-27T18:40:49.831233] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T18:40:50.014932] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-27T18:40:50.684907] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T18:40:50.814962] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-27T18:40:51.440002] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-27T18:40:51.506337] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T18:40:51.614986] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-27T18:40:52.395462] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-27T18:40:52.398339] [INFO ] [REMOTE ] EVN: Full fetch complete (16978 records). [2025-10-27T18:40:52.398409] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-27T18:40:52.420013] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-27T18:40:52.760924] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-27T18:40:52.761006] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-27T18:40:52.761360] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-27T18:40:52.761398] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-27T18:40:52.761918] [DEBUG] [LOCAL ] EVN: Trimmed 16978 records to 10881 (keeping 200 days of data) [2025-10-27T18:40:52.828350] [DEBUG] [LOCAL ] EVN: Primary data saved (10881 records). [2025-10-27T18:40:52.828481] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-27T18:40:52.828573] [INFO ] [MAIN ] Update Progress: 790/2366 symbols completed. EVN took 24.3s. Estimated remaining: 3h 21m 9s. Rate: 7.8 symbols/min [2025-10-27T18:40:52.996974] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:40:53.022076] [DEBUG] [LOCAL ] EVTC: Loaded 27158 existing records from primary storage. [2025-10-27T18:40:53.022374] [INFO ] [MAIN ] EVTC: Loaded 27158 existing records. [2025-10-27T18:40:53.208610] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:40:53.208890] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-27T18:40:53.208959] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-27T18:40:53.209447] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-27T18:40:53.209510] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-27T18:40:53.221533] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-27T18:40:53.608988] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:40:53.879586] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-27T18:40:53.944006] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-27T18:40:54.014971] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-27T18:40:54.814919] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-27T18:40:54.984821] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-27T18:40:55.614935] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-27T18:40:55.770917] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-27T18:40:56.414950] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-27T18:40:57.085153] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T18:40:57.214979] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-27T18:40:57.478361] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T18:40:58.015002] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-27T18:40:58.640891] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T18:40:58.814998] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-27T18:40:58.925102] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T18:40:59.465037] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T18:40:59.614991] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-27T18:41:00.414974] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-27T18:41:00.848828] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T18:41:01.214971] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-27T18:41:01.998733] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-27T18:41:02.014918] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-27T18:41:02.048359] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T18:41:02.814947] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-27T18:41:03.367818] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-27T18:41:03.614973] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-27T18:41:04.415017] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-27T18:41:04.483709] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T18:41:05.185921] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-27T18:41:05.214898] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-27T18:41:05.624559] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T18:41:06.015007] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-27T18:41:06.345713] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-27T18:41:06.814954] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-27T18:41:07.507188] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T18:41:07.614956] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-27T18:41:08.048392] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T18:41:08.414941] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-27T18:41:08.829234] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T18:41:09.214952] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-27T18:41:09.553546] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-27T18:41:10.014934] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-27T18:41:10.408519] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T18:41:10.814915] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-27T18:41:11.028345] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-27T18:41:11.615021] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-27T18:41:11.838153] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T18:41:11.844149] [INFO ] [REMOTE ] EVR: Full fetch complete (50353 records). [2025-10-27T18:41:11.844273] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-27T18:41:12.222291] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-27T18:41:12.222364] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-27T18:41:12.223037] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-27T18:41:12.223098] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-27T18:41:12.224059] [DEBUG] [LOCAL ] EVR: Trimmed 50353 records to 32984 (keeping 200 days of data) [2025-10-27T18:41:12.414977] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-27T18:41:12.438881] [DEBUG] [LOCAL ] EVR: Primary data saved (32984 records). [2025-10-27T18:41:12.439066] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-27T18:41:12.439156] [INFO ] [MAIN ] Update Progress: 791/2366 symbols completed. EVR took 30.6s. Estimated remaining: 3h 21m 25s. Rate: 7.8 symbols/min [2025-10-27T18:41:12.618227] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:41:12.641559] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T18:41:12.681699] [DEBUG] [LOCAL ] EVTL: Loaded 42106 existing records from primary storage. [2025-10-27T18:41:12.682011] [INFO ] [MAIN ] EVTL: Loaded 42106 existing records. [2025-10-27T18:41:12.852962] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:41:12.853180] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-27T18:41:12.853227] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-27T18:41:12.853877] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-27T18:41:12.853935] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-27T18:41:13.195559] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:41:13.214906] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-27T18:41:13.888733] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T18:41:13.898720] [INFO ] [REMOTE ] EVH: Full fetch complete (71585 records). [2025-10-27T18:41:13.898917] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-27T18:41:13.899961] [FATAL] [VALIDATOR ] EVH: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:41:13.900060] [FATAL] [MAIN ] EVH: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:41:13.900105] [WARN ] [MAIN ] EVH: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:41:13.900146] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-27T18:41:13.900211] [DEBUG] [LOCAL ] EVH: No primary data file found to delete. [2025-10-27T18:41:13.900251] [INFO ] [LOCAL ] EVH: Starting deletion of derivative data. [2025-10-27T18:41:13.900424] [DEBUG] [LOCAL ] EVH: Deleted derivative data file. [2025-10-27T18:41:13.900510] [INFO ] [MAIN ] Update Progress: 792/2366 symbols completed. EVH took 47.2s. Estimated remaining: 3h 21m 5s. Rate: 7.8 symbols/min [2025-10-27T18:41:14.020206] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-27T18:41:14.090471] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:41:14.119201] [DEBUG] [LOCAL ] EVTR: Loaded 25943 existing records from primary storage. [2025-10-27T18:41:14.119586] [INFO ] [MAIN ] EVTR: Loaded 25943 existing records. [2025-10-27T18:41:14.310729] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:41:14.311053] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-27T18:41:14.311125] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-27T18:41:14.311944] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-27T18:41:14.312007] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-27T18:41:14.652125] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T18:41:14.743763] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:41:14.814938] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-27T18:41:15.098520] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-27T18:41:15.614971] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-27T18:41:15.774933] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-27T18:41:16.390740] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T18:41:16.415006] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-27T18:41:17.214971] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-27T18:41:17.641221] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T18:41:18.015036] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-27T18:41:18.413082] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-27T18:41:18.419385] [INFO ] [REMOTE ] EVTC: Full fetch complete (38536 records). [2025-10-27T18:41:18.419497] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-27T18:41:18.799512] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-27T18:41:18.799614] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-27T18:41:18.800513] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-27T18:41:18.800606] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-27T18:41:18.801711] [DEBUG] [LOCAL ] EVTC: Trimmed 38536 records to 26579 (keeping 200 days of data) [2025-10-27T18:41:18.854012] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-27T18:41:18.976883] [DEBUG] [LOCAL ] EVTC: Primary data saved (26579 records). [2025-10-27T18:41:18.977105] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-27T18:41:18.977250] [INFO ] [MAIN ] Update Progress: 793/2366 symbols completed. EVTC took 26.1s. Estimated remaining: 3h 20m 52s. Rate: 7.8 symbols/min [2025-10-27T18:41:19.157708] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:41:19.209386] [DEBUG] [LOCAL ] EW: Loaded 54166 existing records from primary storage. [2025-10-27T18:41:19.209858] [INFO ] [MAIN ] EW: Loaded 54166 existing records. [2025-10-27T18:41:19.414370] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:41:19.416146] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T18:41:19.416263] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-27T18:41:19.421981] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-27T18:41:19.423385] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-27T18:41:19.423447] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-27T18:41:19.622412] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-27T18:41:19.822353] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:41:19.856084] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-27T18:41:20.414938] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-27T18:41:20.831788] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-27T18:41:21.214991] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-27T18:41:22.029954] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-27T18:41:22.060751] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T18:41:22.691525] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-27T18:41:22.713881] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T18:41:22.814993] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-27T18:41:23.556097] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-27T18:41:23.614955] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-27T18:41:24.414952] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-27T18:41:24.732753] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T18:41:25.129001] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-27T18:41:25.214954] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-27T18:41:26.014958] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-27T18:41:26.488965] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T18:41:26.814915] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-27T18:41:27.095118] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T18:41:27.614953] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-27T18:41:28.409003] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T18:41:28.419512] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-27T18:41:28.779428] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-27T18:41:29.214931] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-27T18:41:29.362732] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-27T18:41:30.014985] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-27T18:41:30.814976] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-27T18:41:30.847014] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T18:41:31.266141] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T18:41:31.614972] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-27T18:41:31.833924] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T18:41:31.837138] [INFO ] [REMOTE ] EVT: Full fetch complete (24827 records). [2025-10-27T18:41:31.837221] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-27T18:41:32.195047] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-27T18:41:32.195119] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-27T18:41:32.195584] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-27T18:41:32.195626] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-27T18:41:32.196298] [DEBUG] [LOCAL ] EVT: Trimmed 24827 records to 16213 (keeping 200 days of data) [2025-10-27T18:41:32.291770] [DEBUG] [LOCAL ] EVT: Primary data saved (16213 records). [2025-10-27T18:41:32.291902] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-27T18:41:32.291979] [INFO ] [MAIN ] Update Progress: 794/2366 symbols completed. EVT took 44.3s. Estimated remaining: 3h 20m 56s. Rate: 7.8 symbols/min [2025-10-27T18:41:32.429096] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-27T18:41:32.461025] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:41:32.489894] [DEBUG] [LOCAL ] EXG: Loaded 34033 existing records from primary storage. [2025-10-27T18:41:32.490188] [INFO ] [MAIN ] EXG: Loaded 34033 existing records. [2025-10-27T18:41:32.664544] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:41:32.664934] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-27T18:41:32.664982] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-27T18:41:32.665559] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-27T18:41:32.665617] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-27T18:41:33.019743] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:41:33.214981] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-27T18:41:33.558553] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-27T18:41:33.762457] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T18:41:34.014951] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-27T18:41:34.815033] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-27T18:41:34.968743] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-27T18:41:35.614995] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-27T18:41:35.828883] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-27T18:41:36.414929] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-27T18:41:36.459004] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T18:41:37.053593] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T18:41:37.214928] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-27T18:41:37.529899] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T18:41:38.014907] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-27T18:41:38.513242] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-27T18:41:38.814939] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-27T18:41:39.614919] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-27T18:41:39.861121] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-27T18:41:40.253346] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T18:41:40.414933] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-27T18:41:40.505342] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-27T18:41:41.214949] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-27T18:41:42.014940] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-27T18:41:42.048703] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T18:41:42.814916] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-27T18:41:42.989610] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-27T18:41:43.000232] [INFO ] [REMOTE ] EVTL: Full fetch complete (55305 records). [2025-10-27T18:41:43.000370] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-27T18:41:43.382261] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-27T18:41:43.382354] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-27T18:41:43.383104] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-27T18:41:43.383181] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-27T18:41:43.384510] [DEBUG] [LOCAL ] EVTL: Trimmed 55305 records to 41802 (keeping 200 days of data) [2025-10-27T18:41:43.519124] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T18:41:43.621906] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-27T18:41:43.651624] [DEBUG] [LOCAL ] EVTL: Primary data saved (41802 records). [2025-10-27T18:41:43.651779] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-27T18:41:43.651859] [INFO ] [MAIN ] Update Progress: 795/2366 symbols completed. EVTL took 31.2s. Estimated remaining: 3h 20m 56s. Rate: 7.8 symbols/min [2025-10-27T18:41:43.847888] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:41:43.911886] [DEBUG] [LOCAL ] EXK: Loaded 53965 existing records from primary storage. [2025-10-27T18:41:43.912232] [INFO ] [MAIN ] EXK: Loaded 53965 existing records. [2025-10-27T18:41:44.191159] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:41:44.191694] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-27T18:41:44.191754] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-27T18:41:44.192575] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-27T18:41:44.192635] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-27T18:41:44.421183] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-27T18:41:44.704871] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:41:44.746166] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-27T18:41:45.006291] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T18:41:45.214941] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-27T18:41:45.714993] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T18:41:45.721773] [INFO ] [REMOTE ] EVTR: Full fetch complete (34425 records). [2025-10-27T18:41:45.721865] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-27T18:41:46.020018] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-27T18:41:46.097106] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-27T18:41:46.097181] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-27T18:41:46.097751] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-27T18:41:46.097812] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-27T18:41:46.098606] [DEBUG] [LOCAL ] EVTR: Trimmed 34425 records to 25721 (keeping 200 days of data) [2025-10-27T18:41:46.250262] [DEBUG] [LOCAL ] EVTR: Primary data saved (25721 records). [2025-10-27T18:41:46.250386] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-27T18:41:46.250462] [INFO ] [MAIN ] Update Progress: 796/2366 symbols completed. EVTR took 32.3s. Estimated remaining: 3h 20m 38s. Rate: 7.8 symbols/min [2025-10-27T18:41:46.414866] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:41:46.440858] [DEBUG] [LOCAL ] EXP: Loaded 29474 existing records from primary storage. [2025-10-27T18:41:46.441117] [INFO ] [MAIN ] EXP: Loaded 29474 existing records. [2025-10-27T18:41:46.612256] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:41:46.612430] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-27T18:41:46.612475] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-27T18:41:46.613035] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-27T18:41:46.613092] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-27T18:41:46.818269] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-27T18:41:46.966920] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:41:47.091284] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-27T18:41:47.102285] [INFO ] [REMOTE ] EW: Full fetch complete (77504 records). [2025-10-27T18:41:47.102537] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-27T18:41:47.208821] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T18:41:47.521126] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-27T18:41:47.521203] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-27T18:41:47.522203] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-27T18:41:47.522266] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-27T18:41:47.523768] [DEBUG] [LOCAL ] EW: Trimmed 77504 records to 53386 (keeping 200 days of data) [2025-10-27T18:41:47.626131] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-27T18:41:47.836772] [DEBUG] [LOCAL ] EW: Primary data saved (53386 records). [2025-10-27T18:41:47.836941] [INFO ] [MAIN ] EW: Full history saved. [2025-10-27T18:41:47.837669] [INFO ] [MAIN ] Update Progress: 797/2366 symbols completed. EW took 28.9s. Estimated remaining: 3h 20m 18s. Rate: 7.8 symbols/min [2025-10-27T18:41:48.414965] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-27T18:41:48.796386] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-27T18:41:48.864088] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T18:41:49.214924] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-27T18:41:49.658131] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T18:41:50.014990] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-27T18:41:50.814965] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-27T18:41:50.888377] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-27T18:41:51.025075] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-27T18:41:51.614938] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-27T18:41:52.162508] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T18:41:52.414920] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-27T18:41:52.482442] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-27T18:41:53.214961] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-27T18:41:53.427213] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T18:41:54.014965] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-27T18:41:54.193234] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T18:41:54.199469] [INFO ] [REMOTE ] EXG: Full fetch complete (49266 records). [2025-10-27T18:41:54.199616] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-27T18:41:54.590620] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-27T18:41:54.590719] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-27T18:41:54.591377] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-27T18:41:54.591417] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-27T18:41:54.592387] [DEBUG] [LOCAL ] EXG: Trimmed 49266 records to 33130 (keeping 200 days of data) [2025-10-27T18:41:54.783795] [DEBUG] [LOCAL ] EXG: Primary data saved (33130 records). [2025-10-27T18:41:54.783925] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-27T18:41:54.784001] [INFO ] [MAIN ] Update Progress: 798/2366 symbols completed. EXG took 22.5s. Estimated remaining: 3h 20m 9s. Rate: 7.8 symbols/min [2025-10-27T18:41:54.814961] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-27T18:41:55.916103] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-27T18:41:55.927066] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-27T18:41:56.247849] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T18:41:56.414929] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-27T18:41:57.421447] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T18:41:57.432501] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-27T18:41:57.823034] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-27T18:41:58.015054] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-27T18:41:59.354233] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T18:41:59.361025] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-27T18:41:59.413093] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-27T18:41:59.614935] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-27T18:42:00.925762] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T18:42:00.933228] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-27T18:42:01.681888] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-27T18:42:01.692827] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-27T18:42:02.489283] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T18:42:02.495683] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-27T18:42:03.460627] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-27T18:42:03.472942] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-27T18:42:03.870263] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T18:42:03.877461] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-27T18:42:05.155684] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-27T18:42:05.166778] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-27T18:42:05.190591] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T18:42:05.195700] [INFO ] [REMOTE ] EXP: Full fetch complete (42639 records). [2025-10-27T18:42:05.195799] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-27T18:42:05.196311] [FATAL] [VALIDATOR ] EXP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:42:05.196394] [FATAL] [MAIN ] EXP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:42:05.196436] [WARN ] [MAIN ] EXP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:42:05.196474] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-27T18:42:05.196529] [DEBUG] [LOCAL ] EXP: No primary data file found to delete. [2025-10-27T18:42:05.196563] [INFO ] [LOCAL ] EXP: Starting deletion of derivative data. [2025-10-27T18:42:05.196713] [DEBUG] [LOCAL ] EXP: Deleted derivative data file. [2025-10-27T18:42:05.196798] [INFO ] [MAIN ] Update Progress: 799/2366 symbols completed. EXP took 18.9s. Estimated remaining: 3h 20m 7s. Rate: 7.8 symbols/min [2025-10-27T18:42:06.845233] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T18:42:06.858154] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-27T18:42:08.669376] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-27T18:42:08.679592] [INFO ] [REMOTE ] EXK: Full fetch complete (76880 records). [2025-10-27T18:42:08.679776] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-27T18:42:09.067841] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-27T18:42:09.067923] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-27T18:42:09.068888] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-27T18:42:09.068953] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-27T18:42:09.070616] [DEBUG] [LOCAL ] EXK: Trimmed 76880 records to 53188 (keeping 200 days of data) [2025-10-27T18:42:09.366696] [DEBUG] [LOCAL ] EXK: Primary data saved (53188 records). [2025-10-27T18:42:09.366845] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-27T18:42:09.367291] [INFO ] [MAIN ] Update Progress: 800/2366 symbols completed. EXK took 25.7s. Estimated remaining: 3h 19m 52s. Rate: 7.8 symbols/min [2025-10-27T18:42:09.957292] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:42:10.098559] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:42:10.094745] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:42:10.099831] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:42:10.189739] [DEBUG] [LOCAL ] EXR: Loaded 46048 existing records from primary storage. [2025-10-27T18:42:10.206161] [INFO ] [MAIN ] EXR: Loaded 46048 existing records. [2025-10-27T18:42:10.207043] [DEBUG] [LOCAL ] F: Loaded 54600 existing records from primary storage. [2025-10-27T18:42:10.231136] [DEBUG] [LOCAL ] FAF: Loaded 42073 existing records from primary storage. [2025-10-27T18:42:10.250438] [INFO ] [MAIN ] F: Loaded 54600 existing records. [2025-10-27T18:42:10.256718] [INFO ] [MAIN ] FAF: Loaded 42073 existing records. [2025-10-27T18:42:10.256529] [DEBUG] [LOCAL ] EXPD: Loaded 48335 existing records from primary storage. [2025-10-27T18:42:10.297926] [INFO ] [MAIN ] EXPD: Loaded 48335 existing records. [2025-10-27T18:42:10.870235] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:42:10.944267] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:42:10.975735] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-27T18:42:10.967118] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:42:10.963339] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-27T18:42:10.976091] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-27T18:42:10.975859] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-27T18:42:10.991033] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:42:10.987512] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-27T18:42:10.991486] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-27T18:42:10.991415] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-27T18:42:10.991675] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-27T18:42:10.992088] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-27T18:42:10.992172] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-27T18:42:10.997375] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-27T18:42:10.997441] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-27T18:42:11.004360] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-27T18:42:11.004259] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-27T18:42:11.004540] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-27T18:42:11.009738] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-27T18:42:12.303780] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:42:12.370344] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-27T18:42:12.369920] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:42:12.395512] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-27T18:42:12.490508] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:42:12.485745] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:42:12.490974] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-27T18:42:12.491298] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-27T18:42:13.629633] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T18:42:13.639255] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-27T18:42:13.697179] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-27T18:42:13.706130] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-27T18:42:14.197313] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-27T18:42:14.204223] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-27T18:42:14.812287] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-27T18:42:14.822973] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-27T18:42:15.067844] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T18:42:15.076892] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-27T18:42:15.144772] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T18:42:15.157863] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-27T18:42:15.520776] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T18:42:15.527692] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-27T18:42:16.980029] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-27T18:42:16.988775] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-27T18:42:17.031488] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-27T18:42:17.041591] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-27T18:42:17.300026] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-27T18:42:17.310136] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-27T18:42:17.429300] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-10-27T18:42:17.439237] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-27T18:42:18.290784] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T18:42:18.300440] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-27T18:42:18.433961] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T18:42:18.649862] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T18:42:18.814986] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-27T18:42:19.615021] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-27T18:42:19.765047] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-27T18:42:19.821887] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T18:42:20.414913] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-27T18:42:20.618831] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-27T18:42:20.870512] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T18:42:21.214981] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-27T18:42:21.775845] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T18:42:22.015001] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-27T18:42:22.815031] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-27T18:42:23.385547] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T18:42:23.477966] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-27T18:42:23.614913] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-27T18:42:24.217597] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-27T18:42:24.414937] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-27T18:42:25.215002] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-27T18:42:25.789843] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-27T18:42:26.014947] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-27T18:42:26.135369] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-27T18:42:26.814980] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-27T18:42:26.955239] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-27T18:42:27.285021] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T18:42:27.614961] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-27T18:42:28.415010] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-27T18:42:28.753012] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-27T18:42:28.904339] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-27T18:42:29.214978] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-27T18:42:30.015075] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-27T18:42:30.814925] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-27T18:42:30.876310] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T18:42:31.055202] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-10-27T18:42:31.319961] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T18:42:31.614937] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-27T18:42:32.270572] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-27T18:42:32.283802] [INFO ] [REMOTE ] FAF: Full fetch complete (58433 records). [2025-10-27T18:42:32.284114] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-27T18:42:32.420203] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-27T18:42:32.803100] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-27T18:42:32.803263] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-27T18:42:32.804798] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-27T18:42:32.804981] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-27T18:42:32.807140] [DEBUG] [LOCAL ] FAF: Trimmed 58433 records to 41263 (keeping 200 days of data) [2025-10-27T18:42:32.943891] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T18:42:33.130306] [DEBUG] [LOCAL ] FAF: Primary data saved (41263 records). [2025-10-27T18:42:33.130502] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-27T18:42:33.130608] [INFO ] [MAIN ] Update Progress: 801/2366 symbols completed. FAF took 23.8s. Estimated remaining: 3h 20m 16s. Rate: 7.8 symbols/min [2025-10-27T18:42:33.220076] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-27T18:42:33.314325] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:42:33.366491] [DEBUG] [LOCAL ] FBIN: Loaded 51100 existing records from primary storage. [2025-10-27T18:42:33.367051] [INFO ] [MAIN ] FBIN: Loaded 51100 existing records. [2025-10-27T18:42:33.557889] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:42:33.558139] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-27T18:42:33.558192] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-27T18:42:33.559145] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-27T18:42:33.559209] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-27T18:42:33.933173] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:42:33.963163] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T18:42:33.972417] [INFO ] [REMOTE ] EXR: Full fetch complete (65781 records). [2025-10-27T18:42:33.972530] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-27T18:42:33.973378] [FATAL] [VALIDATOR ] EXR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:42:33.973468] [FATAL] [MAIN ] EXR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:42:33.973533] [WARN ] [MAIN ] EXR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:42:33.973575] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-27T18:42:33.973634] [DEBUG] [LOCAL ] EXR: No primary data file found to delete. [2025-10-27T18:42:33.973711] [INFO ] [LOCAL ] EXR: Starting deletion of derivative data. [2025-10-27T18:42:33.973874] [DEBUG] [LOCAL ] EXR: Deleted derivative data file. [2025-10-27T18:42:33.973986] [INFO ] [MAIN ] Update Progress: 802/2366 symbols completed. EXR took 24.6s. Estimated remaining: 3h 19m 55s. Rate: 7.8 symbols/min [2025-10-27T18:42:34.020063] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-27T18:42:34.147868] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:42:34.178009] [DEBUG] [LOCAL ] FBK: Loaded 27741 existing records from primary storage. [2025-10-27T18:42:34.178412] [INFO ] [MAIN ] FBK: Loaded 27741 existing records. [2025-10-27T18:42:34.361277] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:42:34.361497] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-27T18:42:34.361545] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-27T18:42:34.362381] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-27T18:42:34.362704] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-27T18:42:34.752710] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:42:34.817302] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-27T18:42:34.823585] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-27T18:42:35.589818] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T18:42:35.614937] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-27T18:42:36.414935] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-27T18:42:36.522224] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-27T18:42:36.782436] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T18:42:37.214934] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-27T18:42:37.618042] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T18:42:38.014991] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-27T18:42:38.814975] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-27T18:42:39.049370] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-27T18:42:39.460866] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T18:42:39.614915] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-27T18:42:39.671557] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T18:42:40.414937] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-27T18:42:41.214962] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-27T18:42:41.380323] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-27T18:42:41.390262] [INFO ] [REMOTE ] EXPD: Full fetch complete (69019 records). [2025-10-27T18:42:41.390473] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-27T18:42:41.391688] [FATAL] [VALIDATOR ] EXPD: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:42:41.391811] [FATAL] [MAIN ] EXPD: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:42:41.391917] [WARN ] [MAIN ] EXPD: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:42:41.392007] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-27T18:42:41.392093] [DEBUG] [LOCAL ] EXPD: No primary data file found to delete. [2025-10-27T18:42:41.392138] [INFO ] [LOCAL ] EXPD: Starting deletion of derivative data. [2025-10-27T18:42:41.392304] [DEBUG] [LOCAL ] EXPD: Deleted derivative data file. [2025-10-27T18:42:41.392425] [INFO ] [MAIN ] Update Progress: 803/2366 symbols completed. EXPD took 32.0s. Estimated remaining: 3h 19m 47s. Rate: 7.8 symbols/min [2025-10-27T18:42:41.577110] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:42:41.627182] [DEBUG] [LOCAL ] FBP: Loaded 46291 existing records from primary storage. [2025-10-27T18:42:41.627847] [INFO ] [MAIN ] FBP: Loaded 46291 existing records. [2025-10-27T18:42:41.848110] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:42:41.848367] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-27T18:42:41.848427] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-27T18:42:41.849356] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-27T18:42:41.849414] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-27T18:42:42.017684] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-27T18:42:42.218793] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:42:42.230205] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T18:42:42.641177] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-27T18:42:42.814941] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-27T18:42:43.615335] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-27T18:42:43.621223] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T18:42:43.837374] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T18:42:43.847554] [INFO ] [REMOTE ] F: Full fetch complete (78000 records). [2025-10-27T18:42:43.847709] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-27T18:42:44.233431] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-27T18:42:44.233506] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-27T18:42:44.234393] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-27T18:42:44.234455] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-27T18:42:44.235889] [DEBUG] [LOCAL ] F: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-27T18:42:44.423356] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-27T18:42:44.581586] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-10-27T18:42:44.581763] [INFO ] [MAIN ] F: Full history saved. [2025-10-27T18:42:44.581910] [INFO ] [MAIN ] Update Progress: 804/2366 symbols completed. F took 35.2s. Estimated remaining: 3h 19m 31s. Rate: 7.8 symbols/min [2025-10-27T18:42:44.774064] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:42:44.771785] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-27T18:42:44.811986] [DEBUG] [LOCAL ] FBRT: Loaded 35665 existing records from primary storage. [2025-10-27T18:42:44.812247] [INFO ] [MAIN ] FBRT: Loaded 35665 existing records. [2025-10-27T18:42:44.988347] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:42:44.988576] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-27T18:42:44.988665] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-27T18:42:44.989297] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-27T18:42:44.989352] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-27T18:42:45.220038] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-27T18:42:45.372402] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:42:46.014920] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-27T18:42:46.110342] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-27T18:42:46.313425] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-27T18:42:46.814924] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-27T18:42:47.252790] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T18:42:47.624185] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-27T18:42:47.626402] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-27T18:42:48.415000] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-27T18:42:48.765452] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T18:42:49.214949] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-27T18:42:49.674734] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T18:42:50.014947] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-27T18:42:50.559931] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T18:42:50.814998] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-27T18:42:51.285570] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T18:42:51.614996] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-27T18:42:52.331745] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T18:42:52.414905] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-27T18:42:52.772356] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-27T18:42:53.188570] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-27T18:42:53.214892] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-27T18:42:54.014918] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-27T18:42:54.073340] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T18:42:54.814995] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-27T18:42:55.189042] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T18:42:55.614927] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-27T18:42:55.710107] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T18:42:56.414984] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-27T18:42:57.214917] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-27T18:42:57.318276] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-27T18:42:58.014947] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-27T18:42:58.430058] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-27T18:42:58.698021] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-27T18:42:58.704291] [INFO ] [REMOTE ] FBK: Full fetch complete (35680 records). [2025-10-27T18:42:58.704403] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-27T18:42:58.820048] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-27T18:42:59.075912] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-27T18:42:59.076031] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-27T18:42:59.076778] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-27T18:42:59.076861] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-27T18:42:59.077902] [DEBUG] [LOCAL ] FBK: Trimmed 35680 records to 27185 (keeping 200 days of data) [2025-10-27T18:42:59.235623] [DEBUG] [LOCAL ] FBK: Primary data saved (27185 records). [2025-10-27T18:42:59.235769] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-27T18:42:59.235903] [INFO ] [MAIN ] Update Progress: 805/2366 symbols completed. FBK took 25.3s. Estimated remaining: 3h 19m 37s. Rate: 7.8 symbols/min [2025-10-27T18:42:59.408965] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:42:59.422358] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T18:42:59.441059] [DEBUG] [LOCAL ] FC: Loaded 14480 existing records from primary storage. [2025-10-27T18:42:59.441278] [INFO ] [MAIN ] FC: Loaded 14480 existing records. [2025-10-27T18:42:59.611474] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:42:59.611675] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-27T18:42:59.611732] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-27T18:42:59.612028] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-27T18:42:59.612084] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-27T18:42:59.622979] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-27T18:42:59.963626] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:43:00.059841] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-27T18:43:00.414942] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-27T18:43:01.215035] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-27T18:43:01.390410] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-27T18:43:02.014913] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-27T18:43:02.362863] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-27T18:43:02.717439] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T18:43:02.814911] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-27T18:43:03.236691] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T18:43:03.614989] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-27T18:43:03.834140] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T18:43:04.414999] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-27T18:43:04.913045] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T18:43:05.149280] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T18:43:05.214932] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-27T18:43:06.014977] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-27T18:43:06.469682] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T18:43:06.814959] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-27T18:43:07.523507] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-27T18:43:07.532982] [INFO ] [REMOTE ] FBIN: Full fetch complete (72926 records). [2025-10-27T18:43:07.533165] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-27T18:43:07.623535] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-27T18:43:07.928472] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-27T18:43:07.928557] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-27T18:43:07.929605] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-27T18:43:07.929693] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-27T18:43:07.931071] [DEBUG] [LOCAL ] FBIN: Trimmed 72926 records to 50259 (keeping 200 days of data) [2025-10-27T18:43:08.231516] [DEBUG] [LOCAL ] FBIN: Primary data saved (50259 records). [2025-10-27T18:43:08.231638] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-27T18:43:08.232136] [INFO ] [MAIN ] Update Progress: 806/2366 symbols completed. FBIN took 35.1s. Estimated remaining: 3h 19m 31s. Rate: 7.8 symbols/min [2025-10-27T18:43:08.404615] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:43:08.414993] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-27T18:43:08.443088] [DEBUG] [LOCAL ] FCF: Loaded 39629 existing records from primary storage. [2025-10-27T18:43:08.443455] [INFO ] [MAIN ] FCF: Loaded 39629 existing records. [2025-10-27T18:43:08.614365] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-27T18:43:08.658323] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:43:08.658442] [INFO ] [REMOTE ] FBRT: Full fetch complete (49595 records). [2025-10-27T18:43:08.658626] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-27T18:43:08.658800] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-27T18:43:08.658874] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-27T18:43:08.691170] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-27T18:43:08.734913] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-27T18:43:09.459824] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-27T18:43:09.461187] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-27T18:43:09.484851] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-27T18:43:09.483892] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:43:09.485184] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-27T18:43:09.485507] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-27T18:43:09.488348] [DEBUG] [LOCAL ] FBRT: Trimmed 49595 records to 34825 (keeping 200 days of data) [2025-10-27T18:43:09.621224] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-27T18:43:09.625123] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-27T18:43:09.760077] [DEBUG] [LOCAL ] FBRT: Primary data saved (34825 records). [2025-10-27T18:43:09.760211] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-27T18:43:09.760292] [INFO ] [MAIN ] Update Progress: 807/2366 symbols completed. FBRT took 25.2s. Estimated remaining: 3h 19m 12s. Rate: 7.8 symbols/min [2025-10-27T18:43:09.931690] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:43:09.956964] [DEBUG] [LOCAL ] FCN: Loaded 26423 existing records from primary storage. [2025-10-27T18:43:09.957253] [INFO ] [MAIN ] FCN: Loaded 26423 existing records. [2025-10-27T18:43:10.020029] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-27T18:43:10.134821] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:43:10.135025] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-27T18:43:10.135089] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-27T18:43:10.135567] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-27T18:43:10.135624] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-27T18:43:10.477841] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:43:10.738046] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T18:43:10.814937] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-27T18:43:10.947639] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-27T18:43:11.614954] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-27T18:43:11.858783] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-27T18:43:12.414966] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-27T18:43:12.451352] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-27T18:43:13.214960] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-27T18:43:13.305768] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T18:43:14.014952] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-27T18:43:14.335085] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-27T18:43:14.814948] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-27T18:43:15.262126] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T18:43:15.614990] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-27T18:43:16.224897] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T18:43:16.414990] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-27T18:43:16.698104] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-27T18:43:17.214952] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-27T18:43:18.015045] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-27T18:43:18.353334] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-27T18:43:18.544269] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-27T18:43:18.815022] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-27T18:43:19.614994] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-27T18:43:19.747040] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-27T18:43:20.414964] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-27T18:43:20.778373] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-27T18:43:20.781248] [INFO ] [REMOTE ] FC: Full fetch complete (21860 records). [2025-10-27T18:43:20.781328] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-27T18:43:21.156543] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-27T18:43:21.156635] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-27T18:43:21.157221] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-27T18:43:21.157300] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-27T18:43:21.158142] [DEBUG] [LOCAL ] FC: Trimmed 21860 records to 13951 (keeping 200 days of data) [2025-10-27T18:43:21.230331] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T18:43:21.229288] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-27T18:43:21.260620] [DEBUG] [LOCAL ] FC: Primary data saved (13951 records). [2025-10-27T18:43:21.260791] [INFO ] [MAIN ] FC: Full history saved. [2025-10-27T18:43:21.260873] [INFO ] [MAIN ] Update Progress: 808/2366 symbols completed. FC took 22.0s. Estimated remaining: 3h 19m 12s. Rate: 7.8 symbols/min [2025-10-27T18:43:21.428280] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:43:21.461838] [DEBUG] [LOCAL ] FCPT: Loaded 37417 existing records from primary storage. [2025-10-27T18:43:21.462102] [INFO ] [MAIN ] FCPT: Loaded 37417 existing records. [2025-10-27T18:43:21.646149] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:43:21.646395] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-27T18:43:21.646450] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-27T18:43:21.646992] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-27T18:43:21.647051] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-27T18:43:22.017218] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-27T18:43:22.050254] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:43:22.080481] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T18:43:22.634552] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T18:43:22.814938] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-27T18:43:23.542900] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T18:43:23.614936] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-27T18:43:23.799095] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T18:43:24.390767] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T18:43:24.414985] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-27T18:43:25.215001] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-27T18:43:25.870311] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-27T18:43:26.014927] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-27T18:43:26.603898] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T18:43:26.802155] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-27T18:43:26.814898] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-27T18:43:27.614914] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-27T18:43:27.692093] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T18:43:28.414966] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-27T18:43:29.173759] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-27T18:43:29.214896] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-27T18:43:29.556981] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T18:43:30.014981] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-27T18:43:30.814925] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-27T18:43:31.032900] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-27T18:43:31.581333] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-27T18:43:31.590184] [INFO ] [REMOTE ] FBP: Full fetch complete (66763 records). [2025-10-27T18:43:31.590293] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-27T18:43:31.620918] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-27T18:43:31.973047] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-27T18:43:31.973121] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-27T18:43:31.973987] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-27T18:43:31.974084] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-27T18:43:31.975427] [DEBUG] [LOCAL ] FBP: Trimmed 66763 records to 45446 (keeping 200 days of data) [2025-10-27T18:43:32.237054] [DEBUG] [LOCAL ] FBP: Primary data saved (45446 records). [2025-10-27T18:43:32.237173] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-27T18:43:32.237843] [INFO ] [MAIN ] Update Progress: 809/2366 symbols completed. FBP took 50.8s. Estimated remaining: 3h 19m 10s. Rate: 7.8 symbols/min [2025-10-27T18:43:32.419221] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-27T18:43:32.410947] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:43:32.433944] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-27T18:43:32.434059] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-27T18:43:32.434187] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-27T18:43:32.434276] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-27T18:43:32.434559] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-27T18:43:32.434624] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-27T18:43:32.467544] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T18:43:32.796058] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:43:33.214964] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-27T18:43:33.278335] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-27T18:43:33.761218] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-27T18:43:33.994442] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T18:43:34.000071] [INFO ] [REMOTE ] FCN: Full fetch complete (36733 records). [2025-10-27T18:43:34.000169] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-27T18:43:34.021220] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-27T18:43:34.372125] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-27T18:43:34.372196] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-27T18:43:34.372773] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-27T18:43:34.372833] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-27T18:43:34.373585] [DEBUG] [LOCAL ] FCN: Trimmed 36733 records to 25826 (keeping 200 days of data) [2025-10-27T18:43:34.522756] [DEBUG] [LOCAL ] FCN: Primary data saved (25826 records). [2025-10-27T18:43:34.522876] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-27T18:43:34.522951] [INFO ] [MAIN ] Update Progress: 810/2366 symbols completed. FCN took 24.8s. Estimated remaining: 3h 18m 52s. Rate: 7.8 symbols/min [2025-10-27T18:43:34.631728] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-27T18:43:34.718922] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:43:34.736102] [DEBUG] [LOCAL ] FCT: Loaded 15148 existing records from primary storage. [2025-10-27T18:43:34.736330] [INFO ] [MAIN ] FCT: Loaded 15148 existing records. [2025-10-27T18:43:34.820093] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-27T18:43:34.916051] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:43:34.916250] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-27T18:43:34.916299] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-27T18:43:34.916545] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-27T18:43:34.916587] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-27T18:43:35.304431] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:43:35.614938] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-27T18:43:36.155317] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T18:43:36.414969] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-27T18:43:36.876704] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-27T18:43:37.214938] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-27T18:43:37.429989] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T18:43:38.014916] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-27T18:43:38.738749] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T18:43:38.814944] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-27T18:43:39.518713] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T18:43:39.614957] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-27T18:43:40.211384] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T18:43:40.414941] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-27T18:43:40.885561] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-27T18:43:41.214976] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-27T18:43:41.296409] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T18:43:41.305878] [INFO ] [REMOTE ] FCF: Full fetch complete (58054 records). [2025-10-27T18:43:41.306130] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-27T18:43:41.853038] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-27T18:43:41.853140] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-27T18:43:41.854272] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-27T18:43:41.854352] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-27T18:43:41.856042] [DEBUG] [LOCAL ] FCF: Trimmed 58054 records to 38757 (keeping 200 days of data) [2025-10-27T18:43:42.050021] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-27T18:43:42.115693] [DEBUG] [LOCAL ] FCF: Primary data saved (38757 records). [2025-10-27T18:43:42.116721] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-27T18:43:42.116862] [INFO ] [MAIN ] Update Progress: 811/2366 symbols completed. FCF took 33.9s. Estimated remaining: 3h 18m 45s. Rate: 7.8 symbols/min [2025-10-27T18:43:42.305231] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:43:42.354511] [DEBUG] [LOCAL ] FCX: Loaded 54481 existing records from primary storage. [2025-10-27T18:43:42.354957] [INFO ] [MAIN ] FCX: Loaded 54481 existing records. [2025-10-27T18:43:42.531726] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:43:42.532152] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-27T18:43:42.532229] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-27T18:43:42.532551] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-27T18:43:42.532690] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-27T18:43:42.652706] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T18:43:42.748098] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T18:43:42.820086] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-27T18:43:42.943633] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:43:43.614952] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-27T18:43:44.414926] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-27T18:43:44.671557] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-27T18:43:45.214911] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-27T18:43:45.354577] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T18:43:45.355431] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-27T18:43:46.014928] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-27T18:43:46.606779] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-27T18:43:46.782497] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-27T18:43:46.814916] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-27T18:43:47.614915] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-27T18:43:47.695670] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-27T18:43:48.414950] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-27T18:43:49.015923] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T18:43:49.214954] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-27T18:43:49.616595] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-27T18:43:49.836844] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T18:43:50.014954] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-27T18:43:50.605157] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-27T18:43:50.814931] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-27T18:43:51.614987] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-27T18:43:52.176514] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-27T18:43:52.184057] [INFO ] [REMOTE ] FCPT: Full fetch complete (53796 records). [2025-10-27T18:43:52.184216] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-27T18:43:52.420353] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-27T18:43:52.578377] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-27T18:43:52.578461] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-27T18:43:52.579285] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-27T18:43:52.579347] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-27T18:43:52.580438] [DEBUG] [LOCAL ] FCPT: Trimmed 53796 records to 36614 (keeping 200 days of data) [2025-10-27T18:43:52.689969] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T18:43:52.824191] [DEBUG] [LOCAL ] FCPT: Primary data saved (36614 records). [2025-10-27T18:43:52.824360] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-27T18:43:52.824455] [INFO ] [MAIN ] Update Progress: 812/2366 symbols completed. FCPT took 31.6s. Estimated remaining: 3h 18m 43s. Rate: 7.8 symbols/min [2025-10-27T18:43:53.005038] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:43:53.034389] [DEBUG] [LOCAL ] FDP: Loaded 30019 existing records from primary storage. [2025-10-27T18:43:53.034677] [INFO ] [MAIN ] FDP: Loaded 30019 existing records. [2025-10-27T18:43:53.207962] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:43:53.208226] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-27T18:43:53.208273] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-27T18:43:53.208447] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-27T18:43:53.208503] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-27T18:43:53.221048] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-27T18:43:53.562206] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:43:54.014950] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-27T18:43:54.196108] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T18:43:54.327435] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-27T18:43:54.814999] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-27T18:43:54.928331] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-27T18:43:55.614957] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-27T18:43:56.068136] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T18:43:56.414920] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-27T18:43:57.214979] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-27T18:43:57.300882] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T18:43:57.466435] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-27T18:43:57.633612] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-27T18:43:58.014972] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-27T18:43:58.357003] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-27T18:43:58.815017] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-27T18:43:59.614956] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-27T18:44:00.094216] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-27T18:44:00.095159] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-27T18:44:00.414962] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-27T18:44:01.214982] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-27T18:44:01.235799] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-27T18:44:02.014955] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-27T18:44:02.815045] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-27T18:44:03.494386] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-27T18:44:03.498447] [INFO ] [REMOTE ] FCT: Full fetch complete (21368 records). [2025-10-27T18:44:03.498545] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-27T18:44:03.499075] [FATAL] [VALIDATOR ] FCT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:44:03.499158] [FATAL] [MAIN ] FCT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:44:03.499203] [WARN ] [MAIN ] FCT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:44:03.499241] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-27T18:44:03.499295] [DEBUG] [LOCAL ] FCT: No primary data file found to delete. [2025-10-27T18:44:03.499328] [INFO ] [LOCAL ] FCT: Starting deletion of derivative data. [2025-10-27T18:44:03.499459] [DEBUG] [LOCAL ] FCT: Deleted derivative data file. [2025-10-27T18:44:03.499566] [INFO ] [MAIN ] Update Progress: 813/2366 symbols completed. FCT took 29.0s. Estimated remaining: 3h 18m 41s. Rate: 7.8 symbols/min [2025-10-27T18:44:03.619572] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-27T18:44:03.683022] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:44:03.711373] [DEBUG] [LOCAL ] FDS: Loaded 28600 existing records from primary storage. [2025-10-27T18:44:03.711634] [INFO ] [MAIN ] FDS: Loaded 28600 existing records. [2025-10-27T18:44:03.901730] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:44:03.901974] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-27T18:44:03.902031] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-27T18:44:03.908778] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-27T18:44:03.919523] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-27T18:44:03.952740] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-27T18:44:04.289340] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:44:04.327095] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T18:44:04.359893] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T18:44:04.360531] [INFO ] [REMOTE ] FCRX: Full fetch complete (1611 records). [2025-10-27T18:44:04.360598] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-27T18:44:04.424951] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-27T18:44:04.547279] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-27T18:44:04.547454] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:44:04.547521] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:44:04.547594] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-27T18:44:04.547681] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-27T18:44:04.547736] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-27T18:44:04.547779] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-27T18:44:04.547837] [INFO ] [MAIN ] Update Progress: 814/2366 symbols completed. FCRX took 32.3s. Estimated remaining: 3h 18m 20s. Rate: 7.8 symbols/min [2025-10-27T18:44:04.715292] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:44:04.765919] [DEBUG] [LOCAL ] FDX: Loaded 51851 existing records from primary storage. [2025-10-27T18:44:04.766241] [INFO ] [MAIN ] FDX: Loaded 51851 existing records. [2025-10-27T18:44:04.968155] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:44:04.968354] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-27T18:44:04.968400] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-27T18:44:04.968784] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-27T18:44:04.968842] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-27T18:44:05.222249] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-27T18:44:05.364683] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:44:06.014971] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-27T18:44:06.299848] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-27T18:44:06.639194] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-27T18:44:06.814985] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-27T18:44:07.556517] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-27T18:44:07.614921] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-27T18:44:08.414936] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-27T18:44:08.675895] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T18:44:08.906469] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-27T18:44:09.214955] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-27T18:44:09.457840] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-27T18:44:10.014942] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-27T18:44:10.814912] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-27T18:44:10.857476] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-27T18:44:11.614917] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-27T18:44:11.703547] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-27T18:44:11.777875] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-27T18:44:12.414963] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-27T18:44:12.760612] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-27T18:44:13.215049] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-27T18:44:14.014975] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-27T18:44:14.363603] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T18:44:14.415956] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-27T18:44:14.814948] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-27T18:44:14.978044] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T18:44:15.614963] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-27T18:44:16.414964] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-27T18:44:17.215007] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-27T18:44:17.709981] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T18:44:17.741006] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (2.93 seconds). [2025-10-27T18:44:17.750808] [INFO ] [REMOTE ] FCX: Full fetch complete (77488 records). [2025-10-27T18:44:17.750934] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-27T18:44:17.751733] [FATAL] [VALIDATOR ] FCX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:44:17.751832] [FATAL] [MAIN ] FCX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:44:17.751910] [WARN ] [MAIN ] FCX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:44:17.751997] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-27T18:44:17.752073] [DEBUG] [LOCAL ] FCX: No primary data file found to delete. [2025-10-27T18:44:17.752112] [INFO ] [LOCAL ] FCX: Starting deletion of derivative data. [2025-10-27T18:44:17.752449] [DEBUG] [LOCAL ] FCX: Deleted derivative data file. [2025-10-27T18:44:17.753007] [INFO ] [MAIN ] Update Progress: 815/2366 symbols completed. FCX took 35.6s. Estimated remaining: 3h 18m 23s. Rate: 7.8 symbols/min [2025-10-27T18:44:17.931246] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:44:18.013452] [DEBUG] [LOCAL ] FE: Loaded 54210 existing records from primary storage. [2025-10-27T18:44:18.014461] [INFO ] [MAIN ] FE: Loaded 54210 existing records. [2025-10-27T18:44:18.015546] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-27T18:44:18.015664] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-27T18:44:18.227437] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:44:18.228092] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-27T18:44:18.228163] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-27T18:44:18.228884] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-27T18:44:18.228941] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-27T18:44:18.588771] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:44:18.609255] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-27T18:44:18.814913] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-27T18:44:19.412119] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T18:44:19.615006] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-27T18:44:20.414981] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-27T18:44:20.451990] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-27T18:44:20.839052] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T18:44:21.214942] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-27T18:44:22.005976] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-27T18:44:22.014897] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-27T18:44:22.315758] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-27T18:44:22.814997] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-27T18:44:23.100830] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T18:44:23.614924] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-27T18:44:23.792898] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T18:44:24.414933] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-27T18:44:25.214986] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-27T18:44:25.256016] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-27T18:44:25.731547] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-27T18:44:26.015000] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-27T18:44:26.532211] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T18:44:26.814954] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-27T18:44:27.040677] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T18:44:27.045989] [INFO ] [REMOTE ] FDP: Full fetch complete (42804 records). [2025-10-27T18:44:27.046089] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-27T18:44:27.421106] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-27T18:44:27.421184] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-27T18:44:27.421887] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-27T18:44:27.421949] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-27T18:44:27.422856] [DEBUG] [LOCAL ] FDP: Trimmed 42804 records to 29418 (keeping 200 days of data) [2025-10-27T18:44:27.596994] [DEBUG] [LOCAL ] FDP: Primary data saved (29418 records). [2025-10-27T18:44:27.597127] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-27T18:44:27.597234] [INFO ] [MAIN ] Update Progress: 816/2366 symbols completed. FDP took 34.8s. Estimated remaining: 3h 18m 20s. Rate: 7.8 symbols/min [2025-10-27T18:44:27.620083] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-27T18:44:27.770717] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:44:27.770942] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-27T18:44:27.770986] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-27T18:44:27.771094] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-27T18:44:27.771137] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-27T18:44:27.771178] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-27T18:44:27.771210] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-27T18:44:28.116541] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:44:28.414972] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-27T18:44:28.946390] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-27T18:44:29.215021] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-27T18:44:29.640277] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-27T18:44:30.014988] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-27T18:44:30.174524] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-27T18:44:30.182327] [INFO ] [REMOTE ] FDS: Full fetch complete (39749 records). [2025-10-27T18:44:30.182411] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-27T18:44:30.553285] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-27T18:44:30.553445] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-27T18:44:30.554108] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-27T18:44:30.554169] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-27T18:44:30.555035] [DEBUG] [LOCAL ] FDS: Trimmed 39749 records to 28149 (keeping 200 days of data) [2025-10-27T18:44:30.646517] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-27T18:44:30.731718] [DEBUG] [LOCAL ] FDS: Primary data saved (28149 records). [2025-10-27T18:44:30.731857] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-27T18:44:30.731937] [INFO ] [MAIN ] Update Progress: 817/2366 symbols completed. FDS took 27.2s. Estimated remaining: 3h 18m 3s. Rate: 7.8 symbols/min [2025-10-27T18:44:30.820473] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-27T18:44:30.902738] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:44:30.949873] [DEBUG] [LOCAL ] FERG: Loaded 49424 existing records from primary storage. [2025-10-27T18:44:30.950180] [INFO ] [MAIN ] FERG: Loaded 49424 existing records. [2025-10-27T18:44:31.136496] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:44:31.136838] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-27T18:44:31.136996] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-27T18:44:31.137614] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-27T18:44:31.137722] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-27T18:44:31.266865] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-27T18:44:31.282547] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-27T18:44:31.566418] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:44:31.614942] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-27T18:44:32.042144] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-27T18:44:32.414929] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-27T18:44:32.876892] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-27T18:44:33.215006] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-27T18:44:33.656567] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-27T18:44:34.014941] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-27T18:44:34.815002] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-27T18:44:35.614924] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-27T18:44:35.845447] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-27T18:44:36.414924] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-27T18:44:36.694590] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-27T18:44:37.106119] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T18:44:37.214956] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-27T18:44:37.659609] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-27T18:44:38.020041] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-27T18:44:38.033496] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-27T18:44:38.814938] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-27T18:44:39.614932] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-27T18:44:39.697071] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-27T18:44:40.131515] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-27T18:44:40.414916] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-27T18:44:40.517447] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-27T18:44:41.012534] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T18:44:41.214917] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-27T18:44:41.830778] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-27T18:44:42.014927] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-27T18:44:42.815008] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-27T18:44:43.313019] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-27T18:44:43.313847] [INFO ] [REMOTE ] FENG: Full fetch complete (2253 records). [2025-10-27T18:44:43.313931] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-27T18:44:43.314323] [FATAL] [VALIDATOR ] FENG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:44:43.314406] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:44:43.314475] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:44:43.314547] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-27T18:44:43.314609] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-27T18:44:43.314671] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-27T18:44:43.314739] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-27T18:44:43.314796] [INFO ] [MAIN ] Update Progress: 818/2366 symbols completed. FENG took 15.7s. Estimated remaining: 3h 18m 5s. Rate: 7.8 symbols/min [2025-10-27T18:44:43.490839] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:44:43.504780] [DEBUG] [LOCAL ] FET: Loaded 13196 existing records from primary storage. [2025-10-27T18:44:43.505010] [INFO ] [MAIN ] FET: Loaded 13196 existing records. [2025-10-27T18:44:43.620121] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-27T18:44:43.680562] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:44:43.680741] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-27T18:44:43.680792] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-27T18:44:43.681009] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-27T18:44:43.681056] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-27T18:44:44.032505] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:44:44.288582] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-27T18:44:44.414909] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-27T18:44:45.214970] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-27T18:44:46.015057] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-27T18:44:46.144052] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T18:44:46.255012] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-27T18:44:46.328213] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-27T18:44:46.814944] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-27T18:44:47.614944] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-27T18:44:47.957140] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T18:44:48.223278] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-27T18:44:48.414930] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-27T18:44:49.214952] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-27T18:44:49.470177] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-27T18:44:49.480175] [INFO ] [REMOTE ] FDX: Full fetch complete (74152 records). [2025-10-27T18:44:49.480337] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-27T18:44:49.877791] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-27T18:44:49.877934] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-27T18:44:49.878988] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-27T18:44:49.879101] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-27T18:44:49.880847] [DEBUG] [LOCAL ] FDX: Trimmed 74152 records to 51063 (keeping 200 days of data) [2025-10-27T18:44:50.021300] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-27T18:44:50.015075] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-27T18:44:50.246736] [DEBUG] [LOCAL ] FDX: Primary data saved (51063 records). [2025-10-27T18:44:50.246893] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-27T18:44:50.247753] [INFO ] [MAIN ] Update Progress: 819/2366 symbols completed. FDX took 45.7s. Estimated remaining: 3h 17m 56s. Rate: 7.8 symbols/min [2025-10-27T18:44:50.412081] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:44:50.435203] [DEBUG] [LOCAL ] FF: Loaded 23887 existing records from primary storage. [2025-10-27T18:44:50.435437] [INFO ] [MAIN ] FF: Loaded 23887 existing records. [2025-10-27T18:44:50.610392] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:44:50.610725] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-27T18:44:50.610779] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-27T18:44:50.610953] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-27T18:44:50.611011] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-27T18:44:50.819732] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-27T18:44:50.972193] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:44:51.024693] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T18:44:51.030570] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-27T18:44:51.614952] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-27T18:44:52.414953] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-27T18:44:52.626994] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-27T18:44:52.673165] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-27T18:44:53.214944] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-27T18:44:53.600583] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T18:44:53.969488] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-27T18:44:54.014902] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-27T18:44:54.814958] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-27T18:44:54.860626] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-27T18:44:55.614990] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-27T18:44:56.415017] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-27T18:44:56.448109] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T18:44:57.214988] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-27T18:44:57.251898] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T18:44:57.517917] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T18:44:58.014912] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-27T18:44:58.357887] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T18:44:58.814920] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-27T18:44:58.932689] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T18:44:59.614952] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-27T18:45:00.265481] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T18:45:00.414917] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-27T18:45:00.529920] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-27T18:45:01.214958] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-27T18:45:02.014983] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-27T18:45:02.302941] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-27T18:45:02.814979] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-27T18:45:03.375813] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T18:45:03.614969] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-27T18:45:04.099562] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-27T18:45:04.102854] [INFO ] [REMOTE ] FET: Full fetch complete (18629 records). [2025-10-27T18:45:04.102967] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-27T18:45:04.419397] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-27T18:45:04.488686] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-27T18:45:04.504876] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-27T18:45:04.515889] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-27T18:45:04.516007] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-27T18:45:04.518055] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (3.30 seconds). [2025-10-27T18:45:04.518441] [DEBUG] [LOCAL ] FET: Trimmed 18629 records to 12924 (keeping 200 days of data) [2025-10-27T18:45:04.529892] [INFO ] [REMOTE ] FE: Full fetch complete (77494 records). [2025-10-27T18:45:04.559154] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-27T18:45:04.708312] [DEBUG] [LOCAL ] FET: Primary data saved (12924 records). [2025-10-27T18:45:04.714248] [INFO ] [MAIN ] FET: Full history saved. [2025-10-27T18:45:04.724687] [INFO ] [MAIN ] Update Progress: 820/2366 symbols completed. FET took 21.4s. Estimated remaining: 3h 18m 1s. Rate: 7.8 symbols/min [2025-10-27T18:45:05.104360] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:45:05.206428] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-27T18:45:05.210046] [DEBUG] [LOCAL ] FFA: Loaded 5642 existing records from primary storage. [2025-10-27T18:45:05.227795] [INFO ] [MAIN ] FFA: Loaded 5642 existing records. [2025-10-27T18:45:05.227555] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-27T18:45:05.241403] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T18:45:05.229397] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-27T18:45:05.291981] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-27T18:45:05.292275] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-27T18:45:05.341250] [DEBUG] [LOCAL ] FE: Trimmed 77494 records to 53430 (keeping 200 days of data) [2025-10-27T18:45:05.550216] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:45:05.550441] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-27T18:45:05.550488] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-27T18:45:05.550753] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-27T18:45:05.550823] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-27T18:45:06.108509] [DEBUG] [LOCAL ] FE: Primary data saved (53430 records). [2025-10-27T18:45:06.128274] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:45:06.128821] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-27T18:45:06.128542] [INFO ] [MAIN ] FE: Full history saved. [2025-10-27T18:45:06.129328] [INFO ] [MAIN ] Update Progress: 821/2366 symbols completed. FE took 48.4s. Estimated remaining: 3h 17m 42s. Rate: 7.8 symbols/min [2025-10-27T18:45:06.311329] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:45:06.330154] [DEBUG] [LOCAL ] FFC: Loaded 16845 existing records from primary storage. [2025-10-27T18:45:06.330387] [INFO ] [MAIN ] FFC: Loaded 16845 existing records. [2025-10-27T18:45:06.514157] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:45:06.514806] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-27T18:45:06.515111] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-27T18:45:06.515353] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-27T18:45:06.515408] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-27T18:45:06.734075] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T18:45:06.804884] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-27T18:45:06.820070] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-27T18:45:06.879065] [INFO ] [REMOTE ] FERG: Full fetch complete (71226 records). [2025-10-27T18:45:06.879305] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-27T18:45:07.068844] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:45:07.113134] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T18:45:07.395606] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-27T18:45:07.395735] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-27T18:45:07.396864] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-27T18:45:07.396941] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-27T18:45:07.398729] [DEBUG] [LOCAL ] FERG: Trimmed 71226 records to 48610 (keeping 200 days of data) [2025-10-27T18:45:07.626937] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-27T18:45:07.725451] [DEBUG] [LOCAL ] FERG: Primary data saved (48610 records). [2025-10-27T18:45:07.725590] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-27T18:45:07.725694] [INFO ] [MAIN ] Update Progress: 822/2366 symbols completed. FERG took 37.0s. Estimated remaining: 3h 17m 23s. Rate: 7.8 symbols/min [2025-10-27T18:45:07.899049] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:45:07.915966] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T18:45:07.951718] [DEBUG] [LOCAL ] FFWM: Loaded 36144 existing records from primary storage. [2025-10-27T18:45:07.951990] [INFO ] [MAIN ] FFWM: Loaded 36144 existing records. [2025-10-27T18:45:08.135794] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:45:08.136014] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-27T18:45:08.136077] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-27T18:45:08.136377] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-27T18:45:08.136434] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-27T18:45:08.424473] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-27T18:45:08.517480] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:45:08.642020] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T18:45:09.064752] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T18:45:09.214994] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-27T18:45:09.620466] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-27T18:45:10.014937] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-27T18:45:10.814946] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-27T18:45:10.865570] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T18:45:11.614939] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-27T18:45:11.803372] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-27T18:45:12.366553] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-27T18:45:12.414909] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-27T18:45:12.982027] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T18:45:13.214989] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-27T18:45:14.014980] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-27T18:45:14.676744] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-27T18:45:14.814923] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-27T18:45:14.983226] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-27T18:45:15.614946] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-27T18:45:15.737203] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T18:45:16.414977] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-27T18:45:16.616231] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-27T18:45:17.165330] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T18:45:17.214920] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-27T18:45:18.014927] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-27T18:45:18.103412] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-27T18:45:18.683029] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-27T18:45:18.814950] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-27T18:45:19.614957] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-27T18:45:20.123854] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-27T18:45:20.238985] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-27T18:45:20.415007] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-27T18:45:21.111448] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-27T18:45:21.214984] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-27T18:45:21.906349] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-27T18:45:22.015037] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-27T18:45:22.814971] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-27T18:45:23.014132] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-27T18:45:23.615002] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-27T18:45:24.005069] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T18:45:24.414993] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-27T18:45:24.775766] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-27T18:45:24.780247] [INFO ] [REMOTE ] FF: Full fetch complete (36243 records). [2025-10-27T18:45:24.780399] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-27T18:45:25.223452] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-27T18:45:25.225985] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-27T18:45:25.226692] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-27T18:45:25.227422] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-27T18:45:25.227562] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-27T18:45:25.228532] [DEBUG] [LOCAL ] FF: Trimmed 36243 records to 23163 (keeping 200 days of data) [2025-10-27T18:45:25.361786] [DEBUG] [LOCAL ] FF: Primary data saved (23163 records). [2025-10-27T18:45:25.361908] [INFO ] [MAIN ] FF: Full history saved. [2025-10-27T18:45:25.361980] [INFO ] [MAIN ] Update Progress: 823/2366 symbols completed. FF took 35.1s. Estimated remaining: 3h 17m 34s. Rate: 7.8 symbols/min [2025-10-27T18:45:25.531123] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:45:25.551608] [DEBUG] [LOCAL ] FG: Loaded 21546 existing records from primary storage. [2025-10-27T18:45:25.551893] [INFO ] [MAIN ] FG: Loaded 21546 existing records. [2025-10-27T18:45:25.666845] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-27T18:45:25.748522] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:45:25.748747] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-27T18:45:25.748799] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-27T18:45:25.748985] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-27T18:45:25.749040] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-27T18:45:26.018673] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-27T18:45:26.106447] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:45:26.107548] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-27T18:45:26.814955] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-27T18:45:27.320292] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T18:45:27.322187] [INFO ] [REMOTE ] FFA: Full fetch complete (8599 records). [2025-10-27T18:45:27.322349] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-27T18:45:27.438622] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T18:45:27.622154] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-27T18:45:27.705064] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-27T18:45:27.705132] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-27T18:45:27.705337] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-27T18:45:27.705373] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-27T18:45:27.705789] [DEBUG] [LOCAL ] FFA: Trimmed 8599 records to 5303 (keeping 200 days of data) [2025-10-27T18:45:27.736742] [DEBUG] [LOCAL ] FFA: Primary data saved (5303 records). [2025-10-27T18:45:27.736858] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-27T18:45:27.736944] [INFO ] [MAIN ] Update Progress: 824/2366 symbols completed. FFA took 23.0s. Estimated remaining: 3h 17m 16s. Rate: 7.8 symbols/min [2025-10-27T18:45:27.901404] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:45:27.906479] [DEBUG] [LOCAL ] FGN: Loaded 3584 existing records from primary storage. [2025-10-27T18:45:27.906729] [INFO ] [MAIN ] FGN: Loaded 3584 existing records. [2025-10-27T18:45:28.082878] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:45:28.083123] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-27T18:45:28.083173] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-27T18:45:28.083360] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-27T18:45:28.083415] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-27T18:45:28.266523] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-27T18:45:28.420097] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-27T18:45:28.448921] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:45:29.044224] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-27T18:45:29.214937] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-27T18:45:30.014913] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-27T18:45:30.753683] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-27T18:45:30.780563] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-27T18:45:30.814928] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-27T18:45:31.348426] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-27T18:45:31.614946] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-27T18:45:32.088192] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-27T18:45:32.414958] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-27T18:45:33.214932] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-27T18:45:33.744714] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T18:45:33.985542] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-27T18:45:34.014903] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-27T18:45:34.814910] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-27T18:45:35.091776] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T18:45:35.614945] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-27T18:45:36.137811] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T18:45:36.414985] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-27T18:45:36.756375] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T18:45:36.759858] [INFO ] [REMOTE ] FFC: Full fetch complete (24467 records). [2025-10-27T18:45:36.759935] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-27T18:45:37.118948] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-27T18:45:37.119026] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-27T18:45:37.119809] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-27T18:45:37.119871] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-27T18:45:37.120505] [DEBUG] [LOCAL ] FFC: Trimmed 24467 records to 16365 (keeping 200 days of data) [2025-10-27T18:45:37.214985] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-27T18:45:37.220783] [DEBUG] [LOCAL ] FFC: Primary data saved (16365 records). [2025-10-27T18:45:37.221680] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-27T18:45:37.221793] [INFO ] [MAIN ] Update Progress: 825/2366 symbols completed. FFC took 31.1s. Estimated remaining: 3h 17m 12s. Rate: 7.8 symbols/min [2025-10-27T18:45:37.387106] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:45:37.387301] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-27T18:45:37.387338] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-27T18:45:37.387447] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-27T18:45:37.387489] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-27T18:45:37.387529] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-27T18:45:37.387562] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-27T18:45:37.699826] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T18:45:37.757352] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:45:38.014942] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-10-27T18:45:38.683929] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T18:45:38.691018] [INFO ] [REMOTE ] FFWM: Full fetch complete (51929 records). [2025-10-27T18:45:38.691155] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-27T18:45:38.820190] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-27T18:45:39.002484] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-27T18:45:39.107197] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-27T18:45:39.107263] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-27T18:45:39.107965] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-27T18:45:39.108026] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-27T18:45:39.109003] [DEBUG] [LOCAL ] FFWM: Trimmed 51929 records to 35352 (keeping 200 days of data) [2025-10-27T18:45:39.297181] [DEBUG] [LOCAL ] FFWM: Primary data saved (35352 records). [2025-10-27T18:45:39.297315] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-27T18:45:39.297393] [INFO ] [MAIN ] Update Progress: 826/2366 symbols completed. FFWM took 31.6s. Estimated remaining: 3h 16m 53s. Rate: 7.8 symbols/min [2025-10-27T18:45:39.465334] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:45:39.502016] [DEBUG] [LOCAL ] FHI: Loaded 39980 existing records from primary storage. [2025-10-27T18:45:39.502292] [INFO ] [MAIN ] FHI: Loaded 39980 existing records. [2025-10-27T18:45:39.620071] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-10-27T18:45:39.683845] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:45:39.684060] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-27T18:45:39.684108] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-27T18:45:39.684402] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-27T18:45:39.684442] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-27T18:45:40.034050] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:45:40.041878] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-27T18:45:40.141534] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T18:45:40.414929] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-27T18:45:41.214976] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-10-27T18:45:41.672736] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-27T18:45:42.014909] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-27T18:45:42.105931] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-27T18:45:42.814992] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-27T18:45:43.198639] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T18:45:43.614944] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-27T18:45:43.623525] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T18:45:44.414989] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-27T18:45:44.999432] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-27T18:45:45.214924] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-27T18:45:45.374392] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-27T18:45:45.859305] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-27T18:45:46.014994] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-27T18:45:46.386135] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-27T18:45:46.814948] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-10-27T18:45:47.531046] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-27T18:45:47.614936] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-27T18:45:48.414941] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-27T18:45:48.949618] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-27T18:45:49.028268] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T18:45:49.214941] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-27T18:45:50.014951] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-10-27T18:45:50.814947] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-27T18:45:50.891003] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-27T18:45:51.205499] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-27T18:45:51.391152] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-27T18:45:51.614935] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-27T18:45:52.414963] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-27T18:45:52.861602] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T18:45:53.214951] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-27T18:45:53.534636] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T18:45:53.991607] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-27T18:45:54.014938] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-27T18:45:54.814993] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-10-27T18:45:54.992542] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T18:45:55.220150] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-27T18:45:55.614976] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-27T18:45:56.194011] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-27T18:45:56.414951] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-27T18:45:57.214916] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-27T18:45:57.519095] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T18:45:57.735006] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T18:45:57.736016] [INFO ] [REMOTE ] FGN: Full fetch complete (5405 records). [2025-10-27T18:45:57.736083] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-27T18:45:57.736474] [FATAL] [VALIDATOR ] FGN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:45:57.736556] [FATAL] [MAIN ] FGN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:45:57.736599] [WARN ] [MAIN ] FGN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:45:57.736638] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-27T18:45:57.736741] [DEBUG] [LOCAL ] FGN: No primary data file found to delete. [2025-10-27T18:45:57.736778] [INFO ] [LOCAL ] FGN: Starting deletion of derivative data. [2025-10-27T18:45:57.736989] [DEBUG] [LOCAL ] FGN: Deleted derivative data file. [2025-10-27T18:45:57.737081] [INFO ] [MAIN ] Update Progress: 827/2366 symbols completed. FGN took 30.0s. Estimated remaining: 3h 17m 6s. Rate: 7.8 symbols/min [2025-10-27T18:45:57.907112] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:45:57.955587] [DEBUG] [LOCAL ] FHN: Loaded 54179 existing records from primary storage. [2025-10-27T18:45:57.955943] [INFO ] [MAIN ] FHN: Loaded 54179 existing records. [2025-10-27T18:45:58.020137] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-27T18:45:58.134196] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:45:58.134417] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-27T18:45:58.134471] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-27T18:45:58.134726] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-27T18:45:58.134783] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-27T18:45:58.480734] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:45:58.814973] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-27T18:45:59.456347] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T18:45:59.614989] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-27T18:46:00.385401] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-27T18:46:00.414899] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-27T18:46:00.642431] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-27T18:46:01.214976] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-27T18:46:02.014923] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-27T18:46:02.185372] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-27T18:46:02.189882] [INFO ] [REMOTE ] FG: Full fetch complete (28993 records). [2025-10-27T18:46:02.190043] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-27T18:46:02.558923] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-27T18:46:02.558996] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-27T18:46:02.559510] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-27T18:46:02.559549] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-27T18:46:02.560395] [DEBUG] [LOCAL ] FG: Trimmed 28993 records to 20750 (keeping 200 days of data) [2025-10-27T18:46:02.690677] [DEBUG] [LOCAL ] FG: Primary data saved (20750 records). [2025-10-27T18:46:02.690818] [INFO ] [MAIN ] FG: Full history saved. [2025-10-27T18:46:02.690904] [INFO ] [MAIN ] Update Progress: 828/2366 symbols completed. FG took 37.3s. Estimated remaining: 3h 16m 53s. Rate: 7.8 symbols/min [2025-10-27T18:46:02.820062] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-10-27T18:46:02.881791] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:46:02.939378] [DEBUG] [LOCAL ] FI: Loaded 54355 existing records from primary storage. [2025-10-27T18:46:02.939793] [INFO ] [MAIN ] FI: Loaded 54355 existing records. [2025-10-27T18:46:03.120211] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:46:03.120865] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-27T18:46:03.121130] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-27T18:46:03.121899] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-27T18:46:03.121958] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-27T18:46:03.379264] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-27T18:46:03.451192] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-27T18:46:03.544229] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T18:46:03.563995] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:46:03.614899] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-27T18:46:04.415008] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-10-27T18:46:04.771452] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-27T18:46:05.214993] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-27T18:46:05.566337] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-27T18:46:06.014947] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-27T18:46:06.814982] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-10-27T18:46:06.988562] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-27T18:46:07.178602] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-27T18:46:07.522022] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T18:46:07.614960] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-27T18:46:08.414961] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-27T18:46:09.008533] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-27T18:46:09.215012] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-10. [2025-10-27T18:46:09.823694] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T18:46:09.825126] [INFO ] [REMOTE ] FGSN: Full fetch complete (8140 records). [2025-10-27T18:46:09.825221] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-10-27T18:46:10.023568] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-27T18:46:10.050025] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-27T18:46:10.050740] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:46:10.050883] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:46:10.050961] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-27T18:46:10.051147] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-27T18:46:10.051215] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-27T18:46:10.051262] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-27T18:46:10.051366] [INFO ] [MAIN ] Update Progress: 829/2366 symbols completed. FGSN took 32.8s. Estimated remaining: 3h 16m 45s. Rate: 7.8 symbols/min [2025-10-27T18:46:10.273828] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:46:10.319754] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-27T18:46:10.351593] [DEBUG] [LOCAL ] FICO: Loaded 22292 existing records from primary storage. [2025-10-27T18:46:10.352001] [INFO ] [MAIN ] FICO: Loaded 22292 existing records. [2025-10-27T18:46:10.531633] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:46:10.531878] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-27T18:46:10.531924] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-27T18:46:10.532141] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-27T18:46:10.532197] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-27T18:46:10.820111] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-27T18:46:10.879614] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:46:11.475742] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T18:46:11.614952] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-27T18:46:12.279706] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T18:46:12.421941] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-27T18:46:12.425346] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T18:46:13.214965] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-27T18:46:13.942630] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T18:46:14.014953] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-27T18:46:14.773634] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-27T18:46:14.780579] [INFO ] [REMOTE ] FHI: Full fetch complete (57411 records). [2025-10-27T18:46:14.780710] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-27T18:46:14.820115] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-27T18:46:15.189180] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-27T18:46:15.189268] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-27T18:46:15.190082] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-27T18:46:15.190142] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-27T18:46:15.191283] [DEBUG] [LOCAL ] FHI: Trimmed 57411 records to 39290 (keeping 200 days of data) [2025-10-27T18:46:15.431381] [DEBUG] [LOCAL ] FHI: Primary data saved (39290 records). [2025-10-27T18:46:15.431502] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-27T18:46:15.431576] [INFO ] [MAIN ] Update Progress: 830/2366 symbols completed. FHI took 36.1s. Estimated remaining: 3h 16m 33s. Rate: 7.8 symbols/min [2025-10-27T18:46:15.609411] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:46:15.609669] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-27T18:46:15.609724] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-27T18:46:15.609834] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-27T18:46:15.609874] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-27T18:46:15.609914] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-27T18:46:15.609945] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-27T18:46:15.643859] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-27T18:46:16.003269] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:46:16.010136] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-27T18:46:16.043371] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-27T18:46:16.414938] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-27T18:46:17.196551] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-27T18:46:17.214909] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-27T18:46:17.568541] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-27T18:46:18.014975] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-27T18:46:18.320264] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-27T18:46:18.587092] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-27T18:46:18.814946] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-27T18:46:19.614929] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-27T18:46:19.881460] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-27T18:46:20.414999] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-27T18:46:20.924767] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T18:46:21.214957] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-27T18:46:21.329707] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T18:46:21.616035] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-27T18:46:22.014937] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-27T18:46:22.814953] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-27T18:46:23.614981] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-27T18:46:23.669031] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-27T18:46:23.949689] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T18:46:24.022555] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-27T18:46:24.414920] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-27T18:46:25.214962] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-27T18:46:26.014929] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-27T18:46:26.081683] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-27T18:46:26.091899] [INFO ] [REMOTE ] FHN: Full fetch complete (77481 records). [2025-10-27T18:46:26.092036] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-27T18:46:26.365994] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-27T18:46:26.511190] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-27T18:46:26.511755] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-27T18:46:26.512328] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T18:46:26.518692] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-27T18:46:26.519213] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-27T18:46:26.520554] [DEBUG] [LOCAL ] FHN: Trimmed 77481 records to 53398 (keeping 200 days of data) [2025-10-27T18:46:26.815995] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-27T18:46:26.835728] [DEBUG] [LOCAL ] FHN: Primary data saved (53398 records). [2025-10-27T18:46:26.835810] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-27T18:46:26.835881] [INFO ] [MAIN ] Update Progress: 831/2366 symbols completed. FHN took 29.1s. Estimated remaining: 3h 16m 32s. Rate: 7.8 symbols/min [2025-10-27T18:46:27.003522] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:46:27.045090] [DEBUG] [LOCAL ] FIGS: Loaded 49150 existing records from primary storage. [2025-10-27T18:46:27.045396] [INFO ] [MAIN ] FIGS: Loaded 49150 existing records. [2025-10-27T18:46:27.220905] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:46:27.221113] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-27T18:46:27.221180] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-27T18:46:27.221365] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-27T18:46:27.221403] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-27T18:46:27.565237] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:46:27.614930] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-27T18:46:28.414965] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-27T18:46:28.742074] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-27T18:46:28.744793] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-27T18:46:29.186368] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T18:46:29.214903] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-27T18:46:30.014939] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-27T18:46:30.217270] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T18:46:30.217627] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-27T18:46:30.217732] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T18:46:30.217804] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-27T18:46:30.217868] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T18:46:30.217934] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-27T18:46:30.217998] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-27T18:46:30.218032] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-27T18:46:30.218070] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-27T18:46:30.218114] [INFO ] [MAIN ] Update Progress: 832/2366 symbols completed. FIG took 14.8s. Estimated remaining: 3h 16m 16s. Rate: 7.8 symbols/min [2025-10-27T18:46:30.384672] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:46:30.422076] [DEBUG] [LOCAL ] FIHL: Loaded 39562 existing records from primary storage. [2025-10-27T18:46:30.422519] [INFO ] [MAIN ] FIHL: Loaded 39562 existing records. [2025-10-27T18:46:30.547736] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-27T18:46:30.635958] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:46:30.636163] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-27T18:46:30.636219] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-27T18:46:30.636522] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-27T18:46:30.636577] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-27T18:46:30.820235] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-27T18:46:31.002968] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:46:31.614935] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-27T18:46:32.414994] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-27T18:46:32.541996] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-27T18:46:33.214999] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-27T18:46:33.371056] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T18:46:33.397290] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T18:46:34.014928] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-27T18:46:34.607537] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T18:46:34.814990] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-27T18:46:35.614925] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-27T18:46:35.809048] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-27T18:46:36.003999] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T18:46:36.414898] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-27T18:46:36.448954] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T18:46:37.214986] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-27T18:46:38.014965] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-27T18:46:38.448930] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-27T18:46:38.785189] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-27T18:46:38.814901] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-27T18:46:38.945918] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T18:46:39.614920] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-27T18:46:40.373867] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-27T18:46:40.384595] [INFO ] [REMOTE ] FI: Full fetch complete (77498 records). [2025-10-27T18:46:40.384804] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-27T18:46:40.420229] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-27T18:46:40.783181] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-27T18:46:40.816740] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-27T18:46:40.817189] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-27T18:46:40.818204] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-27T18:46:40.818268] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-27T18:46:40.819601] [DEBUG] [LOCAL ] FI: Trimmed 77498 records to 53574 (keeping 200 days of data) [2025-10-27T18:46:41.135182] [DEBUG] [LOCAL ] FI: Primary data saved (53574 records). [2025-10-27T18:46:41.135320] [INFO ] [MAIN ] FI: Full history saved. [2025-10-27T18:46:41.136143] [INFO ] [MAIN ] Update Progress: 833/2366 symbols completed. FI took 38.4s. Estimated remaining: 3h 16m 15s. Rate: 7.8 symbols/min [2025-10-27T18:46:41.223793] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-27T18:46:41.305011] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:46:41.317124] [DEBUG] [LOCAL ] FINS: Loaded 8341 existing records from primary storage. [2025-10-27T18:46:41.317348] [INFO ] [MAIN ] FINS: Loaded 8341 existing records. [2025-10-27T18:46:41.490811] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:46:41.491028] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-27T18:46:41.491076] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-27T18:46:41.491231] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-27T18:46:41.491288] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-27T18:46:41.848142] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:46:41.863922] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T18:46:41.869213] [INFO ] [REMOTE ] FICO: Full fetch complete (30175 records). [2025-10-27T18:46:41.869301] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-27T18:46:42.020067] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-27T18:46:42.254348] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-27T18:46:42.254427] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-27T18:46:42.255117] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-27T18:46:42.255178] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-27T18:46:42.255922] [DEBUG] [LOCAL ] FICO: Trimmed 30175 records to 21863 (keeping 200 days of data) [2025-10-27T18:46:42.388343] [DEBUG] [LOCAL ] FICO: Primary data saved (21863 records). [2025-10-27T18:46:42.388475] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-27T18:46:42.388554] [INFO ] [MAIN ] Update Progress: 834/2366 symbols completed. FICO took 32.3s. Estimated remaining: 3h 15m 55s. Rate: 7.8 symbols/min [2025-10-27T18:46:42.559304] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:46:42.601447] [DEBUG] [LOCAL ] FINV: Loaded 45901 existing records from primary storage. [2025-10-27T18:46:42.601780] [INFO ] [MAIN ] FINV: Loaded 45901 existing records. [2025-10-27T18:46:42.775795] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:46:42.775987] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-27T18:46:42.776040] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-27T18:46:42.776436] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-27T18:46:42.776493] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-27T18:46:42.821501] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-27T18:46:43.187379] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:46:43.192428] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-27T18:46:43.345939] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-27T18:46:43.427367] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T18:46:43.614945] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-27T18:46:44.414980] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-27T18:46:45.186868] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T18:46:45.214898] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-27T18:46:45.452334] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T18:46:45.876877] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-27T18:46:46.014933] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-27T18:46:46.807884] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-27T18:46:46.814886] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-27T18:46:47.607743] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-27T18:46:47.614901] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-27T18:46:48.379914] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-27T18:46:48.414925] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-27T18:46:48.933577] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-27T18:46:49.214957] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-27T18:46:50.014938] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-27T18:46:50.610317] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T18:46:50.814937] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-27T18:46:51.193228] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-27T18:46:51.437064] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T18:46:51.614917] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-27T18:46:52.414933] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-27T18:46:52.447777] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T18:46:53.214944] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-27T18:46:53.559172] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-27T18:46:54.015007] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-27T18:46:54.661395] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T18:46:54.814943] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-27T18:46:55.615039] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-27T18:46:55.995481] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T18:46:56.005892] [INFO ] [REMOTE ] FIGS: Full fetch complete (70740 records). [2025-10-27T18:46:56.006094] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-27T18:46:56.332807] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T18:46:56.423007] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-27T18:46:56.440104] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-27T18:46:56.441083] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-27T18:46:56.441996] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-27T18:46:56.442187] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-27T18:46:56.443502] [DEBUG] [LOCAL ] FIGS: Trimmed 70740 records to 48361 (keeping 200 days of data) [2025-10-27T18:46:56.707004] [DEBUG] [LOCAL ] FIGS: Primary data saved (48361 records). [2025-10-27T18:46:56.707152] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-27T18:46:56.707250] [INFO ] [MAIN ] Update Progress: 835/2366 symbols completed. FIGS took 29.9s. Estimated remaining: 3h 15m 60s. Rate: 7.8 symbols/min [2025-10-27T18:46:56.886442] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:46:56.937814] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T18:46:56.966145] [DEBUG] [LOCAL ] FIS: Loaded 54105 existing records from primary storage. [2025-10-27T18:46:56.970952] [INFO ] [MAIN ] FIS: Loaded 54105 existing records. [2025-10-27T18:46:56.970846] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-27T18:46:57.028409] [INFO ] [REMOTE ] FINS: Full fetch complete (11547 records). [2025-10-27T18:46:57.042989] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-27T18:46:57.219786] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-27T18:46:57.260195] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:46:57.260966] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-27T18:46:57.261773] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-27T18:46:57.287983] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-27T18:46:57.305670] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-27T18:46:57.815727] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-27T18:46:57.816055] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-27T18:46:57.821720] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-27T18:46:57.826922] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-27T18:46:57.868293] [DEBUG] [LOCAL ] FINS: Trimmed 11547 records to 8194 (keeping 200 days of data) [2025-10-27T18:46:57.898453] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:46:57.948258] [DEBUG] [LOCAL ] FINS: Primary data saved (8194 records). [2025-10-27T18:46:57.948373] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-27T18:46:57.948451] [INFO ] [MAIN ] Update Progress: 836/2366 symbols completed. FINS took 16.8s. Estimated remaining: 3h 15m 40s. Rate: 7.8 symbols/min [2025-10-27T18:46:58.023386] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-27T18:46:58.121561] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:46:58.148140] [DEBUG] [LOCAL ] FIX: Loaded 28996 existing records from primary storage. [2025-10-27T18:46:58.148543] [INFO ] [MAIN ] FIX: Loaded 28996 existing records. [2025-10-27T18:46:58.331117] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:46:58.331477] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-27T18:46:58.331548] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-27T18:46:58.331927] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-27T18:46:58.331985] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-27T18:46:58.533201] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T18:46:58.717941] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:46:58.814907] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-27T18:46:59.607794] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T18:46:59.617682] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-27T18:47:00.050067] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T18:47:00.414998] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-27T18:47:01.214971] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-27T18:47:01.361442] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T18:47:02.014983] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-27T18:47:02.524974] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-27T18:47:02.815028] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-27T18:47:02.976124] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-27T18:47:03.403825] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-27T18:47:03.614957] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-27T18:47:04.128273] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T18:47:04.414988] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-27T18:47:05.214936] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-27T18:47:05.373669] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-27T18:47:05.530455] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T18:47:06.015001] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-27T18:47:06.435298] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-27T18:47:06.814931] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-27T18:47:07.614916] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-27T18:47:07.870521] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-27T18:47:08.010555] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T18:47:08.414955] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-27T18:47:09.074438] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-27T18:47:09.214936] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-27T18:47:09.865099] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T18:47:10.014972] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-27T18:47:10.679970] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T18:47:10.814932] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-27T18:47:11.279791] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T18:47:11.614996] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-27T18:47:12.195747] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-27T18:47:12.203056] [INFO ] [REMOTE ] FIHL: Full fetch complete (56309 records). [2025-10-27T18:47:12.203189] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-27T18:47:12.425196] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-27T18:47:12.590186] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-27T18:47:12.590266] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-27T18:47:12.591016] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-27T18:47:12.591079] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-27T18:47:12.592280] [DEBUG] [LOCAL ] FIHL: Trimmed 56309 records to 38701 (keeping 200 days of data) [2025-10-27T18:47:12.836743] [DEBUG] [LOCAL ] FIHL: Primary data saved (38701 records). [2025-10-27T18:47:12.836902] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-27T18:47:12.836987] [INFO ] [MAIN ] Update Progress: 837/2366 symbols completed. FIHL took 42.6s. Estimated remaining: 3h 15m 46s. Rate: 7.8 symbols/min [2025-10-27T18:47:13.214972] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-27T18:47:13.443002] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-27T18:47:13.842727] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T18:47:14.014918] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-27T18:47:14.272299] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T18:47:14.814989] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-27T18:47:15.582206] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T18:47:15.614907] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-27T18:47:15.825509] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-27T18:47:16.415019] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-27T18:47:17.214983] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-27T18:47:17.281322] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-27T18:47:17.873247] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-27T18:47:18.014930] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-27T18:47:18.503675] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-27T18:47:18.814918] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-27T18:47:19.614979] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-27T18:47:19.901184] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-27T18:47:19.910491] [INFO ] [REMOTE ] FINV: Full fetch complete (65014 records). [2025-10-27T18:47:19.910703] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-27T18:47:20.338924] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-27T18:47:20.339043] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-27T18:47:20.339980] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-27T18:47:20.340047] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-27T18:47:20.341378] [DEBUG] [LOCAL ] FINV: Trimmed 65014 records to 45169 (keeping 200 days of data) [2025-10-27T18:47:20.622447] [DEBUG] [LOCAL ] FINV: Primary data saved (45169 records). [2025-10-27T18:47:20.622672] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-27T18:47:20.623275] [INFO ] [MAIN ] Update Progress: 838/2366 symbols completed. FINV took 38.2s. Estimated remaining: 3h 15m 38s. Rate: 7.8 symbols/min [2025-10-27T18:47:20.657979] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T18:47:20.669580] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-27T18:47:20.851021] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-27T18:47:20.859405] [INFO ] [REMOTE ] FIX: Full fetch complete (45706 records). [2025-10-27T18:47:20.859547] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-27T18:47:21.234487] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-27T18:47:21.234598] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-27T18:47:21.235308] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-27T18:47:21.235369] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-27T18:47:21.236341] [DEBUG] [LOCAL ] FIX: Trimmed 45706 records to 28309 (keeping 200 days of data) [2025-10-27T18:47:21.406109] [DEBUG] [LOCAL ] FIX: Primary data saved (28309 records). [2025-10-27T18:47:21.406228] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-27T18:47:21.406302] [INFO ] [MAIN ] Update Progress: 839/2366 symbols completed. FIX took 23.5s. Estimated remaining: 3h 15m 18s. Rate: 7.8 symbols/min [2025-10-27T18:47:22.188095] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T18:47:22.199179] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-27T18:47:24.010087] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-27T18:47:24.021497] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-27T18:47:24.776550] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-27T18:47:24.786618] [INFO ] [REMOTE ] FIS: Full fetch complete (77397 records). [2025-10-27T18:47:24.786749] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-27T18:47:25.173115] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-27T18:47:25.173189] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-27T18:47:25.174082] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-27T18:47:25.174144] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-27T18:47:25.175508] [DEBUG] [LOCAL ] FIS: Trimmed 77397 records to 53324 (keeping 200 days of data) [2025-10-27T18:47:25.492896] [DEBUG] [LOCAL ] FIS: Primary data saved (53324 records). [2025-10-27T18:47:25.493041] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-27T18:47:25.493148] [INFO ] [MAIN ] Update Progress: 840/2366 symbols completed. FIS took 28.8s. Estimated remaining: 3h 15m 4s. Rate: 7.8 symbols/min [2025-10-27T18:47:26.159715] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:47:26.187028] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:47:26.187863] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:47:26.188947] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:47:26.189293] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-27T18:47:26.189794] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-27T18:47:26.190031] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-27T18:47:26.190092] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-27T18:47:26.190138] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-27T18:47:26.190171] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-27T18:47:26.305955] [DEBUG] [LOCAL ] FLC: Loaded 5477 existing records from primary storage. [2025-10-27T18:47:26.349260] [INFO ] [MAIN ] FLC: Loaded 5477 existing records. [2025-10-27T18:47:26.577981] [DEBUG] [LOCAL ] FLNG: Loaded 33679 existing records from primary storage. [2025-10-27T18:47:26.611276] [INFO ] [MAIN ] FLNG: Loaded 33679 existing records. [2025-10-27T18:47:26.645976] [DEBUG] [LOCAL ] FLG: Loaded 54097 existing records from primary storage. [2025-10-27T18:47:26.719004] [INFO ] [MAIN ] FLG: Loaded 54097 existing records. [2025-10-27T18:47:26.912417] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:47:26.971367] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-10-27T18:47:26.943312] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:47:26.982153] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-27T18:47:27.021429] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-27T18:47:27.064621] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-27T18:47:27.093814] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-27T18:47:27.145105] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:47:27.207608] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-27T18:47:27.207510] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:47:27.217995] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-27T18:47:27.223559] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-27T18:47:27.223495] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-27T18:47:27.223721] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-27T18:47:27.223773] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-27T18:47:27.231207] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-27T18:47:27.256028] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-27T18:47:27.276827] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T18:47:27.328779] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-10-27T18:47:27.450155] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T18:47:27.506853] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-27T18:47:27.517807] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T18:47:27.564250] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-27T18:47:27.606026] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-27T18:47:27.678416] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-27T18:47:27.769354] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-27T18:47:27.795355] [INFO ] [MAIN ] Update Progress: 841/2366 symbols completed. FIXT took 2.3s. Estimated remaining: 3h 14m 47s. Rate: 7.8 symbols/min [2025-10-27T18:47:28.266794] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:47:28.303115] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-27T18:47:28.413088] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:47:28.399839] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:47:28.429277] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-27T18:47:28.484460] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:47:28.484886] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-27T18:47:28.531636] [DEBUG] [LOCAL ] FLO: Loaded 52834 existing records from primary storage. [2025-10-27T18:47:28.531964] [INFO ] [MAIN ] FLO: Loaded 52834 existing records. [2025-10-27T18:47:28.704413] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:47:28.704634] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-27T18:47:28.704716] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-27T18:47:28.704923] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-27T18:47:28.704977] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-27T18:47:28.923553] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-27T18:47:28.957199] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-27T18:47:29.068247] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:47:29.068541] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-27T18:47:29.433738] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-27T18:47:29.435961] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-27T18:47:29.552557] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-27T18:47:29.559813] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-27T18:47:29.771600] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T18:47:29.782242] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-27T18:47:30.054607] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T18:47:30.056525] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-27T18:47:30.145249] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-27T18:47:30.481530] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-27T18:47:30.553394] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-27T18:47:30.814916] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-27T18:47:31.352277] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T18:47:31.614954] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-27T18:47:32.046334] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T18:47:32.414991] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-27T18:47:33.013911] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T18:47:33.214938] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-27T18:47:33.768721] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-27T18:47:33.768975] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-27T18:47:34.014944] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-27T18:47:34.623090] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T18:47:34.814944] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-27T18:47:35.273713] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-27T18:47:35.614948] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-27T18:47:36.414965] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-27T18:47:36.628546] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-27T18:47:37.214959] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-27T18:47:38.014984] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-27T18:47:38.233522] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-27T18:47:38.496055] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-27T18:47:38.574142] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T18:47:38.814944] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-27T18:47:39.250181] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-27T18:47:39.614992] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-27T18:47:40.414940] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-27T18:47:41.171155] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-27T18:47:41.173070] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T18:47:41.174768] [INFO ] [REMOTE ] FLC: Full fetch complete (7816 records). [2025-10-27T18:47:41.185082] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-27T18:47:41.220019] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-27T18:47:41.579301] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-27T18:47:41.579379] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-27T18:47:41.579571] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-27T18:47:41.579609] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-27T18:47:41.580010] [DEBUG] [LOCAL ] FLC: Trimmed 7816 records to 5167 (keeping 200 days of data) [2025-10-27T18:47:41.611241] [DEBUG] [LOCAL ] FLC: Primary data saved (5167 records). [2025-10-27T18:47:41.611339] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-27T18:47:41.611413] [INFO ] [MAIN ] Update Progress: 842/2366 symbols completed. FLC took 16.1s. Estimated remaining: 3h 14m 50s. Rate: 7.8 symbols/min [2025-10-27T18:47:41.786167] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:47:41.786353] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-27T18:47:41.786402] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-27T18:47:41.786510] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-27T18:47:41.786552] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-27T18:47:41.786591] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-27T18:47:41.786622] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-27T18:47:42.023577] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-27T18:47:42.137235] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:47:42.478781] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T18:47:42.814994] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-27T18:47:43.465714] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T18:47:43.614927] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-27T18:47:44.267877] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T18:47:44.414925] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-27T18:47:45.214947] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-27T18:47:45.282520] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T18:47:45.775545] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T18:47:46.014931] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-27T18:47:46.814907] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-27T18:47:47.021033] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-27T18:47:47.092365] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-27T18:47:47.614932] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-27T18:47:48.414973] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-10-27T18:47:48.576461] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T18:47:49.214945] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-27T18:47:49.557341] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T18:47:49.593504] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-27T18:47:50.014934] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-27T18:47:50.324716] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T18:47:50.814939] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-27T18:47:51.614936] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-27T18:47:51.788961] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-27T18:47:51.917677] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-27T18:47:52.414944] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-10-27T18:47:53.214935] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-27T18:47:53.456769] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-27T18:47:53.725140] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T18:47:54.014943] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-27T18:47:54.556569] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-27T18:47:54.562867] [INFO ] [REMOTE ] FLNG: Full fetch complete (49710 records). [2025-10-27T18:47:54.562993] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-27T18:47:54.820050] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-10-27T18:47:55.013505] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-27T18:47:55.013616] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-27T18:47:55.014741] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-27T18:47:55.014829] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-27T18:47:55.016404] [DEBUG] [LOCAL ] FLNG: Trimmed 49710 records to 32921 (keeping 200 days of data) [2025-10-27T18:47:55.238846] [DEBUG] [LOCAL ] FLNG: Primary data saved (32921 records). [2025-10-27T18:47:55.238991] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-27T18:47:55.239099] [INFO ] [MAIN ] Update Progress: 843/2366 symbols completed. FLNG took 29.7s. Estimated remaining: 3h 14m 53s. Rate: 7.8 symbols/min [2025-10-27T18:47:55.458213] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:47:55.510813] [DEBUG] [LOCAL ] FLR: Loaded 54025 existing records from primary storage. [2025-10-27T18:47:55.511188] [INFO ] [MAIN ] FLR: Loaded 54025 existing records. [2025-10-27T18:47:55.620118] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-27T18:47:55.743777] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:47:55.744168] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-27T18:47:55.744291] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-27T18:47:55.744562] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-27T18:47:55.744675] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-27T18:47:55.967517] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-27T18:47:56.200638] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:47:56.220375] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T18:47:56.414948] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-10-27T18:47:57.214995] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-27T18:47:57.348159] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T18:47:57.724860] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-27T18:47:58.014920] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-27T18:47:58.814903] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-10-27T18:47:58.867183] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-27T18:47:58.877085] [INFO ] [REMOTE ] FLO: Full fetch complete (75403 records). [2025-10-27T18:47:58.877188] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-27T18:47:59.260457] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-27T18:47:59.260563] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-27T18:47:59.261476] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-27T18:47:59.261551] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-27T18:47:59.263034] [DEBUG] [LOCAL ] FLO: Trimmed 75403 records to 52066 (keeping 200 days of data) [2025-10-27T18:47:59.572551] [DEBUG] [LOCAL ] FLO: Primary data saved (52066 records). [2025-10-27T18:47:59.572717] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-27T18:47:59.572936] [INFO ] [MAIN ] Update Progress: 844/2366 symbols completed. FLO took 31.7s. Estimated remaining: 3h 14m 39s. Rate: 7.8 symbols/min [2025-10-27T18:47:59.626017] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-27T18:47:59.675946] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T18:47:59.712952] [INFO ] [REMOTE ] FLG: Full fetch complete (77426 records). [2025-10-27T18:47:59.718727] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-27T18:47:59.887009] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:48:00.177073] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-27T18:48:00.191613] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-27T18:48:00.193263] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-27T18:48:00.193437] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-27T18:48:00.215345] [DEBUG] [LOCAL ] FLG: Trimmed 77426 records to 53317 (keeping 200 days of data) [2025-10-27T18:48:00.216551] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T18:48:00.300135] [DEBUG] [LOCAL ] FLS: Loaded 51134 existing records from primary storage. [2025-10-27T18:48:00.326324] [INFO ] [MAIN ] FLS: Loaded 51134 existing records. [2025-10-27T18:48:00.422035] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-10-27T18:48:00.626685] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:48:00.630324] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-27T18:48:00.634704] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-27T18:48:00.641948] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-27T18:48:00.642451] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-27T18:48:01.016344] [DEBUG] [LOCAL ] FLG: Primary data saved (53317 records). [2025-10-27T18:48:01.026430] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-27T18:48:01.027743] [INFO ] [MAIN ] Update Progress: 845/2366 symbols completed. FLG took 35.5s. Estimated remaining: 3h 14m 21s. Rate: 7.8 symbols/min [2025-10-27T18:48:01.210529] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:48:01.216722] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-27T18:48:01.282351] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:48:01.330611] [DEBUG] [LOCAL ] FLUT: Loaded 51394 existing records from primary storage. [2025-10-27T18:48:01.330922] [INFO ] [MAIN ] FLUT: Loaded 51394 existing records. [2025-10-27T18:48:01.542495] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:48:01.545110] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-27T18:48:01.543327] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-27T18:48:01.545344] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-27T18:48:01.555728] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-27T18:48:01.555832] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-27T18:48:01.825980] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T18:48:02.015896] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:48:02.016003] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-27T18:48:02.814975] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-10-27T18:48:02.942287] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T18:48:03.614930] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-27T18:48:03.737965] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-27T18:48:04.088110] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T18:48:04.414970] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-10-27T18:48:05.013562] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T18:48:05.214917] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-27T18:48:05.463697] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-27T18:48:06.015003] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-27T18:48:06.815043] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-27T18:48:06.892038] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-27T18:48:07.533350] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T18:48:07.615019] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-27T18:48:08.229851] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T18:48:08.415015] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-27T18:48:09.214937] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-10-27T18:48:09.319862] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-27T18:48:10.016221] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T18:48:10.016567] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-27T18:48:10.055225] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-27T18:48:10.815027] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-27T18:48:11.614957] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-10. [2025-10-27T18:48:11.975389] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-27T18:48:12.259291] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-27T18:48:12.414963] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-27T18:48:12.598936] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T18:48:12.604280] [INFO ] [REMOTE ] FLOC: Full fetch complete (41562 records). [2025-10-27T18:48:12.604381] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-10-27T18:48:12.785434] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-27T18:48:12.785943] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:48:12.786013] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:48:12.786081] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-27T18:48:12.786144] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-27T18:48:12.786180] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-27T18:48:12.786219] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-27T18:48:12.786275] [INFO ] [MAIN ] Update Progress: 846/2366 symbols completed. FLOC took 31.2s. Estimated remaining: 3h 14m 20s. Rate: 7.8 symbols/min [2025-10-27T18:48:12.948544] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:48:12.969623] [DEBUG] [LOCAL ] FLXR: Loaded 21785 existing records from primary storage. [2025-10-27T18:48:12.969907] [INFO ] [MAIN ] FLXR: Loaded 21785 existing records. [2025-10-27T18:48:13.146779] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:48:13.146962] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-27T18:48:13.147011] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-27T18:48:13.147177] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-27T18:48:13.147233] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-27T18:48:13.220019] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-27T18:48:13.491860] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:48:14.014930] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-27T18:48:14.183581] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-27T18:48:14.814963] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-27T18:48:14.846518] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-27T18:48:15.502208] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T18:48:15.615904] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-27T18:48:15.616972] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T18:48:16.414984] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-27T18:48:17.214987] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-27T18:48:17.296501] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-27T18:48:17.810255] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T18:48:18.014926] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-27T18:48:18.472455] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-27T18:48:18.695883] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T18:48:18.814966] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-27T18:48:19.614934] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-27T18:48:20.414917] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-27T18:48:20.524363] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-27T18:48:21.020331] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-27T18:48:21.214911] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-27T18:48:21.258877] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-27T18:48:22.014950] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-27T18:48:22.814993] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-27T18:48:22.970990] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T18:48:23.614908] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-27T18:48:23.655401] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-27T18:48:24.414934] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-27T18:48:24.766672] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-27T18:48:25.215273] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T18:48:25.215361] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-27T18:48:25.652725] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-27T18:48:25.991327] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T18:48:26.014898] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-27T18:48:26.652677] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-27T18:48:26.814953] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-27T18:48:27.614933] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-27T18:48:28.414946] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-27T18:48:28.614778] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-27T18:48:29.225182] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-27T18:48:29.231317] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T18:48:29.797481] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T18:48:30.014907] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-27T18:48:30.320245] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T18:48:30.814989] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-27T18:48:31.592124] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T18:48:31.601806] [INFO ] [REMOTE ] FLS: Full fetch complete (72597 records). [2025-10-27T18:48:31.601933] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-27T18:48:31.622501] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-27T18:48:31.978002] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T18:48:32.040352] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-27T18:48:32.040425] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-27T18:48:32.041338] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-27T18:48:32.041401] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-27T18:48:32.042727] [DEBUG] [LOCAL ] FLS: Trimmed 72597 records to 50378 (keeping 200 days of data) [2025-10-27T18:48:32.337524] [DEBUG] [LOCAL ] FLS: Primary data saved (50378 records). [2025-10-27T18:48:32.337670] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-27T18:48:32.337765] [INFO ] [MAIN ] Update Progress: 847/2366 symbols completed. FLS took 32.8s. Estimated remaining: 3h 14m 34s. Rate: 7.8 symbols/min [2025-10-27T18:48:32.420214] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-27T18:48:32.517047] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:48:32.566220] [DEBUG] [LOCAL ] FMC: Loaded 52635 existing records from primary storage. [2025-10-27T18:48:32.566516] [INFO ] [MAIN ] FMC: Loaded 52635 existing records. [2025-10-27T18:48:32.770033] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:48:32.770268] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-27T18:48:32.770331] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-27T18:48:32.770842] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-27T18:48:32.770901] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-27T18:48:33.128596] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:48:33.214902] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-27T18:48:33.331303] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T18:48:33.341507] [INFO ] [REMOTE ] FLUT: Full fetch complete (73379 records). [2025-10-27T18:48:33.341722] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-27T18:48:33.722002] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-27T18:48:33.722093] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-27T18:48:33.722986] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-27T18:48:33.723050] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-27T18:48:33.724469] [DEBUG] [LOCAL ] FLUT: Trimmed 73379 records to 50601 (keeping 200 days of data) [2025-10-27T18:48:34.023091] [DEBUG] [LOCAL ] FLUT: Primary data saved (50601 records). [2025-10-27T18:48:34.022972] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-27T18:48:34.024260] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-27T18:48:34.024997] [INFO ] [MAIN ] Update Progress: 848/2366 symbols completed. FLUT took 33.0s. Estimated remaining: 3h 14m 15s. Rate: 7.8 symbols/min [2025-10-27T18:48:34.198381] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:48:34.206409] [DEBUG] [LOCAL ] FMN: Loaded 5508 existing records from primary storage. [2025-10-27T18:48:34.206610] [INFO ] [MAIN ] FMN: Loaded 5508 existing records. [2025-10-27T18:48:34.388288] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:48:34.388689] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-27T18:48:34.388795] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-27T18:48:34.389068] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-27T18:48:34.389190] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-27T18:48:34.523829] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-27T18:48:34.721512] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T18:48:34.802146] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:48:34.814895] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-27T18:48:35.349315] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-27T18:48:35.430980] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T18:48:35.614925] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-27T18:48:36.414968] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-27T18:48:37.214957] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-27T18:48:37.547528] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-27T18:48:37.599056] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-27T18:48:37.604312] [INFO ] [REMOTE ] FLXR: Full fetch complete (27988 records). [2025-10-27T18:48:37.604409] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-27T18:48:37.894540] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-27T18:48:37.982758] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-27T18:48:37.982847] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-27T18:48:37.983368] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-27T18:48:37.983408] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-27T18:48:37.984252] [DEBUG] [LOCAL ] FLXR: Trimmed 27988 records to 21635 (keeping 200 days of data) [2025-10-27T18:48:38.034502] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-27T18:48:38.111378] [DEBUG] [LOCAL ] FLXR: Primary data saved (21635 records). [2025-10-27T18:48:38.111488] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-27T18:48:38.111572] [INFO ] [MAIN ] Update Progress: 849/2366 symbols completed. FLXR took 25.3s. Estimated remaining: 3h 14m 1s. Rate: 7.8 symbols/min [2025-10-27T18:48:38.278360] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:48:38.307111] [DEBUG] [LOCAL ] FMS: Loaded 30723 existing records from primary storage. [2025-10-27T18:48:38.307370] [INFO ] [MAIN ] FMS: Loaded 30723 existing records. [2025-10-27T18:48:38.480883] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:48:38.481063] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-27T18:48:38.481108] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-27T18:48:38.481277] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-27T18:48:38.481314] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-27T18:48:38.821684] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-27T18:48:38.842539] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:48:38.886144] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-27T18:48:39.614940] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-27T18:48:40.414914] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-27T18:48:40.603009] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-27T18:48:40.808883] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T18:48:41.214953] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-27T18:48:42.014900] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-27T18:48:42.427315] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-27T18:48:42.529352] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-27T18:48:42.539753] [INFO ] [REMOTE ] FLR: Full fetch complete (76921 records). [2025-10-27T18:48:42.539896] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-27T18:48:42.814973] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-27T18:48:42.934781] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-27T18:48:42.934882] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-27T18:48:42.935881] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-27T18:48:42.936025] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-27T18:48:42.937627] [DEBUG] [LOCAL ] FLR: Trimmed 76921 records to 53242 (keeping 200 days of data) [2025-10-27T18:48:43.050426] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-27T18:48:43.282850] [DEBUG] [LOCAL ] FLR: Primary data saved (53242 records). [2025-10-27T18:48:43.282989] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-27T18:48:43.283086] [INFO ] [MAIN ] Update Progress: 850/2366 symbols completed. FLR took 48.0s. Estimated remaining: 3h 13m 49s. Rate: 7.8 symbols/min [2025-10-27T18:48:43.462166] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:48:43.499374] [DEBUG] [LOCAL ] FMX: Loaded 40863 existing records from primary storage. [2025-10-27T18:48:43.499688] [INFO ] [MAIN ] FMX: Loaded 40863 existing records. [2025-10-27T18:48:43.620037] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-27T18:48:43.683790] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:48:43.684178] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-27T18:48:43.684242] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-27T18:48:43.684691] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-27T18:48:43.684749] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-27T18:48:44.069388] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:48:44.082905] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T18:48:44.414933] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-27T18:48:45.214941] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-27T18:48:45.481460] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-27T18:48:45.522957] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-27T18:48:45.668985] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-27T18:48:46.014939] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-27T18:48:46.814962] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-27T18:48:47.527778] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T18:48:47.614919] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-27T18:48:48.227438] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T18:48:48.414975] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-27T18:48:49.214921] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-27T18:48:49.257497] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-27T18:48:49.601521] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-27T18:48:49.903401] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T18:48:50.014919] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-27T18:48:50.652244] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-27T18:48:50.814919] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-27T18:48:51.615001] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-27T18:48:52.166281] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T18:48:52.206524] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-27T18:48:52.415001] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-27T18:48:53.215003] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-27T18:48:53.979726] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T18:48:54.014927] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-27T18:48:54.505488] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-27T18:48:54.814941] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-27T18:48:55.463002] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T18:48:55.529250] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T18:48:55.614902] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-27T18:48:56.414979] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-27T18:48:57.214951] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-27T18:48:57.428916] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-27T18:48:57.439671] [INFO ] [REMOTE ] FMC: Full fetch complete (75427 records). [2025-10-27T18:48:57.439799] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-27T18:48:57.897507] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-27T18:48:57.897974] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-27T18:48:57.899048] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T18:48:57.900074] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-27T18:48:57.905889] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-27T18:48:57.908035] [DEBUG] [LOCAL ] FMC: Trimmed 75427 records to 51842 (keeping 200 days of data) [2025-10-27T18:48:58.016550] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-27T18:48:58.247675] [DEBUG] [LOCAL ] FMC: Primary data saved (51842 records). [2025-10-27T18:48:58.247822] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-27T18:48:58.247945] [INFO ] [MAIN ] Update Progress: 851/2366 symbols completed. FMC took 25.9s. Estimated remaining: 3h 13m 54s. Rate: 7.8 symbols/min [2025-10-27T18:48:58.439598] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:48:58.462877] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T18:48:58.473273] [DEBUG] [LOCAL ] FMY: Loaded 1371 existing records from primary storage. [2025-10-27T18:48:58.473432] [INFO ] [MAIN ] FMY: Loaded 1371 existing records. [2025-10-27T18:48:58.677716] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:48:58.677907] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-27T18:48:58.677954] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-27T18:48:58.678076] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-27T18:48:58.678116] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-27T18:48:58.820142] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-27T18:48:59.090278] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:48:59.105308] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T18:48:59.614982] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-27T18:49:00.042675] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-27T18:49:00.415012] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-27T18:49:00.835585] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-27T18:49:01.056837] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T18:49:01.214956] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-27T18:49:01.760674] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-27T18:49:02.014926] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-27T18:49:02.814995] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-27T18:49:03.358690] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T18:49:03.407541] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-27T18:49:03.614953] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-27T18:49:04.414928] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-27T18:49:04.768692] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T18:49:04.790456] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-27T18:49:05.214927] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-27T18:49:06.015004] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-27T18:49:06.581789] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T18:49:06.593505] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-27T18:49:06.815008] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-27T18:49:07.614937] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-27T18:49:07.952265] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-27T18:49:08.142907] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-27T18:49:08.414975] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-27T18:49:09.215004] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-27T18:49:09.708317] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-27T18:49:10.015281] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T18:49:10.015446] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-27T18:49:10.814941] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-27T18:49:11.585719] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T18:49:11.594848] [INFO ] [REMOTE ] FMS: Full fetch complete (43117 records). [2025-10-27T18:49:11.595005] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-27T18:49:11.626815] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-27T18:49:11.994752] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-27T18:49:11.994851] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-27T18:49:11.995583] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-27T18:49:11.995635] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-27T18:49:11.996526] [DEBUG] [LOCAL ] FMS: Trimmed 43117 records to 30079 (keeping 200 days of data) [2025-10-27T18:49:12.181718] [DEBUG] [LOCAL ] FMS: Primary data saved (30079 records). [2025-10-27T18:49:12.181943] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-27T18:49:12.182108] [INFO ] [MAIN ] Update Progress: 852/2366 symbols completed. FMS took 34.1s. Estimated remaining: 3h 13m 58s. Rate: 7.8 symbols/min [2025-10-27T18:49:12.322698] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T18:49:12.388360] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:49:12.423430] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-27T18:49:12.426027] [DEBUG] [LOCAL ] FN: Loaded 37847 existing records from primary storage. [2025-10-27T18:49:12.426322] [INFO ] [MAIN ] FN: Loaded 37847 existing records. [2025-10-27T18:49:12.480511] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-27T18:49:12.617903] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:49:12.618107] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-27T18:49:12.618155] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-27T18:49:12.618455] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-27T18:49:12.618513] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-27T18:49:12.976574] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:49:13.214943] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-27T18:49:14.014921] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-27T18:49:14.146783] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-27T18:49:14.153816] [INFO ] [REMOTE ] FMX: Full fetch complete (57813 records). [2025-10-27T18:49:14.153946] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-27T18:49:14.540314] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-27T18:49:14.561528] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-27T18:49:14.561689] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-27T18:49:14.562500] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-27T18:49:14.562606] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-27T18:49:14.564052] [DEBUG] [LOCAL ] FMX: Trimmed 57813 records to 39996 (keeping 200 days of data) [2025-10-27T18:49:14.710004] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T18:49:14.816673] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-27T18:49:14.839341] [DEBUG] [LOCAL ] FMX: Primary data saved (39996 records). [2025-10-27T18:49:14.839459] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-27T18:49:14.839533] [INFO ] [MAIN ] Update Progress: 853/2366 symbols completed. FMX took 31.6s. Estimated remaining: 3h 13m 41s. Rate: 7.8 symbols/min [2025-10-27T18:49:15.009257] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:49:15.059738] [DEBUG] [LOCAL ] FNB: Loaded 53382 existing records from primary storage. [2025-10-27T18:49:15.060032] [INFO ] [MAIN ] FNB: Loaded 53382 existing records. [2025-10-27T18:49:15.237052] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:49:15.237277] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-27T18:49:15.237339] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-27T18:49:15.237683] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-27T18:49:15.237748] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-27T18:49:15.313095] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-27T18:49:15.337015] [INFO ] [REMOTE ] FMY: Full fetch complete (1942 records). [2025-10-27T18:49:15.339206] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-27T18:49:15.619381] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-27T18:49:15.964056] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:49:15.964314] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-27T18:49:15.964412] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-27T18:49:15.964860] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-27T18:49:15.964922] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-27T18:49:15.965252] [DEBUG] [LOCAL ] FMY: Trimmed 1942 records to 1320 (keeping 200 days of data) [2025-10-27T18:49:15.973521] [DEBUG] [LOCAL ] FMY: Primary data saved (1320 records). [2025-10-27T18:49:15.973598] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-27T18:49:15.973689] [INFO ] [MAIN ] Update Progress: 854/2366 symbols completed. FMY took 17.7s. Estimated remaining: 3h 13m 22s. Rate: 7.8 symbols/min [2025-10-27T18:49:16.138499] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:49:16.186999] [DEBUG] [LOCAL ] FND: Loaded 52826 existing records from primary storage. [2025-10-27T18:49:16.187328] [INFO ] [MAIN ] FND: Loaded 52826 existing records. [2025-10-27T18:49:16.361995] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:49:16.362207] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-27T18:49:16.362261] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-27T18:49:16.362558] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-27T18:49:16.362618] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-27T18:49:16.422799] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-27T18:49:16.730998] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:49:16.768360] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T18:49:16.770243] [INFO ] [REMOTE ] FMN: Full fetch complete (9769 records). [2025-10-27T18:49:16.770309] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-27T18:49:17.117679] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-27T18:49:17.117762] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-27T18:49:17.118040] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-27T18:49:17.118085] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-27T18:49:17.118478] [DEBUG] [LOCAL ] FMN: Trimmed 9769 records to 5419 (keeping 200 days of data) [2025-10-27T18:49:17.150840] [DEBUG] [LOCAL ] FMN: Primary data saved (5419 records). [2025-10-27T18:49:17.150921] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-27T18:49:17.150991] [INFO ] [MAIN ] Update Progress: 855/2366 symbols completed. FMN took 43.1s. Estimated remaining: 3h 13m 3s. Rate: 7.8 symbols/min [2025-10-27T18:49:17.223560] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-27T18:49:17.320954] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:49:17.371699] [DEBUG] [LOCAL ] FNF: Loaded 49387 existing records from primary storage. [2025-10-27T18:49:17.372067] [INFO ] [MAIN ] FNF: Loaded 49387 existing records. [2025-10-27T18:49:17.574579] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:49:17.574825] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-27T18:49:17.574883] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-27T18:49:17.575114] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-27T18:49:17.575191] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-27T18:49:18.000519] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:49:18.014900] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-27T18:49:18.081947] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T18:49:18.821857] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-27T18:49:18.845296] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-27T18:49:19.112808] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-27T18:49:19.614911] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-27T18:49:20.418612] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-27T18:49:20.421474] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-27T18:49:20.921203] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T18:49:21.214946] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-27T18:49:22.014937] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-27T18:49:22.071772] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T18:49:22.814958] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-27T18:49:23.615000] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-27T18:49:23.661234] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-27T18:49:24.414956] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-27T18:49:24.938185] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (2.92 seconds). [2025-10-27T18:49:25.181348] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-27T18:49:25.214904] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-27T18:49:25.845696] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-27T18:49:26.014951] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-27T18:49:26.571342] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-27T18:49:26.619244] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T18:49:26.814940] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-27T18:49:27.316196] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T18:49:27.614962] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-27T18:49:28.414950] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-27T18:49:28.500465] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T18:49:28.763066] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T18:49:29.215010] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-27T18:49:29.852556] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-27T18:49:30.014947] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-27T18:49:30.651955] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T18:49:30.814930] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-27T18:49:31.614903] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-27T18:49:31.726561] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-27T18:49:32.122400] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-27T18:49:32.414964] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-27T18:49:33.039152] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T18:49:33.214942] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-27T18:49:33.615191] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T18:49:34.015036] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-27T18:49:34.501475] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T18:49:34.814941] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-27T18:49:35.621699] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-27T18:49:35.653842] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-27T18:49:36.415000] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-27T18:49:36.678448] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-27T18:49:37.022839] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-27T18:49:37.215018] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-27T18:49:38.015041] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-27T18:49:38.142374] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-27T18:49:38.722561] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T18:49:38.814944] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-27T18:49:39.614971] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-27T18:49:39.800440] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-27T18:49:40.234068] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T18:49:40.414947] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-27T18:49:41.071228] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T18:49:41.214962] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-27T18:49:42.014925] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-27T18:49:42.180378] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-27T18:49:42.815011] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-27T18:49:42.968397] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-27T18:49:43.614951] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-27T18:49:43.677701] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T18:49:43.684146] [INFO ] [REMOTE ] FN: Full fetch complete (56469 records). [2025-10-27T18:49:43.684263] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-27T18:49:44.066084] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-27T18:49:44.066283] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-27T18:49:44.067217] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-27T18:49:44.067381] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-27T18:49:44.068844] [DEBUG] [LOCAL ] FN: Trimmed 56469 records to 37005 (keeping 200 days of data) [2025-10-27T18:49:44.292023] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T18:49:44.330996] [DEBUG] [LOCAL ] FN: Primary data saved (37005 records). [2025-10-27T18:49:44.331144] [INFO ] [MAIN ] FN: Full history saved. [2025-10-27T18:49:44.331228] [INFO ] [MAIN ] Update Progress: 856/2366 symbols completed. FN took 32.1s. Estimated remaining: 3h 13m 30s. Rate: 7.8 symbols/min [2025-10-27T18:49:44.422179] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-27T18:49:44.504149] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:49:44.554746] [DEBUG] [LOCAL ] FNV: Loaded 46719 existing records from primary storage. [2025-10-27T18:49:44.555101] [INFO ] [MAIN ] FNV: Loaded 46719 existing records. [2025-10-27T18:49:44.732926] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:49:44.733138] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-27T18:49:44.733185] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-27T18:49:44.733597] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-27T18:49:44.733686] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-27T18:49:45.112408] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:49:45.214905] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-27T18:49:45.487275] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-27T18:49:45.497254] [INFO ] [REMOTE ] FND: Full fetch complete (75097 records). [2025-10-27T18:49:45.497387] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-27T18:49:45.891850] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-27T18:49:45.892030] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-27T18:49:45.892999] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-27T18:49:45.893084] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-27T18:49:45.894878] [DEBUG] [LOCAL ] FND: Trimmed 75097 records to 52045 (keeping 200 days of data) [2025-10-27T18:49:46.022841] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-27T18:49:46.032965] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-27T18:49:46.051327] [INFO ] [REMOTE ] FNB: Full fetch complete (76250 records). [2025-10-27T18:49:46.051456] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-27T18:49:46.501262] [DEBUG] [LOCAL ] FND: Primary data saved (52045 records). [2025-10-27T18:49:46.506633] [INFO ] [MAIN ] FND: Full history saved. [2025-10-27T18:49:46.513443] [INFO ] [MAIN ] Update Progress: 857/2366 symbols completed. FND took 30.5s. Estimated remaining: 3h 13m 12s. Rate: 7.8 symbols/min [2025-10-27T18:49:46.766600] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-27T18:49:46.790067] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-27T18:49:46.791180] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-27T18:49:46.791817] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-27T18:49:46.826372] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:49:46.826949] [DEBUG] [LOCAL ] FNB: Trimmed 76250 records to 52602 (keeping 200 days of data) [2025-10-27T18:49:46.950353] [DEBUG] [LOCAL ] FOA: Loaded 13179 existing records from primary storage. [2025-10-27T18:49:46.951106] [INFO ] [MAIN ] FOA: Loaded 13179 existing records. [2025-10-27T18:49:47.021281] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-27T18:49:47.065182] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-27T18:49:47.299733] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:49:47.300503] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-27T18:49:47.302045] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-27T18:49:47.302474] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-27T18:49:47.303154] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-27T18:49:47.904306] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:49:47.909155] [DEBUG] [LOCAL ] FNB: Primary data saved (52602 records). [2025-10-27T18:49:47.910094] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-27T18:49:47.910381] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-27T18:49:47.911478] [INFO ] [MAIN ] Update Progress: 858/2366 symbols completed. FNB took 33.1s. Estimated remaining: 3h 12m 54s. Rate: 7.8 symbols/min [2025-10-27T18:49:48.144405] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-27T18:49:48.172165] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:49:48.195627] [DEBUG] [LOCAL ] FOF: Loaded 8488 existing records from primary storage. [2025-10-27T18:49:48.195951] [INFO ] [MAIN ] FOF: Loaded 8488 existing records. [2025-10-27T18:49:48.415074] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-27T18:49:48.465053] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:49:48.465810] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-27T18:49:48.466032] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-27T18:49:48.466337] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-27T18:49:48.466427] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-27T18:49:48.865696] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:49:48.888691] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-27T18:49:49.069037] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T18:49:49.214945] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-27T18:49:49.756956] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-27T18:49:50.014947] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-27T18:49:50.641308] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-27T18:49:50.814954] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-27T18:49:51.443691] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T18:49:51.488959] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T18:49:51.497833] [INFO ] [REMOTE ] FNF: Full fetch complete (69936 records). [2025-10-27T18:49:51.497952] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-27T18:49:51.620148] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-27T18:49:51.904508] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-27T18:49:51.904586] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-27T18:49:51.905457] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-27T18:49:51.905518] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-27T18:49:51.906896] [DEBUG] [LOCAL ] FNF: Trimmed 69936 records to 48527 (keeping 200 days of data) [2025-10-27T18:49:52.197135] [DEBUG] [LOCAL ] FNF: Primary data saved (48527 records). [2025-10-27T18:49:52.197274] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-27T18:49:52.197353] [INFO ] [MAIN ] Update Progress: 859/2366 symbols completed. FNF took 35.0s. Estimated remaining: 3h 12m 40s. Rate: 7.8 symbols/min [2025-10-27T18:49:52.365148] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:49:52.383904] [DEBUG] [LOCAL ] FOR: Loaded 19663 existing records from primary storage. [2025-10-27T18:49:52.384121] [INFO ] [MAIN ] FOR: Loaded 19663 existing records. [2025-10-27T18:49:52.420113] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-27T18:49:52.563015] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:49:52.563242] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-27T18:49:52.563319] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-27T18:49:52.563813] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-27T18:49:52.563873] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-27T18:49:52.714759] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-27T18:49:52.931610] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:49:53.214986] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-27T18:49:54.014940] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-27T18:49:54.179445] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-27T18:49:54.331836] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T18:49:54.689326] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-27T18:49:54.814977] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-27T18:49:55.614968] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-27T18:49:55.892922] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T18:49:56.327290] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-27T18:49:56.414977] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-27T18:49:57.214985] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-27T18:49:57.786957] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-27T18:49:57.989530] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-27T18:49:58.014957] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-27T18:49:58.820051] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-27T18:49:58.831827] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T18:49:59.514777] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-27T18:49:59.614924] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-27T18:50:00.414942] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-27T18:50:00.806071] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T18:50:01.214989] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-27T18:50:01.824330] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-27T18:50:02.014979] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-27T18:50:02.202690] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T18:50:02.815017] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-27T18:50:03.482483] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T18:50:03.614983] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-27T18:50:03.764143] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T18:50:04.414998] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-27T18:50:04.675214] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T18:50:05.214996] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-27T18:50:05.658310] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-27T18:50:06.014945] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-27T18:50:06.190012] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T18:50:06.815039] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-27T18:50:06.853746] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-27T18:50:07.518242] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-27T18:50:07.614981] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-27T18:50:08.414924] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-27T18:50:08.674747] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T18:50:08.833388] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-27T18:50:09.214973] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-27T18:50:10.014958] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-27T18:50:10.259499] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-27T18:50:10.815005] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-27T18:50:11.577223] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T18:50:11.614934] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-27T18:50:11.845921] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T18:50:11.849185] [INFO ] [REMOTE ] FOR: Full fetch complete (29448 records). [2025-10-27T18:50:11.849271] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-27T18:50:12.221944] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-27T18:50:12.222082] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-27T18:50:12.222706] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-27T18:50:12.222769] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-27T18:50:12.223674] [DEBUG] [LOCAL ] FOR: Trimmed 29448 records to 19027 (keeping 200 days of data) [2025-10-27T18:50:12.331203] [DEBUG] [LOCAL ] FOR: Primary data saved (19027 records). [2025-10-27T18:50:12.331351] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-27T18:50:12.331433] [INFO ] [MAIN ] Update Progress: 860/2366 symbols completed. FOR took 20.1s. Estimated remaining: 3h 12m 54s. Rate: 7.8 symbols/min [2025-10-27T18:50:12.421054] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-27T18:50:12.461721] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T18:50:12.520345] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:50:12.564916] [DEBUG] [LOCAL ] FOUR: Loaded 50380 existing records from primary storage. [2025-10-27T18:50:12.565294] [INFO ] [MAIN ] FOUR: Loaded 50380 existing records. [2025-10-27T18:50:12.740456] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:50:12.740686] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-27T18:50:12.740745] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-27T18:50:12.740930] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-27T18:50:12.740968] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-27T18:50:13.100764] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:50:13.214895] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-27T18:50:13.311667] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-27T18:50:14.014937] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-27T18:50:14.645092] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T18:50:14.814988] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-27T18:50:15.614988] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-27T18:50:15.647003] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-27T18:50:15.674866] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-27T18:50:16.414948] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-27T18:50:16.923923] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T18:50:17.214998] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-27T18:50:18.015008] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-27T18:50:18.110623] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-27T18:50:18.814953] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-27T18:50:19.614922] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-27T18:50:19.758572] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-27T18:50:19.834514] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-27T18:50:19.843884] [INFO ] [REMOTE ] FNV: Full fetch complete (66990 records). [2025-10-27T18:50:19.844017] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-27T18:50:20.275302] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-27T18:50:20.275184] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T18:50:20.275530] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-27T18:50:20.276571] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-27T18:50:20.276675] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-27T18:50:20.281332] [DEBUG] [LOCAL ] FNV: Trimmed 66990 records to 45932 (keeping 200 days of data) [2025-10-27T18:50:20.475714] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-27T18:50:20.619592] [DEBUG] [LOCAL ] FNV: Primary data saved (45932 records). [2025-10-27T18:50:20.622537] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-27T18:50:20.623171] [INFO ] [MAIN ] Update Progress: 861/2366 symbols completed. FNV took 36.3s. Estimated remaining: 3h 12m 47s. Rate: 7.8 symbols/min [2025-10-27T18:50:20.689624] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-27T18:50:20.807614] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:50:20.828170] [DEBUG] [LOCAL ] FPF: Loaded 19027 existing records from primary storage. [2025-10-27T18:50:20.828398] [INFO ] [MAIN ] FPF: Loaded 19027 existing records. [2025-10-27T18:50:20.999251] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:50:20.999423] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-27T18:50:20.999468] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-27T18:50:20.999778] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-27T18:50:20.999836] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-27T18:50:21.226294] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-27T18:50:21.352015] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:50:21.360740] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-27T18:50:21.363770] [INFO ] [REMOTE ] FOA: Full fetch complete (20677 records). [2025-10-27T18:50:21.363871] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-27T18:50:21.744142] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-27T18:50:21.744236] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-27T18:50:21.744724] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-27T18:50:21.744805] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-27T18:50:21.745412] [DEBUG] [LOCAL ] FOA: Trimmed 20677 records to 12847 (keeping 200 days of data) [2025-10-27T18:50:21.820440] [DEBUG] [LOCAL ] FOA: Primary data saved (12847 records). [2025-10-27T18:50:21.820577] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-27T18:50:21.820684] [INFO ] [MAIN ] Update Progress: 862/2366 symbols completed. FOA took 35.3s. Estimated remaining: 3h 12m 28s. Rate: 7.8 symbols/min [2025-10-27T18:50:21.987219] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:50:22.005968] [DEBUG] [LOCAL ] FPH: Loaded 19472 existing records from primary storage. [2025-10-27T18:50:22.006209] [INFO ] [MAIN ] FPH: Loaded 19472 existing records. [2025-10-27T18:50:22.020213] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-27T18:50:22.188259] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:50:22.189039] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-27T18:50:22.189113] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-27T18:50:22.189295] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-27T18:50:22.189356] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-27T18:50:22.533484] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:50:22.814994] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-27T18:50:23.088676] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-27T18:50:23.165763] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T18:50:23.614922] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-27T18:50:23.818277] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T18:50:23.820346] [INFO ] [REMOTE ] FOF: Full fetch complete (11895 records). [2025-10-27T18:50:23.820417] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-27T18:50:24.173328] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-27T18:50:24.173405] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-27T18:50:24.173700] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-27T18:50:24.173760] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-27T18:50:24.174308] [DEBUG] [LOCAL ] FOF: Trimmed 11895 records to 8138 (keeping 200 days of data) [2025-10-27T18:50:24.228738] [DEBUG] [LOCAL ] FOF: Primary data saved (8138 records). [2025-10-27T18:50:24.228942] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-27T18:50:24.229033] [INFO ] [MAIN ] Update Progress: 863/2366 symbols completed. FOF took 36.3s. Estimated remaining: 3h 12m 12s. Rate: 7.8 symbols/min [2025-10-27T18:50:24.395345] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:50:24.415010] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-27T18:50:24.427837] [DEBUG] [LOCAL ] FPI: Loaded 31756 existing records from primary storage. [2025-10-27T18:50:24.428075] [INFO ] [MAIN ] FPI: Loaded 31756 existing records. [2025-10-27T18:50:24.600788] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:50:24.600990] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-27T18:50:24.601036] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-27T18:50:24.601250] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-27T18:50:24.601305] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-27T18:50:24.942663] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:50:25.087549] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-27T18:50:25.214925] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-27T18:50:25.389079] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-27T18:50:26.014993] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-27T18:50:26.088083] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T18:50:26.814944] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-27T18:50:27.197469] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-27T18:50:27.614955] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-27T18:50:28.414915] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-27T18:50:28.479885] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-27T18:50:28.544094] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-27T18:50:29.214915] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-27T18:50:29.519189] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T18:50:30.014946] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-27T18:50:30.814919] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-27T18:50:31.100450] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-27T18:50:31.111073] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-27T18:50:31.614985] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-27T18:50:31.710977] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-27T18:50:32.414932] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-27T18:50:32.507715] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-27T18:50:33.138058] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-27T18:50:33.214927] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-27T18:50:34.014947] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-27T18:50:34.444611] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T18:50:34.814955] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-27T18:50:35.198747] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-27T18:50:35.614961] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-27T18:50:36.414987] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-27T18:50:36.579865] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-27T18:50:36.746243] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-27T18:50:37.018226] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T18:50:37.214951] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-27T18:50:38.014943] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-27T18:50:38.239434] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T18:50:38.814946] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-27T18:50:39.250684] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T18:50:39.615018] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-27T18:50:39.998611] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T18:50:40.414980] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-27T18:50:41.214916] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-27T18:50:41.305041] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-27T18:50:41.456131] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-27T18:50:42.015021] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-27T18:50:42.550615] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T18:50:42.633502] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-27T18:50:42.814967] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-27T18:50:43.614945] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-27T18:50:44.086410] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-27T18:50:44.414979] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-27T18:50:44.926623] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-27T18:50:45.197792] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-27T18:50:45.201523] [INFO ] [REMOTE ] FPH: Full fetch complete (30857 records). [2025-10-27T18:50:45.201610] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-27T18:50:45.223055] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-27T18:50:45.574843] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-27T18:50:45.574916] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-27T18:50:45.575463] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-27T18:50:45.575503] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-27T18:50:45.576180] [DEBUG] [LOCAL ] FPH: Trimmed 30857 records to 19064 (keeping 200 days of data) [2025-10-27T18:50:45.676865] [DEBUG] [LOCAL ] FPH: Primary data saved (19064 records). [2025-10-27T18:50:45.676991] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-27T18:50:45.677066] [INFO ] [MAIN ] Update Progress: 864/2366 symbols completed. FPH took 23.9s. Estimated remaining: 3h 12m 28s. Rate: 7.8 symbols/min [2025-10-27T18:50:45.852080] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:50:45.893073] [DEBUG] [LOCAL ] FR: Loaded 47298 existing records from primary storage. [2025-10-27T18:50:45.893382] [INFO ] [MAIN ] FR: Loaded 47298 existing records. [2025-10-27T18:50:46.020061] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-27T18:50:46.076726] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:50:46.077245] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-27T18:50:46.077360] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-27T18:50:46.077667] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-27T18:50:46.077734] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-27T18:50:46.406687] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T18:50:46.462709] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:50:46.814910] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-27T18:50:47.615104] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-27T18:50:47.904308] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T18:50:47.909264] [INFO ] [REMOTE ] FPF: Full fetch complete (26579 records). [2025-10-27T18:50:47.909344] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-27T18:50:48.305078] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-27T18:50:48.305295] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-27T18:50:48.305864] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-27T18:50:48.306279] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-27T18:50:48.307254] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-27T18:50:48.317300] [DEBUG] [LOCAL ] FPF: Trimmed 26579 records to 18490 (keeping 200 days of data) [2025-10-27T18:50:48.317460] [INFO ] [REMOTE ] FOUR: Full fetch complete (72241 records). [2025-10-27T18:50:48.317880] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-27T18:50:48.427298] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-27T18:50:48.675612] [DEBUG] [LOCAL ] FPF: Primary data saved (18490 records). [2025-10-27T18:50:48.687893] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-27T18:50:48.708087] [INFO ] [MAIN ] Update Progress: 865/2366 symbols completed. FPF took 28.1s. Estimated remaining: 3h 12m 12s. Rate: 7.8 symbols/min [2025-10-27T18:50:48.936684] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-27T18:50:48.937078] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-27T18:50:48.938388] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-27T18:50:48.954143] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-27T18:50:49.009497] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:50:49.028287] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T18:50:49.035120] [DEBUG] [LOCAL ] FOUR: Trimmed 72241 records to 49574 (keeping 200 days of data) [2025-10-27T18:50:49.151352] [DEBUG] [LOCAL ] FRA: Loaded 14173 existing records from primary storage. [2025-10-27T18:50:49.159045] [INFO ] [MAIN ] FRA: Loaded 14173 existing records. [2025-10-27T18:50:49.239887] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-27T18:50:49.452185] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:50:49.452577] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-27T18:50:49.453170] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-27T18:50:49.454326] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-27T18:50:49.454399] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-27T18:50:49.801171] [DEBUG] [LOCAL ] FOUR: Primary data saved (49574 records). [2025-10-27T18:50:49.804757] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-27T18:50:49.805801] [INFO ] [MAIN ] Update Progress: 866/2366 symbols completed. FOUR took 37.5s. Estimated remaining: 3h 11m 53s. Rate: 7.8 symbols/min [2025-10-27T18:50:49.925520] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:50:50.022180] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-27T18:50:50.072511] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:50:50.077462] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T18:50:50.103508] [DEBUG] [LOCAL ] FRGE: Loaded 15673 existing records from primary storage. [2025-10-27T18:50:50.103777] [INFO ] [MAIN ] FRGE: Loaded 15673 existing records. [2025-10-27T18:50:50.281907] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:50:50.282055] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-27T18:50:50.282100] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-27T18:50:50.282248] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-27T18:50:50.282296] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-27T18:50:50.627607] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:50:50.764055] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T18:50:50.814905] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-27T18:50:51.132208] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-27T18:50:51.614906] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-27T18:50:52.012782] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-27T18:50:52.415001] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-27T18:50:53.150212] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-27T18:50:53.214899] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-27T18:50:53.751225] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T18:50:54.014957] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-27T18:50:54.814913] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-27T18:50:54.909607] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T18:50:55.023849] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-27T18:50:55.615002] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-27T18:50:55.926524] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T18:50:56.415006] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-27T18:50:56.752026] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T18:50:57.214986] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-27T18:50:57.762929] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T18:50:57.769862] [INFO ] [REMOTE ] FPI: Full fetch complete (43623 records). [2025-10-27T18:50:57.770057] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-27T18:50:58.017713] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-27T18:50:58.280678] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-27T18:50:58.280775] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-27T18:50:58.281682] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-27T18:50:58.281743] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-27T18:50:58.283195] [DEBUG] [LOCAL ] FPI: Trimmed 43623 records to 31057 (keeping 200 days of data) [2025-10-27T18:50:58.479108] [DEBUG] [LOCAL ] FPI: Primary data saved (31057 records). [2025-10-27T18:50:58.479253] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-27T18:50:58.479353] [INFO ] [MAIN ] Update Progress: 867/2366 symbols completed. FPI took 34.3s. Estimated remaining: 3h 11m 47s. Rate: 7.8 symbols/min [2025-10-27T18:50:58.685747] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:50:58.687450] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T18:50:58.742508] [DEBUG] [LOCAL ] FRO: Loaded 52440 existing records from primary storage. [2025-10-27T18:50:58.742853] [INFO ] [MAIN ] FRO: Loaded 52440 existing records. [2025-10-27T18:50:58.820177] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-27T18:50:58.921243] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:50:58.921453] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-27T18:50:58.921501] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-27T18:50:58.922237] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-27T18:50:58.922296] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-27T18:50:59.276588] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:50:59.341186] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T18:50:59.566257] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T18:50:59.615006] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-27T18:51:00.414962] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-27T18:51:01.214910] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-27T18:51:01.732050] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-27T18:51:01.993982] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T18:51:02.014965] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-27T18:51:02.423418] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-27T18:51:02.814937] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-27T18:51:03.083229] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-27T18:51:03.614952] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-27T18:51:04.041610] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-27T18:51:04.414954] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-27T18:51:04.513467] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T18:51:04.761673] [DEBUG] [REMOTE ] FR: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-27T18:51:04.762020] [WARN ] [REMOTE ] FR: No data returned for month 2025-07 [2025-10-27T18:51:04.762124] [FATAL] [REMOTE ] FR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T18:51:04.762216] [FATAL] [MAIN ] FR: Failed to fetch primary data. [2025-10-27T18:51:04.762285] [WARN ] [MAIN ] FR: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T18:51:04.762352] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-27T18:51:04.762413] [DEBUG] [LOCAL ] FR: No primary data file found to delete. [2025-10-27T18:51:04.762447] [INFO ] [LOCAL ] FR: Starting deletion of derivative data. [2025-10-27T18:51:04.763573] [DEBUG] [LOCAL ] FR: Deleted derivative data file. [2025-10-27T18:51:04.763677] [INFO ] [MAIN ] Update Progress: 868/2366 symbols completed. FR took 19.1s. Estimated remaining: 3h 11m 37s. Rate: 7.8 symbols/min [2025-10-27T18:51:04.935195] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:51:04.979344] [DEBUG] [LOCAL ] FRT: Loaded 41967 existing records from primary storage. [2025-10-27T18:51:04.979708] [INFO ] [MAIN ] FRT: Loaded 41967 existing records. [2025-10-27T18:51:05.158883] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:51:05.159086] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-27T18:51:05.159132] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-27T18:51:05.159437] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-27T18:51:05.159495] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-27T18:51:05.214911] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-27T18:51:05.528942] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:51:06.014938] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-27T18:51:06.814946] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-27T18:51:06.969810] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T18:51:07.242755] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-27T18:51:07.614949] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-27T18:51:08.165177] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T18:51:08.414911] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-27T18:51:08.595170] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T18:51:09.214910] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-27T18:51:09.397025] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-27T18:51:10.014960] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-27T18:51:10.814974] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-27T18:51:10.901194] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-27T18:51:11.614917] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-27T18:51:11.705134] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-27T18:51:11.968724] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-27T18:51:12.414914] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-27T18:51:12.483628] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T18:51:13.214950] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-27T18:51:13.795359] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-27T18:51:14.015496] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-27T18:51:14.018215] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T18:51:14.814937] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-27T18:51:15.558335] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-27T18:51:15.614911] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-27T18:51:15.673283] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T18:51:16.415004] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-27T18:51:16.607805] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T18:51:16.610777] [INFO ] [REMOTE ] FRA: Full fetch complete (23122 records). [2025-10-27T18:51:16.610853] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-27T18:51:16.978403] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-27T18:51:16.978487] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-27T18:51:16.978994] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-27T18:51:16.979057] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-27T18:51:16.979799] [DEBUG] [LOCAL ] FRA: Trimmed 23122 records to 13514 (keeping 200 days of data) [2025-10-27T18:51:17.061911] [DEBUG] [LOCAL ] FRA: Primary data saved (13514 records). [2025-10-27T18:51:17.062047] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-27T18:51:17.062126] [INFO ] [MAIN ] Update Progress: 869/2366 symbols completed. FRA took 28.3s. Estimated remaining: 3h 11m 37s. Rate: 7.8 symbols/min [2025-10-27T18:51:17.229113] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-27T18:51:17.232707] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:51:17.267667] [DEBUG] [LOCAL ] FSCO: Loaded 39084 existing records from primary storage. [2025-10-27T18:51:17.267982] [INFO ] [MAIN ] FSCO: Loaded 39084 existing records. [2025-10-27T18:51:17.446934] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:51:17.447140] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-27T18:51:17.447186] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-27T18:51:17.447717] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-27T18:51:17.447775] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-27T18:51:17.801479] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:51:18.014949] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-27T18:51:18.265361] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-27T18:51:18.814991] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-27T18:51:19.103060] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-27T18:51:19.387407] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T18:51:19.614946] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-27T18:51:19.843514] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-27T18:51:20.415012] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-27T18:51:20.923704] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T18:51:21.214947] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-27T18:51:22.014966] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-27T18:51:22.311017] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-27T18:51:22.715929] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T18:51:22.814926] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-27T18:51:23.571485] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T18:51:23.614940] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-27T18:51:24.250403] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-27T18:51:24.414946] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-27T18:51:25.101636] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T18:51:25.214966] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-27T18:51:25.367831] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T18:51:26.014928] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-27T18:51:26.044124] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T18:51:26.814939] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-27T18:51:26.919184] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-27T18:51:27.448435] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T18:51:27.451139] [INFO ] [REMOTE ] FRGE: Full fetch complete (29665 records). [2025-10-27T18:51:27.451212] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-27T18:51:27.628415] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-27T18:51:27.828291] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-27T18:51:27.828389] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-27T18:51:27.828943] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-27T18:51:27.829003] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-27T18:51:27.829689] [DEBUG] [LOCAL ] FRGE: Trimmed 29665 records to 15237 (keeping 200 days of data) [2025-10-27T18:51:27.917081] [DEBUG] [LOCAL ] FRGE: Primary data saved (15237 records). [2025-10-27T18:51:27.917206] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-27T18:51:27.917281] [INFO ] [MAIN ] Update Progress: 870/2366 symbols completed. FRGE took 38.1s. Estimated remaining: 3h 11m 35s. Rate: 7.8 symbols/min [2025-10-27T18:51:28.083102] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:51:28.130530] [DEBUG] [LOCAL ] FSK: Loaded 50191 existing records from primary storage. [2025-10-27T18:51:28.130859] [INFO ] [MAIN ] FSK: Loaded 50191 existing records. [2025-10-27T18:51:28.308489] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:51:28.308704] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-27T18:51:28.308788] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-27T18:51:28.309090] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-27T18:51:28.309129] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-27T18:51:28.420179] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-27T18:51:28.663761] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:51:29.010824] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-27T18:51:29.214932] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-27T18:51:30.014946] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-27T18:51:30.342016] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-27T18:51:30.468519] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T18:51:30.814955] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-27T18:51:30.968136] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T18:51:31.614956] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-27T18:51:32.297336] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T18:51:32.414962] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-27T18:51:33.024429] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T18:51:33.215024] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-27T18:51:33.998136] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T18:51:34.007872] [INFO ] [REMOTE ] FRO: Full fetch complete (75352 records). [2025-10-27T18:51:34.007991] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-27T18:51:34.021243] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-27T18:51:34.397841] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-27T18:51:34.397922] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-27T18:51:34.398894] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-27T18:51:34.398963] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-27T18:51:34.400408] [DEBUG] [LOCAL ] FRO: Trimmed 75352 records to 51628 (keeping 200 days of data) [2025-10-27T18:51:34.718301] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T18:51:34.746745] [DEBUG] [LOCAL ] FRO: Primary data saved (51628 records). [2025-10-27T18:51:34.746911] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-27T18:51:34.746999] [INFO ] [MAIN ] Update Progress: 871/2366 symbols completed. FRO took 36.3s. Estimated remaining: 3h 11m 26s. Rate: 7.8 symbols/min [2025-10-27T18:51:34.820569] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-27T18:51:34.916531] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:51:34.962820] [DEBUG] [LOCAL ] FSLY: Loaded 52033 existing records from primary storage. [2025-10-27T18:51:34.963117] [INFO ] [MAIN ] FSLY: Loaded 52033 existing records. [2025-10-27T18:51:35.177027] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:51:35.177390] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-27T18:51:35.177497] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-27T18:51:35.177734] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-27T18:51:35.177808] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-27T18:51:35.385364] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-27T18:51:35.566595] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:51:35.614918] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-27T18:51:36.170444] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T18:51:36.177754] [INFO ] [REMOTE ] FRT: Full fetch complete (60385 records). [2025-10-27T18:51:36.177858] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-27T18:51:36.420140] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-27T18:51:36.562479] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-27T18:51:36.562554] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-27T18:51:36.563348] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-27T18:51:36.563410] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-27T18:51:36.564524] [DEBUG] [LOCAL ] FRT: Trimmed 60385 records to 41110 (keeping 200 days of data) [2025-10-27T18:51:36.820804] [DEBUG] [LOCAL ] FRT: Primary data saved (41110 records). [2025-10-27T18:51:36.821140] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-27T18:51:36.821390] [INFO ] [MAIN ] Update Progress: 872/2366 symbols completed. FRT took 32.1s. Estimated remaining: 3h 11m 9s. Rate: 7.8 symbols/min [2025-10-27T18:51:36.989838] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:51:37.025989] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T18:51:37.079998] [DEBUG] [LOCAL ] FSM: Loaded 54078 existing records from primary storage. [2025-10-27T18:51:37.080327] [INFO ] [MAIN ] FSM: Loaded 54078 existing records. [2025-10-27T18:51:37.220113] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-27T18:51:37.259381] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:51:37.259593] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-27T18:51:37.259663] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-27T18:51:37.260064] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-27T18:51:37.260121] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-27T18:51:37.606731] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:51:38.014984] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-27T18:51:38.223639] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-27T18:51:38.814937] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-27T18:51:39.184586] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-27T18:51:39.592277] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T18:51:39.614898] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-27T18:51:40.355418] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-27T18:51:40.414895] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-27T18:51:41.103130] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-27T18:51:41.214893] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-27T18:51:42.014910] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-27T18:51:42.224245] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-27T18:51:42.814949] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-27T18:51:43.129474] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-27T18:51:43.614960] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-27T18:51:43.715116] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T18:51:43.724591] [INFO ] [REMOTE ] FSCO: Full fetch complete (55316 records). [2025-10-27T18:51:43.724830] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-27T18:51:44.112182] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-27T18:51:44.112269] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-27T18:51:44.113098] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-27T18:51:44.113161] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-27T18:51:44.114841] [DEBUG] [LOCAL ] FSCO: Trimmed 55316 records to 38336 (keeping 200 days of data) [2025-10-27T18:51:44.342019] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T18:51:44.379807] [DEBUG] [LOCAL ] FSCO: Primary data saved (38336 records). [2025-10-27T18:51:44.379951] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-27T18:51:44.380446] [INFO ] [MAIN ] Update Progress: 873/2366 symbols completed. FSCO took 27.3s. Estimated remaining: 3h 11m 1s. Rate: 7.8 symbols/min [2025-10-27T18:51:44.421949] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-27T18:51:44.548753] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:51:44.586563] [DEBUG] [LOCAL ] FSS: Loaded 33423 existing records from primary storage. [2025-10-27T18:51:44.586926] [INFO ] [MAIN ] FSS: Loaded 33423 existing records. [2025-10-27T18:51:44.777730] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:51:44.777953] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-27T18:51:44.778003] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-27T18:51:44.778200] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-27T18:51:44.778240] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-27T18:51:45.193520] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:51:45.214947] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-27T18:51:45.583494] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-27T18:51:46.014906] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-27T18:51:46.191219] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-27T18:51:46.814935] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-27T18:51:46.951390] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-27T18:51:47.506112] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T18:51:47.614903] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-27T18:51:48.415029] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-27T18:51:48.662823] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-27T18:51:48.889370] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T18:51:49.215002] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-27T18:51:49.978319] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T18:51:50.014922] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-27T18:51:50.814978] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-27T18:51:50.848675] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T18:51:51.614971] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-27T18:51:51.795834] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-27T18:51:51.955983] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T18:51:52.414948] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-27T18:51:53.214928] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-27T18:51:53.342018] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-27T18:51:54.014969] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-27T18:51:54.229223] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-27T18:51:54.814991] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-27T18:51:55.271024] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-27T18:51:55.614972] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-27T18:51:55.737199] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T18:51:56.414925] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-27T18:51:56.643316] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-27T18:51:57.220629] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-27T18:51:57.226303] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T18:51:57.707468] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-27T18:51:58.014981] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-27T18:51:58.461247] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T18:51:58.814963] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-27T18:51:59.614918] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-27T18:51:59.844268] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-27T18:52:00.414944] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-27T18:52:00.461222] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T18:52:01.214946] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-27T18:52:01.578128] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-27T18:52:01.775770] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-27T18:52:01.786206] [INFO ] [REMOTE ] FSK: Full fetch complete (72144 records). [2025-10-27T18:52:01.786364] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-27T18:52:02.023608] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-27T18:52:02.181304] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-27T18:52:02.181379] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-27T18:52:02.182261] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-27T18:52:02.182322] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-27T18:52:02.183718] [DEBUG] [LOCAL ] FSK: Trimmed 72144 records to 49397 (keeping 200 days of data) [2025-10-27T18:52:02.471344] [DEBUG] [LOCAL ] FSK: Primary data saved (49397 records). [2025-10-27T18:52:02.472012] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-27T18:52:02.472925] [INFO ] [MAIN ] Update Progress: 874/2366 symbols completed. FSK took 34.6s. Estimated remaining: 3h 11m 11s. Rate: 7.8 symbols/min [2025-10-27T18:52:02.640768] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:52:02.649499] [DEBUG] [LOCAL ] FT: Loaded 6909 existing records from primary storage. [2025-10-27T18:52:02.649734] [INFO ] [MAIN ] FT: Loaded 6909 existing records. [2025-10-27T18:52:02.828219] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:52:02.828724] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-27T18:52:02.828481] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-27T18:52:02.828942] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-27T18:52:02.830165] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-27T18:52:02.830245] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-27T18:52:03.193213] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-27T18:52:03.213957] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:52:03.316329] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-27T18:52:03.614968] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-27T18:52:04.414987] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-27T18:52:05.151215] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-27T18:52:05.161346] [INFO ] [REMOTE ] FSM: Full fetch complete (77207 records). [2025-10-27T18:52:05.161464] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-27T18:52:05.224462] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-27T18:52:05.565211] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-27T18:52:05.565414] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-27T18:52:05.566453] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-27T18:52:05.566664] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-27T18:52:05.594777] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T18:52:05.593542] [DEBUG] [LOCAL ] FSM: Trimmed 77207 records to 53298 (keeping 200 days of data) [2025-10-27T18:52:05.605601] [INFO ] [REMOTE ] FSLY: Full fetch complete (74876 records). [2025-10-27T18:52:05.605808] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-27T18:52:05.853473] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-27T18:52:06.033469] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-27T18:52:06.033399] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T18:52:06.352289] [DEBUG] [LOCAL ] FSM: Primary data saved (53298 records). [2025-10-27T18:52:06.370622] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-27T18:52:06.370434] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-27T18:52:06.370806] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-27T18:52:06.371776] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-27T18:52:06.371941] [INFO ] [MAIN ] Update Progress: 875/2366 symbols completed. FSM took 29.6s. Estimated remaining: 3h 10m 57s. Rate: 7.8 symbols/min [2025-10-27T18:52:06.372212] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-27T18:52:06.480595] [DEBUG] [LOCAL ] FSLY: Trimmed 74876 records to 51237 (keeping 200 days of data) [2025-10-27T18:52:06.641991] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:52:06.736350] [DEBUG] [LOCAL ] FTHY: Loaded 12452 existing records from primary storage. [2025-10-27T18:52:06.764047] [INFO ] [MAIN ] FTHY: Loaded 12452 existing records. [2025-10-27T18:52:06.797037] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T18:52:06.834927] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-27T18:52:07.025843] [DEBUG] [LOCAL ] FSLY: Primary data saved (51237 records). [2025-10-27T18:52:07.031468] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-27T18:52:07.056119] [INFO ] [MAIN ] Update Progress: 876/2366 symbols completed. FSLY took 32.3s. Estimated remaining: 3h 10m 37s. Rate: 7.8 symbols/min [2025-10-27T18:52:07.060441] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:52:07.104130] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-27T18:52:07.124415] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-27T18:52:07.140867] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-27T18:52:07.151279] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-27T18:52:07.362018] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:52:07.592111] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:52:07.625297] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-27T18:52:07.627965] [DEBUG] [LOCAL ] FTI: Loaded 54073 existing records from primary storage. [2025-10-27T18:52:07.628230] [INFO ] [MAIN ] FTI: Loaded 54073 existing records. [2025-10-27T18:52:07.803275] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:52:07.803488] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-27T18:52:07.803538] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-27T18:52:07.803753] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-27T18:52:07.803826] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-27T18:52:08.167150] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:52:08.266060] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-27T18:52:08.269031] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T18:52:08.414923] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-27T18:52:09.214989] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-27T18:52:09.924890] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T18:52:10.014923] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-27T18:52:10.405846] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T18:52:10.814948] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-27T18:52:11.074789] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T18:52:11.498941] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-27T18:52:11.614949] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-27T18:52:12.414956] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-27T18:52:12.664271] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-27T18:52:13.214939] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-27T18:52:13.957154] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T18:52:14.014953] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-27T18:52:14.052214] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-27T18:52:14.541760] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-27T18:52:14.814955] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-27T18:52:15.614968] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-27T18:52:16.082360] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-27T18:52:16.414920] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-27T18:52:16.622617] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-27T18:52:17.144953] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T18:52:17.214974] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-27T18:52:17.651905] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-27T18:52:18.014922] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-27T18:52:18.653284] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-27T18:52:18.814965] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-27T18:52:19.602712] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-27T18:52:19.614907] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-27T18:52:20.414959] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-27T18:52:20.968893] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T18:52:20.974597] [INFO ] [REMOTE ] FSS: Full fetch complete (48294 records). [2025-10-27T18:52:20.974733] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-27T18:52:21.220086] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-27T18:52:21.392840] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-27T18:52:21.392920] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-27T18:52:21.393594] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-27T18:52:21.393679] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-27T18:52:21.394752] [DEBUG] [LOCAL ] FSS: Trimmed 48294 records to 32611 (keeping 200 days of data) [2025-10-27T18:52:21.602768] [DEBUG] [LOCAL ] FSS: Primary data saved (32611 records). [2025-10-27T18:52:21.602915] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-27T18:52:21.603335] [INFO ] [MAIN ] Update Progress: 877/2366 symbols completed. FSS took 37.2s. Estimated remaining: 3h 10m 41s. Rate: 7.8 symbols/min [2025-10-27T18:52:21.719241] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-27T18:52:21.848264] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T18:52:22.014946] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-27T18:52:22.815008] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-27T18:52:23.614920] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-27T18:52:23.853489] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-27T18:52:23.875813] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T18:52:24.226002] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T18:52:24.228531] [INFO ] [REMOTE ] FT: Full fetch complete (9324 records). [2025-10-27T18:52:24.228605] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-27T18:52:24.420126] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-27T18:52:24.604266] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-27T18:52:24.604338] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-27T18:52:24.604561] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-27T18:52:24.604598] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-27T18:52:24.605030] [DEBUG] [LOCAL ] FT: Trimmed 9324 records to 6749 (keeping 200 days of data) [2025-10-27T18:52:24.643667] [DEBUG] [LOCAL ] FT: Primary data saved (6749 records). [2025-10-27T18:52:24.643786] [INFO ] [MAIN ] FT: Full history saved. [2025-10-27T18:52:24.643862] [INFO ] [MAIN ] Update Progress: 878/2366 symbols completed. FT took 22.2s. Estimated remaining: 3h 10m 26s. Rate: 7.8 symbols/min [2025-10-27T18:52:25.215013] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-27T18:52:25.955535] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-27T18:52:26.014904] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-27T18:52:26.273694] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-27T18:52:26.767534] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-27T18:52:26.814914] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-27T18:52:27.615005] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-27T18:52:27.630959] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T18:52:28.414946] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-27T18:52:29.190173] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-27T18:52:29.214903] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-27T18:52:29.451639] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T18:52:29.961273] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-27T18:52:30.014917] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-27T18:52:30.782978] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T18:52:30.786002] [INFO ] [REMOTE ] FTHY: Full fetch complete (17264 records). [2025-10-27T18:52:30.786073] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-27T18:52:30.828384] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-27T18:52:31.143467] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-27T18:52:31.143539] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-27T18:52:31.143925] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-27T18:52:31.143985] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-27T18:52:31.144468] [DEBUG] [LOCAL ] FTHY: Trimmed 17264 records to 12001 (keeping 200 days of data) [2025-10-27T18:52:31.214548] [DEBUG] [LOCAL ] FTHY: Primary data saved (12001 records). [2025-10-27T18:52:31.214699] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-27T18:52:31.214806] [INFO ] [MAIN ] Update Progress: 879/2366 symbols completed. FTHY took 24.8s. Estimated remaining: 3h 10m 16s. Rate: 7.8 symbols/min [2025-10-27T18:52:32.363699] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-27T18:52:32.374868] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-27T18:52:33.992609] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T18:52:34.005501] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-27T18:52:35.956021] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-27T18:52:35.966295] [INFO ] [REMOTE ] FTI: Full fetch complete (77334 records). [2025-10-27T18:52:35.966444] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-27T18:52:36.352260] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-27T18:52:36.352355] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-27T18:52:36.353344] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-27T18:52:36.353406] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-27T18:52:36.354769] [DEBUG] [LOCAL ] FTI: Trimmed 77334 records to 53292 (keeping 200 days of data) [2025-10-27T18:52:36.669554] [DEBUG] [LOCAL ] FTI: Primary data saved (53292 records). [2025-10-27T18:52:36.669708] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-27T18:52:36.669794] [INFO ] [MAIN ] Update Progress: 880/2366 symbols completed. FTI took 29.6s. Estimated remaining: 3h 10m 5s. Rate: 7.8 symbols/min [2025-10-27T18:52:37.192668] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:52:37.333541] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:52:37.341131] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:52:37.390703] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:52:37.396383] [DEBUG] [LOCAL ] FTWO: Loaded 1980 existing records from primary storage. [2025-10-27T18:52:37.396857] [INFO ] [MAIN ] FTWO: Loaded 1980 existing records. [2025-10-27T18:52:37.519157] [DEBUG] [LOCAL ] FTK: Loaded 33491 existing records from primary storage. [2025-10-27T18:52:37.541579] [INFO ] [MAIN ] FTK: Loaded 33491 existing records. [2025-10-27T18:52:37.843311] [DEBUG] [LOCAL ] FTS: Loaded 43082 existing records from primary storage. [2025-10-27T18:52:37.873275] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:52:37.886585] [INFO ] [MAIN ] FTS: Loaded 43082 existing records. [2025-10-27T18:52:37.892302] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-27T18:52:37.875671] [DEBUG] [LOCAL ] FTV: Loaded 53787 existing records from primary storage. [2025-10-27T18:52:37.919148] [INFO ] [MAIN ] FTV: Loaded 53787 existing records. [2025-10-27T18:52:37.913516] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-27T18:52:38.032118] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-27T18:52:38.113359] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:52:38.159422] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-27T18:52:38.192910] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-27T18:52:38.284794] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-27T18:52:38.432224] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-27T18:52:38.489041] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-27T18:52:38.523280] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:52:38.641897] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-27T18:52:38.725910] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-27T18:52:38.707699] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:52:38.792135] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-27T18:52:38.842616] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-27T18:52:38.853702] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-27T18:52:38.860706] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-27T18:52:38.866029] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-27T18:52:38.905299] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-27T18:52:39.676065] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:52:39.765193] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:52:39.793242] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-27T18:52:39.816065] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-27T18:52:40.017154] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:52:40.023781] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-27T18:52:40.105438] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:52:40.105856] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-27T18:52:40.191905] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-27T18:52:40.193749] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-27T18:52:40.772954] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T18:52:40.774217] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-27T18:52:40.929400] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-27T18:52:40.935063] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-27T18:52:41.066695] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-27T18:52:41.068058] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-27T18:52:41.122497] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T18:52:41.130339] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-27T18:52:41.358204] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-27T18:52:41.368472] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-27T18:52:41.441441] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-27T18:52:41.442496] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-27T18:52:41.551147] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T18:52:41.715691] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-27T18:52:42.014919] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-27T18:52:42.138979] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-27T18:52:42.677812] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T18:52:42.811161] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-27T18:52:42.816763] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-27T18:52:43.614943] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-27T18:52:43.954993] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T18:52:44.282943] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-27T18:52:44.414934] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-27T18:52:45.214930] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-27T18:52:45.884198] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T18:52:46.014911] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-27T18:52:46.814910] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-27T18:52:47.096695] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-27T18:52:47.147130] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-27T18:52:47.148266] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T18:52:47.614927] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-27T18:52:48.414928] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-27T18:52:48.595127] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-27T18:52:48.841618] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-27T18:52:49.214944] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-27T18:52:50.014949] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-27T18:52:50.450374] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-27T18:52:50.792206] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T18:52:50.814894] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-27T18:52:51.614981] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-27T18:52:51.887617] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-27T18:52:52.414927] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-27T18:52:52.623388] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-27T18:52:53.048689] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T18:52:53.049870] [INFO ] [REMOTE ] FTWO: Full fetch complete (3311 records). [2025-10-27T18:52:53.049939] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-27T18:52:53.215864] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-27T18:52:53.402207] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-27T18:52:53.402288] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-27T18:52:53.402419] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-27T18:52:53.402458] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-27T18:52:53.402822] [DEBUG] [LOCAL ] FTWO: Trimmed 3311 records to 1917 (keeping 200 days of data) [2025-10-27T18:52:53.414604] [DEBUG] [LOCAL ] FTWO: Primary data saved (1917 records). [2025-10-27T18:52:53.414694] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-27T18:52:53.414789] [INFO ] [MAIN ] Update Progress: 881/2366 symbols completed. FTWO took 16.7s. Estimated remaining: 3h 10m 12s. Rate: 7.8 symbols/min [2025-10-27T18:52:53.588938] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:52:53.642442] [DEBUG] [LOCAL ] FUBO: Loaded 54493 existing records from primary storage. [2025-10-27T18:52:53.642841] [INFO ] [MAIN ] FUBO: Loaded 54493 existing records. [2025-10-27T18:52:53.839981] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:52:53.840204] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-27T18:52:53.840257] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-27T18:52:53.840624] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-27T18:52:53.840716] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-27T18:52:54.020028] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-27T18:52:54.230768] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:52:54.814979] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-27T18:52:54.907971] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-27T18:52:55.149528] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T18:52:55.615008] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-27T18:52:55.831348] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-27T18:52:56.415007] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-27T18:52:57.214934] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-27T18:52:57.250309] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-27T18:52:57.806700] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-27T18:52:58.014949] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-27T18:52:58.815002] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-27T18:52:59.614975] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-27T18:52:59.672633] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T18:52:59.679455] [INFO ] [REMOTE ] FTK: Full fetch complete (44160 records). [2025-10-27T18:52:59.679614] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-27T18:52:59.784527] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-27T18:53:00.138492] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-27T18:53:00.138598] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-27T18:53:00.139294] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-27T18:53:00.139373] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-27T18:53:00.141473] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-27T18:53:00.151119] [DEBUG] [LOCAL ] FTK: Trimmed 44160 records to 33051 (keeping 200 days of data) [2025-10-27T18:53:00.343287] [DEBUG] [LOCAL ] FTK: Primary data saved (33051 records). [2025-10-27T18:53:00.343418] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-27T18:53:00.343499] [INFO ] [MAIN ] Update Progress: 882/2366 symbols completed. FTK took 23.7s. Estimated remaining: 3h 10m 3s. Rate: 7.8 symbols/min [2025-10-27T18:53:00.420099] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-27T18:53:00.542818] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:53:00.576726] [DEBUG] [LOCAL ] FUL: Loaded 32473 existing records from primary storage. [2025-10-27T18:53:00.577089] [INFO ] [MAIN ] FUL: Loaded 32473 existing records. [2025-10-27T18:53:00.756482] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:53:00.756728] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-27T18:53:00.756813] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-27T18:53:00.757021] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-27T18:53:00.757060] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-27T18:53:01.113389] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:53:01.214982] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-27T18:53:01.641341] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-27T18:53:02.014946] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-27T18:53:02.776435] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-27T18:53:02.778145] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T18:53:02.814898] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-27T18:53:03.587134] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T18:53:03.614890] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-27T18:53:03.768397] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T18:53:04.414999] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-27T18:53:05.215196] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-27T18:53:05.242540] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T18:53:06.014954] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-27T18:53:06.369849] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-27T18:53:06.814940] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-27T18:53:06.998220] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-27T18:53:07.242894] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T18:53:07.614992] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-27T18:53:08.414951] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-27T18:53:08.568316] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T18:53:08.578437] [INFO ] [REMOTE ] FTV: Full fetch complete (76610 records). [2025-10-27T18:53:08.578620] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-27T18:53:08.984346] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-27T18:53:08.984453] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-27T18:53:08.985506] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-27T18:53:08.985599] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-27T18:53:08.987223] [DEBUG] [LOCAL ] FTV: Trimmed 76610 records to 52997 (keeping 200 days of data) [2025-10-27T18:53:09.224705] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-27T18:53:09.251500] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-27T18:53:09.341630] [DEBUG] [LOCAL ] FTV: Primary data saved (52997 records). [2025-10-27T18:53:09.341803] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-27T18:53:09.342604] [INFO ] [MAIN ] Update Progress: 883/2366 symbols completed. FTV took 32.6s. Estimated remaining: 3h 9m 58s. Rate: 7.8 symbols/min [2025-10-27T18:53:09.505585] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:53:09.554774] [DEBUG] [LOCAL ] FUN: Loaded 52795 existing records from primary storage. [2025-10-27T18:53:09.555094] [INFO ] [MAIN ] FUN: Loaded 52795 existing records. [2025-10-27T18:53:09.728700] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:53:09.728911] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-27T18:53:09.728964] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-27T18:53:09.729152] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-27T18:53:09.729207] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-27T18:53:10.020084] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-27T18:53:10.081099] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:53:10.249973] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-27T18:53:10.730785] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T18:53:10.814943] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-27T18:53:11.521304] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T18:53:11.614937] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-27T18:53:12.019262] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-27T18:53:12.414995] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-27T18:53:13.132351] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T18:53:13.214906] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-27T18:53:13.777181] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-27T18:53:13.785932] [INFO ] [REMOTE ] FTS: Full fetch complete (60934 records). [2025-10-27T18:53:13.786050] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-27T18:53:14.020481] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-27T18:53:14.221371] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-27T18:53:14.221469] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-27T18:53:14.222494] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-27T18:53:14.222570] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-27T18:53:14.223877] [DEBUG] [LOCAL ] FTS: Trimmed 60934 records to 42295 (keeping 200 days of data) [2025-10-27T18:53:14.497144] [DEBUG] [LOCAL ] FTS: Primary data saved (42295 records). [2025-10-27T18:53:14.497271] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-27T18:53:14.497349] [INFO ] [MAIN ] Update Progress: 884/2366 symbols completed. FTS took 37.8s. Estimated remaining: 3h 9m 46s. Rate: 7.8 symbols/min [2025-10-27T18:53:14.706578] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:53:14.723058] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T18:53:14.752235] [DEBUG] [LOCAL ] FVR: Loaded 21021 existing records from primary storage. [2025-10-27T18:53:14.752490] [INFO ] [MAIN ] FVR: Loaded 21021 existing records. [2025-10-27T18:53:14.825990] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-27T18:53:14.957504] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:53:14.957730] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-27T18:53:14.957785] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-27T18:53:14.957947] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-27T18:53:14.957986] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-27T18:53:15.350885] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:53:15.614944] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-27T18:53:15.815638] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-27T18:53:16.416636] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-27T18:53:16.422692] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-27T18:53:17.214949] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-27T18:53:17.427634] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-27T18:53:17.470019] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T18:53:18.014948] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-27T18:53:18.814921] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-27T18:53:19.306678] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-27T18:53:19.614979] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-27T18:53:19.760365] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-27T18:53:20.279032] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T18:53:20.414917] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-27T18:53:21.214991] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-27T18:53:21.954053] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-27T18:53:21.978687] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T18:53:22.015342] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-27T18:53:22.017017] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-27T18:53:22.814974] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-27T18:53:23.130928] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-27T18:53:23.614942] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-27T18:53:24.414916] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-27T18:53:24.823283] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T18:53:24.914745] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-27T18:53:25.215004] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-27T18:53:25.632358] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-27T18:53:26.015013] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-27T18:53:26.142910] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-27T18:53:26.778944] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-27T18:53:26.814935] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-27T18:53:27.502932] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-27T18:53:27.614951] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-27T18:53:28.414961] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-27T18:53:28.926918] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T18:53:28.933186] [INFO ] [REMOTE ] FUL: Full fetch complete (47811 records). [2025-10-27T18:53:28.933278] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-27T18:53:29.224324] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-27T18:53:29.324398] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-27T18:53:29.324491] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-27T18:53:29.325190] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-27T18:53:29.325252] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-27T18:53:29.326260] [DEBUG] [LOCAL ] FUL: Trimmed 47811 records to 31762 (keeping 200 days of data) [2025-10-27T18:53:29.515900] [DEBUG] [LOCAL ] FUL: Primary data saved (31762 records). [2025-10-27T18:53:29.516028] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-27T18:53:29.516432] [INFO ] [MAIN ] Update Progress: 885/2366 symbols completed. FUL took 29.2s. Estimated remaining: 3h 9m 50s. Rate: 7.8 symbols/min [2025-10-27T18:53:29.687519] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:53:29.725803] [DEBUG] [LOCAL ] FVRR: Loaded 41105 existing records from primary storage. [2025-10-27T18:53:29.726167] [INFO ] [MAIN ] FVRR: Loaded 41105 existing records. [2025-10-27T18:53:29.912766] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:53:29.912958] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-27T18:53:29.913006] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-27T18:53:29.913196] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-27T18:53:29.913253] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-27T18:53:30.020016] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-27T18:53:30.276049] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:53:30.312043] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-27T18:53:30.814981] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-27T18:53:30.932659] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T18:53:31.055114] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-27T18:53:31.614935] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-27T18:53:32.128962] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T18:53:32.414946] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-27T18:53:33.214954] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-27T18:53:33.906946] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-27T18:53:33.917446] [INFO ] [REMOTE ] FUBO: Full fetch complete (77865 records). [2025-10-27T18:53:33.917594] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-27T18:53:34.016398] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-27T18:53:34.236015] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-27T18:53:34.349139] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-27T18:53:34.349227] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-27T18:53:34.350170] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-27T18:53:34.350235] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-27T18:53:34.351717] [DEBUG] [LOCAL ] FUBO: Trimmed 77865 records to 53714 (keeping 200 days of data) [2025-10-27T18:53:34.661114] [DEBUG] [LOCAL ] FUBO: Primary data saved (53714 records). [2025-10-27T18:53:34.661239] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-27T18:53:34.661314] [INFO ] [MAIN ] Update Progress: 886/2366 symbols completed. FUBO took 41.2s. Estimated remaining: 3h 9m 38s. Rate: 7.8 symbols/min [2025-10-27T18:53:34.828778] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:53:34.828965] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-27T18:53:34.844866] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-27T18:53:34.846465] [DEBUG] [LOCAL ] FXED: Loaded 1249 existing records from primary storage. [2025-10-27T18:53:34.852011] [INFO ] [MAIN ] FXED: Loaded 1249 existing records. [2025-10-27T18:53:35.056707] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:53:35.058798] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-27T18:53:35.069374] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-27T18:53:35.069529] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-27T18:53:35.070263] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-27T18:53:35.070321] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-27T18:53:35.411957] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:53:35.615004] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-27T18:53:36.415490] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-27T18:53:36.420508] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T18:53:36.723562] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-27T18:53:37.214957] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-27T18:53:37.667488] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-27T18:53:37.677621] [INFO ] [REMOTE ] FUN: Full fetch complete (73694 records). [2025-10-27T18:53:37.677789] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-27T18:53:38.024342] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-27T18:53:38.061297] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-27T18:53:38.061398] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-27T18:53:38.062505] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-27T18:53:38.062681] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-27T18:53:38.064198] [DEBUG] [LOCAL ] FUN: Trimmed 73694 records to 52033 (keeping 200 days of data) [2025-10-27T18:53:38.385469] [DEBUG] [LOCAL ] FUN: Primary data saved (52033 records). [2025-10-27T18:53:38.386201] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-27T18:53:38.387001] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T18:53:38.387144] [INFO ] [MAIN ] Update Progress: 887/2366 symbols completed. FUN took 29.0s. Estimated remaining: 3h 9m 24s. Rate: 7.8 symbols/min [2025-10-27T18:53:38.571488] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:53:38.616560] [DEBUG] [LOCAL ] G: Loaded 50825 existing records from primary storage. [2025-10-27T18:53:38.616898] [INFO ] [MAIN ] G: Loaded 50825 existing records. [2025-10-27T18:53:38.790493] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:53:38.790776] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-27T18:53:38.790825] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-27T18:53:38.790988] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-27T18:53:38.791025] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-27T18:53:38.820828] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-27T18:53:39.151392] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-27T18:53:39.149185] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:53:39.164570] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T18:53:39.614983] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-27T18:53:40.415048] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-27T18:53:40.786682] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T18:53:41.214999] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-27T18:53:41.446849] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-27T18:53:41.824450] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-27T18:53:42.014961] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-27T18:53:42.352223] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-27T18:53:42.814992] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-27T18:53:43.614952] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-27T18:53:43.996584] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T18:53:44.414985] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-27T18:53:45.219194] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-27T18:53:45.224526] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-27T18:53:45.542270] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T18:53:46.014971] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-27T18:53:46.199936] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-27T18:53:46.814936] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-27T18:53:47.223711] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-27T18:53:47.614967] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-27T18:53:47.667674] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T18:53:47.972269] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-27T18:53:48.414918] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-27T18:53:48.708601] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-27T18:53:49.215008] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-27T18:53:49.726153] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-27T18:53:50.014978] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-27T18:53:50.815012] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-27T18:53:51.298368] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T18:53:51.316849] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-27T18:53:51.614953] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-27T18:53:52.340786] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T18:53:52.344114] [INFO ] [REMOTE ] FVR: Full fetch complete (29183 records). [2025-10-27T18:53:52.344184] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-27T18:53:52.420179] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-27T18:53:52.705663] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-27T18:53:52.705753] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-27T18:53:52.706295] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-27T18:53:52.706335] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-27T18:53:52.707075] [DEBUG] [LOCAL ] FVR: Trimmed 29183 records to 20577 (keeping 200 days of data) [2025-10-27T18:53:52.828497] [DEBUG] [LOCAL ] FVR: Primary data saved (20577 records). [2025-10-27T18:53:52.828616] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-27T18:53:52.828729] [INFO ] [MAIN ] Update Progress: 888/2366 symbols completed. FVR took 38.3s. Estimated remaining: 3h 9m 28s. Rate: 7.8 symbols/min [2025-10-27T18:53:52.994709] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:53:53.022400] [DEBUG] [LOCAL ] GAB: Loaded 27743 existing records from primary storage. [2025-10-27T18:53:53.022662] [INFO ] [MAIN ] GAB: Loaded 27743 existing records. [2025-10-27T18:53:53.194789] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:53:53.194981] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-27T18:53:53.195028] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-27T18:53:53.195198] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-27T18:53:53.195237] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-27T18:53:53.225151] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-27T18:53:53.563549] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:53:54.014945] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-27T18:53:54.148505] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T18:53:54.614318] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-27T18:53:54.615339] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T18:53:54.626141] [INFO ] [REMOTE ] FXED: Full fetch complete (1783 records). [2025-10-27T18:53:54.626632] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-27T18:53:54.824009] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-27T18:53:54.984681] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-27T18:53:54.984773] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-27T18:53:54.984875] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-27T18:53:54.984913] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-27T18:53:54.985306] [DEBUG] [LOCAL ] FXED: Trimmed 1783 records to 1221 (keeping 200 days of data) [2025-10-27T18:53:54.993287] [DEBUG] [LOCAL ] FXED: Primary data saved (1221 records). [2025-10-27T18:53:54.993358] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-27T18:53:54.993430] [INFO ] [MAIN ] Update Progress: 889/2366 symbols completed. FXED took 20.3s. Estimated remaining: 3h 9m 11s. Rate: 7.8 symbols/min [2025-10-27T18:53:55.156298] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:53:55.162367] [DEBUG] [LOCAL ] GAM: Loaded 3866 existing records from primary storage. [2025-10-27T18:53:55.162531] [INFO ] [MAIN ] GAM: Loaded 3866 existing records. [2025-10-27T18:53:55.333183] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:53:55.333387] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-27T18:53:55.333432] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-27T18:53:55.333560] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-27T18:53:55.333596] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-27T18:53:55.620088] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-27T18:53:55.683355] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:53:56.002161] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T18:53:56.415013] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-27T18:53:56.601749] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T18:53:57.215008] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-27T18:53:58.014955] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-27T18:53:58.149499] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-27T18:53:58.686395] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-27T18:53:58.814956] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-27T18:53:58.989392] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-27T18:53:58.997564] [INFO ] [REMOTE ] FVRR: Full fetch complete (59301 records). [2025-10-27T18:53:58.997751] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-27T18:53:59.382216] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-27T18:53:59.382295] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-27T18:53:59.383080] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-27T18:53:59.383141] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-27T18:53:59.384248] [DEBUG] [LOCAL ] FVRR: Trimmed 59301 records to 40434 (keeping 200 days of data) [2025-10-27T18:53:59.624544] [DEBUG] [LOCAL ] FVRR: Primary data saved (40434 records). [2025-10-27T18:53:59.626364] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-27T18:53:59.628434] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-27T18:53:59.627121] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-27T18:53:59.634452] [INFO ] [MAIN ] Update Progress: 890/2366 symbols completed. FVRR took 30.1s. Estimated remaining: 3h 8m 58s. Rate: 7.8 symbols/min [2025-10-27T18:53:59.822519] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:53:59.884900] [DEBUG] [LOCAL ] GAP: Loaded 54433 existing records from primary storage. [2025-10-27T18:53:59.885213] [INFO ] [MAIN ] GAP: Loaded 54433 existing records. [2025-10-27T18:54:00.067985] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:54:00.068191] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-27T18:54:00.068237] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-27T18:54:00.068575] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-27T18:54:00.068676] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-27T18:54:00.418127] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-27T18:54:00.418049] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:54:01.155011] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T18:54:01.214955] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-27T18:54:01.477171] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-27T18:54:02.014981] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-27T18:54:02.762323] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T18:54:02.814939] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-27T18:54:03.085752] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T18:54:03.614928] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-27T18:54:03.969078] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-27T18:54:04.343096] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T18:54:04.414925] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-27T18:54:05.214935] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-27T18:54:06.015040] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-27T18:54:06.214386] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-27T18:54:06.258224] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-27T18:54:06.596328] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T18:54:06.814951] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-27T18:54:07.614955] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-27T18:54:08.210055] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-27T18:54:08.410820] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T18:54:08.420504] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-27T18:54:09.214951] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-27T18:54:09.264315] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-27T18:54:10.014950] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-27T18:54:10.814975] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-27T18:54:11.147195] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-27T18:54:11.379252] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T18:54:11.426254] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T18:54:11.614959] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-27T18:54:12.414993] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-27T18:54:13.073171] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-27T18:54:13.082896] [INFO ] [REMOTE ] G: Full fetch complete (72330 records). [2025-10-27T18:54:13.083014] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-27T18:54:13.224723] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-27T18:54:13.485345] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-27T18:54:13.494839] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-27T18:54:13.497415] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T18:54:13.496365] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-27T18:54:13.503505] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-27T18:54:13.505227] [DEBUG] [LOCAL ] G: Trimmed 72330 records to 50010 (keeping 200 days of data) [2025-10-27T18:54:13.812857] [DEBUG] [LOCAL ] G: Primary data saved (50010 records). [2025-10-27T18:54:13.812992] [INFO ] [MAIN ] G: Full history saved. [2025-10-27T18:54:13.813104] [INFO ] [MAIN ] Update Progress: 891/2366 symbols completed. G took 35.4s. Estimated remaining: 3h 9m 1s. Rate: 7.8 symbols/min [2025-10-27T18:54:13.931628] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-27T18:54:14.018620] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:54:14.018725] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-27T18:54:14.041157] [DEBUG] [LOCAL ] GATX: Loaded 18267 existing records from primary storage. [2025-10-27T18:54:14.041456] [INFO ] [MAIN ] GATX: Loaded 18267 existing records. [2025-10-27T18:54:14.238478] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:54:14.238717] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-27T18:54:14.238773] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-27T18:54:14.239024] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-27T18:54:14.239063] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-27T18:54:14.586959] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:54:14.814946] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-27T18:54:15.231270] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-27T18:54:15.417467] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-27T18:54:15.614918] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-27T18:54:16.414931] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-27T18:54:16.467425] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-27T18:54:17.214961] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-27T18:54:17.860838] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-27T18:54:18.014931] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-27T18:54:18.366115] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-27T18:54:18.706579] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-27T18:54:18.814930] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-27T18:54:19.614933] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-27T18:54:19.926610] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-27T18:54:20.414909] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-27T18:54:20.802525] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-27T18:54:21.214972] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-27T18:54:22.014923] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-27T18:54:22.183165] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T18:54:22.352633] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-27T18:54:22.814933] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-27T18:54:23.032950] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-27T18:54:23.614917] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-27T18:54:23.818722] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T18:54:24.029937] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-27T18:54:24.415033] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-27T18:54:25.214967] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-27T18:54:25.453588] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-27T18:54:26.014930] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-27T18:54:26.619607] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-27T18:54:26.621325] [INFO ] [REMOTE ] GAM: Full fetch complete (6414 records). [2025-10-27T18:54:26.623735] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-27T18:54:26.824636] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-27T18:54:26.990947] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-27T18:54:26.991025] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-27T18:54:26.991227] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-27T18:54:26.991268] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-27T18:54:26.991670] [DEBUG] [LOCAL ] GAM: Trimmed 6414 records to 3682 (keeping 200 days of data) [2025-10-27T18:54:27.013300] [DEBUG] [LOCAL ] GAM: Primary data saved (3682 records). [2025-10-27T18:54:27.013463] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-27T18:54:27.013723] [INFO ] [MAIN ] Update Progress: 892/2366 symbols completed. GAM took 32.0s. Estimated remaining: 3h 9m 3s. Rate: 7.8 symbols/min [2025-10-27T18:54:27.147278] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-27T18:54:27.227533] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:54:27.241763] [DEBUG] [LOCAL ] GBAB: Loaded 12835 existing records from primary storage. [2025-10-27T18:54:27.241974] [INFO ] [MAIN ] GBAB: Loaded 12835 existing records. [2025-10-27T18:54:27.420159] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:54:27.420362] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-27T18:54:27.420409] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-27T18:54:27.420689] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-27T18:54:27.420747] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-27T18:54:27.620544] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-27T18:54:27.779186] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:54:27.973178] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-27T18:54:28.414967] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-27T18:54:29.215001] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-27T18:54:29.321468] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T18:54:29.677994] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-27T18:54:29.683140] [INFO ] [REMOTE ] GAB: Full fetch complete (39322 records). [2025-10-27T18:54:29.683217] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-27T18:54:30.021036] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-27T18:54:30.059297] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-27T18:54:30.059517] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-27T18:54:30.060268] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-27T18:54:30.065516] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-27T18:54:30.073554] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T18:54:30.079212] [DEBUG] [LOCAL ] GAB: Trimmed 39322 records to 26973 (keeping 200 days of data) [2025-10-27T18:54:30.230815] [DEBUG] [LOCAL ] GAB: Primary data saved (26973 records). [2025-10-27T18:54:30.230942] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-27T18:54:30.231020] [INFO ] [MAIN ] Update Progress: 893/2366 symbols completed. GAB took 37.4s. Estimated remaining: 3h 8m 48s. Rate: 7.8 symbols/min [2025-10-27T18:54:30.395141] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:54:30.432959] [DEBUG] [LOCAL ] GBCI: Loaded 41806 existing records from primary storage. [2025-10-27T18:54:30.433230] [INFO ] [MAIN ] GBCI: Loaded 41806 existing records. [2025-10-27T18:54:30.605421] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:54:30.605634] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-27T18:54:30.605714] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-27T18:54:30.606052] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-27T18:54:30.606109] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-27T18:54:30.820221] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-27T18:54:30.956505] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:54:31.170580] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T18:54:31.614987] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-27T18:54:32.414919] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-27T18:54:32.711813] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-27T18:54:33.007167] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-27T18:54:33.106864] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T18:54:33.214961] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-27T18:54:34.014991] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-27T18:54:34.695507] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T18:54:34.814906] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-27T18:54:35.514500] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T18:54:35.614908] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-27T18:54:36.002115] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-27T18:54:36.414968] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-27T18:54:37.215072] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-27T18:54:37.248577] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-27T18:54:37.595044] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T18:54:37.606551] [INFO ] [REMOTE ] GAP: Full fetch complete (77814 records). [2025-10-27T18:54:37.606745] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-27T18:54:38.006187] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-27T18:54:38.006509] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-27T18:54:38.010629] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-27T18:54:38.010876] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-27T18:54:38.019455] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-27T18:54:38.022411] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-27T18:54:38.027105] [INFO ] [REMOTE ] GATX: Full fetch complete (25112 records). [2025-10-27T18:54:38.027295] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-27T18:54:38.027484] [DEBUG] [LOCAL ] GAP: Trimmed 77814 records to 53653 (keeping 200 days of data) [2025-10-27T18:54:38.643703] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-27T18:54:38.644123] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-27T18:54:38.645820] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-27T18:54:38.645901] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-27T18:54:38.657144] [DEBUG] [LOCAL ] GATX: Trimmed 25112 records to 17782 (keeping 200 days of data) [2025-10-27T18:54:38.822828] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-27T18:54:38.851081] [DEBUG] [LOCAL ] GAP: Primary data saved (53653 records). [2025-10-27T18:54:38.852726] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-27T18:54:38.865808] [INFO ] [MAIN ] Update Progress: 894/2366 symbols completed. GAP took 39.2s. Estimated remaining: 3h 8m 41s. Rate: 7.8 symbols/min [2025-10-27T18:54:39.052289] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:54:39.053417] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-27T18:54:39.054034] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-27T18:54:39.055831] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-27T18:54:39.055962] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-27T18:54:39.058967] [DEBUG] [LOCAL ] GATX: Primary data saved (17782 records). [2025-10-27T18:54:39.059120] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-27T18:54:39.059291] [INFO ] [MAIN ] Update Progress: 895/2366 symbols completed. GATX took 25.2s. Estimated remaining: 3h 8m 21s. Rate: 7.8 symbols/min [2025-10-27T18:54:39.059618] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-27T18:54:39.129211] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-27T18:54:39.364788] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:54:39.652195] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:54:39.652779] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-27T18:54:39.690520] [DEBUG] [LOCAL ] GBTG: Loaded 40762 existing records from primary storage. [2025-10-27T18:54:39.693073] [INFO ] [MAIN ] GBTG: Loaded 40762 existing records. [2025-10-27T18:54:39.760524] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-27T18:54:39.862177] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-27T18:54:39.910130] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:54:39.910356] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-27T18:54:39.910408] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-27T18:54:39.910597] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-27T18:54:39.910636] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-27T18:54:40.017129] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-27T18:54:40.289742] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:54:40.414997] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-27T18:54:40.907167] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-27T18:54:41.214963] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-27T18:54:42.014942] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-27T18:54:42.249821] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T18:54:42.323499] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-27T18:54:42.814920] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-27T18:54:43.614929] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-27T18:54:43.898874] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T18:54:44.415015] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-27T18:54:45.052154] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T18:54:45.214939] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-27T18:54:46.014936] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-27T18:54:46.356329] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-27T18:54:46.814940] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-27T18:54:47.236614] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-27T18:54:47.466586] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-27T18:54:47.614921] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-27T18:54:47.857969] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T18:54:48.414937] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-27T18:54:48.709294] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-27T18:54:49.078458] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T18:54:49.214900] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-27T18:54:50.014992] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-27T18:54:50.725799] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T18:54:50.814899] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-27T18:54:51.603102] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-27T18:54:51.614897] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-27T18:54:51.882590] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-27T18:54:52.415021] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-27T18:54:53.010495] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T18:54:53.214977] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-27T18:54:53.357868] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T18:54:53.589772] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-27T18:54:54.014939] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-27T18:54:54.816989] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-27T18:54:54.820089] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T18:54:55.614940] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-27T18:54:56.314449] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T18:54:56.414915] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-27T18:54:56.498062] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-27T18:54:56.500454] [INFO ] [REMOTE ] GBAB: Full fetch complete (18450 records). [2025-10-27T18:54:56.500524] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-27T18:54:56.889810] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-27T18:54:56.889887] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-27T18:54:56.890385] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-27T18:54:56.890452] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-27T18:54:56.891150] [DEBUG] [LOCAL ] GBAB: Trimmed 18450 records to 12396 (keeping 200 days of data) [2025-10-27T18:54:56.974779] [DEBUG] [LOCAL ] GBAB: Primary data saved (12396 records). [2025-10-27T18:54:56.974937] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-27T18:54:56.975027] [INFO ] [MAIN ] Update Progress: 896/2366 symbols completed. GBAB took 30.0s. Estimated remaining: 3h 8m 30s. Rate: 7.8 symbols/min [2025-10-27T18:54:57.172375] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:54:57.200854] [DEBUG] [LOCAL ] GBX: Loaded 28498 existing records from primary storage. [2025-10-27T18:54:57.201139] [INFO ] [MAIN ] GBX: Loaded 28498 existing records. [2025-10-27T18:54:57.221740] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-27T18:54:57.382399] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:54:57.382603] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-27T18:54:57.382710] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-27T18:54:57.382965] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-27T18:54:57.383025] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-27T18:54:57.733172] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:54:57.789902] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-27T18:54:57.799696] [INFO ] [REMOTE ] GBCI: Full fetch complete (59569 records). [2025-10-27T18:54:57.799833] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-27T18:54:58.021746] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-27T18:54:58.185015] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-27T18:54:58.185106] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-27T18:54:58.185994] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-27T18:54:58.186067] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-27T18:54:58.187421] [DEBUG] [LOCAL ] GBCI: Trimmed 59569 records to 41110 (keeping 200 days of data) [2025-10-27T18:54:58.372791] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-27T18:54:58.441411] [DEBUG] [LOCAL ] GBCI: Primary data saved (41110 records). [2025-10-27T18:54:58.441552] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-27T18:54:58.442446] [INFO ] [MAIN ] Update Progress: 897/2366 symbols completed. GBCI took 28.2s. Estimated remaining: 3h 8m 13s. Rate: 7.8 symbols/min [2025-10-27T18:54:58.616062] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:54:58.657466] [DEBUG] [LOCAL ] GCI: Loaded 44213 existing records from primary storage. [2025-10-27T18:54:58.657846] [INFO ] [MAIN ] GCI: Loaded 44213 existing records. [2025-10-27T18:54:58.820589] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-27T18:54:58.860901] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:54:58.862381] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-27T18:54:58.863751] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-27T18:54:58.866952] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-27T18:54:58.872616] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-27T18:54:58.872799] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-27T18:54:59.216703] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-27T18:54:59.241759] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:54:59.614938] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-27T18:55:00.414964] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-27T18:55:00.843783] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-27T18:55:01.214997] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-27T18:55:01.602359] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-27T18:55:01.815147] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T18:55:02.014986] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-27T18:55:02.814950] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-27T18:55:03.535563] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T18:55:03.614907] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-27T18:55:04.258290] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T18:55:04.414924] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-27T18:55:05.215929] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T18:55:05.215097] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-27T18:55:05.835124] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T18:55:06.014958] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-27T18:55:06.554385] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T18:55:06.814916] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-27T18:55:07.479086] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-27T18:55:07.486585] [INFO ] [REMOTE ] GBTG: Full fetch complete (56886 records). [2025-10-27T18:55:07.486698] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-27T18:55:07.622815] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-27T18:55:07.865697] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-27T18:55:07.865821] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-27T18:55:07.866623] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-27T18:55:07.866893] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-27T18:55:07.868155] [DEBUG] [LOCAL ] GBTG: Trimmed 56886 records to 39966 (keeping 200 days of data) [2025-10-27T18:55:08.072757] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T18:55:08.109815] [DEBUG] [LOCAL ] GBTG: Primary data saved (39966 records). [2025-10-27T18:55:08.109913] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-27T18:55:08.109984] [INFO ] [MAIN ] Update Progress: 898/2366 symbols completed. GBTG took 29.1s. Estimated remaining: 3h 8m 8s. Rate: 7.8 symbols/min [2025-10-27T18:55:08.274259] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:55:08.295682] [DEBUG] [LOCAL ] GCO: Loaded 23030 existing records from primary storage. [2025-10-27T18:55:08.295915] [INFO ] [MAIN ] GCO: Loaded 23030 existing records. [2025-10-27T18:55:08.420014] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-27T18:55:08.477924] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:55:08.478097] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-27T18:55:08.478179] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-27T18:55:08.478348] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-27T18:55:08.478388] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-27T18:55:08.824989] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:55:09.214965] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-27T18:55:09.265687] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T18:55:09.336851] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T18:55:09.556299] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-27T18:55:10.014925] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-27T18:55:10.814973] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-27T18:55:11.614984] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-27T18:55:11.674811] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T18:55:11.987202] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T18:55:12.414939] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-27T18:55:12.710808] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-27T18:55:13.214950] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-27T18:55:13.703119] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-27T18:55:13.704094] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-27T18:55:13.704865] [INFO ] [REMOTE ] GBLI: Full fetch complete (1287 records). [2025-10-27T18:55:13.706873] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-27T18:55:13.710841] [FATAL] [VALIDATOR ] GBLI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:55:13.711182] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:55:13.711270] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:55:13.711359] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-27T18:55:13.711437] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-27T18:55:13.711475] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-27T18:55:13.711514] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-27T18:55:13.711597] [INFO ] [MAIN ] Update Progress: 899/2366 symbols completed. GBLI took 34.8s. Estimated remaining: 3h 7m 57s. Rate: 7.8 symbols/min [2025-10-27T18:55:13.882519] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:55:13.901769] [DEBUG] [LOCAL ] GCTS: Loaded 20476 existing records from primary storage. [2025-10-27T18:55:13.902006] [INFO ] [MAIN ] GCTS: Loaded 20476 existing records. [2025-10-27T18:55:14.020048] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-27T18:55:14.082042] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:55:14.082375] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-27T18:55:14.082438] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-27T18:55:14.082623] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-27T18:55:14.082720] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-27T18:55:14.430204] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:55:14.814957] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-27T18:55:15.614931] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-27T18:55:15.755582] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-27T18:55:15.778202] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-27T18:55:16.414919] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-27T18:55:16.581793] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-27T18:55:17.214905] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-27T18:55:17.235780] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T18:55:18.014922] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-27T18:55:18.186229] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-27T18:55:18.814987] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-27T18:55:19.536260] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T18:55:19.614965] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-27T18:55:20.420050] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-27T18:55:20.430220] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T18:55:20.505747] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T18:55:21.022754] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-27T18:55:21.214985] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-27T18:55:21.855811] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-27T18:55:22.014953] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-27T18:55:22.814939] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-27T18:55:23.587997] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T18:55:23.614907] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-27T18:55:24.200360] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T18:55:24.414975] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-27T18:55:24.616408] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-27T18:55:25.194022] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T18:55:25.214998] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-27T18:55:26.014952] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-27T18:55:26.713599] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-27T18:55:26.721718] [INFO ] [REMOTE ] GBX: Full fetch complete (42502 records). [2025-10-27T18:55:26.721826] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-27T18:55:26.820032] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-27T18:55:27.111039] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-27T18:55:27.111121] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-27T18:55:27.111790] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-27T18:55:27.111854] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-27T18:55:27.112844] [DEBUG] [LOCAL ] GBX: Trimmed 42502 records to 27618 (keeping 200 days of data) [2025-10-27T18:55:27.280402] [DEBUG] [LOCAL ] GBX: Primary data saved (27618 records). [2025-10-27T18:55:27.280543] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-27T18:55:27.280625] [INFO ] [MAIN ] Update Progress: 900/2366 symbols completed. GBX took 30.3s. Estimated remaining: 3h 7m 59s. Rate: 7.8 symbols/min [2025-10-27T18:55:27.461425] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:55:27.480965] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T18:55:27.495479] [DEBUG] [LOCAL ] GCV: Loaded 8030 existing records from primary storage. [2025-10-27T18:55:27.495744] [INFO ] [MAIN ] GCV: Loaded 8030 existing records. [2025-10-27T18:55:27.620155] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-27T18:55:27.689304] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:55:27.689527] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-27T18:55:27.689575] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-27T18:55:27.689764] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-27T18:55:27.689823] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-27T18:55:28.061289] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:55:28.418769] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-27T18:55:28.430812] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-27T18:55:28.508060] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-27T18:55:28.516437] [INFO ] [REMOTE ] GCI: Full fetch complete (63232 records). [2025-10-27T18:55:28.516604] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-27T18:55:28.903147] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-27T18:55:28.903221] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-27T18:55:28.904139] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-27T18:55:28.904203] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-27T18:55:28.905418] [DEBUG] [LOCAL ] GCI: Trimmed 63232 records to 43427 (keeping 200 days of data) [2025-10-27T18:55:29.148104] [DEBUG] [LOCAL ] GCI: Primary data saved (43427 records). [2025-10-27T18:55:29.148235] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-27T18:55:29.148949] [INFO ] [MAIN ] Update Progress: 901/2366 symbols completed. GCI took 30.7s. Estimated remaining: 3h 7m 42s. Rate: 7.8 symbols/min [2025-10-27T18:55:29.220115] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-27T18:55:29.330693] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:55:29.374422] [DEBUG] [LOCAL ] GD: Loaded 47208 existing records from primary storage. [2025-10-27T18:55:29.374805] [INFO ] [MAIN ] GD: Loaded 47208 existing records. [2025-10-27T18:55:29.552402] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:55:29.552631] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-27T18:55:29.552715] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-27T18:55:29.552974] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-27T18:55:29.553030] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-27T18:55:29.694965] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-27T18:55:29.856143] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-27T18:55:29.936078] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:55:30.014939] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-27T18:55:30.814941] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-27T18:55:31.468782] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T18:55:31.515239] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T18:55:31.614937] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-27T18:55:32.206384] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-27T18:55:32.414949] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-27T18:55:33.214951] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-27T18:55:33.947076] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-27T18:55:34.014918] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-27T18:55:34.814915] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-27T18:55:35.025697] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-27T18:55:35.214718] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T18:55:35.559226] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-27T18:55:35.614944] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-27T18:55:36.414942] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-27T18:55:36.542157] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-27T18:55:37.214951] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-27T18:55:37.977391] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-27T18:55:38.014905] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-27T18:55:38.257336] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T18:55:38.814992] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-27T18:55:39.085968] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T18:55:39.614944] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-27T18:55:39.974795] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-27T18:55:40.350495] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-27T18:55:40.414905] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-27T18:55:41.214944] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-27T18:55:41.479804] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-27T18:55:42.014949] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-27T18:55:42.721345] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T18:55:42.814991] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-27T18:55:43.132164] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-27T18:55:43.206834] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-27T18:55:43.614932] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-27T18:55:44.414999] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-27T18:55:45.214934] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-27T18:55:45.299349] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-27T18:55:45.303701] [INFO ] [REMOTE ] GCTS: Full fetch complete (26650 records). [2025-10-27T18:55:45.303803] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-27T18:55:45.708762] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-27T18:55:45.715713] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-27T18:55:45.715792] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-27T18:55:45.725480] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-27T18:55:45.725560] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-27T18:55:45.726959] [DEBUG] [LOCAL ] GCTS: Trimmed 26650 records to 20201 (keeping 200 days of data) [2025-10-27T18:55:45.839083] [DEBUG] [LOCAL ] GCTS: Primary data saved (20201 records). [2025-10-27T18:55:45.839202] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-27T18:55:45.839274] [INFO ] [MAIN ] Update Progress: 902/2366 symbols completed. GCTS took 32.1s. Estimated remaining: 3h 7m 49s. Rate: 7.8 symbols/min [2025-10-27T18:55:46.009757] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:55:46.014919] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-27T18:55:46.060732] [DEBUG] [LOCAL ] GDDY: Loaded 50276 existing records from primary storage. [2025-10-27T18:55:46.061101] [INFO ] [MAIN ] GDDY: Loaded 50276 existing records. [2025-10-27T18:55:46.203145] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T18:55:46.257740] [INFO ] [REMOTE ] GCO: Full fetch complete (34480 records). [2025-10-27T18:55:46.263392] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:55:46.263789] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-27T18:55:46.263717] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-27T18:55:46.263886] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-27T18:55:46.264240] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-27T18:55:46.264307] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-27T18:55:46.815765] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-27T18:55:47.006601] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:55:47.022736] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-27T18:55:47.022831] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-27T18:55:47.023447] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-27T18:55:47.023489] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-27T18:55:47.024460] [DEBUG] [LOCAL ] GCO: Trimmed 34480 records to 22201 (keeping 200 days of data) [2025-10-27T18:55:47.152113] [DEBUG] [LOCAL ] GCO: Primary data saved (22201 records). [2025-10-27T18:55:47.152247] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-27T18:55:47.152328] [INFO ] [MAIN ] Update Progress: 903/2366 symbols completed. GCO took 39.0s. Estimated remaining: 3h 7m 31s. Rate: 7.8 symbols/min [2025-10-27T18:55:47.326763] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:55:47.332405] [DEBUG] [LOCAL ] GDIV: Loaded 3552 existing records from primary storage. [2025-10-27T18:55:47.332685] [INFO ] [MAIN ] GDIV: Loaded 3552 existing records. [2025-10-27T18:55:47.517034] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:55:47.517324] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-27T18:55:47.517447] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-27T18:55:47.517751] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-27T18:55:47.517922] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-27T18:55:47.615937] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-27T18:55:47.673330] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-27T18:55:47.946119] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-27T18:55:47.951338] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:55:48.415022] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-27T18:55:48.886409] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-27T18:55:49.214926] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-27T18:55:49.321610] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T18:55:49.637350] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-27T18:55:50.014950] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-27T18:55:50.739304] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-27T18:55:50.814963] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-27T18:55:51.436025] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T18:55:51.614928] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-27T18:55:52.414932] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-27T18:55:53.040923] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-27T18:55:53.214909] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-27T18:55:53.271578] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-27T18:55:53.658200] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-27T18:55:54.014964] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-27T18:55:54.814968] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-27T18:55:55.484433] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T18:55:55.614899] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-27T18:55:55.817128] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T18:55:55.819632] [INFO ] [REMOTE ] GCV: Full fetch complete (10195 records). [2025-10-27T18:55:55.819727] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-27T18:55:56.174134] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-27T18:55:56.174206] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-27T18:55:56.174438] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-27T18:55:56.174476] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-27T18:55:56.174930] [DEBUG] [LOCAL ] GCV: Trimmed 10195 records to 7919 (keeping 200 days of data) [2025-10-27T18:55:56.218932] [DEBUG] [LOCAL ] GCV: Primary data saved (7919 records). [2025-10-27T18:55:56.219049] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-27T18:55:56.219132] [INFO ] [MAIN ] Update Progress: 904/2366 symbols completed. GCV took 28.9s. Estimated remaining: 3h 7m 25s. Rate: 7.8 symbols/min [2025-10-27T18:55:56.383177] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:55:56.387281] [DEBUG] [LOCAL ] GDL: Loaded 2532 existing records from primary storage. [2025-10-27T18:55:56.387447] [INFO ] [MAIN ] GDL: Loaded 2532 existing records. [2025-10-27T18:55:56.420075] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-27T18:55:56.569058] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:55:56.569246] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-27T18:55:56.569331] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-27T18:55:56.569503] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-27T18:55:56.569561] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-27T18:55:56.915702] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:55:57.214935] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-27T18:55:57.316187] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-27T18:55:57.716167] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-27T18:55:58.024918] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-27T18:55:58.051052] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T18:55:58.623770] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-27T18:55:58.814941] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-27T18:55:59.179177] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-27T18:55:59.614992] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-27T18:55:59.923402] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-27T18:56:00.414999] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-27T18:56:01.214952] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-27T18:56:02.014973] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-27T18:56:02.210830] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-27T18:56:02.746029] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-27T18:56:02.814938] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-27T18:56:03.400515] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-27T18:56:03.614975] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-27T18:56:04.384571] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-27T18:56:04.414917] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-27T18:56:05.042512] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T18:56:05.214918] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-27T18:56:05.985316] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-27T18:56:06.014902] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-27T18:56:06.814978] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-27T18:56:07.210212] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-27T18:56:07.219910] [INFO ] [REMOTE ] GD: Full fetch complete (69633 records). [2025-10-27T18:56:07.220108] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-27T18:56:07.319802] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-27T18:56:07.626835] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-27T18:56:07.651207] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-27T18:56:07.652527] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-27T18:56:07.653874] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-27T18:56:07.654116] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-27T18:56:07.656111] [DEBUG] [LOCAL ] GD: Trimmed 69633 records to 46417 (keeping 200 days of data) [2025-10-27T18:56:07.793934] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-27T18:56:08.005560] [DEBUG] [LOCAL ] GD: Primary data saved (46417 records). [2025-10-27T18:56:08.005818] [INFO ] [MAIN ] GD: Full history saved. [2025-10-27T18:56:08.006712] [INFO ] [MAIN ] Update Progress: 905/2366 symbols completed. GD took 38.9s. Estimated remaining: 3h 7m 24s. Rate: 7.8 symbols/min [2025-10-27T18:56:08.086358] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-27T18:56:08.188706] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:56:08.197342] [DEBUG] [LOCAL ] GDO: Loaded 5931 existing records from primary storage. [2025-10-27T18:56:08.197560] [INFO ] [MAIN ] GDO: Loaded 5931 existing records. [2025-10-27T18:56:08.379581] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:56:08.379814] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-27T18:56:08.379862] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-27T18:56:08.380090] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-27T18:56:08.380150] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-27T18:56:08.420076] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-27T18:56:08.752997] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:56:08.791163] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-27T18:56:09.214943] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-27T18:56:10.015002] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-27T18:56:10.361423] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-27T18:56:10.815011] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-27T18:56:11.015282] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-27T18:56:11.166745] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-27T18:56:11.614968] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-27T18:56:12.414941] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-27T18:56:12.948388] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-27T18:56:13.214913] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-27T18:56:13.366467] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T18:56:13.376316] [INFO ] [REMOTE ] GDDY: Full fetch complete (72089 records). [2025-10-27T18:56:13.376460] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-27T18:56:13.688586] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-27T18:56:13.786265] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-27T18:56:13.786354] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-27T18:56:13.787398] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-27T18:56:13.787488] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-27T18:56:13.789131] [DEBUG] [LOCAL ] GDDY: Trimmed 72089 records to 49453 (keeping 200 days of data) [2025-10-27T18:56:14.014963] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-27T18:56:14.085738] [DEBUG] [LOCAL ] GDDY: Primary data saved (49453 records). [2025-10-27T18:56:14.085866] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-27T18:56:14.086341] [INFO ] [MAIN ] Update Progress: 906/2366 symbols completed. GDDY took 28.2s. Estimated remaining: 3h 7m 14s. Rate: 7.8 symbols/min [2025-10-27T18:56:14.257226] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:56:14.295573] [DEBUG] [LOCAL ] GDOT: Loaded 38172 existing records from primary storage. [2025-10-27T18:56:14.295866] [INFO ] [MAIN ] GDOT: Loaded 38172 existing records. [2025-10-27T18:56:14.476203] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:56:14.476444] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-27T18:56:14.476491] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-27T18:56:14.476826] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-27T18:56:14.476886] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-27T18:56:14.579676] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-27T18:56:14.817588] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-27T18:56:14.847192] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:56:15.413965] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-27T18:56:15.415084] [INFO ] [REMOTE ] GDIV: Full fetch complete (5409 records). [2025-10-27T18:56:15.415151] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-27T18:56:15.616687] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-27T18:56:15.774708] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-27T18:56:15.774787] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-27T18:56:15.774957] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-27T18:56:15.774995] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-27T18:56:15.775353] [DEBUG] [LOCAL ] GDIV: Trimmed 5409 records to 3405 (keeping 200 days of data) [2025-10-27T18:56:15.795791] [DEBUG] [LOCAL ] GDIV: Primary data saved (3405 records). [2025-10-27T18:56:15.795872] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-27T18:56:15.795941] [INFO ] [MAIN ] Update Progress: 907/2366 symbols completed. GDIV took 28.6s. Estimated remaining: 3h 6m 56s. Rate: 7.8 symbols/min [2025-10-27T18:56:15.964850] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:56:15.984043] [DEBUG] [LOCAL ] GDV: Loaded 19349 existing records from primary storage. [2025-10-27T18:56:15.984308] [INFO ] [MAIN ] GDV: Loaded 19349 existing records. [2025-10-27T18:56:16.103045] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-27T18:56:16.170470] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:56:16.170702] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-27T18:56:16.170761] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-27T18:56:16.170992] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-27T18:56:16.171032] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-27T18:56:16.420031] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-27T18:56:16.529800] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:56:17.214993] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-27T18:56:17.685425] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T18:56:17.748943] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T18:56:17.750446] [INFO ] [REMOTE ] GDL: Full fetch complete (3453 records). [2025-10-27T18:56:17.750532] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-27T18:56:18.024760] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-27T18:56:18.259433] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-27T18:56:18.259548] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-27T18:56:18.259728] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-27T18:56:18.259789] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-27T18:56:18.260339] [DEBUG] [LOCAL ] GDL: Trimmed 3453 records to 2495 (keeping 200 days of data) [2025-10-27T18:56:18.276009] [DEBUG] [LOCAL ] GDL: Primary data saved (2495 records). [2025-10-27T18:56:18.276155] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-27T18:56:18.276244] [INFO ] [MAIN ] Update Progress: 908/2366 symbols completed. GDL took 22.1s. Estimated remaining: 3h 6m 40s. Rate: 7.8 symbols/min [2025-10-27T18:56:18.460309] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:56:18.513364] [DEBUG] [LOCAL ] GE: Loaded 54473 existing records from primary storage. [2025-10-27T18:56:18.513732] [INFO ] [MAIN ] GE: Loaded 54473 existing records. [2025-10-27T18:56:18.689801] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:56:18.689992] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-27T18:56:18.690038] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-27T18:56:18.690367] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-27T18:56:18.690423] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-27T18:56:18.826357] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-27T18:56:19.048774] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:56:19.064005] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T18:56:19.614983] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-27T18:56:19.767534] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-27T18:56:20.414964] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-27T18:56:21.215002] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-27T18:56:21.354013] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T18:56:21.436860] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-27T18:56:22.014947] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-27T18:56:22.468713] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T18:56:22.814987] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-27T18:56:23.614959] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-27T18:56:23.754095] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-27T18:56:23.947828] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-27T18:56:24.414919] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-27T18:56:24.475791] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-27T18:56:25.214991] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-27T18:56:26.014949] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-27T18:56:26.487310] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-27T18:56:26.695060] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-27T18:56:26.728181] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T18:56:26.814902] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-27T18:56:27.614945] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-27T18:56:28.260296] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T18:56:28.405541] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-27T18:56:28.414931] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-27T18:56:29.214980] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-27T18:56:29.570268] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-27T18:56:30.014953] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-27T18:56:30.814935] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-27T18:56:30.901343] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-27T18:56:31.392913] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-27T18:56:31.614928] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-27T18:56:32.052702] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T18:56:32.414997] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-27T18:56:33.214928] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-27T18:56:33.377098] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-27T18:56:33.601922] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-27T18:56:33.941801] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-27T18:56:34.014966] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-27T18:56:34.814942] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-27T18:56:35.614934] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-27T18:56:35.747934] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-27T18:56:36.233533] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T18:56:36.242266] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-27T18:56:36.414942] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-27T18:56:37.214982] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-27T18:56:37.513626] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-27T18:56:37.520887] [INFO ] [REMOTE ] GDOT: Full fetch complete (53745 records). [2025-10-27T18:56:37.520977] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-27T18:56:37.897105] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-27T18:56:37.897183] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-27T18:56:37.897994] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-27T18:56:37.898059] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-27T18:56:37.899157] [DEBUG] [LOCAL ] GDOT: Trimmed 53745 records to 37431 (keeping 200 days of data) [2025-10-27T18:56:38.052019] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-27T18:56:38.114786] [DEBUG] [LOCAL ] GDOT: Primary data saved (37431 records). [2025-10-27T18:56:38.114933] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-27T18:56:38.115391] [INFO ] [MAIN ] Update Progress: 909/2366 symbols completed. GDOT took 24.0s. Estimated remaining: 3h 6m 52s. Rate: 7.8 symbols/min [2025-10-27T18:56:38.285384] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:56:38.307352] [DEBUG] [LOCAL ] GEF: Loaded 20945 existing records from primary storage. [2025-10-27T18:56:38.307590] [INFO ] [MAIN ] GEF: Loaded 20945 existing records. [2025-10-27T18:56:38.481919] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:56:38.482122] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-27T18:56:38.482167] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-27T18:56:38.482450] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-27T18:56:38.482526] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-27T18:56:38.769390] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-27T18:56:38.821357] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-27T18:56:38.853207] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:56:39.192793] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-27T18:56:39.614938] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-27T18:56:39.845272] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-27T18:56:40.414938] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-27T18:56:40.443792] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-27T18:56:40.795878] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-27T18:56:41.214945] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-27T18:56:41.892273] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-27T18:56:42.014942] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-27T18:56:42.814958] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-27T18:56:42.998121] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T18:56:43.614930] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-27T18:56:43.845998] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-27T18:56:44.414951] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-27T18:56:44.448257] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-27T18:56:45.091826] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-27T18:56:45.214928] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-27T18:56:45.612896] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-27T18:56:46.014941] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-27T18:56:46.814951] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-27T18:56:47.398663] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-27T18:56:47.614993] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-27T18:56:48.156131] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-27T18:56:48.414903] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-27T18:56:48.731903] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T18:56:49.214992] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-27T18:56:49.338109] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T18:56:50.014951] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-27T18:56:50.814913] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-27T18:56:50.860979] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-27T18:56:50.963798] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-27T18:56:51.448261] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T18:56:51.449778] [INFO ] [REMOTE ] GDO: Full fetch complete (8440 records). [2025-10-27T18:56:51.449845] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-27T18:56:51.621800] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-27T18:56:51.808577] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-27T18:56:51.808692] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-27T18:56:51.808969] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-27T18:56:51.809035] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-27T18:56:51.809619] [DEBUG] [LOCAL ] GDO: Trimmed 8440 records to 5681 (keeping 200 days of data) [2025-10-27T18:56:51.845864] [DEBUG] [LOCAL ] GDO: Primary data saved (5681 records). [2025-10-27T18:56:51.845992] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-27T18:56:51.846075] [INFO ] [MAIN ] Update Progress: 910/2366 symbols completed. GDO took 43.8s. Estimated remaining: 3h 6m 54s. Rate: 7.8 symbols/min [2025-10-27T18:56:52.013526] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:56:52.046688] [DEBUG] [LOCAL ] GEL: Loaded 31489 existing records from primary storage. [2025-10-27T18:56:52.046986] [INFO ] [MAIN ] GEL: Loaded 31489 existing records. [2025-10-27T18:56:52.224864] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:56:52.225097] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-27T18:56:52.225145] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-27T18:56:52.225447] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-27T18:56:52.225506] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-27T18:56:52.420821] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-27T18:56:52.580034] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:56:53.215000] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-27T18:56:53.654260] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T18:56:53.879155] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-27T18:56:53.890787] [INFO ] [REMOTE ] GE: Full fetch complete (77858 records). [2025-10-27T18:56:53.891110] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-27T18:56:54.020132] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-27T18:56:54.343099] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-27T18:56:54.343213] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-27T18:56:54.344431] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-27T18:56:54.344507] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-27T18:56:54.346498] [DEBUG] [LOCAL ] GE: Trimmed 77858 records to 53689 (keeping 200 days of data) [2025-10-27T18:56:54.608525] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T18:56:54.744385] [DEBUG] [LOCAL ] GE: Primary data saved (53689 records). [2025-10-27T18:56:54.744601] [INFO ] [MAIN ] GE: Full history saved. [2025-10-27T18:56:54.744731] [INFO ] [MAIN ] Update Progress: 911/2366 symbols completed. GE took 36.5s. Estimated remaining: 3h 6m 39s. Rate: 7.8 symbols/min [2025-10-27T18:56:54.816745] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-27T18:56:54.924883] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:56:54.943685] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-27T18:56:55.000355] [DEBUG] [LOCAL ] GENI: Loaded 53659 existing records from primary storage. [2025-10-27T18:56:55.000826] [INFO ] [MAIN ] GENI: Loaded 53659 existing records. [2025-10-27T18:56:55.179733] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:56:55.180100] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-27T18:56:55.180159] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-27T18:56:55.180428] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-27T18:56:55.180515] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-27T18:56:55.540357] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:56:55.614963] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-27T18:56:55.775375] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-27T18:56:56.393136] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-27T18:56:56.414907] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-27T18:56:57.209999] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-27T18:56:57.215090] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-27T18:56:58.002687] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T18:56:58.006971] [INFO ] [REMOTE ] GEF: Full fetch complete (29259 records). [2025-10-27T18:56:58.007051] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-27T18:56:58.020042] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-27T18:56:58.401739] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-27T18:56:58.401820] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-27T18:56:58.402431] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-27T18:56:58.402470] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-27T18:56:58.403162] [DEBUG] [LOCAL ] GEF: Trimmed 29259 records to 20495 (keeping 200 days of data) [2025-10-27T18:56:58.528699] [DEBUG] [LOCAL ] GEF: Primary data saved (20495 records). [2025-10-27T18:56:58.528873] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-27T18:56:58.528986] [INFO ] [MAIN ] Update Progress: 912/2366 symbols completed. GEF took 20.4s. Estimated remaining: 3h 6m 25s. Rate: 7.8 symbols/min [2025-10-27T18:56:58.711091] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:56:58.760088] [DEBUG] [LOCAL ] GEO: Loaded 52386 existing records from primary storage. [2025-10-27T18:56:58.760428] [INFO ] [MAIN ] GEO: Loaded 52386 existing records. [2025-10-27T18:56:58.823445] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-27T18:56:58.940508] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:56:58.940753] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-27T18:56:58.940810] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-27T18:56:58.940994] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-27T18:56:58.941031] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-27T18:56:59.295492] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:56:59.357084] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T18:56:59.614940] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-27T18:56:59.647019] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-27T18:56:59.651120] [INFO ] [REMOTE ] GDV: Full fetch complete (28175 records). [2025-10-27T18:56:59.651204] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-27T18:57:00.018853] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-27T18:57:00.018932] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-27T18:57:00.019473] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-27T18:57:00.019515] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-27T18:57:00.020266] [DEBUG] [LOCAL ] GDV: Trimmed 28175 records to 18804 (keeping 200 days of data) [2025-10-27T18:57:00.132585] [DEBUG] [LOCAL ] GDV: Primary data saved (18804 records). [2025-10-27T18:57:00.132752] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-27T18:57:00.132838] [INFO ] [MAIN ] Update Progress: 913/2366 symbols completed. GDV took 44.3s. Estimated remaining: 3h 6m 8s. Rate: 7.8 symbols/min [2025-10-27T18:57:00.297138] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:57:00.338558] [DEBUG] [LOCAL ] GES: Loaded 38332 existing records from primary storage. [2025-10-27T18:57:00.338884] [INFO ] [MAIN ] GES: Loaded 38332 existing records. [2025-10-27T18:57:00.420130] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-27T18:57:00.514731] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:57:00.514925] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-27T18:57:00.514970] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-27T18:57:00.515237] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-27T18:57:00.515293] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-27T18:57:00.877537] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:57:01.214935] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-27T18:57:01.346057] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-27T18:57:02.015035] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-27T18:57:02.227006] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-27T18:57:02.722428] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-27T18:57:02.815002] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-27T18:57:03.614970] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-27T18:57:03.837241] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-27T18:57:03.876467] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T18:57:04.414940] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-27T18:57:05.215018] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-27T18:57:05.266407] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T18:57:05.942567] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T18:57:06.015075] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-27T18:57:06.624848] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T18:57:06.814983] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-27T18:57:07.459354] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T18:57:07.614942] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-27T18:57:08.414945] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-27T18:57:08.623577] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-27T18:57:09.197339] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T18:57:09.214896] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-27T18:57:09.409530] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T18:57:10.014984] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-27T18:57:10.814981] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-27T18:57:11.059010] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T18:57:11.197948] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-27T18:57:11.614982] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-27T18:57:12.209557] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T18:57:12.414965] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-27T18:57:13.214920] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-27T18:57:13.316363] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T18:57:13.924593] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T18:57:14.014990] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-27T18:57:14.312346] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T18:57:14.814959] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-27T18:57:15.614966] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-27T18:57:15.839966] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T18:57:15.931549] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-27T18:57:16.414960] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-27T18:57:17.214950] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-27T18:57:17.297495] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T18:57:17.451675] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T18:57:18.014941] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-27T18:57:18.814938] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-27T18:57:18.988481] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-27T18:57:19.261899] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T18:57:19.614965] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-27T18:57:20.414944] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-27T18:57:20.460787] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T18:57:20.971960] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T18:57:21.214936] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-27T18:57:21.414052] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T18:57:21.418439] [INFO ] [REMOTE ] GEL: Full fetch complete (47749 records). [2025-10-27T18:57:21.418531] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-27T18:57:21.793614] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-27T18:57:21.793724] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-27T18:57:21.794516] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-27T18:57:21.794559] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-27T18:57:21.795674] [DEBUG] [LOCAL ] GEL: Trimmed 47749 records to 30690 (keeping 200 days of data) [2025-10-27T18:57:21.973706] [DEBUG] [LOCAL ] GEL: Primary data saved (30690 records). [2025-10-27T18:57:21.973837] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-27T18:57:21.974605] [INFO ] [MAIN ] Update Progress: 914/2366 symbols completed. GEL took 30.1s. Estimated remaining: 3h 6m 22s. Rate: 7.8 symbols/min [2025-10-27T18:57:22.020065] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-27T18:57:22.145600] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:57:22.181419] [DEBUG] [LOCAL ] GETY: Loaded 35795 existing records from primary storage. [2025-10-27T18:57:22.181706] [INFO ] [MAIN ] GETY: Loaded 35795 existing records. [2025-10-27T18:57:22.359798] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:57:22.360044] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-27T18:57:22.360102] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-27T18:57:22.360446] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-27T18:57:22.360518] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-27T18:57:22.723485] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:57:22.814909] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-27T18:57:23.381920] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-27T18:57:23.391826] [INFO ] [REMOTE ] GENI: Full fetch complete (76067 records). [2025-10-27T18:57:23.391945] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-27T18:57:23.636614] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-27T18:57:23.784189] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-27T18:57:23.784293] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-27T18:57:23.785359] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-27T18:57:23.785438] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-27T18:57:23.786974] [DEBUG] [LOCAL ] GENI: Trimmed 76067 records to 52863 (keeping 200 days of data) [2025-10-27T18:57:24.035057] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-27T18:57:24.143846] [DEBUG] [LOCAL ] GENI: Primary data saved (52863 records). [2025-10-27T18:57:24.143980] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-27T18:57:24.144072] [INFO ] [MAIN ] Update Progress: 915/2366 symbols completed. GENI took 29.4s. Estimated remaining: 3h 6m 6s. Rate: 7.8 symbols/min [2025-10-27T18:57:24.319135] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:57:24.369270] [DEBUG] [LOCAL ] GEV: Loaded 53767 existing records from primary storage. [2025-10-27T18:57:24.369591] [INFO ] [MAIN ] GEV: Loaded 53767 existing records. [2025-10-27T18:57:24.422772] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-27T18:57:24.549539] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:57:24.549751] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-27T18:57:24.549802] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-27T18:57:24.550112] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-27T18:57:24.550152] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-27T18:57:24.913984] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:57:24.950993] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-27T18:57:24.974230] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T18:57:25.214978] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-27T18:57:26.014929] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-27T18:57:26.461099] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-27T18:57:26.498700] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-27T18:57:26.814939] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-27T18:57:27.614983] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-27T18:57:28.221167] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-27T18:57:28.414903] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-27T18:57:28.749571] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-27T18:57:28.759130] [INFO ] [REMOTE ] GEO: Full fetch complete (75415 records). [2025-10-27T18:57:28.759271] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-27T18:57:29.164673] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-27T18:57:29.164825] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-27T18:57:29.166065] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-27T18:57:29.166214] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-27T18:57:29.168323] [DEBUG] [LOCAL ] GEO: Trimmed 75415 records to 51578 (keeping 200 days of data) [2025-10-27T18:57:29.215684] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-27T18:57:29.297398] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T18:57:29.504910] [DEBUG] [LOCAL ] GEO: Primary data saved (51578 records). [2025-10-27T18:57:29.505066] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-27T18:57:29.505631] [INFO ] [MAIN ] Update Progress: 916/2366 symbols completed. GEO took 31.0s. Estimated remaining: 3h 5m 54s. Rate: 7.8 symbols/min [2025-10-27T18:57:29.685051] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:57:29.690198] [DEBUG] [LOCAL ] GF: Loaded 2647 existing records from primary storage. [2025-10-27T18:57:29.690387] [INFO ] [MAIN ] GF: Loaded 2647 existing records. [2025-10-27T18:57:29.873606] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:57:29.873928] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-27T18:57:29.873989] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-27T18:57:29.874178] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-27T18:57:29.874235] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-27T18:57:30.020079] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-27T18:57:30.226273] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:57:30.322617] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-27T18:57:30.730856] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T18:57:30.814903] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-27T18:57:31.605104] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T18:57:31.614903] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-27T18:57:32.009067] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T18:57:32.414988] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-27T18:57:32.785713] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T18:57:33.214946] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-27T18:57:33.526733] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T18:57:34.014936] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-27T18:57:34.814941] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-27T18:57:35.203129] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-27T18:57:35.489103] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T18:57:35.535533] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-27T18:57:35.614940] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-27T18:57:36.414973] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-27T18:57:36.780424] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-27T18:57:37.200801] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T18:57:37.214914] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-27T18:57:38.014932] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-27T18:57:38.657172] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T18:57:38.814923] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-27T18:57:39.614937] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-27T18:57:40.001157] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-27T18:57:40.285670] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T18:57:40.318181] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T18:57:40.414949] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-27T18:57:41.214932] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-27T18:57:41.491474] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T18:57:41.498315] [INFO ] [REMOTE ] GES: Full fetch complete (58208 records). [2025-10-27T18:57:41.498428] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-27T18:57:41.906583] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-27T18:57:41.906691] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-27T18:57:41.907502] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-27T18:57:41.907564] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-27T18:57:41.908722] [DEBUG] [LOCAL ] GES: Trimmed 58208 records to 37496 (keeping 200 days of data) [2025-10-27T18:57:42.016220] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-27T18:57:42.129346] [DEBUG] [LOCAL ] GES: Primary data saved (37496 records). [2025-10-27T18:57:42.129479] [INFO ] [MAIN ] GES: Full history saved. [2025-10-27T18:57:42.129557] [INFO ] [MAIN ] Update Progress: 917/2366 symbols completed. GES took 42.0s. Estimated remaining: 3h 5m 55s. Rate: 7.8 symbols/min [2025-10-27T18:57:42.546294] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T18:57:42.654598] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-27T18:57:42.814928] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-27T18:57:43.463529] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T18:57:43.614912] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-27T18:57:44.288551] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-27T18:57:44.414974] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-27T18:57:45.214991] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-27T18:57:45.625907] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T18:57:45.633251] [INFO ] [REMOTE ] GETY: Full fetch complete (55359 records). [2025-10-27T18:57:45.633358] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-27T18:57:46.025473] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-27T18:57:46.028514] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-27T18:57:46.028890] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-27T18:57:46.030561] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-27T18:57:46.030676] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-27T18:57:46.032030] [DEBUG] [LOCAL ] GETY: Trimmed 55359 records to 35015 (keeping 200 days of data) [2025-10-27T18:57:46.223957] [DEBUG] [LOCAL ] GETY: Primary data saved (35015 records). [2025-10-27T18:57:46.224092] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-27T18:57:46.224168] [INFO ] [MAIN ] Update Progress: 918/2366 symbols completed. GETY took 24.2s. Estimated remaining: 3h 5m 41s. Rate: 7.8 symbols/min [2025-10-27T18:57:46.532829] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-27T18:57:46.814951] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-27T18:57:47.199811] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-27T18:57:47.620094] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-27T18:57:47.642739] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-27T18:57:48.012039] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-27T18:57:48.414989] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-27T18:57:49.215010] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-27T18:57:49.853111] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-27T18:57:49.853999] [INFO ] [REMOTE ] GF: Full fetch complete (4834 records). [2025-10-27T18:57:49.854065] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-27T18:57:50.214832] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-27T18:57:50.214903] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-27T18:57:50.215046] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-27T18:57:50.215082] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-27T18:57:50.215418] [DEBUG] [LOCAL ] GF: Trimmed 4834 records to 2566 (keeping 200 days of data) [2025-10-27T18:57:50.230665] [DEBUG] [LOCAL ] GF: Primary data saved (2566 records). [2025-10-27T18:57:50.230736] [INFO ] [MAIN ] GF: Full history saved. [2025-10-27T18:57:50.230803] [INFO ] [MAIN ] Update Progress: 919/2366 symbols completed. GF took 20.7s. Estimated remaining: 3h 5m 28s. Rate: 7.8 symbols/min [2025-10-27T18:57:50.679416] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-27T18:57:50.690151] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-27T18:57:53.176894] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-27T18:57:53.189021] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-27T18:57:55.572058] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-27T18:57:55.583528] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-27T18:57:57.643308] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-27T18:57:57.654563] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-27T18:58:00.130489] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-27T18:58:00.143929] [INFO ] [REMOTE ] GEV: Full fetch complete (77058 records). [2025-10-27T18:58:00.144099] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-27T18:58:00.534922] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-27T18:58:00.535015] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-27T18:58:00.535950] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-27T18:58:00.536014] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-27T18:58:00.537494] [DEBUG] [LOCAL ] GEV: Trimmed 77058 records to 52985 (keeping 200 days of data) [2025-10-27T18:58:00.866358] [DEBUG] [LOCAL ] GEV: Primary data saved (52985 records). [2025-10-27T18:58:00.866490] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-27T18:58:00.866566] [INFO ] [MAIN ] Update Progress: 920/2366 symbols completed. GEV took 36.7s. Estimated remaining: 3h 5m 25s. Rate: 7.8 symbols/min [2025-10-27T18:58:01.503284] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:58:01.546800] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:58:01.618528] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:58:01.619890] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:58:01.630324] [DEBUG] [LOCAL ] GFR: Loaded 7419 existing records from primary storage. [2025-10-27T18:58:01.630598] [INFO ] [MAIN ] GFR: Loaded 7419 existing records. [2025-10-27T18:58:01.868916] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:58:01.869230] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-27T18:58:01.869283] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-27T18:58:01.869421] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-27T18:58:01.869465] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-27T18:58:01.894380] [DEBUG] [LOCAL ] GFF: Loaded 29679 existing records from primary storage. [2025-10-27T18:58:01.954430] [INFO ] [MAIN ] GFF: Loaded 29679 existing records. [2025-10-27T18:58:02.007590] [DEBUG] [LOCAL ] GFI: Loaded 53895 existing records from primary storage. [2025-10-27T18:58:02.024104] [INFO ] [MAIN ] GFI: Loaded 53895 existing records. [2025-10-27T18:58:02.042245] [DEBUG] [LOCAL ] GFL: Loaded 48095 existing records from primary storage. [2025-10-27T18:58:02.143270] [INFO ] [MAIN ] GFL: Loaded 48095 existing records. [2025-10-27T18:58:02.666324] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:58:02.689415] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:58:02.690221] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-27T18:58:02.695754] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-27T18:58:02.722075] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-27T18:58:02.716713] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-27T18:58:02.756609] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-27T18:58:02.756747] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-27T18:58:02.839342] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:58:02.896951] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-27T18:58:02.911169] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:58:02.911484] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-27T18:58:02.911301] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-27T18:58:02.931141] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-27T18:58:02.937706] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-27T18:58:02.937913] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-27T18:58:03.005299] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-27T18:58:03.786572] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:58:03.823901] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-27T18:58:03.894021] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-27T18:58:03.953300] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-27T18:58:03.998536] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:58:04.005161] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-27T18:58:04.031792] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:58:04.032267] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-27T18:58:04.439533] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T18:58:04.441964] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-27T18:58:04.932941] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-27T18:58:04.937572] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-27T18:58:05.187045] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-27T18:58:05.196225] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-27T18:58:05.250057] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-27T18:58:05.256158] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-27T18:58:05.453618] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-27T18:58:05.456930] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-27T18:58:05.561970] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T18:58:05.572125] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-27T18:58:06.250787] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-27T18:58:06.253706] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-27T18:58:06.547674] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-27T18:58:06.554370] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-27T18:58:06.648173] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T18:58:06.662902] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-27T18:58:06.662704] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-27T18:58:06.665983] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-27T18:58:07.092216] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T18:58:07.107412] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-27T18:58:07.285801] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-27T18:58:07.287774] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-27T18:58:07.524302] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-27T18:58:07.535365] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-27T18:58:07.714426] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-27T18:58:07.716340] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-27T18:58:08.291182] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-27T18:58:08.414925] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-27T18:58:08.631905] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T18:58:08.636041] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T18:58:08.705274] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-27T18:58:09.214974] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-27T18:58:10.014986] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-27T18:58:10.138306] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T18:58:10.777358] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-27T18:58:10.779043] [INFO ] [REMOTE ] GFR: Full fetch complete (11909 records). [2025-10-27T18:58:10.779117] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-27T18:58:10.820405] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-27T18:58:11.148078] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-27T18:58:11.148316] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-27T18:58:11.148700] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-27T18:58:11.148977] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-27T18:58:11.149804] [DEBUG] [LOCAL ] GFR: Trimmed 11909 records to 6925 (keeping 200 days of data) [2025-10-27T18:58:11.212359] [DEBUG] [LOCAL ] GFR: Primary data saved (6925 records). [2025-10-27T18:58:11.215337] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-27T18:58:11.215423] [INFO ] [MAIN ] Update Progress: 921/2366 symbols completed. GFR took 10.3s. Estimated remaining: 3h 5m 21s. Rate: 7.8 symbols/min [2025-10-27T18:58:11.284841] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-27T18:58:11.393901] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:58:11.439222] [DEBUG] [LOCAL ] GGB: Loaded 52322 existing records from primary storage. [2025-10-27T18:58:11.439507] [INFO ] [MAIN ] GGB: Loaded 52322 existing records. [2025-10-27T18:58:11.615747] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:58:11.615829] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-27T18:58:11.616058] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-27T18:58:11.616132] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-27T18:58:11.616948] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-27T18:58:11.617008] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-27T18:58:11.967396] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:58:12.258884] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T18:58:12.414994] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-27T18:58:13.214920] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-27T18:58:13.328305] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-27T18:58:14.020031] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-27T18:58:14.038417] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-27T18:58:14.814973] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-27T18:58:15.070353] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-27T18:58:15.179804] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T18:58:15.614997] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-27T18:58:16.041849] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T18:58:16.414979] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-27T18:58:16.974818] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-27T18:58:17.214920] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-27T18:58:17.639392] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-27T18:58:18.014926] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-27T18:58:18.580287] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T18:58:18.814973] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-27T18:58:19.580382] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T18:58:19.614898] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-27T18:58:20.162750] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T18:58:20.414949] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-27T18:58:20.918723] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T18:58:21.214927] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-27T18:58:21.514081] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T18:58:22.014923] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-27T18:58:22.621454] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T18:58:22.814933] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-27T18:58:23.265357] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T18:58:23.614937] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-27T18:58:24.418187] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-27T18:58:24.436728] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T18:58:24.461244] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-27T18:58:24.466118] [INFO ] [REMOTE ] GFF: Full fetch complete (43426 records). [2025-10-27T18:58:24.466217] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-27T18:58:24.842987] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-27T18:58:24.843072] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-27T18:58:24.843773] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-27T18:58:24.843835] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-27T18:58:24.844870] [DEBUG] [LOCAL ] GFF: Trimmed 43426 records to 28918 (keeping 200 days of data) [2025-10-27T18:58:25.020965] [DEBUG] [LOCAL ] GFF: Primary data saved (28918 records). [2025-10-27T18:58:25.021104] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-27T18:58:25.021183] [INFO ] [MAIN ] Update Progress: 922/2366 symbols completed. GFF took 24.2s. Estimated remaining: 3h 5m 23s. Rate: 7.8 symbols/min [2025-10-27T18:58:25.188800] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:58:25.214940] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-27T18:58:25.228351] [DEBUG] [LOCAL ] GGG: Loaded 41285 existing records from primary storage. [2025-10-27T18:58:25.228638] [INFO ] [MAIN ] GGG: Loaded 41285 existing records. [2025-10-27T18:58:25.407709] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:58:25.407931] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-27T18:58:25.407977] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-27T18:58:25.408693] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-27T18:58:25.408795] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-27T18:58:25.766780] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:58:25.829349] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T18:58:26.014940] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-27T18:58:26.814915] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-27T18:58:27.018749] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-27T18:58:27.334200] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-27T18:58:27.614939] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-27T18:58:28.365287] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T18:58:28.414972] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-27T18:58:29.214948] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-27T18:58:29.439521] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-27T18:58:29.518217] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-27T18:58:30.014933] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-27T18:58:30.610052] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T18:58:30.814948] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-27T18:58:31.614953] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-27T18:58:31.961062] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-27T18:58:32.286981] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T18:58:32.414936] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-27T18:58:32.860159] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T18:58:33.214932] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-27T18:58:34.014919] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-27T18:58:34.271845] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-27T18:58:34.280814] [INFO ] [REMOTE ] GFL: Full fetch complete (69586 records). [2025-10-27T18:58:34.280940] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-27T18:58:34.664737] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-27T18:58:34.664842] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-27T18:58:34.665710] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-27T18:58:34.665772] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-27T18:58:34.667096] [DEBUG] [LOCAL ] GFL: Trimmed 69586 records to 47263 (keeping 200 days of data) [2025-10-27T18:58:34.835300] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-27T18:58:34.945172] [DEBUG] [LOCAL ] GFL: Primary data saved (47263 records). [2025-10-27T18:58:34.945298] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-27T18:58:34.945372] [INFO ] [MAIN ] Update Progress: 923/2366 symbols completed. GFL took 34.1s. Estimated remaining: 3h 5m 19s. Rate: 7.8 symbols/min [2025-10-27T18:58:35.110607] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:58:35.125966] [DEBUG] [LOCAL ] GGT: Loaded 14679 existing records from primary storage. [2025-10-27T18:58:35.126247] [INFO ] [MAIN ] GGT: Loaded 14679 existing records. [2025-10-27T18:58:35.307532] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:58:35.307893] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-27T18:58:35.307963] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-27T18:58:35.308159] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-27T18:58:35.308225] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-27T18:58:35.694334] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:58:35.694842] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-27T18:58:35.722739] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-27T18:58:35.733119] [INFO ] [REMOTE ] GFI: Full fetch complete (77024 records). [2025-10-27T18:58:35.733251] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-27T18:58:36.112724] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-27T18:58:36.166862] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-27T18:58:36.167259] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-27T18:58:36.168294] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-27T18:58:36.168528] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-27T18:58:36.168911] [INFO ] [REMOTE ] GGB: Full fetch complete (74396 records). [2025-10-27T18:58:36.169105] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-27T18:58:36.191986] [DEBUG] [LOCAL ] GFI: Trimmed 77024 records to 53115 (keeping 200 days of data) [2025-10-27T18:58:36.371362] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-27T18:58:36.451044] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T18:58:36.566220] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-27T18:58:36.922027] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-27T18:58:36.922132] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-27T18:58:36.923084] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-27T18:58:36.923165] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-27T18:58:36.953159] [DEBUG] [LOCAL ] GGB: Trimmed 74396 records to 51546 (keeping 200 days of data) [2025-10-27T18:58:36.958522] [DEBUG] [LOCAL ] GFI: Primary data saved (53115 records). [2025-10-27T18:58:36.959123] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-27T18:58:36.960424] [INFO ] [MAIN ] Update Progress: 924/2366 symbols completed. GFI took 36.1s. Estimated remaining: 3h 5m 2s. Rate: 7.8 symbols/min [2025-10-27T18:58:37.227530] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:58:37.224744] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-27T18:58:37.243445] [DEBUG] [LOCAL ] GGZ: Loaded 2362 existing records from primary storage. [2025-10-27T18:58:37.245229] [INFO ] [MAIN ] GGZ: Loaded 2362 existing records. [2025-10-27T18:58:37.513739] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:58:37.532164] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-27T18:58:37.536009] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-27T18:58:37.536328] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-27T18:58:37.542024] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-27T18:58:37.542377] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-27T18:58:37.781563] [DEBUG] [LOCAL ] GGB: Primary data saved (51546 records). [2025-10-27T18:58:37.842471] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-27T18:58:37.869005] [INFO ] [MAIN ] Update Progress: 925/2366 symbols completed. GGB took 26.7s. Estimated remaining: 3h 4m 44s. Rate: 7.8 symbols/min [2025-10-27T18:58:38.015607] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-27T18:58:38.154416] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:58:38.158554] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:58:38.163937] [DEBUG] [LOCAL ] GHC: Loaded 2993 existing records from primary storage. [2025-10-27T18:58:38.164087] [INFO ] [MAIN ] GHC: Loaded 2993 existing records. [2025-10-27T18:58:38.344410] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:58:38.344575] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-27T18:58:38.344637] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-27T18:58:38.344825] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-27T18:58:38.344889] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-27T18:58:38.723191] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:58:38.814907] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-27T18:58:38.855064] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T18:58:38.915350] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T18:58:39.375784] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-27T18:58:39.614969] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-27T18:58:40.414985] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-27T18:58:41.077427] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-27T18:58:41.214941] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-27T18:58:41.230447] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T18:58:42.014928] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-27T18:58:42.390824] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-27T18:58:42.611470] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T18:58:42.814969] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-27T18:58:43.397550] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T18:58:43.614932] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-27T18:58:44.015961] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-27T18:58:44.414913] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-27T18:58:44.824412] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-27T18:58:45.214932] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-27T18:58:45.922828] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T18:58:46.014907] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-27T18:58:46.814994] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-27T18:58:47.173219] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T18:58:47.280613] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-27T18:58:47.614941] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-27T18:58:48.414963] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-27T18:58:48.716529] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T18:58:48.926288] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-27T18:58:49.215003] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-27T18:58:50.014932] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-27T18:58:50.742537] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T18:58:50.743115] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-27T18:58:50.814900] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-27T18:58:51.615000] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-27T18:58:52.160081] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-27T18:58:52.301185] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T18:58:52.414946] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-27T18:58:53.214953] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-27T18:58:53.445630] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T18:58:54.014960] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-27T18:58:54.544993] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-27T18:58:54.726422] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-27T18:58:54.734522] [INFO ] [REMOTE ] GGG: Full fetch complete (59600 records). [2025-10-27T18:58:54.734679] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-27T18:58:54.820124] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-27T18:58:55.118866] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-27T18:58:55.118956] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-27T18:58:55.119840] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-27T18:58:55.119903] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-27T18:58:55.121367] [DEBUG] [LOCAL ] GGG: Trimmed 59600 records to 40459 (keeping 200 days of data) [2025-10-27T18:58:55.333807] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-27T18:58:55.376135] [DEBUG] [LOCAL ] GGG: Primary data saved (40459 records). [2025-10-27T18:58:55.376258] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-27T18:58:55.376336] [INFO ] [MAIN ] Update Progress: 926/2366 symbols completed. GGG took 30.4s. Estimated remaining: 3h 4m 51s. Rate: 7.8 symbols/min [2025-10-27T18:58:55.551271] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:58:55.555820] [DEBUG] [LOCAL ] GHG: Loaded 3310 existing records from primary storage. [2025-10-27T18:58:55.555969] [INFO ] [MAIN ] GHG: Loaded 3310 existing records. [2025-10-27T18:58:55.620145] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-27T18:58:55.740066] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:58:55.740270] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-27T18:58:55.740316] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-27T18:58:55.740445] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-27T18:58:55.740482] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-27T18:58:56.087174] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:58:56.113717] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-27T18:58:56.414949] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-27T18:58:57.137664] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T18:58:57.214949] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-27T18:58:57.746807] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-27T18:58:58.014943] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-27T18:58:58.458630] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-27T18:58:58.814940] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-27T18:58:59.144237] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-27T18:58:59.614927] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-27T18:58:59.900560] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-27T18:59:00.414945] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-27T18:59:01.092696] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-27T18:59:01.214980] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-27T18:59:02.015034] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-27T18:59:02.618750] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T18:59:02.814997] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-27T18:59:03.050751] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T18:59:03.389092] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-27T18:59:03.391288] [INFO ] [REMOTE ] GHC: Full fetch complete (3710 records). [2025-10-27T18:59:03.391577] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-27T18:59:03.620051] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-27T18:59:03.853488] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-27T18:59:03.853564] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-27T18:59:03.853716] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-27T18:59:03.853777] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-27T18:59:03.854162] [DEBUG] [LOCAL ] GHC: Trimmed 3710 records to 2950 (keeping 200 days of data) [2025-10-27T18:59:03.878142] [DEBUG] [LOCAL ] GHC: Primary data saved (2950 records). [2025-10-27T18:59:03.878312] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-27T18:59:03.878461] [INFO ] [MAIN ] Update Progress: 927/2366 symbols completed. GHC took 26.0s. Estimated remaining: 3h 4m 45s. Rate: 7.8 symbols/min [2025-10-27T18:59:04.045842] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:59:04.056460] [DEBUG] [LOCAL ] GHI: Loaded 8101 existing records from primary storage. [2025-10-27T18:59:04.056687] [INFO ] [MAIN ] GHI: Loaded 8101 existing records. [2025-10-27T18:59:04.233385] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:59:04.233555] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-27T18:59:04.233601] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-27T18:59:04.233771] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-27T18:59:04.233827] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-27T18:59:04.336118] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-27T18:59:04.420153] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-27T18:59:04.594487] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:59:05.214968] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-27T18:59:05.673127] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-27T18:59:05.716540] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-27T18:59:06.014969] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-27T18:59:06.536035] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-27T18:59:06.814963] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-27T18:59:07.614971] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-27T18:59:07.786685] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-27T18:59:07.790287] [INFO ] [REMOTE ] GGT: Full fetch complete (19160 records). [2025-10-27T18:59:07.790415] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-27T18:59:08.163984] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-27T18:59:08.164064] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-27T18:59:08.164461] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-27T18:59:08.164499] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-27T18:59:08.165126] [DEBUG] [LOCAL ] GGT: Trimmed 19160 records to 14417 (keeping 200 days of data) [2025-10-27T18:59:08.202206] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-27T18:59:08.253902] [DEBUG] [LOCAL ] GGT: Primary data saved (14417 records). [2025-10-27T18:59:08.254047] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-27T18:59:08.254202] [INFO ] [MAIN ] Update Progress: 928/2366 symbols completed. GGT took 33.3s. Estimated remaining: 3h 4m 32s. Rate: 7.8 symbols/min [2025-10-27T18:59:08.420142] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-27T18:59:08.422928] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:59:08.430668] [DEBUG] [LOCAL ] GHLD: Loaded 4362 existing records from primary storage. [2025-10-27T18:59:08.430847] [INFO ] [MAIN ] GHLD: Loaded 4362 existing records. [2025-10-27T18:59:08.606299] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:59:08.606516] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-27T18:59:08.606566] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-27T18:59:08.606745] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-27T18:59:08.606859] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-27T18:59:08.956920] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:59:09.055281] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T18:59:09.214945] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-27T18:59:09.651951] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-27T18:59:10.014974] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-27T18:59:10.570590] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T18:59:10.571568] [INFO ] [REMOTE ] GGZ: Full fetch complete (3789 records). [2025-10-27T18:59:10.571636] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-27T18:59:10.820143] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-27T18:59:10.935426] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-27T18:59:10.935507] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-27T18:59:10.935660] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-27T18:59:10.935721] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-27T18:59:10.936165] [DEBUG] [LOCAL ] GGZ: Trimmed 3789 records to 2291 (keeping 200 days of data) [2025-10-27T18:59:10.951149] [DEBUG] [LOCAL ] GGZ: Primary data saved (2291 records). [2025-10-27T18:59:10.951214] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-27T18:59:10.951282] [INFO ] [MAIN ] Update Progress: 929/2366 symbols completed. GGZ took 34.0s. Estimated remaining: 3h 4m 17s. Rate: 7.8 symbols/min [2025-10-27T18:59:11.125631] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:59:11.142841] [DEBUG] [LOCAL ] GHM: Loaded 14511 existing records from primary storage. [2025-10-27T18:59:11.143096] [INFO ] [MAIN ] GHM: Loaded 14511 existing records. [2025-10-27T18:59:11.341131] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:59:11.344213] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-27T18:59:11.344378] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-27T18:59:11.344473] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-27T18:59:11.346035] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-27T18:59:11.346092] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-27T18:59:11.620097] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-27T18:59:11.708747] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:59:12.299257] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-27T18:59:12.414958] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-27T18:59:13.214925] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-27T18:59:13.224955] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T18:59:13.679176] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-27T18:59:14.014937] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-27T18:59:14.479109] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-27T18:59:14.814943] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-27T18:59:15.313230] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-27T18:59:15.614960] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-27T18:59:16.337638] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-27T18:59:16.414923] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-27T18:59:17.214970] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-27T18:59:17.222150] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-27T18:59:17.826118] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T18:59:18.015023] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-27T18:59:18.686943] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-27T18:59:18.814976] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-27T18:59:19.263020] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T18:59:19.614942] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-27T18:59:20.245827] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-27T18:59:20.414965] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-27T18:59:21.176701] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-27T18:59:21.214900] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-27T18:59:21.628390] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-27T18:59:22.015003] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-27T18:59:22.719695] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-27T18:59:22.814904] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-27T18:59:23.614913] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-27T18:59:23.732869] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T18:59:24.256981] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-27T18:59:24.414978] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-27T18:59:25.214924] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-27T18:59:25.263398] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T18:59:25.650008] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-27T18:59:26.014945] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-27T18:59:26.613526] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T18:59:26.814942] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-27T18:59:27.148761] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-27T18:59:27.614942] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-27T18:59:28.414949] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-27T18:59:28.743688] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T18:59:29.012043] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-27T18:59:29.214969] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-27T18:59:29.829631] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T18:59:30.014941] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-27T18:59:30.814978] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-27T18:59:31.464270] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-27T18:59:31.465481] [INFO ] [REMOTE ] GHG: Full fetch complete (4217 records). [2025-10-27T18:59:31.465549] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-27T18:59:31.620060] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-27T18:59:31.796503] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-27T18:59:31.870803] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-27T18:59:31.870875] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-27T18:59:31.871021] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-27T18:59:31.871061] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-27T18:59:31.871435] [DEBUG] [LOCAL ] GHG: Trimmed 4217 records to 3268 (keeping 200 days of data) [2025-10-27T18:59:31.892370] [DEBUG] [LOCAL ] GHG: Primary data saved (3268 records). [2025-10-27T18:59:31.892440] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-27T18:59:31.892537] [INFO ] [MAIN ] Update Progress: 930/2366 symbols completed. GHG took 36.5s. Estimated remaining: 3h 4m 29s. Rate: 7.8 symbols/min [2025-10-27T18:59:32.073979] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:59:32.095722] [DEBUG] [LOCAL ] GHY: Loaded 21125 existing records from primary storage. [2025-10-27T18:59:32.095970] [INFO ] [MAIN ] GHY: Loaded 21125 existing records. [2025-10-27T18:59:32.218368] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-27T18:59:32.235276] [INFO ] [REMOTE ] GHLD: Full fetch complete (5174 records). [2025-10-27T18:59:32.254745] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-27T18:59:32.396261] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:59:32.396848] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-27T18:59:32.396919] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-27T18:59:32.417882] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-27T18:59:32.412705] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-27T18:59:32.441397] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-27T18:59:32.852272] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-27T18:59:32.860926] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-27T18:59:32.861141] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-27T18:59:32.861216] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-27T18:59:32.919392] [DEBUG] [LOCAL ] GHLD: Trimmed 5174 records to 4334 (keeping 200 days of data) [2025-10-27T18:59:33.003942] [DEBUG] [LOCAL ] GHLD: Primary data saved (4334 records). [2025-10-27T18:59:33.022059] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-27T18:59:33.041492] [INFO ] [MAIN ] Update Progress: 931/2366 symbols completed. GHLD took 24.8s. Estimated remaining: 3h 4m 12s. Rate: 7.8 symbols/min [2025-10-27T18:59:33.081930] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:59:33.234288] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-27T18:59:33.237613] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:59:33.269578] [DEBUG] [LOCAL ] GIB: Loaded 31725 existing records from primary storage. [2025-10-27T18:59:33.269930] [INFO ] [MAIN ] GIB: Loaded 31725 existing records. [2025-10-27T18:59:33.397376] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T18:59:33.468089] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:59:33.468302] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-27T18:59:33.468350] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-27T18:59:33.468591] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-27T18:59:33.468632] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-27T18:59:33.847210] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:59:34.014932] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-27T18:59:34.485534] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T18:59:34.814915] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-27T18:59:35.208336] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T18:59:35.614946] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-27T18:59:35.827537] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-27T18:59:36.414955] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-27T18:59:36.657878] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T18:59:37.214981] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-27T18:59:37.351302] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-27T18:59:38.014980] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-27T18:59:38.043729] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-27T18:59:38.814972] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-27T18:59:39.062689] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-27T18:59:39.066803] [INFO ] [REMOTE ] GHM: Full fetch complete (21908 records). [2025-10-27T18:59:39.066893] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-27T18:59:39.443976] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-27T18:59:39.444050] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-27T18:59:39.444477] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-27T18:59:39.444515] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-27T18:59:39.445084] [DEBUG] [LOCAL ] GHM: Trimmed 21908 records to 14338 (keeping 200 days of data) [2025-10-27T18:59:39.524828] [DEBUG] [LOCAL ] GHM: Primary data saved (14338 records). [2025-10-27T18:59:39.524950] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-27T18:59:39.525027] [INFO ] [MAIN ] Update Progress: 932/2366 symbols completed. GHM took 28.6s. Estimated remaining: 3h 4m 2s. Rate: 7.8 symbols/min [2025-10-27T18:59:39.623407] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-27T18:59:39.695859] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:59:39.710040] [DEBUG] [LOCAL ] GIC: Loaded 13286 existing records from primary storage. [2025-10-27T18:59:39.710254] [INFO ] [MAIN ] GIC: Loaded 13286 existing records. [2025-10-27T18:59:39.884377] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:59:39.884558] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-27T18:59:39.884606] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-27T18:59:39.884812] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-27T18:59:39.884875] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-27T18:59:40.240486] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:59:40.293051] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-27T18:59:40.370704] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-27T18:59:40.414899] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-27T18:59:41.214968] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-27T18:59:41.393344] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T18:59:41.396442] [INFO ] [REMOTE ] GHI: Full fetch complete (11370 records). [2025-10-27T18:59:41.396526] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-27T18:59:41.750750] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-27T18:59:41.750826] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-27T18:59:41.751097] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-27T18:59:41.751134] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-27T18:59:41.751611] [DEBUG] [LOCAL ] GHI: Trimmed 11370 records to 8001 (keeping 200 days of data) [2025-10-27T18:59:41.805216] [DEBUG] [LOCAL ] GHI: Primary data saved (8001 records). [2025-10-27T18:59:41.805352] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-27T18:59:41.805432] [INFO ] [MAIN ] Update Progress: 933/2366 symbols completed. GHI took 37.9s. Estimated remaining: 3h 3m 46s. Rate: 7.8 symbols/min [2025-10-27T18:59:41.972632] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:59:42.012280] [DEBUG] [LOCAL ] GIL: Loaded 44636 existing records from primary storage. [2025-10-27T18:59:42.012555] [INFO ] [MAIN ] GIL: Loaded 44636 existing records. [2025-10-27T18:59:42.023490] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-27T18:59:42.198138] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:59:42.198320] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-27T18:59:42.198365] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-27T18:59:42.198538] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-27T18:59:42.198575] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-27T18:59:42.551923] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:59:42.683233] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T18:59:42.814960] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-27T18:59:42.937056] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-27T18:59:43.402958] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-27T18:59:43.614971] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-27T18:59:44.415001] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-27T18:59:44.984865] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T18:59:45.214950] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-27T18:59:45.885418] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T18:59:46.014956] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-27T18:59:46.494844] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-27T18:59:46.814963] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-27T18:59:47.403311] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-27T18:59:47.614978] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-27T18:59:48.040050] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T18:59:48.414918] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-27T18:59:48.807265] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T18:59:49.195886] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T18:59:49.214900] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-27T18:59:50.014917] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-27T18:59:50.167257] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-27T18:59:50.814921] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-27T18:59:51.501441] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T18:59:51.519190] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-27T18:59:51.614955] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-27T18:59:52.414987] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-27T18:59:52.742254] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-27T18:59:53.214989] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-27T18:59:53.836073] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T18:59:54.014923] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-27T18:59:54.249629] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-27T18:59:54.814948] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-27T18:59:55.056429] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T18:59:55.615012] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-27T18:59:55.921915] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T18:59:56.414971] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-27T18:59:56.820988] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-27T18:59:57.148297] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-27T18:59:57.214996] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-27T18:59:58.014906] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-27T18:59:58.251376] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T18:59:58.814943] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-27T18:59:59.529311] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-27T18:59:59.535445] [INFO ] [REMOTE ] GIB: Full fetch complete (46533 records). [2025-10-27T18:59:59.535563] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-27T18:59:59.623256] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-27T18:59:59.932330] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-27T18:59:59.932402] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-27T18:59:59.933110] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-27T18:59:59.933171] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-27T18:59:59.934116] [DEBUG] [LOCAL ] GIB: Trimmed 46533 records to 30975 (keeping 200 days of data) [2025-10-27T19:00:00.096182] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-27T19:00:00.139206] [DEBUG] [LOCAL ] GIB: Primary data saved (30975 records). [2025-10-27T19:00:00.139316] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-27T19:00:00.130618] [INFO ] [REMOTE ] GHY: Full fetch complete (32135 records). [2025-10-27T19:00:00.139435] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-27T19:00:00.139965] [INFO ] [MAIN ] Update Progress: 934/2366 symbols completed. GIB took 27.1s. Estimated remaining: 3h 3m 55s. Rate: 7.8 symbols/min [2025-10-27T19:00:00.435233] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-27T19:00:00.521538] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:00:00.722903] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-27T19:00:00.723051] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-27T19:00:00.723638] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-27T19:00:00.723724] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-27T19:00:00.738416] [DEBUG] [LOCAL ] GHY: Trimmed 32135 records to 20669 (keeping 200 days of data) [2025-10-27T19:00:00.879064] [DEBUG] [LOCAL ] GHY: Primary data saved (20669 records). [2025-10-27T19:00:00.879219] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-27T19:00:00.879340] [INFO ] [MAIN ] Update Progress: 935/2366 symbols completed. GHY took 29.0s. Estimated remaining: 3h 3m 36s. Rate: 7.8 symbols/min [2025-10-27T19:00:00.891967] [DEBUG] [LOCAL ] GIS: Loaded 54455 existing records from primary storage. [2025-10-27T19:00:00.923713] [INFO ] [MAIN ] GIS: Loaded 54455 existing records. [2025-10-27T19:00:01.191622] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:00:01.261920] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:00:01.262242] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-27T19:00:01.262306] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-27T19:00:01.262551] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-27T19:00:01.262623] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-27T19:00:01.596830] [DEBUG] [LOCAL ] GKOS: Loaded 43058 existing records from primary storage. [2025-10-27T19:00:01.597619] [INFO ] [MAIN ] GKOS: Loaded 43058 existing records. [2025-10-27T19:00:01.780100] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:00:01.821619] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-27T19:00:01.942174] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:00:01.942508] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-27T19:00:01.942803] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-27T19:00:01.943103] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-27T19:00:01.943208] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-27T19:00:02.033505] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-27T19:00:02.110993] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-27T19:00:02.133205] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-27T19:00:02.420484] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:00:02.814948] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-27T19:00:02.922676] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T19:00:03.615022] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-27T19:00:04.240387] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-27T19:00:04.414965] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-27T19:00:04.997471] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-27T19:00:05.112180] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-27T19:00:05.214918] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-27T19:00:06.014976] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-27T19:00:06.814932] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-27T19:00:07.105218] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (2.69 seconds). [2025-10-27T19:00:07.171611] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-27T19:00:07.614913] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-27T19:00:08.108774] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-27T19:00:08.159883] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-27T19:00:08.414997] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-27T19:00:09.067680] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T19:00:09.214962] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-27T19:00:10.014913] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-27T19:00:10.145318] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-27T19:00:10.290013] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T19:00:10.293817] [INFO ] [REMOTE ] GIC: Full fetch complete (19674 records). [2025-10-27T19:00:10.294007] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-27T19:00:10.690598] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-27T19:00:10.690717] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-27T19:00:10.691139] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-27T19:00:10.691201] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-27T19:00:10.691800] [DEBUG] [LOCAL ] GIC: Trimmed 19674 records to 12968 (keeping 200 days of data) [2025-10-27T19:00:10.767359] [DEBUG] [LOCAL ] GIC: Primary data saved (12968 records). [2025-10-27T19:00:10.767488] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-27T19:00:10.767570] [INFO ] [MAIN ] Update Progress: 936/2366 symbols completed. GIC took 31.2s. Estimated remaining: 3h 3m 32s. Rate: 7.8 symbols/min [2025-10-27T19:00:10.820903] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-27T19:00:10.945865] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:00:10.983023] [DEBUG] [LOCAL ] GL: Loaded 38036 existing records from primary storage. [2025-10-27T19:00:10.983322] [INFO ] [MAIN ] GL: Loaded 38036 existing records. [2025-10-27T19:00:11.155270] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:00:11.155466] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-27T19:00:11.155512] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-27T19:00:11.155723] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-27T19:00:11.155779] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-27T19:00:11.509056] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:00:11.614924] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-27T19:00:11.754873] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-27T19:00:12.414980] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-27T19:00:12.903664] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-27T19:00:13.081135] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T19:00:13.214957] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-27T19:00:13.864127] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-27T19:00:14.015045] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-27T19:00:14.820067] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-27T19:00:14.837765] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-27T19:00:15.614926] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-27T19:00:16.063973] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-27T19:00:16.414914] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-27T19:00:16.490696] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-27T19:00:17.214973] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-27T19:00:17.914424] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-27T19:00:18.014918] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-27T19:00:18.638060] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-27T19:00:18.815013] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-27T19:00:19.469795] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T19:00:19.614913] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-27T19:00:20.057507] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (2.84 seconds). [2025-10-27T19:00:20.414978] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-27T19:00:20.635535] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T19:00:20.892949] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-27T19:00:21.214970] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-27T19:00:21.556044] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-27T19:00:22.014992] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-27T19:00:22.815018] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-27T19:00:23.006786] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-27T19:00:23.286029] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-27T19:00:23.614953] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-27T19:00:24.372719] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T19:00:24.414922] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-27T19:00:25.214940] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-27T19:00:25.240928] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-27T19:00:25.249808] [INFO ] [REMOTE ] GIL: Full fetch complete (62719 records). [2025-10-27T19:00:25.249923] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-27T19:00:25.642213] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-27T19:00:25.642343] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-27T19:00:25.643177] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-27T19:00:25.643350] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-27T19:00:25.644730] [DEBUG] [LOCAL ] GIL: Trimmed 62719 records to 43844 (keeping 200 days of data) [2025-10-27T19:00:25.784198] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-27T19:00:25.946414] [DEBUG] [LOCAL ] GIL: Primary data saved (43844 records). [2025-10-27T19:00:25.946667] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-27T19:00:25.946810] [INFO ] [MAIN ] Update Progress: 937/2366 symbols completed. GIL took 44.1s. Estimated remaining: 3h 3m 36s. Rate: 7.8 symbols/min [2025-10-27T19:00:26.020762] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-27T19:00:26.115620] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:00:26.158926] [DEBUG] [LOCAL ] GLOB: Loaded 48732 existing records from primary storage. [2025-10-27T19:00:26.159275] [INFO ] [MAIN ] GLOB: Loaded 48732 existing records. [2025-10-27T19:00:26.336960] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:00:26.337331] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-27T19:00:26.337402] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-27T19:00:26.337622] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-27T19:00:26.337702] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-27T19:00:26.706500] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:00:26.729938] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T19:00:26.814964] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-27T19:00:27.612236] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T19:00:27.620734] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-27T19:00:27.976608] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T19:00:28.415013] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-27T19:00:28.716019] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T19:00:29.215068] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-27T19:00:30.014927] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-27T19:00:30.095890] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T19:00:30.104293] [INFO ] [REMOTE ] GKOS: Full fetch complete (60746 records). [2025-10-27T19:00:30.104474] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-27T19:00:30.501219] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-27T19:00:30.501322] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-27T19:00:30.502218] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-27T19:00:30.502340] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-27T19:00:30.503609] [DEBUG] [LOCAL ] GKOS: Trimmed 60746 records to 42292 (keeping 200 days of data) [2025-10-27T19:00:30.610913] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T19:00:30.776806] [DEBUG] [LOCAL ] GKOS: Primary data saved (42292 records). [2025-10-27T19:00:30.776928] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-27T19:00:30.777001] [INFO ] [MAIN ] Update Progress: 938/2366 symbols completed. GKOS took 29.9s. Estimated remaining: 3h 3m 24s. Rate: 7.8 symbols/min [2025-10-27T19:00:30.820062] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-27T19:00:30.947696] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:00:30.958389] [DEBUG] [LOCAL ] GLP: Loaded 9295 existing records from primary storage. [2025-10-27T19:00:30.958593] [INFO ] [MAIN ] GLP: Loaded 9295 existing records. [2025-10-27T19:00:31.133555] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:00:31.133775] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-27T19:00:31.133825] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-27T19:00:31.133975] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-27T19:00:31.134014] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-27T19:00:31.492675] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:00:31.614924] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-27T19:00:31.672440] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T19:00:32.326815] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T19:00:32.414903] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-27T19:00:33.214936] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-27T19:00:33.484981] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-27T19:00:33.836867] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T19:00:34.014959] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-27T19:00:34.814988] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-27T19:00:34.898529] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T19:00:35.080621] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-27T19:00:35.614949] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-27T19:00:35.729811] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-27T19:00:35.740162] [INFO ] [REMOTE ] GIS: Full fetch complete (77844 records). [2025-10-27T19:00:35.740293] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-27T19:00:36.121934] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-27T19:00:36.122011] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-27T19:00:36.122943] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-27T19:00:36.123006] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-27T19:00:36.124389] [DEBUG] [LOCAL ] GIS: Trimmed 77844 records to 53675 (keeping 200 days of data) [2025-10-27T19:00:36.432380] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-27T19:00:36.458635] [DEBUG] [LOCAL ] GIS: Primary data saved (53675 records). [2025-10-27T19:00:36.458903] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-27T19:00:36.459388] [INFO ] [MAIN ] Update Progress: 939/2366 symbols completed. GIS took 36.3s. Estimated remaining: 3h 3m 13s. Rate: 7.8 symbols/min [2025-10-27T19:00:36.631005] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:00:36.684578] [DEBUG] [LOCAL ] GLW: Loaded 54415 existing records from primary storage. [2025-10-27T19:00:36.684932] [INFO ] [MAIN ] GLW: Loaded 54415 existing records. [2025-10-27T19:00:36.864554] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:00:36.864894] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-27T19:00:36.865029] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-27T19:00:36.865249] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-27T19:00:36.865296] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-27T19:00:37.177938] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T19:00:37.226235] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-27T19:00:37.278821] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:00:37.279878] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-27T19:00:38.014938] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-27T19:00:38.538557] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T19:00:38.546951] [INFO ] [REMOTE ] GL: Full fetch complete (54864 records). [2025-10-27T19:00:38.547143] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-27T19:00:38.822416] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-27T19:00:38.962573] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-27T19:00:38.962713] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-27T19:00:38.964227] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-27T19:00:38.964296] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-27T19:00:38.966025] [DEBUG] [LOCAL ] GL: Trimmed 54864 records to 37258 (keeping 200 days of data) [2025-10-27T19:00:39.244788] [DEBUG] [LOCAL ] GL: Primary data saved (37258 records). [2025-10-27T19:00:39.245026] [INFO ] [MAIN ] GL: Full history saved. [2025-10-27T19:00:39.245822] [INFO ] [MAIN ] Update Progress: 940/2366 symbols completed. GL took 28.5s. Estimated remaining: 3h 2m 58s. Rate: 7.8 symbols/min [2025-10-27T19:00:39.413689] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:00:39.481488] [DEBUG] [LOCAL ] GM: Loaded 54509 existing records from primary storage. [2025-10-27T19:00:39.481975] [INFO ] [MAIN ] GM: Loaded 54509 existing records. [2025-10-27T19:00:39.626271] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-27T19:00:39.671726] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:00:39.672152] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-27T19:00:39.672215] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-27T19:00:39.672477] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-27T19:00:39.672519] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-27T19:00:40.093474] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:00:40.130880] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-27T19:00:40.382488] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T19:00:40.414920] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-27T19:00:40.551010] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T19:00:41.214985] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-27T19:00:42.014979] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-27T19:00:42.186735] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-27T19:00:42.452368] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-27T19:00:42.815063] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-27T19:00:42.910043] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T19:00:43.615006] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-27T19:00:44.382934] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T19:00:44.414904] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-27T19:00:45.214978] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-27T19:00:46.014941] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-27T19:00:46.032833] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T19:00:46.102679] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T19:00:46.814985] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-27T19:00:47.524038] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (3.91 seconds). [2025-10-27T19:00:47.614928] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-27T19:00:47.732605] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-27T19:00:48.414933] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-27T19:00:48.722945] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-27T19:00:48.866670] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T19:00:49.220092] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-27T19:00:49.236628] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-27T19:00:50.014944] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-27T19:00:50.814973] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-27T19:00:51.052484] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-27T19:00:51.588664] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-27T19:00:51.614921] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-27T19:00:51.881048] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-27T19:00:52.373532] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-27T19:00:52.414957] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-27T19:00:53.214969] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-27T19:00:53.297527] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-27T19:00:54.014963] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-27T19:00:54.815009] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-27T19:00:55.156501] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-27T19:00:55.615017] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-27T19:00:56.301053] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-27T19:00:56.415010] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-27T19:00:56.646700] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-27T19:00:57.214970] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-27T19:00:57.264991] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-27T19:00:58.014921] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-27T19:00:58.066888] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-27T19:00:58.814936] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-27T19:00:58.905598] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-27T19:00:58.907723] [INFO ] [REMOTE ] GLP: Full fetch complete (14227 records). [2025-10-27T19:00:58.907797] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-27T19:00:59.288227] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-27T19:00:59.288349] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-27T19:00:59.288988] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-27T19:00:59.289150] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-27T19:00:59.290243] [DEBUG] [LOCAL ] GLP: Trimmed 14227 records to 9104 (keeping 200 days of data) [2025-10-27T19:00:59.348493] [DEBUG] [LOCAL ] GLP: Primary data saved (9104 records). [2025-10-27T19:00:59.348720] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-27T19:00:59.348871] [INFO ] [MAIN ] Update Progress: 941/2366 symbols completed. GLP took 28.6s. Estimated remaining: 3h 3m 9s. Rate: 7.8 symbols/min [2025-10-27T19:00:59.488941] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-27T19:00:59.570557] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:00:59.620787] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-27T19:00:59.624059] [DEBUG] [LOCAL ] GME: Loaded 54557 existing records from primary storage. [2025-10-27T19:00:59.624455] [INFO ] [MAIN ] GME: Loaded 54557 existing records. [2025-10-27T19:00:59.824470] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:00:59.824864] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-27T19:00:59.824936] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-27T19:00:59.825182] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-27T19:00:59.825237] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-27T19:01:00.174486] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:01:00.414967] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-27T19:01:00.780263] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-27T19:01:00.789788] [INFO ] [REMOTE ] GLOB: Full fetch complete (66565 records). [2025-10-27T19:01:00.789934] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-27T19:01:01.160758] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-27T19:01:01.160840] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-27T19:01:01.161671] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-27T19:01:01.161770] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-27T19:01:01.163170] [DEBUG] [LOCAL ] GLOB: Trimmed 66565 records to 48001 (keeping 200 days of data) [2025-10-27T19:01:01.220419] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-27T19:01:01.442919] [DEBUG] [LOCAL ] GLOB: Primary data saved (48001 records). [2025-10-27T19:01:01.443172] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-27T19:01:01.443435] [INFO ] [MAIN ] Update Progress: 942/2366 symbols completed. GLOB took 35.5s. Estimated remaining: 3h 2m 52s. Rate: 7.8 symbols/min [2025-10-27T19:01:01.609208] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:01:01.651589] [DEBUG] [LOCAL ] GMED: Loaded 48786 existing records from primary storage. [2025-10-27T19:01:01.651914] [INFO ] [MAIN ] GMED: Loaded 48786 existing records. [2025-10-27T19:01:01.867583] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-27T19:01:01.872026] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:01:01.883183] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-27T19:01:01.883279] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-27T19:01:01.883861] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-27T19:01:01.883913] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-27T19:01:02.024447] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-27T19:01:02.238478] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:01:02.814924] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-27T19:01:03.035545] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-27T19:01:03.615009] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-27T19:01:03.701166] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-27T19:01:03.826263] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-27T19:01:04.414933] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-27T19:01:04.489149] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T19:01:05.215040] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-27T19:01:05.431508] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-27T19:01:05.441860] [INFO ] [REMOTE ] GLW: Full fetch complete (77798 records). [2025-10-27T19:01:05.442010] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-27T19:01:05.828912] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-27T19:01:05.829004] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-27T19:01:05.830005] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-27T19:01:05.830073] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-27T19:01:05.831740] [DEBUG] [LOCAL ] GLW: Trimmed 77798 records to 53635 (keeping 200 days of data) [2025-10-27T19:01:06.015063] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-27T19:01:06.191348] [DEBUG] [LOCAL ] GLW: Primary data saved (53635 records). [2025-10-27T19:01:06.192074] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-27T19:01:06.193109] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-27T19:01:06.193609] [INFO ] [MAIN ] Update Progress: 943/2366 symbols completed. GLW took 29.7s. Estimated remaining: 3h 2m 40s. Rate: 7.8 symbols/min [2025-10-27T19:01:06.381165] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:01:06.446278] [DEBUG] [LOCAL ] GMRE: Loaded 36688 existing records from primary storage. [2025-10-27T19:01:06.446735] [INFO ] [MAIN ] GMRE: Loaded 36688 existing records. [2025-10-27T19:01:06.641864] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:01:06.642243] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-27T19:01:06.642348] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-27T19:01:06.642982] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-27T19:01:06.643043] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-27T19:01:06.823557] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-27T19:01:06.883864] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-27T19:01:07.038810] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:01:07.614986] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-27T19:01:07.725023] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-27T19:01:08.414953] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-27T19:01:09.027095] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T19:01:09.214933] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-27T19:01:09.739088] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.92 seconds). [2025-10-27T19:01:10.014922] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-27T19:01:10.045077] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-27T19:01:10.814935] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-27T19:01:10.855063] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T19:01:11.614962] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-27T19:01:11.837884] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-27T19:01:12.414921] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-27T19:01:12.521791] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-27T19:01:12.532199] [INFO ] [REMOTE ] GM: Full fetch complete (77907 records). [2025-10-27T19:01:12.532369] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-27T19:01:12.969021] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-27T19:01:12.969143] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-27T19:01:12.970098] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-27T19:01:12.970171] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-27T19:01:12.971674] [DEBUG] [LOCAL ] GM: Trimmed 77907 records to 53729 (keeping 200 days of data) [2025-10-27T19:01:13.216578] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-27T19:01:13.299856] [DEBUG] [LOCAL ] GM: Primary data saved (53729 records). [2025-10-27T19:01:13.300021] [INFO ] [MAIN ] GM: Full history saved. [2025-10-27T19:01:13.300825] [INFO ] [MAIN ] Update Progress: 944/2366 symbols completed. GM took 34.1s. Estimated remaining: 3h 2m 32s. Rate: 7.8 symbols/min [2025-10-27T19:01:13.480350] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:01:13.500735] [DEBUG] [LOCAL ] GNE: Loaded 18312 existing records from primary storage. [2025-10-27T19:01:13.500984] [INFO ] [MAIN ] GNE: Loaded 18312 existing records. [2025-10-27T19:01:13.690248] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:01:13.690762] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-27T19:01:13.690883] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-27T19:01:13.691213] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-27T19:01:13.707269] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-27T19:01:13.799155] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.98 seconds). [2025-10-27T19:01:14.015754] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-27T19:01:14.096134] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:01:14.143997] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-27T19:01:14.178625] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-27T19:01:14.815001] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-27T19:01:15.615003] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-27T19:01:15.804978] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T19:01:16.414951] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-27T19:01:16.545353] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T19:01:16.549824] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-27T19:01:17.215008] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-27T19:01:17.705262] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T19:01:17.968703] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T19:01:18.014920] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-27T19:01:18.814951] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-27T19:01:19.293439] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T19:01:19.614962] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-27T19:01:19.802119] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T19:01:20.415013] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-27T19:01:21.215006] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-27T19:01:21.767388] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-27T19:01:21.936486] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T19:01:22.014938] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-27T19:01:22.777487] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T19:01:22.814986] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-27T19:01:23.364148] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T19:01:23.614965] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-27T19:01:23.949417] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-27T19:01:24.180065] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-27T19:01:24.414951] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-27T19:01:25.214947] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-27T19:01:26.014987] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-27T19:01:26.392716] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T19:01:26.513204] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-27T19:01:26.538753] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-27T19:01:26.814949] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-27T19:01:27.614943] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-27T19:01:28.079520] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T19:01:28.414945] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-27T19:01:29.021203] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T19:01:29.214975] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-27T19:01:30.014974] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-27T19:01:30.117891] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-27T19:01:30.534035] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T19:01:30.543467] [INFO ] [REMOTE ] GMED: Full fetch complete (70187 records). [2025-10-27T19:01:30.543598] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-27T19:01:30.818873] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-27T19:01:30.938265] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-27T19:01:30.938366] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-27T19:01:30.939392] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-27T19:01:30.939473] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-27T19:01:30.961673] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T19:01:30.966886] [DEBUG] [LOCAL ] GMED: Trimmed 70187 records to 48055 (keeping 200 days of data) [2025-10-27T19:01:31.246447] [DEBUG] [LOCAL ] GMED: Primary data saved (48055 records). [2025-10-27T19:01:31.246574] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-27T19:01:31.246681] [INFO ] [MAIN ] Update Progress: 945/2366 symbols completed. GMED took 29.8s. Estimated remaining: 3h 2m 39s. Rate: 7.8 symbols/min [2025-10-27T19:01:31.419854] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:01:31.455947] [DEBUG] [LOCAL ] GNK: Loaded 39934 existing records from primary storage. [2025-10-27T19:01:31.456217] [INFO ] [MAIN ] GNK: Loaded 39934 existing records. [2025-10-27T19:01:31.623180] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-27T19:01:31.627904] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:01:31.629024] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-27T19:01:31.629072] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-27T19:01:31.629264] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-27T19:01:31.629319] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-27T19:01:31.977291] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:01:32.414987] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-27T19:01:33.215014] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-27T19:01:33.556446] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-10-27T19:01:33.765994] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-27T19:01:33.841579] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T19:01:34.014942] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-27T19:01:34.268257] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-27T19:01:34.814953] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-27T19:01:35.614924] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-27T19:01:35.851249] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T19:01:35.989602] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-27T19:01:36.414935] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-27T19:01:37.045264] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-27T19:01:37.214943] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-27T19:01:38.014928] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-27T19:01:38.316228] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-27T19:01:38.327616] [INFO ] [REMOTE ] GME: Full fetch complete (77919 records). [2025-10-27T19:01:38.327785] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-27T19:01:38.747604] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-27T19:01:38.747860] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-27T19:01:38.749137] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-27T19:01:38.756887] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-27T19:01:38.758729] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T19:01:38.763412] [INFO ] [REMOTE ] GNE: Full fetch complete (22647 records). [2025-10-27T19:01:38.763608] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-27T19:01:38.769550] [DEBUG] [LOCAL ] GME: Trimmed 77919 records to 53777 (keeping 200 days of data) [2025-10-27T19:01:38.825386] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-27T19:01:39.073854] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T19:01:39.473414] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-27T19:01:39.492297] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-27T19:01:39.499670] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-27T19:01:39.517520] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-27T19:01:39.517431] [DEBUG] [LOCAL ] GME: Primary data saved (53777 records). [2025-10-27T19:01:39.517875] [INFO ] [MAIN ] GME: Full history saved. [2025-10-27T19:01:39.518352] [INFO ] [MAIN ] Update Progress: 946/2366 symbols completed. GME took 40.2s. Estimated remaining: 3h 2m 33s. Rate: 7.8 symbols/min [2025-10-27T19:01:39.530221] [DEBUG] [LOCAL ] GNE: Trimmed 22647 records to 18127 (keeping 200 days of data) [2025-10-27T19:01:39.616692] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-27T19:01:39.780368] [DEBUG] [LOCAL ] GNE: Primary data saved (18127 records). [2025-10-27T19:01:39.786005] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-27T19:01:39.800568] [INFO ] [MAIN ] Update Progress: 947/2366 symbols completed. GNE took 26.5s. Estimated remaining: 3h 2m 14s. Rate: 7.8 symbols/min [2025-10-27T19:01:39.803527] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:01:39.979744] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:01:40.004953] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-27T19:01:40.011192] [INFO ] [REMOTE ] GMRE: Full fetch complete (51441 records). [2025-10-27T19:01:40.011387] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-27T19:01:40.125492] [DEBUG] [LOCAL ] GNL: Loaded 47104 existing records from primary storage. [2025-10-27T19:01:40.134775] [INFO ] [MAIN ] GNL: Loaded 47104 existing records. [2025-10-27T19:01:40.509374] [DEBUG] [LOCAL ] GNRC: Loaded 45998 existing records from primary storage. [2025-10-27T19:01:40.548178] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:01:40.545084] [INFO ] [MAIN ] GNRC: Loaded 45998 existing records. [2025-10-27T19:01:40.558740] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-27T19:01:40.563973] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-27T19:01:40.607109] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-27T19:01:40.663565] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-27T19:01:40.730359] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-27T19:01:40.756820] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-27T19:01:40.776909] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-27T19:01:40.800882] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-27T19:01:40.943777] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:01:40.932772] [DEBUG] [LOCAL ] GMRE: Trimmed 51441 records to 35708 (keeping 200 days of data) [2025-10-27T19:01:40.974262] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-27T19:01:40.985453] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-27T19:01:41.035349] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-27T19:01:41.085595] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-27T19:01:41.532253] [DEBUG] [LOCAL ] GMRE: Primary data saved (35708 records). [2025-10-27T19:01:41.563081] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-27T19:01:41.562995] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:01:41.591547] [INFO ] [MAIN ] Update Progress: 948/2366 symbols completed. GMRE took 35.4s. Estimated remaining: 3h 1m 57s. Rate: 7.8 symbols/min [2025-10-27T19:01:41.607724] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-27T19:01:41.913578] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-27T19:01:41.940084] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:01:41.976283] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-27T19:01:42.032855] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:01:42.036869] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-27T19:01:42.037153] [DEBUG] [LOCAL ] GNT: Loaded 8728 existing records from primary storage. [2025-10-27T19:01:42.037345] [INFO ] [MAIN ] GNT: Loaded 8728 existing records. [2025-10-27T19:01:42.218279] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:01:42.218486] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-27T19:01:42.218533] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-27T19:01:42.218717] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-27T19:01:42.218772] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-27T19:01:42.577735] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:01:42.814999] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-27T19:01:43.160632] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T19:01:43.395495] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T19:01:43.552385] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-27T19:01:43.614988] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-27T19:01:43.645964] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T19:01:44.225543] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-27T19:01:44.415019] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-27T19:01:45.214962] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-27T19:01:45.917928] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T19:01:46.014902] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-27T19:01:46.688944] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T19:01:46.814932] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-27T19:01:47.217339] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-27T19:01:47.614987] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-27T19:01:48.414996] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-27T19:01:48.547622] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-27T19:01:49.074069] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-27T19:01:49.073874] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-27T19:01:49.214962] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-27T19:01:50.014969] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-27T19:01:50.814980] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-27T19:01:51.435061] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-27T19:01:51.616564] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-27T19:01:51.619893] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T19:01:52.143898] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T19:01:52.415016] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-27T19:01:53.071123] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T19:01:53.214978] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-27T19:01:53.807467] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T19:01:54.014969] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-27T19:01:54.058094] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-27T19:01:54.814960] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-27T19:01:54.981770] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-27T19:01:55.598026] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-27T19:01:55.614897] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-27T19:01:56.378439] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-27T19:01:56.414896] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-27T19:01:57.022878] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-27T19:01:57.214985] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-27T19:01:58.015011] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-27T19:01:58.782037] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-27T19:01:58.814913] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-27T19:01:59.243104] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T19:01:59.614986] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-27T19:02:00.123358] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T19:02:00.414941] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-27T19:02:01.214964] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-27T19:02:01.416353] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-27T19:02:02.014995] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-27T19:02:02.405241] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-27T19:02:02.600403] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T19:02:02.814938] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-27T19:02:03.614918] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-27T19:02:03.657719] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-27T19:02:03.664990] [INFO ] [REMOTE ] GNK: Full fetch complete (57129 records). [2025-10-27T19:02:03.665096] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-27T19:02:04.095708] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-27T19:02:04.095798] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-27T19:02:04.096844] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-27T19:02:04.096912] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-27T19:02:04.098160] [DEBUG] [LOCAL ] GNK: Trimmed 57129 records to 39008 (keeping 200 days of data) [2025-10-27T19:02:04.347278] [DEBUG] [LOCAL ] GNK: Primary data saved (39008 records). [2025-10-27T19:02:04.347456] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-27T19:02:04.347563] [INFO ] [MAIN ] Update Progress: 949/2366 symbols completed. GNK took 33.1s. Estimated remaining: 3h 2m 12s. Rate: 7.8 symbols/min [2025-10-27T19:02:04.419691] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-27T19:02:04.556975] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:02:04.602917] [DEBUG] [LOCAL ] GNW: Loaded 52087 existing records from primary storage. [2025-10-27T19:02:04.626951] [INFO ] [MAIN ] GNW: Loaded 52087 existing records. [2025-10-27T19:02:04.728449] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-27T19:02:04.816059] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:02:04.816238] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-27T19:02:04.816284] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-27T19:02:04.816465] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-27T19:02:04.816503] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-27T19:02:05.177981] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:02:05.187162] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T19:02:05.217491] [INFO ] [REMOTE ] GNT: Full fetch complete (11503 records). [2025-10-27T19:02:05.217276] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-27T19:02:05.217860] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-27T19:02:05.232991] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T19:02:05.586563] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-27T19:02:05.586659] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-27T19:02:05.587004] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-27T19:02:05.587065] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-27T19:02:05.587521] [DEBUG] [LOCAL ] GNT: Trimmed 11503 records to 8608 (keeping 200 days of data) [2025-10-27T19:02:05.636472] [DEBUG] [LOCAL ] GNT: Primary data saved (8608 records). [2025-10-27T19:02:05.636606] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-27T19:02:05.636708] [INFO ] [MAIN ] Update Progress: 950/2366 symbols completed. GNT took 24.0s. Estimated remaining: 3h 1m 55s. Rate: 7.8 symbols/min [2025-10-27T19:02:05.799847] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:02:05.840406] [DEBUG] [LOCAL ] GOF: Loaded 43412 existing records from primary storage. [2025-10-27T19:02:05.840715] [INFO ] [MAIN ] GOF: Loaded 43412 existing records. [2025-10-27T19:02:06.011943] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:02:06.012209] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-27T19:02:06.012266] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-27T19:02:06.012445] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-27T19:02:06.012481] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-27T19:02:06.023584] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-27T19:02:06.372223] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:02:06.714591] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T19:02:06.814923] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-27T19:02:07.614932] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-27T19:02:07.856561] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-27T19:02:08.415014] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-27T19:02:08.446055] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T19:02:09.215044] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-27T19:02:09.351827] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-27T19:02:10.014994] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-27T19:02:10.321579] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-27T19:02:10.330269] [INFO ] [REMOTE ] GNRC: Full fetch complete (65709 records). [2025-10-27T19:02:10.330385] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-27T19:02:10.725184] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-27T19:02:10.725316] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-27T19:02:10.726256] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-27T19:02:10.726320] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-27T19:02:10.727671] [DEBUG] [LOCAL ] GNRC: Trimmed 65709 records to 45165 (keeping 200 days of data) [2025-10-27T19:02:10.815928] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-27T19:02:11.003725] [DEBUG] [LOCAL ] GNRC: Primary data saved (45165 records). [2025-10-27T19:02:11.003851] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-27T19:02:11.004434] [INFO ] [MAIN ] Update Progress: 951/2366 symbols completed. GNRC took 31.2s. Estimated remaining: 3h 1m 43s. Rate: 7.8 symbols/min [2025-10-27T19:02:11.176393] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:02:11.211520] [DEBUG] [LOCAL ] GOLF: Loaded 30614 existing records from primary storage. [2025-10-27T19:02:11.211994] [INFO ] [MAIN ] GOLF: Loaded 30614 existing records. [2025-10-27T19:02:11.388523] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-27T19:02:11.417903] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:02:11.426205] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-27T19:02:11.426383] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-27T19:02:11.427141] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-27T19:02:11.427242] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-27T19:02:11.588752] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T19:02:11.628927] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-27T19:02:11.860088] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:02:12.414956] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-27T19:02:12.461396] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-27T19:02:13.019635] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-27T19:02:13.214985] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-27T19:02:14.015007] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-27T19:02:14.286243] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-27T19:02:14.689419] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T19:02:14.698495] [INFO ] [REMOTE ] GNL: Full fetch complete (68016 records). [2025-10-27T19:02:14.698689] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-27T19:02:14.820079] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-27T19:02:15.096191] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-27T19:02:15.096290] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-27T19:02:15.097173] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-27T19:02:15.097234] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-27T19:02:15.098486] [DEBUG] [LOCAL ] GNL: Trimmed 68016 records to 46279 (keeping 200 days of data) [2025-10-27T19:02:15.357559] [DEBUG] [LOCAL ] GNL: Primary data saved (46279 records). [2025-10-27T19:02:15.357713] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-27T19:02:15.357801] [INFO ] [MAIN ] Update Progress: 952/2366 symbols completed. GNL took 35.8s. Estimated remaining: 3h 1m 31s. Rate: 7.8 symbols/min [2025-10-27T19:02:15.525021] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:02:15.565975] [DEBUG] [LOCAL ] GOOS: Loaded 44601 existing records from primary storage. [2025-10-27T19:02:15.566250] [INFO ] [MAIN ] GOOS: Loaded 44601 existing records. [2025-10-27T19:02:15.629947] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-27T19:02:15.751241] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:02:15.751829] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-27T19:02:15.752025] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-27T19:02:15.752389] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-27T19:02:15.752460] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-27T19:02:15.881993] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-27T19:02:16.112853] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-27T19:02:16.168065] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:02:16.414927] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-27T19:02:17.114978] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T19:02:17.214939] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-27T19:02:17.603813] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T19:02:18.014965] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-27T19:02:18.814945] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-27T19:02:18.938902] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T19:02:19.341329] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-27T19:02:19.614993] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-27T19:02:19.967436] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T19:02:20.415007] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-27T19:02:21.214923] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-27T19:02:21.359014] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-27T19:02:21.420871] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T19:02:22.014932] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-27T19:02:22.772599] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T19:02:22.814929] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-27T19:02:23.388849] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T19:02:23.614960] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-27T19:02:24.386375] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T19:02:24.414895] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-27T19:02:25.214933] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-27T19:02:25.332155] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-27T19:02:25.992095] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T19:02:26.014903] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-27T19:02:26.308351] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-27T19:02:26.814941] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-27T19:02:27.573166] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T19:02:27.614958] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-27T19:02:28.414934] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-27T19:02:28.448842] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T19:02:29.153564] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T19:02:29.220049] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-27T19:02:29.231307] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T19:02:30.014974] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-27T19:02:30.814925] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-27T19:02:31.021970] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-27T19:02:31.614993] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-27T19:02:31.742934] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-27T19:02:32.232796] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T19:02:32.414930] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-27T19:02:33.215019] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-27T19:02:33.308544] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-27T19:02:33.318266] [INFO ] [REMOTE ] GNW: Full fetch complete (73915 records). [2025-10-27T19:02:33.318404] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-27T19:02:33.699962] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-27T19:02:33.700059] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-27T19:02:33.700996] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-27T19:02:33.701058] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-27T19:02:33.702433] [DEBUG] [LOCAL ] GNW: Trimmed 73915 records to 51289 (keeping 200 days of data) [2025-10-27T19:02:33.948991] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T19:02:34.014915] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-27T19:02:34.031794] [DEBUG] [LOCAL ] GNW: Primary data saved (51289 records). [2025-10-27T19:02:34.031884] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-27T19:02:34.031957] [INFO ] [MAIN ] Update Progress: 953/2366 symbols completed. GNW took 29.7s. Estimated remaining: 3h 1m 39s. Rate: 7.8 symbols/min [2025-10-27T19:02:34.203214] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:02:34.235626] [DEBUG] [LOCAL ] GOTU: Loaded 37178 existing records from primary storage. [2025-10-27T19:02:34.235912] [INFO ] [MAIN ] GOTU: Loaded 37178 existing records. [2025-10-27T19:02:34.411767] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:02:34.411952] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-27T19:02:34.412002] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-27T19:02:34.412170] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-27T19:02:34.412207] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-27T19:02:34.763473] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:02:34.814905] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-27T19:02:34.865211] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T19:02:35.614989] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-27T19:02:35.690102] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-27T19:02:36.424578] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-27T19:02:36.427958] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T19:02:37.214927] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-27T19:02:37.337913] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T19:02:37.705294] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-27T19:02:38.014925] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-27T19:02:38.631863] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-27T19:02:38.814917] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-27T19:02:39.397807] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T19:02:39.614968] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-27T19:02:40.077119] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-27T19:02:40.415039] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-27T19:02:40.954870] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T19:02:41.214975] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-27T19:02:41.690581] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T19:02:42.015015] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-27T19:02:42.814947] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-27T19:02:43.178539] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-27T19:02:43.185778] [INFO ] [REMOTE ] GOOS: Full fetch complete (64567 records). [2025-10-27T19:02:43.185894] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-27T19:02:43.538929] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-27T19:02:43.595697] [INFO ] [REMOTE ] GOF: Full fetch complete (62783 records). [2025-10-27T19:02:43.614942] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-27T19:02:43.615032] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-27T19:02:43.615127] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-27T19:02:43.615217] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-27T19:02:43.617225] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-27T19:02:43.650720] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-27T19:02:43.724966] [DEBUG] [LOCAL ] GOOS: Trimmed 64567 records to 43756 (keeping 200 days of data) [2025-10-27T19:02:44.141869] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T19:02:44.307959] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-27T19:02:44.318012] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-27T19:02:44.320727] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-27T19:02:44.319111] [DEBUG] [LOCAL ] GOOS: Primary data saved (43756 records). [2025-10-27T19:02:44.320814] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-27T19:02:44.321119] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-27T19:02:44.321220] [INFO ] [MAIN ] Update Progress: 954/2366 symbols completed. GOOS took 29.0s. Estimated remaining: 3h 1m 35s. Rate: 7.8 symbols/min [2025-10-27T19:02:44.420198] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-27T19:02:44.423554] [DEBUG] [LOCAL ] GOF: Trimmed 62783 records to 42668 (keeping 200 days of data) [2025-10-27T19:02:44.562837] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:02:44.781410] [DEBUG] [LOCAL ] GPC: Loaded 46604 existing records from primary storage. [2025-10-27T19:02:44.786491] [INFO ] [MAIN ] GPC: Loaded 46604 existing records. [2025-10-27T19:02:45.004803] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:02:45.007730] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-27T19:02:45.009542] [DEBUG] [LOCAL ] GOF: Primary data saved (42668 records). [2025-10-27T19:02:45.009778] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-27T19:02:45.009833] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-27T19:02:45.010022] [INFO ] [MAIN ] Update Progress: 955/2366 symbols completed. GOF took 39.4s. Estimated remaining: 3h 1m 17s. Rate: 7.8 symbols/min [2025-10-27T19:02:45.015560] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-27T19:02:45.032950] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-27T19:02:45.272391] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-27T19:02:45.377836] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:02:45.387917] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-27T19:02:45.553493] [DEBUG] [LOCAL ] GPI: Loaded 14990 existing records from primary storage. [2025-10-27T19:02:45.578005] [INFO ] [MAIN ] GPI: Loaded 14990 existing records. [2025-10-27T19:02:45.680574] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:02:45.790571] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:02:45.802420] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-27T19:02:45.802987] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-27T19:02:45.803407] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-27T19:02:45.808089] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-27T19:02:45.808552] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-27T19:02:45.850780] [INFO ] [REMOTE ] GOLF: Full fetch complete (45206 records). [2025-10-27T19:02:45.881891] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-27T19:02:46.026557] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-27T19:02:46.520304] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:02:46.572807] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-27T19:02:46.572870] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-27T19:02:46.573593] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-27T19:02:46.573632] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-27T19:02:46.574526] [DEBUG] [LOCAL ] GOLF: Trimmed 45206 records to 29787 (keeping 200 days of data) [2025-10-27T19:02:46.755245] [DEBUG] [LOCAL ] GOLF: Primary data saved (29787 records). [2025-10-27T19:02:46.755500] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-27T19:02:46.756210] [INFO ] [MAIN ] Update Progress: 956/2366 symbols completed. GOLF took 35.8s. Estimated remaining: 3h 1m 1s. Rate: 7.8 symbols/min [2025-10-27T19:02:46.823994] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-27T19:02:46.927755] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:02:46.935845] [DEBUG] [LOCAL ] GPJA: Loaded 4140 existing records from primary storage. [2025-10-27T19:02:46.936047] [INFO ] [MAIN ] GPJA: Loaded 4140 existing records. [2025-10-27T19:02:47.104402] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T19:02:47.146400] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:02:47.146892] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-27T19:02:47.147241] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-27T19:02:47.147388] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-27T19:02:47.147443] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-27T19:02:47.496564] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:02:47.511383] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T19:02:47.614908] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-27T19:02:47.719492] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-27T19:02:48.303771] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T19:02:48.414977] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-27T19:02:49.068427] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T19:02:49.214969] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-27T19:02:50.014976] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-27T19:02:50.500305] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T19:02:50.644282] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T19:02:50.814975] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-27T19:02:51.614961] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-27T19:02:51.981594] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T19:02:52.414954] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-27T19:02:53.033542] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-27T19:02:53.214962] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-27T19:02:53.479008] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-27T19:02:54.014986] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-27T19:02:54.627928] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T19:02:54.814988] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-27T19:02:55.053245] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-27T19:02:55.614972] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-27T19:02:55.925433] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-27T19:02:56.414976] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-27T19:02:56.767695] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T19:02:56.774094] [INFO ] [REMOTE ] GOTU: Full fetch complete (57991 records). [2025-10-27T19:02:56.774194] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-27T19:02:57.043179] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-27T19:02:57.159687] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-27T19:02:57.159765] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-27T19:02:57.160519] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-27T19:02:57.160557] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-27T19:02:57.161616] [DEBUG] [LOCAL ] GOTU: Trimmed 57991 records to 36496 (keeping 200 days of data) [2025-10-27T19:02:57.239107] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-27T19:02:57.364701] [DEBUG] [LOCAL ] GOTU: Primary data saved (36496 records). [2025-10-27T19:02:57.365093] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-27T19:02:57.365192] [INFO ] [MAIN ] Update Progress: 957/2366 symbols completed. GOTU took 23.3s. Estimated remaining: 3h 0m 57s. Rate: 7.8 symbols/min [2025-10-27T19:02:58.015075] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-27T19:02:58.814916] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-27T19:02:58.968025] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T19:02:59.004910] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-27T19:02:59.438340] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-27T19:02:59.614964] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-27T19:03:00.219064] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T19:03:00.414975] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-27T19:03:01.214930] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-27T19:03:02.014981] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-27T19:03:02.034236] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T19:03:02.381122] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-27T19:03:02.647372] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-27T19:03:02.814951] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-27T19:03:03.416568] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T19:03:03.614960] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-27T19:03:04.192983] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-27T19:03:04.414981] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-27T19:03:04.981707] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-27T19:03:05.214941] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-27T19:03:06.014970] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-27T19:03:06.814230] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-27T19:03:06.823125] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-27T19:03:06.872046] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-27T19:03:07.411277] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T19:03:07.614931] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-27T19:03:08.414993] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-27T19:03:08.594062] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-27T19:03:09.214965] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-27T19:03:09.713537] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T19:03:09.879843] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-27T19:03:09.880931] [INFO ] [REMOTE ] GPJA: Full fetch complete (6791 records). [2025-10-27T19:03:09.880996] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-27T19:03:10.020105] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-27T19:03:10.255005] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-27T19:03:10.255117] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-27T19:03:10.255292] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-27T19:03:10.255330] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-27T19:03:10.255721] [DEBUG] [LOCAL ] GPJA: Trimmed 6791 records to 4035 (keeping 200 days of data) [2025-10-27T19:03:10.280339] [DEBUG] [LOCAL ] GPJA: Primary data saved (4035 records). [2025-10-27T19:03:10.280435] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-27T19:03:10.280506] [INFO ] [MAIN ] Update Progress: 958/2366 symbols completed. GPJA took 23.5s. Estimated remaining: 3h 0m 57s. Rate: 7.8 symbols/min [2025-10-27T19:03:10.814989] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-27T19:03:11.618671] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T19:03:11.628046] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-27T19:03:12.045451] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-27T19:03:12.052432] [INFO ] [REMOTE ] GPI: Full fetch complete (21962 records). [2025-10-27T19:03:12.052517] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-27T19:03:12.411456] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-27T19:03:12.411529] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-27T19:03:12.411965] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-27T19:03:12.412026] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-27T19:03:12.412599] [DEBUG] [LOCAL ] GPI: Trimmed 21962 records to 14518 (keeping 200 days of data) [2025-10-27T19:03:12.501773] [DEBUG] [LOCAL ] GPI: Primary data saved (14518 records). [2025-10-27T19:03:12.501909] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-27T19:03:12.501985] [INFO ] [MAIN ] Update Progress: 959/2366 symbols completed. GPI took 27.5s. Estimated remaining: 3h 0m 42s. Rate: 7.8 symbols/min [2025-10-27T19:03:13.616496] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-27T19:03:13.626360] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-27T19:03:15.255499] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-27T19:03:15.264487] [INFO ] [REMOTE ] GPC: Full fetch complete (68688 records). [2025-10-27T19:03:15.264736] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-27T19:03:15.646993] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-27T19:03:15.647064] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-27T19:03:15.647920] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-27T19:03:15.647981] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-27T19:03:15.649390] [DEBUG] [LOCAL ] GPC: Trimmed 68688 records to 45800 (keeping 200 days of data) [2025-10-27T19:03:15.924465] [DEBUG] [LOCAL ] GPC: Primary data saved (45800 records). [2025-10-27T19:03:15.924597] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-27T19:03:15.924700] [INFO ] [MAIN ] Update Progress: 960/2366 symbols completed. GPC took 31.6s. Estimated remaining: 3h 0m 28s. Rate: 7.8 symbols/min [2025-10-27T19:03:16.577808] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:03:16.598251] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:03:16.606025] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:03:16.628091] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:03:16.659795] [DEBUG] [LOCAL ] GPMT: Loaded 26165 existing records from primary storage. [2025-10-27T19:03:16.667881] [INFO ] [MAIN ] GPMT: Loaded 26165 existing records. [2025-10-27T19:03:16.684212] [DEBUG] [LOCAL ] GPOR: Loaded 23736 existing records from primary storage. [2025-10-27T19:03:16.758811] [INFO ] [MAIN ] GPOR: Loaded 23736 existing records. [2025-10-27T19:03:16.962488] [DEBUG] [LOCAL ] GPK: Loaded 53551 existing records from primary storage. [2025-10-27T19:03:16.928038] [DEBUG] [LOCAL ] GPN: Loaded 52523 existing records from primary storage. [2025-10-27T19:03:16.987858] [INFO ] [MAIN ] GPK: Loaded 53551 existing records. [2025-10-27T19:03:16.978194] [INFO ] [MAIN ] GPN: Loaded 52523 existing records. [2025-10-27T19:03:17.030250] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:03:17.212965] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-27T19:03:17.252582] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-27T19:03:17.285081] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:03:17.291370] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-27T19:03:17.291430] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-27T19:03:17.356211] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-27T19:03:17.345347] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-27T19:03:17.447239] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:03:17.438931] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-27T19:03:17.509428] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-27T19:03:17.559383] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:03:17.624128] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-27T19:03:17.641591] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-27T19:03:17.646915] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-27T19:03:17.679935] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-27T19:03:17.704677] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-27T19:03:17.709923] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-27T19:03:17.704603] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-27T19:03:17.752217] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-27T19:03:18.543274] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:03:18.567790] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-27T19:03:18.646062] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:03:18.680940] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-27T19:03:18.949528] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:03:18.954105] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-27T19:03:18.953597] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:03:18.954451] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-27T19:03:19.543768] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T19:03:19.549755] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-27T19:03:19.916610] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T19:03:19.921623] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-27T19:03:20.181095] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T19:03:20.196432] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-27T19:03:20.471386] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T19:03:20.483204] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-27T19:03:20.701570] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T19:03:20.706398] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-27T19:03:20.785385] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T19:03:20.790522] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-27T19:03:21.327763] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T19:03:21.337423] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-27T19:03:21.561170] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-27T19:03:21.752376] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-27T19:03:21.782857] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T19:03:22.014987] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-27T19:03:22.814939] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-27T19:03:23.020145] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T19:03:23.345414] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T19:03:23.614935] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-27T19:03:24.341268] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T19:03:24.414918] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-27T19:03:24.489908] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-27T19:03:25.214962] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-27T19:03:25.310218] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-27T19:03:26.014935] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-27T19:03:26.201127] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-27T19:03:26.814946] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-27T19:03:27.031860] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-27T19:03:27.614939] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-27T19:03:27.913583] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T19:03:28.414941] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-27T19:03:28.965519] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T19:03:29.214918] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-27T19:03:29.406458] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T19:03:30.014976] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-27T19:03:30.753638] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-27T19:03:30.814902] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-27T19:03:30.903936] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T19:03:31.614906] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-27T19:03:31.979118] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-27T19:03:31.983120] [INFO ] [REMOTE ] GPMT: Full fetch complete (36110 records). [2025-10-27T19:03:31.983206] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-27T19:03:32.354344] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-27T19:03:32.354415] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-27T19:03:32.355015] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-27T19:03:32.355075] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-27T19:03:32.355873] [DEBUG] [LOCAL ] GPMT: Trimmed 36110 records to 25517 (keeping 200 days of data) [2025-10-27T19:03:32.435796] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-27T19:03:32.503515] [DEBUG] [LOCAL ] GPMT: Primary data saved (25517 records). [2025-10-27T19:03:32.503681] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-27T19:03:32.503782] [INFO ] [MAIN ] Update Progress: 961/2366 symbols completed. GPMT took 16.6s. Estimated remaining: 3h 0m 33s. Rate: 7.8 symbols/min [2025-10-27T19:03:32.668203] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:03:32.703929] [DEBUG] [LOCAL ] GPRK: Loaded 40591 existing records from primary storage. [2025-10-27T19:03:32.704198] [INFO ] [MAIN ] GPRK: Loaded 40591 existing records. [2025-10-27T19:03:32.887241] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:03:32.887517] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-27T19:03:32.887674] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-27T19:03:32.887971] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-27T19:03:32.888058] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-27T19:03:33.218037] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-27T19:03:33.336088] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:03:33.356026] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T19:03:34.014986] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-27T19:03:34.044157] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-27T19:03:34.155489] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-27T19:03:34.814974] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-27T19:03:35.413137] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T19:03:35.614939] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-27T19:03:36.214467] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T19:03:36.414916] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-27T19:03:37.034796] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-27T19:03:37.214932] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-27T19:03:37.709103] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-27T19:03:38.014948] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-27T19:03:38.464361] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T19:03:38.814985] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-27T19:03:39.614920] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-27T19:03:39.806262] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-27T19:03:40.421465] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-27T19:03:40.440712] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T19:03:41.214916] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-27T19:03:41.560458] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-27T19:03:42.001914] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-27T19:03:42.014920] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-27T19:03:42.625184] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-27T19:03:42.814983] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-27T19:03:43.614927] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-27T19:03:43.892413] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T19:03:44.013594] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-27T19:03:44.414950] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-27T19:03:45.188523] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-27T19:03:45.214901] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-27T19:03:46.014911] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-27T19:03:46.376504] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-27T19:03:46.386560] [INFO ] [REMOTE ] GPK: Full fetch complete (76099 records). [2025-10-27T19:03:46.386703] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-27T19:03:46.780024] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-27T19:03:46.780217] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-27T19:03:46.781228] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-27T19:03:46.781302] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-27T19:03:46.783091] [DEBUG] [LOCAL ] GPK: Trimmed 76099 records to 52765 (keeping 200 days of data) [2025-10-27T19:03:46.834946] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-27T19:03:46.938242] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T19:03:47.170102] [DEBUG] [LOCAL ] GPK: Primary data saved (52765 records). [2025-10-27T19:03:47.170862] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-27T19:03:47.171533] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T19:03:47.171780] [INFO ] [MAIN ] Update Progress: 962/2366 symbols completed. GPK took 31.2s. Estimated remaining: 3h 0m 35s. Rate: 7.8 symbols/min [2025-10-27T19:03:47.344988] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:03:47.370681] [DEBUG] [LOCAL ] GRBK: Loaded 26936 existing records from primary storage. [2025-10-27T19:03:47.370940] [INFO ] [MAIN ] GRBK: Loaded 26936 existing records. [2025-10-27T19:03:47.564697] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:03:47.564904] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-27T19:03:47.564949] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-27T19:03:47.565121] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-27T19:03:47.565158] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-27T19:03:47.626138] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-27T19:03:47.915523] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:03:48.164780] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T19:03:48.414951] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-27T19:03:49.202707] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-27T19:03:49.214910] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-27T19:03:49.394015] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T19:03:49.399316] [INFO ] [REMOTE ] GPOR: Full fetch complete (34910 records). [2025-10-27T19:03:49.399405] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-27T19:03:49.758284] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-27T19:03:49.758359] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-27T19:03:49.758973] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-27T19:03:49.759032] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-27T19:03:49.759787] [DEBUG] [LOCAL ] GPOR: Trimmed 34910 records to 23320 (keeping 200 days of data) [2025-10-27T19:03:49.893125] [DEBUG] [LOCAL ] GPOR: Primary data saved (23320 records). [2025-10-27T19:03:49.893246] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-27T19:03:49.893320] [INFO ] [MAIN ] Update Progress: 963/2366 symbols completed. GPOR took 34.0s. Estimated remaining: 3h 0m 20s. Rate: 7.8 symbols/min [2025-10-27T19:03:50.029400] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-27T19:03:50.060764] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:03:50.072106] [DEBUG] [LOCAL ] GRC: Loaded 9494 existing records from primary storage. [2025-10-27T19:03:50.072396] [INFO ] [MAIN ] GRC: Loaded 9494 existing records. [2025-10-27T19:03:50.243808] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:03:50.243996] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-27T19:03:50.244042] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-27T19:03:50.244207] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-27T19:03:50.244262] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-27T19:03:50.602214] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:03:50.623362] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T19:03:50.815003] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-27T19:03:51.548050] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T19:03:51.614951] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-27T19:03:52.279336] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-27T19:03:52.414963] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-27T19:03:53.214999] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-27T19:03:53.531233] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-27T19:03:53.540739] [INFO ] [REMOTE ] GPN: Full fetch complete (74991 records). [2025-10-27T19:03:53.540851] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-27T19:03:53.957928] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-27T19:03:53.976275] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-27T19:03:53.976403] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-27T19:03:53.986783] [INFO ] [REMOTE ] GPRK: Full fetch complete (58560 records). [2025-10-27T19:03:53.986499] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-27T19:03:53.987053] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-27T19:03:53.986983] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-27T19:03:54.020448] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-27T19:03:54.095968] [DEBUG] [LOCAL ] GPN: Trimmed 74991 records to 51720 (keeping 200 days of data) [2025-10-27T19:03:54.508317] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-27T19:03:54.509688] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-27T19:03:54.515699] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-27T19:03:54.516098] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-27T19:03:54.528172] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T19:03:54.539329] [DEBUG] [LOCAL ] GPRK: Trimmed 58560 records to 39943 (keeping 200 days of data) [2025-10-27T19:03:54.745678] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T19:03:54.835566] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-27T19:03:54.968832] [DEBUG] [LOCAL ] GPN: Primary data saved (51720 records). [2025-10-27T19:03:54.968959] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-27T19:03:54.969068] [INFO ] [MAIN ] Update Progress: 964/2366 symbols completed. GPN took 39.0s. Estimated remaining: 3h 0m 9s. Rate: 7.8 symbols/min [2025-10-27T19:03:54.968738] [DEBUG] [LOCAL ] GPRK: Primary data saved (39943 records). [2025-10-27T19:03:54.980420] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-27T19:03:55.012257] [INFO ] [MAIN ] Update Progress: 965/2366 symbols completed. GPRK took 22.5s. Estimated remaining: 2h 59m 50s. Rate: 7.8 symbols/min [2025-10-27T19:03:55.275589] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:03:55.319134] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:03:55.339308] [DEBUG] [LOCAL ] GRDN: Loaded 21735 existing records from primary storage. [2025-10-27T19:03:55.339545] [INFO ] [MAIN ] GRDN: Loaded 21735 existing records. [2025-10-27T19:03:55.542669] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:03:55.543202] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-27T19:03:55.544389] [DEBUG] [LOCAL ] GRMN: Loaded 40287 existing records from primary storage. [2025-10-27T19:03:55.543352] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-27T19:03:55.544934] [INFO ] [MAIN ] GRMN: Loaded 40287 existing records. [2025-10-27T19:03:55.544828] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-27T19:03:55.545065] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-27T19:03:55.625585] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-27T19:03:55.665416] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-27T19:03:55.910424] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:03:55.977140] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-27T19:03:55.982697] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-27T19:03:56.004170] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-27T19:03:56.014413] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-27T19:03:56.228821] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:03:56.420884] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-27T19:03:56.461035] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:03:56.925783] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T19:03:57.214932] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-27T19:03:57.225827] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-27T19:03:58.014992] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-27T19:03:58.789853] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-27T19:03:58.814919] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-27T19:03:58.869795] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T19:03:59.621906] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-27T19:03:59.625680] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-27T19:04:00.415105] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-27T19:04:00.739299] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T19:04:01.214959] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-27T19:04:02.015071] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-27T19:04:02.763959] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-27T19:04:02.814932] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-27T19:04:02.920796] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-27T19:04:02.952469] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-10-27T19:04:03.455893] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-27T19:04:03.614989] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-27T19:04:04.414980] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-27T19:04:04.692320] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-27T19:04:05.214962] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-27T19:04:05.469400] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-27T19:04:05.851352] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-27T19:04:06.014946] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-27T19:04:06.815009] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-27T19:04:07.583113] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T19:04:07.614904] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-27T19:04:08.235911] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T19:04:08.414955] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-27T19:04:09.062226] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-27T19:04:09.214912] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-27T19:04:09.383458] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T19:04:10.014985] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-27T19:04:10.630155] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T19:04:10.814924] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-27T19:04:10.982036] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T19:04:11.614932] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-27T19:04:11.827184] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-27T19:04:12.292676] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T19:04:12.414986] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-27T19:04:12.892266] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-27T19:04:13.214958] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-27T19:04:14.014953] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-27T19:04:14.814927] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-27T19:04:14.871359] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-27T19:04:14.934031] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-27T19:04:15.614953] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-27T19:04:16.066077] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T19:04:16.117956] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-27T19:04:16.414951] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-27T19:04:17.214909] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-27T19:04:17.378784] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T19:04:17.381621] [INFO ] [REMOTE ] GRC: Full fetch complete (13585 records). [2025-10-27T19:04:17.381728] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-27T19:04:17.737204] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-27T19:04:17.737311] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-27T19:04:17.737634] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-27T19:04:17.737723] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-27T19:04:17.738202] [DEBUG] [LOCAL ] GRC: Trimmed 13585 records to 9285 (keeping 200 days of data) [2025-10-27T19:04:17.793245] [DEBUG] [LOCAL ] GRC: Primary data saved (9285 records). [2025-10-27T19:04:17.793369] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-27T19:04:17.793461] [INFO ] [MAIN ] Update Progress: 966/2366 symbols completed. GRC took 27.9s. Estimated remaining: 3h 0m 4s. Rate: 7.8 symbols/min [2025-10-27T19:04:17.960988] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:04:18.009689] [DEBUG] [LOCAL ] GRND: Loaded 50935 existing records from primary storage. [2025-10-27T19:04:18.010017] [INFO ] [MAIN ] GRND: Loaded 50935 existing records. [2025-10-27T19:04:18.020999] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-27T19:04:18.190785] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:04:18.190992] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-27T19:04:18.191037] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-27T19:04:18.191232] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-27T19:04:18.191289] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-27T19:04:18.541318] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:04:18.687739] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T19:04:18.814941] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-27T19:04:18.945327] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T19:04:19.614964] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-27T19:04:20.295342] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T19:04:20.328764] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-27T19:04:20.414941] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-27T19:04:21.215033] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-27T19:04:21.647048] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-27T19:04:21.653912] [INFO ] [REMOTE ] GRMN: Full fetch complete (59342 records). [2025-10-27T19:04:21.654032] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-27T19:04:22.022357] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-27T19:04:22.058233] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-27T19:04:22.058305] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-27T19:04:22.059107] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-27T19:04:22.059168] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-27T19:04:22.060261] [DEBUG] [LOCAL ] GRMN: Trimmed 59342 records to 39400 (keeping 200 days of data) [2025-10-27T19:04:22.300957] [DEBUG] [LOCAL ] GRMN: Primary data saved (39400 records). [2025-10-27T19:04:22.301088] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-27T19:04:22.301166] [INFO ] [MAIN ] Update Progress: 967/2366 symbols completed. GRMN took 27.3s. Estimated remaining: 2h 59m 52s. Rate: 7.8 symbols/min [2025-10-27T19:04:22.466041] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:04:22.497403] [DEBUG] [LOCAL ] GRNT: Loaded 34437 existing records from primary storage. [2025-10-27T19:04:22.497686] [INFO ] [MAIN ] GRNT: Loaded 34437 existing records. [2025-10-27T19:04:22.673731] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:04:22.673880] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-27T19:04:22.673965] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-27T19:04:22.674137] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-27T19:04:22.674182] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-27T19:04:22.804057] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-27T19:04:22.818347] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-27T19:04:23.066566] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:04:23.307148] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-27T19:04:23.614975] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-27T19:04:23.887554] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-27T19:04:24.414950] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-27T19:04:24.747201] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T19:04:25.214954] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-27T19:04:25.271285] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T19:04:25.276500] [INFO ] [REMOTE ] GRBK: Full fetch complete (39850 records). [2025-10-27T19:04:25.276606] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-27T19:04:25.641717] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-27T19:04:25.641859] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-27T19:04:25.642683] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-27T19:04:25.642765] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-27T19:04:25.643732] [DEBUG] [LOCAL ] GRBK: Trimmed 39850 records to 26261 (keeping 200 days of data) [2025-10-27T19:04:25.806875] [DEBUG] [LOCAL ] GRBK: Primary data saved (26261 records). [2025-10-27T19:04:25.807003] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-27T19:04:25.807082] [INFO ] [MAIN ] Update Progress: 968/2366 symbols completed. GRBK took 38.6s. Estimated remaining: 2h 59m 38s. Rate: 7.8 symbols/min [2025-10-27T19:04:25.974093] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:04:25.984066] [DEBUG] [LOCAL ] GROV: Loaded 8708 existing records from primary storage. [2025-10-27T19:04:25.984266] [INFO ] [MAIN ] GROV: Loaded 8708 existing records. [2025-10-27T19:04:26.020059] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-27T19:04:26.157954] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:04:26.158131] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-27T19:04:26.158176] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-27T19:04:26.158305] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-27T19:04:26.158340] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-27T19:04:26.509502] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:04:26.535917] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T19:04:26.814939] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-27T19:04:27.238492] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T19:04:27.350364] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-27T19:04:27.614938] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-27T19:04:28.414964] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-27T19:04:29.014707] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T19:04:29.214995] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-27T19:04:30.014997] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-27T19:04:30.254169] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T19:04:30.714807] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T19:04:30.814942] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-27T19:04:30.945985] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-27T19:04:31.615012] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-27T19:04:32.154514] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T19:04:32.379387] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T19:04:32.414900] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-27T19:04:33.215002] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-27T19:04:33.976215] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T19:04:34.014904] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-27T19:04:34.814915] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-27T19:04:34.929179] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T19:04:35.323698] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T19:04:35.614930] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-27T19:04:36.153456] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-27T19:04:36.158610] [INFO ] [REMOTE ] GRDN: Full fetch complete (26896 records). [2025-10-27T19:04:36.158713] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-27T19:04:36.419524] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-27T19:04:36.448209] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-27T19:04:36.532928] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-27T19:04:36.533002] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-27T19:04:36.533545] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-27T19:04:36.533583] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-27T19:04:36.534292] [DEBUG] [LOCAL ] GRDN: Trimmed 26896 records to 21538 (keeping 200 days of data) [2025-10-27T19:04:36.655725] [DEBUG] [LOCAL ] GRDN: Primary data saved (21538 records). [2025-10-27T19:04:36.655844] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-27T19:04:36.655920] [INFO ] [MAIN ] Update Progress: 969/2366 symbols completed. GRDN took 41.7s. Estimated remaining: 2h 59m 35s. Rate: 7.8 symbols/min [2025-10-27T19:04:36.823454] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:04:36.830207] [DEBUG] [LOCAL ] GRX: Loaded 4905 existing records from primary storage. [2025-10-27T19:04:36.830388] [INFO ] [MAIN ] GRX: Loaded 4905 existing records. [2025-10-27T19:04:37.021258] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:04:37.021514] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-27T19:04:37.021572] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-27T19:04:37.021745] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-27T19:04:37.021800] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-27T19:04:37.227150] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-27T19:04:37.401874] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:04:37.723363] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T19:04:38.014940] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-27T19:04:38.759051] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-27T19:04:38.814953] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-27T19:04:39.019477] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-27T19:04:39.614938] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-27T19:04:40.272842] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-27T19:04:40.285291] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-27T19:04:40.414961] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-27T19:04:41.215011] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-27T19:04:41.440684] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T19:04:41.447077] [INFO ] [REMOTE ] GRNT: Full fetch complete (48341 records). [2025-10-27T19:04:41.447166] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-27T19:04:41.837663] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-27T19:04:41.837762] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-27T19:04:41.838485] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-27T19:04:41.838546] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-27T19:04:41.839591] [DEBUG] [LOCAL ] GRNT: Trimmed 48341 records to 33640 (keeping 200 days of data) [2025-10-27T19:04:42.020260] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-27T19:04:42.030290] [DEBUG] [LOCAL ] GRNT: Primary data saved (33640 records). [2025-10-27T19:04:42.030423] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-27T19:04:42.030504] [INFO ] [MAIN ] Update Progress: 970/2366 symbols completed. GRNT took 19.7s. Estimated remaining: 2h 59m 24s. Rate: 7.8 symbols/min [2025-10-27T19:04:42.150286] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-27T19:04:42.211843] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:04:42.258366] [DEBUG] [LOCAL ] GS: Loaded 52539 existing records from primary storage. [2025-10-27T19:04:42.258705] [INFO ] [MAIN ] GS: Loaded 52539 existing records. [2025-10-27T19:04:42.441796] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-27T19:04:42.445638] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:04:42.448384] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-27T19:04:42.448449] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-27T19:04:42.448639] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-27T19:04:42.448738] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-27T19:04:42.808564] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:04:42.814912] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-27T19:04:43.614954] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-27T19:04:44.415001] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-27T19:04:44.993800] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-27T19:04:45.012818] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T19:04:45.172705] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T19:04:45.214906] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-27T19:04:46.014988] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-27T19:04:46.814915] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-27T19:04:46.899161] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-27T19:04:47.036889] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-27T19:04:47.614960] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-27T19:04:48.006805] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-27T19:04:48.414923] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-27T19:04:48.776778] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-27T19:04:48.972623] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-27T19:04:49.214975] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-27T19:04:49.832256] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-27T19:04:50.014983] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-27T19:04:50.814978] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-27T19:04:50.824551] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-27T19:04:50.826913] [INFO ] [REMOTE ] GROV: Full fetch complete (13477 records). [2025-10-27T19:04:50.826984] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-27T19:04:51.198708] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-27T19:04:51.198786] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-27T19:04:51.199093] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-27T19:04:51.199152] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-27T19:04:51.199589] [DEBUG] [LOCAL ] GROV: Trimmed 13477 records to 8633 (keeping 200 days of data) [2025-10-27T19:04:51.245943] [DEBUG] [LOCAL ] GROV: Primary data saved (8633 records). [2025-10-27T19:04:51.246051] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-27T19:04:51.246137] [INFO ] [MAIN ] Update Progress: 971/2366 symbols completed. GROV took 25.4s. Estimated remaining: 2h 59m 18s. Rate: 7.8 symbols/min [2025-10-27T19:04:51.420380] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:04:51.456294] [DEBUG] [LOCAL ] GSBD: Loaded 40094 existing records from primary storage. [2025-10-27T19:04:51.456552] [INFO ] [MAIN ] GSBD: Loaded 40094 existing records. [2025-10-27T19:04:51.630670] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:04:51.626093] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-27T19:04:51.631042] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-27T19:04:51.631695] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-27T19:04:51.631884] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-27T19:04:51.631923] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-27T19:04:51.986922] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:04:52.268803] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-27T19:04:52.415025] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-27T19:04:53.063699] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-27T19:04:53.215004] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-27T19:04:53.648712] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T19:04:54.014958] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-27T19:04:54.814971] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-27T19:04:54.910906] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-27T19:04:55.385196] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-27T19:04:55.614966] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-27T19:04:56.291182] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-27T19:04:56.414926] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-27T19:04:57.222239] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-27T19:04:57.237996] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T19:04:57.819128] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-27T19:04:58.014918] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-27T19:04:58.071403] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T19:04:58.645527] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-27T19:04:58.815035] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-27T19:04:59.614993] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-27T19:05:00.414987] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-27T19:05:00.551161] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-27T19:05:00.561258] [INFO ] [REMOTE ] GRND: Full fetch complete (72029 records). [2025-10-27T19:05:00.561428] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-27T19:05:00.958722] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-27T19:05:00.958813] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-27T19:05:00.959804] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-27T19:05:00.959869] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-27T19:05:00.961261] [DEBUG] [LOCAL ] GRND: Trimmed 72029 records to 50170 (keeping 200 days of data) [2025-10-27T19:05:01.223640] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-27T19:05:01.256388] [DEBUG] [LOCAL ] GRND: Primary data saved (50170 records). [2025-10-27T19:05:01.256637] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-27T19:05:01.256801] [INFO ] [MAIN ] Update Progress: 972/2366 symbols completed. GRND took 43.5s. Estimated remaining: 2h 59m 14s. Rate: 7.8 symbols/min [2025-10-27T19:05:01.427415] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:05:01.478178] [DEBUG] [LOCAL ] GSK: Loaded 54290 existing records from primary storage. [2025-10-27T19:05:01.478519] [INFO ] [MAIN ] GSK: Loaded 54290 existing records. [2025-10-27T19:05:01.665936] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:05:01.666961] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-27T19:05:01.667022] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-27T19:05:01.667762] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-27T19:05:01.667821] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-27T19:05:01.885964] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-27T19:05:01.982360] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-27T19:05:02.018712] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-27T19:05:02.120487] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:05:02.762383] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-27T19:05:02.814947] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-27T19:05:03.297045] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-27T19:05:03.615038] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-27T19:05:04.414912] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-27T19:05:04.511308] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T19:05:05.214980] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-27T19:05:05.380436] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-27T19:05:05.454558] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T19:05:06.014941] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-27T19:05:06.484617] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T19:05:06.815006] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-27T19:05:07.250621] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-27T19:05:07.614940] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-27T19:05:08.188377] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-27T19:05:08.190928] [INFO ] [REMOTE ] GRX: Full fetch complete (6558 records). [2025-10-27T19:05:08.192540] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-27T19:05:08.192717] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-27T19:05:08.420169] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-27T19:05:08.571678] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-27T19:05:08.571772] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-27T19:05:08.571958] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-27T19:05:08.571996] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-27T19:05:08.572377] [DEBUG] [LOCAL ] GRX: Trimmed 6558 records to 4811 (keeping 200 days of data) [2025-10-27T19:05:08.599985] [DEBUG] [LOCAL ] GRX: Primary data saved (4811 records). [2025-10-27T19:05:08.600054] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-27T19:05:08.600122] [INFO ] [MAIN ] Update Progress: 973/2366 symbols completed. GRX took 31.9s. Estimated remaining: 2h 59m 5s. Rate: 7.8 symbols/min [2025-10-27T19:05:08.766349] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:05:08.801959] [DEBUG] [LOCAL ] GSL: Loaded 33315 existing records from primary storage. [2025-10-27T19:05:08.802213] [INFO ] [MAIN ] GSL: Loaded 33315 existing records. [2025-10-27T19:05:08.973555] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:05:08.973760] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-27T19:05:08.973807] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-27T19:05:08.973984] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-27T19:05:08.974021] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-27T19:05:09.220094] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-27T19:05:09.322476] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:05:10.014955] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-27T19:05:10.436115] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-27T19:05:10.814991] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-27T19:05:11.038978] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-27T19:05:11.460534] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T19:05:11.614976] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-27T19:05:12.414925] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-27T19:05:12.448096] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T19:05:12.677618] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T19:05:13.215001] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-27T19:05:14.014937] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-27T19:05:14.357593] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-27T19:05:14.415963] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T19:05:14.814958] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-27T19:05:15.614988] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-27T19:05:15.715215] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T19:05:15.904678] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-27T19:05:16.414985] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-27T19:05:16.599300] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-27T19:05:17.214984] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-27T19:05:18.014934] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-27T19:05:18.213810] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-27T19:05:18.282253] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T19:05:18.814968] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-27T19:05:19.614962] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-27T19:05:19.891715] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-27T19:05:20.097375] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-27T19:05:20.108186] [INFO ] [REMOTE ] GS: Full fetch complete (75831 records). [2025-10-27T19:05:20.108485] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-27T19:05:20.422889] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-27T19:05:20.534885] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-27T19:05:20.534971] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-27T19:05:20.536092] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-27T19:05:20.536169] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-27T19:05:20.537734] [DEBUG] [LOCAL ] GS: Trimmed 75831 records to 51743 (keeping 200 days of data) [2025-10-27T19:05:20.890902] [DEBUG] [LOCAL ] GS: Primary data saved (51743 records). [2025-10-27T19:05:20.891051] [INFO ] [MAIN ] GS: Full history saved. [2025-10-27T19:05:20.891175] [INFO ] [MAIN ] Update Progress: 974/2366 symbols completed. GS took 38.9s. Estimated remaining: 2h 59m 4s. Rate: 7.8 symbols/min [2025-10-27T19:05:21.074283] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:05:21.121175] [DEBUG] [LOCAL ] GTES: Loaded 51018 existing records from primary storage. [2025-10-27T19:05:21.121518] [INFO ] [MAIN ] GTES: Loaded 51018 existing records. [2025-10-27T19:05:21.220332] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-27T19:05:21.303666] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:05:21.303859] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-27T19:05:21.303906] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-27T19:05:21.304080] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-27T19:05:21.304119] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-27T19:05:21.678353] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:05:21.699734] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-27T19:05:21.740763] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-27T19:05:22.014946] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-27T19:05:22.531522] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T19:05:22.814943] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-27T19:05:22.990135] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T19:05:23.614949] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-27T19:05:24.414972] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-27T19:05:24.482487] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T19:05:25.214923] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-27T19:05:25.346711] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T19:05:25.356007] [INFO ] [REMOTE ] GSBD: Full fetch complete (58456 records). [2025-10-27T19:05:25.356121] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-27T19:05:25.742865] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-27T19:05:25.742960] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-27T19:05:25.743761] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-27T19:05:25.743836] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-27T19:05:25.763292] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T19:05:25.762504] [DEBUG] [LOCAL ] GSBD: Trimmed 58456 records to 39315 (keeping 200 days of data) [2025-10-27T19:05:26.003365] [DEBUG] [LOCAL ] GSBD: Primary data saved (39315 records). [2025-10-27T19:05:26.003505] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-27T19:05:26.003600] [INFO ] [MAIN ] Update Progress: 975/2366 symbols completed. GSBD took 34.8s. Estimated remaining: 2h 58m 53s. Rate: 7.8 symbols/min [2025-10-27T19:05:26.024037] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-27T19:05:26.171495] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:05:26.214329] [DEBUG] [LOCAL ] GTLS: Loaded 43732 existing records from primary storage. [2025-10-27T19:05:26.214673] [INFO ] [MAIN ] GTLS: Loaded 43732 existing records. [2025-10-27T19:05:26.406166] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:05:26.406381] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-27T19:05:26.406431] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-27T19:05:26.406676] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-27T19:05:26.406768] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-27T19:05:26.800900] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:05:26.814913] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-27T19:05:26.915840] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T19:05:27.615001] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-27T19:05:27.705962] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T19:05:28.414953] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-27T19:05:28.582917] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-27T19:05:29.214936] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-27T19:05:29.249955] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T19:05:30.015019] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-27T19:05:30.195754] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-27T19:05:30.206512] [INFO ] [REMOTE ] GSK: Full fetch complete (77637 records). [2025-10-27T19:05:30.206771] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-27T19:05:30.653301] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-27T19:05:30.653608] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-27T19:05:30.654852] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-27T19:05:30.654951] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-27T19:05:30.678320] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T19:05:30.678517] [DEBUG] [LOCAL ] GSK: Trimmed 77637 records to 53510 (keeping 200 days of data) [2025-10-27T19:05:30.817382] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-27T19:05:31.064981] [DEBUG] [LOCAL ] GSK: Primary data saved (53510 records). [2025-10-27T19:05:31.065190] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-27T19:05:31.065332] [INFO ] [MAIN ] Update Progress: 976/2366 symbols completed. GSK took 29.8s. Estimated remaining: 2h 58m 41s. Rate: 7.8 symbols/min [2025-10-27T19:05:31.302960] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:05:31.349092] [DEBUG] [LOCAL ] GTN: Loaded 45322 existing records from primary storage. [2025-10-27T19:05:31.349430] [INFO ] [MAIN ] GTN: Loaded 45322 existing records. [2025-10-27T19:05:31.579942] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:05:31.580447] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-27T19:05:31.580523] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-27T19:05:31.580839] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-27T19:05:31.580927] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-27T19:05:31.669353] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-27T19:05:31.754945] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-27T19:05:32.134359] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:05:32.332837] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-27T19:05:32.414943] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-27T19:05:33.156033] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T19:05:33.214942] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-27T19:05:33.597135] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-27T19:05:34.014934] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-27T19:05:34.687260] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T19:05:34.693462] [INFO ] [REMOTE ] GSL: Full fetch complete (48246 records). [2025-10-27T19:05:34.693557] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-27T19:05:34.820077] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-27T19:05:35.071859] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-27T19:05:35.071947] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-27T19:05:35.072675] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-27T19:05:35.072739] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-27T19:05:35.073820] [DEBUG] [LOCAL ] GSL: Trimmed 48246 records to 32535 (keeping 200 days of data) [2025-10-27T19:05:35.267397] [DEBUG] [LOCAL ] GSL: Primary data saved (32535 records). [2025-10-27T19:05:35.267499] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-27T19:05:35.267862] [INFO ] [MAIN ] Update Progress: 977/2366 symbols completed. GSL took 26.7s. Estimated remaining: 2h 58m 29s. Rate: 7.8 symbols/min [2025-10-27T19:05:35.436301] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:05:35.468089] [DEBUG] [LOCAL ] GTY: Loaded 30496 existing records from primary storage. [2025-10-27T19:05:35.468389] [INFO ] [MAIN ] GTY: Loaded 30496 existing records. [2025-10-27T19:05:35.627209] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-27T19:05:35.650486] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-27T19:05:35.669988] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:05:35.678680] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-27T19:05:35.678959] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-27T19:05:35.679289] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-27T19:05:35.679346] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-27T19:05:36.025993] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:05:36.107471] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T19:05:36.414976] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-27T19:05:37.214915] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-27T19:05:37.271820] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T19:05:37.618735] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T19:05:38.014959] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-27T19:05:38.814919] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-27T19:05:38.903333] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T19:05:39.318626] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T19:05:39.614960] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-27T19:05:40.415002] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-27T19:05:40.551434] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T19:05:41.214930] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-27T19:05:41.329130] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T19:05:41.939698] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T19:05:42.014949] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-27T19:05:42.814981] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-27T19:05:43.180595] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-27T19:05:43.288389] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-27T19:05:43.614950] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-27T19:05:44.350155] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T19:05:44.414926] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-27T19:05:44.712291] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-27T19:05:45.214953] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-27T19:05:46.015793] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-27T19:05:46.021633] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-27T19:05:46.211046] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-27T19:05:46.814980] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-27T19:05:47.539836] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T19:05:47.624175] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-27T19:05:47.625604] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-27T19:05:48.414937] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-27T19:05:48.901898] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-27T19:05:49.214981] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-27T19:05:50.014973] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-27T19:05:50.104740] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T19:05:50.814937] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-27T19:05:50.844488] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-27T19:05:50.932663] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T19:05:51.614997] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-27T19:05:52.109876] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T19:05:52.414984] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-27T19:05:53.138488] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T19:05:53.214988] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-27T19:05:53.982207] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-27T19:05:54.014899] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-27T19:05:54.814986] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-27T19:05:54.906346] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-27T19:05:55.167311] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T19:05:55.176005] [INFO ] [REMOTE ] GTN: Full fetch complete (65563 records). [2025-10-27T19:05:55.176176] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-27T19:05:55.572734] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-27T19:05:55.572871] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-27T19:05:55.574278] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-27T19:05:55.574347] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-27T19:05:55.576135] [DEBUG] [LOCAL ] GTN: Trimmed 65563 records to 44461 (keeping 200 days of data) [2025-10-27T19:05:55.625307] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-27T19:05:55.854576] [DEBUG] [LOCAL ] GTN: Primary data saved (44461 records). [2025-10-27T19:05:55.854804] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-27T19:05:55.854915] [INFO ] [MAIN ] Update Progress: 978/2366 symbols completed. GTN took 24.8s. Estimated remaining: 2h 58m 39s. Rate: 7.8 symbols/min [2025-10-27T19:05:56.032343] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:05:56.049748] [DEBUG] [LOCAL ] GUG: Loaded 12261 existing records from primary storage. [2025-10-27T19:05:56.050072] [INFO ] [MAIN ] GUG: Loaded 12261 existing records. [2025-10-27T19:05:56.244528] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T19:05:56.286230] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:05:56.287343] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-27T19:05:56.287462] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-27T19:05:56.287750] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-27T19:05:56.287811] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-27T19:05:56.420092] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-27T19:05:56.668247] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:05:57.023463] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-27T19:05:57.214947] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-27T19:05:58.014968] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-27T19:05:58.163910] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-27T19:05:58.455980] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-27T19:05:58.681466] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-27T19:05:58.814933] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-27T19:05:59.578204] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T19:05:59.614941] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-27T19:06:00.414978] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-27T19:06:01.214977] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-27T19:06:01.392052] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-27T19:06:01.841410] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-27T19:06:01.852371] [INFO ] [REMOTE ] GTES: Full fetch complete (73840 records). [2025-10-27T19:06:01.852533] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-27T19:06:02.021434] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-27T19:06:02.262755] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-27T19:06:02.262845] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-27T19:06:02.263757] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-27T19:06:02.263819] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-27T19:06:02.265392] [DEBUG] [LOCAL ] GTES: Trimmed 73840 records to 50229 (keeping 200 days of data) [2025-10-27T19:06:02.547795] [DEBUG] [LOCAL ] GTES: Primary data saved (50229 records). [2025-10-27T19:06:02.547954] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-27T19:06:02.548619] [INFO ] [MAIN ] Update Progress: 979/2366 symbols completed. GTES took 41.7s. Estimated remaining: 2h 58m 30s. Rate: 7.8 symbols/min [2025-10-27T19:06:02.721931] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:06:02.739374] [DEBUG] [LOCAL ] GUT: Loaded 15855 existing records from primary storage. [2025-10-27T19:06:02.739600] [INFO ] [MAIN ] GUT: Loaded 15855 existing records. [2025-10-27T19:06:02.820023] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-27T19:06:02.925266] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:06:02.925497] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-27T19:06:02.925545] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-27T19:06:02.925778] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-27T19:06:02.925834] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-27T19:06:03.299198] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:06:03.371734] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T19:06:03.419080] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-27T19:06:03.608089] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-27T19:06:03.615634] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-27T19:06:03.617307] [INFO ] [REMOTE ] GTLS: Full fetch complete (61406 records). [2025-10-27T19:06:03.617389] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-27T19:06:04.010288] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-27T19:06:04.010367] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-27T19:06:04.011180] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-27T19:06:04.011242] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-27T19:06:04.012420] [DEBUG] [LOCAL ] GTLS: Trimmed 61406 records to 42877 (keeping 200 days of data) [2025-10-27T19:06:04.269130] [DEBUG] [LOCAL ] GTLS: Primary data saved (42877 records). [2025-10-27T19:06:04.269277] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-27T19:06:04.269361] [INFO ] [MAIN ] Update Progress: 980/2366 symbols completed. GTLS took 38.3s. Estimated remaining: 2h 58m 14s. Rate: 7.8 symbols/min [2025-10-27T19:06:04.423269] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-27T19:06:04.454284] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:06:04.485944] [DEBUG] [LOCAL ] GVA: Loaded 33038 existing records from primary storage. [2025-10-27T19:06:04.486193] [INFO ] [MAIN ] GVA: Loaded 33038 existing records. [2025-10-27T19:06:04.668850] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:06:04.669046] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-27T19:06:04.669095] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-27T19:06:04.669275] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-27T19:06:04.669315] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-27T19:06:05.033749] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:06:05.068683] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T19:06:05.214929] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-27T19:06:05.545930] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-27T19:06:05.552221] [INFO ] [REMOTE ] GTY: Full fetch complete (43879 records). [2025-10-27T19:06:05.552314] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-27T19:06:05.920365] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-27T19:06:05.920437] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-27T19:06:05.921131] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-27T19:06:05.921250] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-27T19:06:05.922136] [DEBUG] [LOCAL ] GTY: Trimmed 43879 records to 29754 (keeping 200 days of data) [2025-10-27T19:06:06.014980] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-27T19:06:06.100244] [DEBUG] [LOCAL ] GTY: Primary data saved (29754 records). [2025-10-27T19:06:06.100363] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-27T19:06:06.100441] [INFO ] [MAIN ] Update Progress: 981/2366 symbols completed. GTY took 30.8s. Estimated remaining: 2h 57m 58s. Rate: 7.8 symbols/min [2025-10-27T19:06:06.267564] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:06:06.287253] [DEBUG] [LOCAL ] GWH: Loaded 20766 existing records from primary storage. [2025-10-27T19:06:06.287476] [INFO ] [MAIN ] GWH: Loaded 20766 existing records. [2025-10-27T19:06:06.464413] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:06:06.464722] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-27T19:06:06.464823] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-27T19:06:06.464983] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-27T19:06:06.465023] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-27T19:06:06.800678] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-27T19:06:06.847214] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-27T19:06:06.869589] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:06:06.971025] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-27T19:06:07.615011] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-27T19:06:08.208692] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T19:06:08.414922] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-27T19:06:08.662914] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T19:06:09.203594] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-27T19:06:09.214902] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-27T19:06:10.014984] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-27T19:06:10.131832] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T19:06:10.814976] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-27T19:06:10.990384] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-27T19:06:11.614924] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-27T19:06:11.690322] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T19:06:12.237027] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T19:06:12.415038] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-27T19:06:13.214955] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-27T19:06:13.698399] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-27T19:06:14.021012] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-27T19:06:14.037091] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T19:06:14.814929] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-27T19:06:15.088343] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-27T19:06:15.315547] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-27T19:06:15.614945] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-27T19:06:16.390470] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T19:06:16.414910] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-27T19:06:17.214940] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-27T19:06:17.299441] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-27T19:06:17.301986] [INFO ] [REMOTE ] GUG: Full fetch complete (18701 records). [2025-10-27T19:06:17.302055] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-27T19:06:17.667598] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-27T19:06:17.667694] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-27T19:06:17.668094] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-27T19:06:17.668133] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-27T19:06:17.668629] [DEBUG] [LOCAL ] GUG: Trimmed 18701 records to 11956 (keeping 200 days of data) [2025-10-27T19:06:17.738886] [DEBUG] [LOCAL ] GUG: Primary data saved (11956 records). [2025-10-27T19:06:17.739017] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-27T19:06:17.739094] [INFO ] [MAIN ] Update Progress: 982/2366 symbols completed. GUG took 21.9s. Estimated remaining: 2h 57m 56s. Rate: 7.8 symbols/min [2025-10-27T19:06:17.908374] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:06:17.946723] [DEBUG] [LOCAL ] GWRE: Loaded 39996 existing records from primary storage. [2025-10-27T19:06:17.947002] [INFO ] [MAIN ] GWRE: Loaded 39996 existing records. [2025-10-27T19:06:18.016386] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-27T19:06:18.135466] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:06:18.145101] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-27T19:06:18.144764] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-27T19:06:18.148569] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-27T19:06:18.149074] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-27T19:06:18.149127] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-27T19:06:18.536692] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:06:18.815021] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-27T19:06:19.546766] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T19:06:19.614945] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-27T19:06:20.414934] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-27T19:06:20.478807] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T19:06:20.663851] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T19:06:21.217510] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-27T19:06:21.219293] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-27T19:06:22.014943] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-27T19:06:22.634370] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T19:06:22.814933] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-27T19:06:23.587742] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T19:06:23.614901] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-27T19:06:24.007532] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T19:06:24.414943] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-27T19:06:24.922132] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T19:06:25.064572] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T19:06:25.214951] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-27T19:06:26.014932] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-27T19:06:26.114105] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-27T19:06:26.815075] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-27T19:06:27.313315] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T19:06:27.614962] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-27T19:06:27.965432] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T19:06:28.414947] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-27T19:06:28.580462] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-27T19:06:29.214935] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-27T19:06:29.644508] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-27T19:06:30.014934] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-27T19:06:30.676500] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-27T19:06:30.775763] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T19:06:30.814911] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-27T19:06:31.614933] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-27T19:06:31.780632] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-27T19:06:32.414936] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-27T19:06:33.011087] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T19:06:33.214920] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-27T19:06:33.391948] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T19:06:34.014931] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-27T19:06:34.623175] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T19:06:34.814945] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-27T19:06:35.614921] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-27T19:06:35.920014] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-27T19:06:35.928399] [INFO ] [REMOTE ] GWH: Full fetch complete (25376 records). [2025-10-27T19:06:35.928552] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-27T19:06:36.295001] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-27T19:06:36.295083] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-27T19:06:36.295674] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-27T19:06:36.295735] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-27T19:06:36.296371] [DEBUG] [LOCAL ] GWH: Trimmed 25376 records to 20891 (keeping 200 days of data) [2025-10-27T19:06:36.415725] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-27T19:06:36.415619] [DEBUG] [LOCAL ] GWH: Primary data saved (20891 records). [2025-10-27T19:06:36.416018] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-27T19:06:36.416319] [INFO ] [MAIN ] Update Progress: 983/2366 symbols completed. GWH took 30.3s. Estimated remaining: 2h 58m 3s. Rate: 7.8 symbols/min [2025-10-27T19:06:36.590215] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:06:36.608253] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-27T19:06:36.614962] [INFO ] [REMOTE ] GVA: Full fetch complete (48517 records). [2025-10-27T19:06:36.615060] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-27T19:06:36.786863] [DEBUG] [LOCAL ] GWW: Loaded 19526 existing records from primary storage. [2025-10-27T19:06:36.817023] [INFO ] [MAIN ] GWW: Loaded 19526 existing records. [2025-10-27T19:06:37.231388] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-27T19:06:37.228744] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:06:37.231804] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-27T19:06:37.232009] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-27T19:06:37.232820] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-27T19:06:37.233099] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-27T19:06:37.233245] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-27T19:06:37.233565] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-27T19:06:37.233718] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-27T19:06:37.316545] [DEBUG] [LOCAL ] GVA: Trimmed 48517 records to 32201 (keeping 200 days of data) [2025-10-27T19:06:37.452821] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-27T19:06:37.514033] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-27T19:06:37.552888] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-27T19:06:37.860113] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:06:37.865252] [DEBUG] [LOCAL ] GVA: Primary data saved (32201 records). [2025-10-27T19:06:37.865664] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-27T19:06:37.865781] [INFO ] [MAIN ] Update Progress: 984/2366 symbols completed. GVA took 33.6s. Estimated remaining: 2h 57m 47s. Rate: 7.8 symbols/min [2025-10-27T19:06:38.028617] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-27T19:06:38.031699] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:06:38.073394] [DEBUG] [LOCAL ] GXO: Loaded 47037 existing records from primary storage. [2025-10-27T19:06:38.073704] [INFO ] [MAIN ] GXO: Loaded 47037 existing records. [2025-10-27T19:06:38.248621] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:06:38.248829] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-27T19:06:38.248875] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-27T19:06:38.249065] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-27T19:06:38.249103] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-27T19:06:38.605224] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:06:38.616181] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-27T19:06:38.620066] [INFO ] [REMOTE ] GUT: Full fetch complete (22556 records). [2025-10-27T19:06:38.620144] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-27T19:06:38.820125] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-27T19:06:39.000927] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-27T19:06:39.001024] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-27T19:06:39.001601] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-27T19:06:39.001672] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-27T19:06:39.002353] [DEBUG] [LOCAL ] GUT: Trimmed 22556 records to 15426 (keeping 200 days of data) [2025-10-27T19:06:39.107542] [DEBUG] [LOCAL ] GUT: Primary data saved (15426 records). [2025-10-27T19:06:39.107849] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-27T19:06:39.108005] [INFO ] [MAIN ] Update Progress: 985/2366 symbols completed. GUT took 36.6s. Estimated remaining: 2h 57m 30s. Rate: 7.8 symbols/min [2025-10-27T19:06:39.196884] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T19:06:39.299727] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:06:39.304034] [DEBUG] [LOCAL ] GYLD: Loaded 1542 existing records from primary storage. [2025-10-27T19:06:39.304201] [INFO ] [MAIN ] GYLD: Loaded 1542 existing records. [2025-10-27T19:06:39.479889] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:06:39.480093] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-27T19:06:39.480140] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-27T19:06:39.480278] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-27T19:06:39.480314] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-27T19:06:39.620363] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-27T19:06:39.847202] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:06:40.082621] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-27T19:06:40.414958] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-27T19:06:40.497874] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-27T19:06:41.215027] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-27T19:06:42.010289] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T19:06:42.019453] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-27T19:06:42.385414] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-27T19:06:42.414756] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-27T19:06:42.814949] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-27T19:06:43.614961] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-27T19:06:44.081375] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T19:06:44.414932] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-27T19:06:44.754736] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T19:06:44.792688] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-27T19:06:45.214932] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-27T19:06:46.015006] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-27T19:06:46.112274] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-27T19:06:46.814966] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-27T19:06:47.559839] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T19:06:47.614910] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-27T19:06:48.423296] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-27T19:06:48.426307] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T19:06:49.214980] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-27T19:06:49.261673] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-27T19:06:49.268599] [INFO ] [REMOTE ] GWRE: Full fetch complete (59865 records). [2025-10-27T19:06:49.268748] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-27T19:06:49.644863] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-27T19:06:49.667538] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-27T19:06:49.668352] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-27T19:06:49.669618] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-27T19:06:49.669710] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-27T19:06:49.671024] [DEBUG] [LOCAL ] GWRE: Trimmed 59865 records to 39239 (keeping 200 days of data) [2025-10-27T19:06:49.912443] [DEBUG] [LOCAL ] GWRE: Primary data saved (39239 records). [2025-10-27T19:06:49.912595] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-27T19:06:49.912733] [INFO ] [MAIN ] Update Progress: 986/2366 symbols completed. GWRE took 32.2s. Estimated remaining: 2h 57m 27s. Rate: 7.8 symbols/min [2025-10-27T19:06:50.020161] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-27T19:06:50.084357] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:06:50.126025] [DEBUG] [LOCAL ] H: Loaded 45005 existing records from primary storage. [2025-10-27T19:06:50.126334] [INFO ] [MAIN ] H: Loaded 45005 existing records. [2025-10-27T19:06:50.297559] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:06:50.297774] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-27T19:06:50.297821] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-27T19:06:50.298022] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-27T19:06:50.298079] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-27T19:06:50.399625] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-27T19:06:50.656891] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:06:50.762481] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-27T19:06:50.814905] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-27T19:06:51.111403] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-27T19:06:51.614939] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-27T19:06:52.414944] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-27T19:06:53.202221] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T19:06:53.214907] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-27T19:06:53.783425] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T19:06:54.014946] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-27T19:06:54.812825] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-27T19:06:54.816565] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-27T19:06:55.322453] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-27T19:06:55.621963] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-27T19:06:55.637611] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-27T19:06:55.926814] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-27T19:06:56.414933] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-27T19:06:57.214942] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-27T19:06:57.680478] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-27T19:06:58.014995] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-27T19:06:58.120552] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T19:06:58.814951] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-27T19:06:59.173790] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-27T19:06:59.421770] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T19:06:59.614938] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-27T19:07:00.414949] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-27T19:07:01.075773] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T19:07:01.214922] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-27T19:07:01.783965] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-27T19:07:02.014995] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-27T19:07:02.814916] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-27T19:07:03.170167] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-27T19:07:03.517496] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T19:07:03.614945] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-27T19:07:03.665791] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-27T19:07:04.414968] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-27T19:07:05.214922] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-27T19:07:05.258896] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T19:07:05.525050] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T19:07:06.014980] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-27T19:07:06.486524] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-27T19:07:06.654135] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T19:07:06.662426] [INFO ] [REMOTE ] GXO: Full fetch complete (69163 records). [2025-10-27T19:07:06.662554] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-27T19:07:06.816313] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-27T19:07:07.059039] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-27T19:07:07.059137] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-27T19:07:07.060072] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-27T19:07:07.060138] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-27T19:07:07.061510] [DEBUG] [LOCAL ] GXO: Trimmed 69163 records to 46145 (keeping 200 days of data) [2025-10-27T19:07:07.321812] [DEBUG] [LOCAL ] GXO: Primary data saved (46145 records). [2025-10-27T19:07:07.321942] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-27T19:07:07.322020] [INFO ] [MAIN ] Update Progress: 987/2366 symbols completed. GXO took 29.5s. Estimated remaining: 2h 57m 32s. Rate: 7.8 symbols/min [2025-10-27T19:07:07.486918] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:07:07.522799] [DEBUG] [LOCAL ] HAE: Loaded 39807 existing records from primary storage. [2025-10-27T19:07:07.523076] [INFO ] [MAIN ] HAE: Loaded 39807 existing records. [2025-10-27T19:07:07.620888] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-27T19:07:07.704130] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:07:07.704346] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-27T19:07:07.704393] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-27T19:07:07.704622] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-27T19:07:07.704838] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-27T19:07:08.053589] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:07:08.087695] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T19:07:08.091874] [INFO ] [REMOTE ] GWW: Full fetch complete (29043 records). [2025-10-27T19:07:08.091949] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-27T19:07:08.422467] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-27T19:07:08.451360] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-27T19:07:08.451439] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-27T19:07:08.451996] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-27T19:07:08.452057] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-27T19:07:08.452764] [DEBUG] [LOCAL ] GWW: Trimmed 29043 records to 18953 (keeping 200 days of data) [2025-10-27T19:07:08.574990] [DEBUG] [LOCAL ] GWW: Primary data saved (18953 records). [2025-10-27T19:07:08.575129] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-27T19:07:08.575204] [INFO ] [MAIN ] Update Progress: 988/2366 symbols completed. GWW took 32.2s. Estimated remaining: 2h 57m 16s. Rate: 7.8 symbols/min [2025-10-27T19:07:08.740119] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:07:08.779253] [DEBUG] [LOCAL ] HAFN: Loaded 43254 existing records from primary storage. [2025-10-27T19:07:08.779556] [INFO ] [MAIN ] HAFN: Loaded 43254 existing records. [2025-10-27T19:07:08.968991] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:07:08.969242] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-27T19:07:08.969364] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-27T19:07:08.969558] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-27T19:07:08.969600] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-27T19:07:09.225331] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-27T19:07:09.328142] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:07:09.355150] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-27T19:07:09.734259] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-27T19:07:10.000604] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T19:07:10.014899] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-27T19:07:10.814950] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-27T19:07:11.369796] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-27T19:07:11.372373] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T19:07:11.373522] [INFO ] [REMOTE ] GYLD: Full fetch complete (2105 records). [2025-10-27T19:07:11.382828] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-27T19:07:11.628238] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-27T19:07:11.909261] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-27T19:07:11.909348] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-27T19:07:11.909506] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-27T19:07:11.909570] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-27T19:07:11.909999] [DEBUG] [LOCAL ] GYLD: Trimmed 2105 records to 1514 (keeping 200 days of data) [2025-10-27T19:07:11.919838] [DEBUG] [LOCAL ] GYLD: Primary data saved (1514 records). [2025-10-27T19:07:11.919951] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-27T19:07:11.920033] [INFO ] [MAIN ] Update Progress: 989/2366 symbols completed. GYLD took 32.8s. Estimated remaining: 2h 57m 2s. Rate: 7.8 symbols/min [2025-10-27T19:07:12.158795] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:07:12.217025] [DEBUG] [LOCAL ] HAL: Loaded 54498 existing records from primary storage. [2025-10-27T19:07:12.217352] [INFO ] [MAIN ] HAL: Loaded 54498 existing records. [2025-10-27T19:07:12.395743] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:07:12.395943] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-27T19:07:12.396013] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-27T19:07:12.396228] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-27T19:07:12.396284] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-27T19:07:12.426951] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-27T19:07:12.750427] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:07:12.929434] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T19:07:13.214927] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-27T19:07:14.015064] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-27T19:07:14.016141] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T19:07:14.825163] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-27T19:07:14.827785] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T19:07:15.614925] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-27T19:07:15.953345] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-27T19:07:16.414948] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-27T19:07:16.617114] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-27T19:07:17.214936] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-27T19:07:17.258073] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T19:07:18.014982] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-27T19:07:18.180167] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-27T19:07:18.814949] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-27T19:07:18.930618] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-27T19:07:19.614915] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-27T19:07:19.793333] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-27T19:07:19.801620] [INFO ] [REMOTE ] H: Full fetch complete (63555 records). [2025-10-27T19:07:19.801841] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-27T19:07:20.188834] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-27T19:07:20.188991] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-27T19:07:20.189963] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-27T19:07:20.190119] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-27T19:07:20.191484] [DEBUG] [LOCAL ] H: Trimmed 63555 records to 44189 (keeping 200 days of data) [2025-10-27T19:07:20.418363] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-27T19:07:20.477550] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T19:07:20.502202] [DEBUG] [LOCAL ] H: Primary data saved (44189 records). [2025-10-27T19:07:20.502692] [INFO ] [MAIN ] H: Full history saved. [2025-10-27T19:07:20.502806] [INFO ] [MAIN ] Update Progress: 990/2366 symbols completed. H took 30.6s. Estimated remaining: 2h 56m 55s. Rate: 7.8 symbols/min [2025-10-27T19:07:20.681991] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:07:20.724455] [DEBUG] [LOCAL ] HASI: Loaded 48367 existing records from primary storage. [2025-10-27T19:07:20.724817] [INFO ] [MAIN ] HASI: Loaded 48367 existing records. [2025-10-27T19:07:20.913984] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:07:20.914162] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-27T19:07:20.914211] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-27T19:07:20.914386] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-27T19:07:20.914425] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-27T19:07:21.217615] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-27T19:07:21.289500] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:07:21.322891] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T19:07:22.014991] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-27T19:07:22.080528] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T19:07:22.596937] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T19:07:22.814987] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-27T19:07:23.483800] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T19:07:23.614921] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-27T19:07:24.213252] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T19:07:24.414963] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-27T19:07:25.215031] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-27T19:07:25.605488] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-27T19:07:25.859382] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T19:07:26.014949] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-27T19:07:26.520475] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-27T19:07:26.814956] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-27T19:07:27.618559] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-27T19:07:27.621121] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T19:07:28.194741] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T19:07:28.414991] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-27T19:07:29.214949] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-27T19:07:29.634362] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-27T19:07:30.014912] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-27T19:07:30.163345] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-27T19:07:30.533884] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T19:07:30.814945] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-27T19:07:31.614904] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-27T19:07:31.945516] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-27T19:07:32.090180] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T19:07:32.414940] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-27T19:07:33.214944] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-27T19:07:33.264594] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-27T19:07:33.272671] [INFO ] [REMOTE ] HAE: Full fetch complete (59338 records). [2025-10-27T19:07:33.272830] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-27T19:07:33.651428] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-27T19:07:33.651516] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-27T19:07:33.652321] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-27T19:07:33.652384] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-27T19:07:33.653511] [DEBUG] [LOCAL ] HAE: Trimmed 59338 records to 38963 (keeping 200 days of data) [2025-10-27T19:07:33.874218] [DEBUG] [LOCAL ] HAE: Primary data saved (38963 records). [2025-10-27T19:07:33.874359] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-27T19:07:33.874445] [INFO ] [MAIN ] Update Progress: 991/2366 symbols completed. HAE took 26.6s. Estimated remaining: 2h 56m 56s. Rate: 7.8 symbols/min [2025-10-27T19:07:34.040147] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-27T19:07:34.042601] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:07:34.088239] [DEBUG] [LOCAL ] HAYW: Loaded 49525 existing records from primary storage. [2025-10-27T19:07:34.088549] [INFO ] [MAIN ] HAYW: Loaded 49525 existing records. [2025-10-27T19:07:34.265132] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:07:34.265357] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-27T19:07:34.265404] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-27T19:07:34.265601] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-27T19:07:34.265690] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-27T19:07:34.654176] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:07:34.678047] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T19:07:34.715752] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-27T19:07:34.814909] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-27T19:07:35.614977] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-27T19:07:35.649334] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-27T19:07:36.290850] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T19:07:36.414929] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-27T19:07:37.214985] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-27T19:07:37.482428] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-27T19:07:37.517619] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T19:07:38.014991] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-27T19:07:38.814998] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-27T19:07:38.907438] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T19:07:39.377323] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T19:07:39.387371] [INFO ] [REMOTE ] HAL: Full fetch complete (77897 records). [2025-10-27T19:07:39.387489] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-27T19:07:39.623810] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-27T19:07:39.813462] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-27T19:07:39.813663] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-27T19:07:39.815203] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-27T19:07:39.816844] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T19:07:39.816989] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-27T19:07:39.828506] [DEBUG] [LOCAL ] HAL: Trimmed 77897 records to 53718 (keeping 200 days of data) [2025-10-27T19:07:40.149671] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-10-27T19:07:40.149805] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-27T19:07:40.150435] [INFO ] [MAIN ] Update Progress: 992/2366 symbols completed. HAL took 28.2s. Estimated remaining: 2h 56m 46s. Rate: 7.8 symbols/min [2025-10-27T19:07:40.317477] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:07:40.327198] [DEBUG] [LOCAL ] HBB: Loaded 6337 existing records from primary storage. [2025-10-27T19:07:40.327402] [INFO ] [MAIN ] HBB: Loaded 6337 existing records. [2025-10-27T19:07:40.423236] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-27T19:07:40.503389] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:07:40.503570] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-27T19:07:40.503615] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-27T19:07:40.503780] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-27T19:07:40.503829] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-27T19:07:40.864228] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:07:40.889042] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-27T19:07:41.214934] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-27T19:07:41.841489] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-27T19:07:42.014911] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-27T19:07:42.176726] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-27T19:07:42.815017] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-27T19:07:43.133879] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-27T19:07:43.614949] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-27T19:07:44.414924] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-27T19:07:44.604351] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-27T19:07:45.214934] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-27T19:07:45.366598] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T19:07:45.374356] [INFO ] [REMOTE ] HAFN: Full fetch complete (64522 records). [2025-10-27T19:07:45.374459] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-27T19:07:45.761564] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-27T19:07:45.761766] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-27T19:07:45.762614] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-27T19:07:45.762710] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-27T19:07:45.790236] [DEBUG] [LOCAL ] HAFN: Trimmed 64522 records to 42433 (keeping 200 days of data) [2025-10-27T19:07:45.790084] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T19:07:46.025618] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-27T19:07:46.044281] [DEBUG] [LOCAL ] HAFN: Primary data saved (42433 records). [2025-10-27T19:07:46.044434] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-27T19:07:46.044784] [INFO ] [MAIN ] Update Progress: 993/2366 symbols completed. HAFN took 37.5s. Estimated remaining: 2h 56m 36s. Rate: 7.8 symbols/min [2025-10-27T19:07:46.212272] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:07:46.261521] [DEBUG] [LOCAL ] HBI: Loaded 53680 existing records from primary storage. [2025-10-27T19:07:46.261861] [INFO ] [MAIN ] HBI: Loaded 53680 existing records. [2025-10-27T19:07:46.434997] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:07:46.435193] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-27T19:07:46.435238] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-27T19:07:46.435415] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-27T19:07:46.435465] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-27T19:07:46.798120] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:07:46.798410] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T19:07:46.814896] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-27T19:07:47.106848] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-27T19:07:47.531320] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-27T19:07:47.614913] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-27T19:07:48.414958] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-27T19:07:49.207970] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T19:07:49.217131] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-27T19:07:49.256978] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-27T19:07:50.014986] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-27T19:07:50.821500] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-27T19:07:50.826557] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T19:07:51.510250] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T19:07:51.614967] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-27T19:07:52.129880] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-27T19:07:52.400216] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T19:07:52.414906] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-27T19:07:53.214947] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-27T19:07:53.886034] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T19:07:54.014981] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-27T19:07:54.510897] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T19:07:54.814963] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-27T19:07:55.412354] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T19:07:55.614998] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-27T19:07:55.733101] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T19:07:56.415009] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-27T19:07:57.214930] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-27T19:07:57.271251] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T19:07:57.662983] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T19:07:58.014959] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-27T19:07:58.814951] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-27T19:07:58.942511] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T19:07:59.498942] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-27T19:07:59.533859] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T19:07:59.614976] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-27T19:08:00.415000] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-27T19:08:01.214964] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-27T19:08:02.015008] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-27T19:08:03.186934] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T19:08:03.189471] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-27T19:08:03.258213] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (2.84 seconds). [2025-10-27T19:08:03.268059] [INFO ] [REMOTE ] HASI: Full fetch complete (68250 records). [2025-10-27T19:08:03.268197] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-27T19:08:03.676853] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-27T19:08:03.690507] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-27T19:08:03.691612] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-27T19:08:03.691732] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-27T19:08:03.694245] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-27T19:08:03.705572] [DEBUG] [LOCAL ] HASI: Trimmed 68250 records to 47503 (keeping 200 days of data) [2025-10-27T19:08:03.706163] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-27T19:08:03.994854] [DEBUG] [LOCAL ] HASI: Primary data saved (47503 records). [2025-10-27T19:08:03.995041] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-27T19:08:03.995139] [INFO ] [MAIN ] Update Progress: 994/2366 symbols completed. HASI took 43.5s. Estimated remaining: 2h 56m 42s. Rate: 7.8 symbols/min [2025-10-27T19:08:04.160785] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:08:04.209168] [DEBUG] [LOCAL ] HBM: Loaded 53759 existing records from primary storage. [2025-10-27T19:08:04.209459] [INFO ] [MAIN ] HBM: Loaded 53759 existing records. [2025-10-27T19:08:04.407509] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:08:04.407802] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-27T19:08:04.407853] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-27T19:08:04.408052] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-27T19:08:04.408110] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-27T19:08:04.828581] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:08:04.829078] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-27T19:08:04.890442] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (5.28 seconds). [2025-10-27T19:08:04.899879] [INFO ] [REMOTE ] HAYW: Full fetch complete (70908 records). [2025-10-27T19:08:04.900053] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-27T19:08:05.008382] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-27T19:08:05.220173] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-27T19:08:05.302872] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-27T19:08:05.313684] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-27T19:08:05.319835] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-27T19:08:05.330596] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-27T19:08:05.335748] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-27T19:08:05.347955] [DEBUG] [LOCAL ] HAYW: Trimmed 70908 records to 48740 (keeping 200 days of data) [2025-10-27T19:08:05.620747] [DEBUG] [LOCAL ] HAYW: Primary data saved (48740 records). [2025-10-27T19:08:05.620874] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-27T19:08:05.620951] [INFO ] [MAIN ] Update Progress: 995/2366 symbols completed. HAYW took 31.7s. Estimated remaining: 2h 56m 26s. Rate: 7.8 symbols/min [2025-10-27T19:08:05.786292] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:08:05.791174] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-27T19:08:05.792735] [INFO ] [REMOTE ] HBB: Full fetch complete (9160 records). [2025-10-27T19:08:05.792808] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-27T19:08:06.031557] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-27T19:08:06.095450] [DEBUG] [LOCAL ] HCA: Loaded 47631 existing records from primary storage. [2025-10-27T19:08:06.110728] [INFO ] [MAIN ] HCA: Loaded 47631 existing records. [2025-10-27T19:08:06.283800] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-27T19:08:06.299910] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-27T19:08:06.300422] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-27T19:08:06.300560] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-27T19:08:06.317019] [DEBUG] [LOCAL ] HBB: Trimmed 9160 records to 6050 (keeping 200 days of data) [2025-10-27T19:08:06.410527] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:08:06.414916] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-27T19:08:06.438548] [DEBUG] [LOCAL ] HBB: Primary data saved (6050 records). [2025-10-27T19:08:06.440838] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-27T19:08:06.447536] [INFO ] [MAIN ] Update Progress: 996/2366 symbols completed. HBB took 26.3s. Estimated remaining: 2h 56m 9s. Rate: 7.8 symbols/min [2025-10-27T19:08:06.438725] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-27T19:08:06.483716] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-27T19:08:06.484185] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-27T19:08:06.508540] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T19:08:06.824447] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-27T19:08:06.834701] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:08:07.012169] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:08:07.042124] [DEBUG] [LOCAL ] HCC: Loaded 45578 existing records from primary storage. [2025-10-27T19:08:07.042546] [INFO ] [MAIN ] HCC: Loaded 45578 existing records. [2025-10-27T19:08:07.234063] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:08:07.234277] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-27T19:08:07.234324] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-27T19:08:07.234510] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-27T19:08:07.234550] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-27T19:08:07.584324] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:08:07.614935] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-27T19:08:07.811557] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-27T19:08:08.334051] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T19:08:08.414927] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-27T19:08:09.134893] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T19:08:09.214958] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-27T19:08:09.900387] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T19:08:10.014952] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-27T19:08:10.768568] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-27T19:08:10.814903] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-27T19:08:11.614964] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-27T19:08:11.846545] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-27T19:08:12.320848] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T19:08:12.414960] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-27T19:08:13.081290] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T19:08:13.214954] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-27T19:08:14.014958] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-27T19:08:14.138545] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-27T19:08:14.798050] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-27T19:08:14.814909] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-27T19:08:15.570989] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T19:08:15.614907] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-27T19:08:16.420147] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-27T19:08:16.432457] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-27T19:08:17.214947] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-27T19:08:17.365251] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-27T19:08:18.014966] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-27T19:08:18.158854] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-27T19:08:18.538088] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-27T19:08:18.814942] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-27T19:08:19.566104] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-27T19:08:19.614902] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-27T19:08:20.414976] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-27T19:08:20.741096] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-27T19:08:20.751410] [INFO ] [REMOTE ] HBI: Full fetch complete (76966 records). [2025-10-27T19:08:20.751514] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-27T19:08:21.144774] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-27T19:08:21.144880] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-27T19:08:21.145949] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-27T19:08:21.146055] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-27T19:08:21.147850] [DEBUG] [LOCAL ] HBI: Trimmed 76966 records to 52899 (keeping 200 days of data) [2025-10-27T19:08:21.230219] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-27T19:08:21.379413] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-27T19:08:21.493433] [DEBUG] [LOCAL ] HBI: Primary data saved (52899 records). [2025-10-27T19:08:21.493691] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-27T19:08:21.494072] [INFO ] [MAIN ] Update Progress: 997/2366 symbols completed. HBI took 35.4s. Estimated remaining: 2h 56m 11s. Rate: 7.8 symbols/min [2025-10-27T19:08:21.616393] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T19:08:22.014944] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-27T19:08:22.814960] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-27T19:08:23.402487] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-27T19:08:23.614913] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-27T19:08:23.999545] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-27T19:08:24.278850] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T19:08:24.414915] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-27T19:08:25.214980] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-27T19:08:25.430082] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-27T19:08:25.550993] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T19:08:26.014934] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-27T19:08:26.814916] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-27T19:08:26.916055] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T19:08:27.324728] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T19:08:27.615024] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-27T19:08:28.414985] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-27T19:08:28.573588] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-27T19:08:29.154155] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T19:08:29.214905] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-27T19:08:30.015006] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-27T19:08:30.112112] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T19:08:30.120542] [INFO ] [REMOTE ] HCC: Full fetch complete (64792 records). [2025-10-27T19:08:30.120745] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-27T19:08:30.534817] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-27T19:08:30.534901] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-27T19:08:30.535825] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-27T19:08:30.535890] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-27T19:08:30.537247] [DEBUG] [LOCAL ] HCC: Trimmed 64792 records to 44733 (keeping 200 days of data) [2025-10-27T19:08:30.800003] [DEBUG] [LOCAL ] HCC: Primary data saved (44733 records). [2025-10-27T19:08:30.800211] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-27T19:08:30.800879] [INFO ] [MAIN ] Update Progress: 998/2366 symbols completed. HCC took 24.4s. Estimated remaining: 2h 56m 5s. Rate: 7.8 symbols/min [2025-10-27T19:08:30.991469] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T19:08:31.002325] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-27T19:08:32.085608] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-27T19:08:32.095964] [INFO ] [REMOTE ] HBM: Full fetch complete (76762 records). [2025-10-27T19:08:32.096083] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-27T19:08:32.506402] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-27T19:08:32.506542] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-27T19:08:32.507680] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-27T19:08:32.507744] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-27T19:08:32.509258] [DEBUG] [LOCAL ] HBM: Trimmed 76762 records to 52979 (keeping 200 days of data) [2025-10-27T19:08:32.657801] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T19:08:32.754838] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-27T19:08:32.872786] [DEBUG] [LOCAL ] HBM: Primary data saved (52979 records). [2025-10-27T19:08:32.872976] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-27T19:08:32.873076] [INFO ] [MAIN ] Update Progress: 999/2366 symbols completed. HBM took 28.9s. Estimated remaining: 2h 55m 50s. Rate: 7.8 symbols/min [2025-10-27T19:08:34.340550] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T19:08:34.350107] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-27T19:08:36.001089] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-27T19:08:36.010297] [INFO ] [REMOTE ] HCA: Full fetch complete (68939 records). [2025-10-27T19:08:36.010436] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-27T19:08:36.401834] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-27T19:08:36.401931] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-27T19:08:36.402886] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-27T19:08:36.402948] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-27T19:08:36.404217] [DEBUG] [LOCAL ] HCA: Trimmed 68939 records to 46869 (keeping 200 days of data) [2025-10-27T19:08:36.695667] [DEBUG] [LOCAL ] HCA: Primary data saved (46869 records). [2025-10-27T19:08:36.695816] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-27T19:08:36.695909] [INFO ] [MAIN ] Update Progress: 1000/2366 symbols completed. HCA took 31.1s. Estimated remaining: 2h 55m 37s. Rate: 7.8 symbols/min [2025-10-27T19:08:37.282041] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:08:37.397553] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:08:37.442691] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:08:37.443078] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-27T19:08:37.441184] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:08:37.443791] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-27T19:08:37.444866] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-27T19:08:37.444936] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-27T19:08:37.449489] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-27T19:08:37.449780] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-27T19:08:37.527849] [DEBUG] [LOCAL ] HCI: Loaded 14235 existing records from primary storage. [2025-10-27T19:08:37.544256] [INFO ] [MAIN ] HCI: Loaded 14235 existing records. [2025-10-27T19:08:37.994930] [DEBUG] [LOCAL ] HDB: Loaded 52684 existing records from primary storage. [2025-10-27T19:08:38.052137] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:08:38.055024] [DEBUG] [LOCAL ] HD: Loaded 54239 existing records from primary storage. [2025-10-27T19:08:38.060880] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-27T19:08:38.061427] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-27T19:08:38.055325] [INFO ] [MAIN ] HDB: Loaded 52684 existing records. [2025-10-27T19:08:38.061694] [INFO ] [MAIN ] HD: Loaded 54239 existing records. [2025-10-27T19:08:38.074007] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-27T19:08:38.133457] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-27T19:08:38.404140] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:08:38.486321] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-27T19:08:38.812247] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:08:38.853277] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-27T19:08:38.861547] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-27T19:08:38.895781] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-27T19:08:38.917023] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-27T19:08:38.920509] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:08:38.911598] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-27T19:08:38.969529] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-27T19:08:38.991501] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-27T19:08:38.991692] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-27T19:08:39.053192] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-27T19:08:39.085353] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-27T19:08:39.144073] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:08:39.198538] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-27T19:08:39.376820] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-27T19:08:39.389810] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-27T19:08:39.725532] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:08:39.737129] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-27T19:08:39.750175] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-27T19:08:39.790134] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-27T19:08:39.810795] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:08:39.812359] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-27T19:08:40.043840] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-10-27T19:08:40.044663] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-27T19:08:40.219098] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T19:08:40.221949] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-27T19:08:40.287535] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-27T19:08:40.414954] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-27T19:08:40.690952] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-27T19:08:41.102593] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-27T19:08:41.160146] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T19:08:41.214931] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-27T19:08:41.840623] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-27T19:08:42.015027] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-27T19:08:42.477769] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T19:08:42.815003] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-27T19:08:43.069522] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-27T19:08:43.614986] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-27T19:08:43.870172] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-27T19:08:44.214763] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-27T19:08:44.415075] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-27T19:08:45.215015] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-27T19:08:46.014974] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-27T19:08:46.237754] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-27T19:08:46.421107] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-27T19:08:46.579336] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T19:08:46.814949] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-27T19:08:47.614957] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-27T19:08:48.019276] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-27T19:08:48.019962] [INFO ] [REMOTE ] HCXY: Full fetch complete (517 records). [2025-10-27T19:08:48.020028] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-27T19:08:48.190018] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 162 unique days, need 200 days [2025-10-27T19:08:48.190171] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:08:48.190237] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:08:48.190308] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-27T19:08:48.190368] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-27T19:08:48.190402] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-27T19:08:48.190441] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-27T19:08:48.190494] [INFO ] [MAIN ] Update Progress: 1001/2366 symbols completed. HCXY took 11.5s. Estimated remaining: 2h 55m 34s. Rate: 7.8 symbols/min [2025-10-27T19:08:48.351512] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:08:48.398269] [DEBUG] [LOCAL ] HE: Loaded 49431 existing records from primary storage. [2025-10-27T19:08:48.398560] [INFO ] [MAIN ] HE: Loaded 49431 existing records. [2025-10-27T19:08:48.420165] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-27T19:08:48.573542] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:08:48.573747] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-27T19:08:48.573796] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-27T19:08:48.574062] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-27T19:08:48.574120] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-27T19:08:48.925407] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:08:49.026483] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-27T19:08:49.214916] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-27T19:08:50.015017] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-27T19:08:50.452012] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-27T19:08:50.717833] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T19:08:50.742773] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T19:08:50.814967] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-27T19:08:51.614939] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-27T19:08:51.886440] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-27T19:08:52.415007] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-27T19:08:53.214939] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-27T19:08:53.434190] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T19:08:54.014936] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-27T19:08:54.155147] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-27T19:08:54.172561] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-27T19:08:54.815000] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-27T19:08:55.615025] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-27T19:08:56.148914] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-27T19:08:56.252115] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-27T19:08:56.414939] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-27T19:08:56.695065] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T19:08:57.214938] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-27T19:08:58.014982] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-27T19:08:58.464391] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-27T19:08:58.622429] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T19:08:58.815048] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-27T19:08:59.360951] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T19:08:59.614961] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-27T19:09:00.414957] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-27T19:09:00.965383] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T19:09:01.214924] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-27T19:09:01.637404] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-10-27T19:09:02.015002] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-27T19:09:02.491031] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-27T19:09:02.511326] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T19:09:02.815005] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-27T19:09:03.614931] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-27T19:09:04.271182] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T19:09:04.311948] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-27T19:09:04.415001] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-27T19:09:04.559297] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T19:09:05.215003] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-27T19:09:05.719598] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T19:09:06.015002] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-27T19:09:06.136326] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-27T19:09:06.139617] [INFO ] [REMOTE ] HCI: Full fetch complete (19553 records). [2025-10-27T19:09:06.139713] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-27T19:09:06.506594] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-27T19:09:06.506736] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-27T19:09:06.507253] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-27T19:09:06.507303] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-27T19:09:06.507984] [DEBUG] [LOCAL ] HCI: Trimmed 19553 records to 13895 (keeping 200 days of data) [2025-10-27T19:09:06.602671] [DEBUG] [LOCAL ] HCI: Primary data saved (13895 records). [2025-10-27T19:09:06.602819] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-27T19:09:06.602915] [INFO ] [MAIN ] Update Progress: 1002/2366 symbols completed. HCI took 29.9s. Estimated remaining: 2h 55m 41s. Rate: 7.8 symbols/min [2025-10-27T19:09:06.795136] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:09:06.815151] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-27T19:09:06.828949] [DEBUG] [LOCAL ] HEI: Loaded 30813 existing records from primary storage. [2025-10-27T19:09:06.829225] [INFO ] [MAIN ] HEI: Loaded 30813 existing records. [2025-10-27T19:09:07.003004] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:09:07.003222] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-27T19:09:07.003268] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-27T19:09:07.003471] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-27T19:09:07.003508] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-27T19:09:07.354182] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:09:07.614970] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-27T19:09:08.132968] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-27T19:09:08.414998] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-27T19:09:08.442061] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T19:09:08.704208] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-27T19:09:09.214962] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-27T19:09:10.014967] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-27T19:09:10.506555] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-27T19:09:10.516797] [INFO ] [REMOTE ] HD: Full fetch complete (77537 records). [2025-10-27T19:09:10.516919] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-27T19:09:10.818614] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-27T19:09:10.920668] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-27T19:09:10.920846] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-27T19:09:10.922052] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-27T19:09:10.922162] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-27T19:09:10.923693] [DEBUG] [LOCAL ] HD: Trimmed 77537 records to 53453 (keeping 200 days of data) [2025-10-27T19:09:11.052435] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-27T19:09:11.304698] [DEBUG] [LOCAL ] HD: Primary data saved (53453 records). [2025-10-27T19:09:11.304879] [INFO ] [MAIN ] HD: Full history saved. [2025-10-27T19:09:11.305455] [INFO ] [MAIN ] Update Progress: 1003/2366 symbols completed. HD took 34.6s. Estimated remaining: 2h 55m 29s. Rate: 7.8 symbols/min [2025-10-27T19:09:11.500717] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:09:11.522280] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T19:09:11.535101] [DEBUG] [LOCAL ] HEQ: Loaded 6878 existing records from primary storage. [2025-10-27T19:09:11.535299] [INFO ] [MAIN ] HEQ: Loaded 6878 existing records. [2025-10-27T19:09:11.620192] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-27T19:09:11.716298] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:09:11.716519] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-27T19:09:11.716569] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-27T19:09:11.716744] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-27T19:09:11.716802] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-27T19:09:12.075116] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:09:12.288542] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T19:09:12.414933] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-27T19:09:13.214922] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-27T19:09:13.631317] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-27T19:09:13.659076] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-27T19:09:13.669134] [INFO ] [REMOTE ] HDB: Full fetch complete (75669 records). [2025-10-27T19:09:13.669255] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-27T19:09:14.019322] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-27T19:09:14.061236] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-27T19:09:14.061432] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-27T19:09:14.062437] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-27T19:09:14.062619] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-27T19:09:14.064239] [DEBUG] [LOCAL ] HDB: Trimmed 75669 records to 51901 (keeping 200 days of data) [2025-10-27T19:09:14.185020] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-27T19:09:14.419138] [DEBUG] [LOCAL ] HDB: Primary data saved (51901 records). [2025-10-27T19:09:14.419299] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-27T19:09:14.419385] [INFO ] [MAIN ] Update Progress: 1004/2366 symbols completed. HDB took 37.7s. Estimated remaining: 2h 55m 15s. Rate: 7.8 symbols/min [2025-10-27T19:09:14.585893] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:09:14.628111] [DEBUG] [LOCAL ] HESM: Loaded 49331 existing records from primary storage. [2025-10-27T19:09:14.628396] [INFO ] [MAIN ] HESM: Loaded 49331 existing records. [2025-10-27T19:09:14.739877] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-27T19:09:14.815056] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:09:14.815278] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-27T19:09:14.816429] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-27T19:09:14.816502] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-27T19:09:14.816856] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-27T19:09:14.816917] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-27T19:09:15.181328] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:09:15.478515] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-27T19:09:15.614972] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-27T19:09:16.414938] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-27T19:09:17.214927] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-27T19:09:17.274574] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T19:09:17.951038] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-27T19:09:18.014957] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-27T19:09:18.159583] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-27T19:09:18.814924] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-27T19:09:19.133391] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-27T19:09:19.614918] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-27T19:09:19.665363] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T19:09:20.414933] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-27T19:09:21.055928] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T19:09:21.214957] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-27T19:09:21.865381] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-27T19:09:21.922507] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-27T19:09:21.931593] [INFO ] [REMOTE ] HE: Full fetch complete (71927 records). [2025-10-27T19:09:21.931728] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-27T19:09:22.020120] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-27T19:09:22.315960] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-27T19:09:22.316040] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-27T19:09:22.316932] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-27T19:09:22.316994] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-27T19:09:22.318304] [DEBUG] [LOCAL ] HE: Trimmed 71927 records to 48626 (keeping 200 days of data) [2025-10-27T19:09:22.594857] [DEBUG] [LOCAL ] HE: Primary data saved (48626 records). [2025-10-27T19:09:22.594977] [INFO ] [MAIN ] HE: Full history saved. [2025-10-27T19:09:22.595616] [INFO ] [MAIN ] Update Progress: 1005/2366 symbols completed. HE took 34.4s. Estimated remaining: 2h 55m 8s. Rate: 7.8 symbols/min [2025-10-27T19:09:22.765365] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:09:22.765490] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-27T19:09:22.765525] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-27T19:09:22.765661] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-27T19:09:22.765728] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-27T19:09:22.765808] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-27T19:09:22.765862] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-27T19:09:22.828117] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-27T19:09:23.113249] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:09:23.614911] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-27T19:09:23.707850] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T19:09:23.955605] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-27T19:09:24.414944] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-27T19:09:24.443566] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-27T19:09:25.117109] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-27T19:09:25.214927] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-27T19:09:26.015012] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-27T19:09:26.814931] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-27T19:09:26.860066] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T19:09:27.082181] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-27T19:09:27.138168] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T19:09:27.614942] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-27T19:09:28.414952] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-27T19:09:28.770771] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-27T19:09:28.861569] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-27T19:09:29.214933] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-27T19:09:30.014959] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-27T19:09:30.262014] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T19:09:30.742077] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-27T19:09:30.814906] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-27T19:09:31.614947] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-27T19:09:31.671444] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T19:09:31.674124] [INFO ] [REMOTE ] HEQ: Full fetch complete (9656 records). [2025-10-27T19:09:31.674215] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-27T19:09:32.083811] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-27T19:09:32.083886] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-27T19:09:32.084129] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-27T19:09:32.084167] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-27T19:09:32.084564] [DEBUG] [LOCAL ] HEQ: Trimmed 9656 records to 6624 (keeping 200 days of data) [2025-10-27T19:09:32.123067] [DEBUG] [LOCAL ] HEQ: Primary data saved (6624 records). [2025-10-27T19:09:32.123173] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-27T19:09:32.123259] [INFO ] [MAIN ] Update Progress: 1006/2366 symbols completed. HEQ took 20.8s. Estimated remaining: 2h 55m 3s. Rate: 7.8 symbols/min [2025-10-27T19:09:32.290390] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:09:32.290533] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-27T19:09:32.290569] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-27T19:09:32.290697] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-27T19:09:32.290749] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-27T19:09:32.290790] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-27T19:09:32.290822] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-27T19:09:32.428837] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-27T19:09:32.652174] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:09:33.099897] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T19:09:33.214915] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-27T19:09:34.014944] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-27T19:09:34.164044] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-27T19:09:34.221961] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-27T19:09:34.333571] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-27T19:09:34.814964] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-27T19:09:35.105739] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-27T19:09:35.614951] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-27T19:09:35.905491] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-27T19:09:36.414972] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-27T19:09:37.214995] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-27T19:09:37.477889] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-27T19:09:37.798940] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-27T19:09:38.014986] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-27T19:09:38.815011] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-27T19:09:39.615024] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-27T19:09:39.710400] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-27T19:09:39.761338] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-27T19:09:39.905192] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-27T19:09:40.414989] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-27T19:09:40.685628] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-27T19:09:41.214982] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-27T19:09:41.465915] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-27T19:09:42.014958] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-27T19:09:42.814919] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-27T19:09:43.227598] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T19:09:43.232185] [INFO ] [REMOTE ] HEI: Full fetch complete (46798 records). [2025-10-27T19:09:43.232274] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-27T19:09:43.604351] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-27T19:09:43.604433] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-27T19:09:43.605134] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-27T19:09:43.605194] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-27T19:09:43.606120] [DEBUG] [LOCAL ] HEI: Trimmed 46798 records to 30061 (keeping 200 days of data) [2025-10-27T19:09:43.658461] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-27T19:09:43.788865] [DEBUG] [LOCAL ] HEI: Primary data saved (30061 records). [2025-10-27T19:09:43.789001] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-27T19:09:43.789077] [INFO ] [MAIN ] Update Progress: 1007/2366 symbols completed. HEI took 37.2s. Estimated remaining: 2h 55m 1s. Rate: 7.8 symbols/min [2025-10-27T19:09:43.959780] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:09:43.976869] [DEBUG] [LOCAL ] HFRO: Loaded 16453 existing records from primary storage. [2025-10-27T19:09:43.977124] [INFO ] [MAIN ] HFRO: Loaded 16453 existing records. [2025-10-27T19:09:44.079321] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-27T19:09:44.164468] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:09:44.164692] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-27T19:09:44.164750] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-27T19:09:44.164917] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-27T19:09:44.164957] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-27T19:09:44.416554] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-27T19:09:44.566860] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:09:44.596543] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-27T19:09:44.853891] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-27T19:09:45.214926] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-27T19:09:46.014918] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-27T19:09:46.260566] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-27T19:09:46.383422] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T19:09:46.814941] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-27T19:09:47.045476] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-27T19:09:47.614977] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-27T19:09:47.948039] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-27T19:09:47.948946] [INFO ] [REMOTE ] HF: Full fetch complete (422 records). [2025-10-27T19:09:47.949018] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-27T19:09:48.134459] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 144 unique days, need 200 days [2025-10-27T19:09:48.134763] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:09:48.134843] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:09:48.134926] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-27T19:09:48.135010] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-27T19:09:48.135050] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-27T19:09:48.135092] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-27T19:09:48.135160] [INFO ] [MAIN ] Update Progress: 1008/2366 symbols completed. HF took 25.5s. Estimated remaining: 2h 54m 48s. Rate: 7.8 symbols/min [2025-10-27T19:09:48.315581] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:09:48.336512] [DEBUG] [LOCAL ] HGER: Loaded 15921 existing records from primary storage. [2025-10-27T19:09:48.336876] [INFO ] [MAIN ] HGER: Loaded 15921 existing records. [2025-10-27T19:09:48.420085] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-27T19:09:48.540075] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:09:48.540391] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-27T19:09:48.540451] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-27T19:09:48.540749] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-27T19:09:48.540808] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-27T19:09:48.935219] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:09:49.214959] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-27T19:09:49.634517] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-27T19:09:50.014968] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-27T19:09:50.118369] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T19:09:50.128077] [INFO ] [REMOTE ] HESM: Full fetch complete (70064 records). [2025-10-27T19:09:50.128218] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-27T19:09:50.513723] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-27T19:09:50.513805] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-27T19:09:50.514724] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-27T19:09:50.514786] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-27T19:09:50.516044] [DEBUG] [LOCAL ] HESM: Trimmed 70064 records to 48557 (keeping 200 days of data) [2025-10-27T19:09:50.800801] [DEBUG] [LOCAL ] HESM: Primary data saved (48557 records). [2025-10-27T19:09:50.800931] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-27T19:09:50.801007] [INFO ] [MAIN ] Update Progress: 1009/2366 symbols completed. HESM took 36.4s. Estimated remaining: 2h 54m 34s. Rate: 7.8 symbols/min [2025-10-27T19:09:50.822878] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-27T19:09:50.974869] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:09:50.986098] [DEBUG] [LOCAL ] HGLB: Loaded 9712 existing records from primary storage. [2025-10-27T19:09:50.986291] [INFO ] [MAIN ] HGLB: Loaded 9712 existing records. [2025-10-27T19:09:51.162214] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:09:51.162549] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-27T19:09:51.162694] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-27T19:09:51.168054] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-27T19:09:51.174973] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-27T19:09:51.251328] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T19:09:51.294241] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-27T19:09:51.546662] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:09:51.614944] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-27T19:09:52.396405] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-27T19:09:52.414898] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-27T19:09:53.214999] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-27T19:09:53.335963] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T19:09:53.875242] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-27T19:09:54.014995] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-27T19:09:54.296759] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-27T19:09:54.814965] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-27T19:09:55.614984] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-27T19:09:55.872954] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-27T19:09:55.899491] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-27T19:09:56.414935] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-27T19:09:56.841121] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-27T19:09:57.215010] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-27T19:09:58.014983] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-27T19:09:58.024262] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T19:09:58.599716] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T19:09:58.814966] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-27T19:09:59.544385] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T19:09:59.614939] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-27T19:10:00.414928] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-27T19:10:00.607487] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T19:10:01.214938] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-27T19:10:02.014916] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-27T19:10:02.059511] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T19:10:02.246331] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T19:10:02.540621] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T19:10:02.541867] [INFO ] [REMOTE ] HFND: Full fetch complete (1780 records). [2025-10-27T19:10:02.541961] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-27T19:10:02.721777] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-27T19:10:02.722010] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:10:02.722098] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:10:02.722182] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-27T19:10:02.722262] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-27T19:10:02.722313] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-27T19:10:02.722394] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-27T19:10:02.722485] [INFO ] [MAIN ] Update Progress: 1010/2366 symbols completed. HFND took 30.6s. Estimated remaining: 2h 54m 32s. Rate: 7.8 symbols/min [2025-10-27T19:10:02.821046] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-27T19:10:02.893512] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:10:02.908311] [DEBUG] [LOCAL ] HGTY: Loaded 13518 existing records from primary storage. [2025-10-27T19:10:02.908547] [INFO ] [MAIN ] HGTY: Loaded 13518 existing records. [2025-10-27T19:10:03.105585] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:10:03.105820] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-27T19:10:03.105869] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-27T19:10:03.106047] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-27T19:10:03.106103] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-27T19:10:03.449556] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:10:03.614901] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-27T19:10:04.190391] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T19:10:04.367692] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-27T19:10:04.414947] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-27T19:10:04.989285] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-27T19:10:05.214960] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-27T19:10:06.014928] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-27T19:10:06.156727] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-27T19:10:06.492615] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-27T19:10:06.814958] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-27T19:10:07.614948] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-27T19:10:07.928427] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-27T19:10:08.414977] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-27T19:10:08.425212] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-27T19:10:08.947215] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-27T19:10:09.214954] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-27T19:10:10.014911] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-27T19:10:10.085060] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T19:10:10.814937] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-27T19:10:10.848686] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-27T19:10:11.269167] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-27T19:10:11.614945] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-27T19:10:12.414970] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-27T19:10:12.639943] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-27T19:10:13.194804] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-27T19:10:13.214914] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-27T19:10:14.014918] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-27T19:10:14.109387] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-27T19:10:14.820000] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-27T19:10:14.821130] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T19:10:15.614919] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-27T19:10:15.873768] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-27T19:10:16.414932] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-27T19:10:16.541122] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-27T19:10:17.185739] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-27T19:10:17.214907] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-27T19:10:17.719409] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-27T19:10:18.014950] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-27T19:10:18.633123] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-27T19:10:18.635709] [INFO ] [REMOTE ] HGLB: Full fetch complete (14368 records). [2025-10-27T19:10:18.635781] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-27T19:10:18.816738] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-27T19:10:19.015624] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-27T19:10:19.015752] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-27T19:10:19.016219] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-27T19:10:19.016263] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-27T19:10:19.017048] [DEBUG] [LOCAL ] HGLB: Trimmed 14368 records to 9325 (keeping 200 days of data) [2025-10-27T19:10:19.076600] [DEBUG] [LOCAL ] HGLB: Primary data saved (9325 records). [2025-10-27T19:10:19.076845] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-27T19:10:19.076951] [INFO ] [MAIN ] Update Progress: 1011/2366 symbols completed. HGLB took 28.3s. Estimated remaining: 2h 54m 36s. Rate: 7.8 symbols/min [2025-10-27T19:10:19.253185] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:10:19.299905] [DEBUG] [LOCAL ] HGV: Loaded 46712 existing records from primary storage. [2025-10-27T19:10:19.300387] [INFO ] [MAIN ] HGV: Loaded 46712 existing records. [2025-10-27T19:10:19.485770] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:10:19.486038] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-27T19:10:19.486089] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-27T19:10:19.486318] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-27T19:10:19.486358] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-27T19:10:19.623839] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-27T19:10:19.861814] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:10:19.877437] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T19:10:20.414929] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-27T19:10:20.707455] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T19:10:21.214981] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-27T19:10:21.352515] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T19:10:22.014938] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-27T19:10:22.362186] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T19:10:22.692525] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-27T19:10:22.814965] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-27T19:10:23.615003] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-27T19:10:23.957823] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-27T19:10:24.407959] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T19:10:24.410961] [INFO ] [REMOTE ] HGTY: Full fetch complete (17637 records). [2025-10-27T19:10:24.411051] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-27T19:10:24.422197] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-27T19:10:24.773291] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-27T19:10:24.773364] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-27T19:10:24.773795] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-27T19:10:24.773855] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-27T19:10:24.774382] [DEBUG] [LOCAL ] HGTY: Trimmed 17637 records to 13404 (keeping 200 days of data) [2025-10-27T19:10:24.848775] [DEBUG] [LOCAL ] HGTY: Primary data saved (13404 records). [2025-10-27T19:10:24.848900] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-27T19:10:24.848978] [INFO ] [MAIN ] Update Progress: 1012/2366 symbols completed. HGTY took 22.1s. Estimated remaining: 2h 54m 25s. Rate: 7.8 symbols/min [2025-10-27T19:10:25.016995] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:10:25.052820] [DEBUG] [LOCAL ] HHH: Loaded 33416 existing records from primary storage. [2025-10-27T19:10:25.053138] [INFO ] [MAIN ] HHH: Loaded 33416 existing records. [2025-10-27T19:10:25.228944] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-27T19:10:25.234454] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:10:25.235395] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-27T19:10:25.235444] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-27T19:10:25.235607] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-27T19:10:25.235679] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-27T19:10:25.587432] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:10:25.903269] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T19:10:26.014919] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-27T19:10:26.527416] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-27T19:10:26.530133] [INFO ] [REMOTE ] HFRO: Full fetch complete (26319 records). [2025-10-27T19:10:26.530210] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-27T19:10:26.820065] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-27T19:10:26.905318] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-27T19:10:26.905405] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-27T19:10:26.905976] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-27T19:10:26.906040] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-27T19:10:26.906915] [DEBUG] [LOCAL ] HFRO: Trimmed 26319 records to 15780 (keeping 200 days of data) [2025-10-27T19:10:26.999930] [DEBUG] [LOCAL ] HFRO: Primary data saved (15780 records). [2025-10-27T19:10:27.000119] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-27T19:10:27.000264] [INFO ] [MAIN ] Update Progress: 1013/2366 symbols completed. HFRO took 43.2s. Estimated remaining: 2h 54m 10s. Rate: 7.8 symbols/min [2025-10-27T19:10:27.170871] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:10:27.205620] [DEBUG] [LOCAL ] HI: Loaded 36789 existing records from primary storage. [2025-10-27T19:10:27.205934] [INFO ] [MAIN ] HI: Loaded 36789 existing records. [2025-10-27T19:10:27.389110] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:10:27.389424] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-27T19:10:27.389583] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-27T19:10:27.389849] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-27T19:10:27.389924] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-27T19:10:27.581162] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T19:10:27.622097] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-27T19:10:27.781915] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:10:27.798286] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T19:10:28.414982] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-27T19:10:28.571386] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-27T19:10:28.576856] [INFO ] [REMOTE ] HGER: Full fetch complete (19434 records). [2025-10-27T19:10:28.576939] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-27T19:10:28.942292] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-27T19:10:28.942371] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-27T19:10:28.942922] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-27T19:10:28.942985] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-27T19:10:28.943593] [DEBUG] [LOCAL ] HGER: Trimmed 19434 records to 15806 (keeping 200 days of data) [2025-10-27T19:10:29.033319] [DEBUG] [LOCAL ] HGER: Primary data saved (15806 records). [2025-10-27T19:10:29.033446] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-27T19:10:29.033543] [INFO ] [MAIN ] Update Progress: 1014/2366 symbols completed. HGER took 40.9s. Estimated remaining: 2h 53m 55s. Rate: 7.8 symbols/min [2025-10-27T19:10:29.198452] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:10:29.215007] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-27T19:10:29.251543] [DEBUG] [LOCAL ] HIG: Loaded 51830 existing records from primary storage. [2025-10-27T19:10:29.251877] [INFO ] [MAIN ] HIG: Loaded 51830 existing records. [2025-10-27T19:10:29.428949] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:10:29.429323] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-27T19:10:29.429389] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-27T19:10:29.429780] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-27T19:10:29.429836] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-27T19:10:29.780258] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:10:29.796993] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T19:10:30.014942] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-27T19:10:30.657389] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-27T19:10:30.814915] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-27T19:10:31.408457] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-27T19:10:31.614910] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-27T19:10:32.159148] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T19:10:32.414913] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-27T19:10:33.005227] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T19:10:33.214933] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-27T19:10:33.351222] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T19:10:34.014984] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-27T19:10:34.689207] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T19:10:34.814914] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-27T19:10:35.140523] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-27T19:10:35.615008] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-27T19:10:36.423987] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-27T19:10:36.430567] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-27T19:10:36.842232] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-27T19:10:37.214933] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-27T19:10:37.598060] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T19:10:38.014947] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-27T19:10:38.820181] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-27T19:10:38.825414] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-27T19:10:39.614920] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-27T19:10:40.414933] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-27T19:10:40.896469] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T19:10:41.214914] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-27T19:10:41.824861] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T19:10:42.014979] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-27T19:10:42.232367] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (4.22 seconds). [2025-10-27T19:10:42.344500] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-27T19:10:42.814918] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-27T19:10:43.237468] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (4.42 seconds). [2025-10-27T19:10:43.553557] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-27T19:10:43.614949] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-27T19:10:44.328885] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T19:10:44.414899] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-27T19:10:45.036486] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T19:10:45.214944] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-27T19:10:45.938132] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T19:10:46.014926] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-27T19:10:46.802548] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T19:10:46.814907] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-27T19:10:47.615017] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-27T19:10:48.272788] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-27T19:10:48.414914] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-27T19:10:48.669509] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-27T19:10:48.939810] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-27T19:10:49.214949] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-27T19:10:49.536293] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-27T19:10:50.014921] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-27T19:10:50.814935] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-27T19:10:50.964214] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-27T19:10:51.613548] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T19:10:51.622509] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-27T19:10:52.219518] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T19:10:52.414965] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-27T19:10:52.942186] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T19:10:53.214936] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-27T19:10:53.928409] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T19:10:54.014964] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-27T19:10:54.714350] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T19:10:54.815004] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-27T19:10:55.456280] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T19:10:55.473008] [INFO ] [REMOTE ] HIG: Full fetch complete (73703 records). [2025-10-27T19:10:55.473397] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-27T19:10:55.620136] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-27T19:10:55.928775] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-27T19:10:55.928896] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-27T19:10:55.930532] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-27T19:10:55.930626] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-27T19:10:55.932504] [DEBUG] [LOCAL ] HIG: Trimmed 73703 records to 51028 (keeping 200 days of data) [2025-10-27T19:10:56.247480] [DEBUG] [LOCAL ] HIG: Primary data saved (51028 records). [2025-10-27T19:10:56.247705] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-27T19:10:56.248623] [INFO ] [MAIN ] Update Progress: 1015/2366 symbols completed. HIG took 27.2s. Estimated remaining: 2h 54m 13s. Rate: 7.8 symbols/min [2025-10-27T19:10:56.391322] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T19:10:56.416414] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-27T19:10:56.447451] [INFO ] [REMOTE ] HHH: Full fetch complete (46236 records). [2025-10-27T19:10:56.450201] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-27T19:10:56.449132] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:10:56.826875] [DEBUG] [LOCAL ] HII: Loaded 33817 existing records from primary storage. [2025-10-27T19:10:56.873031] [INFO ] [MAIN ] HII: Loaded 33817 existing records. [2025-10-27T19:10:56.992448] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-27T19:10:57.014636] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-27T19:10:57.026348] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-27T19:10:57.031764] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-27T19:10:57.099328] [DEBUG] [LOCAL ] HHH: Trimmed 46236 records to 32806 (keeping 200 days of data) [2025-10-27T19:10:57.099161] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:10:57.100408] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-27T19:10:57.100533] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-27T19:10:57.100898] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-27T19:10:57.101041] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-27T19:10:57.256342] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-27T19:10:57.338038] [INFO ] [REMOTE ] HI: Full fetch complete (51613 records). [2025-10-27T19:10:57.342325] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-27T19:10:57.794728] [DEBUG] [LOCAL ] HHH: Primary data saved (32806 records). [2025-10-27T19:10:57.806087] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-27T19:10:57.833952] [INFO ] [MAIN ] Update Progress: 1016/2366 symbols completed. HHH took 33.0s. Estimated remaining: 2h 53m 57s. Rate: 7.8 symbols/min [2025-10-27T19:10:58.061600] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:10:58.072524] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-27T19:10:58.270794] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-27T19:10:58.270956] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-27T19:10:58.288558] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-27T19:10:58.291465] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:10:58.288712] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-27T19:10:58.292965] [DEBUG] [LOCAL ] HI: Trimmed 51613 records to 36099 (keeping 200 days of data) [2025-10-27T19:10:58.402547] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-27T19:10:58.419772] [INFO ] [REMOTE ] HGV: Full fetch complete (65904 records). [2025-10-27T19:10:58.420047] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-27T19:10:58.791114] [DEBUG] [LOCAL ] HIMS: Loaded 54597 existing records from primary storage. [2025-10-27T19:10:58.816621] [INFO ] [MAIN ] HIMS: Loaded 54597 existing records. [2025-10-27T19:10:58.805082] [DEBUG] [LOCAL ] HI: Primary data saved (36099 records). [2025-10-27T19:10:58.860085] [INFO ] [MAIN ] HI: Full history saved. [2025-10-27T19:10:58.884025] [INFO ] [MAIN ] Update Progress: 1017/2366 symbols completed. HI took 31.9s. Estimated remaining: 2h 53m 40s. Rate: 7.8 symbols/min [2025-10-27T19:10:59.281251] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-27T19:10:59.281007] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:10:59.286814] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-27T19:10:59.287927] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-27T19:10:59.298467] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-27T19:10:59.318568] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-27T19:10:59.321355] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-27T19:10:59.324488] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-27T19:10:59.343087] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-27T19:10:59.346776] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:10:59.434360] [DEBUG] [LOCAL ] HGV: Trimmed 65904 records to 45936 (keeping 200 days of data) [2025-10-27T19:10:59.624385] [DEBUG] [LOCAL ] HIO: Loaded 24328 existing records from primary storage. [2025-10-27T19:10:59.716570] [INFO ] [MAIN ] HIO: Loaded 24328 existing records. [2025-10-27T19:11:00.191241] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:11:00.193032] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-27T19:11:00.194161] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-27T19:11:00.230699] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:11:00.227497] [DEBUG] [LOCAL ] HGV: Primary data saved (45936 records). [2025-10-27T19:11:00.232918] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-27T19:11:00.232850] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-27T19:11:00.232989] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-27T19:11:00.233130] [INFO ] [MAIN ] Update Progress: 1018/2366 symbols completed. HGV took 41.2s. Estimated remaining: 2h 53m 24s. Rate: 7.8 symbols/min [2025-10-27T19:11:00.231836] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-27T19:11:00.244925] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-27T19:11:00.263531] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-27T19:11:00.654441] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:11:00.795308] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:11:00.802270] [DEBUG] [LOCAL ] HIPO: Loaded 21635 existing records from primary storage. [2025-10-27T19:11:00.801932] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-27T19:11:00.803215] [INFO ] [MAIN ] HIPO: Loaded 21635 existing records. [2025-10-27T19:11:00.979857] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:11:00.980119] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-27T19:11:00.980172] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-27T19:11:00.980339] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-27T19:11:00.980425] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-27T19:11:01.329710] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:11:01.329997] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-27T19:11:02.349270] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T19:11:02.358536] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-27T19:11:02.532350] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T19:11:02.536876] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-27T19:11:02.617081] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-27T19:11:02.814972] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-27T19:11:02.924566] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-10-27T19:11:03.185387] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T19:11:03.623610] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-27T19:11:03.625820] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T19:11:04.414928] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-27T19:11:04.509680] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-27T19:11:04.614953] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T19:11:05.214931] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-27T19:11:05.919717] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T19:11:06.015002] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-27T19:11:06.814950] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-27T19:11:06.964108] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-27T19:11:07.614926] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-27T19:11:07.866231] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-27T19:11:08.074521] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-27T19:11:08.414980] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-27T19:11:08.768512] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T19:11:09.214991] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-27T19:11:09.436446] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-27T19:11:09.928444] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T19:11:10.014984] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-27T19:11:10.814949] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-27T19:11:11.096440] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T19:11:11.614991] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-27T19:11:11.641068] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-27T19:11:12.415002] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-27T19:11:13.214939] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-27T19:11:13.972294] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T19:11:14.014954] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-27T19:11:14.369781] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-27T19:11:14.436795] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.82 seconds). [2025-10-27T19:11:14.814981] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-27T19:11:15.428059] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T19:11:15.614942] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-27T19:11:15.761781] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T19:11:16.414949] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-27T19:11:16.697941] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-27T19:11:17.150884] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-27T19:11:17.215026] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-27T19:11:18.014957] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-27T19:11:18.239747] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-27T19:11:18.814947] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-27T19:11:19.205621] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T19:11:19.614906] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-27T19:11:20.060320] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T19:11:20.414933] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-27T19:11:21.214987] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-27T19:11:21.257285] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-27T19:11:21.264314] [INFO ] [REMOTE ] HII: Full fetch complete (52274 records). [2025-10-27T19:11:21.264508] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-27T19:11:21.367077] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T19:11:21.689081] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-27T19:11:21.689165] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-27T19:11:21.689973] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-27T19:11:21.690035] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-27T19:11:21.691095] [DEBUG] [LOCAL ] HII: Trimmed 52274 records to 33058 (keeping 200 days of data) [2025-10-27T19:11:21.893673] [DEBUG] [LOCAL ] HII: Primary data saved (33058 records). [2025-10-27T19:11:21.893814] [INFO ] [MAIN ] HII: Full history saved. [2025-10-27T19:11:21.894423] [INFO ] [MAIN ] Update Progress: 1019/2366 symbols completed. HII took 25.6s. Estimated remaining: 2h 53m 35s. Rate: 7.8 symbols/min [2025-10-27T19:11:22.020156] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-27T19:11:22.067153] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:11:22.111083] [DEBUG] [LOCAL ] HIW: Loaded 45049 existing records from primary storage. [2025-10-27T19:11:22.111423] [INFO ] [MAIN ] HIW: Loaded 45049 existing records. [2025-10-27T19:11:22.285873] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:11:22.286141] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-27T19:11:22.286194] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-27T19:11:22.286402] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-27T19:11:22.286457] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-27T19:11:22.629341] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:11:22.814918] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-27T19:11:23.158612] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T19:11:23.162453] [INFO ] [REMOTE ] HIPO: Full fetch complete (30946 records). [2025-10-27T19:11:23.162568] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-27T19:11:23.576560] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-27T19:11:23.576799] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-27T19:11:23.577552] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-27T19:11:23.577759] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-27T19:11:23.578593] [DEBUG] [LOCAL ] HIPO: Trimmed 30946 records to 21121 (keeping 200 days of data) [2025-10-27T19:11:23.627954] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-27T19:11:23.712249] [DEBUG] [LOCAL ] HIPO: Primary data saved (21121 records). [2025-10-27T19:11:23.712482] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-27T19:11:23.712673] [INFO ] [MAIN ] Update Progress: 1020/2366 symbols completed. HIPO took 23.5s. Estimated remaining: 2h 53m 19s. Rate: 7.8 symbols/min [2025-10-27T19:11:23.860138] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-27T19:11:23.934211] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:11:23.954215] [DEBUG] [LOCAL ] HIX: Loaded 20759 existing records from primary storage. [2025-10-27T19:11:23.954457] [INFO ] [MAIN ] HIX: Loaded 20759 existing records. [2025-10-27T19:11:24.125836] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:11:24.125997] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-27T19:11:24.126041] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-27T19:11:24.126226] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-27T19:11:24.126281] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-27T19:11:24.417877] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-27T19:11:24.502327] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:11:24.526891] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T19:11:24.885177] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T19:11:25.214933] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-27T19:11:26.014966] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-27T19:11:26.340477] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T19:11:26.794205] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-27T19:11:26.814921] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-27T19:11:27.112620] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T19:11:27.615006] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-27T19:11:28.414943] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-27T19:11:28.638137] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T19:11:28.644719] [INFO ] [REMOTE ] HIO: Full fetch complete (38270 records). [2025-10-27T19:11:28.644803] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-27T19:11:29.020208] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-27T19:11:29.020370] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-27T19:11:29.021203] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-27T19:11:29.021287] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-27T19:11:29.022526] [DEBUG] [LOCAL ] HIO: Trimmed 38270 records to 23581 (keeping 200 days of data) [2025-10-27T19:11:29.186981] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-27T19:11:29.198321] [DEBUG] [LOCAL ] HIO: Primary data saved (23581 records). [2025-10-27T19:11:29.208932] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-27T19:11:29.209051] [INFO ] [MAIN ] Update Progress: 1021/2366 symbols completed. HIO took 30.2s. Estimated remaining: 2h 53m 9s. Rate: 7.8 symbols/min [2025-10-27T19:11:29.221714] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-27T19:11:29.401771] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:11:29.421757] [DEBUG] [LOCAL ] HKD: Loaded 18983 existing records from primary storage. [2025-10-27T19:11:29.422188] [INFO ] [MAIN ] HKD: Loaded 18983 existing records. [2025-10-27T19:11:29.556705] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T19:11:29.650022] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:11:29.650305] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-27T19:11:29.650368] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-27T19:11:29.650536] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-27T19:11:29.650575] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-27T19:11:30.011318] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:11:30.014899] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-27T19:11:30.815000] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-27T19:11:30.842272] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-27T19:11:31.015199] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-27T19:11:31.614922] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-27T19:11:31.917453] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T19:11:32.414966] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-27T19:11:32.967597] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T19:11:33.214925] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-27T19:11:33.630166] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-27T19:11:34.014936] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-27T19:11:34.814995] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-27T19:11:35.614976] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-27T19:11:35.675933] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-27T19:11:36.020598] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T19:11:36.168584] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-10-27T19:11:36.414911] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-27T19:11:36.446539] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-27T19:11:37.151011] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-27T19:11:37.214918] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-27T19:11:38.014968] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-27T19:11:38.815009] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-27T19:11:39.451865] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T19:11:39.614988] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-27T19:11:39.800593] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T19:11:39.909553] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-10-27T19:11:40.359858] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-27T19:11:40.414896] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-27T19:11:41.214963] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-27T19:11:41.412508] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-27T19:11:41.867869] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T19:11:42.015012] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-27T19:11:42.815004] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-27T19:11:43.127141] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T19:11:43.614998] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-27T19:11:44.415000] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-27T19:11:44.623901] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-27T19:11:45.124671] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T19:11:45.214969] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-27T19:11:45.602014] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-10-27T19:11:46.014985] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-27T19:11:46.066517] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T19:11:46.815014] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-27T19:11:47.580752] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T19:11:47.584971] [INFO ] [REMOTE ] HIX: Full fetch complete (30106 records). [2025-10-27T19:11:47.585047] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-27T19:11:47.620041] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-27T19:11:47.964747] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-27T19:11:47.964827] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-27T19:11:47.965473] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-27T19:11:47.965514] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-27T19:11:47.966283] [DEBUG] [LOCAL ] HIX: Trimmed 30106 records to 20160 (keeping 200 days of data) [2025-10-27T19:11:48.088067] [DEBUG] [LOCAL ] HIX: Primary data saved (20160 records). [2025-10-27T19:11:48.088204] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-27T19:11:48.088314] [INFO ] [MAIN ] Update Progress: 1022/2366 symbols completed. HIX took 24.4s. Estimated remaining: 2h 53m 16s. Rate: 7.8 symbols/min [2025-10-27T19:11:48.283884] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:11:48.332225] [DEBUG] [LOCAL ] HL: Loaded 54456 existing records from primary storage. [2025-10-27T19:11:48.332543] [INFO ] [MAIN ] HL: Loaded 54456 existing records. [2025-10-27T19:11:48.421200] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-27T19:11:48.509667] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:11:48.509863] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-27T19:11:48.509909] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-27T19:11:48.510128] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-27T19:11:48.510183] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-27T19:11:48.869859] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:11:48.964768] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.95 seconds). [2025-10-27T19:11:48.975349] [INFO ] [REMOTE ] HIMS: Full fetch complete (77996 records). [2025-10-27T19:11:48.975516] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-27T19:11:49.220676] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-27T19:11:49.363018] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T19:11:49.420765] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-27T19:11:49.421026] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-27T19:11:49.422117] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-27T19:11:49.422209] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-27T19:11:49.424075] [DEBUG] [LOCAL ] HIMS: Trimmed 77996 records to 53817 (keeping 200 days of data) [2025-10-27T19:11:49.522682] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-27T19:11:49.753439] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-10-27T19:11:49.753559] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-27T19:11:49.753639] [INFO ] [MAIN ] Update Progress: 1023/2366 symbols completed. HIMS took 51.9s. Estimated remaining: 2h 53m 0s. Rate: 7.8 symbols/min [2025-10-27T19:11:49.923407] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:11:49.965363] [DEBUG] [LOCAL ] HLF: Loaded 49053 existing records from primary storage. [2025-10-27T19:11:49.965693] [INFO ] [MAIN ] HLF: Loaded 49053 existing records. [2025-10-27T19:11:50.025333] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-27T19:11:50.157907] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:11:50.158105] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-27T19:11:50.158152] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-27T19:11:50.158325] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-27T19:11:50.158364] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-27T19:11:50.524220] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:11:50.814968] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-27T19:11:50.982355] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-27T19:11:51.620086] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-27T19:11:51.644214] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-27T19:11:51.742039] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-27T19:11:52.414949] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-27T19:11:52.982617] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T19:11:53.214983] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-27T19:11:54.014940] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-27T19:11:54.095805] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T19:11:54.710034] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T19:11:54.814949] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-27T19:11:55.512760] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T19:11:55.614946] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-27T19:11:56.358489] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-27T19:11:56.414923] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-27T19:11:57.214928] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-27T19:11:57.303574] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-27T19:11:57.312623] [INFO ] [REMOTE ] HIW: Full fetch complete (64914 records). [2025-10-27T19:11:57.312906] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-27T19:11:57.700909] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-27T19:11:57.700984] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-27T19:11:57.701843] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-27T19:11:57.701905] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-27T19:11:57.703197] [DEBUG] [LOCAL ] HIW: Trimmed 64914 records to 44271 (keeping 200 days of data) [2025-10-27T19:11:57.964556] [DEBUG] [LOCAL ] HIW: Primary data saved (44271 records). [2025-10-27T19:11:57.964703] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-27T19:11:57.965351] [INFO ] [MAIN ] Update Progress: 1024/2366 symbols completed. HIW took 36.1s. Estimated remaining: 2h 52m 53s. Rate: 7.8 symbols/min [2025-10-27T19:11:58.022978] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-27T19:11:58.144951] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:11:58.176015] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-27T19:11:58.212431] [DEBUG] [LOCAL ] HLI: Loaded 31042 existing records from primary storage. [2025-10-27T19:11:58.212722] [INFO ] [MAIN ] HLI: Loaded 31042 existing records. [2025-10-27T19:11:58.400780] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:11:58.400991] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-27T19:11:58.401043] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-27T19:11:58.401224] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-27T19:11:58.401282] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-27T19:11:58.515715] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-27T19:11:58.558982] [INFO ] [REMOTE ] HKD: Full fetch complete (27778 records). [2025-10-27T19:11:58.576519] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-27T19:11:58.819280] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-27T19:11:59.033482] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:11:59.173925] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-27T19:11:59.173998] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-27T19:11:59.174513] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-27T19:11:59.174552] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-27T19:11:59.175261] [DEBUG] [LOCAL ] HKD: Trimmed 27778 records to 18741 (keeping 200 days of data) [2025-10-27T19:11:59.277812] [DEBUG] [LOCAL ] HKD: Primary data saved (18741 records). [2025-10-27T19:11:59.277947] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-27T19:11:59.278023] [INFO ] [MAIN ] Update Progress: 1025/2366 symbols completed. HKD took 30.1s. Estimated remaining: 2h 52m 37s. Rate: 7.8 symbols/min [2025-10-27T19:11:59.449268] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:11:59.481452] [DEBUG] [LOCAL ] HLIO: Loaded 28394 existing records from primary storage. [2025-10-27T19:11:59.481739] [INFO ] [MAIN ] HLIO: Loaded 28394 existing records. [2025-10-27T19:11:59.624781] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-27T19:11:59.666713] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:11:59.666882] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-27T19:11:59.666947] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-27T19:11:59.667167] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-27T19:11:59.667226] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-27T19:12:00.043854] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:12:00.149363] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-27T19:12:00.188423] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T19:12:00.414952] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-27T19:12:01.214911] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-27T19:12:01.565114] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-27T19:12:01.981264] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T19:12:02.015007] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-27T19:12:02.660910] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T19:12:02.814910] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-27T19:12:03.103834] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-27T19:12:03.544111] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T19:12:03.614916] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-27T19:12:04.414935] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-27T19:12:05.214919] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-27T19:12:05.298389] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-27T19:12:06.014969] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-27T19:12:06.129638] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-27T19:12:06.202387] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-27T19:12:06.814960] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-27T19:12:07.615018] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-27T19:12:07.751380] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T19:12:07.879427] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-27T19:12:08.414985] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-27T19:12:08.964239] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T19:12:09.214958] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-27T19:12:10.014946] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-27T19:12:10.133488] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-27T19:12:10.645277] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T19:12:10.814914] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-27T19:12:11.614996] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-27T19:12:11.858541] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T19:12:11.950148] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T19:12:12.415002] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-27T19:12:12.590824] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T19:12:13.214960] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-27T19:12:14.014913] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-27T19:12:14.424246] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-27T19:12:14.798874] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T19:12:14.814905] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-27T19:12:15.614988] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-27T19:12:15.783863] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-27T19:12:15.903571] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-27T19:12:16.414953] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-27T19:12:17.214961] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-27T19:12:17.403913] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-27T19:12:17.698604] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-27T19:12:18.014954] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-27T19:12:18.814984] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-27T19:12:19.400117] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-27T19:12:19.426880] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-27T19:12:19.465276] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-27T19:12:19.614943] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-27T19:12:20.414955] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-27T19:12:20.879406] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-27T19:12:20.884635] [INFO ] [REMOTE ] HLIO: Full fetch complete (37256 records). [2025-10-27T19:12:20.884799] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-27T19:12:21.225051] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-27T19:12:21.256465] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-27T19:12:21.256534] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-27T19:12:21.257223] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-27T19:12:21.257485] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-27T19:12:21.258346] [DEBUG] [LOCAL ] HLIO: Trimmed 37256 records to 27820 (keeping 200 days of data) [2025-10-27T19:12:21.421894] [DEBUG] [LOCAL ] HLIO: Primary data saved (27820 records). [2025-10-27T19:12:21.422026] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-27T19:12:21.422103] [INFO ] [MAIN ] Update Progress: 1026/2366 symbols completed. HLIO took 22.1s. Estimated remaining: 2h 52m 48s. Rate: 7.8 symbols/min [2025-10-27T19:12:21.589695] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:12:21.620709] [DEBUG] [LOCAL ] HLLY: Loaded 33731 existing records from primary storage. [2025-10-27T19:12:21.620968] [INFO ] [MAIN ] HLLY: Loaded 33731 existing records. [2025-10-27T19:12:21.798947] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:12:21.799143] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-27T19:12:21.799189] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-27T19:12:21.799588] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-27T19:12:21.799674] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-27T19:12:22.035188] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-27T19:12:22.148961] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:12:22.814969] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-27T19:12:22.894067] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-27T19:12:22.933137] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-27T19:12:22.943590] [INFO ] [REMOTE ] HL: Full fetch complete (77827 records). [2025-10-27T19:12:22.943737] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-27T19:12:23.343812] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-27T19:12:23.343890] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-27T19:12:23.344874] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-27T19:12:23.344936] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-27T19:12:23.346435] [DEBUG] [LOCAL ] HL: Trimmed 77827 records to 53676 (keeping 200 days of data) [2025-10-27T19:12:23.634228] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-27T19:12:23.635069] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T19:12:23.696529] [DEBUG] [LOCAL ] HL: Primary data saved (53676 records). [2025-10-27T19:12:23.697191] [INFO ] [MAIN ] HL: Full history saved. [2025-10-27T19:12:23.697345] [INFO ] [MAIN ] Update Progress: 1027/2366 symbols completed. HL took 35.6s. Estimated remaining: 2h 52m 33s. Rate: 7.8 symbols/min [2025-10-27T19:12:23.833621] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T19:12:23.892984] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:12:23.943147] [DEBUG] [LOCAL ] HLN: Loaded 53891 existing records from primary storage. [2025-10-27T19:12:23.943510] [INFO ] [MAIN ] HLN: Loaded 53891 existing records. [2025-10-27T19:12:24.128238] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:12:24.128491] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-27T19:12:24.128553] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-27T19:12:24.128792] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-27T19:12:24.128872] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-27T19:12:24.423076] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-27T19:12:24.516504] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:12:25.214976] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-27T19:12:25.361829] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T19:12:25.370861] [INFO ] [REMOTE ] HLF: Full fetch complete (70700 records). [2025-10-27T19:12:25.370977] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-27T19:12:25.771221] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-27T19:12:25.777222] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-27T19:12:25.779249] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T19:12:25.778698] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-27T19:12:25.785628] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-27T19:12:25.786926] [DEBUG] [LOCAL ] HLF: Trimmed 70700 records to 48241 (keeping 200 days of data) [2025-10-27T19:12:26.008218] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T19:12:26.015002] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-27T19:12:26.077552] [DEBUG] [LOCAL ] HLF: Primary data saved (48241 records). [2025-10-27T19:12:26.077694] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-27T19:12:26.077782] [INFO ] [MAIN ] Update Progress: 1028/2366 symbols completed. HLF took 36.3s. Estimated remaining: 2h 52m 18s. Rate: 7.8 symbols/min [2025-10-27T19:12:26.241486] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:12:26.287982] [DEBUG] [LOCAL ] HLT: Loaded 51202 existing records from primary storage. [2025-10-27T19:12:26.288294] [INFO ] [MAIN ] HLT: Loaded 51202 existing records. [2025-10-27T19:12:26.460538] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:12:26.460753] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-27T19:12:26.460824] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-27T19:12:26.461056] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-27T19:12:26.461113] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-27T19:12:26.810039] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:12:26.814906] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-27T19:12:26.931051] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T19:12:27.614939] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-27T19:12:28.414974] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-27T19:12:28.488380] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T19:12:29.105834] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T19:12:29.214937] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-27T19:12:29.840514] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T19:12:30.014946] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-27T19:12:30.296805] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-27T19:12:30.814983] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-27T19:12:31.373123] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T19:12:31.614914] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-27T19:12:32.258850] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T19:12:32.265039] [INFO ] [REMOTE ] HLI: Full fetch complete (45430 records). [2025-10-27T19:12:32.265135] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-27T19:12:32.417121] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-27T19:12:32.645476] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-27T19:12:32.645549] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-27T19:12:32.646245] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-27T19:12:32.646309] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-27T19:12:32.647249] [DEBUG] [LOCAL ] HLI: Trimmed 45430 records to 30327 (keeping 200 days of data) [2025-10-27T19:12:32.833977] [DEBUG] [LOCAL ] HLI: Primary data saved (30327 records). [2025-10-27T19:12:32.834099] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-27T19:12:32.835283] [INFO ] [MAIN ] Update Progress: 1029/2366 symbols completed. HLI took 34.9s. Estimated remaining: 2h 52m 9s. Rate: 7.8 symbols/min [2025-10-27T19:12:33.007899] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:12:33.052216] [DEBUG] [LOCAL ] HLX: Loaded 48034 existing records from primary storage. [2025-10-27T19:12:33.052495] [INFO ] [MAIN ] HLX: Loaded 48034 existing records. [2025-10-27T19:12:33.218459] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-27T19:12:33.240240] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:12:33.241361] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-27T19:12:33.241509] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-27T19:12:33.241797] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-27T19:12:33.241859] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-27T19:12:33.459883] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T19:12:33.637275] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:12:33.691728] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T19:12:34.014956] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-27T19:12:34.658168] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T19:12:34.814888] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-27T19:12:34.918470] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-27T19:12:35.614982] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-27T19:12:36.374703] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-27T19:12:36.414999] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-27T19:12:37.065914] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T19:12:37.214942] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-27T19:12:37.841872] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T19:12:38.014919] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-27T19:12:38.703077] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T19:12:38.814951] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-27T19:12:39.614936] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-27T19:12:39.671414] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T19:12:39.943038] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T19:12:40.414983] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-27T19:12:41.214944] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-27T19:12:41.424366] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-27T19:12:41.975058] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T19:12:42.014906] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-27T19:12:42.441637] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-27T19:12:42.814945] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-27T19:12:43.614930] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-27T19:12:43.852720] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-27T19:12:43.937398] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-27T19:12:44.414938] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-27T19:12:44.749217] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T19:12:45.214930] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-27T19:12:45.773852] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-27T19:12:46.014936] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-27T19:12:46.814921] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-27T19:12:47.085877] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-27T19:12:47.319804] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-27T19:12:47.325967] [INFO ] [REMOTE ] HLLY: Full fetch complete (46061 records). [2025-10-27T19:12:47.326059] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-27T19:12:47.620108] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-27T19:12:47.697367] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-27T19:12:47.697442] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-27T19:12:47.698177] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-27T19:12:47.698239] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-27T19:12:47.699210] [DEBUG] [LOCAL ] HLLY: Trimmed 46061 records to 33098 (keeping 200 days of data) [2025-10-27T19:12:47.885143] [DEBUG] [LOCAL ] HLLY: Primary data saved (33098 records). [2025-10-27T19:12:47.885274] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-27T19:12:47.885672] [INFO ] [MAIN ] Update Progress: 1030/2366 symbols completed. HLLY took 26.5s. Estimated remaining: 2h 52m 11s. Rate: 7.8 symbols/min [2025-10-27T19:12:48.053847] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:12:48.100223] [DEBUG] [LOCAL ] HMC: Loaded 46860 existing records from primary storage. [2025-10-27T19:12:48.100521] [INFO ] [MAIN ] HMC: Loaded 46860 existing records. [2025-10-27T19:12:48.276231] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:12:48.276529] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-27T19:12:48.276604] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-27T19:12:48.277057] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-27T19:12:48.277181] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-27T19:12:48.419601] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-27T19:12:48.592174] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T19:12:48.703371] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:12:49.214955] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-27T19:12:49.331350] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-27T19:12:50.014913] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-27T19:12:50.141155] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-27T19:12:50.814947] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-27T19:12:50.981510] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-27T19:12:51.614977] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-27T19:12:51.818756] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-27T19:12:52.414991] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-27T19:12:52.641635] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-27T19:12:53.215007] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-27T19:12:53.358392] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-27T19:12:53.921869] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-27T19:12:53.932442] [INFO ] [REMOTE ] HLN: Full fetch complete (77034 records). [2025-10-27T19:12:53.932626] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-27T19:12:54.020109] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-27T19:12:54.365712] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-27T19:12:54.365896] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-27T19:12:54.366940] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-27T19:12:54.367052] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-27T19:12:54.368774] [DEBUG] [LOCAL ] HLN: Trimmed 77034 records to 53110 (keeping 200 days of data) [2025-10-27T19:12:54.497030] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T19:12:54.725838] [DEBUG] [LOCAL ] HLN: Primary data saved (53110 records). [2025-10-27T19:12:54.725979] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-27T19:12:54.726058] [INFO ] [MAIN ] Update Progress: 1031/2366 symbols completed. HLN took 31.0s. Estimated remaining: 2h 52m 2s. Rate: 7.8 symbols/min [2025-10-27T19:12:54.824240] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-27T19:12:54.898500] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:12:54.920121] [DEBUG] [LOCAL ] HMN: Loaded 23520 existing records from primary storage. [2025-10-27T19:12:54.920363] [INFO ] [MAIN ] HMN: Loaded 23520 existing records. [2025-10-27T19:12:55.092916] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:12:55.093110] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-27T19:12:55.093156] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-27T19:12:55.093387] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-27T19:12:55.093444] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-27T19:12:55.444363] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:12:55.614950] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-27T19:12:55.837874] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-27T19:12:56.255127] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T19:12:56.414918] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-27T19:12:56.641914] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-27T19:12:57.214985] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-27T19:12:57.897583] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-27T19:12:58.014950] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-27T19:12:58.343969] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T19:12:58.815010] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-27T19:12:59.481208] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-27T19:12:59.614939] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-27T19:12:59.701402] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-27T19:13:00.414978] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-27T19:13:01.214951] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-27T19:13:01.378338] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-27T19:13:02.014992] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-27T19:13:02.201122] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-27T19:13:02.646933] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T19:13:02.814936] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-27T19:13:03.334552] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T19:13:03.343249] [INFO ] [REMOTE ] HLX: Full fetch complete (69008 records). [2025-10-27T19:13:03.343380] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-27T19:13:03.620111] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-27T19:13:03.727667] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-27T19:13:03.727772] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-27T19:13:03.728721] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-27T19:13:03.728785] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-27T19:13:03.730221] [DEBUG] [LOCAL ] HLX: Trimmed 69008 records to 47244 (keeping 200 days of data) [2025-10-27T19:13:03.996053] [DEBUG] [LOCAL ] HLX: Primary data saved (47244 records). [2025-10-27T19:13:03.996178] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-27T19:13:03.996989] [INFO ] [MAIN ] Update Progress: 1032/2366 symbols completed. HLX took 31.2s. Estimated remaining: 2h 51m 57s. Rate: 7.8 symbols/min [2025-10-27T19:13:04.180437] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:13:04.233364] [DEBUG] [LOCAL ] HMY: Loaded 53946 existing records from primary storage. [2025-10-27T19:13:04.233702] [INFO ] [MAIN ] HMY: Loaded 53946 existing records. [2025-10-27T19:13:04.408896] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:13:04.409095] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-27T19:13:04.409141] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-27T19:13:04.409322] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-27T19:13:04.409360] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-27T19:13:04.429769] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-27T19:13:04.766142] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:13:04.863946] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-27T19:13:04.875412] [INFO ] [REMOTE ] HLT: Full fetch complete (73667 records). [2025-10-27T19:13:04.875589] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-27T19:13:05.092389] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T19:13:05.220202] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-27T19:13:05.350225] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-27T19:13:05.350312] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-27T19:13:05.351334] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-27T19:13:05.351401] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-27T19:13:05.352904] [DEBUG] [LOCAL ] HLT: Trimmed 73667 records to 50413 (keeping 200 days of data) [2025-10-27T19:13:05.672059] [DEBUG] [LOCAL ] HLT: Primary data saved (50413 records). [2025-10-27T19:13:05.672185] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-27T19:13:05.672923] [INFO ] [MAIN ] Update Progress: 1033/2366 symbols completed. HLT took 39.6s. Estimated remaining: 2h 51m 41s. Rate: 7.8 symbols/min [2025-10-27T19:13:05.892429] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:13:05.895688] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-27T19:13:05.896559] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T19:13:05.896735] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-27T19:13:05.906292] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-27T19:13:05.906459] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-27T19:13:05.906528] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-27T19:13:05.906570] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-27T19:13:06.018888] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-27T19:13:06.253973] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T19:13:06.293725] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:13:06.814951] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-27T19:13:07.536502] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T19:13:07.614899] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-27T19:13:07.985586] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-27T19:13:08.414919] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-27T19:13:08.970490] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-27T19:13:09.214918] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-10-27T19:13:09.416849] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T19:13:09.417845] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-27T19:13:09.422299] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-10-27T19:13:09.422829] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:13:09.423227] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-27T19:13:09.423299] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:13:09.423372] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-27T19:13:09.423474] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-27T19:13:09.423518] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-27T19:13:09.423559] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-27T19:13:09.423602] [INFO ] [MAIN ] Update Progress: 1034/2366 symbols completed. HNGE took 3.8s. Estimated remaining: 2h 51m 28s. Rate: 7.8 symbols/min [2025-10-27T19:13:09.594458] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:13:09.632452] [DEBUG] [LOCAL ] HNI: Loaded 30187 existing records from primary storage. [2025-10-27T19:13:09.632802] [INFO ] [MAIN ] HNI: Loaded 30187 existing records. [2025-10-27T19:13:09.807183] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:13:09.807360] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-27T19:13:09.807405] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-27T19:13:09.807585] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-27T19:13:09.807622] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-27T19:13:10.020175] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-27T19:13:10.153870] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:13:10.814995] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-27T19:13:11.614949] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-27T19:13:11.809261] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-27T19:13:12.005849] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T19:13:12.415021] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-27T19:13:12.499442] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-27T19:13:13.214955] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-27T19:13:14.014919] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-27T19:13:14.133366] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T19:13:14.685117] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T19:13:14.814908] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-27T19:13:15.147972] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T19:13:15.151810] [INFO ] [REMOTE ] HMN: Full fetch complete (31655 records). [2025-10-27T19:13:15.151884] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-27T19:13:15.521587] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-27T19:13:15.521716] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-27T19:13:15.522340] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-27T19:13:15.522402] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-27T19:13:15.523144] [DEBUG] [LOCAL ] HMN: Trimmed 31655 records to 22910 (keeping 200 days of data) [2025-10-27T19:13:15.616002] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-27T19:13:15.660231] [DEBUG] [LOCAL ] HMN: Primary data saved (22910 records). [2025-10-27T19:13:15.660334] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-27T19:13:15.660409] [INFO ] [MAIN ] Update Progress: 1035/2366 symbols completed. HMN took 20.9s. Estimated remaining: 2h 51m 19s. Rate: 7.8 symbols/min [2025-10-27T19:13:15.836372] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:13:15.882258] [DEBUG] [LOCAL ] HOG: Loaded 51314 existing records from primary storage. [2025-10-27T19:13:15.882550] [INFO ] [MAIN ] HOG: Loaded 51314 existing records. [2025-10-27T19:13:16.060086] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:13:16.060289] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-27T19:13:16.060340] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-27T19:13:16.060538] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-27T19:13:16.060594] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-27T19:13:16.420108] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:13:16.415104] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-27T19:13:16.514456] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-27T19:13:16.814256] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-27T19:13:17.214933] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-27T19:13:18.026094] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-27T19:13:18.032183] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T19:13:18.595243] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T19:13:18.814948] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-27T19:13:19.238617] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T19:13:19.614951] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-27T19:13:20.414976] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-27T19:13:20.885006] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-27T19:13:20.893744] [INFO ] [REMOTE ] HMC: Full fetch complete (68437 records). [2025-10-27T19:13:20.893863] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-27T19:13:21.147489] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T19:13:21.220165] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-27T19:13:21.319545] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-27T19:13:21.319628] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-27T19:13:21.320567] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-27T19:13:21.320617] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-27T19:13:21.322000] [DEBUG] [LOCAL ] HMC: Trimmed 68437 records to 46041 (keeping 200 days of data) [2025-10-27T19:13:21.584154] [DEBUG] [LOCAL ] HMC: Primary data saved (46041 records). [2025-10-27T19:13:21.584279] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-27T19:13:21.584591] [INFO ] [MAIN ] Update Progress: 1036/2366 symbols completed. HMC took 33.7s. Estimated remaining: 2h 51m 8s. Rate: 7.8 symbols/min [2025-10-27T19:13:21.751424] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:13:21.791812] [DEBUG] [LOCAL ] HOMB: Loaded 44356 existing records from primary storage. [2025-10-27T19:13:21.792124] [INFO ] [MAIN ] HOMB: Loaded 44356 existing records. [2025-10-27T19:13:21.971271] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:13:21.971595] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-27T19:13:21.971694] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-27T19:13:21.971952] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-27T19:13:21.972053] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-27T19:13:22.025684] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-27T19:13:22.306675] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-27T19:13:22.375622] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:13:22.390470] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T19:13:22.815001] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-27T19:13:23.614949] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-27T19:13:24.292777] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-27T19:13:24.366930] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T19:13:24.414944] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-27T19:13:24.957862] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T19:13:25.214939] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-27T19:13:25.885259] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T19:13:26.014905] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-27T19:13:26.720183] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T19:13:26.814919] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-27T19:13:27.615029] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-27T19:13:27.665120] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-27T19:13:28.150309] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T19:13:28.414996] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-27T19:13:29.214995] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-27T19:13:29.351624] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T19:13:29.650834] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-27T19:13:29.964360] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-27T19:13:30.014910] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-27T19:13:30.821548] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-27T19:13:30.822958] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T19:13:31.614935] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-27T19:13:32.414975] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-27T19:13:32.683894] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-27T19:13:33.143357] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T19:13:33.214938] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-27T19:13:34.014973] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-27T19:13:34.134315] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T19:13:34.732553] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T19:13:34.814905] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-27T19:13:35.495005] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T19:13:35.614914] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-27T19:13:36.206404] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-27T19:13:36.414950] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-27T19:13:37.215004] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-27T19:13:37.755147] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-27T19:13:37.928162] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T19:13:38.014897] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-27T19:13:38.800581] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T19:13:38.814898] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-27T19:13:39.614910] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-27T19:13:39.726395] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T19:13:40.371102] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-27T19:13:40.414964] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-27T19:13:40.730240] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-27T19:13:40.736912] [INFO ] [REMOTE ] HNI: Full fetch complete (42285 records). [2025-10-27T19:13:40.737072] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-27T19:13:41.221492] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-27T19:13:41.222589] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-27T19:13:41.223591] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-27T19:13:41.224975] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-27T19:13:41.225203] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-27T19:13:41.226713] [DEBUG] [LOCAL ] HNI: Trimmed 42285 records to 29700 (keeping 200 days of data) [2025-10-27T19:13:41.412548] [DEBUG] [LOCAL ] HNI: Primary data saved (29700 records). [2025-10-27T19:13:41.412729] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-27T19:13:41.412823] [INFO ] [MAIN ] Update Progress: 1037/2366 symbols completed. HNI took 32.0s. Estimated remaining: 2h 51m 16s. Rate: 7.8 symbols/min [2025-10-27T19:13:42.015005] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-27T19:13:42.362987] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-27T19:13:42.375090] [INFO ] [REMOTE ] HOG: Full fetch complete (74240 records). [2025-10-27T19:13:42.375265] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-27T19:13:42.758996] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-27T19:13:42.759074] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-27T19:13:42.759990] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-27T19:13:42.760056] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-27T19:13:42.761393] [DEBUG] [LOCAL ] HOG: Trimmed 74240 records to 50529 (keeping 200 days of data) [2025-10-27T19:13:43.058336] [DEBUG] [LOCAL ] HOG: Primary data saved (50529 records). [2025-10-27T19:13:43.058465] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-27T19:13:43.058540] [INFO ] [MAIN ] Update Progress: 1038/2366 symbols completed. HOG took 27.4s. Estimated remaining: 2h 51m 1s. Rate: 7.8 symbols/min [2025-10-27T19:13:43.272499] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-27T19:13:43.283543] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-27T19:13:43.451045] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T19:13:43.614992] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-27T19:13:44.784156] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T19:13:44.793563] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-27T19:13:45.457405] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-27T19:13:45.468835] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-27T19:13:46.209246] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T19:13:46.218422] [INFO ] [REMOTE ] HOMB: Full fetch complete (64506 records). [2025-10-27T19:13:46.218543] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-27T19:13:46.601971] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-27T19:13:46.602061] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-27T19:13:46.602914] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-27T19:13:46.602974] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-27T19:13:46.604168] [DEBUG] [LOCAL ] HOMB: Trimmed 64506 records to 43589 (keeping 200 days of data) [2025-10-27T19:13:46.857445] [DEBUG] [LOCAL ] HOMB: Primary data saved (43589 records). [2025-10-27T19:13:46.857569] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-27T19:13:46.857938] [INFO ] [MAIN ] Update Progress: 1039/2366 symbols completed. HOMB took 25.3s. Estimated remaining: 2h 50m 48s. Rate: 7.8 symbols/min [2025-10-27T19:13:47.506583] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-27T19:13:47.517231] [INFO ] [REMOTE ] HMY: Full fetch complete (77159 records). [2025-10-27T19:13:47.517378] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-27T19:13:47.912838] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-27T19:13:47.912946] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-27T19:13:47.914043] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-27T19:13:47.914109] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-27T19:13:47.915693] [DEBUG] [LOCAL ] HMY: Trimmed 77159 records to 53166 (keeping 200 days of data) [2025-10-27T19:13:48.241926] [DEBUG] [LOCAL ] HMY: Primary data saved (53166 records). [2025-10-27T19:13:48.242070] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-27T19:13:48.242150] [INFO ] [MAIN ] Update Progress: 1040/2366 symbols completed. HMY took 44.2s. Estimated remaining: 2h 50m 32s. Rate: 7.8 symbols/min [2025-10-27T19:13:48.827129] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:13:48.891831] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:13:48.952791] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:13:48.981718] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:13:49.008576] [DEBUG] [LOCAL ] HOV: Loaded 13910 existing records from primary storage. [2025-10-27T19:13:49.008934] [INFO ] [MAIN ] HOV: Loaded 13910 existing records. [2025-10-27T19:13:49.140699] [DEBUG] [LOCAL ] HOUS: Loaded 46499 existing records from primary storage. [2025-10-27T19:13:49.189427] [INFO ] [MAIN ] HOUS: Loaded 46499 existing records. [2025-10-27T19:13:49.248097] [DEBUG] [LOCAL ] HP: Loaded 52118 existing records from primary storage. [2025-10-27T19:13:49.323482] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:13:49.297550] [INFO ] [MAIN ] HP: Loaded 52118 existing records. [2025-10-27T19:13:49.368148] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-27T19:13:49.369341] [DEBUG] [LOCAL ] HPE: Loaded 54477 existing records from primary storage. [2025-10-27T19:13:49.369608] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-27T19:13:49.431170] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-27T19:13:49.445782] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-27T19:13:49.425855] [INFO ] [MAIN ] HPE: Loaded 54477 existing records. [2025-10-27T19:13:49.585162] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:13:49.615692] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-27T19:13:49.649025] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-27T19:13:49.708605] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-27T19:13:49.737799] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-27T19:13:49.969431] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:13:50.006836] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-27T19:13:50.090588] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-27T19:13:50.168167] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-27T19:13:50.173571] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-27T19:13:50.156410] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:13:50.199827] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-27T19:13:50.262182] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-27T19:13:50.339754] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-27T19:13:50.354419] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-27T19:13:50.691882] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:13:50.714269] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-27T19:13:51.152287] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:13:51.192845] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-27T19:13:51.396389] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:13:51.415828] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-27T19:13:51.415579] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:13:51.416850] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-27T19:13:51.616479] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-27T19:13:51.620132] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-27T19:13:52.566118] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T19:13:52.570279] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-27T19:13:52.848736] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T19:13:52.863609] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-27T19:13:53.040703] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-27T19:13:53.053223] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-27T19:13:53.119554] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-27T19:13:53.124236] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-27T19:13:53.287009] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-27T19:13:53.298171] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-27T19:13:53.700680] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T19:13:53.920539] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T19:13:54.015024] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-27T19:13:54.392088] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T19:13:54.505452] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-27T19:13:54.814967] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-27T19:13:54.966895] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-27T19:13:55.614964] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-27T19:13:55.794953] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T19:13:56.414955] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-27T19:13:57.053129] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T19:13:57.215042] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-27T19:13:58.015004] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-27T19:13:58.213341] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-27T19:13:58.248682] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-27T19:13:58.814937] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-27T19:13:59.503309] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T19:13:59.614911] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-27T19:13:59.764816] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-27T19:14:00.414949] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-27T19:14:01.215050] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-27T19:14:01.700203] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-27T19:14:01.946115] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T19:14:02.014979] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-27T19:14:02.379805] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-27T19:14:02.814942] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-27T19:14:03.489259] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-27T19:14:03.491751] [INFO ] [REMOTE ] HOV: Full fetch complete (18867 records). [2025-10-27T19:14:03.491826] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-27T19:14:03.620047] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-27T19:14:03.935853] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-27T19:14:03.935927] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-27T19:14:03.936398] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-27T19:14:03.936457] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-27T19:14:03.937075] [DEBUG] [LOCAL ] HOV: Trimmed 18867 records to 13651 (keeping 200 days of data) [2025-10-27T19:14:04.019077] [DEBUG] [LOCAL ] HOV: Primary data saved (13651 records). [2025-10-27T19:14:04.019244] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-27T19:14:04.019460] [INFO ] [MAIN ] Update Progress: 1041/2366 symbols completed. HOV took 15.8s. Estimated remaining: 2h 50m 35s. Rate: 7.8 symbols/min [2025-10-27T19:14:04.205692] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:14:04.241499] [DEBUG] [LOCAL ] HPF: Loaded 7554 existing records from primary storage. [2025-10-27T19:14:04.242228] [INFO ] [MAIN ] HPF: Loaded 7554 existing records. [2025-10-27T19:14:04.243545] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-27T19:14:04.417678] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-27T19:14:04.446769] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:14:04.446919] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-27T19:14:04.446966] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-27T19:14:04.447108] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-27T19:14:04.447149] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-27T19:14:04.820936] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:14:05.223681] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-27T19:14:05.242965] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T19:14:06.014932] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-27T19:14:06.029101] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T19:14:06.207478] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-27T19:14:06.814962] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-27T19:14:07.614947] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-27T19:14:07.667280] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T19:14:08.246931] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T19:14:08.313025] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T19:14:08.414911] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-27T19:14:09.044330] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-27T19:14:09.214963] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-27T19:14:10.014952] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-27T19:14:10.814968] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-27T19:14:11.314688] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-27T19:14:11.387517] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T19:14:11.526967] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-27T19:14:11.614936] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-27T19:14:12.414951] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-27T19:14:13.214976] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-27T19:14:13.313573] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-27T19:14:13.798105] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-27T19:14:13.800078] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-27T19:14:14.014959] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-27T19:14:14.814960] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-27T19:14:15.048176] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T19:14:15.614974] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-27T19:14:16.415016] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-27T19:14:16.940207] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-27T19:14:16.970397] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-27T19:14:16.968692] [INFO ] [REMOTE ] HPE: Full fetch complete (77876 records). [2025-10-27T19:14:16.980353] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-27T19:14:17.221960] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-27T19:14:17.238931] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T19:14:17.397972] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-27T19:14:17.398076] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-27T19:14:17.399451] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-27T19:14:17.399519] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-27T19:14:17.401739] [DEBUG] [LOCAL ] HPE: Trimmed 77876 records to 53697 (keeping 200 days of data) [2025-10-27T19:14:17.764348] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-10-27T19:14:17.764556] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-27T19:14:17.765968] [INFO ] [MAIN ] Update Progress: 1042/2366 symbols completed. HPE took 29.5s. Estimated remaining: 2h 50m 35s. Rate: 7.8 symbols/min [2025-10-27T19:14:17.947429] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:14:17.965588] [DEBUG] [LOCAL ] HPI: Loaded 10818 existing records from primary storage. [2025-10-27T19:14:17.965913] [INFO ] [MAIN ] HPI: Loaded 10818 existing records. [2025-10-27T19:14:18.027567] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-27T19:14:18.152317] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:14:18.152557] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-27T19:14:18.152608] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-27T19:14:18.152843] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-27T19:14:18.152900] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-27T19:14:18.515456] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:14:18.622675] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T19:14:18.772897] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-27T19:14:18.814985] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-27T19:14:19.614965] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-27T19:14:20.414984] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-27T19:14:20.562041] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-27T19:14:21.033114] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T19:14:21.135205] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-27T19:14:21.214964] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-27T19:14:21.732294] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-27T19:14:22.014943] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-27T19:14:22.707800] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-27T19:14:22.709496] [INFO ] [REMOTE ] HPF: Full fetch complete (10465 records). [2025-10-27T19:14:22.709564] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-27T19:14:22.820132] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-27T19:14:23.084738] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-27T19:14:23.084813] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-27T19:14:23.085059] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-27T19:14:23.085096] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-27T19:14:23.085492] [DEBUG] [LOCAL ] HPF: Trimmed 10465 records to 7315 (keeping 200 days of data) [2025-10-27T19:14:23.128491] [DEBUG] [LOCAL ] HPF: Primary data saved (7315 records). [2025-10-27T19:14:23.128591] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-27T19:14:23.128685] [INFO ] [MAIN ] Update Progress: 1043/2366 symbols completed. HPF took 19.1s. Estimated remaining: 2h 50m 24s. Rate: 7.8 symbols/min [2025-10-27T19:14:23.307476] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:14:23.358434] [DEBUG] [LOCAL ] HPP: Loaded 51926 existing records from primary storage. [2025-10-27T19:14:23.358896] [INFO ] [MAIN ] HPP: Loaded 51926 existing records. [2025-10-27T19:14:23.541466] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:14:23.541722] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-27T19:14:23.541779] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-27T19:14:23.541986] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-27T19:14:23.542044] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-27T19:14:23.618489] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-27T19:14:23.708934] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-27T19:14:23.946959] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:14:24.414946] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-27T19:14:25.214971] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-27T19:14:25.319174] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T19:14:25.330631] [INFO ] [REMOTE ] HOUS: Full fetch complete (64840 records). [2025-10-27T19:14:25.330924] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-27T19:14:25.742395] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-27T19:14:25.742512] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-27T19:14:25.744084] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-27T19:14:25.744289] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-27T19:14:25.746546] [DEBUG] [LOCAL ] HOUS: Trimmed 64840 records to 45802 (keeping 200 days of data) [2025-10-27T19:14:25.847823] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T19:14:26.028879] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-27T19:14:26.082322] [DEBUG] [LOCAL ] HOUS: Primary data saved (45802 records). [2025-10-27T19:14:26.085744] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-27T19:14:26.086341] [INFO ] [MAIN ] Update Progress: 1044/2366 symbols completed. HOUS took 37.8s. Estimated remaining: 2h 50m 10s. Rate: 7.8 symbols/min [2025-10-27T19:14:26.089240] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T19:14:26.279511] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:14:26.353931] [DEBUG] [LOCAL ] HPQ: Loaded 54449 existing records from primary storage. [2025-10-27T19:14:26.354411] [INFO ] [MAIN ] HPQ: Loaded 54449 existing records. [2025-10-27T19:14:26.542767] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:14:26.544173] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-27T19:14:26.544237] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-27T19:14:26.545159] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-27T19:14:26.545221] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-27T19:14:26.815915] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-27T19:14:26.823497] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-27T19:14:26.929348] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:14:27.614944] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-27T19:14:28.323762] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-27T19:14:28.412547] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-27T19:14:28.416422] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-27T19:14:29.200862] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T19:14:29.214889] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-27T19:14:29.668784] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T19:14:30.014928] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-27T19:14:30.814942] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-27T19:14:31.466175] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-27T19:14:31.614932] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-27T19:14:32.425471] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-27T19:14:32.431082] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-27T19:14:32.947666] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-27T19:14:32.957203] [INFO ] [REMOTE ] HP: Full fetch complete (74194 records). [2025-10-27T19:14:32.957322] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-27T19:14:33.106932] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-27T19:14:33.225099] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-27T19:14:33.376589] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-27T19:14:33.376743] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-27T19:14:33.377846] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-27T19:14:33.377914] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-27T19:14:33.379408] [DEBUG] [LOCAL ] HP: Trimmed 74194 records to 51297 (keeping 200 days of data) [2025-10-27T19:14:33.772444] [DEBUG] [LOCAL ] HP: Primary data saved (51297 records). [2025-10-27T19:14:33.772674] [INFO ] [MAIN ] HP: Full history saved. [2025-10-27T19:14:33.772808] [INFO ] [MAIN ] Update Progress: 1045/2366 symbols completed. HP took 45.5s. Estimated remaining: 2h 50m 2s. Rate: 7.8 symbols/min [2025-10-27T19:14:33.951891] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:14:33.965567] [DEBUG] [LOCAL ] HPS: Loaded 10420 existing records from primary storage. [2025-10-27T19:14:33.965854] [INFO ] [MAIN ] HPS: Loaded 10420 existing records. [2025-10-27T19:14:34.020101] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-27T19:14:34.222741] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:14:34.222986] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-27T19:14:34.223064] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-27T19:14:34.223256] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-27T19:14:34.223330] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-27T19:14:34.628925] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:14:34.808461] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-27T19:14:34.818215] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-27T19:14:35.259880] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T19:14:35.617037] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-27T19:14:35.623015] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T19:14:36.414987] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-27T19:14:37.214932] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-27T19:14:37.375839] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-27T19:14:37.472548] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T19:14:38.012472] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T19:14:38.014979] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-27T19:14:38.552476] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-27T19:14:38.814993] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-27T19:14:39.614950] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-27T19:14:40.384851] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-27T19:14:40.414898] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-27T19:14:40.463719] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-27T19:14:41.079577] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-27T19:14:41.214928] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-27T19:14:42.014948] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-27T19:14:42.088739] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T19:14:42.091302] [INFO ] [REMOTE ] HPI: Full fetch complete (13832 records). [2025-10-27T19:14:42.091380] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-27T19:14:42.505568] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-27T19:14:42.505714] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-27T19:14:42.506382] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-27T19:14:42.506433] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-27T19:14:42.507212] [DEBUG] [LOCAL ] HPI: Trimmed 13832 records to 10526 (keeping 200 days of data) [2025-10-27T19:14:42.576151] [DEBUG] [LOCAL ] HPI: Primary data saved (10526 records). [2025-10-27T19:14:42.576345] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-27T19:14:42.576445] [INFO ] [MAIN ] Update Progress: 1046/2366 symbols completed. HPI took 24.8s. Estimated remaining: 2h 49m 56s. Rate: 7.8 symbols/min [2025-10-27T19:14:42.753387] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:14:42.783036] [DEBUG] [LOCAL ] HQH: Loaded 26090 existing records from primary storage. [2025-10-27T19:14:42.783433] [INFO ] [MAIN ] HQH: Loaded 26090 existing records. [2025-10-27T19:14:42.820191] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-27T19:14:42.973541] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:14:42.973847] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-27T19:14:42.973899] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-27T19:14:42.974116] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-27T19:14:42.974155] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-27T19:14:43.340375] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:14:43.614975] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-27T19:14:43.624563] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-27T19:14:44.125424] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-27T19:14:44.414949] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-27T19:14:44.738235] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T19:14:45.214936] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-27T19:14:46.015005] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-27T19:14:46.035948] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T19:14:46.293748] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-27T19:14:46.814971] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-27T19:14:47.090328] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T19:14:47.449444] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-27T19:14:47.614984] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-27T19:14:48.414998] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-27T19:14:48.484093] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-27T19:14:49.214935] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-27T19:14:50.014997] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-27T19:14:50.266033] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-27T19:14:50.292128] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-27T19:14:50.471994] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-27T19:14:50.815023] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-27T19:14:51.614924] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-27T19:14:51.939140] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T19:14:52.372526] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T19:14:52.414950] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-27T19:14:53.214944] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-27T19:14:53.289226] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T19:14:53.291572] [INFO ] [REMOTE ] HPS: Full fetch complete (15006 records). [2025-10-27T19:14:53.292031] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-27T19:14:53.643070] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-27T19:14:53.643148] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-27T19:14:53.643512] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-27T19:14:53.643550] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-27T19:14:53.644062] [DEBUG] [LOCAL ] HPS: Trimmed 15006 records to 10175 (keeping 200 days of data) [2025-10-27T19:14:53.703704] [DEBUG] [LOCAL ] HPS: Primary data saved (10175 records). [2025-10-27T19:14:53.703828] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-27T19:14:53.703912] [INFO ] [MAIN ] Update Progress: 1047/2366 symbols completed. HPS took 19.9s. Estimated remaining: 2h 49m 53s. Rate: 7.8 symbols/min [2025-10-27T19:14:53.867084] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:14:53.886860] [DEBUG] [LOCAL ] HQL: Loaded 17318 existing records from primary storage. [2025-10-27T19:14:53.887067] [INFO ] [MAIN ] HQL: Loaded 17318 existing records. [2025-10-27T19:14:54.022695] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-27T19:14:54.061815] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:14:54.061976] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-27T19:14:54.062022] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-27T19:14:54.062186] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-27T19:14:54.062224] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-27T19:14:54.407944] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:14:54.814966] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-27T19:14:54.971615] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T19:14:55.176127] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T19:14:55.614979] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-27T19:14:55.870041] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-27T19:14:56.414945] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-27T19:14:57.214926] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-27T19:14:57.277318] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-27T19:14:57.570403] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-27T19:14:58.014980] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-27T19:14:58.167851] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T19:14:58.814956] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-27T19:14:59.304509] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T19:14:59.614997] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-27T19:15:00.365952] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-27T19:15:00.414897] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-27T19:15:00.567010] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-27T19:15:01.214986] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-27T19:15:02.015000] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-27T19:15:02.699836] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-27T19:15:02.751950] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T19:15:02.814910] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-27T19:15:03.169170] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T19:15:03.614947] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-27T19:15:04.184468] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-27T19:15:04.190154] [INFO ] [REMOTE ] HQH: Full fetch complete (36823 records). [2025-10-27T19:15:04.190247] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-27T19:15:04.426906] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-27T19:15:04.560441] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-27T19:15:04.560517] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-27T19:15:04.561159] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-27T19:15:04.561220] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-27T19:15:04.562023] [DEBUG] [LOCAL ] HQH: Trimmed 36823 records to 25547 (keeping 200 days of data) [2025-10-27T19:15:04.756456] [DEBUG] [LOCAL ] HQH: Primary data saved (25547 records). [2025-10-27T19:15:04.756586] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-27T19:15:04.756711] [INFO ] [MAIN ] Update Progress: 1048/2366 symbols completed. HQH took 22.2s. Estimated remaining: 2h 49m 49s. Rate: 7.8 symbols/min [2025-10-27T19:15:04.927368] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:15:04.977205] [DEBUG] [LOCAL ] HR: Loaded 52883 existing records from primary storage. [2025-10-27T19:15:04.977526] [INFO ] [MAIN ] HR: Loaded 52883 existing records. [2025-10-27T19:15:05.155003] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:15:05.155424] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-27T19:15:05.155551] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-27T19:15:05.155838] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-27T19:15:05.155895] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-27T19:15:05.222405] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-27T19:15:05.500434] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-27T19:15:05.536506] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:15:05.567542] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-27T19:15:06.014924] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-27T19:15:06.558692] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T19:15:06.628251] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T19:15:06.638430] [INFO ] [REMOTE ] HPQ: Full fetch complete (77842 records). [2025-10-27T19:15:06.638565] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-27T19:15:06.825854] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-27T19:15:07.025039] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-27T19:15:07.025126] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-27T19:15:07.026085] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-27T19:15:07.026145] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-27T19:15:07.027574] [DEBUG] [LOCAL ] HPQ: Trimmed 77842 records to 53669 (keeping 200 days of data) [2025-10-27T19:15:07.344609] [DEBUG] [LOCAL ] HPQ: Primary data saved (53669 records). [2025-10-27T19:15:07.344756] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-27T19:15:07.344848] [INFO ] [MAIN ] Update Progress: 1049/2366 symbols completed. HPQ took 41.3s. Estimated remaining: 2h 49m 35s. Rate: 7.8 symbols/min [2025-10-27T19:15:07.531037] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:15:07.573021] [DEBUG] [LOCAL ] HRB: Loaded 48840 existing records from primary storage. [2025-10-27T19:15:07.573301] [INFO ] [MAIN ] HRB: Loaded 48840 existing records. [2025-10-27T19:15:07.626371] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-27T19:15:07.751373] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:15:07.751631] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-27T19:15:07.751716] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-27T19:15:07.760029] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-27T19:15:07.760323] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-27T19:15:07.760403] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-27T19:15:08.111429] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:15:08.414956] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-27T19:15:09.058580] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T19:15:09.214948] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-27T19:15:09.837694] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-27T19:15:09.903822] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T19:15:10.014925] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-27T19:15:10.592945] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-27T19:15:10.814965] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-27T19:15:11.614970] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-27T19:15:11.795339] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-27T19:15:12.414934] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-27T19:15:13.207885] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T19:15:13.218452] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-27T19:15:13.414427] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T19:15:14.014937] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-27T19:15:14.815415] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-27T19:15:14.818122] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-27T19:15:15.615004] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-27T19:15:15.781068] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-27T19:15:15.872958] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T19:15:16.414947] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-27T19:15:16.802458] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-27T19:15:17.214969] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-27T19:15:18.014924] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-27T19:15:18.155404] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-27T19:15:18.165197] [INFO ] [REMOTE ] HPP: Full fetch complete (73350 records). [2025-10-27T19:15:18.165330] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-27T19:15:18.564911] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-27T19:15:18.565096] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-27T19:15:18.566424] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-27T19:15:18.566507] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-27T19:15:18.568345] [DEBUG] [LOCAL ] HPP: Trimmed 73350 records to 51188 (keeping 200 days of data) [2025-10-27T19:15:18.793314] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T19:15:18.815102] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-27T19:15:18.897609] [DEBUG] [LOCAL ] HPP: Primary data saved (51188 records). [2025-10-27T19:15:18.897787] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-27T19:15:18.897879] [INFO ] [MAIN ] Update Progress: 1050/2366 symbols completed. HPP took 55.8s. Estimated remaining: 2h 49m 32s. Rate: 7.8 symbols/min [2025-10-27T19:15:19.061135] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:15:19.093668] [DEBUG] [LOCAL ] HRI: Loaded 32615 existing records from primary storage. [2025-10-27T19:15:19.093981] [INFO ] [MAIN ] HRI: Loaded 32615 existing records. [2025-10-27T19:15:19.268166] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:15:19.268446] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-27T19:15:19.268613] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-27T19:15:19.268926] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-27T19:15:19.269102] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-27T19:15:19.639685] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-27T19:15:19.662895] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:15:19.667493] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-27T19:15:20.355580] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T19:15:20.414901] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-27T19:15:20.832474] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-27T19:15:20.839103] [INFO ] [REMOTE ] HQL: Full fetch complete (25436 records). [2025-10-27T19:15:20.839276] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-27T19:15:21.220150] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-27T19:15:21.329370] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-27T19:15:21.329469] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-27T19:15:21.330718] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-27T19:15:21.330804] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-27T19:15:21.331952] [DEBUG] [LOCAL ] HQL: Trimmed 25436 records to 17143 (keeping 200 days of data) [2025-10-27T19:15:21.481931] [DEBUG] [LOCAL ] HQL: Primary data saved (17143 records). [2025-10-27T19:15:21.482099] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-27T19:15:21.482220] [INFO ] [MAIN ] Update Progress: 1051/2366 symbols completed. HQL took 27.8s. Estimated remaining: 2h 49m 18s. Rate: 7.8 symbols/min [2025-10-27T19:15:21.703231] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:15:21.782014] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T19:15:21.827503] [DEBUG] [LOCAL ] HRL: Loaded 53895 existing records from primary storage. [2025-10-27T19:15:21.828015] [INFO ] [MAIN ] HRL: Loaded 53895 existing records. [2025-10-27T19:15:22.021588] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-27T19:15:22.065986] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:15:22.066273] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-27T19:15:22.066344] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-27T19:15:22.066777] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-27T19:15:22.066851] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-27T19:15:22.452041] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:15:22.564415] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T19:15:22.814996] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-27T19:15:23.208885] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T19:15:23.614937] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-27T19:15:24.166448] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T19:15:24.414931] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-27T19:15:25.085488] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T19:15:25.214933] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-27T19:15:26.015399] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-27T19:15:26.017887] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T19:15:26.714475] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-27T19:15:26.814912] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-27T19:15:27.421518] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T19:15:27.614934] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-27T19:15:28.129294] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T19:15:28.414884] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-27T19:15:28.974808] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-27T19:15:29.214930] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-27T19:15:29.547019] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-27T19:15:30.014980] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-27T19:15:30.605869] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-27T19:15:30.814952] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-27T19:15:31.406214] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T19:15:31.614906] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-27T19:15:32.148954] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-27T19:15:32.414965] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-27T19:15:32.783293] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T19:15:33.214938] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-27T19:15:34.014947] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-27T19:15:34.167890] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T19:15:34.280975] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-27T19:15:34.814956] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-27T19:15:35.614944] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-27T19:15:35.770180] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-27T19:15:36.067489] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T19:15:36.414910] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-27T19:15:36.943050] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T19:15:37.214930] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-27T19:15:38.014989] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-27T19:15:38.098376] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-27T19:15:38.814973] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-27T19:15:39.094606] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-27T19:15:39.105007] [INFO ] [REMOTE ] HR: Full fetch complete (75080 records). [2025-10-27T19:15:39.105166] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-27T19:15:39.548305] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-27T19:15:39.548151] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T19:15:39.557309] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-27T19:15:39.558886] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-27T19:15:39.559119] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-27T19:15:39.560562] [DEBUG] [LOCAL ] HR: Trimmed 75080 records to 52096 (keeping 200 days of data) [2025-10-27T19:15:39.621233] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-27T19:15:39.873426] [DEBUG] [LOCAL ] HR: Primary data saved (52096 records). [2025-10-27T19:15:39.873567] [INFO ] [MAIN ] HR: Full history saved. [2025-10-27T19:15:39.874107] [INFO ] [MAIN ] Update Progress: 1052/2366 symbols completed. HR took 35.1s. Estimated remaining: 2h 49m 23s. Rate: 7.8 symbols/min [2025-10-27T19:15:40.056450] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:15:40.092216] [DEBUG] [LOCAL ] HRTG: Loaded 34934 existing records from primary storage. [2025-10-27T19:15:40.092639] [INFO ] [MAIN ] HRTG: Loaded 34934 existing records. [2025-10-27T19:15:40.276467] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-27T19:15:40.319902] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:15:40.320366] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-27T19:15:40.320416] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-27T19:15:40.320596] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-27T19:15:40.320680] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-27T19:15:40.417379] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-27T19:15:40.664210] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:15:41.214911] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-27T19:15:41.321209] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-27T19:15:41.351277] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-27T19:15:42.014975] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-27T19:15:42.224494] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T19:15:42.814951] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-27T19:15:43.295605] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-27T19:15:43.304393] [INFO ] [REMOTE ] HRB: Full fetch complete (69886 records). [2025-10-27T19:15:43.304502] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-27T19:15:43.618389] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-27T19:15:43.690561] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-27T19:15:43.690717] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-27T19:15:43.691609] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-27T19:15:43.691734] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-27T19:15:43.693116] [DEBUG] [LOCAL ] HRB: Trimmed 69886 records to 48064 (keeping 200 days of data) [2025-10-27T19:15:43.917544] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T19:15:43.995602] [DEBUG] [LOCAL ] HRB: Primary data saved (48064 records). [2025-10-27T19:15:43.995762] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-27T19:15:43.995849] [INFO ] [MAIN ] Update Progress: 1053/2366 symbols completed. HRB took 36.7s. Estimated remaining: 2h 49m 11s. Rate: 7.8 symbols/min [2025-10-27T19:15:44.158443] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:15:44.204298] [DEBUG] [LOCAL ] HSBC: Loaded 51741 existing records from primary storage. [2025-10-27T19:15:44.204581] [INFO ] [MAIN ] HSBC: Loaded 51741 existing records. [2025-10-27T19:15:44.375595] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:15:44.375807] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-27T19:15:44.375852] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-27T19:15:44.376028] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-27T19:15:44.376064] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-27T19:15:44.420095] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-27T19:15:44.719987] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:15:45.156789] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-27T19:15:45.162823] [INFO ] [REMOTE ] HRI: Full fetch complete (46851 records). [2025-10-27T19:15:45.162934] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-27T19:15:45.226311] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-27T19:15:45.540179] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-27T19:15:45.540260] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-27T19:15:45.541066] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-27T19:15:45.541132] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-27T19:15:45.542129] [DEBUG] [LOCAL ] HRI: Trimmed 46851 records to 31983 (keeping 200 days of data) [2025-10-27T19:15:45.733390] [DEBUG] [LOCAL ] HRI: Primary data saved (31983 records). [2025-10-27T19:15:45.733525] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-27T19:15:45.733603] [INFO ] [MAIN ] Update Progress: 1054/2366 symbols completed. HRI took 26.8s. Estimated remaining: 2h 48m 56s. Rate: 7.8 symbols/min [2025-10-27T19:15:45.901103] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:15:45.915997] [DEBUG] [LOCAL ] HSHP: Loaded 14591 existing records from primary storage. [2025-10-27T19:15:45.916234] [INFO ] [MAIN ] HSHP: Loaded 14591 existing records. [2025-10-27T19:15:46.020570] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-27T19:15:46.097113] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:15:46.097400] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-27T19:15:46.097470] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-27T19:15:46.097860] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-27T19:15:46.097917] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-27T19:15:46.396746] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T19:15:46.475174] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:15:46.508978] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-27T19:15:46.814943] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-27T19:15:47.374676] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-27T19:15:47.408754] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T19:15:47.614957] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-27T19:15:48.414942] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-27T19:15:49.102495] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-27T19:15:49.214912] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-27T19:15:49.286119] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-27T19:15:50.014964] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-27T19:15:50.695282] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-27T19:15:50.814951] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-27T19:15:51.614923] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-27T19:15:51.748065] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T19:15:52.265474] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T19:15:52.414950] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-27T19:15:52.607374] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-27T19:15:53.214996] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-27T19:15:53.931697] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T19:15:54.014949] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-27T19:15:54.814978] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-27T19:15:55.100177] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-27T19:15:55.267184] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-27T19:15:55.564233] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T19:15:55.614935] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-27T19:15:56.414955] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-27T19:15:57.214924] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-27T19:15:57.422847] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-27T19:15:57.667791] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T19:15:58.014937] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-27T19:15:58.209330] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T19:15:58.814985] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-27T19:15:59.594567] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T19:15:59.614896] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-27T19:15:59.897957] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-27T19:15:59.908807] [INFO ] [REMOTE ] HRL: Full fetch complete (77030 records). [2025-10-27T19:15:59.908944] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-27T19:16:00.288024] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-27T19:16:00.288125] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-27T19:16:00.289088] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-27T19:16:00.289175] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-27T19:16:00.290552] [DEBUG] [LOCAL ] HRL: Trimmed 77030 records to 53115 (keeping 200 days of data) [2025-10-27T19:16:00.459604] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-27T19:16:00.608463] [DEBUG] [LOCAL ] HRL: Primary data saved (53115 records). [2025-10-27T19:16:00.608567] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-27T19:16:00.608847] [INFO ] [MAIN ] Update Progress: 1055/2366 symbols completed. HRL took 39.1s. Estimated remaining: 2h 48m 57s. Rate: 7.8 symbols/min [2025-10-27T19:16:00.774269] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T19:16:00.790674] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:16:00.845666] [DEBUG] [LOCAL ] HSY: Loaded 51078 existing records from primary storage. [2025-10-27T19:16:00.845982] [INFO ] [MAIN ] HSY: Loaded 51078 existing records. [2025-10-27T19:16:01.020390] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:16:01.020613] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-27T19:16:01.020692] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-27T19:16:01.020893] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-27T19:16:01.020933] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-27T19:16:01.220257] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-27T19:16:01.385798] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:16:01.607112] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-27T19:16:02.015006] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-27T19:16:02.645949] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-27T19:16:02.814962] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-27T19:16:03.250633] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-27T19:16:03.614907] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-27T19:16:03.718309] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-27T19:16:04.414993] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-27T19:16:05.214987] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-27T19:16:05.249241] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-27T19:16:05.283387] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T19:16:06.014936] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-27T19:16:06.726386] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-27T19:16:06.734372] [INFO ] [REMOTE ] HRTG: Full fetch complete (44505 records). [2025-10-27T19:16:06.734477] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-27T19:16:06.822258] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-27T19:16:07.111676] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-27T19:16:07.111755] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-27T19:16:07.112479] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-27T19:16:07.112540] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-27T19:16:07.113493] [DEBUG] [LOCAL ] HRTG: Trimmed 44505 records to 34356 (keeping 200 days of data) [2025-10-27T19:16:07.310244] [DEBUG] [LOCAL ] HRTG: Primary data saved (34356 records). [2025-10-27T19:16:07.310376] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-27T19:16:07.311026] [INFO ] [MAIN ] Update Progress: 1056/2366 symbols completed. HRTG took 27.4s. Estimated remaining: 2h 48m 48s. Rate: 7.8 symbols/min [2025-10-27T19:16:07.475377] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:16:07.475531] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-27T19:16:07.475567] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-27T19:16:07.475698] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-27T19:16:07.475751] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-27T19:16:07.475813] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-27T19:16:07.475871] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-27T19:16:07.623965] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-27T19:16:07.767501] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T19:16:07.854155] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:16:07.988086] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-27T19:16:08.414951] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-27T19:16:09.214922] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-27T19:16:09.529740] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-27T19:16:09.852517] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-27T19:16:09.855457] [INFO ] [REMOTE ] HSHP: Full fetch complete (22922 records). [2025-10-27T19:16:09.855537] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-27T19:16:10.018680] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-27T19:16:10.194349] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-27T19:16:10.271265] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-27T19:16:10.271341] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-27T19:16:10.271854] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-27T19:16:10.271916] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-27T19:16:10.272510] [DEBUG] [LOCAL ] HSHP: Trimmed 22922 records to 14105 (keeping 200 days of data) [2025-10-27T19:16:10.351117] [DEBUG] [LOCAL ] HSHP: Primary data saved (14105 records). [2025-10-27T19:16:10.351250] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-27T19:16:10.351343] [INFO ] [MAIN ] Update Progress: 1057/2366 symbols completed. HSHP took 24.6s. Estimated remaining: 2h 48m 35s. Rate: 7.8 symbols/min [2025-10-27T19:16:10.517908] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:16:10.535316] [DEBUG] [LOCAL ] HTD: Loaded 14394 existing records from primary storage. [2025-10-27T19:16:10.535550] [INFO ] [MAIN ] HTD: Loaded 14394 existing records. [2025-10-27T19:16:10.720684] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:16:10.720953] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-27T19:16:10.721014] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-27T19:16:10.721196] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-27T19:16:10.721258] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-27T19:16:10.820141] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-10-27T19:16:11.091506] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:16:11.093599] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T19:16:11.093900] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-10-27T19:16:11.093987] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:16:11.094068] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-27T19:16:11.094144] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:16:11.094237] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-27T19:16:11.094344] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-27T19:16:11.094404] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-27T19:16:11.094468] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-27T19:16:11.094545] [INFO ] [MAIN ] Update Progress: 1058/2366 symbols completed. HTB took 3.8s. Estimated remaining: 2h 48m 18s. Rate: 7.8 symbols/min [2025-10-27T19:16:11.258406] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:16:11.258571] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-27T19:16:11.258608] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-27T19:16:11.258741] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-27T19:16:11.258812] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-27T19:16:11.258878] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-27T19:16:11.258921] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-27T19:16:11.601898] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:16:11.614900] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-27T19:16:11.881418] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-27T19:16:11.915417] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-27T19:16:12.414959] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-27T19:16:12.998745] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T19:16:13.214996] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-27T19:16:13.862235] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T19:16:14.014974] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-27T19:16:14.814965] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-27T19:16:14.907515] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-27T19:16:15.614955] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-27T19:16:16.414908] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-27T19:16:16.610214] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-27T19:16:17.031366] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-27T19:16:17.214907] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-27T19:16:17.244343] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T19:16:18.015000] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-27T19:16:18.337878] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-27T19:16:18.814924] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-27T19:16:18.931832] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-27T19:16:18.942919] [INFO ] [REMOTE ] HSBC: Full fetch complete (74276 records). [2025-10-27T19:16:18.943182] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-27T19:16:19.178628] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-27T19:16:19.421695] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-27T19:16:19.421804] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-27T19:16:19.423046] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-27T19:16:19.423115] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-27T19:16:19.424701] [DEBUG] [LOCAL ] HSBC: Trimmed 74276 records to 50955 (keeping 200 days of data) [2025-10-27T19:16:19.618723] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-27T19:16:19.769159] [DEBUG] [LOCAL ] HSBC: Primary data saved (50955 records). [2025-10-27T19:16:19.769334] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-27T19:16:19.769444] [INFO ] [MAIN ] Update Progress: 1059/2366 symbols completed. HSBC took 35.8s. Estimated remaining: 2h 48m 12s. Rate: 7.8 symbols/min [2025-10-27T19:16:19.989346] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:16:20.037952] [DEBUG] [LOCAL ] HTGC: Loaded 48352 existing records from primary storage. [2025-10-27T19:16:20.038324] [INFO ] [MAIN ] HTGC: Loaded 48352 existing records. [2025-10-27T19:16:20.248426] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:16:20.248692] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-27T19:16:20.248756] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-27T19:16:20.249233] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-27T19:16:20.249289] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-27T19:16:20.425281] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-27T19:16:20.598305] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:16:21.029242] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-27T19:16:21.214911] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-27T19:16:21.461500] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-27T19:16:21.558276] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-27T19:16:22.014989] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-27T19:16:22.792621] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-27T19:16:22.814903] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-27T19:16:23.614936] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-27T19:16:24.258249] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-27T19:16:24.414962] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-27T19:16:24.666796] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-27T19:16:24.809192] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-27T19:16:25.214935] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-27T19:16:26.014941] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-27T19:16:26.397681] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-27T19:16:26.814940] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-27T19:16:27.132728] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-27T19:16:27.614937] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-27T19:16:27.796201] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T19:16:28.119776] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-27T19:16:28.414944] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-27T19:16:29.214921] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-27T19:16:29.351225] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-27T19:16:30.015029] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-27T19:16:30.282006] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-27T19:16:30.708687] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-27T19:16:30.814922] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-27T19:16:31.615020] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-27T19:16:32.063030] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-27T19:16:32.414969] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-27T19:16:32.662715] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-27T19:16:32.688700] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-27T19:16:32.693322] [INFO ] [REMOTE ] HTD: Full fetch complete (19580 records). [2025-10-27T19:16:32.693425] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-27T19:16:33.059716] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-27T19:16:33.059794] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-27T19:16:33.060202] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-27T19:16:33.060244] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-27T19:16:33.060841] [DEBUG] [LOCAL ] HTD: Trimmed 19580 records to 14025 (keeping 200 days of data) [2025-10-27T19:16:33.144237] [DEBUG] [LOCAL ] HTD: Primary data saved (14025 records). [2025-10-27T19:16:33.144358] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-27T19:16:33.144431] [INFO ] [MAIN ] Update Progress: 1060/2366 symbols completed. HTD took 22.8s. Estimated remaining: 2h 48m 11s. Rate: 7.8 symbols/min [2025-10-27T19:16:33.220112] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-27T19:16:33.313849] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:16:33.343353] [DEBUG] [LOCAL ] HTH: Loaded 32834 existing records from primary storage. [2025-10-27T19:16:33.343601] [INFO ] [MAIN ] HTH: Loaded 32834 existing records. [2025-10-27T19:16:33.519491] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:16:33.519732] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-27T19:16:33.519787] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-27T19:16:33.520003] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-27T19:16:33.520048] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-27T19:16:33.918498] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:16:33.945000] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-27T19:16:34.014952] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-27T19:16:34.814971] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-27T19:16:35.165974] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-27T19:16:35.166627] [INFO ] [REMOTE ] HTFC: Full fetch complete (815 records). [2025-10-27T19:16:35.166762] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-27T19:16:35.358903] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-27T19:16:35.360159] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T19:16:35.359529] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:16:35.365732] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:16:35.365805] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-27T19:16:35.365867] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-27T19:16:35.365903] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-27T19:16:35.365941] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-27T19:16:35.366006] [INFO ] [MAIN ] Update Progress: 1061/2366 symbols completed. HTFC took 24.3s. Estimated remaining: 2h 47m 56s. Rate: 7.8 symbols/min [2025-10-27T19:16:35.529609] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:16:35.565137] [DEBUG] [LOCAL ] HUBB: Loaded 36419 existing records from primary storage. [2025-10-27T19:16:35.565385] [INFO ] [MAIN ] HUBB: Loaded 36419 existing records. [2025-10-27T19:16:35.620139] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-27T19:16:35.742636] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:16:35.742830] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-27T19:16:35.742874] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-27T19:16:35.743039] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-27T19:16:35.743076] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-27T19:16:36.092540] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:16:36.414933] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-27T19:16:36.967485] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-27T19:16:37.214985] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-27T19:16:37.889514] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T19:16:38.014981] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-27T19:16:38.754700] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-27T19:16:38.814941] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-27T19:16:38.896110] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T19:16:39.614939] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-27T19:16:40.053163] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T19:16:40.415015] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-27T19:16:40.521244] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-27T19:16:41.214992] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-27T19:16:42.014940] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-27T19:16:42.099535] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-27T19:16:42.596935] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T19:16:42.814919] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-27T19:16:43.384381] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-27T19:16:43.614956] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-27T19:16:44.225554] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-27T19:16:44.414961] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-27T19:16:45.067682] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T19:16:45.214913] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-27T19:16:45.655052] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-27T19:16:46.014943] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-27T19:16:46.074935] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T19:16:46.084411] [INFO ] [REMOTE ] HSY: Full fetch complete (73560 records). [2025-10-27T19:16:46.084556] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-27T19:16:46.468014] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-27T19:16:46.468095] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-27T19:16:46.469105] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-27T19:16:46.469173] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-27T19:16:46.470593] [DEBUG] [LOCAL ] HSY: Trimmed 73560 records to 50292 (keeping 200 days of data) [2025-10-27T19:16:46.781849] [DEBUG] [LOCAL ] HSY: Primary data saved (50292 records). [2025-10-27T19:16:46.781978] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-27T19:16:46.782563] [INFO ] [MAIN ] Update Progress: 1062/2366 symbols completed. HSY took 46.2s. Estimated remaining: 2h 47m 53s. Rate: 7.8 symbols/min [2025-10-27T19:16:46.820073] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-27T19:16:46.952541] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:16:46.992520] [DEBUG] [LOCAL ] HUBS: Loaded 40387 existing records from primary storage. [2025-10-27T19:16:46.992824] [INFO ] [MAIN ] HUBS: Loaded 40387 existing records. [2025-10-27T19:16:47.172120] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:16:47.172342] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-27T19:16:47.172411] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-27T19:16:47.172627] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-27T19:16:47.172727] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-27T19:16:47.495428] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T19:16:47.560077] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:16:47.614911] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-27T19:16:48.414921] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-27T19:16:48.748481] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-27T19:16:48.777370] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T19:16:49.214934] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-27T19:16:50.015021] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-27T19:16:50.340946] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-27T19:16:50.746031] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T19:16:50.814943] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-27T19:16:51.614978] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-27T19:16:51.688109] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T19:16:52.008493] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-27T19:16:52.414989] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-27T19:16:52.903120] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T19:16:53.214983] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-27T19:16:54.014980] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-27T19:16:54.181225] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-27T19:16:54.509464] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-27T19:16:54.814933] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-27T19:16:55.127855] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T19:16:55.614943] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-27T19:16:56.259302] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T19:16:56.268771] [INFO ] [REMOTE ] HTGC: Full fetch complete (68885 records). [2025-10-27T19:16:56.268894] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-27T19:16:56.422947] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-27T19:16:56.659407] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-27T19:16:56.659485] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-27T19:16:56.660378] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-27T19:16:56.660439] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-27T19:16:56.661825] [DEBUG] [LOCAL ] HTGC: Trimmed 68885 records to 47529 (keeping 200 days of data) [2025-10-27T19:16:56.942561] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T19:16:56.977471] [DEBUG] [LOCAL ] HTGC: Primary data saved (47529 records). [2025-10-27T19:16:56.977580] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-27T19:16:56.977671] [INFO ] [MAIN ] Update Progress: 1063/2366 symbols completed. HTGC took 37.2s. Estimated remaining: 2h 47m 49s. Rate: 7.8 symbols/min [2025-10-27T19:16:57.142590] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:16:57.186886] [DEBUG] [LOCAL ] HUM: Loaded 49864 existing records from primary storage. [2025-10-27T19:16:57.187199] [INFO ] [MAIN ] HUM: Loaded 49864 existing records. [2025-10-27T19:16:57.220136] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-27T19:16:57.368399] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:16:57.368705] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-27T19:16:57.368766] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-27T19:16:57.368965] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-27T19:16:57.369019] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-27T19:16:57.732609] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:16:58.024956] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-27T19:16:58.026486] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-27T19:16:58.152660] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-27T19:16:58.815011] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-27T19:16:58.972533] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T19:16:59.614988] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-27T19:17:00.175444] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T19:17:00.414972] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-27T19:17:01.214910] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-27T19:17:01.562606] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-27T19:17:01.886585] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T19:17:02.014966] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-27T19:17:02.815001] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-27T19:17:03.011337] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-27T19:17:03.503584] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-27T19:17:03.614938] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-27T19:17:04.213263] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T19:17:04.414942] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-27T19:17:05.038354] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T19:17:05.214943] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-27T19:17:05.278505] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T19:17:05.284190] [INFO ] [REMOTE ] HTH: Full fetch complete (46924 records). [2025-10-27T19:17:05.284311] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-27T19:17:05.653916] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-27T19:17:05.653998] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-27T19:17:05.654725] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-27T19:17:05.654788] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-27T19:17:05.655840] [DEBUG] [LOCAL ] HTH: Trimmed 46924 records to 32247 (keeping 200 days of data) [2025-10-27T19:17:05.848107] [DEBUG] [LOCAL ] HTH: Primary data saved (32247 records). [2025-10-27T19:17:05.848254] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-27T19:17:05.848363] [INFO ] [MAIN ] Update Progress: 1064/2366 symbols completed. HTH took 32.7s. Estimated remaining: 2h 47m 42s. Rate: 7.8 symbols/min [2025-10-27T19:17:06.014435] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:17:06.014945] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-27T19:17:06.064148] [DEBUG] [LOCAL ] HUN: Loaded 53990 existing records from primary storage. [2025-10-27T19:17:06.064464] [INFO ] [MAIN ] HUN: Loaded 53990 existing records. [2025-10-27T19:17:06.240237] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:17:06.240491] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-27T19:17:06.240590] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-27T19:17:06.240975] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-27T19:17:06.241050] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-27T19:17:06.602815] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:17:06.732793] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T19:17:06.814906] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-27T19:17:07.495194] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T19:17:07.614906] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-27T19:17:08.414906] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-27T19:17:08.501460] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-27T19:17:09.044678] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T19:17:09.051020] [INFO ] [REMOTE ] HUBB: Full fetch complete (54222 records). [2025-10-27T19:17:09.051106] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-27T19:17:09.216983] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-27T19:17:09.428320] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-27T19:17:09.428396] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-27T19:17:09.429184] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-27T19:17:09.429245] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-27T19:17:09.430263] [DEBUG] [LOCAL ] HUBB: Trimmed 54222 records to 35660 (keeping 200 days of data) [2025-10-27T19:17:09.577775] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T19:17:09.687707] [DEBUG] [LOCAL ] HUBB: Primary data saved (35660 records). [2025-10-27T19:17:09.687836] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-27T19:17:09.687910] [INFO ] [MAIN ] Update Progress: 1065/2366 symbols completed. HUBB took 34.3s. Estimated remaining: 2h 47m 30s. Rate: 7.8 symbols/min [2025-10-27T19:17:09.853449] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:17:09.891813] [DEBUG] [LOCAL ] HUYA: Loaded 44262 existing records from primary storage. [2025-10-27T19:17:09.892089] [INFO ] [MAIN ] HUYA: Loaded 44262 existing records. [2025-10-27T19:17:10.020017] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-27T19:17:10.071814] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:17:10.071983] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-27T19:17:10.072029] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-27T19:17:10.072206] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-27T19:17:10.072243] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-27T19:17:10.422736] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:17:10.814949] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-27T19:17:10.878242] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T19:17:11.404890] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-27T19:17:11.614978] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-27T19:17:11.967001] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T19:17:12.415004] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-27T19:17:13.214984] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-27T19:17:13.261557] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-27T19:17:13.940470] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T19:17:14.014956] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-27T19:17:14.814925] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-27T19:17:14.838541] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T19:17:15.265084] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T19:17:15.614990] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-27T19:17:16.426820] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-27T19:17:16.432998] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T19:17:17.039790] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-27T19:17:17.214947] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-27T19:17:17.812961] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T19:17:17.821906] [INFO ] [REMOTE ] HUBS: Full fetch complete (57091 records). [2025-10-27T19:17:17.822067] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-27T19:17:18.020402] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-27T19:17:18.222909] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-27T19:17:18.223016] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-27T19:17:18.224127] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-27T19:17:18.224194] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-27T19:17:18.225796] [DEBUG] [LOCAL ] HUBS: Trimmed 57091 records to 39652 (keeping 200 days of data) [2025-10-27T19:17:18.487187] [DEBUG] [LOCAL ] HUBS: Primary data saved (39652 records). [2025-10-27T19:17:18.487386] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-27T19:17:18.487981] [INFO ] [MAIN ] Update Progress: 1066/2366 symbols completed. HUBS took 31.7s. Estimated remaining: 2h 47m 23s. Rate: 7.8 symbols/min [2025-10-27T19:17:18.673481] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:17:18.697884] [DEBUG] [LOCAL ] HVT: Loaded 14893 existing records from primary storage. [2025-10-27T19:17:18.698336] [INFO ] [MAIN ] HVT: Loaded 14893 existing records. [2025-10-27T19:17:18.820190] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-27T19:17:18.897319] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:17:18.897704] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-27T19:17:18.897765] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-27T19:17:18.897993] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-27T19:17:18.898052] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-27T19:17:19.352510] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:17:19.357379] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-27T19:17:19.614959] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-27T19:17:19.737854] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T19:17:20.218545] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-27T19:17:20.297380] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-27T19:17:20.414958] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-27T19:17:21.214949] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-27T19:17:22.014917] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-27T19:17:22.077106] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T19:17:22.426525] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-27T19:17:22.814947] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-27T19:17:23.195497] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-27T19:17:23.614946] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-27T19:17:24.249163] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T19:17:24.414906] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-27T19:17:25.214918] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-27T19:17:25.429513] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-27T19:17:25.859390] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T19:17:26.014917] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-27T19:17:26.080476] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T19:17:26.814929] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-27T19:17:27.458612] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T19:17:27.615040] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-27T19:17:28.125712] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-27T19:17:28.139108] [INFO ] [REMOTE ] HUM: Full fetch complete (71071 records). [2025-10-27T19:17:28.139263] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-27T19:17:28.420175] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-27T19:17:28.534327] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-27T19:17:28.534423] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-27T19:17:28.535340] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-27T19:17:28.535417] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-27T19:17:28.536813] [DEBUG] [LOCAL ] HUM: Trimmed 71071 records to 49027 (keeping 200 days of data) [2025-10-27T19:17:28.661002] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-27T19:17:28.849533] [DEBUG] [LOCAL ] HUM: Primary data saved (49027 records). [2025-10-27T19:17:28.849691] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-27T19:17:28.850261] [INFO ] [MAIN ] Update Progress: 1067/2366 symbols completed. HUM took 31.9s. Estimated remaining: 2h 47m 19s. Rate: 7.8 symbols/min [2025-10-27T19:17:29.014702] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:17:29.066788] [DEBUG] [LOCAL ] HWM: Loaded 53449 existing records from primary storage. [2025-10-27T19:17:29.067129] [INFO ] [MAIN ] HWM: Loaded 53449 existing records. [2025-10-27T19:17:29.228780] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-27T19:17:29.244179] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:17:29.245045] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-27T19:17:29.245115] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-27T19:17:29.245323] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-27T19:17:29.245378] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-27T19:17:29.590611] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:17:30.014989] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-27T19:17:30.665388] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T19:17:30.742913] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-27T19:17:30.814902] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-27T19:17:31.614941] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-27T19:17:31.965397] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-27T19:17:32.177443] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T19:17:32.320503] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T19:17:32.415006] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-27T19:17:33.214992] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-27T19:17:33.687035] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-27T19:17:34.014960] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-27T19:17:34.566029] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T19:17:34.814960] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-27T19:17:35.215348] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-27T19:17:35.614978] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-27T19:17:36.160531] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T19:17:36.171069] [INFO ] [REMOTE ] HUN: Full fetch complete (77040 records). [2025-10-27T19:17:36.171241] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-27T19:17:36.420776] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-27T19:17:36.585858] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-27T19:17:36.585966] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-27T19:17:36.587068] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-27T19:17:36.587148] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-27T19:17:36.588816] [DEBUG] [LOCAL ] HUN: Trimmed 77040 records to 53210 (keeping 200 days of data) [2025-10-27T19:17:36.903912] [DEBUG] [LOCAL ] HUN: Primary data saved (53210 records). [2025-10-27T19:17:36.904047] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-27T19:17:36.904140] [INFO ] [MAIN ] Update Progress: 1068/2366 symbols completed. HUN took 31.1s. Estimated remaining: 2h 47m 11s. Rate: 7.8 symbols/min [2025-10-27T19:17:37.071985] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:17:37.113169] [DEBUG] [LOCAL ] HXL: Loaded 46545 existing records from primary storage. [2025-10-27T19:17:37.113469] [INFO ] [MAIN ] HXL: Loaded 46545 existing records. [2025-10-27T19:17:37.217933] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-27T19:17:37.289536] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:17:37.289760] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-27T19:17:37.289811] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-27T19:17:37.289991] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-27T19:17:37.290069] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-27T19:17:37.591812] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T19:17:37.622090] [INFO ] [REMOTE ] HUYA: Full fetch complete (64025 records). [2025-10-27T19:17:37.639732] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-27T19:17:37.748230] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:17:38.026503] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-27T19:17:38.084090] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-27T19:17:38.084614] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-27T19:17:38.085885] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-27T19:17:38.086044] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-27T19:17:38.088023] [DEBUG] [LOCAL ] HUYA: Trimmed 64025 records to 43516 (keeping 200 days of data) [2025-10-27T19:17:38.235268] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T19:17:38.258015] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T19:17:38.405853] [DEBUG] [LOCAL ] HUYA: Primary data saved (43516 records). [2025-10-27T19:17:38.406060] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-27T19:17:38.406942] [INFO ] [MAIN ] Update Progress: 1069/2366 symbols completed. HUYA took 28.7s. Estimated remaining: 2h 46m 56s. Rate: 7.8 symbols/min [2025-10-27T19:17:38.599193] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:17:38.615452] [DEBUG] [LOCAL ] HY: Loaded 9943 existing records from primary storage. [2025-10-27T19:17:38.615805] [INFO ] [MAIN ] HY: Loaded 9943 existing records. [2025-10-27T19:17:38.804599] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:17:38.804919] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-27T19:17:38.804975] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-27T19:17:38.805160] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-27T19:17:38.805200] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-27T19:17:38.820107] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-27T19:17:39.185156] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:17:39.467758] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-27T19:17:39.614914] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-27T19:17:39.833948] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-27T19:17:40.137696] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-27T19:17:40.414919] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-27T19:17:41.214958] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-27T19:17:41.852990] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T19:17:42.014990] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-27T19:17:42.814989] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-27T19:17:42.940202] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-27T19:17:43.477901] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T19:17:43.614960] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-27T19:17:43.637007] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T19:17:44.414935] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-27T19:17:45.199453] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T19:17:45.214899] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-27T19:17:45.450445] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-27T19:17:46.014955] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-27T19:17:46.163947] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-27T19:17:46.168287] [INFO ] [REMOTE ] HVT: Full fetch complete (22931 records). [2025-10-27T19:17:46.168402] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-27T19:17:46.542873] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-27T19:17:46.542943] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-27T19:17:46.543444] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-27T19:17:46.543505] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-27T19:17:46.544105] [DEBUG] [LOCAL ] HVT: Trimmed 22931 records to 14524 (keeping 200 days of data) [2025-10-27T19:17:46.628390] [DEBUG] [LOCAL ] HVT: Primary data saved (14524 records). [2025-10-27T19:17:46.628519] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-27T19:17:46.628607] [INFO ] [MAIN ] Update Progress: 1070/2366 symbols completed. HVT took 28.1s. Estimated remaining: 2h 46m 49s. Rate: 7.8 symbols/min [2025-10-27T19:17:46.792513] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:17:46.792724] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-27T19:17:46.792772] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-27T19:17:46.792883] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-27T19:17:46.792923] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-27T19:17:46.792965] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-27T19:17:46.792997] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-27T19:17:46.822968] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-27T19:17:47.161729] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:17:47.614943] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-27T19:17:47.679187] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T19:17:47.760602] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-27T19:17:48.013360] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-27T19:17:48.414946] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-27T19:17:48.676018] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-27T19:17:49.214997] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-27T19:17:50.014978] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-27T19:17:50.050306] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-27T19:17:50.814963] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-27T19:17:51.049747] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-27T19:17:51.166138] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T19:17:51.614943] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-27T19:17:51.965040] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-27T19:17:52.414931] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-27T19:17:52.676668] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-27T19:17:53.214957] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-27T19:17:54.014923] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-27T19:17:54.328527] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-27T19:17:54.814994] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-27T19:17:55.206341] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-27T19:17:55.479844] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T19:17:55.614926] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-27T19:17:56.414961] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-27T19:17:57.214920] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-27T19:17:57.438727] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T19:17:57.532532] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-27T19:17:57.652131] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-27T19:17:58.014939] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-27T19:17:58.254665] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-27T19:17:58.814947] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-27T19:17:59.299908] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-27T19:17:59.614930] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-27T19:18:00.414943] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-27T19:18:00.882573] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-27T19:18:01.214933] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-27T19:18:02.014956] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-27T19:18:02.234752] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-10-27T19:18:02.305127] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T19:18:02.305981] [INFO ] [REMOTE ] HYAC: Full fetch complete (909 records). [2025-10-27T19:18:02.306048] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-27T19:18:02.306370] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T19:18:02.306466] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:18:02.306533] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:18:02.306605] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-27T19:18:02.306731] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-27T19:18:02.306787] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-27T19:18:02.306829] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-27T19:18:02.306893] [INFO ] [MAIN ] Update Progress: 1071/2366 symbols completed. HYAC took 15.7s. Estimated remaining: 2h 46m 51s. Rate: 7.8 symbols/min [2025-10-27T19:18:02.477434] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:18:02.477582] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-27T19:18:02.477619] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-27T19:18:02.477748] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-27T19:18:02.477789] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-27T19:18:02.477831] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-27T19:18:02.477872] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-27T19:18:02.823151] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-27T19:18:02.829296] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:18:03.201711] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T19:18:03.518139] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-27T19:18:03.614954] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-27T19:18:04.414916] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-27T19:18:04.436416] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T19:18:05.214980] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-27T19:18:06.002980] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-27T19:18:06.013045] [INFO ] [REMOTE ] HXL: Full fetch complete (66775 records). [2025-10-27T19:18:06.013192] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-27T19:18:06.025045] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-27T19:18:06.394311] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-27T19:18:06.394387] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-27T19:18:06.395284] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-27T19:18:06.395347] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-27T19:18:06.396639] [DEBUG] [LOCAL ] HXL: Trimmed 66775 records to 45823 (keeping 200 days of data) [2025-10-27T19:18:06.663890] [DEBUG] [LOCAL ] HXL: Primary data saved (45823 records). [2025-10-27T19:18:06.664005] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-27T19:18:06.664096] [INFO ] [MAIN ] Update Progress: 1072/2366 symbols completed. HXL took 29.8s. Estimated remaining: 2h 46m 39s. Rate: 7.8 symbols/min [2025-10-27T19:18:06.836522] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:18:06.836707] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-27T19:18:06.850102] [DEBUG] [LOCAL ] HYI: Loaded 9716 existing records from primary storage. [2025-10-27T19:18:06.850333] [INFO ] [MAIN ] HYI: Loaded 9716 existing records. [2025-10-27T19:18:07.008990] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T19:18:07.093596] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:18:07.106667] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-27T19:18:07.106842] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-27T19:18:07.107214] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-27T19:18:07.107534] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-27T19:18:07.108544] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-27T19:18:07.228762] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-27T19:18:07.502883] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:18:07.614942] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-27T19:18:08.375003] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-27T19:18:08.414899] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-27T19:18:09.213720] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T19:18:09.217021] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-27T19:18:09.455370] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-27T19:18:10.014960] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-27T19:18:10.275635] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-27T19:18:10.814937] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-27T19:18:11.081152] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-27T19:18:11.614937] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-27T19:18:11.934696] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-27T19:18:12.414959] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-27T19:18:13.220166] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-27T19:18:13.228163] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T19:18:13.993315] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-27T19:18:14.014897] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-27T19:18:14.538345] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-27T19:18:14.814962] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-27T19:18:15.132129] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-27T19:18:15.614956] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-27T19:18:16.414950] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-27T19:18:16.461857] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-27T19:18:16.464250] [INFO ] [REMOTE ] HY: Full fetch complete (14792 records). [2025-10-27T19:18:16.464343] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-27T19:18:16.760832] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-27T19:18:16.836671] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-27T19:18:16.836767] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-27T19:18:16.837093] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-27T19:18:16.837131] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-27T19:18:16.837579] [DEBUG] [LOCAL ] HY: Trimmed 14792 records to 9594 (keeping 200 days of data) [2025-10-27T19:18:16.894691] [DEBUG] [LOCAL ] HY: Primary data saved (9594 records). [2025-10-27T19:18:16.894817] [INFO ] [MAIN ] HY: Full history saved. [2025-10-27T19:18:16.894893] [INFO ] [MAIN ] Update Progress: 1073/2366 symbols completed. HY took 38.5s. Estimated remaining: 2h 46m 34s. Rate: 7.8 symbols/min [2025-10-27T19:18:17.060524] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:18:17.092386] [DEBUG] [LOCAL ] HYT: Loaded 33993 existing records from primary storage. [2025-10-27T19:18:17.092674] [INFO ] [MAIN ] HYT: Loaded 33993 existing records. [2025-10-27T19:18:17.220040] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-27T19:18:17.273618] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:18:17.273813] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-27T19:18:17.273868] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-27T19:18:17.274102] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-27T19:18:17.274160] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-27T19:18:17.627394] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:18:18.014943] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-27T19:18:18.034749] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-27T19:18:18.814943] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-27T19:18:19.140610] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-27T19:18:19.426741] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T19:18:19.614940] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-27T19:18:20.414950] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-27T19:18:20.690631] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-27T19:18:20.826441] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T19:18:21.214946] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-27T19:18:22.014988] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-27T19:18:22.814931] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-27T19:18:22.961765] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-27T19:18:23.023525] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T19:18:23.167596] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-27T19:18:23.168317] [INFO ] [REMOTE ] HYBX: Full fetch complete (703 records). [2025-10-27T19:18:23.168388] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-27T19:18:23.345338] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-27T19:18:23.345510] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:18:23.345568] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:18:23.345634] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-27T19:18:23.345735] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-27T19:18:23.345775] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-27T19:18:23.345816] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-27T19:18:23.345871] [INFO ] [MAIN ] Update Progress: 1074/2366 symbols completed. HYBX took 21.0s. Estimated remaining: 2h 46m 25s. Rate: 7.8 symbols/min [2025-10-27T19:18:23.513884] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:18:23.522268] [DEBUG] [LOCAL ] HYTR: Loaded 3140 existing records from primary storage. [2025-10-27T19:18:23.522442] [INFO ] [MAIN ] HYTR: Loaded 3140 existing records. [2025-10-27T19:18:23.620143] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-27T19:18:23.697917] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:18:23.698120] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-27T19:18:23.698166] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-27T19:18:23.698291] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-27T19:18:23.698327] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-27T19:18:24.041961] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:18:24.414986] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-27T19:18:25.214999] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-27T19:18:25.608402] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-27T19:18:25.933540] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-27T19:18:25.978019] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T19:18:26.014898] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-27T19:18:26.817469] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-27T19:18:26.823761] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-27T19:18:27.350483] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-27T19:18:27.614931] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-27T19:18:28.135794] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-27T19:18:28.414955] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-27T19:18:29.178319] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-27T19:18:29.214914] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-27T19:18:30.004975] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-27T19:18:30.014887] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-27T19:18:30.673748] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T19:18:30.815029] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-27T19:18:31.185211] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-27T19:18:31.614949] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-27T19:18:31.945902] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-27T19:18:32.414968] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-27T19:18:33.215007] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-27T19:18:33.460565] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-27T19:18:33.463282] [INFO ] [REMOTE ] HYI: Full fetch complete (14054 records). [2025-10-27T19:18:33.463350] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-27T19:18:33.817031] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-27T19:18:33.817104] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-27T19:18:33.817407] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-27T19:18:33.817445] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-27T19:18:33.817921] [DEBUG] [LOCAL ] HYI: Trimmed 14054 records to 9485 (keeping 200 days of data) [2025-10-27T19:18:33.875538] [DEBUG] [LOCAL ] HYI: Primary data saved (9485 records). [2025-10-27T19:18:33.875705] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-27T19:18:33.875797] [INFO ] [MAIN ] Update Progress: 1075/2366 symbols completed. HYI took 27.2s. Estimated remaining: 2h 46m 21s. Rate: 7.8 symbols/min [2025-10-27T19:18:33.973809] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-27T19:18:34.025992] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-27T19:18:34.059331] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:18:34.086890] [DEBUG] [LOCAL ] HZO: Loaded 28844 existing records from primary storage. [2025-10-27T19:18:34.087141] [INFO ] [MAIN ] HZO: Loaded 28844 existing records. [2025-10-27T19:18:34.260786] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:18:34.260979] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-27T19:18:34.261024] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-27T19:18:34.261189] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-27T19:18:34.261226] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-27T19:18:34.604620] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:18:34.814959] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-27T19:18:35.286440] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-27T19:18:35.472580] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T19:18:35.614934] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-27T19:18:36.414934] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-27T19:18:36.829679] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T19:18:36.963207] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-27T19:18:37.215007] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-27T19:18:38.014942] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-27T19:18:38.517241] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T19:18:38.814938] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-27T19:18:39.615041] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-27T19:18:39.844884] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T19:18:40.091724] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-27T19:18:40.095291] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-27T19:18:40.106398] [INFO ] [REMOTE ] HWM: Full fetch complete (76615 records). [2025-10-27T19:18:40.106593] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-27T19:18:40.420130] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-27T19:18:40.574459] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-27T19:18:40.574534] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-27T19:18:40.575748] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-27T19:18:40.575818] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-27T19:18:40.577720] [DEBUG] [LOCAL ] HWM: Trimmed 76615 records to 52655 (keeping 200 days of data) [2025-10-27T19:18:40.932808] [DEBUG] [LOCAL ] HWM: Primary data saved (52655 records). [2025-10-27T19:18:40.932973] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-27T19:18:40.933672] [INFO ] [MAIN ] Update Progress: 1076/2366 symbols completed. HWM took 1m 12s. Estimated remaining: 2h 46m 12s. Rate: 7.8 symbols/min [2025-10-27T19:18:41.105612] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:18:41.115465] [DEBUG] [LOCAL ] IAE: Loaded 6423 existing records from primary storage. [2025-10-27T19:18:41.115706] [INFO ] [MAIN ] IAE: Loaded 6423 existing records. [2025-10-27T19:18:41.214922] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-27T19:18:41.294559] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:18:41.294805] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-27T19:18:41.294855] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-27T19:18:41.294993] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-27T19:18:41.295031] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-27T19:18:41.669423] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:18:41.715160] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T19:18:42.014952] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-27T19:18:42.621948] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T19:18:42.815004] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-27T19:18:43.138080] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-27T19:18:43.363535] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T19:18:43.614916] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-27T19:18:44.330895] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T19:18:44.332180] [INFO ] [REMOTE ] HYTR: Full fetch complete (4705 records). [2025-10-27T19:18:44.332250] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-27T19:18:44.420129] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-27T19:18:44.681550] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-27T19:18:44.681626] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-27T19:18:44.681809] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-27T19:18:44.681859] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-27T19:18:44.682216] [DEBUG] [LOCAL ] HYTR: Trimmed 4705 records to 3094 (keeping 200 days of data) [2025-10-27T19:18:44.700560] [DEBUG] [LOCAL ] HYTR: Primary data saved (3094 records). [2025-10-27T19:18:44.700623] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-27T19:18:44.700727] [INFO ] [MAIN ] Update Progress: 1077/2366 symbols completed. HYTR took 21.4s. Estimated remaining: 2h 45m 60s. Rate: 7.8 symbols/min [2025-10-27T19:18:45.214970] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-27T19:18:45.813454] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-27T19:18:45.896482] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T19:18:46.014998] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-27T19:18:46.814946] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-27T19:18:47.104343] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T19:18:47.110915] [INFO ] [REMOTE ] HYT: Full fetch complete (47859 records). [2025-10-27T19:18:47.111032] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-27T19:18:47.483672] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-27T19:18:47.483782] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-27T19:18:47.484524] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-27T19:18:47.484584] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-27T19:18:47.485535] [DEBUG] [LOCAL ] HYT: Trimmed 47859 records to 33156 (keeping 200 days of data) [2025-10-27T19:18:47.580085] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T19:18:47.643903] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-27T19:18:47.689612] [DEBUG] [LOCAL ] HYT: Primary data saved (33156 records). [2025-10-27T19:18:47.689767] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-27T19:18:47.689862] [INFO ] [MAIN ] Update Progress: 1078/2366 symbols completed. HYT took 30.8s. Estimated remaining: 2h 45m 46s. Rate: 7.8 symbols/min [2025-10-27T19:18:48.069177] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-27T19:18:48.414997] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-27T19:18:48.997411] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T19:18:49.214932] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-27T19:18:49.824012] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-27T19:18:50.015016] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-27T19:18:50.815026] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-27T19:18:50.860809] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-27T19:18:51.491852] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T19:18:51.614952] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-27T19:18:52.184851] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-27T19:18:52.414956] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-27T19:18:53.011382] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T19:18:53.214965] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-27T19:18:54.014953] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-27T19:18:54.362543] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T19:18:54.436113] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-27T19:18:54.814935] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-27T19:18:55.359361] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-27T19:18:55.361621] [INFO ] [REMOTE ] IAE: Full fetch complete (9176 records). [2025-10-27T19:18:55.361728] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-27T19:18:55.624312] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-27T19:18:55.741273] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-27T19:18:55.741344] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-27T19:18:55.741774] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-27T19:18:55.741838] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-27T19:18:55.742261] [DEBUG] [LOCAL ] IAE: Trimmed 9176 records to 6415 (keeping 200 days of data) [2025-10-27T19:18:55.779138] [DEBUG] [LOCAL ] IAE: Primary data saved (6415 records). [2025-10-27T19:18:55.779252] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-27T19:18:55.779328] [INFO ] [MAIN ] Update Progress: 1079/2366 symbols completed. IAE took 14.8s. Estimated remaining: 2h 45m 39s. Rate: 7.8 symbols/min [2025-10-27T19:18:57.157432] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T19:18:57.164023] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-27T19:18:57.976108] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-27T19:18:57.982613] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-27T19:18:58.836842] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T19:18:58.843108] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-27T19:18:59.712233] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T19:18:59.717377] [INFO ] [REMOTE ] HZO: Full fetch complete (41283 records). [2025-10-27T19:18:59.717480] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-27T19:19:00.127631] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-27T19:19:00.127812] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-27T19:19:00.128565] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-27T19:19:00.128630] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-27T19:19:00.129976] [DEBUG] [LOCAL ] HZO: Trimmed 41283 records to 28097 (keeping 200 days of data) [2025-10-27T19:19:00.309442] [DEBUG] [LOCAL ] HZO: Primary data saved (28097 records). [2025-10-27T19:19:00.309593] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-27T19:19:00.309720] [INFO ] [MAIN ] Update Progress: 1080/2366 symbols completed. HZO took 26.4s. Estimated remaining: 2h 45m 28s. Rate: 7.8 symbols/min [2025-10-27T19:19:01.234386] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:19:01.227556] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:19:01.235433] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:19:01.233323] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:19:01.290208] [DEBUG] [LOCAL ] IBP: Loaded 29036 existing records from primary storage. [2025-10-27T19:19:01.306296] [INFO ] [MAIN ] IBP: Loaded 29036 existing records. [2025-10-27T19:19:01.427674] [DEBUG] [LOCAL ] IBN: Loaded 53601 existing records from primary storage. [2025-10-27T19:19:01.451497] [INFO ] [MAIN ] IBN: Loaded 53601 existing records. [2025-10-27T19:19:01.472842] [DEBUG] [LOCAL ] IAG: Loaded 54272 existing records from primary storage. [2025-10-27T19:19:01.510430] [INFO ] [MAIN ] IAG: Loaded 54272 existing records. [2025-10-27T19:19:01.579625] [DEBUG] [LOCAL ] IBM: Loaded 54408 existing records from primary storage. [2025-10-27T19:19:01.646284] [INFO ] [MAIN ] IBM: Loaded 54408 existing records. [2025-10-27T19:19:01.853374] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:19:01.927458] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-27T19:19:01.995863] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-27T19:19:02.127039] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:19:02.143183] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-27T19:19:02.137552] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:19:02.148548] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-27T19:19:02.164573] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-27T19:19:02.164419] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-27T19:19:02.189872] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-27T19:19:02.206224] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-27T19:19:02.278409] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-27T19:19:02.268065] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:19:02.278974] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-27T19:19:02.278921] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-27T19:19:02.299766] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-27T19:19:02.294497] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-27T19:19:02.369379] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-27T19:19:02.448489] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-27T19:19:02.484285] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-27T19:19:03.668968] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:19:03.770853] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:19:03.750569] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-27T19:19:03.830796] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:19:03.832864] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-27T19:19:03.838985] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-27T19:19:03.927938] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:19:03.928345] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-27T19:19:05.106867] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T19:19:05.112929] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-27T19:19:05.544568] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T19:19:05.555911] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-27T19:19:05.605342] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T19:19:05.617809] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-27T19:19:05.654521] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-27T19:19:05.665407] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-27T19:19:05.888604] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T19:19:05.895338] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-27T19:19:07.253178] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T19:19:07.260808] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-27T19:19:07.297472] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T19:19:07.308718] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-27T19:19:07.344635] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-27T19:19:07.460233] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-27T19:19:07.615007] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-27T19:19:08.415103] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-27T19:19:08.665912] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T19:19:08.750520] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T19:19:09.159544] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T19:19:09.215047] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-27T19:19:10.015019] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-27T19:19:10.441756] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-27T19:19:10.544905] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-27T19:19:10.814959] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-27T19:19:10.967320] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T19:19:11.614996] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-27T19:19:12.414993] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-27T19:19:12.514378] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T19:19:13.170745] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T19:19:13.214903] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-27T19:19:13.555823] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-27T19:19:14.014934] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-27T19:19:14.750773] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T19:19:14.815095] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-27T19:19:15.182122] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-27T19:19:15.614931] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-27T19:19:16.414973] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-27T19:19:16.841722] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-27T19:19:17.071636] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-27T19:19:17.214904] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-27T19:19:17.407596] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T19:19:18.015015] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-27T19:19:18.815009] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-27T19:19:19.059082] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T19:19:19.615000] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-27T19:19:20.095523] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-27T19:19:20.414942] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-27T19:19:20.493385] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-27T19:19:20.834109] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-27T19:19:21.214927] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-27T19:19:21.544288] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T19:19:22.014949] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-27T19:19:22.814913] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-27T19:19:22.928089] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-27T19:19:23.430028] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T19:19:23.435489] [INFO ] [REMOTE ] IBP: Full fetch complete (41148 records). [2025-10-27T19:19:23.435576] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-27T19:19:23.624218] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-27T19:19:23.819233] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-27T19:19:23.819329] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-27T19:19:23.820073] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-27T19:19:23.820136] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-27T19:19:23.821056] [DEBUG] [LOCAL ] IBP: Trimmed 41148 records to 28251 (keeping 200 days of data) [2025-10-27T19:19:23.993350] [DEBUG] [LOCAL ] IBP: Primary data saved (28251 records). [2025-10-27T19:19:23.993479] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-27T19:19:23.993556] [INFO ] [MAIN ] Update Progress: 1081/2366 symbols completed. IBP took 23.7s. Estimated remaining: 2h 45m 39s. Rate: 7.8 symbols/min [2025-10-27T19:19:24.163910] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:19:24.197208] [DEBUG] [LOCAL ] IBTA: Loaded 36486 existing records from primary storage. [2025-10-27T19:19:24.197467] [INFO ] [MAIN ] IBTA: Loaded 36486 existing records. [2025-10-27T19:19:24.387950] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:19:24.388234] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-27T19:19:24.388315] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-27T19:19:24.388613] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-27T19:19:24.388771] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-27T19:19:24.421592] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-27T19:19:24.705545] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-27T19:19:24.795734] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:19:25.214965] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-27T19:19:25.673528] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-27T19:19:26.014925] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-27T19:19:26.487330] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-27T19:19:26.497292] [INFO ] [REMOTE ] IBN: Full fetch complete (76660 records). [2025-10-27T19:19:26.497423] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-27T19:19:26.822468] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-27T19:19:26.880596] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-27T19:19:26.880712] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-27T19:19:26.881685] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-27T19:19:26.881748] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-27T19:19:26.883138] [DEBUG] [LOCAL ] IBN: Trimmed 76660 records to 52799 (keeping 200 days of data) [2025-10-27T19:19:27.204306] [DEBUG] [LOCAL ] IBN: Primary data saved (52799 records). [2025-10-27T19:19:27.204448] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-27T19:19:27.204531] [INFO ] [MAIN ] Update Progress: 1082/2366 symbols completed. IBN took 26.9s. Estimated remaining: 2h 45m 26s. Rate: 7.8 symbols/min [2025-10-27T19:19:27.402240] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:19:27.405527] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-27T19:19:27.467040] [DEBUG] [LOCAL ] ICE: Loaded 53789 existing records from primary storage. [2025-10-27T19:19:27.467426] [INFO ] [MAIN ] ICE: Loaded 53789 existing records. [2025-10-27T19:19:27.616247] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-27T19:19:27.649302] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:19:27.650448] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-27T19:19:27.650516] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-27T19:19:27.650740] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-27T19:19:27.650797] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-27T19:19:28.025078] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:19:28.057572] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-27T19:19:28.085182] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T19:19:28.414960] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-27T19:19:29.215018] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-27T19:19:29.538356] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-27T19:19:29.548593] [INFO ] [REMOTE ] IAG: Full fetch complete (77529 records). [2025-10-27T19:19:29.548765] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-27T19:19:29.937099] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-27T19:19:29.937181] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-27T19:19:29.938263] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-27T19:19:29.939010] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-27T19:19:29.940510] [DEBUG] [LOCAL ] IAG: Trimmed 77529 records to 53492 (keeping 200 days of data) [2025-10-27T19:19:30.022989] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-27T19:19:30.186396] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-27T19:19:30.298296] [DEBUG] [LOCAL ] IAG: Primary data saved (53492 records). [2025-10-27T19:19:30.298539] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-27T19:19:30.299150] [INFO ] [MAIN ] Update Progress: 1083/2366 symbols completed. IAG took 30.0s. Estimated remaining: 2h 45m 13s. Rate: 7.8 symbols/min [2025-10-27T19:19:30.488987] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T19:19:30.492423] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:19:30.535032] [DEBUG] [LOCAL ] ICL: Loaded 38567 existing records from primary storage. [2025-10-27T19:19:30.535403] [INFO ] [MAIN ] ICL: Loaded 38567 existing records. [2025-10-27T19:19:30.719818] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:19:30.720037] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-27T19:19:30.720092] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-27T19:19:30.720341] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-27T19:19:30.720397] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-27T19:19:30.818227] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-27T19:19:31.071048] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:19:31.614987] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-27T19:19:31.925200] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-27T19:19:32.413329] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T19:19:32.422993] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-27T19:19:32.960414] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T19:19:33.214968] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-27T19:19:34.015016] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-27T19:19:34.508038] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-27T19:19:34.814982] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-27T19:19:34.893029] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-27T19:19:35.522878] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T19:19:35.615024] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-27T19:19:36.081986] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-27T19:19:36.414994] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-27T19:19:37.052099] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T19:19:37.214967] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-27T19:19:38.014958] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-27T19:19:38.568000] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-27T19:19:38.621910] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T19:19:38.815033] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-27T19:19:38.994156] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-27T19:19:39.614965] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-27T19:19:40.415032] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-27T19:19:40.485242] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T19:19:40.723366] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-27T19:19:41.214960] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-27T19:19:41.692609] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T19:19:42.015030] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-27T19:19:42.280690] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-27T19:19:42.814970] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-27T19:19:43.614970] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-27T19:19:43.763774] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-27T19:19:43.813441] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-27T19:19:44.414947] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-27T19:19:45.214964] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-27T19:19:45.917619] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-27T19:19:45.956863] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-27T19:19:45.967080] [INFO ] [REMOTE ] IBM: Full fetch complete (77744 records). [2025-10-27T19:19:45.967202] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-27T19:19:46.022327] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-27T19:19:46.364211] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-27T19:19:46.364331] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-27T19:19:46.365411] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-27T19:19:46.365519] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-27T19:19:46.367174] [DEBUG] [LOCAL ] IBM: Trimmed 77744 records to 53628 (keeping 200 days of data) [2025-10-27T19:19:46.509498] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T19:19:46.753355] [DEBUG] [LOCAL ] IBM: Primary data saved (53628 records). [2025-10-27T19:19:46.753495] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-27T19:19:46.753575] [INFO ] [MAIN ] Update Progress: 1084/2366 symbols completed. IBM took 46.4s. Estimated remaining: 2h 45m 15s. Rate: 7.8 symbols/min [2025-10-27T19:19:46.820056] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-27T19:19:46.921286] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:19:46.954252] [DEBUG] [LOCAL ] IDA: Loaded 33218 existing records from primary storage. [2025-10-27T19:19:46.954557] [INFO ] [MAIN ] IDA: Loaded 33218 existing records. [2025-10-27T19:19:47.134847] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:19:47.135057] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-27T19:19:47.135102] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-27T19:19:47.135288] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-27T19:19:47.135342] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-27T19:19:47.537739] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:19:47.616271] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T19:19:47.616505] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-27T19:19:47.997564] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T19:19:48.415022] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-27T19:19:48.632234] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T19:19:49.214981] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-27T19:19:49.846511] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T19:19:49.853289] [INFO ] [REMOTE ] IBTA: Full fetch complete (51133 records). [2025-10-27T19:19:49.853428] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-27T19:19:50.025095] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-27T19:19:50.246728] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-27T19:19:50.246817] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-27T19:19:50.247563] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-27T19:19:50.247604] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-27T19:19:50.248787] [DEBUG] [LOCAL ] IBTA: Trimmed 51133 records to 35583 (keeping 200 days of data) [2025-10-27T19:19:50.446479] [DEBUG] [LOCAL ] IBTA: Primary data saved (35583 records). [2025-10-27T19:19:50.446946] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-27T19:19:50.447237] [INFO ] [MAIN ] Update Progress: 1085/2366 symbols completed. IBTA took 26.5s. Estimated remaining: 2h 45m 3s. Rate: 7.8 symbols/min [2025-10-27T19:19:50.619165] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:19:50.630331] [DEBUG] [LOCAL ] IDE: Loaded 9211 existing records from primary storage. [2025-10-27T19:19:50.630520] [INFO ] [MAIN ] IDE: Loaded 9211 existing records. [2025-10-27T19:19:50.813474] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:19:50.813922] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-27T19:19:50.814032] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-27T19:19:50.814295] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-27T19:19:50.814351] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-27T19:19:50.846066] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-27T19:19:50.951062] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T19:19:51.217043] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:19:51.264107] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T19:19:51.614961] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-27T19:19:52.377913] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-27T19:19:52.417514] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-27T19:19:52.422004] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-27T19:19:53.214954] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-27T19:19:53.792509] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T19:19:54.014960] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-27T19:19:54.482240] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-27T19:19:54.743868] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T19:19:54.814924] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-27T19:19:55.614934] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-27T19:19:55.750203] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-27T19:19:56.414991] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-27T19:19:56.802841] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-27T19:19:56.880218] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-27T19:19:57.214986] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-27T19:19:58.014963] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-27T19:19:58.403190] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-27T19:19:58.814979] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-27T19:19:58.953483] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-27T19:19:59.507157] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-27T19:19:59.614935] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-27T19:20:00.414988] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-27T19:20:01.035337] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T19:20:01.214988] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-27T19:20:02.015059] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-27T19:20:02.300784] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-27T19:20:02.792003] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-27T19:20:02.814929] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-27T19:20:03.256809] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-27T19:20:03.614946] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-27T19:20:03.642776] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-27T19:20:03.649905] [INFO ] [REMOTE ] ICL: Full fetch complete (55697 records). [2025-10-27T19:20:03.650078] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-27T19:20:04.034320] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-27T19:20:04.034397] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-27T19:20:04.035254] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-27T19:20:04.035313] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-27T19:20:04.036464] [DEBUG] [LOCAL ] ICL: Trimmed 55697 records to 37737 (keeping 200 days of data) [2025-10-27T19:20:04.249404] [DEBUG] [LOCAL ] ICL: Primary data saved (37737 records). [2025-10-27T19:20:04.249820] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-27T19:20:04.250625] [INFO ] [MAIN ] Update Progress: 1086/2366 symbols completed. ICL took 34.0s. Estimated remaining: 2h 45m 2s. Rate: 7.8 symbols/min [2025-10-27T19:20:04.428696] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:20:04.425129] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-27T19:20:04.449982] [DEBUG] [LOCAL ] IDT: Loaded 18791 existing records from primary storage. [2025-10-27T19:20:04.450218] [INFO ] [MAIN ] IDT: Loaded 18791 existing records. [2025-10-27T19:20:04.632726] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:20:04.632901] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-27T19:20:04.632946] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-27T19:20:04.633259] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-27T19:20:04.633315] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-27T19:20:04.995576] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:20:05.002543] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-27T19:20:05.138334] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T19:20:05.214926] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-27T19:20:06.014940] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-27T19:20:06.025941] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-27T19:20:06.603231] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-27T19:20:06.814949] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-27T19:20:07.614965] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-27T19:20:08.405955] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-27T19:20:08.414887] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-27T19:20:08.757983] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-27T19:20:08.769562] [INFO ] [REMOTE ] ICE: Full fetch complete (77024 records). [2025-10-27T19:20:08.769761] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-27T19:20:09.199773] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-27T19:20:09.199871] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-27T19:20:09.200844] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-27T19:20:09.200913] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-27T19:20:09.202383] [DEBUG] [LOCAL ] ICE: Trimmed 77024 records to 53009 (keeping 200 days of data) [2025-10-27T19:20:09.256599] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-27T19:20:09.336039] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-27T19:20:09.398398] [INFO ] [REMOTE ] IDE: Full fetch complete (12804 records). [2025-10-27T19:20:09.432539] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-27T19:20:09.918877] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-27T19:20:09.919544] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-27T19:20:09.920426] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-27T19:20:09.920839] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-27T19:20:09.923314] [DEBUG] [LOCAL ] IDE: Trimmed 12804 records to 9081 (keeping 200 days of data) [2025-10-27T19:20:09.985456] [DEBUG] [LOCAL ] IDE: Primary data saved (9081 records). [2025-10-27T19:20:09.986419] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-27T19:20:09.991621] [DEBUG] [LOCAL ] ICE: Primary data saved (53009 records). [2025-10-27T19:20:09.991768] [INFO ] [MAIN ] Update Progress: 1087/2366 symbols completed. IDE took 19.5s. Estimated remaining: 2h 44m 52s. Rate: 7.8 symbols/min [2025-10-27T19:20:09.991895] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-27T19:20:10.003888] [INFO ] [MAIN ] Update Progress: 1088/2366 symbols completed. ICE took 42.8s. Estimated remaining: 2h 44m 35s. Rate: 7.8 symbols/min [2025-10-27T19:20:10.023831] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-27T19:20:10.355260] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:20:10.443074] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:20:10.477435] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-27T19:20:10.547561] [DEBUG] [LOCAL ] IEX: Loaded 38755 existing records from primary storage. [2025-10-27T19:20:10.548804] [INFO ] [MAIN ] IEX: Loaded 38755 existing records. [2025-10-27T19:20:10.607185] [DEBUG] [LOCAL ] IFF: Loaded 51978 existing records from primary storage. [2025-10-27T19:20:10.639990] [INFO ] [MAIN ] IFF: Loaded 51978 existing records. [2025-10-27T19:20:10.832142] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-27T19:20:10.932875] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-27T19:20:11.061309] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:20:11.088826] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:20:11.089132] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-27T19:20:11.089308] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-27T19:20:11.089254] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-27T19:20:11.089455] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-27T19:20:11.089577] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-27T19:20:11.089633] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-27T19:20:11.089706] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-27T19:20:11.106465] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-27T19:20:11.625280] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-27T19:20:11.852253] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:20:11.952323] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:20:11.988785] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-27T19:20:12.325549] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T19:20:12.414968] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-27T19:20:13.214962] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-27T19:20:13.614234] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T19:20:14.014945] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-27T19:20:14.685962] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T19:20:14.692136] [INFO ] [REMOTE ] IDA: Full fetch complete (45403 records). [2025-10-27T19:20:14.692248] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-27T19:20:14.820180] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-27T19:20:15.089447] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-27T19:20:15.089575] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-27T19:20:15.090325] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-27T19:20:15.090393] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-27T19:20:15.091520] [DEBUG] [LOCAL ] IDA: Trimmed 45403 records to 32500 (keeping 200 days of data) [2025-10-27T19:20:15.290453] [DEBUG] [LOCAL ] IDA: Primary data saved (32500 records). [2025-10-27T19:20:15.290580] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-27T19:20:15.291437] [INFO ] [MAIN ] Update Progress: 1089/2366 symbols completed. IDA took 28.5s. Estimated remaining: 2h 44m 25s. Rate: 7.8 symbols/min [2025-10-27T19:20:15.461748] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:20:15.482629] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T19:20:15.504213] [DEBUG] [LOCAL ] IFN: Loaded 18773 existing records from primary storage. [2025-10-27T19:20:15.504461] [INFO ] [MAIN ] IFN: Loaded 18773 existing records. [2025-10-27T19:20:15.620033] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-27T19:20:15.682266] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:20:15.682599] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-27T19:20:15.682671] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-27T19:20:15.682861] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-27T19:20:15.682901] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-27T19:20:16.058184] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:20:16.414970] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-27T19:20:16.530026] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T19:20:16.651402] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-27T19:20:17.214951] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-27T19:20:17.837850] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T19:20:18.014984] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-27T19:20:18.215906] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T19:20:18.814937] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-27T19:20:19.147811] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-27T19:20:19.614995] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-27T19:20:20.234502] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T19:20:20.414938] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-27T19:20:21.002864] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-27T19:20:21.095935] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T19:20:21.214977] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-27T19:20:22.014940] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-27T19:20:22.814907] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-27T19:20:22.841411] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T19:20:22.926155] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T19:20:23.610973] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T19:20:23.615296] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-27T19:20:24.414991] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-27T19:20:25.214921] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-27T19:20:25.397355] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-27T19:20:25.804393] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-27T19:20:25.830037] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T19:20:26.014925] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-27T19:20:26.814941] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-27T19:20:27.269922] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T19:20:27.614910] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-27T19:20:27.859948] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-27T19:20:28.414937] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-27T19:20:28.745253] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T19:20:29.214919] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-27T19:20:29.451434] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T19:20:30.014992] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-27T19:20:30.426050] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T19:20:30.433889] [INFO ] [REMOTE ] IEX: Full fetch complete (53832 records). [2025-10-27T19:20:30.434085] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-27T19:20:30.820141] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-27T19:20:30.890229] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-27T19:20:30.890311] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-27T19:20:30.891083] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-27T19:20:30.891146] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-27T19:20:30.892264] [DEBUG] [LOCAL ] IEX: Trimmed 53832 records to 37995 (keeping 200 days of data) [2025-10-27T19:20:31.133044] [DEBUG] [LOCAL ] IEX: Primary data saved (37995 records). [2025-10-27T19:20:31.133185] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-27T19:20:31.133267] [INFO ] [MAIN ] Update Progress: 1090/2366 symbols completed. IEX took 21.1s. Estimated remaining: 2h 44m 26s. Rate: 7.8 symbols/min [2025-10-27T19:20:31.320328] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:20:31.342056] [DEBUG] [LOCAL ] IFS: Loaded 22413 existing records from primary storage. [2025-10-27T19:20:31.342321] [INFO ] [MAIN ] IFS: Loaded 22413 existing records. [2025-10-27T19:20:31.538798] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:20:31.563730] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-27T19:20:31.566712] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-27T19:20:31.567552] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-27T19:20:31.568639] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-27T19:20:31.579025] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-27T19:20:31.619995] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-27T19:20:31.713677] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-27T19:20:31.971236] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:20:32.414962] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-27T19:20:32.736908] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T19:20:33.214955] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-27T19:20:33.712298] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T19:20:33.839420] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-27T19:20:34.014947] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-27T19:20:34.814940] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-27T19:20:35.445356] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-27T19:20:35.614920] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-27T19:20:35.788781] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-27T19:20:36.414959] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-27T19:20:36.847038] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-27T19:20:36.851603] [INFO ] [REMOTE ] IDT: Full fetch complete (24280 records). [2025-10-27T19:20:36.851721] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-27T19:20:37.218679] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-27T19:20:37.218472] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-27T19:20:37.219026] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-27T19:20:37.220159] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-27T19:20:37.220217] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-27T19:20:37.221007] [DEBUG] [LOCAL ] IDT: Trimmed 24280 records to 18504 (keeping 200 days of data) [2025-10-27T19:20:37.335345] [DEBUG] [LOCAL ] IDT: Primary data saved (18504 records). [2025-10-27T19:20:37.335464] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-27T19:20:37.335539] [INFO ] [MAIN ] Update Progress: 1091/2366 symbols completed. IDT took 33.1s. Estimated remaining: 2h 44m 17s. Rate: 7.8 symbols/min [2025-10-27T19:20:37.518141] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T19:20:37.520445] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:20:37.537294] [DEBUG] [LOCAL ] IGA: Loaded 10208 existing records from primary storage. [2025-10-27T19:20:37.537485] [INFO ] [MAIN ] IGA: Loaded 10208 existing records. [2025-10-27T19:20:37.708836] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:20:37.709024] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-27T19:20:37.709069] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-27T19:20:37.709254] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-27T19:20:37.709309] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-27T19:20:37.968983] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-27T19:20:38.020024] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-27T19:20:38.075881] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:20:38.805001] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-27T19:20:38.814901] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-27T19:20:39.614926] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-27T19:20:39.625710] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T19:20:40.414988] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-27T19:20:41.129673] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-27T19:20:41.214964] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-27T19:20:41.256892] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-27T19:20:42.014912] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-27T19:20:42.278227] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T19:20:42.777937] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-27T19:20:42.814901] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-27T19:20:43.614909] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-27T19:20:43.931728] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T19:20:44.247638] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T19:20:44.414951] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-27T19:20:45.215002] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-27T19:20:45.497369] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T19:20:46.014971] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-27T19:20:46.680447] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-27T19:20:46.820071] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-27T19:20:46.839474] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-27T19:20:47.614936] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-27T19:20:47.931565] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-27T19:20:47.935393] [INFO ] [REMOTE ] IFN: Full fetch complete (28126 records). [2025-10-27T19:20:47.935467] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-27T19:20:48.293119] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-27T19:20:48.293197] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-27T19:20:48.293856] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-27T19:20:48.293919] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-27T19:20:48.294554] [DEBUG] [LOCAL ] IFN: Trimmed 28126 records to 18180 (keeping 200 days of data) [2025-10-27T19:20:48.403920] [DEBUG] [LOCAL ] IFN: Primary data saved (18180 records). [2025-10-27T19:20:48.404069] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-27T19:20:48.404159] [INFO ] [MAIN ] Update Progress: 1092/2366 symbols completed. IFN took 33.1s. Estimated remaining: 2h 44m 13s. Rate: 7.8 symbols/min [2025-10-27T19:20:48.415814] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-27T19:20:48.599744] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:20:48.621421] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-27T19:20:48.644580] [DEBUG] [LOCAL ] IGD: Loaded 19483 existing records from primary storage. [2025-10-27T19:20:48.645126] [INFO ] [MAIN ] IGD: Loaded 19483 existing records. [2025-10-27T19:20:48.842224] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:20:48.842562] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-27T19:20:48.842721] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-27T19:20:48.843048] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-27T19:20:48.843155] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-27T19:20:49.200061] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:20:49.211713] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-27T19:20:49.214887] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-27T19:20:50.014934] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-27T19:20:50.154852] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-27T19:20:50.770044] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-27T19:20:50.814901] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-27T19:20:51.444622] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-27T19:20:51.614963] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-27T19:20:52.074206] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-27T19:20:52.415000] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-27T19:20:53.214959] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-27T19:20:53.839808] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T19:20:53.949885] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T19:20:54.014946] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-27T19:20:54.814966] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-27T19:20:55.614982] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-27T19:20:55.771074] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-27T19:20:55.782082] [INFO ] [REMOTE ] IFF: Full fetch complete (73787 records). [2025-10-27T19:20:55.782297] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-27T19:20:56.131774] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T19:20:56.174177] [INFO ] [REMOTE ] IFS: Full fetch complete (32346 records). [2025-10-27T19:20:56.192591] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-27T19:20:56.210371] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-27T19:20:56.210623] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-27T19:20:56.211827] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-27T19:20:56.247607] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-27T19:20:56.322101] [DEBUG] [LOCAL ] IFF: Trimmed 73787 records to 51193 (keeping 200 days of data) [2025-10-27T19:20:56.428584] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-27T19:20:56.544042] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-27T19:20:56.808909] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-27T19:20:56.809302] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-27T19:20:56.809981] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-27T19:20:56.810057] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-27T19:20:56.848767] [DEBUG] [LOCAL ] IFS: Trimmed 32346 records to 21676 (keeping 200 days of data) [2025-10-27T19:20:57.038690] [DEBUG] [LOCAL ] IFF: Primary data saved (51193 records). [2025-10-27T19:20:57.045686] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-27T19:20:57.046334] [INFO ] [MAIN ] Update Progress: 1093/2366 symbols completed. IFF took 47.0s. Estimated remaining: 2h 44m 6s. Rate: 7.8 symbols/min [2025-10-27T19:20:57.161340] [DEBUG] [LOCAL ] IFS: Primary data saved (21676 records). [2025-10-27T19:20:57.163880] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-27T19:20:57.163979] [INFO ] [MAIN ] Update Progress: 1094/2366 symbols completed. IFS took 26.0s. Estimated remaining: 2h 43m 50s. Rate: 7.8 symbols/min [2025-10-27T19:20:57.216582] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-27T19:20:57.316572] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:20:57.414427] [DEBUG] [LOCAL ] IGI: Loaded 4180 existing records from primary storage. [2025-10-27T19:20:57.412091] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:20:57.414636] [INFO ] [MAIN ] IGI: Loaded 4180 existing records. [2025-10-27T19:20:57.612477] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:20:57.613052] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-27T19:20:57.613109] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-27T19:20:57.613263] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-27T19:20:57.613319] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-27T19:20:57.747854] [DEBUG] [LOCAL ] IGR: Loaded 30924 existing records from primary storage. [2025-10-27T19:20:57.769911] [INFO ] [MAIN ] IGR: Loaded 30924 existing records. [2025-10-27T19:20:58.088777] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-27T19:20:58.129100] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T19:20:58.158626] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-27T19:20:58.294440] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:20:58.305483] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-27T19:20:58.326290] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-27T19:20:58.381853] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-27T19:20:58.409068] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-27T19:20:58.414695] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:20:58.821250] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-27T19:20:58.838695] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-27T19:20:58.928905] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:20:59.181259] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-27T19:20:59.614951] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-27T19:21:00.414991] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-27T19:21:00.978282] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T19:21:01.214952] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-27T19:21:01.639515] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T19:21:01.642183] [INFO ] [REMOTE ] IGA: Full fetch complete (14234 records). [2025-10-27T19:21:01.642251] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-27T19:21:02.012963] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-27T19:21:02.013039] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-27T19:21:02.013385] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-27T19:21:02.013425] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-27T19:21:02.014119] [DEBUG] [LOCAL ] IGA: Trimmed 14234 records to 9709 (keeping 200 days of data) [2025-10-27T19:21:02.014925] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-27T19:21:02.076137] [DEBUG] [LOCAL ] IGA: Primary data saved (9709 records). [2025-10-27T19:21:02.076260] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-27T19:21:02.076338] [INFO ] [MAIN ] Update Progress: 1095/2366 symbols completed. IGA took 24.7s. Estimated remaining: 2h 43m 39s. Rate: 7.8 symbols/min [2025-10-27T19:21:02.257570] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:21:02.261909] [DEBUG] [LOCAL ] IH: Loaded 2759 existing records from primary storage. [2025-10-27T19:21:02.262098] [INFO ] [MAIN ] IH: Loaded 2759 existing records. [2025-10-27T19:21:02.447199] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:21:02.447453] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-27T19:21:02.447521] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-27T19:21:02.447713] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-27T19:21:02.447770] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-27T19:21:02.588583] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T19:21:02.822822] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-27T19:21:02.850370] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:21:03.033908] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T19:21:03.185384] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-27T19:21:03.614941] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-27T19:21:04.414935] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-27T19:21:04.475256] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T19:21:04.714523] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-27T19:21:05.214989] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-27T19:21:06.014919] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-27T19:21:06.249847] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-27T19:21:06.586031] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-27T19:21:06.814971] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-27T19:21:07.305311] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-27T19:21:07.614935] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-27T19:21:08.196208] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-27T19:21:08.414960] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-27T19:21:08.950095] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-27T19:21:09.214948] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-27T19:21:09.543834] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-27T19:21:10.014956] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-27T19:21:10.728946] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T19:21:10.814915] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-27T19:21:11.111619] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-27T19:21:11.615003] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-27T19:21:12.414947] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-27T19:21:12.606722] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-27T19:21:13.214941] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-27T19:21:13.693073] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-27T19:21:13.694080] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T19:21:14.014944] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-27T19:21:14.814913] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-27T19:21:15.041426] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T19:21:15.614968] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-27T19:21:16.048771] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-27T19:21:16.189535] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-27T19:21:16.414966] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-27T19:21:17.214955] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-27T19:21:17.336464] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T19:21:18.014932] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-27T19:21:18.094540] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-27T19:21:18.814930] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-27T19:21:19.252159] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-27T19:21:19.367866] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T19:21:19.372368] [INFO ] [REMOTE ] IGD: Full fetch complete (29970 records). [2025-10-27T19:21:19.372464] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-27T19:21:19.620130] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-27T19:21:19.777460] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-27T19:21:19.777564] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-27T19:21:19.778169] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-27T19:21:19.778229] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-27T19:21:19.778929] [DEBUG] [LOCAL ] IGD: Trimmed 29970 records to 19075 (keeping 200 days of data) [2025-10-27T19:21:19.886197] [DEBUG] [LOCAL ] IGD: Primary data saved (19075 records). [2025-10-27T19:21:19.886343] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-27T19:21:19.886421] [INFO ] [MAIN ] Update Progress: 1096/2366 symbols completed. IGD took 31.5s. Estimated remaining: 2h 43m 43s. Rate: 7.8 symbols/min [2025-10-27T19:21:20.062154] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:21:20.072416] [DEBUG] [LOCAL ] IHD: Loaded 7446 existing records from primary storage. [2025-10-27T19:21:20.072673] [INFO ] [MAIN ] IHD: Loaded 7446 existing records. [2025-10-27T19:21:20.245882] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:21:20.246119] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-27T19:21:20.246166] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-27T19:21:20.246330] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-27T19:21:20.246389] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-27T19:21:20.313277] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-27T19:21:20.421358] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-27T19:21:20.604456] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:21:21.214949] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-27T19:21:21.504763] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T19:21:21.598585] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-27T19:21:22.014955] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-27T19:21:22.470017] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-27T19:21:22.814941] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-27T19:21:23.380576] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-27T19:21:23.614982] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-27T19:21:24.414911] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-27T19:21:24.448068] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-27T19:21:25.022719] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T19:21:25.023812] [INFO ] [REMOTE ] IH: Full fetch complete (5059 records). [2025-10-27T19:21:25.023881] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-27T19:21:25.223538] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-27T19:21:25.388253] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-27T19:21:25.388322] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-27T19:21:25.388472] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-27T19:21:25.388510] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-27T19:21:25.388883] [DEBUG] [LOCAL ] IH: Trimmed 5059 records to 2674 (keeping 200 days of data) [2025-10-27T19:21:25.403329] [DEBUG] [LOCAL ] IH: Primary data saved (2674 records). [2025-10-27T19:21:25.403399] [INFO ] [MAIN ] IH: Full history saved. [2025-10-27T19:21:25.403469] [INFO ] [MAIN ] Update Progress: 1097/2366 symbols completed. IH took 23.3s. Estimated remaining: 2h 43m 32s. Rate: 7.8 symbols/min [2025-10-27T19:21:25.569697] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:21:25.594363] [DEBUG] [LOCAL ] IHG: Loaded 24297 existing records from primary storage. [2025-10-27T19:21:25.594607] [INFO ] [MAIN ] IHG: Loaded 24297 existing records. [2025-10-27T19:21:25.769826] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:21:25.770035] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-27T19:21:25.770082] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-27T19:21:25.770277] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-27T19:21:25.770333] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-27T19:21:25.945428] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T19:21:26.019105] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-27T19:21:26.145360] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:21:26.814951] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-27T19:21:27.438461] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T19:21:27.614946] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-27T19:21:27.815984] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T19:21:28.349683] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-27T19:21:28.414924] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-27T19:21:29.214915] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-27T19:21:29.470359] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T19:21:29.907574] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-27T19:21:30.014937] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-27T19:21:30.724090] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-27T19:21:30.814913] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-27T19:21:31.392315] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T19:21:31.614963] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-27T19:21:32.092140] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-27T19:21:32.414950] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-27T19:21:33.074053] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-27T19:21:33.214955] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-27T19:21:34.014956] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-27T19:21:34.158341] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T19:21:34.619271] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T19:21:34.814968] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-27T19:21:35.614962] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-27T19:21:35.708212] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-27T19:21:36.414924] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-27T19:21:36.804410] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T19:21:37.001690] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T19:21:37.214934] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-27T19:21:37.749241] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T19:21:37.750941] [INFO ] [REMOTE ] IGI: Full fetch complete (5575 records). [2025-10-27T19:21:37.751009] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-27T19:21:38.020102] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-27T19:21:38.101329] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-27T19:21:38.101396] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-27T19:21:38.101570] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-27T19:21:38.101610] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-27T19:21:38.101992] [DEBUG] [LOCAL ] IGI: Trimmed 5575 records to 4108 (keeping 200 days of data) [2025-10-27T19:21:38.126638] [DEBUG] [LOCAL ] IGI: Primary data saved (4108 records). [2025-10-27T19:21:38.126827] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-27T19:21:38.126912] [INFO ] [MAIN ] Update Progress: 1098/2366 symbols completed. IGI took 41.1s. Estimated remaining: 2h 43m 30s. Rate: 7.8 symbols/min [2025-10-27T19:21:38.295636] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:21:38.329402] [DEBUG] [LOCAL ] IHS: Loaded 37672 existing records from primary storage. [2025-10-27T19:21:38.329686] [INFO ] [MAIN ] IHS: Loaded 37672 existing records. [2025-10-27T19:21:38.503039] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:21:38.503263] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-27T19:21:38.503313] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-27T19:21:38.503479] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-27T19:21:38.503515] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-27T19:21:38.687907] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-27T19:21:38.824198] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-27T19:21:38.868058] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:21:39.614946] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-27T19:21:39.987027] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-27T19:21:40.311575] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-27T19:21:40.414968] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-27T19:21:41.214985] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-27T19:21:41.493391] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-27T19:21:42.014921] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-27T19:21:42.381414] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T19:21:42.814961] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-27T19:21:42.872312] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T19:21:42.878121] [INFO ] [REMOTE ] IGR: Full fetch complete (44547 records). [2025-10-27T19:21:42.878212] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-27T19:21:43.252561] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-27T19:21:43.252685] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-27T19:21:43.253473] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-27T19:21:43.253534] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-27T19:21:43.254457] [DEBUG] [LOCAL ] IGR: Trimmed 44547 records to 30163 (keeping 200 days of data) [2025-10-27T19:21:43.421711] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T19:21:43.425104] [INFO ] [REMOTE ] IHD: Full fetch complete (11668 records). [2025-10-27T19:21:43.425741] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-27T19:21:43.621974] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-27T19:21:43.657432] [DEBUG] [LOCAL ] IGR: Primary data saved (30163 records). [2025-10-27T19:21:43.690068] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-27T19:21:43.719689] [INFO ] [MAIN ] Update Progress: 1099/2366 symbols completed. IGR took 46.6s. Estimated remaining: 2h 43m 20s. Rate: 7.8 symbols/min [2025-10-27T19:21:43.949709] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-27T19:21:43.956535] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-27T19:21:43.958156] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-27T19:21:43.958233] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-27T19:21:43.975925] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:21:43.976207] [DEBUG] [LOCAL ] IHD: Trimmed 11668 records to 7348 (keeping 200 days of data) [2025-10-27T19:21:44.019917] [DEBUG] [LOCAL ] IIF: Loaded 5325 existing records from primary storage. [2025-10-27T19:21:44.022597] [INFO ] [MAIN ] IIF: Loaded 5325 existing records. [2025-10-27T19:21:44.024140] [DEBUG] [LOCAL ] IHD: Primary data saved (7348 records). [2025-10-27T19:21:44.055473] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-27T19:21:44.087447] [INFO ] [MAIN ] Update Progress: 1100/2366 symbols completed. IHD took 24.2s. Estimated remaining: 2h 43m 4s. Rate: 7.8 symbols/min [2025-10-27T19:21:44.362712] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:21:44.380710] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-27T19:21:44.380569] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:21:44.381066] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-27T19:21:44.381234] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-27T19:21:44.381279] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-27T19:21:44.424412] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-27T19:21:44.611768] [DEBUG] [LOCAL ] IIIN: Loaded 16519 existing records from primary storage. [2025-10-27T19:21:44.651052] [INFO ] [MAIN ] IIIN: Loaded 16519 existing records. [2025-10-27T19:21:44.868213] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:21:44.950495] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:21:44.950747] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-27T19:21:44.950835] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-27T19:21:44.957667] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-27T19:21:44.957773] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-27T19:21:45.046008] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T19:21:45.220115] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-27T19:21:45.335085] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:21:45.643872] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T19:21:45.736492] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-27T19:21:46.014933] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-27T19:21:46.752101] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T19:21:46.814917] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-27T19:21:47.377088] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T19:21:47.614934] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-27T19:21:48.414966] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-27T19:21:48.775341] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-27T19:21:49.214971] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-27T19:21:49.432716] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T19:21:50.014943] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-27T19:21:50.521706] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T19:21:50.796196] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-27T19:21:50.814900] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-27T19:21:51.436759] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-27T19:21:51.615001] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-27T19:21:52.199755] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T19:21:52.414997] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-27T19:21:53.214980] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-27T19:21:53.422259] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T19:21:53.928498] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-27T19:21:54.014923] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-27T19:21:54.576975] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T19:21:54.814971] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-27T19:21:55.470855] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-27T19:21:55.614966] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-27T19:21:56.414963] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-27T19:21:57.046882] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T19:21:57.214961] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-27T19:21:57.259755] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-27T19:21:58.014954] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-27T19:21:58.284571] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-27T19:21:58.814944] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-27T19:21:59.523996] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T19:21:59.561438] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-27T19:21:59.614923] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-27T19:22:00.025118] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-27T19:22:00.414952] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-27T19:22:01.214943] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-27T19:22:01.645977] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-27T19:22:01.946198] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-27T19:22:02.014989] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-27T19:22:02.820110] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-27T19:22:02.828055] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-27T19:22:02.832990] [INFO ] [REMOTE ] IHG: Full fetch complete (34513 records). [2025-10-27T19:22:02.833069] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-27T19:22:03.200104] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-27T19:22:03.200174] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-27T19:22:03.200822] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-27T19:22:03.200885] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-27T19:22:03.201613] [DEBUG] [LOCAL ] IHG: Trimmed 34513 records to 23569 (keeping 200 days of data) [2025-10-27T19:22:03.342477] [DEBUG] [LOCAL ] IHG: Primary data saved (23569 records). [2025-10-27T19:22:03.342601] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-27T19:22:03.342698] [INFO ] [MAIN ] Update Progress: 1101/2366 symbols completed. IHG took 37.9s. Estimated remaining: 2h 43m 10s. Rate: 7.8 symbols/min [2025-10-27T19:22:03.443089] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-27T19:22:03.517494] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:22:03.534507] [DEBUG] [LOCAL ] IIM: Loaded 15662 existing records from primary storage. [2025-10-27T19:22:03.534742] [INFO ] [MAIN ] IIM: Loaded 15662 existing records. [2025-10-27T19:22:03.620250] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-27T19:22:03.711579] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:22:03.711799] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-27T19:22:03.711847] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-27T19:22:03.712040] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-27T19:22:03.712110] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-27T19:22:04.060540] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:22:04.117232] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-27T19:22:04.118391] [INFO ] [REMOTE ] IIF: Full fetch complete (8761 records). [2025-10-27T19:22:04.118461] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-27T19:22:04.420168] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-27T19:22:04.474218] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-27T19:22:04.474293] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-27T19:22:04.474505] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-27T19:22:04.474542] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-27T19:22:04.474957] [DEBUG] [LOCAL ] IIF: Trimmed 8761 records to 5028 (keeping 200 days of data) [2025-10-27T19:22:04.503613] [DEBUG] [LOCAL ] IIF: Primary data saved (5028 records). [2025-10-27T19:22:04.503734] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-27T19:22:04.503815] [INFO ] [MAIN ] Update Progress: 1102/2366 symbols completed. IIF took 20.8s. Estimated remaining: 2h 42m 54s. Rate: 7.8 symbols/min [2025-10-27T19:22:04.675696] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:22:04.707572] [DEBUG] [LOCAL ] IIPR: Loaded 29218 existing records from primary storage. [2025-10-27T19:22:04.707930] [INFO ] [MAIN ] IIPR: Loaded 29218 existing records. [2025-10-27T19:22:04.895127] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:22:04.895321] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-27T19:22:04.895368] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-27T19:22:04.895541] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-27T19:22:04.895581] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-27T19:22:05.223022] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-27T19:22:05.264415] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:22:05.552683] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T19:22:06.015019] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-27T19:22:06.733508] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T19:22:06.808586] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T19:22:06.815053] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-27T19:22:07.614917] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-27T19:22:07.824841] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T19:22:08.414986] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-27T19:22:08.602234] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-27T19:22:08.956545] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-27T19:22:09.214905] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-27T19:22:10.014921] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-27T19:22:10.109037] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-27T19:22:10.626846] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-27T19:22:10.814928] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-27T19:22:11.615002] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-27T19:22:12.172007] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T19:22:12.414913] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-27T19:22:12.492438] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-27T19:22:13.214974] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-27T19:22:13.547258] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T19:22:14.015002] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-27T19:22:14.673116] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T19:22:14.815009] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-27T19:22:15.058898] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T19:22:15.062497] [INFO ] [REMOTE ] IIIN: Full fetch complete (24980 records). [2025-10-27T19:22:15.062576] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-27T19:22:15.429800] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-27T19:22:15.429870] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-27T19:22:15.430383] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-27T19:22:15.430420] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-27T19:22:15.431056] [DEBUG] [LOCAL ] IIIN: Trimmed 24980 records to 16087 (keeping 200 days of data) [2025-10-27T19:22:15.526053] [DEBUG] [LOCAL ] IIIN: Primary data saved (16087 records). [2025-10-27T19:22:15.526176] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-27T19:22:15.526250] [INFO ] [MAIN ] Update Progress: 1103/2366 symbols completed. IIIN took 31.4s. Estimated remaining: 2h 42m 50s. Rate: 7.8 symbols/min [2025-10-27T19:22:15.622735] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-27T19:22:15.698984] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:22:15.738235] [DEBUG] [LOCAL ] IMAX: Loaded 44157 existing records from primary storage. [2025-10-27T19:22:15.738568] [INFO ] [MAIN ] IMAX: Loaded 44157 existing records. [2025-10-27T19:22:15.915738] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:22:15.915981] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-27T19:22:15.916093] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-27T19:22:15.916415] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-27T19:22:15.916472] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-27T19:22:16.297375] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:22:16.299514] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-27T19:22:16.414901] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-27T19:22:16.539506] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-27T19:22:17.214999] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-27T19:22:17.562882] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T19:22:18.014944] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-27T19:22:18.199222] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T19:22:18.810750] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-27T19:22:18.817588] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-27T19:22:19.614941] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-27T19:22:19.723031] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T19:22:20.414945] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-27T19:22:20.536063] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-27T19:22:21.214949] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-27T19:22:21.346334] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-27T19:22:22.014927] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-27T19:22:22.163992] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-27T19:22:22.814905] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-27T19:22:23.176467] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T19:22:23.614984] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-27T19:22:24.112098] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-27T19:22:24.118408] [INFO ] [REMOTE ] IHS: Full fetch complete (51579 records). [2025-10-27T19:22:24.118542] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-27T19:22:24.431018] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-27T19:22:24.420632] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T19:22:24.567009] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-27T19:22:24.567087] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-27T19:22:24.567819] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-27T19:22:24.567879] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-27T19:22:24.569022] [DEBUG] [LOCAL ] IHS: Trimmed 51579 records to 36888 (keeping 200 days of data) [2025-10-27T19:22:24.773898] [DEBUG] [LOCAL ] IHS: Primary data saved (36888 records). [2025-10-27T19:22:24.774031] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-27T19:22:24.774109] [INFO ] [MAIN ] Update Progress: 1104/2366 symbols completed. IHS took 46.6s. Estimated remaining: 2h 42m 44s. Rate: 7.8 symbols/min [2025-10-27T19:22:24.941360] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:22:24.984458] [DEBUG] [LOCAL ] INFA: Loaded 49194 existing records from primary storage. [2025-10-27T19:22:24.984975] [INFO ] [MAIN ] INFA: Loaded 49194 existing records. [2025-10-27T19:22:25.161200] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:22:25.161390] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-27T19:22:25.161454] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-27T19:22:25.161716] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-27T19:22:25.161775] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-27T19:22:25.224169] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-27T19:22:25.524415] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:22:25.779680] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T19:22:26.014963] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-27T19:22:26.319433] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-27T19:22:26.322931] [INFO ] [REMOTE ] IIM: Full fetch complete (24722 records). [2025-10-27T19:22:26.323024] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-27T19:22:26.702174] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-27T19:22:26.702267] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-27T19:22:26.702850] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-27T19:22:26.702911] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-27T19:22:26.703599] [DEBUG] [LOCAL ] IIM: Trimmed 24722 records to 15363 (keeping 200 days of data) [2025-10-27T19:22:26.799726] [DEBUG] [LOCAL ] IIM: Primary data saved (15363 records). [2025-10-27T19:22:26.799852] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-27T19:22:26.799927] [INFO ] [MAIN ] Update Progress: 1105/2366 symbols completed. IIM took 23.5s. Estimated remaining: 2h 42m 30s. Rate: 7.8 symbols/min [2025-10-27T19:22:26.820725] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-27T19:22:26.973835] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:22:27.026061] [DEBUG] [LOCAL ] INFY: Loaded 54376 existing records from primary storage. [2025-10-27T19:22:27.026484] [INFO ] [MAIN ] INFY: Loaded 54376 existing records. [2025-10-27T19:22:27.208856] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:22:27.209146] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-27T19:22:27.209219] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-27T19:22:27.209434] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-27T19:22:27.209499] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-27T19:22:27.333195] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-27T19:22:27.607254] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:22:27.614897] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-27T19:22:28.336038] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T19:22:28.414957] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-27T19:22:29.155377] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-27T19:22:29.214967] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-27T19:22:29.778847] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T19:22:30.014974] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-27T19:22:30.496094] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-27T19:22:30.814993] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-27T19:22:31.607899] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T19:22:31.617191] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-27T19:22:32.028425] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T19:22:32.415008] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-27T19:22:32.753151] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T19:22:33.214941] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-27T19:22:34.014917] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-27T19:22:34.187092] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T19:22:34.341493] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-27T19:22:34.815014] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-27T19:22:35.363568] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T19:22:35.369351] [INFO ] [REMOTE ] IIPR: Full fetch complete (43550 records). [2025-10-27T19:22:35.369442] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-27T19:22:35.620191] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-27T19:22:35.746074] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-27T19:22:35.746153] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-27T19:22:35.746903] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-27T19:22:35.746966] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-27T19:22:35.747928] [DEBUG] [LOCAL ] IIPR: Trimmed 43550 records to 28414 (keeping 200 days of data) [2025-10-27T19:22:35.921997] [DEBUG] [LOCAL ] IIPR: Primary data saved (28414 records). [2025-10-27T19:22:35.922145] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-27T19:22:35.922244] [INFO ] [MAIN ] Update Progress: 1106/2366 symbols completed. IIPR took 31.4s. Estimated remaining: 2h 42m 24s. Rate: 7.8 symbols/min [2025-10-27T19:22:36.090972] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:22:36.137541] [DEBUG] [LOCAL ] ING: Loaded 51407 existing records from primary storage. [2025-10-27T19:22:36.137900] [INFO ] [MAIN ] ING: Loaded 51407 existing records. [2025-10-27T19:22:36.317896] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:22:36.318171] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-27T19:22:36.318247] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-27T19:22:36.318470] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-27T19:22:36.318596] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-27T19:22:36.424711] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-27T19:22:36.504035] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T19:22:36.788123] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:22:37.000591] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-27T19:22:37.214944] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-27T19:22:37.875399] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-27T19:22:38.015001] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-27T19:22:38.814958] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-27T19:22:39.128414] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-27T19:22:39.510549] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T19:22:39.614980] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-27T19:22:40.407162] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T19:22:40.417636] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-27T19:22:41.118103] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-27T19:22:41.214911] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-27T19:22:42.020029] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-27T19:22:42.035198] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T19:22:42.577508] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-27T19:22:42.814958] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-27T19:22:43.262941] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T19:22:43.614943] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-27T19:22:44.319832] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T19:22:44.414973] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-27T19:22:45.214910] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-27T19:22:45.325024] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-27T19:22:45.891344] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T19:22:46.014989] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-27T19:22:46.788841] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T19:22:46.814928] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-27T19:22:47.614916] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-27T19:22:47.771165] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-27T19:22:48.414952] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-27T19:22:48.528418] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T19:22:49.130903] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T19:22:49.214945] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-27T19:22:50.014980] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-27T19:22:50.282071] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-27T19:22:50.815009] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-27T19:22:51.113230] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-27T19:22:51.122088] [INFO ] [REMOTE ] IMAX: Full fetch complete (61306 records). [2025-10-27T19:22:51.122224] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-27T19:22:51.507972] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-27T19:22:51.508047] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-27T19:22:51.508906] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-27T19:22:51.508969] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-27T19:22:51.510394] [DEBUG] [LOCAL ] IMAX: Trimmed 61306 records to 43361 (keeping 200 days of data) [2025-10-27T19:22:51.621413] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-27T19:22:51.753972] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-27T19:22:51.805487] [DEBUG] [LOCAL ] IMAX: Primary data saved (43361 records). [2025-10-27T19:22:51.805604] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-27T19:22:51.805700] [INFO ] [MAIN ] Update Progress: 1107/2366 symbols completed. IMAX took 36.3s. Estimated remaining: 2h 42m 25s. Rate: 7.8 symbols/min [2025-10-27T19:22:51.980114] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:22:52.008304] [DEBUG] [LOCAL ] INGM: Loaded 28491 existing records from primary storage. [2025-10-27T19:22:52.008557] [INFO ] [MAIN ] INGM: Loaded 28491 existing records. [2025-10-27T19:22:52.194590] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:22:52.194821] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-27T19:22:52.194875] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-27T19:22:52.195043] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-27T19:22:52.195085] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-27T19:22:52.420946] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-27T19:22:52.563901] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:22:52.716491] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-27T19:22:53.214967] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-27T19:22:53.437618] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T19:22:53.673591] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T19:22:54.015000] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-27T19:22:54.791127] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T19:22:54.801761] [INFO ] [REMOTE ] INFY: Full fetch complete (77750 records). [2025-10-27T19:22:54.801918] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-27T19:22:54.823427] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-27T19:22:55.208496] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-27T19:22:55.215612] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-27T19:22:55.216636] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-27T19:22:55.216758] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-27T19:22:55.231174] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T19:22:55.239385] [INFO ] [REMOTE ] INFA: Full fetch complete (70665 records). [2025-10-27T19:22:55.239532] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-27T19:22:55.239621] [DEBUG] [LOCAL ] INFY: Trimmed 77750 records to 53595 (keeping 200 days of data) [2025-10-27T19:22:55.620880] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-27T19:22:55.886540] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-27T19:22:55.921193] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-27T19:22:55.922245] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-27T19:22:55.922472] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-27T19:22:55.954721] [DEBUG] [LOCAL ] INFA: Trimmed 70665 records to 48355 (keeping 200 days of data) [2025-10-27T19:22:56.059065] [DEBUG] [LOCAL ] INFY: Primary data saved (53595 records). [2025-10-27T19:22:56.064372] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-27T19:22:56.068731] [INFO ] [MAIN ] Update Progress: 1108/2366 symbols completed. INFY took 29.3s. Estimated remaining: 2h 42m 14s. Rate: 7.8 symbols/min [2025-10-27T19:22:56.338497] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T19:22:56.366799] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:22:56.423328] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-27T19:22:56.445311] [DEBUG] [LOCAL ] INGR: Loaded 34234 existing records from primary storage. [2025-10-27T19:22:56.460959] [INFO ] [MAIN ] INGR: Loaded 34234 existing records. [2025-10-27T19:22:56.579990] [DEBUG] [LOCAL ] INFA: Primary data saved (48355 records). [2025-10-27T19:22:56.580571] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-27T19:22:56.580696] [INFO ] [MAIN ] Update Progress: 1109/2366 symbols completed. INFA took 31.8s. Estimated remaining: 2h 41m 58s. Rate: 7.8 symbols/min [2025-10-27T19:22:56.758619] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:22:56.764602] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-27T19:22:56.769805] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-27T19:22:56.785390] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-27T19:22:56.805891] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-27T19:22:56.910616] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:22:57.225783] [DEBUG] [LOCAL ] INN: Loaded 41981 existing records from primary storage. [2025-10-27T19:22:57.224251] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:22:57.226509] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-27T19:22:57.226217] [INFO ] [MAIN ] INN: Loaded 41981 existing records. [2025-10-27T19:22:57.432980] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:22:57.436205] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-27T19:22:57.437745] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-27T19:22:57.437866] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-27T19:22:57.447792] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-27T19:22:57.447977] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-27T19:22:57.561137] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T19:22:57.828562] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:22:58.014984] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-27T19:22:58.635973] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T19:22:58.815025] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-27T19:22:58.963116] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-27T19:22:59.614922] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-27T19:23:00.415010] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-27T19:23:01.214996] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-27T19:23:05.810219] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (7.00 seconds). [2025-10-27T19:23:05.818253] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-27T19:23:05.969516] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (5.55 seconds). [2025-10-27T19:23:05.977034] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-27T19:23:06.034407] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (6.42 seconds). [2025-10-27T19:23:06.045967] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-27T19:23:06.449140] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (5.23 seconds). [2025-10-27T19:23:06.457733] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-27T19:23:07.645890] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-27T19:23:07.654124] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-27T19:23:08.992183] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (2.95 seconds). [2025-10-27T19:23:09.002794] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-27T19:23:09.165571] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (3.35 seconds). [2025-10-27T19:23:09.173638] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-27T19:23:09.398290] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (2.94 seconds). [2025-10-27T19:23:09.405201] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-27T19:23:09.640075] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-27T19:23:09.649382] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-27T19:23:10.316192] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T19:23:10.326855] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-27T19:23:10.757120] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-27T19:23:10.763464] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-27T19:23:10.823343] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T19:23:10.830540] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-27T19:23:11.023187] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-27T19:23:11.614918] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-27T19:23:11.681598] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T19:23:11.691915] [INFO ] [REMOTE ] ING: Full fetch complete (73774 records). [2025-10-27T19:23:11.692063] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-27T19:23:11.746582] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T19:23:12.120133] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-27T19:23:12.120221] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-27T19:23:12.121169] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-27T19:23:12.121249] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-27T19:23:12.140614] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-27T19:23:12.147776] [DEBUG] [LOCAL ] ING: Trimmed 73774 records to 50616 (keeping 200 days of data) [2025-10-27T19:23:12.427685] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-27T19:23:12.446933] [DEBUG] [LOCAL ] ING: Primary data saved (50616 records). [2025-10-27T19:23:12.447130] [INFO ] [MAIN ] ING: Full history saved. [2025-10-27T19:23:12.447213] [INFO ] [MAIN ] Update Progress: 1110/2366 symbols completed. ING took 36.5s. Estimated remaining: 2h 41m 59s. Rate: 7.8 symbols/min [2025-10-27T19:23:12.620961] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:23:12.621077] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-27T19:23:12.621113] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-27T19:23:12.621218] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-27T19:23:12.621259] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-27T19:23:12.621300] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-27T19:23:12.621331] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-27T19:23:12.981725] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:23:13.008185] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T19:23:13.214918] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-10-27T19:23:13.558051] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-27T19:23:13.600456] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-27T19:23:14.014944] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-27T19:23:14.814978] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-10-27T19:23:15.312118] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T19:23:15.614907] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-27T19:23:16.289337] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T19:23:16.414955] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-10-27T19:23:17.214947] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-27T19:23:17.796435] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-27T19:23:17.870475] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T19:23:18.014953] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-27T19:23:18.759326] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-27T19:23:18.814917] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-27T19:23:19.087587] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T19:23:19.614988] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-10-27T19:23:20.393008] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T19:23:20.414908] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-27T19:23:20.687565] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-27T19:23:21.214940] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-27T19:23:22.014926] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-27T19:23:22.370530] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-27T19:23:22.378139] [INFO ] [REMOTE ] INGR: Full fetch complete (50874 records). [2025-10-27T19:23:22.378244] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-27T19:23:22.772679] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T19:23:22.798091] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-27T19:23:22.798263] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-27T19:23:22.799087] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-27T19:23:22.799169] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-27T19:23:22.800431] [DEBUG] [LOCAL ] INGR: Trimmed 50874 records to 33584 (keeping 200 days of data) [2025-10-27T19:23:22.853870] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-10-27T19:23:23.007488] [DEBUG] [LOCAL ] INGR: Primary data saved (33584 records). [2025-10-27T19:23:23.007699] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-27T19:23:23.007790] [INFO ] [MAIN ] Update Progress: 1111/2366 symbols completed. INGR took 26.9s. Estimated remaining: 2h 41m 55s. Rate: 7.8 symbols/min [2025-10-27T19:23:23.178528] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T19:23:23.195883] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:23:23.239764] [DEBUG] [LOCAL ] INSP: Loaded 39188 existing records from primary storage. [2025-10-27T19:23:23.240070] [INFO ] [MAIN ] INSP: Loaded 39188 existing records. [2025-10-27T19:23:23.418789] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:23:23.419018] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-27T19:23:23.419092] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-27T19:23:23.419303] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-27T19:23:23.419367] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-27T19:23:23.620317] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-27T19:23:23.783639] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:23:23.943282] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-27T19:23:24.414910] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-10-27T19:23:24.458442] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-27T19:23:25.064230] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-27T19:23:25.214971] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-27T19:23:26.014997] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-10-27T19:23:26.613553] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-27T19:23:26.619428] [INFO ] [REMOTE ] INGM: Full fetch complete (41701 records). [2025-10-27T19:23:26.619596] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-27T19:23:26.820079] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-27T19:23:27.010169] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-27T19:23:27.010245] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-27T19:23:27.011159] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-27T19:23:27.011220] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-27T19:23:27.012253] [DEBUG] [LOCAL ] INGM: Trimmed 41701 records to 27728 (keeping 200 days of data) [2025-10-27T19:23:27.176501] [DEBUG] [LOCAL ] INGM: Primary data saved (27728 records). [2025-10-27T19:23:27.176634] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-27T19:23:27.176955] [INFO ] [MAIN ] Update Progress: 1112/2366 symbols completed. INGM took 35.4s. Estimated remaining: 2h 41m 43s. Rate: 7.8 symbols/min [2025-10-27T19:23:27.347575] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:23:27.383592] [DEBUG] [LOCAL ] INSW: Loaded 39745 existing records from primary storage. [2025-10-27T19:23:27.383900] [INFO ] [MAIN ] INSW: Loaded 39745 existing records. [2025-10-27T19:23:27.565345] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:23:27.565627] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-27T19:23:27.565962] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-27T19:23:27.566365] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-27T19:23:27.566490] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-27T19:23:27.631688] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-27T19:23:27.706382] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T19:23:27.977543] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:23:28.381119] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T19:23:28.414969] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-27T19:23:28.522678] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-27T19:23:29.214978] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-27T19:23:29.804464] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-27T19:23:30.014993] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-27T19:23:30.743087] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T19:23:30.814948] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-27T19:23:31.136718] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-27T19:23:31.147942] [INFO ] [REMOTE ] INN: Full fetch complete (57656 records). [2025-10-27T19:23:31.148078] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-27T19:23:31.526438] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-27T19:23:31.526527] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-27T19:23:31.527472] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-27T19:23:31.527536] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-27T19:23:31.528678] [DEBUG] [LOCAL ] INN: Trimmed 57656 records to 41159 (keeping 200 days of data) [2025-10-27T19:23:31.617542] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-10-27T19:23:31.768494] [DEBUG] [LOCAL ] INN: Primary data saved (41159 records). [2025-10-27T19:23:31.768705] [INFO ] [MAIN ] INN: Full history saved. [2025-10-27T19:23:31.768846] [INFO ] [MAIN ] Update Progress: 1113/2366 symbols completed. INN took 35.2s. Estimated remaining: 2h 41m 32s. Rate: 7.8 symbols/min [2025-10-27T19:23:31.956087] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:23:31.953932] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T19:23:32.009370] [DEBUG] [LOCAL ] INVH: Loaded 53967 existing records from primary storage. [2025-10-27T19:23:32.009694] [INFO ] [MAIN ] INVH: Loaded 53967 existing records. [2025-10-27T19:23:32.181933] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:23:32.182122] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-27T19:23:32.182169] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-27T19:23:32.182470] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-27T19:23:32.182507] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-27T19:23:32.420069] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-27T19:23:32.555366] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:23:32.911624] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T19:23:33.215005] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-27T19:23:33.444693] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T19:23:34.014957] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-10-27T19:23:34.814980] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-27T19:23:34.962604] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-27T19:23:35.621499] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-27T19:23:35.624081] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-27T19:23:36.141164] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T19:23:36.414986] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-10. [2025-10-27T19:23:36.711957] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-27T19:23:37.214946] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-27T19:23:37.774245] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-27T19:23:37.779713] [INFO ] [REMOTE ] INR: Full fetch complete (37858 records). [2025-10-27T19:23:37.779794] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-10-27T19:23:37.963467] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 186 unique days, need 200 days [2025-10-27T19:23:37.964044] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:23:37.964135] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:23:37.964225] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-27T19:23:37.964311] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-27T19:23:37.964362] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-27T19:23:37.964407] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-27T19:23:37.964464] [INFO ] [MAIN ] Update Progress: 1114/2366 symbols completed. INR took 25.5s. Estimated remaining: 2h 41m 22s. Rate: 7.8 symbols/min [2025-10-27T19:23:38.025006] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-27T19:23:38.141249] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:23:38.162777] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T19:23:38.193626] [DEBUG] [LOCAL ] INVX: Loaded 29473 existing records from primary storage. [2025-10-27T19:23:38.193918] [INFO ] [MAIN ] INVX: Loaded 29473 existing records. [2025-10-27T19:23:38.369970] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:23:38.370146] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-27T19:23:38.370191] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-27T19:23:38.370363] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-27T19:23:38.370401] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-27T19:23:38.721167] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:23:38.814962] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-27T19:23:39.262753] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T19:23:39.614969] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-27T19:23:40.234911] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T19:23:40.415039] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-27T19:23:41.220035] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-27T19:23:41.231625] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T19:23:41.448711] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-27T19:23:42.014990] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-27T19:23:42.625114] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T19:23:42.814916] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-27T19:23:43.204853] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-27T19:23:43.614959] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-27T19:23:44.008858] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T19:23:44.414959] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-27T19:23:44.694445] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-27T19:23:45.214999] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-27T19:23:45.985965] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T19:23:46.014899] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-27T19:23:46.692553] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T19:23:46.814913] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-27T19:23:47.461454] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T19:23:47.614912] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-27T19:23:48.201878] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-27T19:23:48.414912] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-27T19:23:48.975124] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-27T19:23:49.215010] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-27T19:23:49.802238] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-27T19:23:50.014991] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-27T19:23:50.185360] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-27T19:23:50.814939] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-27T19:23:51.374835] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T19:23:51.615036] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-27T19:23:52.371184] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T19:23:52.414921] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-27T19:23:52.711167] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-27T19:23:52.718065] [INFO ] [REMOTE ] INSW: Full fetch complete (59153 records). [2025-10-27T19:23:52.718174] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-27T19:23:53.110345] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-27T19:23:53.110464] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-27T19:23:53.111557] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-27T19:23:53.111631] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-27T19:23:53.113230] [DEBUG] [LOCAL ] INSW: Trimmed 59153 records to 38828 (keeping 200 days of data) [2025-10-27T19:23:53.226213] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-27T19:23:53.385826] [DEBUG] [LOCAL ] INSW: Primary data saved (38828 records). [2025-10-27T19:23:53.386028] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-27T19:23:53.386969] [INFO ] [MAIN ] Update Progress: 1115/2366 symbols completed. INSW took 26.2s. Estimated remaining: 2h 41m 23s. Rate: 7.8 symbols/min [2025-10-27T19:23:53.566072] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:23:53.602959] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T19:23:53.658349] [DEBUG] [LOCAL ] IONQ: Loaded 54568 existing records from primary storage. [2025-10-27T19:23:53.658698] [INFO ] [MAIN ] IONQ: Loaded 54568 existing records. [2025-10-27T19:23:53.830002] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:23:53.830178] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-27T19:23:53.830224] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-27T19:23:53.830418] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-27T19:23:53.830455] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-27T19:23:54.022475] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-27T19:23:54.189954] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:23:54.206507] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T19:23:54.814942] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-27T19:23:55.426923] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T19:23:55.614982] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-27T19:23:55.963160] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T19:23:56.414955] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-27T19:23:57.093992] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T19:23:57.214922] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-27T19:23:57.607561] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T19:23:58.014930] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-27T19:23:58.804496] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T19:23:58.815215] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-27T19:23:58.936726] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T19:23:59.614981] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-27T19:24:00.415029] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-27T19:24:01.121854] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T19:24:01.214956] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-27T19:24:01.423832] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-27T19:24:02.015016] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-27T19:24:02.814985] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-27T19:24:02.928864] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-27T19:24:02.937442] [INFO ] [REMOTE ] INSP: Full fetch complete (53937 records). [2025-10-27T19:24:02.937707] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-27T19:24:03.363931] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-27T19:24:03.387971] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-27T19:24:03.388683] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-27T19:24:03.390291] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-27T19:24:03.390420] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-27T19:24:03.392244] [DEBUG] [LOCAL ] INSP: Trimmed 53937 records to 38599 (keeping 200 days of data) [2025-10-27T19:24:03.615683] [DEBUG] [LOCAL ] INSP: Primary data saved (38599 records). [2025-10-27T19:24:03.615767] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-27T19:24:03.616760] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-27T19:24:03.617259] [INFO ] [MAIN ] Update Progress: 1116/2366 symbols completed. INSP took 40.6s. Estimated remaining: 2h 41m 18s. Rate: 7.7 symbols/min [2025-10-27T19:24:03.786494] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:24:03.837005] [DEBUG] [LOCAL ] IOT: Loaded 54232 existing records from primary storage. [2025-10-27T19:24:03.837299] [INFO ] [MAIN ] IOT: Loaded 54232 existing records. [2025-10-27T19:24:04.015941] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:24:04.016092] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-27T19:24:04.016138] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-27T19:24:04.016311] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-27T19:24:04.016349] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-27T19:24:04.375318] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:24:04.417216] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-27T19:24:04.419808] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-27T19:24:04.477905] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T19:24:04.485891] [INFO ] [REMOTE ] INVX: Full fetch complete (42610 records). [2025-10-27T19:24:04.486037] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-27T19:24:04.863067] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-27T19:24:04.863141] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-27T19:24:04.863912] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-27T19:24:04.863982] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-27T19:24:04.864972] [DEBUG] [LOCAL ] INVX: Trimmed 42610 records to 28642 (keeping 200 days of data) [2025-10-27T19:24:05.026184] [DEBUG] [LOCAL ] INVX: Primary data saved (28642 records). [2025-10-27T19:24:05.026308] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-27T19:24:05.026391] [INFO ] [MAIN ] Update Progress: 1117/2366 symbols completed. INVX took 27.1s. Estimated remaining: 2h 41m 3s. Rate: 7.8 symbols/min [2025-10-27T19:24:05.214922] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-27T19:24:05.274116] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T19:24:05.284188] [INFO ] [REMOTE ] INVH: Full fetch complete (76990 records). [2025-10-27T19:24:05.284311] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-27T19:24:05.668022] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-27T19:24:05.668103] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-27T19:24:05.669162] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-27T19:24:05.669227] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-27T19:24:05.670762] [DEBUG] [LOCAL ] INVH: Trimmed 76990 records to 53185 (keeping 200 days of data) [2025-10-27T19:24:05.980589] [DEBUG] [LOCAL ] INVH: Primary data saved (53185 records). [2025-10-27T19:24:05.980743] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-27T19:24:05.980841] [INFO ] [MAIN ] Update Progress: 1118/2366 symbols completed. INVH took 34.2s. Estimated remaining: 2h 40m 48s. Rate: 7.8 symbols/min [2025-10-27T19:24:06.366159] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-27T19:24:06.376561] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-27T19:24:07.651697] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-27T19:24:07.662913] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-27T19:24:08.023448] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T19:24:08.033543] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-27T19:24:09.422600] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T19:24:09.433597] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-27T19:24:09.973812] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-27T19:24:09.986817] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-27T19:24:10.811512] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T19:24:10.822639] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-27T19:24:12.595213] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-27T19:24:12.607081] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-27T19:24:12.641123] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T19:24:12.653127] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-27T19:24:14.423092] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-27T19:24:14.434080] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-27T19:24:14.993945] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-27T19:24:15.009608] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-27T19:24:16.396733] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-27T19:24:16.408236] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-27T19:24:17.405156] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-27T19:24:17.416883] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-27T19:24:17.940711] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T19:24:17.952075] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-27T19:24:19.625409] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-27T19:24:19.643181] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-27T19:24:19.876809] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-27T19:24:19.887928] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-27T19:24:22.027158] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-27T19:24:22.037364] [INFO ] [REMOTE ] IOT: Full fetch complete (77519 records). [2025-10-27T19:24:22.037493] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-27T19:24:22.455325] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-27T19:24:22.467727] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-27T19:24:22.468874] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-27T19:24:22.469220] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-27T19:24:22.471871] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-27T19:24:22.484030] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-27T19:24:22.485393] [DEBUG] [LOCAL ] IOT: Trimmed 77519 records to 53443 (keeping 200 days of data) [2025-10-27T19:24:22.792375] [DEBUG] [LOCAL ] IOT: Primary data saved (53443 records). [2025-10-27T19:24:22.792753] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-27T19:24:22.792852] [INFO ] [MAIN ] Update Progress: 1119/2366 symbols completed. IOT took 19.2s. Estimated remaining: 2h 40m 50s. Rate: 7.8 symbols/min [2025-10-27T19:24:25.307534] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.82 seconds). [2025-10-27T19:24:25.317714] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-27T19:24:25.317843] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-27T19:24:25.723758] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-27T19:24:25.723845] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-27T19:24:25.725538] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-27T19:24:25.725606] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-27T19:24:25.727216] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-10-27T19:24:26.071495] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-10-27T19:24:26.071629] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-27T19:24:26.072347] [INFO ] [MAIN ] Update Progress: 1120/2366 symbols completed. IONQ took 32.7s. Estimated remaining: 2h 40m 38s. Rate: 7.8 symbols/min [2025-10-27T19:24:26.688565] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:24:26.798617] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:24:26.808919] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:24:26.791612] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:24:26.825277] [DEBUG] [LOCAL ] IQI: Loaded 17915 existing records from primary storage. [2025-10-27T19:24:26.825684] [INFO ] [MAIN ] IQI: Loaded 17915 existing records. [2025-10-27T19:24:26.952616] [DEBUG] [LOCAL ] IPI: Loaded 21710 existing records from primary storage. [2025-10-27T19:24:26.959388] [INFO ] [MAIN ] IPI: Loaded 21710 existing records. [2025-10-27T19:24:27.204530] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:24:27.234897] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-27T19:24:27.259697] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-27T19:24:27.260561] [DEBUG] [LOCAL ] IPG: Loaded 54110 existing records from primary storage. [2025-10-27T19:24:27.261355] [INFO ] [MAIN ] IPG: Loaded 54110 existing records. [2025-10-27T19:24:27.262606] [DEBUG] [LOCAL ] IP: Loaded 54078 existing records from primary storage. [2025-10-27T19:24:27.278472] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-27T19:24:27.278684] [INFO ] [MAIN ] IP: Loaded 54078 existing records. [2025-10-27T19:24:27.294948] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-27T19:24:27.551910] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:24:27.607738] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-27T19:24:27.636069] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-27T19:24:27.678414] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-27T19:24:27.687350] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-27T19:24:27.810260] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:24:27.964864] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:24:27.935443] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-27T19:24:27.997980] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-27T19:24:28.013470] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-27T19:24:28.047093] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-27T19:24:28.047243] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-27T19:24:28.041628] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-27T19:24:28.104218] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-27T19:24:28.130161] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-27T19:24:28.790445] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:24:28.840104] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-27T19:24:29.081603] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:24:29.097822] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-27T19:24:29.242156] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:24:29.256870] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-27T19:24:29.278894] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:24:29.279225] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-27T19:24:29.719409] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-27T19:24:29.723928] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-27T19:24:29.792462] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T19:24:29.796714] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-27T19:24:30.426069] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T19:24:30.430188] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-27T19:24:30.691051] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T19:24:30.701426] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-27T19:24:30.758679] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T19:24:30.763926] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-27T19:24:31.014892] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-27T19:24:31.025547] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-27T19:24:31.319844] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T19:24:31.323800] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-27T19:24:31.525248] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T19:24:31.530492] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-27T19:24:31.970722] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T19:24:31.980822] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-27T19:24:32.342473] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-27T19:24:32.348061] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-27T19:24:32.430719] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T19:24:32.442974] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-27T19:24:32.637452] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-27T19:24:32.642875] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-27T19:24:33.262316] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T19:24:33.266107] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-27T19:24:33.370634] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T19:24:33.381627] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-27T19:24:33.488299] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-27T19:24:33.493973] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-27T19:24:33.901524] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-27T19:24:34.014967] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-27T19:24:34.375597] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-27T19:24:34.606604] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-27T19:24:34.683453] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-27T19:24:34.749571] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T19:24:34.814954] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-27T19:24:35.614921] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-27T19:24:35.863945] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-27T19:24:36.414974] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-27T19:24:37.214947] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-27T19:24:37.433544] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T19:24:37.738677] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T19:24:37.873142] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T19:24:38.014968] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-27T19:24:38.815029] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-27T19:24:39.614932] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-27T19:24:39.802876] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-27T19:24:39.827896] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-27T19:24:40.414934] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-27T19:24:41.121090] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T19:24:41.214905] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-27T19:24:41.420123] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-27T19:24:42.014978] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-27T19:24:42.562573] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T19:24:42.755168] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T19:24:42.758517] [INFO ] [REMOTE ] IQI: Full fetch complete (26176 records). [2025-10-27T19:24:42.758592] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-27T19:24:42.820110] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-27T19:24:43.143020] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-27T19:24:43.143093] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-27T19:24:43.143749] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-27T19:24:43.143812] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-27T19:24:43.144474] [DEBUG] [LOCAL ] IQI: Trimmed 26176 records to 17496 (keeping 200 days of data) [2025-10-27T19:24:43.252466] [DEBUG] [LOCAL ] IQI: Primary data saved (17496 records). [2025-10-27T19:24:43.252584] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-27T19:24:43.252701] [INFO ] [MAIN ] Update Progress: 1121/2366 symbols completed. IQI took 17.2s. Estimated remaining: 2h 40m 40s. Rate: 7.7 symbols/min [2025-10-27T19:24:43.439059] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:24:43.491027] [DEBUG] [LOCAL ] IQV: Loaded 50707 existing records from primary storage. [2025-10-27T19:24:43.491348] [INFO ] [MAIN ] IQV: Loaded 50707 existing records. [2025-10-27T19:24:43.629183] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-27T19:24:43.669509] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:24:43.669734] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-27T19:24:43.669788] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-27T19:24:43.669970] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-27T19:24:43.670011] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-27T19:24:44.055573] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:24:44.414982] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-27T19:24:44.542748] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T19:24:44.844468] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-27T19:24:45.214934] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-27T19:24:46.014980] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-27T19:24:46.123740] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T19:24:46.562534] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T19:24:46.567270] [INFO ] [REMOTE ] IPI: Full fetch complete (30410 records). [2025-10-27T19:24:46.567350] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-27T19:24:46.820176] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-27T19:24:46.930021] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-27T19:24:46.930093] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-27T19:24:46.930693] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-27T19:24:46.930753] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-27T19:24:46.931443] [DEBUG] [LOCAL ] IPI: Trimmed 30410 records to 21303 (keeping 200 days of data) [2025-10-27T19:24:47.051852] [DEBUG] [LOCAL ] IPI: Primary data saved (21303 records). [2025-10-27T19:24:47.051991] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-27T19:24:47.052083] [INFO ] [MAIN ] Update Progress: 1122/2366 symbols completed. IPI took 21.0s. Estimated remaining: 2h 40m 28s. Rate: 7.8 symbols/min [2025-10-27T19:24:47.217540] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:24:47.266580] [DEBUG] [LOCAL ] IR: Loaded 53502 existing records from primary storage. [2025-10-27T19:24:47.266965] [INFO ] [MAIN ] IR: Loaded 53502 existing records. [2025-10-27T19:24:47.444155] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:24:47.444367] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-27T19:24:47.444437] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-27T19:24:47.444685] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-27T19:24:47.444751] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-27T19:24:47.616855] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-27T19:24:47.765762] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-27T19:24:47.862025] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:24:48.414912] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-27T19:24:48.689489] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-27T19:24:49.214954] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-27T19:24:49.250231] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T19:24:50.014988] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-27T19:24:50.096128] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T19:24:50.814967] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-27T19:24:50.985303] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-27T19:24:51.361212] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-27T19:24:51.614938] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-27T19:24:52.414929] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-27T19:24:52.461460] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T19:24:53.214922] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-27T19:24:53.404820] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-27T19:24:54.014986] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-27T19:24:54.451673] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-27T19:24:54.462359] [INFO ] [REMOTE ] IPG: Full fetch complete (77443 records). [2025-10-27T19:24:54.462501] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-27T19:24:54.816298] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-27T19:24:54.856724] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-27T19:24:54.856814] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-27T19:24:54.857837] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-27T19:24:54.857944] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-27T19:24:54.859688] [DEBUG] [LOCAL ] IPG: Trimmed 77443 records to 53328 (keeping 200 days of data) [2025-10-27T19:24:55.076171] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-27T19:24:55.236470] [DEBUG] [LOCAL ] IPG: Primary data saved (53328 records). [2025-10-27T19:24:55.236596] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-27T19:24:55.237192] [INFO ] [MAIN ] Update Progress: 1123/2366 symbols completed. IPG took 29.2s. Estimated remaining: 2h 40m 21s. Rate: 7.8 symbols/min [2025-10-27T19:24:55.409329] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:24:55.456767] [DEBUG] [LOCAL ] IRM: Loaded 49536 existing records from primary storage. [2025-10-27T19:24:55.457062] [INFO ] [MAIN ] IRM: Loaded 49536 existing records. [2025-10-27T19:24:55.622903] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-27T19:24:55.664904] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:24:55.667763] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-27T19:24:55.678565] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-27T19:24:55.678946] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-27T19:24:55.679592] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-27T19:24:55.679693] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-27T19:24:56.024938] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:24:56.414922] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-27T19:24:56.557232] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-27T19:24:57.214958] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-27T19:24:57.284871] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T19:24:57.295280] [INFO ] [REMOTE ] IP: Full fetch complete (77423 records). [2025-10-27T19:24:57.295447] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-27T19:24:57.687113] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-27T19:24:57.687192] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-27T19:24:57.688189] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-27T19:24:57.688253] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-27T19:24:57.689618] [DEBUG] [LOCAL ] IP: Trimmed 77423 records to 53297 (keeping 200 days of data) [2025-10-27T19:24:58.017370] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-27T19:24:58.019320] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-27T19:24:58.049150] [DEBUG] [LOCAL ] IP: Primary data saved (53297 records). [2025-10-27T19:24:58.049766] [INFO ] [MAIN ] IP: Full history saved. [2025-10-27T19:24:58.049871] [INFO ] [MAIN ] Update Progress: 1124/2366 symbols completed. IP took 32.0s. Estimated remaining: 2h 40m 8s. Rate: 7.8 symbols/min [2025-10-27T19:24:58.223690] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:24:58.250145] [DEBUG] [LOCAL ] IRS: Loaded 23670 existing records from primary storage. [2025-10-27T19:24:58.250406] [INFO ] [MAIN ] IRS: Loaded 23670 existing records. [2025-10-27T19:24:58.436031] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:24:58.436236] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-27T19:24:58.436284] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-27T19:24:58.436465] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-27T19:24:58.436523] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-27T19:24:58.799623] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:24:58.814930] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-27T19:24:58.872517] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T19:24:59.489444] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T19:24:59.614920] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-27T19:24:59.689121] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T19:25:00.414945] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-27T19:25:01.214985] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-27T19:25:01.521013] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-27T19:25:02.015023] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-27T19:25:02.365821] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-27T19:25:02.814978] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-27T19:25:03.463491] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-27T19:25:03.580149] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-27T19:25:03.614928] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-27T19:25:03.662932] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T19:25:04.414943] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-27T19:25:05.063259] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T19:25:05.214953] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-27T19:25:05.947006] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T19:25:06.014902] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-27T19:25:06.767470] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-27T19:25:06.814944] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-27T19:25:07.268786] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T19:25:07.614962] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-27T19:25:08.414971] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-27T19:25:08.733034] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-27T19:25:08.763431] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T19:25:09.214951] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-27T19:25:09.834538] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-27T19:25:09.849453] [INFO ] [REMOTE ] IQV: Full fetch complete (72667 records). [2025-10-27T19:25:09.849604] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-27T19:25:10.014916] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-27T19:25:10.269420] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-27T19:25:10.269512] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-27T19:25:10.270470] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-27T19:25:10.270597] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-27T19:25:10.323208] [DEBUG] [LOCAL ] IQV: Trimmed 72667 records to 49937 (keeping 200 days of data) [2025-10-27T19:25:10.323087] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-27T19:25:10.623696] [DEBUG] [LOCAL ] IQV: Primary data saved (49937 records). [2025-10-27T19:25:10.623820] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-27T19:25:10.624477] [INFO ] [MAIN ] Update Progress: 1125/2366 symbols completed. IQV took 27.4s. Estimated remaining: 2h 40m 6s. Rate: 7.8 symbols/min [2025-10-27T19:25:10.794014] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:25:10.805259] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-27T19:25:10.814904] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-27T19:25:10.862242] [DEBUG] [LOCAL ] IRT: Loaded 51098 existing records from primary storage. [2025-10-27T19:25:10.862562] [INFO ] [MAIN ] IRT: Loaded 51098 existing records. [2025-10-27T19:25:11.033776] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:25:11.033983] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-27T19:25:11.034029] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-27T19:25:11.034225] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-27T19:25:11.034263] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-27T19:25:11.378061] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:25:11.614927] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-27T19:25:11.839768] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T19:25:12.414983] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-27T19:25:12.807456] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T19:25:13.214970] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-27T19:25:13.696844] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-27T19:25:13.869561] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-27T19:25:14.014951] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-27T19:25:14.814948] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-27T19:25:15.559585] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-27T19:25:15.614899] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-27T19:25:16.171138] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T19:25:16.414922] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-27T19:25:16.835380] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-27T19:25:17.096388] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-27T19:25:17.214908] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-27T19:25:18.014944] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-27T19:25:18.815015] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-27T19:25:18.909208] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-27T19:25:18.957230] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-27T19:25:18.967441] [INFO ] [REMOTE ] IR: Full fetch complete (76477 records). [2025-10-27T19:25:18.967569] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-27T19:25:19.349194] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-27T19:25:19.349270] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-27T19:25:19.350666] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-27T19:25:19.350728] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-27T19:25:19.352093] [DEBUG] [LOCAL ] IR: Trimmed 76477 records to 52720 (keeping 200 days of data) [2025-10-27T19:25:19.618517] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-27T19:25:19.663222] [DEBUG] [LOCAL ] IR: Primary data saved (52720 records). [2025-10-27T19:25:19.663365] [INFO ] [MAIN ] IR: Full history saved. [2025-10-27T19:25:19.663784] [INFO ] [MAIN ] Update Progress: 1126/2366 symbols completed. IR took 32.6s. Estimated remaining: 2h 39m 59s. Rate: 7.8 symbols/min [2025-10-27T19:25:19.833028] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:25:19.850864] [DEBUG] [LOCAL ] ISD: Loaded 15824 existing records from primary storage. [2025-10-27T19:25:19.851106] [INFO ] [MAIN ] ISD: Loaded 15824 existing records. [2025-10-27T19:25:20.032014] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:25:20.032258] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-27T19:25:20.032325] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-27T19:25:20.032615] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-27T19:25:20.032715] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-27T19:25:20.341119] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T19:25:20.425836] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-27T19:25:20.432449] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:25:21.214944] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-27T19:25:21.318894] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T19:25:21.859284] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T19:25:21.865490] [INFO ] [REMOTE ] IRS: Full fetch complete (32676 records). [2025-10-27T19:25:21.865590] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-27T19:25:22.015521] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-27T19:25:22.243200] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-27T19:25:22.243277] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-27T19:25:22.243991] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-27T19:25:22.244055] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-27T19:25:22.244782] [DEBUG] [LOCAL ] IRS: Trimmed 32676 records to 23461 (keeping 200 days of data) [2025-10-27T19:25:22.374575] [DEBUG] [LOCAL ] IRS: Primary data saved (23461 records). [2025-10-27T19:25:22.374727] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-27T19:25:22.374811] [INFO ] [MAIN ] Update Progress: 1127/2366 symbols completed. IRS took 24.3s. Estimated remaining: 2h 39m 46s. Rate: 7.8 symbols/min [2025-10-27T19:25:22.540189] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:25:22.580368] [DEBUG] [LOCAL ] IT: Loaded 42830 existing records from primary storage. [2025-10-27T19:25:22.580679] [INFO ] [MAIN ] IT: Loaded 42830 existing records. [2025-10-27T19:25:22.753378] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:25:22.753634] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-27T19:25:22.753716] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-27T19:25:22.753896] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-27T19:25:22.753933] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-27T19:25:22.815752] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-27T19:25:23.108242] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:25:23.167579] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-27T19:25:23.614928] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-27T19:25:23.801217] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-27T19:25:23.848507] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-27T19:25:24.414997] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-27T19:25:24.909879] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-27T19:25:25.214977] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-27T19:25:25.367367] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T19:25:26.014982] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-27T19:25:26.507584] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-27T19:25:26.814916] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-27T19:25:27.006000] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T19:25:27.614963] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-27T19:25:28.030327] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T19:25:28.414982] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-27T19:25:29.205116] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T19:25:29.214941] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-27T19:25:29.604260] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T19:25:30.014995] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-27T19:25:30.758758] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T19:25:30.814971] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-27T19:25:31.285271] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T19:25:31.433622] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-27T19:25:31.614939] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-27T19:25:32.414971] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-27T19:25:33.007302] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-27T19:25:33.214569] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-27T19:25:33.224600] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-27T19:25:34.015007] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-27T19:25:34.481199] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T19:25:34.814947] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-27T19:25:35.268685] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T19:25:35.614960] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-27T19:25:36.384453] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-27T19:25:36.414938] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-27T19:25:36.931002] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-27T19:25:37.214912] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-27T19:25:37.376342] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-27T19:25:38.014941] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-27T19:25:38.256510] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T19:25:38.814985] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-27T19:25:39.614922] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-27T19:25:39.780064] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-27T19:25:39.789150] [INFO ] [REMOTE ] IRM: Full fetch complete (71911 records). [2025-10-27T19:25:39.789289] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-27T19:25:40.178618] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-27T19:25:40.178757] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-27T19:25:40.179765] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-27T19:25:40.179830] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-27T19:25:40.181210] [DEBUG] [LOCAL ] IRM: Trimmed 71911 records to 48673 (keeping 200 days of data) [2025-10-27T19:25:40.421673] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-27T19:25:40.482184] [DEBUG] [LOCAL ] IRM: Primary data saved (48673 records). [2025-10-27T19:25:40.482538] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-27T19:25:40.482671] [INFO ] [MAIN ] Update Progress: 1128/2366 symbols completed. IRM took 45.2s. Estimated remaining: 2h 39m 50s. Rate: 7.7 symbols/min [2025-10-27T19:25:40.661629] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:25:40.693305] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T19:25:40.731185] [DEBUG] [LOCAL ] ITGR: Loaded 31720 existing records from primary storage. [2025-10-27T19:25:40.731802] [INFO ] [MAIN ] ITGR: Loaded 31720 existing records. [2025-10-27T19:25:40.917563] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:25:40.917769] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-27T19:25:40.917821] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-27T19:25:40.918022] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-27T19:25:40.918083] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-27T19:25:41.122403] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T19:25:41.247348] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-27T19:25:41.249712] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-27T19:25:41.330507] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:25:42.014983] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-27T19:25:42.814949] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-27T19:25:42.946826] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T19:25:42.956402] [INFO ] [REMOTE ] IRT: Full fetch complete (72825 records). [2025-10-27T19:25:42.956537] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-27T19:25:43.359852] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-27T19:25:43.359998] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-27T19:25:43.361112] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-27T19:25:43.361176] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-27T19:25:43.362720] [DEBUG] [LOCAL ] IRT: Trimmed 72825 records to 50309 (keeping 200 days of data) [2025-10-27T19:25:43.603592] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T19:25:43.616913] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-27T19:25:43.713035] [DEBUG] [LOCAL ] IRT: Primary data saved (50309 records). [2025-10-27T19:25:43.713140] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-27T19:25:43.713916] [INFO ] [MAIN ] Update Progress: 1129/2366 symbols completed. IRT took 33.1s. Estimated remaining: 2h 39m 37s. Rate: 7.7 symbols/min [2025-10-27T19:25:43.821622] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-27T19:25:43.892804] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:25:43.927495] [DEBUG] [LOCAL ] ITT: Loaded 32727 existing records from primary storage. [2025-10-27T19:25:43.927806] [INFO ] [MAIN ] ITT: Loaded 32727 existing records. [2025-10-27T19:25:44.098217] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:25:44.098430] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-27T19:25:44.098476] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-27T19:25:44.098704] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-27T19:25:44.098760] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-27T19:25:44.420862] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-27T19:25:44.451031] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:25:44.629685] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T19:25:45.214922] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-27T19:25:45.353214] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-27T19:25:46.014912] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-27T19:25:46.368197] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T19:25:46.820836] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-27T19:25:46.825166] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-27T19:25:46.829384] [INFO ] [REMOTE ] ISD: Full fetch complete (23971 records). [2025-10-27T19:25:46.829482] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-27T19:25:47.211213] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-27T19:25:47.211286] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-27T19:25:47.211842] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-27T19:25:47.211904] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-27T19:25:47.212527] [DEBUG] [LOCAL ] ISD: Trimmed 23971 records to 15420 (keeping 200 days of data) [2025-10-27T19:25:47.304750] [DEBUG] [LOCAL ] ISD: Primary data saved (15420 records). [2025-10-27T19:25:47.304884] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-27T19:25:47.304961] [INFO ] [MAIN ] Update Progress: 1130/2366 symbols completed. ISD took 27.6s. Estimated remaining: 2h 39m 25s. Rate: 7.8 symbols/min [2025-10-27T19:25:47.469983] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:25:47.519571] [DEBUG] [LOCAL ] ITUB: Loaded 54090 existing records from primary storage. [2025-10-27T19:25:47.519898] [INFO ] [MAIN ] ITUB: Loaded 54090 existing records. [2025-10-27T19:25:47.618357] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-27T19:25:47.698845] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:25:47.699046] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-27T19:25:47.699093] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-27T19:25:47.699272] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-27T19:25:47.699310] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-27T19:25:48.058513] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:25:48.219176] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T19:25:48.414932] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-27T19:25:48.783505] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T19:25:49.214947] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-27T19:25:49.351211] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T19:25:50.014955] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-27T19:25:50.814934] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-27T19:25:50.903615] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-27T19:25:51.614949] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-27T19:25:51.717198] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T19:25:51.884306] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-27T19:25:51.893067] [INFO ] [REMOTE ] IT: Full fetch complete (58143 records). [2025-10-27T19:25:51.893202] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-27T19:25:52.262274] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-27T19:25:52.262348] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-27T19:25:52.263167] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-27T19:25:52.263227] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-27T19:25:52.264319] [DEBUG] [LOCAL ] IT: Trimmed 58143 records to 42087 (keeping 200 days of data) [2025-10-27T19:25:52.426859] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-27T19:25:52.511825] [DEBUG] [LOCAL ] IT: Primary data saved (42087 records). [2025-10-27T19:25:52.511948] [INFO ] [MAIN ] IT: Full history saved. [2025-10-27T19:25:52.512025] [INFO ] [MAIN ] Update Progress: 1131/2366 symbols completed. IT took 30.1s. Estimated remaining: 2h 39m 14s. Rate: 7.8 symbols/min [2025-10-27T19:25:52.686762] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:25:52.711287] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T19:25:52.753215] [DEBUG] [LOCAL ] ITW: Loaded 46349 existing records from primary storage. [2025-10-27T19:25:52.753464] [INFO ] [MAIN ] ITW: Loaded 46349 existing records. [2025-10-27T19:25:52.924748] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:25:52.924927] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-27T19:25:52.924971] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-27T19:25:52.925138] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-27T19:25:52.925175] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-27T19:25:53.220132] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-27T19:25:53.270144] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:25:53.610931] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-27T19:25:54.014945] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-27T19:25:54.814918] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-27T19:25:54.843452] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-27T19:25:55.396971] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T19:25:55.614971] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-27T19:25:55.985551] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-27T19:25:56.415010] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-27T19:25:56.841246] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T19:25:57.214997] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-27T19:25:57.647893] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T19:25:58.014939] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-27T19:25:58.763432] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T19:25:58.814910] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-27T19:25:59.087351] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-27T19:25:59.614956] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-27T19:26:00.374597] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T19:26:00.414982] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-27T19:26:00.960635] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-27T19:26:01.214982] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-27T19:26:02.015056] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-27T19:26:02.228014] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-27T19:26:02.798037] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-27T19:26:02.814889] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-27T19:26:03.246047] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T19:26:03.614946] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-27T19:26:04.417690] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-27T19:26:04.432973] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-27T19:26:05.215214] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T19:26:05.215327] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-27T19:26:05.499630] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-27T19:26:06.014900] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-27T19:26:06.059428] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-27T19:26:06.814939] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-27T19:26:07.195266] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T19:26:07.614915] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-27T19:26:07.678167] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-27T19:26:08.414943] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-27T19:26:09.218258] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-27T19:26:09.223847] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-27T19:26:09.511742] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-27T19:26:10.014946] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-27T19:26:10.199274] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T19:26:10.205399] [INFO ] [REMOTE ] ITT: Full fetch complete (47571 records). [2025-10-27T19:26:10.205488] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-27T19:26:10.577272] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-27T19:26:10.577347] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-27T19:26:10.578086] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-27T19:26:10.578148] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-27T19:26:10.579076] [DEBUG] [LOCAL ] ITT: Trimmed 47571 records to 31974 (keeping 200 days of data) [2025-10-27T19:26:10.804429] [DEBUG] [LOCAL ] ITT: Primary data saved (31974 records). [2025-10-27T19:26:10.804537] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-27T19:26:10.804619] [INFO ] [MAIN ] Update Progress: 1132/2366 symbols completed. ITT took 27.1s. Estimated remaining: 2h 39m 18s. Rate: 7.7 symbols/min [2025-10-27T19:26:10.820040] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-27T19:26:10.996326] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:26:11.040075] [DEBUG] [LOCAL ] IVR: Loaded 48532 existing records from primary storage. [2025-10-27T19:26:11.040371] [INFO ] [MAIN ] IVR: Loaded 48532 existing records. [2025-10-27T19:26:11.232310] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:26:11.232969] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-27T19:26:11.233177] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-27T19:26:11.233454] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-27T19:26:11.233514] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-27T19:26:11.638044] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:26:11.622181] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-27T19:26:11.633856] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T19:26:12.375599] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T19:26:12.414909] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-27T19:26:12.467886] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T19:26:13.214997] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-27T19:26:13.888572] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T19:26:14.014923] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-27T19:26:14.815013] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-27T19:26:14.937660] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T19:26:15.443698] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T19:26:15.614960] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-27T19:26:16.190563] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-27T19:26:16.197409] [INFO ] [REMOTE ] ITGR: Full fetch complete (44025 records). [2025-10-27T19:26:16.197559] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-27T19:26:16.422097] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-27T19:26:16.589376] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-27T19:26:16.589464] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-27T19:26:16.590239] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-27T19:26:16.590309] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-27T19:26:16.591440] [DEBUG] [LOCAL ] ITGR: Trimmed 44025 records to 31163 (keeping 200 days of data) [2025-10-27T19:26:16.790627] [DEBUG] [LOCAL ] ITGR: Primary data saved (31163 records). [2025-10-27T19:26:16.790812] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-27T19:26:16.790927] [INFO ] [MAIN ] Update Progress: 1133/2366 symbols completed. ITGR took 36.3s. Estimated remaining: 2h 39m 8s. Rate: 7.7 symbols/min [2025-10-27T19:26:16.976819] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:26:17.007943] [DEBUG] [LOCAL ] IVT: Loaded 31798 existing records from primary storage. [2025-10-27T19:26:17.008253] [INFO ] [MAIN ] IVT: Loaded 31798 existing records. [2025-10-27T19:26:17.208950] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:26:17.209288] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-27T19:26:17.209458] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-27T19:26:17.209736] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-27T19:26:17.209808] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-27T19:26:17.220893] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-27T19:26:17.410554] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T19:26:17.633348] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:26:18.014997] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-27T19:26:18.419712] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-27T19:26:18.435070] [INFO ] [REMOTE ] ITUB: Full fetch complete (77307 records). [2025-10-27T19:26:18.435274] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-27T19:26:18.820026] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-27T19:26:19.073194] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-27T19:26:19.074839] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-27T19:26:19.075081] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-27T19:26:19.085533] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-27T19:26:19.085859] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-27T19:26:19.087751] [DEBUG] [LOCAL ] ITUB: Trimmed 77307 records to 53305 (keeping 200 days of data) [2025-10-27T19:26:19.434322] [DEBUG] [LOCAL ] ITUB: Primary data saved (53305 records). [2025-10-27T19:26:19.434463] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-27T19:26:19.435033] [INFO ] [MAIN ] Update Progress: 1134/2366 symbols completed. ITUB took 32.1s. Estimated remaining: 2h 38m 55s. Rate: 7.8 symbols/min [2025-10-27T19:26:19.613834] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:26:19.614922] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-27T19:26:19.666864] [DEBUG] [LOCAL ] IVZ: Loaded 53908 existing records from primary storage. [2025-10-27T19:26:19.667183] [INFO ] [MAIN ] IVZ: Loaded 53908 existing records. [2025-10-27T19:26:19.847850] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:26:19.848090] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-27T19:26:19.848180] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-27T19:26:19.848590] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-27T19:26:19.864638] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-27T19:26:19.967944] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-27T19:26:20.200675] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T19:26:20.296741] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:26:20.414991] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-27T19:26:20.812861] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T19:26:21.214930] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-27T19:26:21.605675] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-27T19:26:22.014930] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-27T19:26:22.814969] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-27T19:26:23.014848] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-27T19:26:23.511166] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T19:26:23.614934] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-27T19:26:24.336940] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T19:26:24.415005] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-27T19:26:24.463417] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T19:26:25.214998] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-27T19:26:25.712348] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T19:26:26.014953] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-27T19:26:26.397857] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T19:26:26.814977] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-27T19:26:27.491038] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T19:26:27.614948] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-27T19:26:28.288840] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T19:26:28.414957] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-27T19:26:29.130254] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T19:26:29.214906] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-27T19:26:29.562868] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T19:26:30.014942] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-27T19:26:30.485042] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T19:26:30.494055] [INFO ] [REMOTE ] ITW: Full fetch complete (66943 records). [2025-10-27T19:26:30.494180] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-27T19:26:30.827359] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-27T19:26:30.884163] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-27T19:26:30.884249] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-27T19:26:30.885227] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-27T19:26:30.885293] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-27T19:26:30.886767] [DEBUG] [LOCAL ] ITW: Trimmed 66943 records to 45560 (keeping 200 days of data) [2025-10-27T19:26:31.163912] [DEBUG] [LOCAL ] ITW: Primary data saved (45560 records). [2025-10-27T19:26:31.164040] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-27T19:26:31.164128] [INFO ] [MAIN ] Update Progress: 1135/2366 symbols completed. ITW took 38.7s. Estimated remaining: 2h 38m 52s. Rate: 7.7 symbols/min [2025-10-27T19:26:31.333949] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:26:31.355270] [DEBUG] [LOCAL ] IX: Loaded 22374 existing records from primary storage. [2025-10-27T19:26:31.355520] [INFO ] [MAIN ] IX: Loaded 22374 existing records. [2025-10-27T19:26:31.540638] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:26:31.540989] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-27T19:26:31.541069] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-27T19:26:31.541318] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-27T19:26:31.541389] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-27T19:26:31.615108] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-27T19:26:31.913434] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-27T19:26:31.935071] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:26:32.414953] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-27T19:26:32.541284] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-27T19:26:32.698114] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-27T19:26:33.214991] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-27T19:26:34.014969] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-27T19:26:34.347339] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T19:26:34.426528] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T19:26:34.815020] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-27T19:26:34.900636] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-27T19:26:35.614995] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-27T19:26:36.185899] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-27T19:26:36.394482] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T19:26:36.414938] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-27T19:26:37.214966] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-27T19:26:38.014927] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-27T19:26:38.336997] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-27T19:26:38.347488] [INFO ] [REMOTE ] IVR: Full fetch complete (69033 records). [2025-10-27T19:26:38.347673] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-27T19:26:38.662970] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T19:26:38.762986] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-27T19:26:38.763064] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-27T19:26:38.764011] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-27T19:26:38.764075] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-27T19:26:38.765386] [DEBUG] [LOCAL ] IVR: Trimmed 69033 records to 47696 (keeping 200 days of data) [2025-10-27T19:26:38.816725] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-27T19:26:39.062337] [DEBUG] [LOCAL ] IVR: Primary data saved (47696 records). [2025-10-27T19:26:39.062481] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-27T19:26:39.063181] [INFO ] [MAIN ] Update Progress: 1136/2366 symbols completed. IVR took 28.3s. Estimated remaining: 2h 38m 44s. Rate: 7.7 symbols/min [2025-10-27T19:26:39.238001] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:26:39.282052] [DEBUG] [LOCAL ] J: Loaded 41171 existing records from primary storage. [2025-10-27T19:26:39.282574] [INFO ] [MAIN ] J: Loaded 41171 existing records. [2025-10-27T19:26:39.438998] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T19:26:39.485393] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T19:26:39.519679] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:26:39.520393] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-27T19:26:39.520450] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-27T19:26:39.520904] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-27T19:26:39.520968] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-27T19:26:39.620079] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-27T19:26:39.876211] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:26:40.414938] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-27T19:26:40.722356] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T19:26:41.214951] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-27T19:26:41.779274] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-27T19:26:41.786066] [INFO ] [REMOTE ] IVT: Full fetch complete (45581 records). [2025-10-27T19:26:41.786157] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-27T19:26:42.021328] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-27T19:26:42.154459] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-27T19:26:42.154557] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-27T19:26:42.155368] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-27T19:26:42.155421] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-27T19:26:42.156355] [DEBUG] [LOCAL ] IVT: Trimmed 45581 records to 31135 (keeping 200 days of data) [2025-10-27T19:26:42.344593] [DEBUG] [LOCAL ] IVT: Primary data saved (31135 records). [2025-10-27T19:26:42.344783] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-27T19:26:42.344874] [INFO ] [MAIN ] Update Progress: 1137/2366 symbols completed. IVT took 25.6s. Estimated remaining: 2h 38m 31s. Rate: 7.8 symbols/min [2025-10-27T19:26:42.476502] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T19:26:42.534329] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:26:42.572481] [DEBUG] [LOCAL ] JBGS: Loaded 42157 existing records from primary storage. [2025-10-27T19:26:42.572777] [INFO ] [MAIN ] JBGS: Loaded 42157 existing records. [2025-10-27T19:26:42.744131] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:26:42.744361] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-27T19:26:42.744407] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-27T19:26:42.744607] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-27T19:26:42.744694] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-27T19:26:42.820135] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-27T19:26:43.093762] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:26:43.541059] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T19:26:43.614937] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-27T19:26:43.739347] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-27T19:26:44.414934] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-27T19:26:45.051616] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T19:26:45.214931] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-27T19:26:46.014945] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-27T19:26:46.213340] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-27T19:26:46.814920] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-27T19:26:46.889801] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-27T19:26:47.147013] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T19:26:47.615002] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-27T19:26:48.291373] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T19:26:48.414893] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-27T19:26:48.430456] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T19:26:49.214953] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-27T19:26:49.751609] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T19:26:50.014951] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-27T19:26:50.636339] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-27T19:26:50.814980] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-27T19:26:51.612971] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-27T19:26:51.623114] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-27T19:26:52.027531] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T19:26:52.414932] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-27T19:26:53.045271] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T19:26:53.066835] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-27T19:26:53.214922] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-27T19:26:54.014956] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-27T19:26:54.661091] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T19:26:54.814968] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-27T19:26:55.109554] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-27T19:26:55.615005] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-27T19:26:55.807854] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T19:26:56.414996] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-27T19:26:56.572687] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-27T19:26:57.214940] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-27T19:26:58.014986] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-27T19:26:58.054466] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-27T19:26:58.064801] [INFO ] [REMOTE ] IVZ: Full fetch complete (77072 records). [2025-10-27T19:26:58.064918] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-27T19:26:58.464786] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-27T19:26:58.464920] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-27T19:26:58.465918] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-27T19:26:58.466066] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-27T19:26:58.495190] [DEBUG] [LOCAL ] IVZ: Trimmed 77072 records to 53128 (keeping 200 days of data) [2025-10-27T19:26:58.496814] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T19:26:58.816867] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-27T19:26:58.821101] [DEBUG] [LOCAL ] IVZ: Primary data saved (53128 records). [2025-10-27T19:26:58.822142] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-27T19:26:58.822596] [INFO ] [MAIN ] Update Progress: 1138/2366 symbols completed. IVZ took 39.4s. Estimated remaining: 2h 38m 33s. Rate: 7.7 symbols/min [2025-10-27T19:26:58.994689] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:26:59.036782] [DEBUG] [LOCAL ] JBI: Loaded 43031 existing records from primary storage. [2025-10-27T19:26:59.037206] [INFO ] [MAIN ] JBI: Loaded 43031 existing records. [2025-10-27T19:26:59.175033] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-27T19:26:59.257411] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:26:59.257704] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-27T19:26:59.257762] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-27T19:26:59.257937] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-27T19:26:59.257974] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-27T19:26:59.601517] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:26:59.614897] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-27T19:27:00.079240] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T19:27:00.414986] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-27T19:27:00.852973] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T19:27:01.214994] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-27T19:27:01.824929] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-27T19:27:01.829191] [INFO ] [REMOTE ] IX: Full fetch complete (28978 records). [2025-10-27T19:27:01.829284] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-27T19:27:02.028599] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-27T19:27:02.219782] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-27T19:27:02.219845] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-27T19:27:02.220442] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-27T19:27:02.220479] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-27T19:27:02.221162] [DEBUG] [LOCAL ] IX: Trimmed 28978 records to 21695 (keeping 200 days of data) [2025-10-27T19:27:02.342049] [DEBUG] [LOCAL ] IX: Primary data saved (21695 records). [2025-10-27T19:27:02.342157] [INFO ] [MAIN ] IX: Full history saved. [2025-10-27T19:27:02.342225] [INFO ] [MAIN ] Update Progress: 1139/2366 symbols completed. IX took 31.2s. Estimated remaining: 2h 38m 21s. Rate: 7.7 symbols/min [2025-10-27T19:27:02.507371] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:27:02.551401] [DEBUG] [LOCAL ] JBL: Loaded 49039 existing records from primary storage. [2025-10-27T19:27:02.551767] [INFO ] [MAIN ] JBL: Loaded 49039 existing records. [2025-10-27T19:27:02.730108] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:27:02.730387] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-27T19:27:02.730433] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-27T19:27:02.730619] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-27T19:27:02.730694] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-27T19:27:02.820451] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-27T19:27:03.130125] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:27:03.132786] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-27T19:27:03.444702] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-27T19:27:03.614987] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-27T19:27:04.291081] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T19:27:04.414908] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-27T19:27:05.214915] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-27T19:27:05.275867] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T19:27:05.867840] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T19:27:06.014942] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-27T19:27:06.191981] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-27T19:27:06.815016] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-27T19:27:07.175864] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-27T19:27:07.615002] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-27T19:27:08.255410] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T19:27:08.414925] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-27T19:27:09.047084] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T19:27:09.055733] [INFO ] [REMOTE ] J: Full fetch complete (59985 records). [2025-10-27T19:27:09.055863] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-27T19:27:09.224022] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-27T19:27:09.431613] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-27T19:27:09.431737] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-27T19:27:09.432609] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-27T19:27:09.432680] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-27T19:27:09.433852] [DEBUG] [LOCAL ] J: Trimmed 59985 records to 40512 (keeping 200 days of data) [2025-10-27T19:27:09.689284] [DEBUG] [LOCAL ] J: Primary data saved (40512 records). [2025-10-27T19:27:09.689496] [INFO ] [MAIN ] J: Full history saved. [2025-10-27T19:27:09.690514] [INFO ] [MAIN ] Update Progress: 1140/2366 symbols completed. J took 30.6s. Estimated remaining: 2h 38m 13s. Rate: 7.7 symbols/min [2025-10-27T19:27:09.863061] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:27:09.892396] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-27T19:27:09.929765] [DEBUG] [LOCAL ] JBND: Loaded 27871 existing records from primary storage. [2025-10-27T19:27:09.930031] [INFO ] [MAIN ] JBND: Loaded 27871 existing records. [2025-10-27T19:27:10.020132] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-27T19:27:10.110822] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:27:10.111059] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-27T19:27:10.111135] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-27T19:27:10.111369] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-27T19:27:10.111435] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-27T19:27:10.484893] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:27:10.508329] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-27T19:27:10.814951] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-27T19:27:11.342050] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T19:27:11.413301] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-27T19:27:11.614989] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-27T19:27:12.414973] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-27T19:27:12.975665] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T19:27:13.006170] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-27T19:27:13.215002] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-27T19:27:14.015000] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-27T19:27:14.277110] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-27T19:27:14.814960] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-27T19:27:15.565372] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T19:27:15.618172] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-27T19:27:15.621253] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T19:27:16.414942] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-27T19:27:16.673403] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T19:27:17.214939] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-27T19:27:18.015003] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-27T19:27:18.114013] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T19:27:18.599544] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-27T19:27:18.606382] [INFO ] [REMOTE ] JBGS: Full fetch complete (59102 records). [2025-10-27T19:27:18.606476] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-27T19:27:18.823777] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-27T19:27:18.985800] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-27T19:27:18.985889] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-27T19:27:18.986745] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-27T19:27:18.986807] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-27T19:27:18.988046] [DEBUG] [LOCAL ] JBGS: Trimmed 59102 records to 41297 (keeping 200 days of data) [2025-10-27T19:27:19.226628] [DEBUG] [LOCAL ] JBGS: Primary data saved (41297 records). [2025-10-27T19:27:19.226789] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-27T19:27:19.226865] [INFO ] [MAIN ] Update Progress: 1141/2366 symbols completed. JBGS took 36.9s. Estimated remaining: 2h 38m 7s. Rate: 7.7 symbols/min [2025-10-27T19:27:19.421092] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:27:19.421313] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-27T19:27:19.421466] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-27T19:27:19.421668] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-27T19:27:19.421857] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-27T19:27:19.421978] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-27T19:27:19.422157] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-27T19:27:19.628758] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-27T19:27:19.706773] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-27T19:27:19.819315] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:27:20.238006] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T19:27:20.325326] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-27T19:27:20.414903] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-27T19:27:21.214926] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-27T19:27:21.812789] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T19:27:22.014939] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-10-27T19:27:22.211179] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T19:27:22.211495] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-10-27T19:27:22.211581] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:27:22.211632] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-27T19:27:22.211723] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:27:22.211799] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-27T19:27:22.211862] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-27T19:27:22.211896] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-27T19:27:22.211935] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-27T19:27:22.211981] [INFO ] [MAIN ] Update Progress: 1142/2366 symbols completed. JBS took 3.0s. Estimated remaining: 2h 37m 54s. Rate: 7.8 symbols/min [2025-10-27T19:27:22.379789] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:27:22.412922] [DEBUG] [LOCAL ] JBTM: Loaded 33976 existing records from primary storage. [2025-10-27T19:27:22.413190] [INFO ] [MAIN ] JBTM: Loaded 33976 existing records. [2025-10-27T19:27:22.597252] [WARN ] [MAIN ] JBTM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:27:22.597689] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-27T19:27:22.597782] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-27T19:27:22.598131] [DEBUG] [LOCAL ] JBTM: Deleted primary data file. [2025-10-27T19:27:22.598271] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-27T19:27:22.820725] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-27T19:27:22.913720] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T19:27:23.002629] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:27:23.569875] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-27T19:27:23.614893] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-27T19:27:24.414998] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-27T19:27:24.678107] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T19:27:25.214993] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-27T19:27:25.845322] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T19:27:26.014984] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-27T19:27:26.814921] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-10-27T19:27:26.859152] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-27T19:27:26.917996] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T19:27:27.619797] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-27T19:27:27.625830] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T19:27:28.415005] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-10-27T19:27:29.033800] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-27T19:27:29.046291] [INFO ] [REMOTE ] JBI: Full fetch complete (63242 records). [2025-10-27T19:27:29.046532] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-27T19:27:29.220285] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-27T19:27:29.432485] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-27T19:27:29.432601] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-27T19:27:29.433592] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-27T19:27:29.433683] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-27T19:27:29.435009] [DEBUG] [LOCAL ] JBI: Trimmed 63242 records to 42114 (keeping 200 days of data) [2025-10-27T19:27:29.671041] [DEBUG] [LOCAL ] JBI: Primary data saved (42114 records). [2025-10-27T19:27:29.671269] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-27T19:27:29.671741] [INFO ] [MAIN ] Update Progress: 1143/2366 symbols completed. JBI took 30.8s. Estimated remaining: 2h 37m 46s. Rate: 7.8 symbols/min [2025-10-27T19:27:29.759562] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T19:27:29.863918] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:27:29.875302] [DEBUG] [LOCAL ] JCE: Loaded 7308 existing records from primary storage. [2025-10-27T19:27:29.875514] [INFO ] [MAIN ] JCE: Loaded 7308 existing records. [2025-10-27T19:27:30.024617] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-10-27T19:27:30.054699] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:27:30.056283] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-27T19:27:30.056394] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-27T19:27:30.056835] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-27T19:27:30.057041] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-27T19:27:30.350546] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T19:27:30.434790] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:27:30.814960] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-27T19:27:31.312154] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T19:27:31.476376] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-27T19:27:31.614954] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-27T19:27:32.414926] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-27T19:27:32.754836] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T19:27:32.761633] [INFO ] [REMOTE ] JBND: Full fetch complete (36591 records). [2025-10-27T19:27:32.761740] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-27T19:27:33.136199] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-27T19:27:33.136279] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-27T19:27:33.137363] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-27T19:27:33.137470] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-27T19:27:33.138371] [DEBUG] [LOCAL ] JBND: Trimmed 36591 records to 27459 (keeping 200 days of data) [2025-10-27T19:27:33.223745] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-27T19:27:33.305306] [DEBUG] [LOCAL ] JBND: Primary data saved (27459 records). [2025-10-27T19:27:33.305460] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-27T19:27:33.305545] [INFO ] [MAIN ] Update Progress: 1144/2366 symbols completed. JBND took 23.6s. Estimated remaining: 2h 37m 34s. Rate: 7.8 symbols/min [2025-10-27T19:27:33.479693] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:27:33.538244] [DEBUG] [LOCAL ] JCI: Loaded 54295 existing records from primary storage. [2025-10-27T19:27:33.538578] [INFO ] [MAIN ] JCI: Loaded 54295 existing records. [2025-10-27T19:27:33.717086] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:27:33.717342] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-27T19:27:33.717402] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-27T19:27:33.717584] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-27T19:27:33.717623] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-27T19:27:33.834810] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-27T19:27:34.020114] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-10-27T19:27:34.094456] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:27:34.136069] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T19:27:34.814935] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-27T19:27:35.171829] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T19:27:35.458023] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T19:27:35.614963] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-10-27T19:27:36.414979] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-27T19:27:36.685196] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-27T19:27:37.214943] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-27T19:27:37.974414] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-27T19:27:38.014899] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-27T19:27:38.726741] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T19:27:38.814942] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-27T19:27:39.614917] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-27T19:27:39.943165] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T19:27:39.999206] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T19:27:40.013876] [INFO ] [REMOTE ] JBL: Full fetch complete (70550 records). [2025-10-27T19:27:40.014580] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-27T19:27:40.014398] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-27T19:27:40.425576] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-27T19:27:40.430037] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-27T19:27:40.430160] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-27T19:27:40.432056] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-27T19:27:40.432235] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-27T19:27:40.433801] [DEBUG] [LOCAL ] JBL: Trimmed 70550 records to 48193 (keeping 200 days of data) [2025-10-27T19:27:40.725537] [DEBUG] [LOCAL ] JBL: Primary data saved (48193 records). [2025-10-27T19:27:40.725703] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-27T19:27:40.725798] [INFO ] [MAIN ] Update Progress: 1145/2366 symbols completed. JBL took 38.4s. Estimated remaining: 2h 37m 26s. Rate: 7.8 symbols/min [2025-10-27T19:27:40.906692] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:27:40.956750] [DEBUG] [LOCAL ] JEF: Loaded 50955 existing records from primary storage. [2025-10-27T19:27:40.957092] [INFO ] [MAIN ] JEF: Loaded 50955 existing records. [2025-10-27T19:27:41.131929] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:27:41.132142] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-27T19:27:41.132209] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-27T19:27:41.132397] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-27T19:27:41.132435] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-27T19:27:41.222213] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-27T19:27:41.502926] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:27:41.747384] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T19:27:41.818101] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-27T19:27:42.014956] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-27T19:27:42.814931] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-27T19:27:43.267097] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T19:27:43.614993] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-10-27T19:27:44.274240] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T19:27:44.416478] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-27T19:27:44.420046] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-27T19:27:45.214960] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-27T19:27:45.590161] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-27T19:27:45.662922] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T19:27:46.014969] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-27T19:27:46.814976] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-27T19:27:47.472259] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T19:27:47.512239] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T19:27:47.614928] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-10-27T19:27:48.414919] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-27T19:27:48.497221] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T19:27:49.021049] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-27T19:27:49.214945] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-27T19:27:50.014966] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-27T19:27:50.501835] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T19:27:50.814940] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-27T19:27:51.335998] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-27T19:27:51.575556] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T19:27:51.614917] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-27T19:27:52.414933] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-27T19:27:52.599868] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T19:27:52.602197] [INFO ] [REMOTE ] JCE: Full fetch complete (9603 records). [2025-10-27T19:27:52.602267] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-27T19:27:52.950717] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-27T19:27:52.950799] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-27T19:27:52.951021] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-27T19:27:52.951060] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-27T19:27:52.951465] [DEBUG] [LOCAL ] JCE: Trimmed 9603 records to 7116 (keeping 200 days of data) [2025-10-27T19:27:52.992898] [DEBUG] [LOCAL ] JCE: Primary data saved (7116 records). [2025-10-27T19:27:52.993021] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-27T19:27:52.993098] [INFO ] [MAIN ] Update Progress: 1146/2366 symbols completed. JCE took 23.3s. Estimated remaining: 2h 37m 23s. Rate: 7.8 symbols/min [2025-10-27T19:27:53.156600] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:27:53.197939] [DEBUG] [LOCAL ] JELD: Loaded 46422 existing records from primary storage. [2025-10-27T19:27:53.198222] [INFO ] [MAIN ] JELD: Loaded 46422 existing records. [2025-10-27T19:27:53.220083] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-27T19:27:53.382256] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:27:53.382473] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-27T19:27:53.382540] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-27T19:27:53.382766] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-27T19:27:53.382822] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-27T19:27:53.776416] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:27:54.025207] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-27T19:27:54.031277] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-27T19:27:54.550567] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-27T19:27:54.814965] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-27T19:27:55.410129] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T19:27:55.614968] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-27T19:27:56.085895] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-27T19:27:56.414968] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-27T19:27:57.200460] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T19:27:57.214895] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-27T19:27:57.706559] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T19:27:58.014968] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-27T19:27:58.310272] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T19:27:58.814972] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-27T19:27:59.614953] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-10-27T19:27:59.953941] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-27T19:28:00.183165] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T19:28:00.414944] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-27T19:28:00.769002] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-27T19:28:01.214946] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-27T19:28:02.015019] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-10-27T19:28:02.815000] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-27T19:28:03.251045] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-27T19:28:03.614925] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-10. [2025-10-27T19:28:04.056305] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T19:28:04.414988] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-27T19:28:04.758052] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T19:28:04.765447] [INFO ] [REMOTE ] JBTM: Full fetch complete (46946 records). [2025-10-27T19:28:04.765540] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-10-27T19:28:05.145940] [DEBUG] [VALIDATOR ] JBTM: All expected trading days are present. [2025-10-27T19:28:05.146036] [DEBUG] [VALIDATOR ] JBTM: Primary data validation passed. [2025-10-27T19:28:05.146800] [INFO ] [MAIN ] JBTM: Fetched primary data is valid. [2025-10-27T19:28:05.146880] [DEBUG] [LOCAL ] JBTM: Saving primary data. [2025-10-27T19:28:05.173973] [DEBUG] [LOCAL ] JBTM: Trimmed 46946 records to 33232 (keeping 200 days of data) [2025-10-27T19:28:05.175881] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (4.76 seconds). [2025-10-27T19:28:05.186834] [INFO ] [REMOTE ] JCI: Full fetch complete (77658 records). [2025-10-27T19:28:05.186941] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-27T19:28:05.796367] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-27T19:28:05.813677] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-27T19:28:05.814749] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-27T19:28:05.821774] [DEBUG] [LOCAL ] JBTM: Primary data saved (33232 records). [2025-10-27T19:28:05.816339] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-27T19:28:05.821900] [INFO ] [MAIN ] JBTM: Full history saved. [2025-10-27T19:28:05.822517] [INFO ] [MAIN ] Update Progress: 1147/2366 symbols completed. JBTM took 43.6s. Estimated remaining: 2h 37m 20s. Rate: 7.7 symbols/min [2025-10-27T19:28:05.891118] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-27T19:28:05.956760] [DEBUG] [LOCAL ] JCI: Trimmed 77658 records to 53513 (keeping 200 days of data) [2025-10-27T19:28:05.998129] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-27T19:28:06.107518] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:28:06.168798] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (4.95 seconds). [2025-10-27T19:28:06.195155] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-27T19:28:06.213092] [DEBUG] [LOCAL ] JFR: Loaded 31608 existing records from primary storage. [2025-10-27T19:28:06.214434] [INFO ] [MAIN ] JFR: Loaded 31608 existing records. [2025-10-27T19:28:06.540238] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:28:06.546558] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-27T19:28:06.546616] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-27T19:28:06.579914] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-27T19:28:06.580008] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-27T19:28:06.729920] [DEBUG] [LOCAL ] JCI: Primary data saved (53513 records). [2025-10-27T19:28:06.735757] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-27T19:28:06.741812] [INFO ] [MAIN ] Update Progress: 1148/2366 symbols completed. JCI took 33.4s. Estimated remaining: 2h 37m 5s. Rate: 7.8 symbols/min [2025-10-27T19:28:07.100838] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:28:07.163363] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:28:07.163774] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-27T19:28:07.178086] [DEBUG] [LOCAL ] JGH: Loaded 12716 existing records from primary storage. [2025-10-27T19:28:07.178316] [INFO ] [MAIN ] JGH: Loaded 12716 existing records. [2025-10-27T19:28:07.362821] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:28:07.363420] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-27T19:28:07.363476] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-27T19:28:07.363625] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-27T19:28:07.363701] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-27T19:28:07.743111] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:28:07.743727] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-27T19:28:07.778915] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-27T19:28:07.812730] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-27T19:28:08.289439] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T19:28:08.319309] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T19:28:08.414942] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-27T19:28:09.214936] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-27T19:28:09.818459] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T19:28:10.014922] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-27T19:28:10.052072] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-27T19:28:10.814966] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-27T19:28:11.425703] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T19:28:11.614899] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-27T19:28:12.342887] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T19:28:12.414986] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-27T19:28:13.214944] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-27T19:28:13.803180] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-27T19:28:13.813333] [INFO ] [REMOTE ] JEF: Full fetch complete (73315 records). [2025-10-27T19:28:13.813458] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-27T19:28:14.062480] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-27T19:28:14.091526] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-27T19:28:14.255549] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-27T19:28:14.255706] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-27T19:28:14.256884] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-27T19:28:14.256962] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-27T19:28:14.258345] [DEBUG] [LOCAL ] JEF: Trimmed 73315 records to 50159 (keeping 200 days of data) [2025-10-27T19:28:14.591820] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T19:28:14.606121] [DEBUG] [LOCAL ] JEF: Primary data saved (50159 records). [2025-10-27T19:28:14.606582] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-27T19:28:14.606699] [INFO ] [MAIN ] Update Progress: 1149/2366 symbols completed. JEF took 33.9s. Estimated remaining: 2h 36m 58s. Rate: 7.8 symbols/min [2025-10-27T19:28:14.773782] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:28:14.814905] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-27T19:28:14.816844] [DEBUG] [LOCAL ] JHG: Loaded 48186 existing records from primary storage. [2025-10-27T19:28:14.817099] [INFO ] [MAIN ] JHG: Loaded 48186 existing records. [2025-10-27T19:28:14.959530] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T19:28:15.000448] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:28:15.000604] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-27T19:28:15.000676] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-27T19:28:15.000870] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-27T19:28:15.000908] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-27T19:28:15.360076] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:28:15.614961] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-27T19:28:15.954486] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T19:28:16.413887] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-27T19:28:16.418195] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-27T19:28:17.199685] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T19:28:17.214909] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-27T19:28:18.015539] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-27T19:28:18.014904] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-27T19:28:18.751461] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-27T19:28:18.814932] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-27T19:28:19.614954] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-27T19:28:20.283590] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T19:28:20.414959] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-27T19:28:21.214909] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-27T19:28:21.258934] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T19:28:22.014938] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-27T19:28:22.048892] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T19:28:22.125586] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-27T19:28:22.814968] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-27T19:28:23.614943] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-27T19:28:23.687684] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-27T19:28:23.696321] [INFO ] [REMOTE ] JELD: Full fetch complete (64532 records). [2025-10-27T19:28:23.696424] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-27T19:28:24.126144] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-27T19:28:24.139347] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-27T19:28:24.152181] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-27T19:28:24.151685] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-27T19:28:24.155236] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-27T19:28:24.156096] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T19:28:24.164664] [DEBUG] [LOCAL ] JELD: Trimmed 64532 records to 45579 (keeping 200 days of data) [2025-10-27T19:28:24.407088] [DEBUG] [LOCAL ] JELD: Primary data saved (45579 records). [2025-10-27T19:28:24.407210] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-27T19:28:24.407666] [INFO ] [MAIN ] Update Progress: 1150/2366 symbols completed. JELD took 31.4s. Estimated remaining: 2h 36m 52s. Rate: 7.8 symbols/min [2025-10-27T19:28:24.420019] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-27T19:28:24.577840] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:28:24.585020] [DEBUG] [LOCAL ] JHI: Loaded 4189 existing records from primary storage. [2025-10-27T19:28:24.585222] [INFO ] [MAIN ] JHI: Loaded 4189 existing records. [2025-10-27T19:28:24.757247] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:28:24.757460] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-27T19:28:24.757514] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-27T19:28:24.757674] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-27T19:28:24.757729] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-27T19:28:25.103330] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:28:25.214936] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-27T19:28:25.835564] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-27T19:28:26.014918] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-27T19:28:26.082574] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T19:28:26.406696] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-27T19:28:26.814919] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-27T19:28:27.615018] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-27T19:28:28.132462] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-27T19:28:28.414983] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-27T19:28:28.547889] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-27T19:28:29.214985] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-27T19:28:29.835800] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T19:28:30.014998] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-27T19:28:30.470009] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T19:28:30.610120] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-27T19:28:30.814968] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-27T19:28:31.194363] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-27T19:28:31.614935] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-27T19:28:32.414934] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-27T19:28:32.677382] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T19:28:33.214950] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-27T19:28:33.873494] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-27T19:28:33.880796] [INFO ] [REMOTE ] JFR: Full fetch complete (48647 records). [2025-10-27T19:28:33.880915] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-27T19:28:34.027906] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-27T19:28:34.027836] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-27T19:28:34.271202] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-27T19:28:34.271281] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-27T19:28:34.272027] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-27T19:28:34.272090] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-27T19:28:34.273159] [DEBUG] [LOCAL ] JFR: Trimmed 48647 records to 30827 (keeping 200 days of data) [2025-10-27T19:28:34.449389] [DEBUG] [LOCAL ] JFR: Primary data saved (30827 records). [2025-10-27T19:28:34.449534] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-27T19:28:34.449614] [INFO ] [MAIN ] Update Progress: 1151/2366 symbols completed. JFR took 28.6s. Estimated remaining: 2h 36m 47s. Rate: 7.7 symbols/min [2025-10-27T19:28:34.551081] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-27T19:28:34.619045] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:28:34.624474] [DEBUG] [LOCAL ] JHS: Loaded 3045 existing records from primary storage. [2025-10-27T19:28:34.624672] [INFO ] [MAIN ] JHS: Loaded 3045 existing records. [2025-10-27T19:28:34.795746] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:28:34.795943] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-27T19:28:34.795987] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-27T19:28:34.796115] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-27T19:28:34.796151] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-27T19:28:34.820106] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-27T19:28:35.173484] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:28:35.430420] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T19:28:35.614920] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-27T19:28:36.414933] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-27T19:28:37.008815] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-27T19:28:37.098462] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T19:28:37.214905] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-27T19:28:38.015004] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-27T19:28:38.763664] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-27T19:28:38.814916] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-27T19:28:38.885507] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-27T19:28:39.614983] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-27T19:28:39.932677] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-27T19:28:40.406605] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T19:28:40.415714] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-27T19:28:40.835482] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-27T19:28:41.214950] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-27T19:28:42.014931] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-27T19:28:42.788468] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T19:28:42.810252] [INFO ] [REMOTE ] JHG: Full fetch complete (68742 records). [2025-10-27T19:28:42.811050] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-27T19:28:42.811495] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-27T19:28:42.816252] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-27T19:28:42.839124] [INFO ] [REMOTE ] JGH: Full fetch complete (16433 records). [2025-10-27T19:28:42.854605] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-27T19:28:43.560336] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-27T19:28:43.565666] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-27T19:28:43.556459] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T19:28:43.571972] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-27T19:28:43.596524] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-27T19:28:43.618683] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-27T19:28:43.647053] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-27T19:28:43.647940] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-27T19:28:43.648388] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-27T19:28:43.648545] [DEBUG] [LOCAL ] JHG: Trimmed 68742 records to 47426 (keeping 200 days of data) [2025-10-27T19:28:43.648687] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-27T19:28:43.650339] [DEBUG] [LOCAL ] JGH: Trimmed 16433 records to 12378 (keeping 200 days of data) [2025-10-27T19:28:43.904768] [DEBUG] [LOCAL ] JGH: Primary data saved (12378 records). [2025-10-27T19:28:43.913864] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-27T19:28:43.913980] [INFO ] [MAIN ] Update Progress: 1152/2366 symbols completed. JGH took 37.2s. Estimated remaining: 2h 36m 41s. Rate: 7.7 symbols/min [2025-10-27T19:28:44.191291] [DEBUG] [LOCAL ] JHG: Primary data saved (47426 records). [2025-10-27T19:28:44.195888] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:28:44.196102] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-27T19:28:44.196231] [INFO ] [MAIN ] Update Progress: 1153/2366 symbols completed. JHG took 29.6s. Estimated remaining: 2h 36m 25s. Rate: 7.8 symbols/min [2025-10-27T19:28:44.367738] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:28:44.397965] [DEBUG] [LOCAL ] JILL: Loaded 15415 existing records from primary storage. [2025-10-27T19:28:44.412690] [INFO ] [MAIN ] JILL: Loaded 15415 existing records. [2025-10-27T19:28:44.443883] [DEBUG] [LOCAL ] JHX: Loaded 53967 existing records from primary storage. [2025-10-27T19:28:44.442685] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-27T19:28:44.475066] [INFO ] [MAIN ] JHX: Loaded 53967 existing records. [2025-10-27T19:28:44.660271] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-27T19:28:44.705310] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:28:44.716301] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-27T19:28:44.726582] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-27T19:28:44.763523] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-27T19:28:44.779082] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-27T19:28:44.809885] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:28:44.835348] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-27T19:28:44.848617] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-27T19:28:44.863400] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-27T19:28:44.863561] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-27T19:28:44.894836] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-27T19:28:45.226719] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-27T19:28:45.498828] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:28:45.518907] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:28:45.770487] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-27T19:28:46.015008] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-27T19:28:46.360748] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-27T19:28:46.814940] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-27T19:28:47.612189] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T19:28:47.615437] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-27T19:28:48.397627] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T19:28:48.414906] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-27T19:28:49.214919] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-27T19:28:49.430483] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T19:28:49.768990] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-27T19:28:50.014972] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-27T19:28:50.420801] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-27T19:28:50.814969] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-27T19:28:51.440540] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-27T19:28:51.614940] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-27T19:28:52.407162] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T19:28:52.414889] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-27T19:28:53.215015] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-27T19:28:53.334550] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T19:28:53.871579] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-27T19:28:54.014971] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-27T19:28:54.482629] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-27T19:28:54.815002] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-27T19:28:55.614951] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-27T19:28:55.661481] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-27T19:28:55.664062] [INFO ] [REMOTE ] JHI: Full fetch complete (5803 records). [2025-10-27T19:28:55.664152] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-27T19:28:56.040769] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-27T19:28:56.040858] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-27T19:28:56.041054] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-27T19:28:56.041095] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-27T19:28:56.041473] [DEBUG] [LOCAL ] JHI: Trimmed 5803 records to 4048 (keeping 200 days of data) [2025-10-27T19:28:56.065406] [DEBUG] [LOCAL ] JHI: Primary data saved (4048 records). [2025-10-27T19:28:56.065490] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-27T19:28:56.065565] [INFO ] [MAIN ] Update Progress: 1154/2366 symbols completed. JHI took 31.7s. Estimated remaining: 2h 36m 22s. Rate: 7.8 symbols/min [2025-10-27T19:28:56.238279] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:28:56.277535] [DEBUG] [LOCAL ] JKS: Loaded 39701 existing records from primary storage. [2025-10-27T19:28:56.277863] [INFO ] [MAIN ] JKS: Loaded 39701 existing records. [2025-10-27T19:28:56.423838] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-27T19:28:56.460315] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:28:56.460535] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-27T19:28:56.460602] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-27T19:28:56.460802] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-27T19:28:56.460855] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-27T19:28:56.699466] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-27T19:28:56.840141] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:28:57.214955] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-27T19:28:57.887569] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T19:28:58.014913] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-27T19:28:58.792970] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T19:28:58.814915] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-27T19:28:59.614972] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-27T19:28:59.657362] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T19:29:00.004233] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-27T19:29:00.345568] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T19:29:00.414914] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-27T19:29:01.214951] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-27T19:29:01.870392] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-27T19:29:01.871596] [INFO ] [REMOTE ] JHS: Full fetch complete (4591 records). [2025-10-27T19:29:01.871690] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-27T19:29:02.019827] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-27T19:29:02.266049] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-27T19:29:02.294262] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-27T19:29:02.294611] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-27T19:29:02.295017] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-27T19:29:02.295077] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-27T19:29:02.295420] [DEBUG] [LOCAL ] JHS: Trimmed 4591 records to 2985 (keeping 200 days of data) [2025-10-27T19:29:02.312593] [DEBUG] [LOCAL ] JHS: Primary data saved (2985 records). [2025-10-27T19:29:02.312678] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-27T19:29:02.312760] [INFO ] [MAIN ] Update Progress: 1155/2366 symbols completed. JHS took 27.9s. Estimated remaining: 2h 36m 13s. Rate: 7.8 symbols/min [2025-10-27T19:29:02.476536] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:29:02.509714] [DEBUG] [LOCAL ] JLL: Loaded 31885 existing records from primary storage. [2025-10-27T19:29:02.509974] [INFO ] [MAIN ] JLL: Loaded 31885 existing records. [2025-10-27T19:29:02.680993] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:29:02.681187] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-27T19:29:02.681232] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-27T19:29:02.681399] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-27T19:29:02.681445] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-27T19:29:02.820077] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-27T19:29:03.033589] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:29:03.210518] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T19:29:03.614952] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-27T19:29:04.188099] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T19:29:04.414923] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-27T19:29:04.649992] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T19:29:05.214962] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-27T19:29:05.819544] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-27T19:29:06.014918] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-27T19:29:06.460582] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T19:29:06.814950] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-27T19:29:07.614937] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-27T19:29:07.788028] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-27T19:29:07.868361] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-27T19:29:08.414990] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-27T19:29:08.514337] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-27T19:29:09.215001] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-27T19:29:09.336050] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T19:29:10.014966] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-27T19:29:10.234239] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T19:29:10.814949] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-27T19:29:11.584563] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-27T19:29:11.614919] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-27T19:29:11.850261] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T19:29:12.414934] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-27T19:29:13.066821] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-27T19:29:13.214939] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-27T19:29:13.487082] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-27T19:29:13.497038] [INFO ] [REMOTE ] JHX: Full fetch complete (63448 records). [2025-10-27T19:29:13.497159] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-27T19:29:13.899620] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-27T19:29:13.899360] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-27T19:29:13.902406] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-27T19:29:13.903371] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-27T19:29:13.903530] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-27T19:29:13.903833] [INFO ] [REMOTE ] JILL: Full fetch complete (22328 records). [2025-10-27T19:29:13.904192] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-27T19:29:13.994724] [DEBUG] [LOCAL ] JHX: Trimmed 63448 records to 53186 (keeping 200 days of data) [2025-10-27T19:29:14.020030] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-27T19:29:14.483797] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-27T19:29:14.491992] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-27T19:29:14.493866] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-27T19:29:14.493950] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-27T19:29:14.508726] [DEBUG] [LOCAL ] JILL: Trimmed 22328 records to 15011 (keeping 200 days of data) [2025-10-27T19:29:14.679270] [DEBUG] [LOCAL ] JHX: Primary data saved (53186 records). [2025-10-27T19:29:14.686686] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-27T19:29:14.686464] [DEBUG] [LOCAL ] JILL: Primary data saved (15011 records). [2025-10-27T19:29:14.687548] [INFO ] [MAIN ] Update Progress: 1156/2366 symbols completed. JHX took 30.7s. Estimated remaining: 2h 36m 10s. Rate: 7.7 symbols/min [2025-10-27T19:29:14.687670] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-27T19:29:14.730519] [INFO ] [MAIN ] Update Progress: 1157/2366 symbols completed. JILL took 30.5s. Estimated remaining: 2h 35m 54s. Rate: 7.8 symbols/min [2025-10-27T19:29:14.827095] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-27T19:29:14.858108] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:29:14.866244] [DEBUG] [LOCAL ] JLS: Loaded 4056 existing records from primary storage. [2025-10-27T19:29:14.866460] [INFO ] [MAIN ] JLS: Loaded 4056 existing records. [2025-10-27T19:29:15.044325] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:29:15.044614] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-27T19:29:15.044761] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-27T19:29:15.044906] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-27T19:29:15.044944] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-27T19:29:15.401699] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:29:15.427526] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T19:29:15.614939] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-27T19:29:15.815195] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T19:29:16.005305] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-27T19:29:16.414984] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-27T19:29:16.788565] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-27T19:29:17.214957] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-27T19:29:18.014920] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-27T19:29:18.652897] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-27T19:29:18.814966] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-27T19:29:18.908131] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-27T19:29:19.614948] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-27T19:29:19.887418] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-27T19:29:20.414878] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-27T19:29:21.162579] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T19:29:21.214944] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-27T19:29:21.284915] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T19:29:22.015000] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-27T19:29:22.513403] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-27T19:29:22.521196] [INFO ] [REMOTE ] JKS: Full fetch complete (58541 records). [2025-10-27T19:29:22.521332] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-27T19:29:22.820107] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-27T19:29:22.905383] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-27T19:29:22.905475] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-27T19:29:22.906316] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-27T19:29:22.906376] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-27T19:29:22.907473] [DEBUG] [LOCAL ] JKS: Trimmed 58541 records to 38863 (keeping 200 days of data) [2025-10-27T19:29:23.137993] [DEBUG] [LOCAL ] JKS: Primary data saved (38863 records). [2025-10-27T19:29:23.138281] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-27T19:29:23.138847] [INFO ] [MAIN ] Update Progress: 1158/2366 symbols completed. JKS took 27.1s. Estimated remaining: 2h 35m 47s. Rate: 7.8 symbols/min [2025-10-27T19:29:23.260134] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-27T19:29:23.392835] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-27T19:29:23.614973] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-27T19:29:24.201385] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-27T19:29:24.414992] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-27T19:29:25.214958] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-27T19:29:25.386987] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-27T19:29:25.864616] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T19:29:26.014958] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-27T19:29:26.550370] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-27T19:29:26.815008] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-27T19:29:27.376550] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-27T19:29:27.615004] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-27T19:29:28.174281] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-27T19:29:28.414959] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-27T19:29:28.762309] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-27T19:29:29.214932] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-27T19:29:29.621444] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-27T19:29:29.623344] [INFO ] [REMOTE ] JLS: Full fetch complete (5820 records). [2025-10-27T19:29:29.623446] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-27T19:29:29.977847] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-27T19:29:29.977921] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-27T19:29:29.978072] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-27T19:29:29.978114] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-27T19:29:29.978462] [DEBUG] [LOCAL ] JLS: Trimmed 5820 records to 3941 (keeping 200 days of data) [2025-10-27T19:29:30.004736] [DEBUG] [LOCAL ] JLS: Primary data saved (3941 records). [2025-10-27T19:29:30.004872] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-27T19:29:30.004966] [INFO ] [MAIN ] Update Progress: 1159/2366 symbols completed. JLS took 15.3s. Estimated remaining: 2h 35m 38s. Rate: 7.8 symbols/min [2025-10-27T19:29:30.014979] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-27T19:29:30.898097] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-27T19:29:30.904607] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-27T19:29:31.890276] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T19:29:31.895593] [INFO ] [REMOTE ] JLL: Full fetch complete (45090 records). [2025-10-27T19:29:31.895729] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-27T19:29:32.270704] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-27T19:29:32.270834] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-27T19:29:32.271538] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-27T19:29:32.271577] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-27T19:29:32.272503] [DEBUG] [LOCAL ] JLL: Trimmed 45090 records to 31094 (keeping 200 days of data) [2025-10-27T19:29:32.451993] [DEBUG] [LOCAL ] JLL: Primary data saved (31094 records). [2025-10-27T19:29:32.452113] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-27T19:29:32.452188] [INFO ] [MAIN ] Update Progress: 1160/2366 symbols completed. JLL took 30.1s. Estimated remaining: 2h 35m 25s. Rate: 7.8 symbols/min [2025-10-27T19:29:33.106977] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:29:33.152232] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:29:33.150601] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:29:33.171067] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-27T19:29:33.171150] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-27T19:29:33.172693] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:29:33.171382] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-27T19:29:33.173561] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-27T19:29:33.173623] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-27T19:29:33.173961] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-27T19:29:33.512065] [DEBUG] [LOCAL ] JMIA: Loaded 51953 existing records from primary storage. [2025-10-27T19:29:33.593437] [DEBUG] [LOCAL ] JNJ: Loaded 54533 existing records from primary storage. [2025-10-27T19:29:33.592444] [INFO ] [MAIN ] JMIA: Loaded 51953 existing records. [2025-10-27T19:29:33.598965] [INFO ] [MAIN ] JNJ: Loaded 54533 existing records. [2025-10-27T19:29:33.605084] [DEBUG] [LOCAL ] JOBY: Loaded 54589 existing records from primary storage. [2025-10-27T19:29:33.684663] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:29:33.684767] [INFO ] [MAIN ] JOBY: Loaded 54589 existing records. [2025-10-27T19:29:33.709998] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-27T19:29:34.086802] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:29:34.160998] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-27T19:29:34.166590] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:29:34.166738] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-27T19:29:34.179349] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-27T19:29:34.178736] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-27T19:29:34.194742] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-27T19:29:34.194864] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-27T19:29:34.199599] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-27T19:29:34.199489] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:29:34.200700] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-27T19:29:34.200777] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-27T19:29:34.194978] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-27T19:29:34.201014] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-27T19:29:34.200982] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-27T19:29:34.201125] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-27T19:29:34.250405] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-27T19:29:34.577083] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-27T19:29:34.654806] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-27T19:29:35.168993] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-27T19:29:35.209851] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-27T19:29:35.229176] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:29:35.321824] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-27T19:29:35.327386] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:29:35.348988] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:29:35.614958] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-27T19:29:35.745867] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-27T19:29:36.414986] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-27T19:29:36.896836] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-27T19:29:37.215003] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-27T19:29:37.300610] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-27T19:29:37.901889] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-27T19:29:38.014963] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-27T19:29:38.471793] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-27T19:29:38.814991] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-27T19:29:38.956419] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T19:29:39.614958] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-27T19:29:40.414976] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-27T19:29:40.873011] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-27T19:29:40.963365] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-27T19:29:41.226418] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-27T19:29:41.228938] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-27T19:29:42.014964] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-27T19:29:42.815016] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-27T19:29:43.405350] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-27T19:29:43.614968] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-27T19:29:44.391358] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-27T19:29:44.420039] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-27T19:29:44.435982] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-27T19:29:45.214926] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-27T19:29:45.639410] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-27T19:29:45.656209] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-27T19:29:45.724600] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T19:29:46.014946] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-27T19:29:46.814940] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-27T19:29:47.414425] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-27T19:29:47.614942] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-27T19:29:47.802377] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-27T19:29:48.414922] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-27T19:29:48.850493] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-27T19:29:48.851312] [INFO ] [REMOTE ] JMM: Full fetch complete (2321 records). [2025-10-27T19:29:48.851379] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-27T19:29:49.029917] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-27T19:29:49.030148] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:29:49.030236] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:29:49.030330] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-27T19:29:49.030412] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-27T19:29:49.030450] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-27T19:29:49.030491] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-27T19:29:49.030544] [INFO ] [MAIN ] Update Progress: 1161/2366 symbols completed. JMM took 16.6s. Estimated remaining: 2h 35m 27s. Rate: 7.8 symbols/min [2025-10-27T19:29:49.199383] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:29:49.214981] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-27T19:29:49.225214] [DEBUG] [LOCAL ] JOE: Loaded 23916 existing records from primary storage. [2025-10-27T19:29:49.225431] [INFO ] [MAIN ] JOE: Loaded 23916 existing records. [2025-10-27T19:29:49.415895] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:29:49.416311] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-27T19:29:49.416522] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-27T19:29:49.416914] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-27T19:29:49.416995] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-27T19:29:49.813843] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:29:49.819102] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-27T19:29:50.014932] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-27T19:29:50.815025] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-27T19:29:51.441162] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T19:29:51.614916] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-27T19:29:51.839846] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-10-27T19:29:52.077347] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T19:29:52.296477] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-27T19:29:52.414965] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-27T19:29:53.214998] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-27T19:29:54.014950] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-27T19:29:54.210681] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-27T19:29:54.814934] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-27T19:29:54.974223] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T19:29:55.007854] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T19:29:55.614961] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-27T19:29:56.415025] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-27T19:29:56.545552] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-27T19:29:56.915306] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-27T19:29:57.214934] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-27T19:29:57.965323] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-27T19:29:58.014961] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-27T19:29:58.206875] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T19:29:58.814993] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-27T19:29:59.615022] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-27T19:30:00.300389] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-27T19:30:00.414932] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-27T19:30:00.596509] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-27T19:30:00.664981] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T19:30:01.214938] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-27T19:30:02.015006] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-27T19:30:02.718474] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T19:30:02.814939] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-27T19:30:03.158429] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.74 seconds). [2025-10-27T19:30:03.563981] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-27T19:30:03.614926] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-27T19:30:04.414956] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-27T19:30:05.214981] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-27T19:30:05.387289] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (3.37 seconds). [2025-10-27T19:30:05.906567] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-27T19:30:05.916887] [INFO ] [REMOTE ] JMIA: Full fetch complete (73509 records). [2025-10-27T19:30:05.917023] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-27T19:30:06.020839] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-27T19:30:06.324939] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-10-27T19:30:06.373102] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-27T19:30:06.373695] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-27T19:30:06.375624] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-27T19:30:06.375717] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-27T19:30:06.377692] [DEBUG] [LOCAL ] JMIA: Trimmed 73509 records to 51192 (keeping 200 days of data) [2025-10-27T19:30:06.697285] [DEBUG] [LOCAL ] JMIA: Primary data saved (51192 records). [2025-10-27T19:30:06.697497] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-27T19:30:06.697607] [INFO ] [MAIN ] Update Progress: 1162/2366 symbols completed. JMIA took 34.2s. Estimated remaining: 2h 35m 29s. Rate: 7.7 symbols/min [2025-10-27T19:30:06.820177] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-27T19:30:06.882833] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:30:06.893954] [DEBUG] [LOCAL ] JOF: Loaded 6999 existing records from primary storage. [2025-10-27T19:30:06.894262] [INFO ] [MAIN ] JOF: Loaded 6999 existing records. [2025-10-27T19:30:07.086125] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:30:07.086502] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-27T19:30:07.086555] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-27T19:30:07.086907] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-27T19:30:07.086970] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-27T19:30:07.473596] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:30:07.509881] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-27T19:30:07.614931] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-27T19:30:07.737431] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-27T19:30:07.741781] [INFO ] [REMOTE ] JOE: Full fetch complete (35330 records). [2025-10-27T19:30:07.741900] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-27T19:30:08.108688] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-27T19:30:08.108783] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-27T19:30:08.109419] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-27T19:30:08.109459] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-27T19:30:08.110413] [DEBUG] [LOCAL ] JOE: Trimmed 35330 records to 23241 (keeping 200 days of data) [2025-10-27T19:30:08.247626] [DEBUG] [LOCAL ] JOE: Primary data saved (23241 records). [2025-10-27T19:30:08.247767] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-27T19:30:08.247841] [INFO ] [MAIN ] Update Progress: 1163/2366 symbols completed. JOE took 19.2s. Estimated remaining: 2h 35m 15s. Rate: 7.7 symbols/min [2025-10-27T19:30:08.424521] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:30:08.421000] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-27T19:30:08.467287] [DEBUG] [LOCAL ] JPC: Loaded 37523 existing records from primary storage. [2025-10-27T19:30:08.467739] [INFO ] [MAIN ] JPC: Loaded 37523 existing records. [2025-10-27T19:30:08.648388] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-27T19:30:08.702779] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:30:08.703259] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-27T19:30:08.703307] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-27T19:30:08.703489] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-27T19:30:08.703527] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-27T19:30:09.058943] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-27T19:30:09.063932] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:30:09.214989] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-27T19:30:09.858482] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-27T19:30:09.876108] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-27T19:30:10.014948] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-27T19:30:10.815003] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-27T19:30:11.167785] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T19:30:11.614976] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-27T19:30:12.414986] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-27T19:30:13.063199] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-27T19:30:13.214954] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-27T19:30:13.889309] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T19:30:14.020035] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-27T19:30:14.038359] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-27T19:30:14.814928] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-27T19:30:15.488976] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-27T19:30:15.524638] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T19:30:15.620678] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-27T19:30:15.633451] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-27T19:30:15.643740] [INFO ] [REMOTE ] JNJ: Full fetch complete (77933 records). [2025-10-27T19:30:15.643842] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-27T19:30:16.050335] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-27T19:30:16.050408] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-27T19:30:16.051369] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-27T19:30:16.051430] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-27T19:30:16.052811] [DEBUG] [LOCAL ] JNJ: Trimmed 77933 records to 53753 (keeping 200 days of data) [2025-10-27T19:30:16.384096] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-10-27T19:30:16.384222] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-27T19:30:16.385206] [INFO ] [MAIN ] Update Progress: 1164/2366 symbols completed. JNJ took 43.9s. Estimated remaining: 2h 35m 8s. Rate: 7.7 symbols/min [2025-10-27T19:30:16.420228] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-27T19:30:16.551306] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:30:16.602180] [DEBUG] [LOCAL ] JPM: Loaded 54574 existing records from primary storage. [2025-10-27T19:30:16.602597] [INFO ] [MAIN ] JPM: Loaded 54574 existing records. [2025-10-27T19:30:16.777831] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:30:16.778076] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-27T19:30:16.778265] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-27T19:30:16.786639] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-27T19:30:16.800077] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-27T19:30:16.844083] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-27T19:30:17.157964] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:30:17.214898] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-27T19:30:18.014951] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-27T19:30:18.525414] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-27T19:30:18.814959] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-27T19:30:19.076675] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-27T19:30:19.087939] [INFO ] [REMOTE ] JOBY: Full fetch complete (77974 records). [2025-10-27T19:30:19.088178] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-27T19:30:19.309818] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-27T19:30:19.497240] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-27T19:30:19.546742] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-27T19:30:19.546827] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-27T19:30:19.547850] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-27T19:30:19.547914] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-27T19:30:19.549359] [DEBUG] [LOCAL ] JOBY: Trimmed 77974 records to 53809 (keeping 200 days of data) [2025-10-27T19:30:19.629927] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-27T19:30:19.862196] [DEBUG] [LOCAL ] JOBY: Primary data saved (53809 records). [2025-10-27T19:30:19.862322] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-27T19:30:19.862397] [INFO ] [MAIN ] Update Progress: 1165/2366 symbols completed. JOBY took 47.4s. Estimated remaining: 2h 34m 56s. Rate: 7.8 symbols/min [2025-10-27T19:30:20.031618] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:30:20.064126] [DEBUG] [LOCAL ] JQC: Loaded 34356 existing records from primary storage. [2025-10-27T19:30:20.064378] [INFO ] [MAIN ] JQC: Loaded 34356 existing records. [2025-10-27T19:30:20.250092] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:30:20.250302] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-27T19:30:20.250349] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-27T19:30:20.250567] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-27T19:30:20.250624] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-27T19:30:20.426188] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-27T19:30:20.617379] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:30:21.214948] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-27T19:30:21.770384] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-27T19:30:21.874315] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T19:30:22.014979] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-27T19:30:22.557422] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T19:30:22.814965] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-27T19:30:23.614936] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-27T19:30:24.090919] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-27T19:30:24.129838] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T19:30:24.414935] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-27T19:30:24.463639] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-27T19:30:25.215012] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-27T19:30:25.805452] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-27T19:30:26.014983] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-27T19:30:26.282625] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-27T19:30:26.815022] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-27T19:30:27.505901] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T19:30:27.614912] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-27T19:30:28.414991] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-27T19:30:28.519799] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T19:30:28.863000] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-27T19:30:28.861309] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-27T19:30:29.214933] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-27T19:30:30.015000] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-27T19:30:30.612419] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T19:30:30.814908] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-27T19:30:30.834442] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T19:30:31.614939] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-27T19:30:32.329324] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-27T19:30:32.414936] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-27T19:30:33.043588] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T19:30:33.051076] [INFO ] [REMOTE ] JPC: Full fetch complete (54946 records). [2025-10-27T19:30:33.051186] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-27T19:30:33.221345] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-27T19:30:33.428146] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-27T19:30:33.428226] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-27T19:30:33.429024] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-27T19:30:33.429085] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-27T19:30:33.430217] [DEBUG] [LOCAL ] JPC: Trimmed 54946 records to 36745 (keeping 200 days of data) [2025-10-27T19:30:33.651348] [DEBUG] [LOCAL ] JPC: Primary data saved (36745 records). [2025-10-27T19:30:33.651462] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-27T19:30:33.651806] [INFO ] [MAIN ] Update Progress: 1166/2366 symbols completed. JPC took 25.4s. Estimated remaining: 2h 34m 54s. Rate: 7.7 symbols/min [2025-10-27T19:30:33.738767] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T19:30:33.852181] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:30:33.873821] [DEBUG] [LOCAL ] JRI: Loaded 15493 existing records from primary storage. [2025-10-27T19:30:33.874124] [INFO ] [MAIN ] JRI: Loaded 15493 existing records. [2025-10-27T19:30:34.020284] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-27T19:30:34.063384] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:30:34.070004] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-27T19:30:34.070325] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T19:30:34.070408] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-27T19:30:34.072975] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-27T19:30:34.073458] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-27T19:30:34.425104] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:30:34.814919] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-27T19:30:34.920525] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T19:30:35.614969] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-27T19:30:35.653881] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-27T19:30:35.655729] [INFO ] [REMOTE ] JOF: Full fetch complete (9546 records). [2025-10-27T19:30:35.655806] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-27T19:30:36.019219] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-27T19:30:36.019290] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-27T19:30:36.019506] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-27T19:30:36.019544] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-27T19:30:36.019975] [DEBUG] [LOCAL ] JOF: Trimmed 9546 records to 6868 (keeping 200 days of data) [2025-10-27T19:30:36.059732] [DEBUG] [LOCAL ] JOF: Primary data saved (6868 records). [2025-10-27T19:30:36.059839] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-27T19:30:36.059918] [INFO ] [MAIN ] Update Progress: 1167/2366 symbols completed. JOF took 29.4s. Estimated remaining: 2h 34m 41s. Rate: 7.8 symbols/min [2025-10-27T19:30:36.227635] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:30:36.239591] [DEBUG] [LOCAL ] JRS: Loaded 11662 existing records from primary storage. [2025-10-27T19:30:36.239843] [INFO ] [MAIN ] JRS: Loaded 11662 existing records. [2025-10-27T19:30:36.433395] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-27T19:30:36.438293] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:30:36.439116] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-27T19:30:36.439167] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-27T19:30:36.439306] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-27T19:30:36.439345] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-27T19:30:36.797392] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:30:36.812804] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T19:30:37.214958] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-27T19:30:37.639096] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T19:30:37.761230] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-27T19:30:38.014936] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-27T19:30:38.492842] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-27T19:30:38.814962] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-27T19:30:39.614934] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-27T19:30:39.810422] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-27T19:30:40.414939] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-27T19:30:41.214994] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-27T19:30:41.494507] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-27T19:30:41.669872] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-27T19:30:42.014940] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-27T19:30:42.170286] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-27T19:30:42.775602] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-27T19:30:42.814917] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-27T19:30:43.614940] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-27T19:30:43.633143] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T19:30:44.298267] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-27T19:30:44.414930] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-27T19:30:44.968602] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-27T19:30:45.214933] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-27T19:30:45.945311] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T19:30:46.014921] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-27T19:30:46.814931] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-27T19:30:46.973117] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-27T19:30:47.614939] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-27T19:30:48.415048] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-27T19:30:48.439623] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T19:30:48.782482] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-27T19:30:48.998417] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-27T19:30:49.215006] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-27T19:30:50.014978] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-27T19:30:50.253423] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T19:30:50.514108] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-27T19:30:50.815002] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-27T19:30:51.615009] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-27T19:30:52.092408] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-27T19:30:52.414991] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-27T19:30:52.665525] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-27T19:30:53.214946] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-27T19:30:53.408848] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T19:30:53.416271] [INFO ] [REMOTE ] JQC: Full fetch complete (50101 records). [2025-10-27T19:30:53.416466] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-27T19:30:53.806745] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-27T19:30:53.806841] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-27T19:30:53.807720] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-27T19:30:53.807866] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-27T19:30:53.808980] [DEBUG] [LOCAL ] JQC: Trimmed 50101 records to 33597 (keeping 200 days of data) [2025-10-27T19:30:54.014288] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T19:30:54.014917] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-27T19:30:54.027834] [DEBUG] [LOCAL ] JQC: Primary data saved (33597 records). [2025-10-27T19:30:54.028570] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-27T19:30:54.028719] [INFO ] [MAIN ] Update Progress: 1168/2366 symbols completed. JQC took 34.2s. Estimated remaining: 2h 34m 44s. Rate: 7.7 symbols/min [2025-10-27T19:30:54.195617] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:30:54.234589] [DEBUG] [LOCAL ] JXN: Loaded 44772 existing records from primary storage. [2025-10-27T19:30:54.234916] [INFO ] [MAIN ] JXN: Loaded 44772 existing records. [2025-10-27T19:30:54.404933] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:30:54.405149] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-27T19:30:54.405194] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-27T19:30:54.405370] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-27T19:30:54.405407] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-27T19:30:54.748062] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:30:54.814911] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-27T19:30:55.614956] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-27T19:30:56.008233] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-27T19:30:56.324838] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T19:30:56.376286] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T19:30:56.414898] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-27T19:30:57.214994] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-27T19:30:58.014986] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-27T19:30:58.029131] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T19:30:58.465453] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-27T19:30:58.814978] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-27T19:30:59.537126] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T19:30:59.614914] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-27T19:30:59.758953] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-27T19:30:59.761712] [INFO ] [REMOTE ] JRS: Full fetch complete (16037 records). [2025-10-27T19:30:59.761795] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-27T19:31:00.116319] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-27T19:31:00.116413] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-27T19:31:00.116804] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-27T19:31:00.116866] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-27T19:31:00.117364] [DEBUG] [LOCAL ] JRS: Trimmed 16037 records to 11423 (keeping 200 days of data) [2025-10-27T19:31:00.180514] [DEBUG] [LOCAL ] JRS: Primary data saved (11423 records). [2025-10-27T19:31:00.180630] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-27T19:31:00.180741] [INFO ] [MAIN ] Update Progress: 1169/2366 symbols completed. JRS took 24.1s. Estimated remaining: 2h 34m 34s. Rate: 7.7 symbols/min [2025-10-27T19:31:00.344904] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:31:00.390503] [DEBUG] [LOCAL ] K: Loaded 51098 existing records from primary storage. [2025-10-27T19:31:00.390816] [INFO ] [MAIN ] K: Loaded 51098 existing records. [2025-10-27T19:31:00.420695] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-27T19:31:00.570904] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:31:00.571122] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-27T19:31:00.571195] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-27T19:31:00.571590] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-27T19:31:00.571706] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-27T19:31:00.928634] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:31:01.214944] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-27T19:31:01.641471] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-27T19:31:02.014924] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-27T19:31:02.519481] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-27T19:31:02.814997] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-27T19:31:02.877918] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T19:31:02.882321] [INFO ] [REMOTE ] JRI: Full fetch complete (22752 records). [2025-10-27T19:31:02.882420] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-27T19:31:03.241679] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-27T19:31:03.241769] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-27T19:31:03.242264] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-27T19:31:03.242305] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-27T19:31:03.242947] [DEBUG] [LOCAL ] JRI: Trimmed 22752 records to 15041 (keeping 200 days of data) [2025-10-27T19:31:03.334171] [DEBUG] [LOCAL ] JRI: Primary data saved (15041 records). [2025-10-27T19:31:03.334314] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-27T19:31:03.334398] [INFO ] [MAIN ] Update Progress: 1170/2366 symbols completed. JRI took 29.7s. Estimated remaining: 2h 34m 22s. Rate: 7.7 symbols/min [2025-10-27T19:31:03.499724] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:31:03.514111] [DEBUG] [LOCAL ] KAI: Loaded 13576 existing records from primary storage. [2025-10-27T19:31:03.514332] [INFO ] [MAIN ] KAI: Loaded 13576 existing records. [2025-10-27T19:31:03.617319] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-27T19:31:03.698059] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:31:03.698367] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-27T19:31:03.698443] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-27T19:31:03.698761] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-27T19:31:03.698820] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-27T19:31:04.080860] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:31:04.082750] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (3.66 seconds). [2025-10-27T19:31:04.094142] [INFO ] [REMOTE ] JPM: Full fetch complete (77973 records). [2025-10-27T19:31:04.094300] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-27T19:31:04.219400] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T19:31:04.420183] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-27T19:31:04.518444] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-27T19:31:04.518526] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-27T19:31:04.519564] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-27T19:31:04.519628] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-27T19:31:04.521161] [DEBUG] [LOCAL ] JPM: Trimmed 77973 records to 53794 (keeping 200 days of data) [2025-10-27T19:31:04.860456] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-10-27T19:31:04.860615] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-27T19:31:04.861476] [INFO ] [MAIN ] Update Progress: 1171/2366 symbols completed. JPM took 48.5s. Estimated remaining: 2h 34m 8s. Rate: 7.8 symbols/min [2025-10-27T19:31:05.033592] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:31:05.081950] [DEBUG] [LOCAL ] KAR: Loaded 40299 existing records from primary storage. [2025-10-27T19:31:05.082251] [INFO ] [MAIN ] KAR: Loaded 40299 existing records. [2025-10-27T19:31:05.224580] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-27T19:31:05.266879] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:31:05.267074] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-27T19:31:05.267149] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-27T19:31:05.267556] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-27T19:31:05.267626] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-27T19:31:05.551164] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T19:31:05.674201] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:31:05.832425] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T19:31:06.014915] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-27T19:31:06.066862] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T19:31:06.814949] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-27T19:31:07.614970] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-27T19:31:07.870123] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-27T19:31:08.419189] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-27T19:31:08.437347] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T19:31:08.663907] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-27T19:31:09.214990] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-27T19:31:09.643486] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-27T19:31:10.014943] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-27T19:31:10.793491] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T19:31:10.814897] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-27T19:31:10.983517] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-27T19:31:11.614943] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-27T19:31:12.394440] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-27T19:31:12.414989] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-27T19:31:12.989762] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T19:31:13.214964] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-27T19:31:13.477240] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T19:31:14.014934] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-27T19:31:14.540923] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T19:31:14.578422] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-27T19:31:14.814945] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-27T19:31:15.614948] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-27T19:31:15.967357] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T19:31:16.414934] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-27T19:31:17.218880] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-27T19:31:17.233332] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T19:31:17.365360] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-27T19:31:18.014972] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-27T19:31:18.518741] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-27T19:31:18.580280] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-27T19:31:18.814949] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-27T19:31:19.540473] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-27T19:31:19.614939] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-27T19:31:20.414969] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-27T19:31:21.214938] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-27T19:31:21.239776] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-27T19:31:21.248592] [INFO ] [REMOTE ] JXN: Full fetch complete (65257 records). [2025-10-27T19:31:21.248796] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-27T19:31:21.657992] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-27T19:31:21.657177] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-27T19:31:21.661598] [INFO ] [REMOTE ] KAI: Full fetch complete (19400 records). [2025-10-27T19:31:21.661488] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-27T19:31:21.661783] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-27T19:31:21.662983] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-27T19:31:21.663245] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-27T19:31:21.768933] [DEBUG] [LOCAL ] JXN: Trimmed 65257 records to 43924 (keeping 200 days of data) [2025-10-27T19:31:22.015487] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-27T19:31:22.257239] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-27T19:31:22.257693] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-27T19:31:22.258341] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-27T19:31:22.258425] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-27T19:31:22.305204] [DEBUG] [LOCAL ] KAI: Trimmed 19400 records to 13227 (keeping 200 days of data) [2025-10-27T19:31:22.407961] [DEBUG] [LOCAL ] JXN: Primary data saved (43924 records). [2025-10-27T19:31:22.408229] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-27T19:31:22.410701] [INFO ] [MAIN ] Update Progress: 1172/2366 symbols completed. JXN took 28.4s. Estimated remaining: 2h 34m 10s. Rate: 7.7 symbols/min [2025-10-27T19:31:22.608147] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:31:22.619122] [DEBUG] [LOCAL ] KAI: Primary data saved (13227 records). [2025-10-27T19:31:22.619316] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-27T19:31:22.619681] [INFO ] [MAIN ] Update Progress: 1173/2366 symbols completed. KAI took 19.3s. Estimated remaining: 2h 33m 54s. Rate: 7.8 symbols/min [2025-10-27T19:31:22.740790] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T19:31:22.819322] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-27T19:31:22.818171] [DEBUG] [LOCAL ] KB: Loaded 23210 existing records from primary storage. [2025-10-27T19:31:22.853150] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:31:22.853525] [INFO ] [MAIN ] KB: Loaded 23210 existing records. [2025-10-27T19:31:23.034087] [DEBUG] [LOCAL ] KBDC: Loaded 22964 existing records from primary storage. [2025-10-27T19:31:23.054350] [INFO ] [MAIN ] KBDC: Loaded 22964 existing records. [2025-10-27T19:31:23.054250] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:31:23.054582] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-27T19:31:23.103036] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-27T19:31:23.162630] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-27T19:31:23.162863] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-27T19:31:23.390867] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:31:23.414040] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-27T19:31:23.424436] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-27T19:31:23.434236] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-27T19:31:23.458199] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-27T19:31:23.855786] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:31:23.881464] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-27T19:31:24.006099] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:31:24.041262] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-27T19:31:24.414958] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-27T19:31:24.474604] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T19:31:24.729122] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-27T19:31:25.214953] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-27T19:31:25.356830] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-27T19:31:26.014924] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-27T19:31:26.094882] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-27T19:31:26.644102] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T19:31:26.814980] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-27T19:31:27.614959] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-27T19:31:28.012766] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T19:31:28.414944] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-27T19:31:29.223693] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-27T19:31:29.229509] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T19:31:29.838485] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T19:31:30.014982] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-27T19:31:30.322019] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-27T19:31:30.741964] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T19:31:30.814963] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-27T19:31:31.615013] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-27T19:31:31.935050] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T19:31:32.414982] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-27T19:31:32.971290] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T19:31:33.215013] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-27T19:31:33.738005] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-27T19:31:34.014932] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-27T19:31:34.314616] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-27T19:31:34.815022] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-27T19:31:35.511620] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T19:31:35.531999] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-27T19:31:35.614952] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-27T19:31:36.414915] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-27T19:31:36.639440] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T19:31:37.214915] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-27T19:31:37.606506] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T19:31:37.936240] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T19:31:38.014964] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-27T19:31:38.815038] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-27T19:31:39.154852] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T19:31:39.614938] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-27T19:31:39.933681] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-27T19:31:40.415041] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-27T19:31:40.708462] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T19:31:41.214998] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-27T19:31:41.724834] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T19:31:42.014970] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-27T19:31:42.815468] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-27T19:31:42.815389] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T19:31:42.891465] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T19:31:42.900928] [INFO ] [REMOTE ] K: Full fetch complete (72248 records). [2025-10-27T19:31:42.901052] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-27T19:31:43.293358] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-27T19:31:43.293442] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-27T19:31:43.294544] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-27T19:31:43.294612] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-27T19:31:43.296056] [DEBUG] [LOCAL ] K: Trimmed 72248 records to 50265 (keeping 200 days of data) [2025-10-27T19:31:43.617096] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-27T19:31:43.621860] [DEBUG] [LOCAL ] K: Primary data saved (50265 records). [2025-10-27T19:31:43.622021] [INFO ] [MAIN ] K: Full history saved. [2025-10-27T19:31:43.622121] [INFO ] [MAIN ] Update Progress: 1174/2366 symbols completed. K took 43.4s. Estimated remaining: 2h 34m 0s. Rate: 7.7 symbols/min [2025-10-27T19:31:43.815886] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:31:43.860637] [DEBUG] [LOCAL ] KBH: Loaded 49358 existing records from primary storage. [2025-10-27T19:31:43.860969] [INFO ] [MAIN ] KBH: Loaded 49358 existing records. [2025-10-27T19:31:44.065054] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:31:44.065377] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-27T19:31:44.065442] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-27T19:31:44.065781] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-27T19:31:44.065855] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-27T19:31:44.237027] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T19:31:44.355825] [INFO ] [REMOTE ] KAR: Full fetch complete (57037 records). [2025-10-27T19:31:44.375557] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-27T19:31:44.420185] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-27T19:31:44.617162] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:31:44.686322] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-27T19:31:44.958891] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-27T19:31:44.958976] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-27T19:31:44.959887] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-27T19:31:44.959953] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-27T19:31:44.961207] [DEBUG] [LOCAL ] KAR: Trimmed 57037 records to 39580 (keeping 200 days of data) [2025-10-27T19:31:45.182685] [DEBUG] [LOCAL ] KAR: Primary data saved (39580 records). [2025-10-27T19:31:45.182815] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-27T19:31:45.183553] [INFO ] [MAIN ] Update Progress: 1175/2366 symbols completed. KAR took 40.3s. Estimated remaining: 2h 33m 46s. Rate: 7.7 symbols/min [2025-10-27T19:31:45.224852] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-27T19:31:45.358526] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:31:45.405188] [DEBUG] [LOCAL ] KBR: Loaded 48714 existing records from primary storage. [2025-10-27T19:31:45.405496] [INFO ] [MAIN ] KBR: Loaded 48714 existing records. [2025-10-27T19:31:45.529985] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T19:31:45.601706] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:31:45.601875] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-27T19:31:45.601921] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-27T19:31:45.602104] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-27T19:31:45.602143] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-27T19:31:45.951717] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:31:46.014906] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-27T19:31:46.814927] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-27T19:31:46.923107] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T19:31:47.359143] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T19:31:47.614977] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-27T19:31:47.987414] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T19:31:48.339178] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T19:31:48.342999] [INFO ] [REMOTE ] KB: Full fetch complete (33356 records). [2025-10-27T19:31:48.343090] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-27T19:31:48.420261] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-27T19:31:48.737088] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-27T19:31:48.737155] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-27T19:31:48.737857] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-27T19:31:48.737919] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-27T19:31:48.738689] [DEBUG] [LOCAL ] KB: Trimmed 33356 records to 22731 (keeping 200 days of data) [2025-10-27T19:31:48.876492] [DEBUG] [LOCAL ] KB: Primary data saved (22731 records). [2025-10-27T19:31:48.876634] [INFO ] [MAIN ] KB: Full history saved. [2025-10-27T19:31:48.876766] [INFO ] [MAIN ] Update Progress: 1176/2366 symbols completed. KB took 26.5s. Estimated remaining: 2h 33m 34s. Rate: 7.7 symbols/min [2025-10-27T19:31:49.044388] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:31:49.093330] [DEBUG] [LOCAL ] KD: Loaded 53087 existing records from primary storage. [2025-10-27T19:31:49.093631] [INFO ] [MAIN ] KD: Loaded 53087 existing records. [2025-10-27T19:31:49.220069] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-27T19:31:49.293199] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:31:49.293439] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-27T19:31:49.293493] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-27T19:31:49.293773] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-27T19:31:49.293837] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-27T19:31:49.655046] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:31:49.671257] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-27T19:31:49.677679] [INFO ] [REMOTE ] KBDC: Full fetch complete (31145 records). [2025-10-27T19:31:49.677776] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-27T19:31:50.015862] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-27T19:31:50.046215] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-27T19:31:50.046282] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-27T19:31:50.047022] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-27T19:31:50.047083] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-27T19:31:50.047861] [DEBUG] [LOCAL ] KBDC: Trimmed 31145 records to 22512 (keeping 200 days of data) [2025-10-27T19:31:50.183347] [DEBUG] [LOCAL ] KBDC: Primary data saved (22512 records). [2025-10-27T19:31:50.183475] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-27T19:31:50.183595] [INFO ] [MAIN ] Update Progress: 1177/2366 symbols completed. KBDC took 27.6s. Estimated remaining: 2h 33m 20s. Rate: 7.8 symbols/min [2025-10-27T19:31:50.355219] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:31:50.362074] [DEBUG] [LOCAL ] KEN: Loaded 4617 existing records from primary storage. [2025-10-27T19:31:50.362272] [INFO ] [MAIN ] KEN: Loaded 4617 existing records. [2025-10-27T19:31:50.546990] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:31:50.547247] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-27T19:31:50.547408] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-27T19:31:50.547575] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-27T19:31:50.547629] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-27T19:31:50.723865] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T19:31:50.823982] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-27T19:31:50.941141] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:31:51.231501] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T19:31:51.614937] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-27T19:31:52.414966] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-27T19:31:52.775636] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-27T19:31:53.214993] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-27T19:31:53.259858] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T19:31:54.015042] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-27T19:31:54.082582] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-27T19:31:54.359688] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T19:31:54.814996] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-27T19:31:55.271791] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-27T19:31:55.625172] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-27T19:31:55.628710] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T19:31:55.920031] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-27T19:31:56.414995] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-27T19:31:57.214946] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-27T19:31:57.577413] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-27T19:31:58.014961] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-27T19:31:58.814981] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-27T19:31:59.016928] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T19:31:59.415543] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T19:31:59.614939] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-27T19:32:00.019712] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T19:32:00.110235] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-27T19:32:00.414929] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-27T19:32:01.214991] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-27T19:32:02.014941] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-27T19:32:02.032203] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-27T19:32:02.814939] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-27T19:32:03.459078] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-27T19:32:03.614962] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-27T19:32:04.357244] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-27T19:32:04.414941] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-27T19:32:04.980566] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (3.77 seconds). [2025-10-27T19:32:05.214949] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-27T19:32:05.889952] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-27T19:32:06.014944] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-27T19:32:06.523118] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T19:32:06.812754] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-27T19:32:06.814897] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-27T19:32:06.903386] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-27T19:32:07.231995] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-27T19:32:07.614972] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-27T19:32:08.414979] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-27T19:32:09.214919] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-27T19:32:09.268702] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-27T19:32:09.613787] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-27T19:32:09.613616] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T19:32:10.014953] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-27T19:32:10.401695] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-27T19:32:10.814933] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-27T19:32:11.615011] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-27T19:32:12.129533] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T19:32:12.139535] [INFO ] [REMOTE ] KBR: Full fetch complete (70071 records). [2025-10-27T19:32:12.139686] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-27T19:32:12.420134] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-27T19:32:12.553487] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-27T19:32:12.553599] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-27T19:32:12.554912] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-27T19:32:12.554987] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-27T19:32:12.556763] [DEBUG] [LOCAL ] KBR: Trimmed 70071 records to 47929 (keeping 200 days of data) [2025-10-27T19:32:12.837387] [DEBUG] [LOCAL ] KBR: Primary data saved (47929 records). [2025-10-27T19:32:12.837508] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-27T19:32:12.838261] [INFO ] [MAIN ] Update Progress: 1178/2366 symbols completed. KBR took 27.7s. Estimated remaining: 2h 33m 27s. Rate: 7.7 symbols/min [2025-10-27T19:32:13.011340] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:32:13.045347] [DEBUG] [LOCAL ] KEP: Loaded 32980 existing records from primary storage. [2025-10-27T19:32:13.045608] [INFO ] [MAIN ] KEP: Loaded 32980 existing records. [2025-10-27T19:32:13.149957] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T19:32:13.151239] [INFO ] [REMOTE ] KEN: Full fetch complete (5838 records). [2025-10-27T19:32:13.177559] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-27T19:32:13.220895] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-27T19:32:13.297934] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:32:13.298157] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-27T19:32:13.319699] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-27T19:32:13.328211] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-27T19:32:13.335907] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-27T19:32:13.913176] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-27T19:32:13.920686] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-27T19:32:13.940086] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-27T19:32:13.920596] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-27T19:32:13.953368] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-27T19:32:13.980804] [DEBUG] [LOCAL ] KEN: Trimmed 5838 records to 4395 (keeping 200 days of data) [2025-10-27T19:32:14.038788] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-27T19:32:14.045012] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:32:14.060248] [DEBUG] [LOCAL ] KEN: Primary data saved (4395 records). [2025-10-27T19:32:14.060342] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-27T19:32:14.060416] [INFO ] [MAIN ] Update Progress: 1179/2366 symbols completed. KEN took 23.9s. Estimated remaining: 2h 33m 13s. Rate: 7.7 symbols/min [2025-10-27T19:32:14.226060] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:32:14.265529] [DEBUG] [LOCAL ] KEX: Loaded 39315 existing records from primary storage. [2025-10-27T19:32:14.265859] [INFO ] [MAIN ] KEX: Loaded 39315 existing records. [2025-10-27T19:32:14.441209] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:32:14.441406] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-27T19:32:14.441451] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-27T19:32:14.441691] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-27T19:32:14.441747] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-27T19:32:14.807936] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:32:14.820013] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-27T19:32:14.838571] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T19:32:15.604671] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-27T19:32:15.615280] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-27T19:32:15.956295] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T19:32:16.414927] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-27T19:32:16.959061] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T19:32:17.214989] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-27T19:32:17.687386] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-27T19:32:18.014964] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-27T19:32:18.345493] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T19:32:18.814986] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-27T19:32:19.614943] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-27T19:32:19.675370] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T19:32:20.379896] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-27T19:32:20.414898] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-27T19:32:20.526787] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-27T19:32:21.178441] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-27T19:32:21.214936] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-27T19:32:22.014946] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-27T19:32:22.814920] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-27T19:32:23.281370] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T19:32:23.307455] [INFO ] [REMOTE ] KBH: Full fetch complete (71001 records). [2025-10-27T19:32:23.318671] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-27T19:32:23.320256] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-27T19:32:23.396795] [INFO ] [REMOTE ] KD: Full fetch complete (76065 records). [2025-10-27T19:32:23.408144] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-27T19:32:23.629809] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-27T19:32:24.137562] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-27T19:32:24.137823] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-27T19:32:24.137899] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-27T19:32:24.137956] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-27T19:32:24.138944] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-27T19:32:24.139713] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-27T19:32:24.139795] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-27T19:32:24.139866] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-27T19:32:24.141968] [DEBUG] [LOCAL ] KBH: Trimmed 71001 records to 48545 (keeping 200 days of data) [2025-10-27T19:32:24.141873] [DEBUG] [LOCAL ] KD: Trimmed 76065 records to 52295 (keeping 200 days of data) [2025-10-27T19:32:24.582091] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-27T19:32:24.596198] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-27T19:32:24.742942] [DEBUG] [LOCAL ] KD: Primary data saved (52295 records). [2025-10-27T19:32:24.747178] [INFO ] [MAIN ] KD: Full history saved. [2025-10-27T19:32:24.758268] [INFO ] [MAIN ] Update Progress: 1180/2366 symbols completed. KD took 35.9s. Estimated remaining: 2h 33m 8s. Rate: 7.7 symbols/min [2025-10-27T19:32:24.843861] [DEBUG] [LOCAL ] KBH: Primary data saved (48545 records). [2025-10-27T19:32:24.854832] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-27T19:32:24.876446] [INFO ] [MAIN ] Update Progress: 1181/2366 symbols completed. KBH took 41.3s. Estimated remaining: 2h 32m 53s. Rate: 7.8 symbols/min [2025-10-27T19:32:25.031885] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:32:25.058527] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-27T19:32:25.058680] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-27T19:32:25.064447] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-27T19:32:25.069623] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-27T19:32:25.079995] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-27T19:32:25.085242] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-27T19:32:25.183107] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:32:25.332619] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T19:32:25.430320] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-27T19:32:25.535500] [DEBUG] [LOCAL ] KEYS: Loaded 43717 existing records from primary storage. [2025-10-27T19:32:25.568797] [INFO ] [MAIN ] KEYS: Loaded 43717 existing records. [2025-10-27T19:32:25.568542] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:32:25.744160] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:32:25.744452] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-27T19:32:25.744509] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-27T19:32:25.744925] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-27T19:32:25.744982] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-27T19:32:26.019764] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-27T19:32:26.118605] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:32:26.120488] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T19:32:26.490586] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T19:32:26.814946] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-27T19:32:27.580147] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T19:32:27.614917] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-27T19:32:28.250151] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T19:32:28.414918] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-27T19:32:28.816195] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-27T19:32:29.214959] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-27T19:32:29.817686] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T19:32:30.015014] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-27T19:32:30.336061] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T19:32:30.814975] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-27T19:32:31.366170] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T19:32:31.614998] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-27T19:32:32.414950] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-27T19:32:32.481145] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-27T19:32:32.539758] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T19:32:33.214994] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-27T19:32:33.783950] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-27T19:32:34.014967] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-27T19:32:34.347014] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T19:32:34.814967] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-27T19:32:35.614946] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-27T19:32:35.783789] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-27T19:32:36.004476] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-27T19:32:36.401325] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-27T19:32:36.414898] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-27T19:32:37.214968] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-27T19:32:37.859455] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T19:32:37.866109] [INFO ] [REMOTE ] KEP: Full fetch complete (42532 records). [2025-10-27T19:32:37.866240] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-27T19:32:38.023371] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-27T19:32:38.242671] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-27T19:32:38.242754] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-27T19:32:38.243426] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-27T19:32:38.243466] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-27T19:32:38.244344] [DEBUG] [LOCAL ] KEP: Trimmed 42532 records to 32538 (keeping 200 days of data) [2025-10-27T19:32:38.441875] [DEBUG] [LOCAL ] KEP: Primary data saved (32538 records). [2025-10-27T19:32:38.442139] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-27T19:32:38.443052] [INFO ] [MAIN ] Update Progress: 1182/2366 symbols completed. KEP took 25.6s. Estimated remaining: 2h 32m 51s. Rate: 7.7 symbols/min [2025-10-27T19:32:38.612723] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:32:38.649068] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T19:32:38.647585] [DEBUG] [LOCAL ] KF: Loaded 2377 existing records from primary storage. [2025-10-27T19:32:38.660231] [INFO ] [MAIN ] KF: Loaded 2377 existing records. [2025-10-27T19:32:38.840675] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-27T19:32:38.846541] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:32:38.847442] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-27T19:32:38.847498] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-27T19:32:38.847624] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-27T19:32:38.847704] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-27T19:32:39.246213] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:32:39.309242] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T19:32:39.614939] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-27T19:32:39.942993] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-27T19:32:40.222680] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-27T19:32:40.414933] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-27T19:32:41.214944] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-27T19:32:41.932539] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T19:32:42.014907] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-27T19:32:42.524037] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T19:32:42.814944] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-27T19:32:43.513904] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T19:32:43.614933] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-27T19:32:43.692880] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T19:32:44.415016] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-27T19:32:45.215037] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-27T19:32:45.280131] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T19:32:45.535085] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-27T19:32:45.844813] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T19:32:46.015012] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-27T19:32:46.814958] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-27T19:32:47.159793] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-27T19:32:47.615011] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-27T19:32:48.415118] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-27T19:32:48.618049] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-27T19:32:48.732911] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-27T19:32:48.947507] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-27T19:32:49.215027] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-27T19:32:50.014959] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-27T19:32:50.799618] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T19:32:50.809890] [INFO ] [REMOTE ] KEY: Full fetch complete (77427 records). [2025-10-27T19:32:50.810054] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-27T19:32:50.821909] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-27T19:32:51.006119] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-27T19:32:51.007146] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:32:51.007222] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:32:51.007296] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-27T19:32:51.007367] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-27T19:32:51.007404] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-27T19:32:51.007443] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-27T19:32:51.007510] [INFO ] [MAIN ] Update Progress: 1183/2366 symbols completed. KEY took 26.2s. Estimated remaining: 2h 32m 48s. Rate: 7.7 symbols/min [2025-10-27T19:32:51.171865] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:32:51.192232] [DEBUG] [LOCAL ] KFRC: Loaded 21172 existing records from primary storage. [2025-10-27T19:32:51.192488] [INFO ] [MAIN ] KFRC: Loaded 21172 existing records. [2025-10-27T19:32:51.394847] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:32:51.395394] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-27T19:32:51.395468] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-27T19:32:51.395701] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-27T19:32:51.395961] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-27T19:32:51.477460] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-27T19:32:51.631562] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-27T19:32:51.704083] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-27T19:32:51.752492] [INFO ] [REMOTE ] KEX: Full fetch complete (56170 records). [2025-10-27T19:32:51.771085] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-27T19:32:51.792531] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:32:52.167610] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-27T19:32:52.167712] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-27T19:32:52.168511] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-27T19:32:52.168550] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-27T19:32:52.169626] [DEBUG] [LOCAL ] KEX: Trimmed 56170 records to 38625 (keeping 200 days of data) [2025-10-27T19:32:52.396568] [DEBUG] [LOCAL ] KEX: Primary data saved (38625 records). [2025-10-27T19:32:52.396765] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-27T19:32:52.397222] [INFO ] [MAIN ] Update Progress: 1184/2366 symbols completed. KEX took 38.3s. Estimated remaining: 2h 32m 34s. Rate: 7.7 symbols/min [2025-10-27T19:32:52.420112] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-27T19:32:52.577197] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:32:52.588170] [DEBUG] [LOCAL ] KFS: Loaded 8813 existing records from primary storage. [2025-10-27T19:32:52.588382] [INFO ] [MAIN ] KFS: Loaded 8813 existing records. [2025-10-27T19:32:52.763581] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:32:52.763882] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-27T19:32:52.763934] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-27T19:32:52.764093] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-27T19:32:52.764131] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-27T19:32:53.143489] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:32:53.170177] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-27T19:32:53.214907] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-27T19:32:53.307396] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-27T19:32:54.015007] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-27T19:32:54.398726] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-27T19:32:54.782986] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T19:32:54.814909] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-27T19:32:55.614923] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-27T19:32:55.972863] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-27T19:32:56.079321] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T19:32:56.415003] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-27T19:32:56.789061] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-27T19:32:57.214994] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-27T19:32:57.832755] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T19:32:58.014957] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-27T19:32:58.814985] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-27T19:32:59.357624] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-27T19:32:59.401199] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T19:32:59.410779] [INFO ] [REMOTE ] KEYS: Full fetch complete (63112 records). [2025-10-27T19:32:59.410932] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-27T19:32:59.619683] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-27T19:32:59.871580] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-27T19:32:59.871691] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-27T19:32:59.872693] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-27T19:32:59.872757] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-27T19:32:59.874051] [DEBUG] [LOCAL ] KEYS: Trimmed 63112 records to 42921 (keeping 200 days of data) [2025-10-27T19:33:00.156828] [DEBUG] [LOCAL ] KEYS: Primary data saved (42921 records). [2025-10-27T19:33:00.156957] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-27T19:33:00.157033] [INFO ] [MAIN ] Update Progress: 1185/2366 symbols completed. KEYS took 35.3s. Estimated remaining: 2h 32m 26s. Rate: 7.7 symbols/min [2025-10-27T19:33:00.321847] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:33:00.350435] [DEBUG] [LOCAL ] KFY: Loaded 29905 existing records from primary storage. [2025-10-27T19:33:00.350711] [INFO ] [MAIN ] KFY: Loaded 29905 existing records. [2025-10-27T19:33:00.422935] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-27T19:33:00.526464] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:33:00.526638] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-27T19:33:00.526728] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-27T19:33:00.526907] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-27T19:33:00.526957] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-27T19:33:00.870848] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:33:00.882426] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-27T19:33:01.214908] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-27T19:33:02.014960] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-27T19:33:02.814989] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-27T19:33:03.195909] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-27T19:33:03.488579] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T19:33:03.614967] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-27T19:33:03.858220] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-27T19:33:03.876870] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-27T19:33:03.938462] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-27T19:33:04.414972] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-27T19:33:04.891842] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-27T19:33:05.214922] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-27T19:33:06.014982] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-27T19:33:06.119104] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-27T19:33:06.323581] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-27T19:33:06.814960] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-27T19:33:07.614968] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-27T19:33:07.932420] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-27T19:33:07.997172] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T19:33:08.414957] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-27T19:33:09.042950] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-27T19:33:09.214923] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-27T19:33:10.014919] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-27T19:33:10.214322] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T19:33:10.814932] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-27T19:33:11.099311] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-27T19:33:11.284758] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-27T19:33:11.614954] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-27T19:33:12.338552] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T19:33:12.414920] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-27T19:33:12.890147] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-27T19:33:13.214941] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-27T19:33:13.982950] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-27T19:33:14.014909] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-27T19:33:14.814908] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-27T19:33:15.021783] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-27T19:33:15.308833] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-27T19:33:15.614937] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-27T19:33:16.414934] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-27T19:33:16.992455] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-27T19:33:17.006087] [INFO ] [REMOTE ] KF: Full fetch complete (3430 records). [2025-10-27T19:33:17.006959] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-27T19:33:17.007888] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T19:33:17.220741] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-27T19:33:17.412754] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-27T19:33:17.412844] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-27T19:33:17.413002] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-27T19:33:17.413042] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-27T19:33:17.413433] [DEBUG] [LOCAL ] KF: Trimmed 3430 records to 2320 (keeping 200 days of data) [2025-10-27T19:33:17.429112] [DEBUG] [LOCAL ] KF: Primary data saved (2320 records). [2025-10-27T19:33:17.429347] [INFO ] [MAIN ] KF: Full history saved. [2025-10-27T19:33:17.429463] [INFO ] [MAIN ] Update Progress: 1186/2366 symbols completed. KF took 39.0s. Estimated remaining: 2h 32m 28s. Rate: 7.7 symbols/min [2025-10-27T19:33:17.616112] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:33:17.676415] [DEBUG] [LOCAL ] KGC: Loaded 54479 existing records from primary storage. [2025-10-27T19:33:17.676980] [INFO ] [MAIN ] KGC: Loaded 54479 existing records. [2025-10-27T19:33:17.863247] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:33:17.863532] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-27T19:33:17.863583] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-27T19:33:17.863907] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-27T19:33:17.863966] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-27T19:33:18.019330] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-27T19:33:18.144942] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-27T19:33:18.175407] [INFO ] [REMOTE ] KFS: Full fetch complete (11334 records). [2025-10-27T19:33:18.181438] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-27T19:33:18.379087] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:33:18.653496] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-27T19:33:18.653594] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-27T19:33:18.654153] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-27T19:33:18.654218] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-27T19:33:18.654764] [DEBUG] [LOCAL ] KFS: Trimmed 11334 records to 8681 (keeping 200 days of data) [2025-10-27T19:33:18.707127] [DEBUG] [LOCAL ] KFS: Primary data saved (8681 records). [2025-10-27T19:33:18.707315] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-27T19:33:18.707411] [INFO ] [MAIN ] Update Progress: 1187/2366 symbols completed. KFS took 26.3s. Estimated remaining: 2h 32m 14s. Rate: 7.7 symbols/min [2025-10-27T19:33:18.820092] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-27T19:33:18.881774] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:33:18.931357] [DEBUG] [LOCAL ] KGS: Loaded 46710 existing records from primary storage. [2025-10-27T19:33:18.931729] [INFO ] [MAIN ] KGS: Loaded 46710 existing records. [2025-10-27T19:33:19.110209] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:33:19.110871] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-27T19:33:19.111043] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-27T19:33:19.111284] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-27T19:33:19.111327] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-27T19:33:19.405438] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-27T19:33:19.519505] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:33:19.614989] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-27T19:33:20.414967] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-27T19:33:20.793529] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-27T19:33:21.143729] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T19:33:21.214904] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-27T19:33:21.411266] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T19:33:21.416805] [INFO ] [REMOTE ] KFRC: Full fetch complete (27318 records). [2025-10-27T19:33:21.416903] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-27T19:33:21.795718] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-27T19:33:21.795802] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-27T19:33:21.796380] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-27T19:33:21.796419] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-27T19:33:21.797163] [DEBUG] [LOCAL ] KFRC: Trimmed 27318 records to 20906 (keeping 200 days of data) [2025-10-27T19:33:21.921949] [DEBUG] [LOCAL ] KFRC: Primary data saved (20906 records). [2025-10-27T19:33:21.922072] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-27T19:33:21.922145] [INFO ] [MAIN ] Update Progress: 1188/2366 symbols completed. KFRC took 30.9s. Estimated remaining: 2h 32m 2s. Rate: 7.7 symbols/min [2025-10-27T19:33:22.019955] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-27T19:33:22.090070] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:33:22.140190] [DEBUG] [LOCAL ] KIM: Loaded 53768 existing records from primary storage. [2025-10-27T19:33:22.140526] [INFO ] [MAIN ] KIM: Loaded 53768 existing records. [2025-10-27T19:33:22.313929] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:33:22.314140] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-27T19:33:22.314187] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-27T19:33:22.314370] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-27T19:33:22.314407] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-27T19:33:22.675993] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:33:22.699885] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T19:33:22.814914] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-27T19:33:23.060053] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T19:33:23.614953] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-27T19:33:24.368594] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T19:33:24.414929] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-27T19:33:24.903239] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-27T19:33:25.214955] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-27T19:33:25.989358] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T19:33:26.014924] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-27T19:33:26.315812] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-27T19:33:26.814982] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-27T19:33:26.926066] [DEBUG] [REMOTE ] KFY: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-27T19:33:26.926361] [WARN ] [REMOTE ] KFY: No data returned for month 2025-09 [2025-10-27T19:33:26.926448] [FATAL] [REMOTE ] KFY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:33:26.926524] [FATAL] [MAIN ] KFY: Failed to fetch primary data. [2025-10-27T19:33:26.926559] [WARN ] [MAIN ] KFY: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:33:26.926595] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-27T19:33:26.926703] [DEBUG] [LOCAL ] KFY: No primary data file found to delete. [2025-10-27T19:33:26.926761] [INFO ] [LOCAL ] KFY: Starting deletion of derivative data. [2025-10-27T19:33:26.926908] [DEBUG] [LOCAL ] KFY: Deleted derivative data file. [2025-10-27T19:33:26.926991] [INFO ] [MAIN ] Update Progress: 1189/2366 symbols completed. KFY took 26.8s. Estimated remaining: 2h 31m 51s. Rate: 7.8 symbols/min [2025-10-27T19:33:27.094237] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:33:27.115080] [DEBUG] [LOCAL ] KIO: Loaded 21965 existing records from primary storage. [2025-10-27T19:33:27.115316] [INFO ] [MAIN ] KIO: Loaded 21965 existing records. [2025-10-27T19:33:27.287052] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:33:27.287267] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-27T19:33:27.287314] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-27T19:33:27.287477] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-27T19:33:27.287516] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-27T19:33:27.621680] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-27T19:33:27.643506] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:33:27.928681] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-27T19:33:28.414931] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-27T19:33:28.973165] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T19:33:29.214944] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-27T19:33:29.963041] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T19:33:30.014912] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-27T19:33:30.552712] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T19:33:30.814934] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-27T19:33:31.614952] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-27T19:33:31.895057] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T19:33:32.264409] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-27T19:33:32.414936] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-27T19:33:32.651213] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-27T19:33:33.214994] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-27T19:33:33.613510] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T19:33:34.014948] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-27T19:33:34.470740] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T19:33:34.814960] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-27T19:33:35.614969] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-27T19:33:36.002929] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-27T19:33:36.103639] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-27T19:33:36.414972] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-27T19:33:37.020682] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T19:33:37.215009] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-27T19:33:38.015263] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-27T19:33:38.019635] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T19:33:38.069132] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-27T19:33:38.814950] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-27T19:33:39.614939] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-27T19:33:39.802696] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-27T19:33:40.414975] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-27T19:33:40.532574] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T19:33:40.587089] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-27T19:33:41.215008] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-27T19:33:42.015021] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-27T19:33:42.469065] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-27T19:33:42.631678] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T19:33:42.814961] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-27T19:33:43.106580] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-27T19:33:43.615013] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-27T19:33:44.262347] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T19:33:44.312969] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-27T19:33:44.414967] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-27T19:33:45.214966] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-27T19:33:45.767576] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T19:33:46.015021] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-27T19:33:46.814924] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-27T19:33:46.956518] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T19:33:47.117027] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-27T19:33:47.615022] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-27T19:33:48.414992] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-27T19:33:48.770833] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-27T19:33:49.215000] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-27T19:33:49.456484] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-27T19:33:49.479130] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-27T19:33:49.478688] [INFO ] [REMOTE ] KGS: Full fetch complete (66532 records). [2025-10-27T19:33:49.483980] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-27T19:33:49.886583] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-27T19:33:49.886702] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-27T19:33:49.887594] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-27T19:33:49.887635] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-27T19:33:49.888972] [DEBUG] [LOCAL ] KGS: Trimmed 66532 records to 45875 (keeping 200 days of data) [2025-10-27T19:33:50.057006] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-27T19:33:50.158385] [DEBUG] [LOCAL ] KGS: Primary data saved (45875 records). [2025-10-27T19:33:50.158509] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-27T19:33:50.158938] [INFO ] [MAIN ] Update Progress: 1190/2366 symbols completed. KGS took 31.5s. Estimated remaining: 2h 31m 59s. Rate: 7.7 symbols/min [2025-10-27T19:33:50.328927] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:33:50.383059] [DEBUG] [LOCAL ] KKR: Loaded 54277 existing records from primary storage. [2025-10-27T19:33:50.383389] [INFO ] [MAIN ] KKR: Loaded 54277 existing records. [2025-10-27T19:33:50.557791] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:33:50.557997] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-27T19:33:50.558044] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-27T19:33:50.558325] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-27T19:33:50.558365] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-27T19:33:50.827509] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-27T19:33:50.909146] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:33:50.943290] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T19:33:51.614987] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-27T19:33:51.921594] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T19:33:51.926850] [INFO ] [REMOTE ] KIO: Full fetch complete (32438 records). [2025-10-27T19:33:51.926948] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-27T19:33:52.304839] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-27T19:33:52.304918] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-27T19:33:52.305523] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-27T19:33:52.305562] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-27T19:33:52.306351] [DEBUG] [LOCAL ] KIO: Trimmed 32438 records to 21584 (keeping 200 days of data) [2025-10-27T19:33:52.418335] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-27T19:33:52.439727] [DEBUG] [LOCAL ] KIO: Primary data saved (21584 records). [2025-10-27T19:33:52.439983] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-27T19:33:52.440142] [INFO ] [MAIN ] Update Progress: 1191/2366 symbols completed. KIO took 25.5s. Estimated remaining: 2h 31m 45s. Rate: 7.7 symbols/min [2025-10-27T19:33:52.610758] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:33:52.642874] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-27T19:33:52.656565] [DEBUG] [LOCAL ] KKRS: Loaded 5581 existing records from primary storage. [2025-10-27T19:33:52.657424] [INFO ] [MAIN ] KKRS: Loaded 5581 existing records. [2025-10-27T19:33:52.835525] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:33:52.835782] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-27T19:33:52.835833] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-27T19:33:52.835993] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-27T19:33:52.836048] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-27T19:33:53.194942] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:33:53.214906] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-27T19:33:53.345066] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T19:33:53.979897] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-27T19:33:54.014904] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-27T19:33:54.481446] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-27T19:33:54.500103] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T19:33:54.814982] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-27T19:33:55.615048] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-27T19:33:56.415013] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-27T19:33:56.543878] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-27T19:33:57.201024] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-27T19:33:57.211635] [INFO ] [REMOTE ] KIM: Full fetch complete (76969 records). [2025-10-27T19:33:57.211850] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-27T19:33:57.224003] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-27T19:33:57.618502] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-27T19:33:57.618586] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-27T19:33:57.619556] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-27T19:33:57.619622] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-27T19:33:57.621095] [DEBUG] [LOCAL ] KIM: Trimmed 76969 records to 52988 (keeping 200 days of data) [2025-10-27T19:33:57.922683] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T19:33:57.947739] [DEBUG] [LOCAL ] KIM: Primary data saved (52988 records). [2025-10-27T19:33:57.947875] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-27T19:33:57.947953] [INFO ] [MAIN ] Update Progress: 1192/2366 symbols completed. KIM took 36.0s. Estimated remaining: 2h 31m 36s. Rate: 7.7 symbols/min [2025-10-27T19:33:58.020632] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-27T19:33:58.115965] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:33:58.116550] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-27T19:33:58.116606] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-27T19:33:58.116766] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-27T19:33:58.116808] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-27T19:33:58.116849] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-27T19:33:58.116880] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-27T19:33:58.480068] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:33:58.515385] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-27T19:33:58.650239] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-27T19:33:58.814970] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-27T19:33:59.614992] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-27T19:34:00.415024] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-27T19:34:01.215045] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-10-27T19:34:02.399850] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (2.78 seconds). [2025-10-27T19:34:02.417130] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-27T19:34:02.446546] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (3.63 seconds). [2025-10-27T19:34:02.456872] [INFO ] [REMOTE ] KGC: Full fetch complete (77875 records). [2025-10-27T19:34:02.457025] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-27T19:34:02.849491] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-27T19:34:02.849570] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-27T19:34:02.850613] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-27T19:34:02.850698] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-27T19:34:02.852089] [DEBUG] [LOCAL ] KGC: Trimmed 77875 records to 53699 (keeping 200 days of data) [2025-10-27T19:34:03.175126] [DEBUG] [LOCAL ] KGC: Primary data saved (53699 records). [2025-10-27T19:34:03.175255] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-27T19:34:03.175333] [INFO ] [MAIN ] Update Progress: 1193/2366 symbols completed. KGC took 45.7s. Estimated remaining: 2h 31m 25s. Rate: 7.7 symbols/min [2025-10-27T19:34:03.344796] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:34:03.344948] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-27T19:34:03.344986] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-27T19:34:03.345097] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-27T19:34:03.345140] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-27T19:34:03.345180] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-27T19:34:03.345212] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-27T19:34:03.414015] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T19:34:03.443812] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-10-27T19:34:03.445973] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:34:03.446293] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-27T19:34:03.456889] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:34:03.485582] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-27T19:34:03.498315] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-27T19:34:03.498399] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-27T19:34:03.505784] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-27T19:34:03.505868] [INFO ] [MAIN ] Update Progress: 1194/2366 symbols completed. KKRT took 5.6s. Estimated remaining: 2h 31m 10s. Rate: 7.8 symbols/min [2025-10-27T19:34:03.879638] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:34:03.908766] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-10-27T19:34:03.912845] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:34:03.950845] [DEBUG] [LOCAL ] KLC: Loaded 36622 existing records from primary storage. [2025-10-27T19:34:03.951151] [INFO ] [MAIN ] KLC: Loaded 36622 existing records. [2025-10-27T19:34:04.055413] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (3.64 seconds). [2025-10-27T19:34:04.084027] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-27T19:34:04.138349] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:34:04.138747] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-27T19:34:04.138802] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-27T19:34:04.139014] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-27T19:34:04.139071] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-27T19:34:04.494435] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:34:04.494754] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-27T19:34:05.000528] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-27T19:34:05.052912] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T19:34:05.053167] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-10-27T19:34:05.053271] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:34:05.053342] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-27T19:34:05.053391] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:34:05.053446] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-27T19:34:05.053526] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-27T19:34:05.053591] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-27T19:34:05.053678] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-27T19:34:05.053762] [INFO ] [MAIN ] Update Progress: 1195/2366 symbols completed. KLAR took 1.9s. Estimated remaining: 2h 30m 56s. Rate: 7.8 symbols/min [2025-10-27T19:34:05.224704] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-27T19:34:05.229764] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:34:05.280599] [DEBUG] [LOCAL ] KMI: Loaded 54473 existing records from primary storage. [2025-10-27T19:34:05.280940] [INFO ] [MAIN ] KMI: Loaded 54473 existing records. [2025-10-27T19:34:05.460194] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:34:05.460515] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-27T19:34:05.460571] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-27T19:34:05.481897] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-27T19:34:05.499631] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-27T19:34:05.582157] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (3.17 seconds). [2025-10-27T19:34:05.873571] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:34:05.891051] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T19:34:05.962578] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-27T19:34:06.014901] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-27T19:34:06.814939] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-27T19:34:07.614969] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-27T19:34:08.037622] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-27T19:34:08.414969] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-27T19:34:08.571617] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-27T19:34:08.718979] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T19:34:09.214948] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-27T19:34:09.972360] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T19:34:10.014923] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-27T19:34:10.223021] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T19:34:10.814957] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-27T19:34:11.614948] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-27T19:34:11.727066] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T19:34:11.819745] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-27T19:34:12.414980] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-27T19:34:13.214985] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-27T19:34:13.262834] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-27T19:34:13.652872] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T19:34:13.786741] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-27T19:34:14.014941] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-27T19:34:14.814944] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-27T19:34:15.614905] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-27T19:34:15.935301] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-27T19:34:15.961317] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-27T19:34:16.088130] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T19:34:16.414934] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-27T19:34:17.214920] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-27T19:34:18.016851] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-27T19:34:18.021502] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T19:34:18.111677] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-27T19:34:18.815017] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-27T19:34:19.246697] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-27T19:34:19.248148] [INFO ] [REMOTE ] KKRS: Full fetch complete (7538 records). [2025-10-27T19:34:19.248223] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-27T19:34:19.616274] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-27T19:34:19.667708] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-27T19:34:19.667965] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-27T19:34:19.668308] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-27T19:34:19.668498] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-27T19:34:19.669147] [DEBUG] [LOCAL ] KKRS: Trimmed 7538 records to 5455 (keeping 200 days of data) [2025-10-27T19:34:19.707396] [DEBUG] [LOCAL ] KKRS: Primary data saved (5455 records). [2025-10-27T19:34:19.707736] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-27T19:34:19.707867] [INFO ] [MAIN ] Update Progress: 1196/2366 symbols completed. KKRS took 27.3s. Estimated remaining: 2h 30m 56s. Rate: 7.8 symbols/min [2025-10-27T19:34:19.831386] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-27T19:34:19.960612] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:34:19.968969] [DEBUG] [LOCAL ] KMPB: Loaded 3498 existing records from primary storage. [2025-10-27T19:34:19.969275] [INFO ] [MAIN ] KMPB: Loaded 3498 existing records. [2025-10-27T19:34:20.157997] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:34:20.158395] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-27T19:34:20.158452] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-27T19:34:20.158850] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-27T19:34:20.158909] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-27T19:34:20.420234] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-27T19:34:20.540957] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:34:20.752300] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T19:34:21.214997] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-27T19:34:21.799871] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T19:34:22.014937] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-27T19:34:22.255544] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-27T19:34:22.814947] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-27T19:34:23.135733] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-27T19:34:23.614955] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-27T19:34:23.656220] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T19:34:23.962633] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-27T19:34:24.414940] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-27T19:34:24.952453] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-27T19:34:25.214947] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-27T19:34:25.509403] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-27T19:34:26.014931] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-27T19:34:26.560723] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-27T19:34:26.814964] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-27T19:34:27.295088] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-27T19:34:27.614997] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-27T19:34:28.414990] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-27T19:34:29.215001] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-27T19:34:29.282324] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T19:34:30.014989] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-27T19:34:30.227080] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-27T19:34:30.237426] [INFO ] [REMOTE ] KKR: Full fetch complete (77657 records). [2025-10-27T19:34:30.237546] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-27T19:34:30.492511] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-27T19:34:30.664673] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T19:34:30.696031] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-27T19:34:30.696204] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-27T19:34:30.697394] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-27T19:34:30.697486] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-27T19:34:30.698948] [DEBUG] [LOCAL ] KKR: Trimmed 77657 records to 53494 (keeping 200 days of data) [2025-10-27T19:34:30.822758] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-27T19:34:31.025252] [DEBUG] [LOCAL ] KKR: Primary data saved (53494 records). [2025-10-27T19:34:31.025384] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-27T19:34:31.025471] [INFO ] [MAIN ] Update Progress: 1197/2366 symbols completed. KKR took 40.9s. Estimated remaining: 2h 30m 51s. Rate: 7.7 symbols/min [2025-10-27T19:34:31.411565] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T19:34:31.614939] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-27T19:34:32.414940] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-27T19:34:32.942554] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T19:34:32.943577] [INFO ] [REMOTE ] KMPB: Full fetch complete (4916 records). [2025-10-27T19:34:32.943674] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-27T19:34:33.098510] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-27T19:34:33.153877] [INFO ] [REMOTE ] KLC: Full fetch complete (50688 records). [2025-10-27T19:34:33.192728] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-27T19:34:33.229896] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-27T19:34:33.498387] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-27T19:34:33.517819] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-27T19:34:33.538417] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-27T19:34:33.553591] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-27T19:34:33.623375] [DEBUG] [LOCAL ] KMPB: Trimmed 4916 records to 3417 (keeping 200 days of data) [2025-10-27T19:34:33.708916] [DEBUG] [LOCAL ] KMPB: Primary data saved (3417 records). [2025-10-27T19:34:33.728016] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-27T19:34:33.747387] [INFO ] [MAIN ] Update Progress: 1198/2366 symbols completed. KMPB took 14.0s. Estimated remaining: 2h 30m 39s. Rate: 7.8 symbols/min [2025-10-27T19:34:33.759863] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-27T19:34:33.759912] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-27T19:34:33.760850] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-27T19:34:33.760910] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-27T19:34:33.762069] [DEBUG] [LOCAL ] KLC: Trimmed 50688 records to 35861 (keeping 200 days of data) [2025-10-27T19:34:33.957475] [DEBUG] [LOCAL ] KLC: Primary data saved (35861 records). [2025-10-27T19:34:33.957605] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-27T19:34:33.957717] [INFO ] [MAIN ] Update Progress: 1199/2366 symbols completed. KLC took 30.4s. Estimated remaining: 2h 30m 24s. Rate: 7.8 symbols/min [2025-10-27T19:34:35.302127] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-27T19:34:35.318394] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-27T19:34:37.102801] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-27T19:34:37.114749] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-27T19:34:38.834948] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T19:34:38.846513] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-27T19:34:39.815551] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-27T19:34:39.825885] [INFO ] [REMOTE ] KMI: Full fetch complete (77873 records). [2025-10-27T19:34:39.826033] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-27T19:34:40.212985] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-27T19:34:40.213072] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-27T19:34:40.214109] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-27T19:34:40.214177] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-27T19:34:40.215715] [DEBUG] [LOCAL ] KMI: Trimmed 77873 records to 53693 (keeping 200 days of data) [2025-10-27T19:34:40.540500] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-10-27T19:34:40.540626] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-27T19:34:40.541378] [INFO ] [MAIN ] Update Progress: 1200/2366 symbols completed. KMI took 35.5s. Estimated remaining: 2h 30m 15s. Rate: 7.8 symbols/min [2025-10-27T19:34:41.232807] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:34:41.235508] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:34:41.262430] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:34:41.290622] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:34:41.394904] [DEBUG] [LOCAL ] KMX: Loaded 54064 existing records from primary storage. [2025-10-27T19:34:41.396377] [INFO ] [MAIN ] KMX: Loaded 54064 existing records. [2025-10-27T19:34:41.397399] [DEBUG] [LOCAL ] KN: Loaded 39073 existing records from primary storage. [2025-10-27T19:34:41.416128] [DEBUG] [LOCAL ] KMT: Loaded 43438 existing records from primary storage. [2025-10-27T19:34:41.438503] [INFO ] [MAIN ] KMT: Loaded 43438 existing records. [2025-10-27T19:34:41.438330] [INFO ] [MAIN ] KN: Loaded 39073 existing records. [2025-10-27T19:34:41.614280] [DEBUG] [LOCAL ] KMPR: Loaded 41064 existing records from primary storage. [2025-10-27T19:34:41.753684] [INFO ] [MAIN ] KMPR: Loaded 41064 existing records. [2025-10-27T19:34:41.945190] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:34:42.031630] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:34:42.014516] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-27T19:34:42.090291] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-27T19:34:42.112901] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-27T19:34:42.107138] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:34:42.118343] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-27T19:34:42.128701] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-27T19:34:42.128746] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-27T19:34:42.129269] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-27T19:34:42.129319] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-27T19:34:42.155213] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-27T19:34:42.160450] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-27T19:34:42.222758] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-27T19:34:42.311087] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-27T19:34:42.310997] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:34:42.388040] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-27T19:34:42.574885] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-27T19:34:42.655818] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-27T19:34:42.655981] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-27T19:34:43.386829] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:34:43.458762] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-27T19:34:43.530910] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:34:43.568520] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-27T19:34:43.720413] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:34:43.746811] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-27T19:34:43.802797] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:34:43.803447] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-27T19:34:44.972458] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T19:34:44.979927] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-27T19:34:45.239091] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T19:34:45.244590] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-27T19:34:45.580515] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-27T19:34:45.591124] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-27T19:34:45.793505] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-27T19:34:45.803357] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-27T19:34:45.987316] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T19:34:45.993967] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-27T19:34:46.495344] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T19:34:46.503614] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-27T19:34:46.715067] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T19:34:46.724634] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-27T19:34:47.172574] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-27T19:34:47.181073] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-27T19:34:47.285036] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T19:34:47.291535] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-27T19:34:47.673815] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T19:34:47.682519] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-27T19:34:48.288444] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T19:34:48.297362] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-27T19:34:48.463197] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-27T19:34:48.474158] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-27T19:34:48.709338] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-27T19:34:48.739720] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-27T19:34:49.214994] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-27T19:34:49.813092] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T19:34:50.014956] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-27T19:34:50.249007] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T19:34:50.409152] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T19:34:50.815022] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-27T19:34:51.292413] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-27T19:34:51.614934] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-27T19:34:51.751241] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-27T19:34:52.414935] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-27T19:34:52.850077] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T19:34:53.214953] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-27T19:34:53.728522] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T19:34:54.014933] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-27T19:34:54.524598] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T19:34:54.814996] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-27T19:34:54.953947] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-27T19:34:55.614985] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-27T19:34:55.878525] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T19:34:56.414929] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-27T19:34:56.538692] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T19:34:57.214936] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-27T19:34:57.838720] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T19:34:58.014931] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-27T19:34:58.599888] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-27T19:34:58.814957] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-27T19:34:58.973058] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-27T19:34:59.614931] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-27T19:35:00.129527] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T19:35:00.414973] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-27T19:35:01.214941] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-27T19:35:01.254885] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-27T19:35:02.014958] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-27T19:35:02.814944] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-27T19:35:03.288257] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (2.87 seconds). [2025-10-27T19:35:03.594358] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-27T19:35:03.614908] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-27T19:35:04.016070] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-27T19:35:04.414949] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-27T19:35:05.121811] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T19:35:05.224808] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-27T19:35:05.236178] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-27T19:35:06.014948] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-27T19:35:06.366516] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-27T19:35:06.376004] [INFO ] [REMOTE ] KMPR: Full fetch complete (53871 records). [2025-10-27T19:35:06.376236] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-27T19:35:06.777473] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-27T19:35:06.777580] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-27T19:35:06.778810] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-27T19:35:06.778879] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-27T19:35:06.780673] [DEBUG] [LOCAL ] KMPR: Trimmed 53871 records to 40466 (keeping 200 days of data) [2025-10-27T19:35:06.835159] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-27T19:35:07.046531] [DEBUG] [LOCAL ] KMPR: Primary data saved (40466 records). [2025-10-27T19:35:07.046739] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-27T19:35:07.046847] [INFO ] [MAIN ] Update Progress: 1201/2366 symbols completed. KMPR took 26.5s. Estimated remaining: 2h 30m 25s. Rate: 7.7 symbols/min [2025-10-27T19:35:07.234385] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:35:07.260449] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-27T19:35:07.269246] [INFO ] [REMOTE ] KN: Full fetch complete (56798 records). [2025-10-27T19:35:07.269419] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-27T19:35:07.586773] [DEBUG] [LOCAL ] KNF: Loaded 37242 existing records from primary storage. [2025-10-27T19:35:07.596954] [INFO ] [MAIN ] KNF: Loaded 37242 existing records. [2025-10-27T19:35:07.852581] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-27T19:35:07.876781] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-27T19:35:07.916480] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-27T19:35:07.920766] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:35:07.921720] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-27T19:35:07.921598] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-27T19:35:07.922427] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-27T19:35:07.923175] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-27T19:35:07.923345] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-27T19:35:08.003899] [DEBUG] [LOCAL ] KN: Trimmed 56798 records to 38260 (keeping 200 days of data) [2025-10-27T19:35:08.460849] [DEBUG] [LOCAL ] KN: Primary data saved (38260 records). [2025-10-27T19:35:08.470604] [INFO ] [MAIN ] KN: Full history saved. [2025-10-27T19:35:08.475496] [INFO ] [MAIN ] Update Progress: 1202/2366 symbols completed. KN took 27.9s. Estimated remaining: 2h 30m 11s. Rate: 7.8 symbols/min [2025-10-27T19:35:08.694076] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-27T19:35:08.750736] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:35:08.766852] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-27T19:35:08.805690] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-27T19:35:08.875047] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:35:08.881274] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (2.87 seconds). [2025-10-27T19:35:08.892447] [INFO ] [REMOTE ] KMX: Full fetch complete (76429 records). [2025-10-27T19:35:08.892635] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-27T19:35:09.004697] [DEBUG] [LOCAL ] KNOP: Loaded 10190 existing records from primary storage. [2025-10-27T19:35:09.005549] [INFO ] [MAIN ] KNOP: Loaded 10190 existing records. [2025-10-27T19:35:09.415044] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:35:09.443947] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-27T19:35:09.455860] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-27T19:35:09.459964] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-27T19:35:09.478110] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-27T19:35:09.568564] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-27T19:35:09.581909] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-27T19:35:09.600026] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-27T19:35:09.611755] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-27T19:35:09.666170] [DEBUG] [LOCAL ] KMX: Trimmed 76429 records to 53284 (keeping 200 days of data) [2025-10-27T19:35:10.054229] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:35:10.101139] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-27T19:35:10.178277] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T19:35:10.211403] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-27T19:35:10.239937] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T19:35:10.250679] [INFO ] [REMOTE ] KMT: Full fetch complete (61812 records). [2025-10-27T19:35:10.251917] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-27T19:35:10.332771] [DEBUG] [LOCAL ] KMX: Primary data saved (53284 records). [2025-10-27T19:35:10.338556] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-27T19:35:10.343813] [INFO ] [MAIN ] Update Progress: 1203/2366 symbols completed. KMX took 29.8s. Estimated remaining: 2h 29m 58s. Rate: 7.8 symbols/min [2025-10-27T19:35:10.695536] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:35:10.837949] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-27T19:35:10.838795] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-27T19:35:10.839780] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-27T19:35:10.840207] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-27T19:35:10.840134] [DEBUG] [LOCAL ] KNSL: Loaded 18763 existing records from primary storage. [2025-10-27T19:35:10.840545] [INFO ] [MAIN ] KNSL: Loaded 18763 existing records. [2025-10-27T19:35:10.920204] [DEBUG] [LOCAL ] KMT: Trimmed 61812 records to 42540 (keeping 200 days of data) [2025-10-27T19:35:11.115956] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:35:11.124728] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-27T19:35:11.124829] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-27T19:35:11.126483] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-27T19:35:11.127219] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-27T19:35:11.128074] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-27T19:35:11.161692] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-27T19:35:11.629145] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:35:11.632910] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-27T19:35:11.680360] [DEBUG] [LOCAL ] KMT: Primary data saved (42540 records). [2025-10-27T19:35:11.694116] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-27T19:35:11.694320] [INFO ] [MAIN ] Update Progress: 1204/2366 symbols completed. KMT took 31.2s. Estimated remaining: 2h 29m 44s. Rate: 7.8 symbols/min [2025-10-27T19:35:11.763776] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-27T19:35:11.890573] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:35:11.919733] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T19:35:11.939402] [DEBUG] [LOCAL ] KNTK: Loaded 47955 existing records from primary storage. [2025-10-27T19:35:11.939738] [INFO ] [MAIN ] KNTK: Loaded 47955 existing records. [2025-10-27T19:35:12.135566] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:35:12.135806] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-27T19:35:12.135894] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-27T19:35:12.136076] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-27T19:35:12.136115] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-27T19:35:12.420072] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-27T19:35:12.544043] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:35:12.852928] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-27T19:35:12.983208] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T19:35:13.214919] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-27T19:35:13.884143] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-27T19:35:14.014985] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-27T19:35:14.814949] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-27T19:35:15.025275] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T19:35:15.397078] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T19:35:15.614934] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-27T19:35:16.414966] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-27T19:35:16.759090] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T19:35:17.214997] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-27T19:35:18.014966] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-27T19:35:18.126558] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T19:35:18.517220] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T19:35:18.783436] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-27T19:35:18.814904] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-27T19:35:19.614938] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-27T19:35:19.647157] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-27T19:35:20.414935] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-27T19:35:20.918622] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-27T19:35:21.115068] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T19:35:21.214999] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-27T19:35:22.014916] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-27T19:35:22.106484] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-27T19:35:22.814953] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-27T19:35:22.984185] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T19:35:23.614925] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-27T19:35:24.053065] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T19:35:24.296307] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T19:35:24.414928] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-27T19:35:25.214926] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-27T19:35:25.511163] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T19:35:26.014953] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-27T19:35:26.521705] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T19:35:26.715768] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-27T19:35:26.814948] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-27T19:35:27.614938] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-27T19:35:27.752371] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T19:35:28.414988] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-27T19:35:28.521778] [DEBUG] [REMOTE ] KNOP: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-27T19:35:28.522133] [WARN ] [REMOTE ] KNOP: No data returned for month 2025-07 [2025-10-27T19:35:28.522237] [FATAL] [REMOTE ] KNOP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:35:28.522353] [FATAL] [MAIN ] KNOP: Failed to fetch primary data. [2025-10-27T19:35:28.522430] [WARN ] [MAIN ] KNOP: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:35:28.522518] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-27T19:35:28.522590] [DEBUG] [LOCAL ] KNOP: No primary data file found to delete. [2025-10-27T19:35:28.522689] [INFO ] [LOCAL ] KNOP: Starting deletion of derivative data. [2025-10-27T19:35:28.522859] [DEBUG] [LOCAL ] KNOP: Deleted derivative data file. [2025-10-27T19:35:28.522954] [INFO ] [MAIN ] Update Progress: 1205/2366 symbols completed. KNOP took 20.0s. Estimated remaining: 2h 29m 45s. Rate: 7.8 symbols/min [2025-10-27T19:35:28.695491] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:35:28.749120] [DEBUG] [LOCAL ] KNX: Loaded 53425 existing records from primary storage. [2025-10-27T19:35:28.749578] [INFO ] [MAIN ] KNX: Loaded 53425 existing records. [2025-10-27T19:35:28.944609] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:35:28.945268] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-27T19:35:28.945417] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-27T19:35:28.945930] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-27T19:35:28.946015] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-27T19:35:29.222346] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-27T19:35:29.217044] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T19:35:29.382936] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:35:30.014976] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-27T19:35:30.365470] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-27T19:35:30.815012] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-27T19:35:31.603993] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T19:35:31.614907] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-27T19:35:32.209817] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T19:35:32.214214] [INFO ] [REMOTE ] KNSL: Full fetch complete (27232 records). [2025-10-27T19:35:32.214293] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-27T19:35:32.421755] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-27T19:35:32.577046] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-27T19:35:32.577120] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-27T19:35:32.577726] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-27T19:35:32.577787] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-27T19:35:32.578429] [DEBUG] [LOCAL ] KNSL: Trimmed 27232 records to 18472 (keeping 200 days of data) [2025-10-27T19:35:32.695722] [DEBUG] [LOCAL ] KNSL: Primary data saved (18472 records). [2025-10-27T19:35:32.695823] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-27T19:35:32.695898] [INFO ] [MAIN ] Update Progress: 1206/2366 symbols completed. KNSL took 22.3s. Estimated remaining: 2h 29m 34s. Rate: 7.8 symbols/min [2025-10-27T19:35:32.872250] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:35:32.872385] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-27T19:35:32.872421] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-27T19:35:32.872529] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-27T19:35:32.872570] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-27T19:35:32.872610] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-27T19:35:32.872664] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-27T19:35:33.225093] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-27T19:35:33.248959] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:35:33.281125] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T19:35:33.620567] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-27T19:35:34.015030] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-27T19:35:34.814981] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-27T19:35:35.209547] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-27T19:35:35.614956] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-27T19:35:36.152051] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-27T19:35:36.416314] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-27T19:35:36.424334] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-27T19:35:36.906107] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T19:35:36.914097] [INFO ] [REMOTE ] KNF: Full fetch complete (51522 records). [2025-10-27T19:35:36.914270] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-27T19:35:37.220050] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-27T19:35:37.306992] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-27T19:35:37.307061] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-27T19:35:37.307910] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-27T19:35:37.307970] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-27T19:35:37.308956] [DEBUG] [LOCAL ] KNF: Trimmed 51522 records to 36587 (keeping 200 days of data) [2025-10-27T19:35:37.528577] [DEBUG] [LOCAL ] KNF: Primary data saved (36587 records). [2025-10-27T19:35:37.528782] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-27T19:35:37.529468] [INFO ] [MAIN ] Update Progress: 1207/2366 symbols completed. KNF took 30.5s. Estimated remaining: 2h 29m 23s. Rate: 7.8 symbols/min [2025-10-27T19:35:37.698332] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:35:37.738706] [DEBUG] [LOCAL ] KODK: Loaded 44310 existing records from primary storage. [2025-10-27T19:35:37.738989] [INFO ] [MAIN ] KODK: Loaded 44310 existing records. [2025-10-27T19:35:37.915768] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:35:37.916060] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-27T19:35:37.916115] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-27T19:35:37.916360] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-27T19:35:37.916400] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-27T19:35:38.015418] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-27T19:35:38.271254] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:35:38.782296] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T19:35:38.814900] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-27T19:35:38.878458] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-27T19:35:39.543225] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T19:35:39.614951] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-27T19:35:40.153843] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T19:35:40.414965] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-27T19:35:40.906430] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T19:35:41.214960] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-27T19:35:42.014961] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-27T19:35:42.064301] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T19:35:42.597470] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T19:35:42.814928] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-27T19:35:43.614992] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-27T19:35:43.988037] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T19:35:44.081906] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-27T19:35:44.414947] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-27T19:35:44.642963] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T19:35:45.214941] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-27T19:35:46.020146] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-27T19:35:46.038741] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-27T19:35:46.448841] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T19:35:46.815004] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-27T19:35:47.614946] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-27T19:35:47.736050] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T19:35:48.209102] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-27T19:35:48.414961] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-27T19:35:49.214968] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-27T19:35:49.946930] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T19:35:49.956102] [INFO ] [REMOTE ] KNTK: Full fetch complete (66143 records). [2025-10-27T19:35:49.956228] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-27T19:35:50.018510] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-27T19:35:50.343859] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-27T19:35:50.343953] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-27T19:35:50.344905] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-27T19:35:50.344967] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-27T19:35:50.346304] [DEBUG] [LOCAL ] KNTK: Trimmed 66143 records to 47192 (keeping 200 days of data) [2025-10-27T19:35:50.477531] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-10-27T19:35:50.680320] [DEBUG] [LOCAL ] KNTK: Primary data saved (47192 records). [2025-10-27T19:35:50.680438] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-27T19:35:50.680516] [INFO ] [MAIN ] Update Progress: 1208/2366 symbols completed. KNTK took 39.0s. Estimated remaining: 2h 29m 21s. Rate: 7.8 symbols/min [2025-10-27T19:35:50.815141] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-27T19:35:50.862626] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T19:35:50.903727] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:35:50.928762] [DEBUG] [LOCAL ] KOF: Loaded 26803 existing records from primary storage. [2025-10-27T19:35:50.929008] [INFO ] [MAIN ] KOF: Loaded 26803 existing records. [2025-10-27T19:35:51.123101] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:35:51.123448] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-27T19:35:51.123528] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-27T19:35:51.123830] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-27T19:35:51.123889] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-27T19:35:51.471379] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:35:51.496034] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-27T19:35:51.614901] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-27T19:35:52.414990] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-27T19:35:52.745636] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T19:35:53.020776] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-27T19:35:53.214918] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-27T19:35:53.740943] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T19:35:53.981738] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T19:35:54.014911] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-27T19:35:54.814963] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-27T19:35:55.614952] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-27T19:35:56.311047] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T19:35:56.416575] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-27T19:35:56.417699] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-27T19:35:56.491180] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-27T19:35:57.215098] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-27T19:35:58.005333] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-27T19:35:58.014900] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-27T19:35:58.016274] [INFO ] [REMOTE ] KNX: Full fetch complete (76335 records). [2025-10-27T19:35:58.016355] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-27T19:35:58.334302] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T19:35:58.433064] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-27T19:35:58.433138] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-27T19:35:58.434251] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-27T19:35:58.434315] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-27T19:35:58.435722] [DEBUG] [LOCAL ] KNX: Trimmed 76335 records to 52645 (keeping 200 days of data) [2025-10-27T19:35:58.742453] [DEBUG] [LOCAL ] KNX: Primary data saved (52645 records). [2025-10-27T19:35:58.742583] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-27T19:35:58.743386] [INFO ] [MAIN ] Update Progress: 1209/2366 symbols completed. KNX took 30.2s. Estimated remaining: 2h 29m 13s. Rate: 7.8 symbols/min [2025-10-27T19:35:58.820047] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-27T19:35:58.908429] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:35:58.927516] [DEBUG] [LOCAL ] KOP: Loaded 17502 existing records from primary storage. [2025-10-27T19:35:58.927782] [INFO ] [MAIN ] KOP: Loaded 17502 existing records. [2025-10-27T19:35:59.102936] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:35:59.103165] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-27T19:35:59.103218] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-27T19:35:59.103380] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-27T19:35:59.103417] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-27T19:35:59.445818] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:35:59.614932] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-27T19:35:59.750844] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-27T19:36:00.414956] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-27T19:36:00.904836] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-10-27T19:36:01.214945] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-27T19:36:01.746888] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-27T19:36:02.014937] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-27T19:36:02.814997] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-27T19:36:04.176405] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (3.76 seconds). [2025-10-27T19:36:04.186557] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-27T19:36:04.244397] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-27T19:36:04.360358] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (3.15 seconds). [2025-10-27T19:36:04.414928] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-27T19:36:05.219361] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-27T19:36:05.235589] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-27T19:36:05.329459] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T19:36:05.607311] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T19:36:06.014937] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-27T19:36:06.347093] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-27T19:36:06.814946] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-27T19:36:07.455861] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T19:36:07.611367] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-27T19:36:07.616903] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-27T19:36:08.414957] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-27T19:36:09.215014] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-27T19:36:09.597927] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-27T19:36:09.837837] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T19:36:09.847200] [INFO ] [REMOTE ] KODK: Full fetch complete (63247 records). [2025-10-27T19:36:09.847342] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-27T19:36:10.031447] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-27T19:36:10.248077] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-27T19:36:10.248280] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-27T19:36:10.249332] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-27T19:36:10.249397] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-27T19:36:10.250624] [DEBUG] [LOCAL ] KODK: Trimmed 63247 records to 43487 (keeping 200 days of data) [2025-10-27T19:36:10.376084] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T19:36:10.507427] [DEBUG] [LOCAL ] KODK: Primary data saved (43487 records). [2025-10-27T19:36:10.507566] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-27T19:36:10.508000] [INFO ] [MAIN ] Update Progress: 1210/2366 symbols completed. KODK took 33.0s. Estimated remaining: 2h 29m 9s. Rate: 7.8 symbols/min [2025-10-27T19:36:10.674286] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:36:10.678677] [DEBUG] [LOCAL ] KORE: Loaded 2257 existing records from primary storage. [2025-10-27T19:36:10.678827] [INFO ] [MAIN ] KORE: Loaded 2257 existing records. [2025-10-27T19:36:10.820205] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-27T19:36:10.873114] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:36:10.873312] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-27T19:36:10.873359] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-27T19:36:10.873486] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-27T19:36:10.873523] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-27T19:36:11.232389] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:36:11.338192] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-27T19:36:11.614941] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-27T19:36:11.792784] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-27T19:36:12.414946] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-27T19:36:12.566882] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T19:36:13.214956] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-27T19:36:13.376539] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T19:36:13.381888] [INFO ] [REMOTE ] KOF: Full fetch complete (37855 records). [2025-10-27T19:36:13.381970] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-27T19:36:13.747910] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-27T19:36:13.747987] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-27T19:36:13.748681] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-27T19:36:13.748743] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-27T19:36:13.749541] [DEBUG] [LOCAL ] KOF: Trimmed 37855 records to 26160 (keeping 200 days of data) [2025-10-27T19:36:13.907987] [DEBUG] [LOCAL ] KOF: Primary data saved (26160 records). [2025-10-27T19:36:13.908138] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-27T19:36:13.908243] [INFO ] [MAIN ] Update Progress: 1211/2366 symbols completed. KOF took 23.2s. Estimated remaining: 2h 28m 58s. Rate: 7.8 symbols/min [2025-10-27T19:36:14.020147] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-27T19:36:14.082211] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:36:14.130684] [DEBUG] [LOCAL ] KOS: Loaded 53873 existing records from primary storage. [2025-10-27T19:36:14.130987] [INFO ] [MAIN ] KOS: Loaded 53873 existing records. [2025-10-27T19:36:14.304816] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:36:14.305039] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-27T19:36:14.305085] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-27T19:36:14.305272] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-27T19:36:14.305326] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-27T19:36:14.654203] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:36:14.814904] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-27T19:36:14.899551] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-27T19:36:15.614870] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-27T19:36:16.102475] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T19:36:16.254550] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (3.04 seconds). [2025-10-27T19:36:16.264917] [INFO ] [REMOTE ] KO: Full fetch complete (77218 records). [2025-10-27T19:36:16.265066] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-27T19:36:16.418023] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-27T19:36:16.493018] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-27T19:36:16.494017] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:36:16.494135] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:36:16.494363] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-27T19:36:16.494447] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-27T19:36:16.494508] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-27T19:36:16.494585] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-27T19:36:16.494692] [INFO ] [MAIN ] Update Progress: 1212/2366 symbols completed. KO took 43.8s. Estimated remaining: 2h 28m 45s. Rate: 7.8 symbols/min [2025-10-27T19:36:16.716718] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:36:16.722479] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-27T19:36:16.779314] [DEBUG] [LOCAL ] KR: Loaded 54461 existing records from primary storage. [2025-10-27T19:36:16.779625] [INFO ] [MAIN ] KR: Loaded 54461 existing records. [2025-10-27T19:36:16.956505] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:36:16.957545] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-27T19:36:16.957603] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-27T19:36:16.958348] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-27T19:36:16.958405] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-27T19:36:17.148279] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T19:36:17.215150] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-27T19:36:17.322492] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:36:17.544137] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-27T19:36:18.014952] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-27T19:36:18.458930] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-27T19:36:18.814945] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-27T19:36:19.129558] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-27T19:36:19.614939] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-27T19:36:20.030914] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-27T19:36:20.414995] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-27T19:36:21.214951] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-27T19:36:21.812873] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T19:36:22.014958] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-27T19:36:22.047776] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T19:36:22.815029] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-27T19:36:23.615010] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-27T19:36:23.773503] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-27T19:36:23.799888] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T19:36:24.414958] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-27T19:36:24.760173] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-27T19:36:25.214953] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-27T19:36:25.477335] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-27T19:36:26.014953] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-27T19:36:26.815024] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-27T19:36:26.878871] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T19:36:27.022865] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-27T19:36:27.026912] [INFO ] [REMOTE ] KOP: Full fetch complete (25346 records). [2025-10-27T19:36:27.027033] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-27T19:36:27.239482] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-27T19:36:27.432991] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-27T19:36:27.433069] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-27T19:36:27.433584] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-27T19:36:27.433623] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-27T19:36:27.434368] [DEBUG] [LOCAL ] KOP: Trimmed 25346 records to 17144 (keeping 200 days of data) [2025-10-27T19:36:27.539576] [DEBUG] [LOCAL ] KOP: Primary data saved (17144 records). [2025-10-27T19:36:27.539744] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-27T19:36:27.539833] [INFO ] [MAIN ] Update Progress: 1213/2366 symbols completed. KOP took 28.8s. Estimated remaining: 2h 28m 40s. Rate: 7.8 symbols/min [2025-10-27T19:36:27.620045] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-27T19:36:27.718377] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:36:27.767263] [DEBUG] [LOCAL ] KRC: Loaded 48712 existing records from primary storage. [2025-10-27T19:36:27.767559] [INFO ] [MAIN ] KRC: Loaded 48712 existing records. [2025-10-27T19:36:27.945621] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:36:27.945857] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-27T19:36:27.945925] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-27T19:36:27.946144] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-27T19:36:27.946203] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-27T19:36:28.288600] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:36:28.414919] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-27T19:36:29.214944] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-27T19:36:29.262697] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-27T19:36:29.346544] [DEBUG] [REMOTE ] KORE: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-27T19:36:29.346862] [WARN ] [REMOTE ] KORE: No data returned for month 2025-08 [2025-10-27T19:36:29.346963] [FATAL] [REMOTE ] KORE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:36:29.347073] [FATAL] [MAIN ] KORE: Failed to fetch primary data. [2025-10-27T19:36:29.347168] [WARN ] [MAIN ] KORE: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:36:29.347252] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-27T19:36:29.347328] [DEBUG] [LOCAL ] KORE: No primary data file found to delete. [2025-10-27T19:36:29.347379] [INFO ] [LOCAL ] KORE: Starting deletion of derivative data. [2025-10-27T19:36:29.347550] [DEBUG] [LOCAL ] KORE: Deleted derivative data file. [2025-10-27T19:36:29.347635] [INFO ] [MAIN ] Update Progress: 1214/2366 symbols completed. KORE took 18.8s. Estimated remaining: 2h 28m 27s. Rate: 7.8 symbols/min [2025-10-27T19:36:29.521631] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:36:29.550119] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T19:36:29.588474] [DEBUG] [LOCAL ] KREF: Loaded 38596 existing records from primary storage. [2025-10-27T19:36:29.588795] [INFO ] [MAIN ] KREF: Loaded 38596 existing records. [2025-10-27T19:36:29.776833] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:36:29.777045] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-27T19:36:29.777093] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-27T19:36:29.777315] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-27T19:36:29.777354] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-27T19:36:30.020049] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-27T19:36:30.131337] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:36:30.815050] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-27T19:36:31.449444] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T19:36:31.614939] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-27T19:36:32.306794] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-27T19:36:32.414977] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-27T19:36:33.146011] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T19:36:33.214938] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-27T19:36:33.313834] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-27T19:36:34.015002] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-27T19:36:34.814974] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-27T19:36:35.076332] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-27T19:36:35.378630] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T19:36:35.614931] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-27T19:36:36.039228] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T19:36:36.414979] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-27T19:36:37.104189] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T19:36:37.214910] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-27T19:36:37.673743] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-27T19:36:38.014962] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-27T19:36:38.733265] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T19:36:38.814960] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-27T19:36:39.016900] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-27T19:36:39.614997] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-27T19:36:40.192167] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T19:36:40.414950] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-27T19:36:40.679290] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-27T19:36:41.214974] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-27T19:36:42.014986] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-27T19:36:42.142979] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T19:36:42.486941] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T19:36:42.814996] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-27T19:36:43.479173] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-27T19:36:43.614945] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-27T19:36:44.097727] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T19:36:44.414934] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-27T19:36:45.233233] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-27T19:36:45.244751] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-27T19:36:45.582018] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T19:36:46.014989] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-27T19:36:46.639598] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T19:36:46.814987] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-27T19:36:47.614969] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-27T19:36:47.895310] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-27T19:36:47.905544] [INFO ] [REMOTE ] KOS: Full fetch complete (77033 records). [2025-10-27T19:36:47.905736] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-27T19:36:48.307233] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-27T19:36:48.307350] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-27T19:36:48.308448] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-27T19:36:48.308528] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-27T19:36:48.335111] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T19:36:48.334141] [DEBUG] [LOCAL ] KOS: Trimmed 77033 records to 53087 (keeping 200 days of data) [2025-10-27T19:36:48.424166] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-27T19:36:48.639357] [DEBUG] [LOCAL ] KOS: Primary data saved (53087 records). [2025-10-27T19:36:48.639518] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-27T19:36:48.639605] [INFO ] [MAIN ] Update Progress: 1215/2366 symbols completed. KOS took 34.7s. Estimated remaining: 2h 28m 30s. Rate: 7.8 symbols/min [2025-10-27T19:36:48.805248] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:36:48.848527] [DEBUG] [LOCAL ] KRG: Loaded 49992 existing records from primary storage. [2025-10-27T19:36:48.848853] [INFO ] [MAIN ] KRG: Loaded 49992 existing records. [2025-10-27T19:36:49.024278] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:36:49.024464] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-27T19:36:49.024510] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-27T19:36:49.024782] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-27T19:36:49.024856] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-27T19:36:49.223709] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-27T19:36:49.384234] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:36:49.415042] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-27T19:36:49.507743] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-27T19:36:50.014950] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-27T19:36:50.580716] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-27T19:36:50.815001] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-27T19:36:51.243090] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T19:36:51.614942] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-27T19:36:51.970847] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-27T19:36:52.414943] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-27T19:36:53.134002] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T19:36:53.214906] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-27T19:36:53.620708] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T19:36:54.014936] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-27T19:36:54.621816] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T19:36:54.814984] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-27T19:36:55.488027] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T19:36:55.495881] [INFO ] [REMOTE ] KREF: Full fetch complete (53069 records). [2025-10-27T19:36:55.496016] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-27T19:36:55.620101] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-27T19:36:55.895751] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-27T19:36:55.895875] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-27T19:36:55.896811] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-27T19:36:55.896914] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-27T19:36:55.898059] [DEBUG] [LOCAL ] KREF: Trimmed 53069 records to 37851 (keeping 200 days of data) [2025-10-27T19:36:56.024625] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T19:36:56.153541] [DEBUG] [LOCAL ] KREF: Primary data saved (37851 records). [2025-10-27T19:36:56.153696] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-27T19:36:56.154143] [INFO ] [MAIN ] Update Progress: 1216/2366 symbols completed. KREF took 26.8s. Estimated remaining: 2h 28m 22s. Rate: 7.8 symbols/min [2025-10-27T19:36:56.322989] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:36:56.323140] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-27T19:36:56.323181] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-27T19:36:56.323323] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-27T19:36:56.323378] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-27T19:36:56.323431] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-27T19:36:56.323468] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-27T19:36:56.420032] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-27T19:36:56.678447] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:36:56.805862] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T19:36:57.214952] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-27T19:36:58.014918] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-27T19:36:58.100407] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T19:36:58.110540] [INFO ] [REMOTE ] KR: Full fetch complete (77843 records). [2025-10-27T19:36:58.110701] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-27T19:36:58.500482] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-27T19:36:58.500594] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-27T19:36:58.501639] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-27T19:36:58.501721] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-27T19:36:58.503154] [DEBUG] [LOCAL ] KR: Trimmed 77843 records to 53681 (keeping 200 days of data) [2025-10-27T19:36:58.816056] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-10-27T19:36:58.830838] [DEBUG] [LOCAL ] KR: Primary data saved (53681 records). [2025-10-27T19:36:58.830927] [INFO ] [MAIN ] KR: Full history saved. [2025-10-27T19:36:58.831001] [INFO ] [MAIN ] Update Progress: 1217/2366 symbols completed. KR took 42.3s. Estimated remaining: 2h 28m 10s. Rate: 7.8 symbols/min [2025-10-27T19:36:59.007523] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-27T19:36:59.040438] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:36:59.040987] [INFO ] [REMOTE ] KRC: Full fetch complete (70042 records). [2025-10-27T19:36:59.041066] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-27T19:36:59.099963] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T19:36:59.133955] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-10-27T19:36:59.154907] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:36:59.166092] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-27T19:36:59.196574] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:36:59.236892] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-27T19:36:59.305516] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-27T19:36:59.356845] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-27T19:36:59.387421] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-27T19:36:59.393201] [INFO ] [MAIN ] Update Progress: 1218/2366 symbols completed. KRMN took 3.2s. Estimated remaining: 2h 27m 55s. Rate: 7.8 symbols/min [2025-10-27T19:36:59.404194] [DEBUG] [LOCAL ] KRO: Loaded 26911 existing records from primary storage. [2025-10-27T19:36:59.439212] [INFO ] [MAIN ] KRO: Loaded 26911 existing records. [2025-10-27T19:36:59.641940] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-27T19:36:59.676373] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-27T19:36:59.691725] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-27T19:36:59.695472] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-27T19:36:59.817154] [DEBUG] [LOCAL ] KRC: Trimmed 70042 records to 47927 (keeping 200 days of data) [2025-10-27T19:36:59.823892] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:36:59.846714] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:36:59.846852] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-27T19:36:59.847587] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-27T19:36:59.848030] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-27T19:36:59.848087] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-27T19:37:00.215404] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-27T19:37:00.279495] [DEBUG] [LOCAL ] KRP: Loaded 36327 existing records from primary storage. [2025-10-27T19:37:00.285398] [INFO ] [MAIN ] KRP: Loaded 36327 existing records. [2025-10-27T19:37:00.290855] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-27T19:37:00.660136] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:37:00.703054] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-27T19:37:00.759723] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:37:00.760286] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-27T19:37:00.760109] [DEBUG] [LOCAL ] KRC: Primary data saved (47927 records). [2025-10-27T19:37:00.760494] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-27T19:37:00.760431] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-27T19:37:00.761413] [INFO ] [MAIN ] Update Progress: 1219/2366 symbols completed. KRC took 33.2s. Estimated remaining: 2h 27m 42s. Rate: 7.8 symbols/min [2025-10-27T19:37:00.792287] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-27T19:37:00.823697] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-27T19:37:01.084252] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:37:01.298738] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:37:01.299099] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-27T19:37:01.345356] [DEBUG] [LOCAL ] KSS: Loaded 54355 existing records from primary storage. [2025-10-27T19:37:01.345872] [INFO ] [MAIN ] KSS: Loaded 54355 existing records. [2025-10-27T19:37:01.541200] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:37:01.541476] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-27T19:37:01.541543] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-27T19:37:01.541861] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-27T19:37:01.541937] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-27T19:37:01.907985] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:37:02.014912] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-27T19:37:03.358754] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-27T19:37:03.367605] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-27T19:37:04.118203] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (3.83 seconds). [2025-10-27T19:37:04.128848] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-27T19:37:04.391112] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (3.69 seconds). [2025-10-27T19:37:04.414900] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-27T19:37:04.715674] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T19:37:05.202488] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (3.19 seconds). [2025-10-27T19:37:05.214894] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-27T19:37:05.259902] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-27T19:37:06.014913] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-27T19:37:06.102121] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-27T19:37:06.814955] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-27T19:37:06.870814] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-27T19:37:07.524266] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-27T19:37:07.614931] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-27T19:37:08.414983] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-27T19:37:08.473610] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T19:37:09.108627] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T19:37:09.214942] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-27T19:37:09.450026] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T19:37:10.014950] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-27T19:37:10.814944] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-27T19:37:11.340015] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-27T19:37:11.375160] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-27T19:37:11.566291] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-27T19:37:11.614940] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-27T19:37:12.414909] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-27T19:37:12.831506] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T19:37:13.214916] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-27T19:37:13.440150] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T19:37:14.014963] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-27T19:37:14.376278] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T19:37:14.814987] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-27T19:37:15.542021] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-27T19:37:15.606354] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-27T19:37:15.614890] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-27T19:37:16.414989] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-27T19:37:16.489454] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-27T19:37:17.215050] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-27T19:37:18.015243] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-27T19:37:18.311502] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-27T19:37:18.529559] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-27T19:37:18.797208] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-27T19:37:18.814898] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-27T19:37:19.619774] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-27T19:37:19.621689] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T19:37:20.414957] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-27T19:37:21.214984] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-27T19:37:21.474002] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-27T19:37:21.483558] [INFO ] [REMOTE ] KRG: Full fetch complete (71425 records). [2025-10-27T19:37:21.483692] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-27T19:37:21.818269] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T19:37:21.905416] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-27T19:37:21.905491] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-27T19:37:21.906532] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-27T19:37:21.906598] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-27T19:37:21.907955] [DEBUG] [LOCAL ] KRG: Trimmed 71425 records to 49194 (keeping 200 days of data) [2025-10-27T19:37:22.027808] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-27T19:37:22.204444] [DEBUG] [LOCAL ] KRG: Primary data saved (49194 records). [2025-10-27T19:37:22.204588] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-27T19:37:22.204721] [INFO ] [MAIN ] Update Progress: 1220/2366 symbols completed. KRG took 33.6s. Estimated remaining: 2h 27m 47s. Rate: 7.8 symbols/min [2025-10-27T19:37:22.371569] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:37:22.412000] [DEBUG] [LOCAL ] KT: Loaded 45999 existing records from primary storage. [2025-10-27T19:37:22.412331] [INFO ] [MAIN ] KT: Loaded 45999 existing records. [2025-10-27T19:37:22.593046] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:37:22.593269] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-27T19:37:22.593323] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-27T19:37:22.593549] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-27T19:37:22.593594] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-27T19:37:22.816905] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-27T19:37:22.957639] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:37:23.341549] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-27T19:37:23.473591] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T19:37:23.614911] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-27T19:37:23.858496] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T19:37:23.863727] [INFO ] [REMOTE ] KRO: Full fetch complete (35374 records). [2025-10-27T19:37:23.863818] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-27T19:37:24.262068] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-27T19:37:24.262148] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-27T19:37:24.262848] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-27T19:37:24.262908] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-27T19:37:24.263795] [DEBUG] [LOCAL ] KRO: Trimmed 35374 records to 26446 (keeping 200 days of data) [2025-10-27T19:37:24.412369] [DEBUG] [LOCAL ] KRO: Primary data saved (26446 records). [2025-10-27T19:37:24.412484] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-27T19:37:24.412558] [INFO ] [MAIN ] Update Progress: 1221/2366 symbols completed. KRO took 25.6s. Estimated remaining: 2h 27m 34s. Rate: 7.8 symbols/min [2025-10-27T19:37:24.423369] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-27T19:37:24.589392] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:37:24.625280] [DEBUG] [LOCAL ] KTB: Loaded 40735 existing records from primary storage. [2025-10-27T19:37:24.625571] [INFO ] [MAIN ] KTB: Loaded 40735 existing records. [2025-10-27T19:37:24.807328] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:37:24.807576] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-27T19:37:24.807630] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-27T19:37:24.807846] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-27T19:37:24.807890] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-27T19:37:25.074954] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T19:37:25.190506] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:37:25.214906] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-27T19:37:26.014952] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-27T19:37:26.255425] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-27T19:37:26.437877] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-27T19:37:26.814982] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-27T19:37:27.614986] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-27T19:37:27.958935] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-27T19:37:28.033285] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T19:37:28.414948] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-27T19:37:28.783759] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T19:37:29.214956] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-27T19:37:30.014915] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-27T19:37:30.050024] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-27T19:37:30.200827] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-27T19:37:30.814975] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-27T19:37:31.602047] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T19:37:31.614902] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-27T19:37:32.414929] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-27T19:37:32.552582] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-27T19:37:33.015870] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T19:37:33.214943] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-27T19:37:33.889991] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-27T19:37:33.896399] [INFO ] [REMOTE ] KRP: Full fetch complete (54774 records). [2025-10-27T19:37:33.896546] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-27T19:37:34.020119] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-27T19:37:34.274888] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-27T19:37:34.275016] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-27T19:37:34.275874] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-27T19:37:34.275978] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-27T19:37:34.277117] [DEBUG] [LOCAL ] KRP: Trimmed 54774 records to 35495 (keeping 200 days of data) [2025-10-27T19:37:34.551807] [DEBUG] [LOCAL ] KRP: Primary data saved (35495 records). [2025-10-27T19:37:34.554192] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T19:37:34.554437] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-27T19:37:34.563028] [INFO ] [MAIN ] Update Progress: 1222/2366 symbols completed. KRP took 35.2s. Estimated remaining: 2h 27m 28s. Rate: 7.8 symbols/min [2025-10-27T19:37:34.727194] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:37:34.739898] [DEBUG] [LOCAL ] KTF: Loaded 11768 existing records from primary storage. [2025-10-27T19:37:34.740111] [INFO ] [MAIN ] KTF: Loaded 11768 existing records. [2025-10-27T19:37:34.820334] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-27T19:37:34.914917] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:37:34.915111] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-27T19:37:34.915159] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-27T19:37:34.915522] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-27T19:37:34.915636] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-27T19:37:35.273344] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:37:35.614952] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-27T19:37:36.037962] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-27T19:37:36.314240] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-27T19:37:36.324375] [INFO ] [REMOTE ] KSS: Full fetch complete (77738 records). [2025-10-27T19:37:36.324499] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-27T19:37:36.420131] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-27T19:37:36.715880] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-27T19:37:36.715977] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-27T19:37:36.717127] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-27T19:37:36.717224] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-27T19:37:36.718734] [DEBUG] [LOCAL ] KSS: Trimmed 77738 records to 53574 (keeping 200 days of data) [2025-10-27T19:37:36.809957] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T19:37:37.048052] [DEBUG] [LOCAL ] KSS: Primary data saved (53574 records). [2025-10-27T19:37:37.048185] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-27T19:37:37.048260] [INFO ] [MAIN ] Update Progress: 1223/2366 symbols completed. KSS took 36.3s. Estimated remaining: 2h 27m 16s. Rate: 7.8 symbols/min [2025-10-27T19:37:37.219681] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-27T19:37:37.221146] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:37:37.270718] [DEBUG] [LOCAL ] KVUE: Loaded 54447 existing records from primary storage. [2025-10-27T19:37:37.271040] [INFO ] [MAIN ] KVUE: Loaded 54447 existing records. [2025-10-27T19:37:37.454996] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:37:37.455225] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-27T19:37:37.455280] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-27T19:37:37.455471] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-27T19:37:37.455511] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-27T19:37:37.824417] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:37:37.849505] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T19:37:38.014940] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-27T19:37:38.762635] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T19:37:38.814958] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-27T19:37:39.450573] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T19:37:39.616730] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-27T19:37:39.619360] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T19:37:40.414997] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-27T19:37:40.967257] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T19:37:40.989740] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-27T19:37:41.214992] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-27T19:37:42.014958] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-27T19:37:42.580197] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-27T19:37:42.814946] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-27T19:37:43.614993] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-27T19:37:43.733492] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T19:37:43.993792] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T19:37:44.415029] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-27T19:37:44.865464] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T19:37:45.214906] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-27T19:37:45.376499] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T19:37:46.014973] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-27T19:37:46.788828] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T19:37:46.814898] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-27T19:37:47.088769] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T19:37:47.614919] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-27T19:37:48.414974] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-27T19:37:48.483672] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T19:37:48.926515] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T19:37:49.214976] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-27T19:37:49.943195] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T19:37:50.014933] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-27T19:37:50.801045] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T19:37:50.814896] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-27T19:37:51.122539] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T19:37:51.614930] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-27T19:37:51.937509] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-27T19:37:51.944298] [INFO ] [REMOTE ] KTB: Full fetch complete (58292 records). [2025-10-27T19:37:51.944399] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-27T19:37:52.319663] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-27T19:37:52.319774] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-27T19:37:52.320594] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-27T19:37:52.320636] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-27T19:37:52.321771] [DEBUG] [LOCAL ] KTB: Trimmed 58292 records to 39895 (keeping 200 days of data) [2025-10-27T19:37:52.414981] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-27T19:37:52.560532] [DEBUG] [LOCAL ] KTB: Primary data saved (39895 records). [2025-10-27T19:37:52.560685] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-27T19:37:52.560795] [INFO ] [MAIN ] Update Progress: 1224/2366 symbols completed. KTB took 28.1s. Estimated remaining: 2h 27m 15s. Rate: 7.8 symbols/min [2025-10-27T19:37:52.731793] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:37:52.778723] [DEBUG] [LOCAL ] KVYO: Loaded 51644 existing records from primary storage. [2025-10-27T19:37:52.779076] [INFO ] [MAIN ] KVYO: Loaded 51644 existing records. [2025-10-27T19:37:52.971690] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:37:52.972076] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-27T19:37:52.978541] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-27T19:37:52.980036] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-27T19:37:52.979974] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-27T19:37:52.980157] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-27T19:37:53.216421] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-27T19:37:53.358852] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:37:53.393720] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-27T19:37:53.828301] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T19:37:54.014944] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-27T19:37:54.814937] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-27T19:37:55.614951] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-27T19:37:55.788574] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-27T19:37:56.027037] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T19:37:56.414977] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-27T19:37:56.756164] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T19:37:56.765906] [INFO ] [REMOTE ] KT: Full fetch complete (66661 records). [2025-10-27T19:37:56.766124] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-27T19:37:57.145477] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-27T19:37:57.145555] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-27T19:37:57.146495] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-27T19:37:57.146559] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-27T19:37:57.147844] [DEBUG] [LOCAL ] KT: Trimmed 66661 records to 45188 (keeping 200 days of data) [2025-10-27T19:37:57.234038] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-27T19:37:57.418077] [DEBUG] [LOCAL ] KT: Primary data saved (45188 records). [2025-10-27T19:37:57.418247] [INFO ] [MAIN ] KT: Full history saved. [2025-10-27T19:37:57.418343] [INFO ] [MAIN ] Update Progress: 1225/2366 symbols completed. KT took 35.2s. Estimated remaining: 2h 27m 5s. Rate: 7.8 symbols/min [2025-10-27T19:37:57.588861] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:37:57.626465] [DEBUG] [LOCAL ] KW: Loaded 40820 existing records from primary storage. [2025-10-27T19:37:57.627005] [INFO ] [MAIN ] KW: Loaded 40820 existing records. [2025-10-27T19:37:57.769272] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T19:37:57.876698] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:37:57.877022] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-27T19:37:57.877073] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-27T19:37:57.877298] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-27T19:37:57.877338] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-27T19:37:58.023519] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-27T19:37:58.264296] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:37:58.502706] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-27T19:37:58.569168] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-27T19:37:58.815000] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-27T19:37:59.614924] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-27T19:38:00.029438] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T19:38:00.414960] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-27T19:38:01.214944] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-27T19:38:01.366618] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-27T19:38:02.014939] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-27T19:38:02.814946] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-27T19:38:03.498541] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-27T19:38:03.614970] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-27T19:38:03.638923] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (3.22 seconds). [2025-10-27T19:38:03.736105] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T19:38:04.414965] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-27T19:38:04.963292] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T19:38:05.215051] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-27T19:38:05.554471] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T19:38:06.014986] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-27T19:38:06.029219] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-27T19:38:06.031382] [INFO ] [REMOTE ] KTF: Full fetch complete (17376 records). [2025-10-27T19:38:06.031471] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-27T19:38:06.207322] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (3.39 seconds). [2025-10-27T19:38:06.436802] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-27T19:38:06.436876] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-27T19:38:06.437245] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-27T19:38:06.437285] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-27T19:38:06.437805] [DEBUG] [LOCAL ] KTF: Trimmed 17376 records to 11395 (keeping 200 days of data) [2025-10-27T19:38:06.507882] [DEBUG] [LOCAL ] KTF: Primary data saved (11395 records). [2025-10-27T19:38:06.508012] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-27T19:38:06.508109] [INFO ] [MAIN ] Update Progress: 1226/2366 symbols completed. KTF took 31.9s. Estimated remaining: 2h 26m 58s. Rate: 7.8 symbols/min [2025-10-27T19:38:06.674413] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:38:06.691683] [DEBUG] [LOCAL ] KWR: Loaded 15854 existing records from primary storage. [2025-10-27T19:38:06.691933] [INFO ] [MAIN ] KWR: Loaded 15854 existing records. [2025-10-27T19:38:06.820141] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-27T19:38:06.878847] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:38:06.879069] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-27T19:38:06.879119] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-27T19:38:06.879311] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-27T19:38:06.879368] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-27T19:38:07.229115] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:38:07.614914] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-27T19:38:07.772486] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-27T19:38:07.782555] [INFO ] [REMOTE ] KVUE: Full fetch complete (77845 records). [2025-10-27T19:38:07.782708] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-27T19:38:08.170044] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-27T19:38:08.185883] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-27T19:38:08.196552] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-27T19:38:08.199415] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-27T19:38:08.201673] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-27T19:38:08.213621] [DEBUG] [LOCAL ] KVUE: Trimmed 77845 records to 53667 (keeping 200 days of data) [2025-10-27T19:38:08.419986] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-27T19:38:08.539072] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-10-27T19:38:08.539324] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-27T19:38:08.540284] [INFO ] [MAIN ] Update Progress: 1227/2366 symbols completed. KVUE took 31.5s. Estimated remaining: 2h 26m 45s. Rate: 7.8 symbols/min [2025-10-27T19:38:08.711391] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:38:08.744314] [DEBUG] [LOCAL ] KYN: Loaded 30665 existing records from primary storage. [2025-10-27T19:38:08.744566] [INFO ] [MAIN ] KYN: Loaded 30665 existing records. [2025-10-27T19:38:08.954237] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:38:08.954489] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-27T19:38:08.954539] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-27T19:38:08.954768] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-27T19:38:08.954830] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-27T19:38:09.169273] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-27T19:38:09.218748] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-27T19:38:09.378996] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:38:09.687836] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T19:38:10.014948] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-27T19:38:10.403082] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-27T19:38:10.814978] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-27T19:38:11.127437] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-27T19:38:11.614973] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-27T19:38:12.352116] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-27T19:38:12.414971] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-27T19:38:12.555047] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-27T19:38:13.214974] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-27T19:38:13.621980] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T19:38:14.014898] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-27T19:38:14.558749] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T19:38:14.814987] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-27T19:38:15.614997] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-27T19:38:15.644518] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-27T19:38:15.817740] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-27T19:38:16.309819] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-27T19:38:16.414974] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-27T19:38:17.214954] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-27T19:38:17.815786] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-27T19:38:18.014931] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-27T19:38:18.299612] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-27T19:38:18.310154] [INFO ] [REMOTE ] KVYO: Full fetch complete (72433 records). [2025-10-27T19:38:18.310315] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-27T19:38:18.719987] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-27T19:38:18.720123] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-27T19:38:18.721170] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-27T19:38:18.721332] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-27T19:38:18.723073] [DEBUG] [LOCAL ] KVYO: Trimmed 72433 records to 50902 (keeping 200 days of data) [2025-10-27T19:38:18.818397] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-27T19:38:18.833116] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T19:38:19.035552] [DEBUG] [LOCAL ] KVYO: Primary data saved (50902 records). [2025-10-27T19:38:19.035728] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-27T19:38:19.035829] [INFO ] [MAIN ] Update Progress: 1228/2366 symbols completed. KVYO took 26.5s. Estimated remaining: 2h 26m 40s. Rate: 7.8 symbols/min [2025-10-27T19:38:19.205340] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:38:19.243925] [DEBUG] [LOCAL ] L: Loaded 41681 existing records from primary storage. [2025-10-27T19:38:19.244212] [INFO ] [MAIN ] L: Loaded 41681 existing records. [2025-10-27T19:38:19.417835] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:38:19.418182] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-27T19:38:19.418240] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-27T19:38:19.418866] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-27T19:38:19.418923] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-27T19:38:19.624015] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-27T19:38:19.791165] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:38:19.929492] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T19:38:20.414916] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-27T19:38:20.725092] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-27T19:38:21.214996] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-27T19:38:21.315484] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-27T19:38:21.944868] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-27T19:38:22.014927] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-27T19:38:22.814926] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-27T19:38:23.258808] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T19:38:23.615008] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-27T19:38:23.757408] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-27T19:38:24.415026] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-27T19:38:24.728315] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-27T19:38:24.735928] [INFO ] [REMOTE ] KW: Full fetch complete (57128 records). [2025-10-27T19:38:24.736083] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-27T19:38:25.123355] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-27T19:38:25.123478] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-27T19:38:25.124354] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-27T19:38:25.124418] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-27T19:38:25.125605] [DEBUG] [LOCAL ] KW: Trimmed 57128 records to 40000 (keeping 200 days of data) [2025-10-27T19:38:25.224808] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-27T19:38:25.362503] [DEBUG] [LOCAL ] KW: Primary data saved (40000 records). [2025-10-27T19:38:25.362703] [INFO ] [MAIN ] KW: Full history saved. [2025-10-27T19:38:25.362801] [INFO ] [MAIN ] Update Progress: 1229/2366 symbols completed. KW took 27.9s. Estimated remaining: 2h 26m 31s. Rate: 7.8 symbols/min [2025-10-27T19:38:25.541485] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:38:25.590049] [DEBUG] [LOCAL ] LAC: Loaded 53351 existing records from primary storage. [2025-10-27T19:38:25.590348] [INFO ] [MAIN ] LAC: Loaded 53351 existing records. [2025-10-27T19:38:25.773163] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:38:25.773526] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-27T19:38:25.773631] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-27T19:38:25.774025] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-27T19:38:25.774135] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-27T19:38:25.918934] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T19:38:26.020079] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-27T19:38:26.175402] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:38:26.202358] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-27T19:38:26.814952] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-27T19:38:27.260437] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T19:38:27.614978] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-27T19:38:27.765535] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T19:38:28.415022] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-27T19:38:29.157629] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-27T19:38:29.214962] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-27T19:38:29.254914] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T19:38:30.014950] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-27T19:38:30.188304] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-27T19:38:30.814947] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-27T19:38:31.412788] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-27T19:38:31.535559] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T19:38:31.614926] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-27T19:38:32.414958] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-27T19:38:33.214986] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-27T19:38:33.262095] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T19:38:33.936409] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T19:38:34.014930] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-27T19:38:34.080340] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-27T19:38:34.814976] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-27T19:38:34.945497] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T19:38:34.948012] [INFO ] [REMOTE ] KWR: Full fetch complete (23047 records). [2025-10-27T19:38:34.948080] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-27T19:38:35.298679] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-27T19:38:35.298763] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-27T19:38:35.299233] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-27T19:38:35.299273] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-27T19:38:35.299877] [DEBUG] [LOCAL ] KWR: Trimmed 23047 records to 15417 (keeping 200 days of data) [2025-10-27T19:38:35.392114] [DEBUG] [LOCAL ] KWR: Primary data saved (15417 records). [2025-10-27T19:38:35.392241] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-27T19:38:35.392316] [INFO ] [MAIN ] Update Progress: 1230/2366 symbols completed. KWR took 28.9s. Estimated remaining: 2h 26m 25s. Rate: 7.8 symbols/min [2025-10-27T19:38:35.554512] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:38:35.576821] [DEBUG] [LOCAL ] LAD: Loaded 23777 existing records from primary storage. [2025-10-27T19:38:35.577049] [INFO ] [MAIN ] LAD: Loaded 23777 existing records. [2025-10-27T19:38:35.620174] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-27T19:38:35.757192] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:38:35.757429] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-27T19:38:35.757489] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-27T19:38:35.757681] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-27T19:38:35.757737] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-27T19:38:36.127868] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:38:36.129353] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T19:38:36.414959] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-27T19:38:36.656886] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T19:38:37.214914] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-27T19:38:37.265986] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T19:38:38.014974] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-27T19:38:38.122095] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-27T19:38:38.814974] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-27T19:38:39.614973] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-27T19:38:39.810930] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-27T19:38:40.165675] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T19:38:40.414962] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-27T19:38:41.015988] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T19:38:41.214938] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-27T19:38:41.618132] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-27T19:38:42.014990] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-27T19:38:42.303833] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-27T19:38:42.814982] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-27T19:38:42.947354] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T19:38:42.953319] [INFO ] [REMOTE ] KYN: Full fetch complete (44419 records). [2025-10-27T19:38:42.953403] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-27T19:38:43.322470] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-27T19:38:43.322558] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-27T19:38:43.323468] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-27T19:38:43.323552] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-27T19:38:43.324617] [DEBUG] [LOCAL ] KYN: Trimmed 44419 records to 29810 (keeping 200 days of data) [2025-10-27T19:38:43.504596] [DEBUG] [LOCAL ] KYN: Primary data saved (29810 records). [2025-10-27T19:38:43.504776] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-27T19:38:43.505520] [INFO ] [MAIN ] Update Progress: 1231/2366 symbols completed. KYN took 35.0s. Estimated remaining: 2h 26m 18s. Rate: 7.8 symbols/min [2025-10-27T19:38:43.620198] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-27T19:38:43.672313] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:38:43.712357] [DEBUG] [LOCAL ] LADR: Loaded 39961 existing records from primary storage. [2025-10-27T19:38:43.712669] [INFO ] [MAIN ] LADR: Loaded 39961 existing records. [2025-10-27T19:38:43.888176] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:38:43.888408] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-27T19:38:43.888455] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-27T19:38:43.888665] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-27T19:38:43.888724] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-27T19:38:44.247564] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:38:44.272008] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-27T19:38:44.414907] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-27T19:38:44.669494] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-27T19:38:45.214994] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-27T19:38:46.014973] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-27T19:38:46.161732] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T19:38:46.169702] [INFO ] [REMOTE ] L: Full fetch complete (59230 records). [2025-10-27T19:38:46.169839] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-27T19:38:46.556216] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-27T19:38:46.556395] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-27T19:38:46.563957] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-27T19:38:46.573840] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-27T19:38:46.575387] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T19:38:46.582108] [DEBUG] [LOCAL ] L: Trimmed 59230 records to 40785 (keeping 200 days of data) [2025-10-27T19:38:46.814995] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-27T19:38:46.820609] [DEBUG] [LOCAL ] L: Primary data saved (40785 records). [2025-10-27T19:38:46.820768] [INFO ] [MAIN ] L: Full history saved. [2025-10-27T19:38:46.820851] [INFO ] [MAIN ] Update Progress: 1232/2366 symbols completed. L took 27.8s. Estimated remaining: 2h 26m 6s. Rate: 7.8 symbols/min [2025-10-27T19:38:46.984351] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:38:46.989137] [DEBUG] [LOCAL ] LANV: Loaded 2817 existing records from primary storage. [2025-10-27T19:38:46.989281] [INFO ] [MAIN ] LANV: Loaded 2817 existing records. [2025-10-27T19:38:47.158122] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:38:47.158365] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-27T19:38:47.158412] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-27T19:38:47.158553] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-27T19:38:47.158590] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-27T19:38:47.507944] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:38:47.571217] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T19:38:47.614906] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-27T19:38:47.737629] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-27T19:38:48.159999] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-27T19:38:48.414995] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-27T19:38:49.214942] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-27T19:38:49.556587] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-27T19:38:49.730729] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T19:38:50.014934] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-27T19:38:50.814992] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-27T19:38:50.978773] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-27T19:38:51.614932] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-27T19:38:52.230196] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T19:38:52.414928] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-27T19:38:52.537275] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T19:38:53.214946] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-27T19:38:53.519930] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-27T19:38:53.723241] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T19:38:54.014928] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-27T19:38:54.460415] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-27T19:38:54.814943] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-27T19:38:55.614932] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-27T19:38:55.766542] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T19:38:56.027200] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-27T19:38:56.414945] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-27T19:38:56.884252] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-27T19:38:57.214940] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-27T19:38:58.014939] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-27T19:38:58.702406] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T19:38:58.814962] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-27T19:38:59.121141] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-27T19:38:59.614928] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-27T19:38:59.962210] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-27T19:39:00.414952] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-27T19:39:01.222510] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-27T19:39:01.244603] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T19:39:02.014954] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-27T19:39:02.815000] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-27T19:39:03.720630] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-27T19:39:03.722105] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-27T19:39:04.336621] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-27T19:39:04.414894] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-27T19:39:04.563288] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (4.15 seconds). [2025-10-27T19:39:04.918742] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-27T19:39:05.140944] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (3.92 seconds). [2025-10-27T19:39:05.214998] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-27T19:39:05.475212] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-27T19:39:05.476327] [INFO ] [REMOTE ] LANV: Full fetch complete (4234 records). [2025-10-27T19:39:05.476396] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-27T19:39:05.828943] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-27T19:39:05.829014] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-27T19:39:05.829140] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-27T19:39:05.829177] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-27T19:39:05.829505] [DEBUG] [LOCAL ] LANV: Trimmed 4234 records to 2761 (keeping 200 days of data) [2025-10-27T19:39:05.844194] [DEBUG] [LOCAL ] LANV: Primary data saved (2761 records). [2025-10-27T19:39:05.844254] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-27T19:39:05.844318] [INFO ] [MAIN ] Update Progress: 1233/2366 symbols completed. LANV took 19.0s. Estimated remaining: 2h 26m 9s. Rate: 7.8 symbols/min [2025-10-27T19:39:06.010989] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:39:06.011153] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-27T19:39:06.011189] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-27T19:39:06.011293] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-27T19:39:06.011337] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-27T19:39:06.011420] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-27T19:39:06.011470] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-27T19:39:06.023111] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-27T19:39:06.366093] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:39:06.814935] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-10-27T19:39:07.078158] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-27T19:39:07.133186] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-27T19:39:07.290838] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-27T19:39:07.614931] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-27T19:39:08.414935] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-27T19:39:09.214996] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-27T19:39:09.472873] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-27T19:39:10.014943] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-10-27T19:39:10.326812] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.71 seconds). [2025-10-27T19:39:10.336994] [INFO ] [REMOTE ] LAC: Full fetch complete (76151 records). [2025-10-27T19:39:10.337109] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-27T19:39:10.728201] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-27T19:39:10.735234] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-27T19:39:10.747913] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-27T19:39:10.748046] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-27T19:39:10.750014] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T19:39:10.758475] [DEBUG] [LOCAL ] LAC: Trimmed 76151 records to 52585 (keeping 200 days of data) [2025-10-27T19:39:10.837473] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-27T19:39:11.061854] [DEBUG] [LOCAL ] LAC: Primary data saved (52585 records). [2025-10-27T19:39:11.062206] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-27T19:39:11.062309] [INFO ] [MAIN ] Update Progress: 1234/2366 symbols completed. LAC took 45.7s. Estimated remaining: 2h 25m 59s. Rate: 7.8 symbols/min [2025-10-27T19:39:11.271776] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:39:11.313237] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T19:39:11.336378] [DEBUG] [LOCAL ] LAW: Loaded 15240 existing records from primary storage. [2025-10-27T19:39:11.336638] [INFO ] [MAIN ] LAW: Loaded 15240 existing records. [2025-10-27T19:39:11.593325] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:39:11.593631] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-27T19:39:11.593724] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-27T19:39:11.593889] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-27T19:39:11.593929] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-27T19:39:11.620402] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-27T19:39:12.100572] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:39:12.131128] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-27T19:39:12.414961] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-27T19:39:12.974391] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T19:39:12.980247] [INFO ] [REMOTE ] LAD: Full fetch complete (35751 records). [2025-10-27T19:39:12.980384] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-27T19:39:13.137501] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-27T19:39:13.220211] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-27T19:39:13.370956] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-27T19:39:13.371030] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-27T19:39:13.371715] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-27T19:39:13.371774] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-27T19:39:13.372561] [DEBUG] [LOCAL ] LAD: Trimmed 35751 records to 23328 (keeping 200 days of data) [2025-10-27T19:39:13.524000] [DEBUG] [LOCAL ] LAD: Primary data saved (23328 records). [2025-10-27T19:39:13.524117] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-27T19:39:13.524193] [INFO ] [MAIN ] Update Progress: 1235/2366 symbols completed. LAD took 38.1s. Estimated remaining: 2h 25m 46s. Rate: 7.8 symbols/min [2025-10-27T19:39:13.691280] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:39:13.730785] [DEBUG] [LOCAL ] LAZ: Loaded 45115 existing records from primary storage. [2025-10-27T19:39:13.731107] [INFO ] [MAIN ] LAZ: Loaded 45115 existing records. [2025-10-27T19:39:13.927966] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:39:13.928225] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-27T19:39:13.928278] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-27T19:39:13.928485] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-27T19:39:13.928540] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-27T19:39:14.037010] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-27T19:39:14.050674] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-27T19:39:14.292219] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:39:14.814961] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-27T19:39:15.325209] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-27T19:39:15.511019] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T19:39:15.614961] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-27T19:39:16.122971] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-27T19:39:16.414943] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-10-27T19:39:17.214963] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-27T19:39:17.978276] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-27T19:39:18.014907] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-10-27T19:39:18.376283] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T19:39:18.814955] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-27T19:39:19.285282] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-27T19:39:19.614939] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-27T19:39:19.931222] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-27T19:39:20.415003] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-27T19:39:21.085837] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T19:39:21.214988] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-27T19:39:21.275883] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-27T19:39:22.015003] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-27T19:39:22.815006] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-10-27T19:39:23.096175] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-27T19:39:23.103938] [INFO ] [REMOTE ] LADR: Full fetch complete (55703 records). [2025-10-27T19:39:23.104068] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-27T19:39:23.480329] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-27T19:39:23.480431] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-27T19:39:23.481294] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-27T19:39:23.481377] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-27T19:39:23.482530] [DEBUG] [LOCAL ] LADR: Trimmed 55703 records to 39131 (keeping 200 days of data) [2025-10-27T19:39:23.651916] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-27T19:39:23.721179] [DEBUG] [LOCAL ] LADR: Primary data saved (39131 records). [2025-10-27T19:39:23.721524] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-27T19:39:23.722225] [INFO ] [MAIN ] Update Progress: 1236/2366 symbols completed. LADR took 40.2s. Estimated remaining: 2h 25m 41s. Rate: 7.8 symbols/min [2025-10-27T19:39:23.860134] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-27T19:39:23.938026] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:39:23.973804] [DEBUG] [LOCAL ] LB: Loaded 37459 existing records from primary storage. [2025-10-27T19:39:23.974090] [INFO ] [MAIN ] LB: Loaded 37459 existing records. [2025-10-27T19:39:24.146940] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:39:24.147130] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-27T19:39:24.147177] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-27T19:39:24.147384] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-27T19:39:24.147439] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-27T19:39:24.431705] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-27T19:39:24.436813] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-27T19:39:24.522053] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:39:24.756976] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-27T19:39:25.214970] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-10-27T19:39:25.837770] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T19:39:26.014908] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-27T19:39:26.318009] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T19:39:26.814936] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-27T19:39:27.369210] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-27T19:39:27.614901] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-10-27T19:39:27.713176] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T19:39:28.414988] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-27T19:39:28.870518] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-27T19:39:29.214953] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-27T19:39:29.910458] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-27T19:39:30.014951] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-27T19:39:30.584639] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T19:39:30.614190] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T19:39:30.814980] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-27T19:39:31.614914] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-27T19:39:31.760477] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T19:39:32.415014] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-10-27T19:39:32.881339] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T19:39:33.215052] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-27T19:39:33.971846] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T19:39:34.014920] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-10-27T19:39:34.148803] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T19:39:34.152975] [INFO ] [REMOTE ] LAW: Full fetch complete (21217 records). [2025-10-27T19:39:34.153054] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-27T19:39:34.509408] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-27T19:39:34.509481] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-27T19:39:34.509958] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-27T19:39:34.510019] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-27T19:39:34.510565] [DEBUG] [LOCAL ] LAW: Trimmed 21217 records to 15098 (keeping 200 days of data) [2025-10-27T19:39:34.592106] [DEBUG] [LOCAL ] LAW: Primary data saved (15098 records). [2025-10-27T19:39:34.592212] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-27T19:39:34.592299] [INFO ] [MAIN ] Update Progress: 1237/2366 symbols completed. LAW took 23.5s. Estimated remaining: 2h 25m 36s. Rate: 7.8 symbols/min [2025-10-27T19:39:34.814941] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-27T19:39:35.195543] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T19:39:35.614957] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-27T19:39:36.293743] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T19:39:36.414944] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-10. [2025-10-27T19:39:36.616358] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-27T19:39:37.214947] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-27T19:39:38.014972] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-27T19:39:38.287363] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-27T19:39:38.358385] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-27T19:39:38.369381] [INFO ] [REMOTE ] LAR: Full fetch complete (63615 records). [2025-10-27T19:39:38.369503] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-10-27T19:39:38.582272] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-27T19:39:38.582931] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:39:38.583004] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:39:38.583077] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-27T19:39:38.583141] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-27T19:39:38.583177] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-27T19:39:38.583216] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-27T19:39:38.583278] [INFO ] [MAIN ] Update Progress: 1238/2366 symbols completed. LAR took 32.7s. Estimated remaining: 2h 25m 25s. Rate: 7.8 symbols/min [2025-10-27T19:39:38.814963] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-27T19:39:39.140864] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-27T19:39:39.614996] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-27T19:39:40.017925] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-27T19:39:40.025713] [INFO ] [REMOTE ] LAZ: Full fetch complete (65336 records). [2025-10-27T19:39:40.025822] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-27T19:39:40.405807] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-27T19:39:40.405882] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-27T19:39:40.406820] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-27T19:39:40.406880] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-27T19:39:40.408127] [DEBUG] [LOCAL ] LAZ: Trimmed 65336 records to 44276 (keeping 200 days of data) [2025-10-27T19:39:40.672474] [DEBUG] [LOCAL ] LAZ: Primary data saved (44276 records). [2025-10-27T19:39:40.672787] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-27T19:39:40.673299] [INFO ] [MAIN ] Update Progress: 1239/2366 symbols completed. LAZ took 27.1s. Estimated remaining: 2h 25m 12s. Rate: 7.8 symbols/min [2025-10-27T19:39:40.725981] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-27T19:39:40.733811] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-27T19:39:42.139264] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-27T19:39:42.147616] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-27T19:39:43.326718] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-27T19:39:43.334549] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-27T19:39:44.990588] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T19:39:45.000317] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-27T19:39:46.464469] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T19:39:46.472896] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-27T19:39:47.745303] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-27T19:39:47.753293] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-27T19:39:48.826510] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-27T19:39:48.833733] [INFO ] [REMOTE ] LB: Full fetch complete (55494 records). [2025-10-27T19:39:48.833880] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-27T19:39:49.220628] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-27T19:39:49.220745] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-27T19:39:49.221573] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-27T19:39:49.221621] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-27T19:39:49.222747] [DEBUG] [LOCAL ] LB: Trimmed 55494 records to 36633 (keeping 200 days of data) [2025-10-27T19:39:49.442397] [DEBUG] [LOCAL ] LB: Primary data saved (36633 records). [2025-10-27T19:39:49.442528] [INFO ] [MAIN ] LB: Full history saved. [2025-10-27T19:39:49.442679] [INFO ] [MAIN ] Update Progress: 1240/2366 symbols completed. LB took 25.7s. Estimated remaining: 2h 25m 5s. Rate: 7.8 symbols/min [2025-10-27T19:39:50.124899] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:39:50.145459] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:39:50.147403] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:39:50.166131] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:39:50.203362] [DEBUG] [LOCAL ] LCII: Loaded 27122 existing records from primary storage. [2025-10-27T19:39:50.226736] [INFO ] [MAIN ] LCII: Loaded 27122 existing records. [2025-10-27T19:39:50.324024] [DEBUG] [LOCAL ] LC: Loaded 49022 existing records from primary storage. [2025-10-27T19:39:50.309221] [DEBUG] [LOCAL ] LDI: Loaded 45883 existing records from primary storage. [2025-10-27T19:39:50.370514] [INFO ] [MAIN ] LC: Loaded 49022 existing records. [2025-10-27T19:39:50.370343] [INFO ] [MAIN ] LDI: Loaded 45883 existing records. [2025-10-27T19:39:50.380197] [DEBUG] [LOCAL ] LBRT: Loaded 53783 existing records from primary storage. [2025-10-27T19:39:50.533782] [INFO ] [MAIN ] LBRT: Loaded 53783 existing records. [2025-10-27T19:39:50.728822] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:39:50.784876] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-27T19:39:50.822891] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-27T19:39:50.905553] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-27T19:39:50.914623] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:39:50.939443] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-27T19:39:50.905817] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-27T19:39:50.939694] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-27T19:39:50.966170] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:39:50.988407] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-27T19:39:51.011767] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-27T19:39:51.002336] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-27T19:39:51.098454] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-27T19:39:51.178456] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-27T19:39:51.220677] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:39:51.264044] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-27T19:39:51.280193] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-27T19:39:51.387887] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-27T19:39:51.478368] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-27T19:39:51.537916] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-27T19:39:52.229355] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:39:52.260162] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:39:52.260469] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-27T19:39:52.285902] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-27T19:39:52.469293] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:39:52.471887] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-27T19:39:52.549751] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:39:52.549995] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-27T19:39:53.407812] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T19:39:53.412576] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-27T19:39:53.866539] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T19:39:53.873878] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-27T19:39:53.906462] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T19:39:53.916948] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-27T19:39:54.598136] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-27T19:39:54.608335] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-27T19:39:54.633359] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T19:39:54.638848] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-27T19:39:54.677836] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T19:39:54.685065] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-27T19:39:55.573896] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T19:39:55.581182] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-27T19:39:55.641211] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-27T19:39:55.655963] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-27T19:39:55.762549] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T19:39:55.772336] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-27T19:39:56.158201] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T19:39:56.167218] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-27T19:39:57.086249] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T19:39:57.097418] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-27T19:39:57.139303] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T19:39:57.214918] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-27T19:39:57.265303] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T19:39:57.590629] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-27T19:39:58.014964] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-27T19:39:58.147139] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-27T19:39:58.500094] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T19:39:58.814917] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-27T19:39:59.490865] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-27T19:39:59.614899] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-27T19:40:00.095551] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-27T19:40:00.414959] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-27T19:40:01.214985] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-27T19:40:01.570796] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-27T19:40:02.014990] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-27T19:40:02.749473] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-27T19:40:02.814955] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-27T19:40:03.615022] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-27T19:40:04.291972] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (3.08 seconds). [2025-10-27T19:40:04.414970] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-27T19:40:04.762502] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-27T19:40:05.065076] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-27T19:40:05.136278] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T19:40:05.214965] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-27T19:40:06.014908] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-27T19:40:06.070596] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T19:40:06.371179] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T19:40:06.814936] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-27T19:40:07.614940] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-27T19:40:07.993346] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-27T19:40:08.253137] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-27T19:40:08.279506] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T19:40:08.414932] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-27T19:40:09.214945] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-27T19:40:09.703917] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T19:40:10.015000] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-27T19:40:10.814928] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-27T19:40:11.614952] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-27T19:40:11.893792] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T19:40:12.228760] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (3.01 seconds). [2025-10-27T19:40:12.233291] [INFO ] [REMOTE ] LCII: Full fetch complete (39063 records). [2025-10-27T19:40:12.233384] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-27T19:40:12.424675] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-27T19:40:12.516734] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-27T19:40:12.674711] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-27T19:40:12.674804] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-27T19:40:12.675496] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-27T19:40:12.675537] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-27T19:40:12.676524] [DEBUG] [LOCAL ] LCII: Trimmed 39063 records to 26354 (keeping 200 days of data) [2025-10-27T19:40:12.836224] [DEBUG] [LOCAL ] LCII: Primary data saved (26354 records). [2025-10-27T19:40:12.836416] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-27T19:40:12.836593] [INFO ] [MAIN ] Update Progress: 1241/2366 symbols completed. LCII took 23.4s. Estimated remaining: 2h 25m 12s. Rate: 7.7 symbols/min [2025-10-27T19:40:13.011462] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:40:13.039377] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T19:40:13.085433] [DEBUG] [LOCAL ] LDOS: Loaded 45191 existing records from primary storage. [2025-10-27T19:40:13.085768] [INFO ] [MAIN ] LDOS: Loaded 45191 existing records. [2025-10-27T19:40:13.221432] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-27T19:40:13.268237] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:40:13.268445] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-27T19:40:13.268493] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-27T19:40:13.268711] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-27T19:40:13.268769] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-27T19:40:13.616255] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:40:14.015028] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-27T19:40:14.109416] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T19:40:14.119991] [INFO ] [REMOTE ] LBRT: Full fetch complete (76929 records). [2025-10-27T19:40:14.120168] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-27T19:40:14.512353] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-27T19:40:14.512491] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-27T19:40:14.513660] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-27T19:40:14.513769] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-27T19:40:14.540301] [DEBUG] [LOCAL ] LBRT: Trimmed 76929 records to 53003 (keeping 200 days of data) [2025-10-27T19:40:14.541829] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T19:40:14.825204] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-27T19:40:14.871790] [DEBUG] [LOCAL ] LBRT: Primary data saved (53003 records). [2025-10-27T19:40:14.871894] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-27T19:40:14.871968] [INFO ] [MAIN ] Update Progress: 1242/2366 symbols completed. LBRT took 25.4s. Estimated remaining: 2h 24m 59s. Rate: 7.8 symbols/min [2025-10-27T19:40:15.040264] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:40:15.054335] [DEBUG] [LOCAL ] LDP: Loaded 12611 existing records from primary storage. [2025-10-27T19:40:15.054719] [INFO ] [MAIN ] LDP: Loaded 12611 existing records. [2025-10-27T19:40:15.229857] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:40:15.230189] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-27T19:40:15.230249] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-27T19:40:15.230416] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-27T19:40:15.230471] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-27T19:40:15.351745] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T19:40:15.606457] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:40:15.614904] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-27T19:40:16.252002] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T19:40:16.261509] [INFO ] [REMOTE ] LC: Full fetch complete (70736 records). [2025-10-27T19:40:16.261619] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-27T19:40:16.418377] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-27T19:40:16.654058] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-27T19:40:16.654225] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-27T19:40:16.655193] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-27T19:40:16.655281] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-27T19:40:16.656872] [DEBUG] [LOCAL ] LC: Trimmed 70736 records to 48250 (keeping 200 days of data) [2025-10-27T19:40:16.781955] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T19:40:16.977131] [DEBUG] [LOCAL ] LC: Primary data saved (48250 records). [2025-10-27T19:40:16.977264] [INFO ] [MAIN ] LC: Full history saved. [2025-10-27T19:40:16.977810] [INFO ] [MAIN ] Update Progress: 1243/2366 symbols completed. LC took 27.5s. Estimated remaining: 2h 24m 46s. Rate: 7.8 symbols/min [2025-10-27T19:40:17.143672] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:40:17.185357] [DEBUG] [LOCAL ] LEA: Loaded 41626 existing records from primary storage. [2025-10-27T19:40:17.185627] [INFO ] [MAIN ] LEA: Loaded 41626 existing records. [2025-10-27T19:40:17.220271] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-27T19:40:17.362210] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:40:17.362384] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-27T19:40:17.362428] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-27T19:40:17.362598] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-27T19:40:17.362634] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-27T19:40:17.715894] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:40:17.742967] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-27T19:40:17.778579] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-27T19:40:18.014976] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-27T19:40:18.814972] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-27T19:40:19.615086] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-27T19:40:19.648563] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-27T19:40:20.133993] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-27T19:40:20.414974] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-27T19:40:21.093728] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-27T19:40:21.214948] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-27T19:40:21.789911] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-27T19:40:22.015000] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-27T19:40:22.815047] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-27T19:40:23.016108] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-27T19:40:23.026003] [INFO ] [REMOTE ] LDI: Full fetch complete (62457 records). [2025-10-27T19:40:23.026112] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-27T19:40:23.424348] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-27T19:40:23.424528] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-27T19:40:23.425728] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-27T19:40:23.430350] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-27T19:40:23.430762] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-27T19:40:23.440965] [DEBUG] [LOCAL ] LDI: Trimmed 62457 records to 45259 (keeping 200 days of data) [2025-10-27T19:40:23.458288] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T19:40:23.621207] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-27T19:40:23.718670] [DEBUG] [LOCAL ] LDI: Primary data saved (45259 records). [2025-10-27T19:40:23.718804] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-27T19:40:23.719618] [INFO ] [MAIN ] Update Progress: 1244/2366 symbols completed. LDI took 34.2s. Estimated remaining: 2h 24m 37s. Rate: 7.8 symbols/min [2025-10-27T19:40:23.889790] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:40:23.937697] [DEBUG] [LOCAL ] LEG: Loaded 50679 existing records from primary storage. [2025-10-27T19:40:23.937987] [INFO ] [MAIN ] LEG: Loaded 50679 existing records. [2025-10-27T19:40:24.119559] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:40:24.119916] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-27T19:40:24.119974] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-27T19:40:24.120555] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-27T19:40:24.120612] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-27T19:40:24.420130] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-27T19:40:24.470989] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:40:25.215556] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-27T19:40:25.218603] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T19:40:25.332885] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T19:40:26.014959] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-27T19:40:26.815030] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-27T19:40:26.892393] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T19:40:27.131149] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-27T19:40:27.614956] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-27T19:40:28.414988] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-27T19:40:28.629106] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-27T19:40:29.138296] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T19:40:29.214974] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-27T19:40:29.533276] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T19:40:30.015002] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-27T19:40:30.481976] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-27T19:40:30.778288] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-27T19:40:30.815040] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-27T19:40:31.615037] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-27T19:40:31.815687] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-27T19:40:32.415002] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-27T19:40:32.930682] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T19:40:33.214978] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-27T19:40:33.976490] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T19:40:34.014897] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-27T19:40:34.424367] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T19:40:34.814943] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-27T19:40:35.527129] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-27T19:40:35.622856] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-27T19:40:35.639268] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-27T19:40:36.417985] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-27T19:40:36.421224] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-27T19:40:37.214939] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-27T19:40:37.659579] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-27T19:40:38.014919] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-27T19:40:38.622450] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T19:40:38.814966] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-27T19:40:39.236006] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T19:40:39.614950] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-27T19:40:40.389030] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-27T19:40:40.414906] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-27T19:40:40.590282] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T19:40:41.214930] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-27T19:40:41.947687] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-27T19:40:42.014908] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-27T19:40:42.295013] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T19:40:42.814946] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-27T19:40:43.105555] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T19:40:43.614923] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-27T19:40:43.647938] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-27T19:40:43.650576] [INFO ] [REMOTE ] LDP: Full fetch complete (18707 records). [2025-10-27T19:40:43.650711] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-27T19:40:44.010485] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-27T19:40:44.010559] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-27T19:40:44.010993] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-27T19:40:44.011055] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-27T19:40:44.011592] [DEBUG] [LOCAL ] LDP: Trimmed 18707 records to 12250 (keeping 200 days of data) [2025-10-27T19:40:44.083293] [DEBUG] [LOCAL ] LDP: Primary data saved (12250 records). [2025-10-27T19:40:44.083416] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-27T19:40:44.083496] [INFO ] [MAIN ] Update Progress: 1245/2366 symbols completed. LDP took 29.2s. Estimated remaining: 2h 24m 41s. Rate: 7.7 symbols/min [2025-10-27T19:40:44.244728] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:40:44.295091] [DEBUG] [LOCAL ] LEN: Loaded 53974 existing records from primary storage. [2025-10-27T19:40:44.295385] [INFO ] [MAIN ] LEN: Loaded 53974 existing records. [2025-10-27T19:40:44.420124] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-27T19:40:44.473302] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:40:44.473494] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-27T19:40:44.473541] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-27T19:40:44.473763] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-27T19:40:44.473819] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-27T19:40:44.817544] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:40:45.196221] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T19:40:45.203622] [INFO ] [REMOTE ] LEA: Full fetch complete (60376 records). [2025-10-27T19:40:45.203784] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-27T19:40:45.224576] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-27T19:40:45.636122] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-27T19:40:45.636336] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-27T19:40:45.637365] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-27T19:40:45.637453] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-27T19:40:45.639232] [DEBUG] [LOCAL ] LEA: Trimmed 60376 records to 40872 (keeping 200 days of data) [2025-10-27T19:40:45.793103] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-27T19:40:45.930438] [DEBUG] [LOCAL ] LEA: Primary data saved (40872 records). [2025-10-27T19:40:45.930567] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-27T19:40:45.930663] [INFO ] [MAIN ] Update Progress: 1246/2366 symbols completed. LEA took 29.0s. Estimated remaining: 2h 24m 28s. Rate: 7.8 symbols/min [2025-10-27T19:40:46.024758] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-27T19:40:46.096090] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:40:46.113172] [DEBUG] [LOCAL ] LEO: Loaded 17046 existing records from primary storage. [2025-10-27T19:40:46.113409] [INFO ] [MAIN ] LEO: Loaded 17046 existing records. [2025-10-27T19:40:46.285803] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:40:46.286015] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-27T19:40:46.286061] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-27T19:40:46.286223] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-27T19:40:46.286260] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-27T19:40:46.636916] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:40:46.814935] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-27T19:40:46.986438] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-27T19:40:47.315084] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-27T19:40:47.396617] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T19:40:47.614968] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-27T19:40:48.414953] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-27T19:40:48.861508] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-27T19:40:49.214935] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-27T19:40:49.876115] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T19:40:50.014946] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-27T19:40:50.801448] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-27T19:40:50.810715] [INFO ] [REMOTE ] LEG: Full fetch complete (72776 records). [2025-10-27T19:40:50.810855] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-27T19:40:50.822579] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-27T19:40:51.198800] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-27T19:40:51.198909] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-27T19:40:51.200021] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-27T19:40:51.200106] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-27T19:40:51.201711] [DEBUG] [LOCAL ] LEG: Trimmed 72776 records to 49847 (keeping 200 days of data) [2025-10-27T19:40:51.435453] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T19:40:51.539118] [DEBUG] [LOCAL ] LEG: Primary data saved (49847 records). [2025-10-27T19:40:51.539264] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-27T19:40:51.540065] [INFO ] [MAIN ] Update Progress: 1247/2366 symbols completed. LEG took 27.8s. Estimated remaining: 2h 24m 18s. Rate: 7.8 symbols/min [2025-10-27T19:40:51.620093] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-27T19:40:51.738413] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:40:51.794746] [DEBUG] [LOCAL ] LEVI: Loaded 52588 existing records from primary storage. [2025-10-27T19:40:51.795069] [INFO ] [MAIN ] LEVI: Loaded 52588 existing records. [2025-10-27T19:40:52.024316] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:40:52.024550] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-27T19:40:52.024626] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-27T19:40:52.024913] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-27T19:40:52.024982] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-27T19:40:52.176118] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T19:40:52.420255] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-27T19:40:52.592171] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:40:53.214482] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T19:40:53.225558] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-27T19:40:53.695152] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T19:40:53.704525] [INFO ] [REMOTE ] LDOS: Full fetch complete (66694 records). [2025-10-27T19:40:53.704730] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-27T19:40:54.029282] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-27T19:40:54.084268] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-27T19:40:54.084339] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-27T19:40:54.085294] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-27T19:40:54.085358] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-27T19:40:54.086613] [DEBUG] [LOCAL ] LDOS: Trimmed 66694 records to 44312 (keeping 200 days of data) [2025-10-27T19:40:54.354819] [DEBUG] [LOCAL ] LDOS: Primary data saved (44312 records). [2025-10-27T19:40:54.354935] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-27T19:40:54.355348] [INFO ] [MAIN ] Update Progress: 1248/2366 symbols completed. LDOS took 41.5s. Estimated remaining: 2h 24m 6s. Rate: 7.8 symbols/min [2025-10-27T19:40:54.527176] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:40:54.545786] [DEBUG] [LOCAL ] LFT: Loaded 18343 existing records from primary storage. [2025-10-27T19:40:54.546024] [INFO ] [MAIN ] LFT: Loaded 18343 existing records. [2025-10-27T19:40:54.727228] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:40:54.727555] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-27T19:40:54.727740] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-27T19:40:54.727981] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-27T19:40:54.728057] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-27T19:40:54.818443] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-27T19:40:54.950631] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T19:40:55.174635] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:40:55.436576] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T19:40:55.498757] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T19:40:55.614993] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-27T19:40:56.414969] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-27T19:40:56.692342] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-27T19:40:57.214947] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-27T19:40:57.362174] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-27T19:40:58.014944] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-27T19:40:58.690505] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-27T19:40:58.814925] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-27T19:40:58.856070] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T19:40:59.543089] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-27T19:40:59.614939] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-27T19:41:00.414952] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-27T19:41:00.970553] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T19:41:01.214937] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-27T19:41:02.014951] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-27T19:41:02.814998] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-27T19:41:03.017979] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-27T19:41:03.538099] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T19:41:03.614934] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-27T19:41:03.679165] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-27T19:41:04.414942] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-27T19:41:04.975330] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-27T19:41:05.214957] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-27T19:41:05.385790] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-27T19:41:06.014934] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-27T19:41:06.409047] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-27T19:41:06.629754] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T19:41:06.814916] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-27T19:41:07.126920] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-27T19:41:07.614991] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-27T19:41:08.414919] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-27T19:41:08.490728] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T19:41:08.657921] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-27T19:41:09.219918] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-27T19:41:09.222259] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T19:41:10.014949] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-27T19:41:10.202245] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T19:41:10.814961] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-27T19:41:11.614998] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-27T19:41:11.673459] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-27T19:41:11.715321] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T19:41:12.414987] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-27T19:41:12.554318] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-27T19:41:13.214949] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-27T19:41:13.817314] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T19:41:13.992584] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T19:41:14.014901] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-27T19:41:14.769590] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-27T19:41:14.772721] [INFO ] [REMOTE ] LFT: Full fetch complete (23752 records). [2025-10-27T19:41:14.772792] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-27T19:41:14.823624] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-27T19:41:15.131617] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-27T19:41:15.131755] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-27T19:41:15.132238] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-27T19:41:15.132277] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-27T19:41:15.132923] [DEBUG] [LOCAL ] LFT: Trimmed 23752 records to 18012 (keeping 200 days of data) [2025-10-27T19:41:15.232291] [DEBUG] [LOCAL ] LFT: Primary data saved (18012 records). [2025-10-27T19:41:15.232419] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-27T19:41:15.232497] [INFO ] [MAIN ] Update Progress: 1249/2366 symbols completed. LFT took 20.9s. Estimated remaining: 2h 24m 10s. Rate: 7.7 symbols/min [2025-10-27T19:41:15.397099] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:41:15.408403] [DEBUG] [LOCAL ] LGI: Loaded 10091 existing records from primary storage. [2025-10-27T19:41:15.408611] [INFO ] [MAIN ] LGI: Loaded 10091 existing records. [2025-10-27T19:41:15.582923] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:41:15.583153] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-27T19:41:15.583200] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-27T19:41:15.583351] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-27T19:41:15.583388] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-27T19:41:15.624275] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-27T19:41:15.935806] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:41:16.414988] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-27T19:41:16.426254] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-27T19:41:16.429715] [INFO ] [REMOTE ] LEO: Full fetch complete (26391 records). [2025-10-27T19:41:16.429796] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-27T19:41:16.811297] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-27T19:41:16.811392] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-27T19:41:16.811954] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-27T19:41:16.812040] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-27T19:41:16.812957] [DEBUG] [LOCAL ] LEO: Trimmed 26391 records to 16427 (keeping 200 days of data) [2025-10-27T19:41:16.909342] [DEBUG] [LOCAL ] LEO: Primary data saved (16427 records). [2025-10-27T19:41:16.909623] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-27T19:41:16.909855] [INFO ] [MAIN ] Update Progress: 1250/2366 symbols completed. LEO took 31.0s. Estimated remaining: 2h 23m 57s. Rate: 7.8 symbols/min [2025-10-27T19:41:17.037864] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-27T19:41:17.049298] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-27T19:41:17.131363] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:41:17.166176] [DEBUG] [LOCAL ] LH: Loaded 37491 existing records from primary storage. [2025-10-27T19:41:17.166443] [INFO ] [MAIN ] LH: Loaded 37491 existing records. [2025-10-27T19:41:17.214910] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-27T19:41:17.350694] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:41:17.350869] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-27T19:41:17.350918] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-27T19:41:17.351093] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-27T19:41:17.351147] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-27T19:41:17.716353] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:41:17.989177] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T19:41:18.014906] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-27T19:41:18.814916] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-27T19:41:18.823921] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T19:41:19.614997] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-27T19:41:20.414989] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-27T19:41:20.730327] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-27T19:41:20.769914] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T19:41:21.165555] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-27T19:41:21.215022] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-27T19:41:21.683886] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-27T19:41:22.015011] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-27T19:41:22.815032] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-27T19:41:23.468394] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-27T19:41:23.471391] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T19:41:23.614983] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-27T19:41:24.414996] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-27T19:41:24.886517] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-27T19:41:25.214950] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-27T19:41:25.218031] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T19:41:26.014940] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-27T19:41:26.814949] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-27T19:41:27.122435] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T19:41:27.545828] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-27T19:41:27.614931] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-27T19:41:27.788998] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-27T19:41:27.799925] [INFO ] [REMOTE ] LEN: Full fetch complete (77224 records). [2025-10-27T19:41:27.800127] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-27T19:41:28.142672] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-27T19:41:28.221330] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-27T19:41:28.221414] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-27T19:41:28.222428] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-27T19:41:28.222494] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-27T19:41:28.223960] [DEBUG] [LOCAL ] LEN: Trimmed 77224 records to 53194 (keeping 200 days of data) [2025-10-27T19:41:28.433802] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-27T19:41:28.552174] [DEBUG] [LOCAL ] LEN: Primary data saved (53194 records). [2025-10-27T19:41:28.552313] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-27T19:41:28.552391] [INFO ] [MAIN ] Update Progress: 1251/2366 symbols completed. LEN took 44.5s. Estimated remaining: 2h 23m 53s. Rate: 7.7 symbols/min [2025-10-27T19:41:28.715721] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:41:28.761582] [DEBUG] [LOCAL ] LHX: Loaded 49076 existing records from primary storage. [2025-10-27T19:41:28.761965] [INFO ] [MAIN ] LHX: Loaded 49076 existing records. [2025-10-27T19:41:28.934064] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:41:28.934286] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-27T19:41:28.934333] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-27T19:41:28.934529] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-27T19:41:28.934582] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-27T19:41:29.124185] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-27T19:41:29.185492] [INFO ] [REMOTE ] LGI: Full fetch complete (14487 records). [2025-10-27T19:41:29.191194] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-27T19:41:29.220278] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-27T19:41:29.435472] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:41:29.698939] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-27T19:41:29.699040] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-27T19:41:29.699357] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-27T19:41:29.699396] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-27T19:41:29.699907] [DEBUG] [LOCAL ] LGI: Trimmed 14487 records to 9859 (keeping 200 days of data) [2025-10-27T19:41:29.757901] [DEBUG] [LOCAL ] LGI: Primary data saved (9859 records). [2025-10-27T19:41:29.758026] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-27T19:41:29.758113] [INFO ] [MAIN ] Update Progress: 1252/2366 symbols completed. LGI took 14.5s. Estimated remaining: 2h 23m 39s. Rate: 7.8 symbols/min [2025-10-27T19:41:29.924951] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:41:29.952399] [DEBUG] [LOCAL ] LII: Loaded 28260 existing records from primary storage. [2025-10-27T19:41:29.952673] [INFO ] [MAIN ] LII: Loaded 28260 existing records. [2025-10-27T19:41:30.020129] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-27T19:41:30.132523] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:41:30.132757] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-27T19:41:30.132807] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-27T19:41:30.132996] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-27T19:41:30.133051] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-27T19:41:30.486020] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:41:30.795522] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-27T19:41:30.814919] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-27T19:41:31.614930] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-27T19:41:31.699466] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T19:41:32.414911] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-27T19:41:32.606722] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-27T19:41:32.669250] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T19:41:33.214938] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-27T19:41:34.014938] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-27T19:41:34.380441] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-27T19:41:34.390604] [INFO ] [REMOTE ] LEVI: Full fetch complete (75005 records). [2025-10-27T19:41:34.390770] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-27T19:41:34.780395] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-27T19:41:34.780639] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-27T19:41:34.781921] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-27T19:41:34.782039] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-27T19:41:34.783769] [DEBUG] [LOCAL ] LEVI: Trimmed 75005 records to 51807 (keeping 200 days of data) [2025-10-27T19:41:34.843292] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-27T19:41:35.029924] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-27T19:41:35.144086] [DEBUG] [LOCAL ] LEVI: Primary data saved (51807 records). [2025-10-27T19:41:35.144221] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-27T19:41:35.144942] [INFO ] [MAIN ] Update Progress: 1253/2366 symbols completed. LEVI took 43.6s. Estimated remaining: 2h 23m 29s. Rate: 7.8 symbols/min [2025-10-27T19:41:35.313370] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:41:35.358518] [DEBUG] [LOCAL ] LION: Loaded 47662 existing records from primary storage. [2025-10-27T19:41:35.358939] [INFO ] [MAIN ] LION: Loaded 47662 existing records. [2025-10-27T19:41:35.562360] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-27T19:41:35.566036] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:41:35.575579] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-27T19:41:35.575675] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-27T19:41:35.576046] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-27T19:41:35.576112] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-27T19:41:35.620014] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-27T19:41:35.928878] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:41:36.097998] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-27T19:41:36.415049] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-27T19:41:37.214957] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-27T19:41:37.271467] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-27T19:41:37.657243] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T19:41:38.014949] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-27T19:41:38.235252] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T19:41:38.814936] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-27T19:41:39.401754] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T19:41:39.614966] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-27T19:41:39.766163] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T19:41:40.414992] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-27T19:41:41.116471] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T19:41:41.214920] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-27T19:41:42.008580] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T19:41:42.018799] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-27T19:41:42.497360] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-27T19:41:42.814931] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-27T19:41:43.231230] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T19:41:43.614993] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-27T19:41:44.146994] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T19:41:44.414949] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-27T19:41:44.504189] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-27T19:41:45.214973] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-27T19:41:45.247764] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-27T19:41:46.014993] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-27T19:41:46.217272] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-27T19:41:46.724498] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-27T19:41:46.814913] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-27T19:41:47.614921] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-27T19:41:47.812785] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-27T19:41:48.414980] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-27T19:41:48.841676] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-27T19:41:49.214934] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-27T19:41:49.248988] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-27T19:41:50.014967] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-27T19:41:50.764282] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-27T19:41:50.814953] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-27T19:41:51.615009] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-27T19:41:51.727973] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T19:41:51.734856] [INFO ] [REMOTE ] LH: Full fetch complete (54778 records). [2025-10-27T19:41:51.735004] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-27T19:41:52.117751] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-27T19:41:52.117826] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-27T19:41:52.118669] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-27T19:41:52.118730] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-27T19:41:52.119818] [DEBUG] [LOCAL ] LH: Trimmed 54778 records to 36776 (keeping 200 days of data) [2025-10-27T19:41:52.347371] [DEBUG] [LOCAL ] LH: Primary data saved (36776 records). [2025-10-27T19:41:52.347583] [INFO ] [MAIN ] LH: Full history saved. [2025-10-27T19:41:52.347710] [INFO ] [MAIN ] Update Progress: 1254/2366 symbols completed. LH took 35.4s. Estimated remaining: 2h 23m 30s. Rate: 7.7 symbols/min [2025-10-27T19:41:52.416283] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-27T19:41:52.519428] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:41:52.536863] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T19:41:52.544813] [DEBUG] [LOCAL ] LITB: Loaded 3922 existing records from primary storage. [2025-10-27T19:41:52.545303] [INFO ] [MAIN ] LITB: Loaded 3922 existing records. [2025-10-27T19:41:52.746096] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-27T19:41:52.750573] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:41:52.760536] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-27T19:41:52.760743] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-27T19:41:52.761183] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-27T19:41:52.761235] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-27T19:41:53.112053] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:41:53.214898] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-27T19:41:53.690456] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-27T19:41:53.998040] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T19:41:54.014904] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-27T19:41:54.815032] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-27T19:41:55.126465] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-27T19:41:55.495386] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T19:41:55.614916] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-27T19:41:56.414955] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-27T19:41:57.215002] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-27T19:41:57.350323] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T19:41:57.650171] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-27T19:41:57.661299] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-27T19:41:58.014991] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-27T19:41:58.814994] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-27T19:41:59.276706] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-27T19:41:59.552735] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-27T19:41:59.614919] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-27T19:42:00.414996] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-27T19:42:01.215042] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-27T19:42:02.014957] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-27T19:42:03.302739] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-27T19:42:03.304109] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-27T19:42:03.643028] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (3.23 seconds). [2025-10-27T19:42:03.654794] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-27T19:42:03.740490] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (4.13 seconds). [2025-10-27T19:42:03.866986] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T19:42:04.139455] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (2.92 seconds). [2025-10-27T19:42:04.145363] [INFO ] [REMOTE ] LII: Full fetch complete (41936 records). [2025-10-27T19:42:04.145486] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-27T19:42:04.420143] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-27T19:42:04.508020] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-27T19:42:04.508092] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-27T19:42:04.508809] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-27T19:42:04.508870] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-27T19:42:04.509737] [DEBUG] [LOCAL ] LII: Trimmed 41936 records to 27586 (keeping 200 days of data) [2025-10-27T19:42:04.674947] [DEBUG] [LOCAL ] LII: Primary data saved (27586 records). [2025-10-27T19:42:04.675069] [INFO ] [MAIN ] LII: Full history saved. [2025-10-27T19:42:04.675143] [INFO ] [MAIN ] Update Progress: 1255/2366 symbols completed. LII took 34.9s. Estimated remaining: 2h 23m 26s. Rate: 7.7 symbols/min [2025-10-27T19:42:04.842153] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:42:04.892429] [DEBUG] [LOCAL ] LLY: Loaded 53960 existing records from primary storage. [2025-10-27T19:42:04.892789] [INFO ] [MAIN ] LLY: Loaded 53960 existing records. [2025-10-27T19:42:05.063571] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:42:05.063785] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-27T19:42:05.063831] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-27T19:42:05.064032] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-27T19:42:05.064086] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-27T19:42:05.215718] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-27T19:42:05.409208] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:42:06.014971] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-27T19:42:06.266712] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-27T19:42:06.814972] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-27T19:42:06.923384] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (3.27 seconds). [2025-10-27T19:42:07.009269] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-27T19:42:07.022927] [INFO ] [REMOTE ] LHX: Full fetch complete (70683 records). [2025-10-27T19:42:07.023166] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-27T19:42:07.131972] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-27T19:42:07.407480] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-27T19:42:07.407565] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-27T19:42:07.408600] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-27T19:42:07.408690] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-27T19:42:07.410062] [DEBUG] [LOCAL ] LHX: Trimmed 70683 records to 48276 (keeping 200 days of data) [2025-10-27T19:42:07.620425] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-27T19:42:07.707896] [DEBUG] [LOCAL ] LHX: Primary data saved (48276 records). [2025-10-27T19:42:07.708030] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-27T19:42:07.708109] [INFO ] [MAIN ] Update Progress: 1256/2366 symbols completed. LHX took 39.2s. Estimated remaining: 2h 23m 14s. Rate: 7.7 symbols/min [2025-10-27T19:42:07.884136] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:42:07.934166] [DEBUG] [LOCAL ] LMND: Loaded 52880 existing records from primary storage. [2025-10-27T19:42:07.934489] [INFO ] [MAIN ] LMND: Loaded 52880 existing records. [2025-10-27T19:42:08.143677] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-27T19:42:08.147706] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:42:08.148020] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-27T19:42:08.159880] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-27T19:42:08.160129] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-27T19:42:08.160186] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-27T19:42:08.423159] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-27T19:42:08.511407] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:42:09.079908] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T19:42:09.214986] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-27T19:42:09.317481] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T19:42:09.327247] [INFO ] [REMOTE ] LION: Full fetch complete (58494 records). [2025-10-27T19:42:09.327402] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-27T19:42:09.702376] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-27T19:42:09.702449] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-27T19:42:09.703314] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-27T19:42:09.703374] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-27T19:42:09.704482] [DEBUG] [LOCAL ] LION: Trimmed 58494 records to 47270 (keeping 200 days of data) [2025-10-27T19:42:09.964301] [DEBUG] [LOCAL ] LION: Primary data saved (47270 records). [2025-10-27T19:42:09.964502] [INFO ] [MAIN ] LION: Full history saved. [2025-10-27T19:42:09.965217] [INFO ] [MAIN ] Update Progress: 1257/2366 symbols completed. LION took 34.8s. Estimated remaining: 2h 23m 2s. Rate: 7.8 symbols/min [2025-10-27T19:42:10.027166] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-27T19:42:10.132567] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:42:10.180977] [DEBUG] [LOCAL ] LMT: Loaded 50333 existing records from primary storage. [2025-10-27T19:42:10.181297] [INFO ] [MAIN ] LMT: Loaded 50333 existing records. [2025-10-27T19:42:10.352868] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:42:10.353075] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-27T19:42:10.353121] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-27T19:42:10.353362] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-27T19:42:10.353418] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-27T19:42:10.692909] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:42:10.814902] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-27T19:42:11.224293] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-27T19:42:11.614966] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-27T19:42:11.793904] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-27T19:42:12.414949] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-27T19:42:12.513485] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T19:42:13.135106] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T19:42:13.214918] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-27T19:42:14.015004] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-27T19:42:14.423620] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-27T19:42:14.814936] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-27T19:42:15.004125] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-27T19:42:15.456049] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-27T19:42:15.457453] [INFO ] [REMOTE ] LITB: Full fetch complete (5810 records). [2025-10-27T19:42:15.457521] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-27T19:42:15.627998] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-27T19:42:15.815769] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-27T19:42:15.815843] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-27T19:42:15.816013] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-27T19:42:15.816052] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-27T19:42:15.816417] [DEBUG] [LOCAL ] LITB: Trimmed 5810 records to 3695 (keeping 200 days of data) [2025-10-27T19:42:15.837670] [DEBUG] [LOCAL ] LITB: Primary data saved (3695 records). [2025-10-27T19:42:15.837774] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-27T19:42:15.837895] [INFO ] [MAIN ] Update Progress: 1258/2366 symbols completed. LITB took 23.5s. Estimated remaining: 2h 22m 52s. Rate: 7.8 symbols/min [2025-10-27T19:42:16.011452] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:42:16.059189] [DEBUG] [LOCAL ] LNC: Loaded 52139 existing records from primary storage. [2025-10-27T19:42:16.059520] [INFO ] [MAIN ] LNC: Loaded 52139 existing records. [2025-10-27T19:42:16.258528] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:42:16.258858] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-27T19:42:16.258966] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-27T19:42:16.259221] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-27T19:42:16.259271] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-27T19:42:16.445955] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-27T19:42:16.561305] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-10-27T19:42:16.671809] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:42:17.215007] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-27T19:42:17.622009] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-27T19:42:18.014990] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-27T19:42:18.225884] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-27T19:42:18.814961] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-27T19:42:19.114901] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-27T19:42:19.614951] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-27T19:42:20.191388] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T19:42:20.412807] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-27T19:42:20.417428] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-27T19:42:21.214932] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-27T19:42:22.014978] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-27T19:42:22.752274] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (3.14 seconds). [2025-10-27T19:42:22.814907] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-27T19:42:23.529969] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T19:42:23.614949] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-27T19:42:24.106027] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (3.69 seconds). [2025-10-27T19:42:24.414970] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-27T19:42:24.618727] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-27T19:42:25.129034] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T19:42:25.214918] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-27T19:42:25.321014] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (4.11 seconds). [2025-10-27T19:42:26.014908] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-27T19:42:26.216280] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T19:42:26.814934] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-27T19:42:27.162786] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-27T19:42:27.468848] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T19:42:27.614941] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-27T19:42:28.414996] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-27T19:42:28.761314] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-27T19:42:29.214914] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-27T19:42:29.774578] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-27T19:42:30.014993] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-27T19:42:30.135898] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-27T19:42:30.814959] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-27T19:42:31.592088] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-27T19:42:31.614956] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-27T19:42:32.020106] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-27T19:42:32.414947] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-27T19:42:32.519291] [DEBUG] [REMOTE ] LMND: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-27T19:42:32.519500] [WARN ] [REMOTE ] LMND: No data returned for month 2025-10 [2025-10-27T19:42:32.519588] [FATAL] [REMOTE ] LMND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:42:32.519705] [FATAL] [MAIN ] LMND: Failed to fetch primary data. [2025-10-27T19:42:32.519776] [WARN ] [MAIN ] LMND: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:42:32.519862] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-27T19:42:32.519963] [DEBUG] [LOCAL ] LMND: No primary data file found to delete. [2025-10-27T19:42:32.520042] [INFO ] [LOCAL ] LMND: Starting deletion of derivative data. [2025-10-27T19:42:32.521096] [DEBUG] [LOCAL ] LMND: Deleted derivative data file. [2025-10-27T19:42:32.521208] [INFO ] [MAIN ] Update Progress: 1259/2366 symbols completed. LMND took 24.8s. Estimated remaining: 2h 22m 52s. Rate: 7.7 symbols/min [2025-10-27T19:42:32.700009] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:42:32.707226] [DEBUG] [LOCAL ] LND: Loaded 5066 existing records from primary storage. [2025-10-27T19:42:32.707453] [INFO ] [MAIN ] LND: Loaded 5066 existing records. [2025-10-27T19:42:32.891868] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:42:32.892376] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-27T19:42:32.892578] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-27T19:42:32.892882] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-27T19:42:32.892934] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-27T19:42:33.221351] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-27T19:42:33.217944] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-27T19:42:33.345967] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:42:33.995884] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-27T19:42:34.014908] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-27T19:42:34.653200] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-27T19:42:34.663364] [INFO ] [REMOTE ] LLY: Full fetch complete (77192 records). [2025-10-27T19:42:34.663514] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-27T19:42:34.824202] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-27T19:42:35.083291] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-27T19:42:35.083508] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-27T19:42:35.084784] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-27T19:42:35.084854] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-27T19:42:35.086928] [DEBUG] [LOCAL ] LLY: Trimmed 77192 records to 53169 (keeping 200 days of data) [2025-10-27T19:42:35.220625] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-27T19:42:35.386244] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-27T19:42:35.511205] [DEBUG] [LOCAL ] LLY: Primary data saved (53169 records). [2025-10-27T19:42:35.511411] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-27T19:42:35.512113] [INFO ] [MAIN ] Update Progress: 1260/2366 symbols completed. LLY took 30.8s. Estimated remaining: 2h 22m 41s. Rate: 7.8 symbols/min [2025-10-27T19:42:35.621501] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-27T19:42:35.703969] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:42:35.763357] [DEBUG] [LOCAL ] LNG: Loaded 51798 existing records from primary storage. [2025-10-27T19:42:35.763908] [INFO ] [MAIN ] LNG: Loaded 51798 existing records. [2025-10-27T19:42:35.956315] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:42:35.956623] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-27T19:42:35.956732] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-27T19:42:35.956995] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-27T19:42:35.957039] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-27T19:42:36.279287] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-27T19:42:36.369463] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:42:36.414930] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-27T19:42:36.826063] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-27T19:42:37.214983] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-27T19:42:38.014997] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-27T19:42:38.551247] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-27T19:42:38.814922] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-27T19:42:39.279925] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-27T19:42:39.389531] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T19:42:39.614930] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-27T19:42:40.415007] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-27T19:42:40.800450] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T19:42:41.214942] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-27T19:42:41.961855] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-27T19:42:42.014894] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-27T19:42:42.374328] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-27T19:42:42.705903] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-27T19:42:42.815031] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-27T19:42:43.614958] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-27T19:42:44.414920] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-27T19:42:44.448737] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T19:42:45.214991] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-27T19:42:45.656752] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-27T19:42:45.691630] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-27T19:42:45.701108] [INFO ] [REMOTE ] LMT: Full fetch complete (72566 records). [2025-10-27T19:42:45.701232] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-27T19:42:46.023373] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-27T19:42:46.079312] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-27T19:42:46.079387] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-27T19:42:46.080363] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-27T19:42:46.080426] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-27T19:42:46.081830] [DEBUG] [LOCAL ] LMT: Trimmed 72566 records to 49543 (keeping 200 days of data) [2025-10-27T19:42:46.392974] [DEBUG] [LOCAL ] LMT: Primary data saved (49543 records). [2025-10-27T19:42:46.393116] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-27T19:42:46.393811] [INFO ] [MAIN ] Update Progress: 1261/2366 symbols completed. LMT took 36.4s. Estimated remaining: 2h 22m 36s. Rate: 7.7 symbols/min [2025-10-27T19:42:46.569635] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:42:46.584684] [DEBUG] [LOCAL ] LNN: Loaded 11861 existing records from primary storage. [2025-10-27T19:42:46.584934] [INFO ] [MAIN ] LNN: Loaded 11861 existing records. [2025-10-27T19:42:46.686879] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-27T19:42:46.767558] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:42:46.767815] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-27T19:42:46.767878] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-27T19:42:46.768174] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-27T19:42:46.768231] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-27T19:42:46.820088] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-27T19:42:47.123748] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:42:47.158158] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-27T19:42:47.614971] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-27T19:42:47.955770] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-27T19:42:48.420717] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-27T19:42:48.436481] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T19:42:48.964992] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-27T19:42:49.214948] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-27T19:42:50.015027] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-27T19:42:50.814931] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-27T19:42:51.046586] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-27T19:42:51.330240] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T19:42:51.332585] [INFO ] [REMOTE ] LND: Full fetch complete (7821 records). [2025-10-27T19:42:51.332693] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-27T19:42:51.617958] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-27T19:42:51.701564] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-27T19:42:51.701683] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-27T19:42:51.702013] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-27T19:42:51.702189] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-27T19:42:51.721712] [DEBUG] [LOCAL ] LND: Trimmed 7821 records to 4869 (keeping 200 days of data) [2025-10-27T19:42:51.744860] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T19:42:51.773170] [DEBUG] [LOCAL ] LND: Primary data saved (4869 records). [2025-10-27T19:42:51.773285] [INFO ] [MAIN ] LND: Full history saved. [2025-10-27T19:42:51.773374] [INFO ] [MAIN ] Update Progress: 1262/2366 symbols completed. LND took 19.3s. Estimated remaining: 2h 22m 26s. Rate: 7.8 symbols/min [2025-10-27T19:42:51.936038] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:42:51.974705] [DEBUG] [LOCAL ] LOAR: Loaded 42569 existing records from primary storage. [2025-10-27T19:42:51.974990] [INFO ] [MAIN ] LOAR: Loaded 42569 existing records. [2025-10-27T19:42:52.162996] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:42:52.164262] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-27T19:42:52.164745] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-27T19:42:52.167155] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-27T19:42:52.168486] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-27T19:42:52.168553] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-27T19:42:52.420156] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-27T19:42:52.523111] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:42:53.214963] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-27T19:42:53.649356] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-27T19:42:54.014943] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-27T19:42:54.445370] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T19:42:54.814997] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-27T19:42:55.620101] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-27T19:42:55.635418] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-27T19:42:55.812067] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-27T19:42:56.414943] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-27T19:42:57.113140] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-27T19:42:57.122687] [INFO ] [REMOTE ] LNC: Full fetch complete (74523 records). [2025-10-27T19:42:57.122823] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-27T19:42:57.220069] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-27T19:42:57.253186] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-27T19:42:57.526080] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-27T19:42:57.526165] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-27T19:42:57.527179] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-27T19:42:57.527241] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-27T19:42:57.528534] [DEBUG] [LOCAL ] LNC: Trimmed 74523 records to 51328 (keeping 200 days of data) [2025-10-27T19:42:57.828045] [DEBUG] [LOCAL ] LNC: Primary data saved (51328 records). [2025-10-27T19:42:57.828167] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-27T19:42:57.828243] [INFO ] [MAIN ] Update Progress: 1263/2366 symbols completed. LNC took 42.0s. Estimated remaining: 2h 22m 17s. Rate: 7.8 symbols/min [2025-10-27T19:42:57.994368] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:42:58.020102] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-27T19:42:58.022460] [DEBUG] [LOCAL ] LOB: Loaded 27102 existing records from primary storage. [2025-10-27T19:42:58.022758] [INFO ] [MAIN ] LOB: Loaded 27102 existing records. [2025-10-27T19:42:58.200934] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:42:58.201149] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-27T19:42:58.201201] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-27T19:42:58.201390] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-27T19:42:58.201445] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-27T19:42:58.544418] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:42:58.676525] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-27T19:42:58.814911] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-27T19:42:59.011306] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T19:42:59.539342] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-27T19:42:59.614904] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-27T19:43:00.414934] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-27T19:43:01.214997] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-27T19:43:01.901917] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-27T19:43:01.952254] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T19:43:02.014950] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-27T19:43:02.639526] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T19:43:02.814943] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-27T19:43:03.614972] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-27T19:43:04.414922] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-27T19:43:04.465898] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (3.25 seconds). [2025-10-27T19:43:05.069480] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-27T19:43:05.090434] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-27T19:43:05.214918] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-27T19:43:05.525239] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-27T19:43:06.014957] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-27T19:43:06.151098] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-27T19:43:06.603038] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-27T19:43:06.814962] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-27T19:43:07.614944] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-27T19:43:07.960424] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T19:43:08.414975] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-27T19:43:09.126579] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-27T19:43:09.214911] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-27T19:43:09.409596] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-27T19:43:10.014949] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-27T19:43:10.668286] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-27T19:43:10.683404] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-27T19:43:10.814928] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-27T19:43:11.614923] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-27T19:43:12.420969] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-27T19:43:12.446527] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-27T19:43:12.447381] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T19:43:13.214983] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-27T19:43:13.928793] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-27T19:43:13.939176] [INFO ] [REMOTE ] LNG: Full fetch complete (74664 records). [2025-10-27T19:43:13.939384] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-27T19:43:14.020158] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-27T19:43:14.358706] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-27T19:43:14.358843] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-27T19:43:14.360331] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-27T19:43:14.360485] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-27T19:43:14.362732] [DEBUG] [LOCAL ] LNG: Trimmed 74664 records to 50980 (keeping 200 days of data) [2025-10-27T19:43:14.634745] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T19:43:14.748522] [DEBUG] [LOCAL ] LNG: Primary data saved (50980 records). [2025-10-27T19:43:14.748777] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-27T19:43:14.749307] [INFO ] [MAIN ] Update Progress: 1264/2366 symbols completed. LNG took 39.2s. Estimated remaining: 2h 22m 17s. Rate: 7.7 symbols/min [2025-10-27T19:43:14.820141] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-27T19:43:14.929419] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:43:14.935583] [DEBUG] [LOCAL ] LOCL: Loaded 3535 existing records from primary storage. [2025-10-27T19:43:14.935973] [INFO ] [MAIN ] LOCL: Loaded 3535 existing records. [2025-10-27T19:43:15.126556] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:43:15.126884] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-27T19:43:15.126947] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-27T19:43:15.127068] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-27T19:43:15.127120] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-27T19:43:15.320387] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T19:43:15.517142] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:43:15.527960] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-27T19:43:15.531170] [INFO ] [REMOTE ] LNN: Full fetch complete (16303 records). [2025-10-27T19:43:15.531242] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-27T19:43:15.620161] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-27T19:43:15.890199] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-27T19:43:15.890273] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-27T19:43:15.890620] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-27T19:43:15.890689] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-27T19:43:15.891185] [DEBUG] [LOCAL ] LNN: Trimmed 16303 records to 11526 (keeping 200 days of data) [2025-10-27T19:43:15.962084] [DEBUG] [LOCAL ] LNN: Primary data saved (11526 records). [2025-10-27T19:43:15.962202] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-27T19:43:15.962276] [INFO ] [MAIN ] Update Progress: 1265/2366 symbols completed. LNN took 29.6s. Estimated remaining: 2h 22m 3s. Rate: 7.8 symbols/min [2025-10-27T19:43:16.137692] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:43:16.176877] [DEBUG] [LOCAL ] LOMA: Loaded 33310 existing records from primary storage. [2025-10-27T19:43:16.177274] [INFO ] [MAIN ] LOMA: Loaded 33310 existing records. [2025-10-27T19:43:16.357096] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:43:16.357390] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-27T19:43:16.357445] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-27T19:43:16.357719] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-27T19:43:16.357779] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-27T19:43:16.422901] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-27T19:43:16.738030] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:43:16.853688] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T19:43:17.214955] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-27T19:43:17.624987] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T19:43:18.014953] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-27T19:43:18.141845] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T19:43:18.815000] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-27T19:43:19.368985] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T19:43:19.608669] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T19:43:19.615223] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-27T19:43:20.415011] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-27T19:43:21.006832] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-27T19:43:21.038941] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T19:43:21.214918] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-27T19:43:22.015000] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-27T19:43:22.625391] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T19:43:22.814988] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-27T19:43:22.943749] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-27T19:43:23.614956] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-27T19:43:23.923170] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-27T19:43:23.930317] [INFO ] [REMOTE ] LOAR: Full fetch complete (56041 records). [2025-10-27T19:43:23.930430] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-27T19:43:24.304811] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-27T19:43:24.304887] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-27T19:43:24.305737] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-27T19:43:24.305797] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-27T19:43:24.306952] [DEBUG] [LOCAL ] LOAR: Trimmed 56041 records to 41789 (keeping 200 days of data) [2025-10-27T19:43:24.424018] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-27T19:43:24.551911] [DEBUG] [LOCAL ] LOAR: Primary data saved (41789 records). [2025-10-27T19:43:24.552205] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-27T19:43:24.552313] [INFO ] [MAIN ] Update Progress: 1266/2366 symbols completed. LOAR took 32.8s. Estimated remaining: 2h 21m 56s. Rate: 7.7 symbols/min [2025-10-27T19:43:24.745203] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:43:24.747351] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-27T19:43:24.801138] [DEBUG] [LOCAL ] LOW: Loaded 53735 existing records from primary storage. [2025-10-27T19:43:24.801454] [INFO ] [MAIN ] LOW: Loaded 53735 existing records. [2025-10-27T19:43:24.984340] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:43:24.984570] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-27T19:43:24.984619] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-27T19:43:24.984869] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-27T19:43:24.984925] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-27T19:43:25.225531] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-27T19:43:25.341819] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:43:25.590424] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-27T19:43:25.730823] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T19:43:25.736415] [INFO ] [REMOTE ] LOB: Full fetch complete (38789 records). [2025-10-27T19:43:25.736568] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-27T19:43:26.023928] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-27T19:43:26.117979] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-27T19:43:26.118051] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-27T19:43:26.118785] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-27T19:43:26.118846] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-27T19:43:26.119604] [DEBUG] [LOCAL ] LOB: Trimmed 38789 records to 26452 (keeping 200 days of data) [2025-10-27T19:43:26.272446] [DEBUG] [LOCAL ] LOB: Primary data saved (26452 records). [2025-10-27T19:43:26.272570] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-27T19:43:26.272755] [INFO ] [MAIN ] Update Progress: 1267/2366 symbols completed. LOB took 28.4s. Estimated remaining: 2h 21m 43s. Rate: 7.8 symbols/min [2025-10-27T19:43:26.444007] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-27T19:43:26.447160] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:43:26.485387] [DEBUG] [LOCAL ] LPG: Loaded 39709 existing records from primary storage. [2025-10-27T19:43:26.485686] [INFO ] [MAIN ] LPG: Loaded 39709 existing records. [2025-10-27T19:43:26.669940] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:43:26.670193] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-27T19:43:26.670240] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-27T19:43:26.670454] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-27T19:43:26.670509] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-27T19:43:26.821167] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-27T19:43:27.037487] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:43:27.615003] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-27T19:43:27.791113] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T19:43:28.415014] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-27T19:43:28.702053] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-27T19:43:29.214958] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-27T19:43:29.475554] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T19:43:30.014950] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-27T19:43:30.753886] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-27T19:43:30.814900] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-27T19:43:31.123512] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-27T19:43:31.625307] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-27T19:43:31.627969] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-27T19:43:32.415020] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-27T19:43:32.878051] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-27T19:43:33.214938] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-27T19:43:33.525182] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-27T19:43:33.577788] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-27T19:43:34.014983] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-27T19:43:34.815001] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-27T19:43:35.101320] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T19:43:35.614952] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-27T19:43:36.378112] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T19:43:36.414901] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-27T19:43:37.008752] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T19:43:37.016886] [INFO ] [REMOTE ] LOMA: Full fetch complete (47985 records). [2025-10-27T19:43:37.017119] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-27T19:43:37.221234] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-27T19:43:37.425062] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-27T19:43:37.425207] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-27T19:43:37.426696] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-27T19:43:37.426841] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-27T19:43:37.428361] [DEBUG] [LOCAL ] LOMA: Trimmed 47985 records to 32945 (keeping 200 days of data) [2025-10-27T19:43:37.642771] [DEBUG] [LOCAL ] LOMA: Primary data saved (32945 records). [2025-10-27T19:43:37.643099] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-27T19:43:37.643935] [INFO ] [MAIN ] Update Progress: 1268/2366 symbols completed. LOMA took 21.7s. Estimated remaining: 2h 21m 39s. Rate: 7.8 symbols/min [2025-10-27T19:43:37.789668] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T19:43:37.789944] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-27T19:43:37.875137] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:43:37.909914] [DEBUG] [LOCAL ] LPL: Loaded 29601 existing records from primary storage. [2025-10-27T19:43:37.910303] [INFO ] [MAIN ] LPL: Loaded 29601 existing records. [2025-10-27T19:43:38.020150] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-27T19:43:38.107618] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:43:38.107930] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-27T19:43:38.107981] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-27T19:43:38.108206] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-27T19:43:38.108246] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-27T19:43:38.496208] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:43:38.814940] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-27T19:43:39.482856] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T19:43:39.614908] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-27T19:43:39.933992] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T19:43:40.414940] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-27T19:43:41.214949] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-27T19:43:41.296043] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T19:43:41.413108] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T19:43:42.014945] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-27T19:43:42.435581] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-27T19:43:42.759177] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T19:43:42.815014] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-27T19:43:43.614951] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-27T19:43:43.790164] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T19:43:44.414953] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-27T19:43:45.131025] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T19:43:45.214933] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-27T19:43:45.529924] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-27T19:43:46.015208] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-27T19:43:46.814926] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-27T19:43:46.910446] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T19:43:47.334774] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-27T19:43:47.443511] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T19:43:47.614979] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-27T19:43:48.282324] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-27T19:43:48.414930] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-27T19:43:49.214995] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-27T19:43:49.514352] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-27T19:43:49.685977] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-27T19:43:50.014944] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-27T19:43:50.414701] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-27T19:43:50.814938] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-27T19:43:51.379318] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T19:43:51.380498] [INFO ] [REMOTE ] LOCL: Full fetch complete (4534 records). [2025-10-27T19:43:51.380567] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-27T19:43:51.620198] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-27T19:43:51.730930] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-27T19:43:51.731004] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-27T19:43:51.731151] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-27T19:43:51.731190] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-27T19:43:51.731540] [DEBUG] [LOCAL ] LOCL: Trimmed 4534 records to 3246 (keeping 200 days of data) [2025-10-27T19:43:51.749625] [DEBUG] [LOCAL ] LOCL: Primary data saved (3246 records). [2025-10-27T19:43:51.749717] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-27T19:43:51.749790] [INFO ] [MAIN ] Update Progress: 1269/2366 symbols completed. LOCL took 37.0s. Estimated remaining: 2h 21m 37s. Rate: 7.7 symbols/min [2025-10-27T19:43:51.914794] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:43:51.957265] [DEBUG] [LOCAL ] LPX: Loaded 40685 existing records from primary storage. [2025-10-27T19:43:51.957580] [INFO ] [MAIN ] LPX: Loaded 40685 existing records. [2025-10-27T19:43:52.132017] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:43:52.132213] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-27T19:43:52.132264] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-27T19:43:52.132461] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-27T19:43:52.132517] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-27T19:43:52.420139] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-27T19:43:52.480905] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:43:53.089066] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-27T19:43:53.214923] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-27T19:43:53.612417] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-27T19:43:53.948113] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T19:43:54.014969] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-27T19:43:54.814929] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-27T19:43:54.857390] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-27T19:43:55.614957] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-27T19:43:56.413634] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T19:43:56.422207] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-27T19:43:57.214938] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-27T19:43:57.341974] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T19:43:57.830275] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T19:43:58.014931] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-27T19:43:58.382101] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T19:43:58.814941] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-27T19:43:59.289623] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T19:43:59.296336] [INFO ] [REMOTE ] LPG: Full fetch complete (58619 records). [2025-10-27T19:43:59.296437] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-27T19:43:59.620066] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-27T19:43:59.689264] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-27T19:43:59.689345] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-27T19:43:59.690219] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-27T19:43:59.690282] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-27T19:43:59.691410] [DEBUG] [LOCAL ] LPG: Trimmed 58619 records to 38804 (keeping 200 days of data) [2025-10-27T19:43:59.924178] [DEBUG] [LOCAL ] LPG: Primary data saved (38804 records). [2025-10-27T19:43:59.924430] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-27T19:43:59.924596] [INFO ] [MAIN ] Update Progress: 1270/2366 symbols completed. LPG took 33.7s. Estimated remaining: 2h 21m 29s. Rate: 7.7 symbols/min [2025-10-27T19:44:00.094884] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:44:00.121004] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T19:44:00.164106] [DEBUG] [LOCAL ] LRN: Loaded 39785 existing records from primary storage. [2025-10-27T19:44:00.164488] [INFO ] [MAIN ] LRN: Loaded 39785 existing records. [2025-10-27T19:44:00.344860] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:44:00.345095] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-27T19:44:00.345184] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-27T19:44:00.345373] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-27T19:44:00.345414] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-27T19:44:00.420051] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-27T19:44:00.707800] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:44:01.214970] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-27T19:44:02.014961] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-27T19:44:02.266726] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-27T19:44:02.814952] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-27T19:44:03.827109] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (3.41 seconds). [2025-10-27T19:44:03.835417] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-27T19:44:04.837275] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (3.62 seconds). [2025-10-27T19:44:04.846311] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-27T19:44:05.120962] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (3.11 seconds). [2025-10-27T19:44:05.214918] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-27T19:44:05.788165] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-27T19:44:05.942557] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T19:44:06.014915] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-27T19:44:06.256800] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (3.44 seconds). [2025-10-27T19:44:06.267332] [INFO ] [REMOTE ] LOW: Full fetch complete (76706 records). [2025-10-27T19:44:06.267472] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-27T19:44:06.657877] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-27T19:44:06.657960] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-27T19:44:06.658956] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-27T19:44:06.659017] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-27T19:44:06.660427] [DEBUG] [LOCAL ] LOW: Trimmed 76706 records to 52939 (keeping 200 days of data) [2025-10-27T19:44:06.836009] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-27T19:44:07.007674] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-27T19:44:07.027191] [DEBUG] [LOCAL ] LOW: Primary data saved (52939 records). [2025-10-27T19:44:07.027845] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-27T19:44:07.028020] [INFO ] [MAIN ] Update Progress: 1271/2366 symbols completed. LOW took 42.5s. Estimated remaining: 2h 21m 21s. Rate: 7.7 symbols/min [2025-10-27T19:44:07.210767] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:44:07.253491] [DEBUG] [LOCAL ] LSPD: Loaded 42896 existing records from primary storage. [2025-10-27T19:44:07.253816] [INFO ] [MAIN ] LSPD: Loaded 42896 existing records. [2025-10-27T19:44:07.436036] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:44:07.436318] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-27T19:44:07.436391] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-27T19:44:07.437028] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-27T19:44:07.437086] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-27T19:44:07.638231] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-27T19:44:07.708225] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T19:44:07.825043] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:44:08.269908] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-27T19:44:08.414907] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-27T19:44:08.881127] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-27T19:44:08.889108] [INFO ] [REMOTE ] LPL: Full fetch complete (38071 records). [2025-10-27T19:44:08.889199] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-27T19:44:09.220094] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-27T19:44:09.267429] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-27T19:44:09.267993] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-27T19:44:09.268753] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-27T19:44:09.268815] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-27T19:44:09.269826] [DEBUG] [LOCAL ] LPL: Trimmed 38071 records to 29165 (keeping 200 days of data) [2025-10-27T19:44:09.438058] [DEBUG] [LOCAL ] LPL: Primary data saved (29165 records). [2025-10-27T19:44:09.438175] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-27T19:44:09.438287] [INFO ] [MAIN ] Update Progress: 1272/2366 symbols completed. LPL took 31.8s. Estimated remaining: 2h 21m 9s. Rate: 7.8 symbols/min [2025-10-27T19:44:09.639171] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:44:09.636258] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T19:44:09.681002] [DEBUG] [LOCAL ] LTC: Loaded 31075 existing records from primary storage. [2025-10-27T19:44:09.681272] [INFO ] [MAIN ] LTC: Loaded 31075 existing records. [2025-10-27T19:44:09.854739] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:44:09.854955] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-27T19:44:09.855019] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-27T19:44:09.855354] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-27T19:44:09.855426] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-27T19:44:10.024045] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-27T19:44:10.209256] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:44:10.571720] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T19:44:10.814946] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-27T19:44:11.614914] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-27T19:44:11.921920] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-27T19:44:12.370859] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T19:44:12.414943] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-27T19:44:12.863719] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T19:44:13.214986] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-27T19:44:13.623097] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T19:44:14.014984] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-27T19:44:14.676576] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T19:44:14.774359] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T19:44:14.814931] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-27T19:44:15.614940] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-27T19:44:16.095231] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T19:44:16.415026] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-27T19:44:16.846684] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T19:44:17.214972] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-27T19:44:17.670360] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T19:44:18.014976] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-27T19:44:18.295926] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T19:44:18.814954] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-27T19:44:19.325421] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-27T19:44:19.614944] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-27T19:44:20.017857] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T19:44:20.414941] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-27T19:44:21.110335] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-27T19:44:21.118456] [INFO ] [REMOTE ] LPX: Full fetch complete (58635 records). [2025-10-27T19:44:21.118590] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-27T19:44:21.220422] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-27T19:44:21.509346] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-27T19:44:21.509434] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-27T19:44:21.510553] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-27T19:44:21.510632] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-27T19:44:21.512120] [DEBUG] [LOCAL ] LPX: Trimmed 58635 records to 39955 (keeping 200 days of data) [2025-10-27T19:44:21.647545] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-27T19:44:21.787936] [DEBUG] [LOCAL ] LPX: Primary data saved (39955 records). [2025-10-27T19:44:21.788084] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-27T19:44:21.788497] [INFO ] [MAIN ] Update Progress: 1273/2366 symbols completed. LPX took 30.0s. Estimated remaining: 2h 21m 5s. Rate: 7.7 symbols/min [2025-10-27T19:44:21.954600] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:44:22.005637] [DEBUG] [LOCAL ] LTH: Loaded 52315 existing records from primary storage. [2025-10-27T19:44:22.005963] [INFO ] [MAIN ] LTH: Loaded 52315 existing records. [2025-10-27T19:44:22.020191] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-27T19:44:22.184665] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:44:22.184877] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-27T19:44:22.184924] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-27T19:44:22.185209] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-27T19:44:22.185250] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-27T19:44:22.536398] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:44:22.595208] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T19:44:22.814962] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-27T19:44:23.536520] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T19:44:23.614903] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-27T19:44:24.192284] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T19:44:24.414958] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-27T19:44:24.699663] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T19:44:25.215014] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-27T19:44:25.580780] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T19:44:26.014998] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-27T19:44:26.262280] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-27T19:44:26.269577] [INFO ] [REMOTE ] LRN: Full fetch complete (58102 records). [2025-10-27T19:44:26.269780] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-27T19:44:26.721571] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-27T19:44:26.721704] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-27T19:44:26.723156] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-27T19:44:26.723227] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-27T19:44:26.724802] [DEBUG] [LOCAL ] LRN: Trimmed 58102 records to 39074 (keeping 200 days of data) [2025-10-27T19:44:26.815933] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-27T19:44:26.986445] [DEBUG] [LOCAL ] LRN: Primary data saved (39074 records). [2025-10-27T19:44:26.986700] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-27T19:44:26.986827] [INFO ] [MAIN ] Update Progress: 1274/2366 symbols completed. LRN took 27.1s. Estimated remaining: 2h 20m 55s. Rate: 7.7 symbols/min [2025-10-27T19:44:27.172009] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:44:27.216905] [DEBUG] [LOCAL ] LTM: Loaded 39877 existing records from primary storage. [2025-10-27T19:44:27.217317] [INFO ] [MAIN ] LTM: Loaded 39877 existing records. [2025-10-27T19:44:27.408522] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:44:27.409040] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-27T19:44:27.409198] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-27T19:44:27.409547] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-27T19:44:27.409609] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-27T19:44:27.623933] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-27T19:44:27.668863] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-27T19:44:27.840242] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:44:27.902760] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-27T19:44:28.415001] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-27T19:44:28.547968] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-27T19:44:29.214998] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-27T19:44:29.398612] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T19:44:30.014927] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-27T19:44:30.508286] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-27T19:44:30.815028] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-27T19:44:31.511520] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T19:44:31.614978] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-27T19:44:32.415010] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-27T19:44:32.607425] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-27T19:44:32.621077] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-27T19:44:33.215003] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-27T19:44:33.467720] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-27T19:44:34.014993] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-27T19:44:34.299607] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T19:44:34.814952] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-27T19:44:35.354939] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T19:44:35.614982] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-27T19:44:36.139204] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T19:44:36.414947] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-27T19:44:36.872993] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T19:44:37.214954] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-27T19:44:37.897570] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T19:44:38.014960] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-27T19:44:38.668475] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-27T19:44:38.675288] [INFO ] [REMOTE ] LTC: Full fetch complete (43913 records). [2025-10-27T19:44:38.675411] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-27T19:44:38.820028] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-27T19:44:39.092872] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-27T19:44:39.092960] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-27T19:44:39.093770] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-27T19:44:39.093835] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-27T19:44:39.094936] [DEBUG] [LOCAL ] LTC: Trimmed 43913 records to 30481 (keeping 200 days of data) [2025-10-27T19:44:39.285195] [DEBUG] [LOCAL ] LTC: Primary data saved (30481 records). [2025-10-27T19:44:39.285323] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-27T19:44:39.286038] [INFO ] [MAIN ] Update Progress: 1275/2366 symbols completed. LTC took 29.8s. Estimated remaining: 2h 20m 51s. Rate: 7.7 symbols/min [2025-10-27T19:44:39.454196] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:44:39.499961] [DEBUG] [LOCAL ] LU: Loaded 49888 existing records from primary storage. [2025-10-27T19:44:39.526846] [INFO ] [MAIN ] LU: Loaded 49888 existing records. [2025-10-27T19:44:39.597534] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T19:44:39.630568] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-27T19:44:39.722840] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:44:39.722996] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-27T19:44:39.723042] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-27T19:44:39.723230] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-27T19:44:39.723285] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-27T19:44:40.081425] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:44:40.099391] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T19:44:40.415002] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-27T19:44:41.214925] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-27T19:44:41.254261] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-27T19:44:41.262784] [INFO ] [REMOTE ] LSPD: Full fetch complete (62440 records). [2025-10-27T19:44:41.262942] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-27T19:44:41.649968] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-27T19:44:41.650074] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-27T19:44:41.651034] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-27T19:44:41.651112] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-27T19:44:41.652330] [DEBUG] [LOCAL ] LSPD: Trimmed 62440 records to 42066 (keeping 200 days of data) [2025-10-27T19:44:41.920975] [DEBUG] [LOCAL ] LSPD: Primary data saved (42066 records). [2025-10-27T19:44:41.921191] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-27T19:44:41.921541] [INFO ] [MAIN ] Update Progress: 1276/2366 symbols completed. LSPD took 34.9s. Estimated remaining: 2h 20m 39s. Rate: 7.7 symbols/min [2025-10-27T19:44:41.957971] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T19:44:42.019416] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-27T19:44:42.114869] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:44:42.137239] [DEBUG] [LOCAL ] LUCK: Loaded 24073 existing records from primary storage. [2025-10-27T19:44:42.137506] [INFO ] [MAIN ] LUCK: Loaded 24073 existing records. [2025-10-27T19:44:42.319223] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:44:42.319867] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-27T19:44:42.319986] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-27T19:44:42.320371] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-27T19:44:42.320441] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-27T19:44:42.513040] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-27T19:44:42.747434] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:44:42.814948] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-27T19:44:43.372680] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-27T19:44:43.614921] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-27T19:44:43.998922] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T19:44:44.414954] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-27T19:44:44.596334] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T19:44:45.214936] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-27T19:44:45.990404] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-27T19:44:46.014899] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-27T19:44:46.708325] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T19:44:46.814941] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-27T19:44:47.620073] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-27T19:44:47.641109] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T19:44:48.205716] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-27T19:44:48.414945] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-27T19:44:49.220135] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-27T19:44:49.237190] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T19:44:49.642880] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T19:44:50.014947] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-27T19:44:50.272998] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-27T19:44:50.814950] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-27T19:44:51.173203] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-27T19:44:51.615010] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-27T19:44:52.343085] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-27T19:44:52.414939] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-27T19:44:52.825707] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T19:44:53.214971] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-27T19:44:53.814635] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-27T19:44:53.824873] [INFO ] [REMOTE ] LTH: Full fetch complete (74746 records). [2025-10-27T19:44:53.825172] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-27T19:44:54.022537] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-27T19:44:54.231396] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-27T19:44:54.231484] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-27T19:44:54.232524] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-27T19:44:54.232587] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-27T19:44:54.234114] [DEBUG] [LOCAL ] LTH: Trimmed 74746 records to 51546 (keeping 200 days of data) [2025-10-27T19:44:54.533298] [DEBUG] [LOCAL ] LTH: Primary data saved (51546 records). [2025-10-27T19:44:54.533426] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-27T19:44:54.533940] [INFO ] [MAIN ] Update Progress: 1277/2366 symbols completed. LTH took 32.7s. Estimated remaining: 2h 20m 35s. Rate: 7.7 symbols/min [2025-10-27T19:44:54.620298] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T19:44:54.814905] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-27T19:44:54.840210] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T19:44:55.614943] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-27T19:44:56.378000] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T19:44:56.414982] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-27T19:44:56.789430] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T19:44:57.126273] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-27T19:44:57.214942] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-27T19:44:58.014964] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-27T19:44:58.814957] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-27T19:44:58.964799] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T19:44:58.979690] [INFO ] [REMOTE ] LTM: Full fetch complete (51764 records). [2025-10-27T19:44:58.985039] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-27T19:44:58.984704] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-27T19:44:59.364027] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-27T19:44:59.364108] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-27T19:44:59.364910] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-27T19:44:59.364971] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-27T19:44:59.366041] [DEBUG] [LOCAL ] LTM: Trimmed 51764 records to 39414 (keeping 200 days of data) [2025-10-27T19:44:59.590027] [DEBUG] [LOCAL ] LTM: Primary data saved (39414 records). [2025-10-27T19:44:59.590164] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-27T19:44:59.590250] [INFO ] [MAIN ] Update Progress: 1278/2366 symbols completed. LTM took 32.6s. Estimated remaining: 2h 20m 25s. Rate: 7.7 symbols/min [2025-10-27T19:44:59.614918] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-27T19:44:59.945267] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T19:45:00.414941] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-27T19:45:01.088794] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T19:45:01.214965] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-27T19:45:03.077778] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-27T19:45:03.082102] [INFO ] [REMOTE ] LUCK: Full fetch complete (38807 records). [2025-10-27T19:45:03.082208] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-27T19:45:03.466815] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-27T19:45:03.466904] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-27T19:45:03.467786] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-27T19:45:03.467848] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-27T19:45:03.468717] [DEBUG] [LOCAL ] LUCK: Trimmed 38807 records to 23228 (keeping 200 days of data) [2025-10-27T19:45:03.620865] [DEBUG] [LOCAL ] LUCK: Primary data saved (23228 records). [2025-10-27T19:45:03.633812] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-27T19:45:03.636680] [INFO ] [MAIN ] Update Progress: 1279/2366 symbols completed. LUCK took 21.7s. Estimated remaining: 2h 20m 14s. Rate: 7.8 symbols/min [2025-10-27T19:45:03.639478] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (3.22 seconds). [2025-10-27T19:45:03.650082] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-27T19:45:05.425661] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T19:45:05.436632] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-27T19:45:06.592825] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T19:45:06.602917] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-27T19:45:08.427449] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-27T19:45:08.438463] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-27T19:45:09.717253] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-27T19:45:09.726555] [INFO ] [REMOTE ] LU: Full fetch complete (70958 records). [2025-10-27T19:45:09.726721] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-27T19:45:10.105814] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-27T19:45:10.105893] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-27T19:45:10.106890] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-27T19:45:10.106952] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-27T19:45:10.108553] [DEBUG] [LOCAL ] LU: Trimmed 70958 records to 49197 (keeping 200 days of data) [2025-10-27T19:45:10.376008] [DEBUG] [LOCAL ] LU: Primary data saved (49197 records). [2025-10-27T19:45:10.376150] [INFO ] [MAIN ] LU: Full history saved. [2025-10-27T19:45:10.376870] [INFO ] [MAIN ] Update Progress: 1280/2366 symbols completed. LU took 31.1s. Estimated remaining: 2h 20m 6s. Rate: 7.8 symbols/min [2025-10-27T19:45:11.020889] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:45:11.022010] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:45:11.083056] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:45:11.086114] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-27T19:45:11.100382] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-27T19:45:11.104453] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-27T19:45:11.104388] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:45:11.104923] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-27T19:45:11.105286] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-27T19:45:11.105340] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-27T19:45:11.407471] [DEBUG] [LOCAL ] LUMN: Loaded 54425 existing records from primary storage. [2025-10-27T19:45:11.424558] [INFO ] [MAIN ] LUMN: Loaded 54425 existing records. [2025-10-27T19:45:11.501983] [DEBUG] [LOCAL ] LUV: Loaded 54469 existing records from primary storage. [2025-10-27T19:45:11.528179] [DEBUG] [LOCAL ] LVS: Loaded 54349 existing records from primary storage. [2025-10-27T19:45:11.538820] [INFO ] [MAIN ] LVS: Loaded 54349 existing records. [2025-10-27T19:45:11.544247] [INFO ] [MAIN ] LUV: Loaded 54469 existing records. [2025-10-27T19:45:11.892873] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:45:11.912021] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-10-27T19:45:12.146259] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:45:12.157400] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:45:12.157689] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-27T19:45:12.172836] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-27T19:45:12.173080] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-27T19:45:12.179459] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:45:12.179616] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-27T19:45:12.179802] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-27T19:45:12.179982] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-27T19:45:12.180041] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-27T19:45:12.180205] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-27T19:45:12.180299] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-27T19:45:12.200894] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-27T19:45:12.277317] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-27T19:45:12.266940] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T19:45:12.366266] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-10-27T19:45:12.355884] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-27T19:45:12.385902] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:45:12.394439] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-27T19:45:12.477230] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:45:12.549017] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-27T19:45:12.619019] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-27T19:45:12.668035] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-27T19:45:12.722928] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-27T19:45:12.800938] [INFO ] [MAIN ] Update Progress: 1281/2366 symbols completed. LUXE took 2.4s. Estimated remaining: 2h 19m 54s. Rate: 7.8 symbols/min [2025-10-27T19:45:13.338014] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:45:13.455787] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-27T19:45:13.496233] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:45:13.530356] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:45:13.541130] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-27T19:45:13.566141] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:45:13.566809] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-27T19:45:13.582243] [DEBUG] [LOCAL ] LVWR: Loaded 18752 existing records from primary storage. [2025-10-27T19:45:13.582797] [INFO ] [MAIN ] LVWR: Loaded 18752 existing records. [2025-10-27T19:45:13.753908] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:45:13.754109] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-27T19:45:13.754154] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-27T19:45:13.754308] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-27T19:45:13.754345] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-27T19:45:14.095355] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:45:14.095670] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-27T19:45:14.446411] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-27T19:45:14.448309] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-27T19:45:14.876125] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-27T19:45:14.881315] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-27T19:45:15.273852] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T19:45:15.284507] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-27T19:45:15.396751] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-27T19:45:15.407905] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-27T19:45:15.441733] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-27T19:45:15.452405] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-27T19:45:15.497748] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T19:45:15.499368] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-27T19:45:16.077554] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T19:45:16.079394] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-27T19:45:16.586781] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T19:45:16.597402] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-27T19:45:16.804871] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-27T19:45:16.809026] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-27T19:45:16.905851] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T19:45:16.915995] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-27T19:45:17.251126] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-27T19:45:17.261721] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-27T19:45:18.000447] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T19:45:18.014896] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-27T19:45:18.190812] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-27T19:45:18.658315] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T19:45:18.766421] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-27T19:45:18.814994] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-27T19:45:19.614938] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-27T19:45:19.846480] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-27T19:45:20.414944] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-27T19:45:20.997464] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-27T19:45:21.119012] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T19:45:21.214918] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-27T19:45:21.903679] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T19:45:22.014935] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-27T19:45:22.731374] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T19:45:22.814908] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-27T19:45:23.614920] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-27T19:45:23.694317] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-27T19:45:24.261385] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T19:45:24.414950] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-27T19:45:24.740846] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-27T19:45:25.214934] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-27T19:45:25.816275] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T19:45:25.885982] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T19:45:26.014943] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-27T19:45:26.814997] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-27T19:45:27.547501] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-27T19:45:27.614971] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-27T19:45:28.423556] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-27T19:45:28.426393] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-27T19:45:28.547977] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-27T19:45:29.215000] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-27T19:45:29.974131] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-27T19:45:30.014971] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-27T19:45:30.814943] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-27T19:45:30.926786] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T19:45:31.614981] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-27T19:45:31.728024] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-27T19:45:32.414968] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-27T19:45:32.522520] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-27T19:45:33.033093] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-27T19:45:33.037193] [INFO ] [REMOTE ] LVWR: Full fetch complete (20854 records). [2025-10-27T19:45:33.037290] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-27T19:45:33.218107] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-27T19:45:33.414661] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-27T19:45:33.414834] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-27T19:45:33.415380] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-27T19:45:33.415453] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-27T19:45:33.416428] [DEBUG] [LOCAL ] LVWR: Trimmed 20854 records to 18668 (keeping 200 days of data) [2025-10-27T19:45:33.538410] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-27T19:45:33.563254] [DEBUG] [LOCAL ] LVWR: Primary data saved (18668 records). [2025-10-27T19:45:33.563394] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-27T19:45:33.563470] [INFO ] [MAIN ] Update Progress: 1282/2366 symbols completed. LVWR took 20.7s. Estimated remaining: 2h 19m 57s. Rate: 7.7 symbols/min [2025-10-27T19:45:33.744673] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:45:33.795095] [DEBUG] [LOCAL ] LW: Loaded 51910 existing records from primary storage. [2025-10-27T19:45:33.795458] [INFO ] [MAIN ] LW: Loaded 51910 existing records. [2025-10-27T19:45:33.994662] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:45:33.994882] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-27T19:45:33.994931] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-27T19:45:33.995210] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-27T19:45:33.995249] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-27T19:45:34.025451] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-27T19:45:34.381072] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:45:34.814951] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-27T19:45:35.555177] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-27T19:45:35.614913] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-27T19:45:35.665330] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T19:45:36.414927] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-27T19:45:36.546234] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T19:45:37.214943] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-27T19:45:37.316112] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T19:45:38.014948] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-27T19:45:38.650027] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-27T19:45:38.660720] [INFO ] [REMOTE ] LUMN: Full fetch complete (77785 records). [2025-10-27T19:45:38.660854] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-27T19:45:38.832261] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-27T19:45:39.050717] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-27T19:45:39.050806] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-27T19:45:39.051809] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-27T19:45:39.051872] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-27T19:45:39.053591] [DEBUG] [LOCAL ] LUMN: Trimmed 77785 records to 53646 (keeping 200 days of data) [2025-10-27T19:45:39.084312] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-27T19:45:39.178344] [INFO ] [REMOTE ] LVS: Full fetch complete (77728 records). [2025-10-27T19:45:39.191227] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-27T19:45:39.862344] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-27T19:45:39.887636] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-27T19:45:39.900478] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-27T19:45:39.913330] [DEBUG] [LOCAL ] LUMN: Primary data saved (53646 records). [2025-10-27T19:45:39.913713] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-27T19:45:39.913511] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-27T19:45:39.914324] [INFO ] [MAIN ] Update Progress: 1283/2366 symbols completed. LUMN took 29.5s. Estimated remaining: 2h 19m 48s. Rate: 7.7 symbols/min [2025-10-27T19:45:40.035809] [DEBUG] [LOCAL ] LVS: Trimmed 77728 records to 53569 (keeping 200 days of data) [2025-10-27T19:45:40.090067] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-27T19:45:40.258470] [INFO ] [REMOTE ] LUV: Full fetch complete (77865 records). [2025-10-27T19:45:40.290594] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-27T19:45:40.326590] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:45:40.504050] [DEBUG] [LOCAL ] LXFR: Loaded 16581 existing records from primary storage. [2025-10-27T19:45:40.515619] [INFO ] [MAIN ] LXFR: Loaded 16581 existing records. [2025-10-27T19:45:41.143997] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:45:41.165519] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-27T19:45:41.170231] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-27T19:45:41.191729] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-27T19:45:41.208907] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-27T19:45:41.408334] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-27T19:45:41.408087] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-10-27T19:45:41.447121] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-27T19:45:41.474868] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-27T19:45:41.484340] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-27T19:45:41.498377] [DEBUG] [LOCAL ] LVS: Primary data saved (53569 records). [2025-10-27T19:45:41.498760] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-27T19:45:41.498475] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-27T19:45:41.512945] [INFO ] [MAIN ] Update Progress: 1284/2366 symbols completed. LVS took 31.1s. Estimated remaining: 2h 19m 35s. Rate: 7.8 symbols/min [2025-10-27T19:45:41.632309] [DEBUG] [LOCAL ] LUV: Trimmed 77865 records to 53689 (keeping 200 days of data) [2025-10-27T19:45:41.992275] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:45:42.151719] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:45:42.152264] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-27T19:45:42.322506] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-10-27T19:45:42.337448] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-27T19:45:42.337589] [INFO ] [MAIN ] Update Progress: 1285/2366 symbols completed. LUV took 31.9s. Estimated remaining: 2h 19m 21s. Rate: 7.8 symbols/min [2025-10-27T19:45:42.364837] [DEBUG] [LOCAL ] LXP: Loaded 51479 existing records from primary storage. [2025-10-27T19:45:42.403716] [INFO ] [MAIN ] LXP: Loaded 51479 existing records. [2025-10-27T19:45:42.662029] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:45:42.697453] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:45:42.697789] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-27T19:45:42.697846] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-27T19:45:42.698037] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-27T19:45:42.698075] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-27T19:45:42.974767] [DEBUG] [LOCAL ] LXU: Loaded 31894 existing records from primary storage. [2025-10-27T19:45:43.021144] [INFO ] [MAIN ] LXU: Loaded 31894 existing records. [2025-10-27T19:45:43.178731] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-27T19:45:43.224104] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-27T19:45:43.301030] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:45:43.304239] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-27T19:45:43.303834] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:45:43.305603] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-27T19:45:43.305844] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-27T19:45:43.317256] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-27T19:45:43.337415] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-27T19:45:43.372892] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-27T19:45:43.446582] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-27T19:45:43.703217] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:45:43.703591] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-27T19:45:44.007466] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T19:45:44.411829] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-27T19:45:44.421172] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-27T19:45:44.689075] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T19:45:44.717501] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T19:45:45.214939] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-27T19:45:45.401109] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-27T19:45:46.014920] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-27T19:45:46.673950] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-27T19:45:46.814938] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-27T19:45:47.278191] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T19:45:47.614964] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-27T19:45:48.414995] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-27T19:45:48.665686] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-27T19:45:49.123612] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-27T19:45:49.214941] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-27T19:45:49.810347] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T19:45:49.832827] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-27T19:45:50.014952] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-27T19:45:50.814948] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-27T19:45:51.614967] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-27T19:45:51.652481] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-27T19:45:51.729267] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T19:45:52.282437] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-27T19:45:52.414930] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-27T19:45:53.214923] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-27T19:45:53.378214] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-27T19:45:53.982971] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-27T19:45:54.014900] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-27T19:45:54.814942] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-27T19:45:55.342228] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T19:45:55.614931] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-27T19:45:56.198071] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T19:45:56.414939] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-27T19:45:57.220098] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-27T19:45:57.235460] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-27T19:45:57.759368] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T19:45:58.014918] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-27T19:45:58.048028] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-27T19:45:58.814941] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-27T19:45:59.614921] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-27T19:45:59.724003] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-27T19:45:59.804690] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-27T19:46:00.414939] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-27T19:46:01.214948] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-27T19:46:01.829867] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-27T19:46:02.015032] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-27T19:46:02.814988] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-27T19:46:03.912442] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-27T19:46:03.915806] [INFO ] [REMOTE ] LXFR: Full fetch complete (24662 records). [2025-10-27T19:46:03.916198] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-27T19:46:03.934177] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-10-27T19:46:04.012133] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-27T19:46:04.291055] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (3.88 seconds). [2025-10-27T19:46:04.385135] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-27T19:46:04.385211] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-27T19:46:04.385831] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-27T19:46:04.385895] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-27T19:46:04.386499] [DEBUG] [LOCAL ] LXFR: Trimmed 24662 records to 16176 (keeping 200 days of data) [2025-10-27T19:46:04.428754] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-27T19:46:04.485796] [DEBUG] [LOCAL ] LXFR: Primary data saved (16176 records). [2025-10-27T19:46:04.485925] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-27T19:46:04.486012] [INFO ] [MAIN ] Update Progress: 1286/2366 symbols completed. LXFR took 24.6s. Estimated remaining: 2h 19m 26s. Rate: 7.7 symbols/min [2025-10-27T19:46:04.653046] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:46:04.701846] [DEBUG] [LOCAL ] LYB: Loaded 54401 existing records from primary storage. [2025-10-27T19:46:04.702152] [INFO ] [MAIN ] LYB: Loaded 54401 existing records. [2025-10-27T19:46:04.880539] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:46:04.880793] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-27T19:46:04.880845] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-27T19:46:04.881182] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-27T19:46:04.881239] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-27T19:46:05.260129] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:46:05.260791] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-27T19:46:05.310905] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (3.30 seconds). [2025-10-27T19:46:05.604413] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T19:46:05.646488] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T19:46:06.014941] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-27T19:46:06.815051] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-27T19:46:07.566273] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-27T19:46:07.614966] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-27T19:46:07.744288] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-27T19:46:08.289697] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-27T19:46:08.414973] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-27T19:46:08.787704] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T19:46:09.214974] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-27T19:46:09.325744] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-27T19:46:10.014967] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-27T19:46:10.814966] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-27T19:46:10.914258] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T19:46:10.925914] [INFO ] [REMOTE ] LXP: Full fetch complete (72850 records). [2025-10-27T19:46:10.926168] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-27T19:46:11.308689] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T19:46:11.371176] [INFO ] [REMOTE ] LXU: Full fetch complete (45284 records). [2025-10-27T19:46:11.383486] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-27T19:46:11.493145] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-27T19:46:11.510236] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-27T19:46:11.511907] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-27T19:46:11.519175] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-27T19:46:11.591596] [DEBUG] [LOCAL ] LXP: Trimmed 72850 records to 50671 (keeping 200 days of data) [2025-10-27T19:46:11.628363] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-27T19:46:12.059009] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-27T19:46:12.059131] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-27T19:46:12.060733] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-27T19:46:12.111697] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-27T19:46:12.187422] [DEBUG] [LOCAL ] LXU: Trimmed 45284 records to 31131 (keeping 200 days of data) [2025-10-27T19:46:12.396375] [DEBUG] [LOCAL ] LXP: Primary data saved (50671 records). [2025-10-27T19:46:12.397150] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-27T19:46:12.397314] [INFO ] [MAIN ] Update Progress: 1287/2366 symbols completed. LXP took 30.9s. Estimated remaining: 2h 19m 18s. Rate: 7.7 symbols/min [2025-10-27T19:46:12.712684] [DEBUG] [LOCAL ] LXU: Primary data saved (31131 records). [2025-10-27T19:46:12.717078] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:46:12.717553] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-27T19:46:12.717878] [INFO ] [MAIN ] Update Progress: 1288/2366 symbols completed. LXU took 30.4s. Estimated remaining: 2h 19m 4s. Rate: 7.8 symbols/min [2025-10-27T19:46:12.745175] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-27T19:46:12.832539] [INFO ] [REMOTE ] LW: Full fetch complete (74742 records). [2025-10-27T19:46:12.845215] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-27T19:46:13.040902] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:46:13.195631] [DEBUG] [LOCAL ] LYG: Loaded 53424 existing records from primary storage. [2025-10-27T19:46:13.229056] [INFO ] [MAIN ] LYG: Loaded 53424 existing records. [2025-10-27T19:46:13.654070] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-27T19:46:13.657073] [DEBUG] [LOCAL ] LYV: Loaded 51724 existing records from primary storage. [2025-10-27T19:46:13.657344] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-27T19:46:13.669988] [INFO ] [MAIN ] LYV: Loaded 51724 existing records. [2025-10-27T19:46:13.672236] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-27T19:46:13.695101] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:46:13.673230] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-27T19:46:13.728934] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-27T19:46:13.744949] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-27T19:46:13.783106] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-27T19:46:13.799235] [DEBUG] [LOCAL ] LW: Trimmed 74742 records to 51116 (keeping 200 days of data) [2025-10-27T19:46:13.810354] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-27T19:46:14.132620] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:46:14.137986] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-27T19:46:14.177401] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-27T19:46:14.279307] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-27T19:46:14.369803] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-10-27T19:46:14.432684] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-27T19:46:14.629476] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-27T19:46:14.675177] [DEBUG] [LOCAL ] LW: Primary data saved (51116 records). [2025-10-27T19:46:14.691791] [INFO ] [MAIN ] LW: Full history saved. [2025-10-27T19:46:14.723097] [INFO ] [MAIN ] Update Progress: 1289/2366 symbols completed. LW took 41.2s. Estimated remaining: 2h 18m 52s. Rate: 7.8 symbols/min [2025-10-27T19:46:14.902248] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:46:14.941360] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-27T19:46:15.132083] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:46:15.298264] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:46:15.310167] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-27T19:46:15.328382] [DEBUG] [LOCAL ] LZB: Loaded 35474 existing records from primary storage. [2025-10-27T19:46:15.328865] [INFO ] [MAIN ] LZB: Loaded 35474 existing records. [2025-10-27T19:46:15.542193] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:46:15.542566] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-27T19:46:15.542633] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-27T19:46:15.542975] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-27T19:46:15.543046] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-27T19:46:15.964919] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:46:15.965375] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-27T19:46:16.625752] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-27T19:46:16.660842] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-27T19:46:16.663758] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T19:46:16.674446] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-27T19:46:16.770762] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-27T19:46:16.834413] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T19:46:17.214951] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-27T19:46:17.911040] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T19:46:18.014961] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-27T19:46:18.433252] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-27T19:46:18.485141] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T19:46:18.814964] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-27T19:46:19.614944] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-27T19:46:19.705212] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T19:46:20.165631] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T19:46:20.414945] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-27T19:46:21.220225] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-27T19:46:21.234144] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-27T19:46:21.352899] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T19:46:22.014986] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-27T19:46:22.814950] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-27T19:46:23.134855] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-27T19:46:23.342514] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T19:46:23.614948] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-27T19:46:24.414938] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-27T19:46:24.611002] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-27T19:46:24.897489] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-27T19:46:25.214944] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-27T19:46:26.014927] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-27T19:46:26.092136] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T19:46:26.625166] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T19:46:26.814969] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-27T19:46:27.614982] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-27T19:46:27.713298] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-27T19:46:28.105860] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-27T19:46:28.414994] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-27T19:46:29.127742] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T19:46:29.214967] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-27T19:46:30.014980] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-27T19:46:30.299195] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T19:46:30.814967] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-27T19:46:31.047836] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-27T19:46:31.128532] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-27T19:46:31.614946] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-27T19:46:32.029788] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-27T19:46:32.414968] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-27T19:46:32.996297] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T19:46:33.214939] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-27T19:46:33.950861] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T19:46:34.014936] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-27T19:46:34.814928] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-27T19:46:34.907889] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-27T19:46:34.918369] [INFO ] [REMOTE ] LYB: Full fetch complete (77642 records). [2025-10-27T19:46:34.918564] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-27T19:46:35.339808] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-27T19:46:35.339894] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-27T19:46:35.341004] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-27T19:46:35.341067] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-27T19:46:35.342549] [DEBUG] [LOCAL ] LYB: Trimmed 77642 records to 53621 (keeping 200 days of data) [2025-10-27T19:46:35.619951] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-27T19:46:35.671690] [DEBUG] [LOCAL ] LYB: Primary data saved (53621 records). [2025-10-27T19:46:35.671838] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-27T19:46:35.671919] [INFO ] [MAIN ] Update Progress: 1290/2366 symbols completed. LYB took 31.2s. Estimated remaining: 2h 18m 55s. Rate: 7.7 symbols/min [2025-10-27T19:46:35.858795] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:46:35.893399] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-27T19:46:35.920107] [DEBUG] [LOCAL ] LZM: Loaded 15105 existing records from primary storage. [2025-10-27T19:46:35.920440] [INFO ] [MAIN ] LZM: Loaded 15105 existing records. [2025-10-27T19:46:36.111711] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:46:36.125581] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-27T19:46:36.126193] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-27T19:46:36.127292] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T19:46:36.130123] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-27T19:46:36.135127] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-27T19:46:36.420053] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-27T19:46:36.488805] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:46:37.111098] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T19:46:37.214927] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-27T19:46:37.446731] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T19:46:37.454188] [INFO ] [REMOTE ] LZB: Full fetch complete (51169 records). [2025-10-27T19:46:37.454353] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-27T19:46:37.860127] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-27T19:46:37.860260] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-27T19:46:37.861638] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-27T19:46:37.861739] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-27T19:46:37.863683] [DEBUG] [LOCAL ] LZB: Trimmed 51169 records to 34783 (keeping 200 days of data) [2025-10-27T19:46:38.041566] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-27T19:46:38.094407] [DEBUG] [LOCAL ] LZB: Primary data saved (34783 records). [2025-10-27T19:46:38.094564] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-27T19:46:38.094694] [INFO ] [MAIN ] Update Progress: 1291/2366 symbols completed. LZB took 23.4s. Estimated remaining: 2h 18m 43s. Rate: 7.7 symbols/min [2025-10-27T19:46:38.261134] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:46:38.312289] [DEBUG] [LOCAL ] M: Loaded 54323 existing records from primary storage. [2025-10-27T19:46:38.312670] [INFO ] [MAIN ] M: Loaded 54323 existing records. [2025-10-27T19:46:38.490770] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:46:38.491195] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-27T19:46:38.491282] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-27T19:46:38.491668] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-27T19:46:38.491742] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-27T19:46:38.772765] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T19:46:38.810146] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T19:46:38.815978] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-27T19:46:38.901049] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:46:39.614940] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-27T19:46:39.692971] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-27T19:46:40.414930] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-27T19:46:41.214933] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-27T19:46:41.454849] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-27T19:46:41.754749] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-27T19:46:41.991252] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-27T19:46:42.014929] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-27T19:46:42.814979] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-27T19:46:43.614929] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-27T19:46:43.711560] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-27T19:46:44.414956] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-27T19:46:44.667527] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-27T19:46:44.680043] [INFO ] [REMOTE ] LYG: Full fetch complete (76283 records). [2025-10-27T19:46:44.680229] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-27T19:46:45.130070] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-27T19:46:45.130205] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-27T19:46:45.131468] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-27T19:46:45.131553] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-27T19:46:45.133394] [DEBUG] [LOCAL ] LYG: Trimmed 76283 records to 52640 (keeping 200 days of data) [2025-10-27T19:46:45.216911] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-27T19:46:45.365466] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-27T19:46:45.479270] [DEBUG] [LOCAL ] LYG: Primary data saved (52640 records). [2025-10-27T19:46:45.479415] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-27T19:46:45.480207] [INFO ] [MAIN ] Update Progress: 1292/2366 symbols completed. LYG took 33.1s. Estimated remaining: 2h 18m 35s. Rate: 7.8 symbols/min [2025-10-27T19:46:45.647739] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:46:45.699785] [DEBUG] [LOCAL ] MA: Loaded 53204 existing records from primary storage. [2025-10-27T19:46:45.700084] [INFO ] [MAIN ] MA: Loaded 53204 existing records. [2025-10-27T19:46:45.880948] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:46:45.881317] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-27T19:46:45.881387] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-27T19:46:45.881601] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-27T19:46:45.881689] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-27T19:46:46.036749] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-27T19:46:46.205494] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-27T19:46:46.268520] [INFO ] [REMOTE ] LYV: Full fetch complete (74138 records). [2025-10-27T19:46:46.290248] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-27T19:46:46.290136] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:46:46.376906] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-27T19:46:46.730313] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-27T19:46:46.730439] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-27T19:46:46.731991] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-27T19:46:46.732061] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-27T19:46:46.734014] [DEBUG] [LOCAL ] LYV: Trimmed 74138 records to 50904 (keeping 200 days of data) [2025-10-27T19:46:46.821482] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-27T19:46:47.044747] [DEBUG] [LOCAL ] LYV: Primary data saved (50904 records). [2025-10-27T19:46:47.044891] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-27T19:46:47.045003] [INFO ] [MAIN ] Update Progress: 1293/2366 symbols completed. LYV took 34.3s. Estimated remaining: 2h 18m 22s. Rate: 7.8 symbols/min [2025-10-27T19:46:47.209267] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:46:47.250791] [DEBUG] [LOCAL ] MAA: Loaded 43628 existing records from primary storage. [2025-10-27T19:46:47.251141] [INFO ] [MAIN ] MAA: Loaded 43628 existing records. [2025-10-27T19:46:47.439400] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:46:47.439979] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-27T19:46:47.440121] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-27T19:46:47.440435] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-27T19:46:47.440638] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-27T19:46:47.552945] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-27T19:46:47.619079] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-27T19:46:47.841248] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:46:47.870465] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-27T19:46:48.414958] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-27T19:46:49.220151] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-27T19:46:49.234472] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-27T19:46:49.893906] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-27T19:46:49.957199] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-27T19:46:50.014915] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-27T19:46:50.814962] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-27T19:46:50.841792] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-27T19:46:51.614932] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-27T19:46:52.415009] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-27T19:46:52.796100] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-27T19:46:53.007750] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-27T19:46:53.214937] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-27T19:46:53.727148] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T19:46:53.992137] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-27T19:46:54.014906] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-27T19:46:54.649962] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-27T19:46:54.815002] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-27T19:46:55.614952] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-27T19:46:55.993041] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-27T19:46:55.997874] [INFO ] [REMOTE ] LZM: Full fetch complete (20202 records). [2025-10-27T19:46:55.997964] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-27T19:46:56.388706] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-27T19:46:56.388791] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-27T19:46:56.389205] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-27T19:46:56.389244] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-27T19:46:56.389887] [DEBUG] [LOCAL ] LZM: Trimmed 20202 records to 14897 (keeping 200 days of data) [2025-10-27T19:46:56.420530] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-27T19:46:56.473584] [DEBUG] [LOCAL ] LZM: Primary data saved (14897 records). [2025-10-27T19:46:56.473800] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-27T19:46:56.473901] [INFO ] [MAIN ] Update Progress: 1294/2366 symbols completed. LZM took 20.8s. Estimated remaining: 2h 18m 16s. Rate: 7.8 symbols/min [2025-10-27T19:46:56.642306] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:46:56.688458] [DEBUG] [LOCAL ] MAC: Loaded 50284 existing records from primary storage. [2025-10-27T19:46:56.688819] [INFO ] [MAIN ] MAC: Loaded 50284 existing records. [2025-10-27T19:46:56.868069] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:46:56.868275] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-27T19:46:56.868322] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-27T19:46:56.868609] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-10-27T19:46:56.868681] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-27T19:46:57.222913] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-27T19:46:57.227555] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:46:57.289514] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T19:46:57.993169] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T19:46:58.014907] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-27T19:46:58.815022] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-27T19:46:59.158813] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T19:46:59.199617] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-27T19:46:59.614929] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-27T19:47:00.374459] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-27T19:47:00.414905] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-27T19:47:01.214948] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-27T19:47:02.015030] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-27T19:47:02.214497] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-27T19:47:02.815041] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-27T19:47:04.685462] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (3.47 seconds). [2025-10-27T19:47:04.696468] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-27T19:47:05.009045] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (4.59 seconds). [2025-10-27T19:47:05.018735] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-27T19:47:05.127251] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (3.11 seconds). [2025-10-27T19:47:05.214928] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-27T19:47:05.524589] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-10-27T19:47:06.014984] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-27T19:47:06.362777] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T19:47:06.455146] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T19:47:06.814996] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-27T19:47:07.218073] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-27T19:47:07.614971] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-27T19:47:07.760599] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-27T19:47:07.945194] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T19:47:08.415030] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-27T19:47:09.214907] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-27T19:47:09.792447] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-27T19:47:10.020100] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-27T19:47:10.034952] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T19:47:10.815962] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-27T19:47:10.819602] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T19:47:11.528960] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T19:47:11.614936] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-27T19:47:12.370896] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-27T19:47:12.414906] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-27T19:47:13.214925] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-27T19:47:13.514781] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-27T19:47:13.525568] [INFO ] [REMOTE ] M: Full fetch complete (77657 records). [2025-10-27T19:47:13.525816] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-27T19:47:13.785489] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-27T19:47:13.955793] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-27T19:47:13.955865] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-27T19:47:13.956880] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-27T19:47:13.956942] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-27T19:47:13.958304] [DEBUG] [LOCAL ] M: Trimmed 77657 records to 53543 (keeping 200 days of data) [2025-10-27T19:47:14.018874] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-27T19:47:14.278488] [DEBUG] [LOCAL ] M: Primary data saved (53543 records). [2025-10-27T19:47:14.278609] [INFO ] [MAIN ] M: Full history saved. [2025-10-27T19:47:14.278709] [INFO ] [MAIN ] Update Progress: 1295/2366 symbols completed. M took 36.2s. Estimated remaining: 2h 18m 16s. Rate: 7.7 symbols/min [2025-10-27T19:47:14.448360] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:47:14.482843] [DEBUG] [LOCAL ] MAGN: Loaded 36632 existing records from primary storage. [2025-10-27T19:47:14.483128] [INFO ] [MAIN ] MAGN: Loaded 36632 existing records. [2025-10-27T19:47:14.675836] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:47:14.685563] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-27T19:47:14.685637] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-27T19:47:14.686459] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T19:47:14.689736] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-27T19:47:14.695333] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-27T19:47:14.820025] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-27T19:47:15.050342] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:47:15.544863] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T19:47:15.614916] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-27T19:47:15.992804] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T19:47:16.414977] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-27T19:47:17.214912] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-27T19:47:17.307328] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-27T19:47:17.619148] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T19:47:18.015027] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-10-27T19:47:18.534918] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T19:47:18.543460] [INFO ] [REMOTE ] MAA: Full fetch complete (61989 records). [2025-10-27T19:47:18.543603] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-27T19:47:18.822028] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-27T19:47:18.947144] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-27T19:47:18.947222] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-27T19:47:18.948242] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-27T19:47:18.948305] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-27T19:47:18.949629] [DEBUG] [LOCAL ] MAA: Trimmed 61989 records to 42844 (keeping 200 days of data) [2025-10-27T19:47:19.220233] [DEBUG] [LOCAL ] MAA: Primary data saved (42844 records). [2025-10-27T19:47:19.220355] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-27T19:47:19.220431] [INFO ] [MAIN ] Update Progress: 1296/2366 symbols completed. MAA took 32.2s. Estimated remaining: 2h 18m 6s. Rate: 7.7 symbols/min [2025-10-27T19:47:19.402327] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:47:19.431248] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T19:47:19.476472] [DEBUG] [LOCAL ] MAIN: Loaded 42512 existing records from primary storage. [2025-10-27T19:47:19.476794] [INFO ] [MAIN ] MAIN: Loaded 42512 existing records. [2025-10-27T19:47:19.620057] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-10-27T19:47:19.656023] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:47:19.656434] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-27T19:47:19.656489] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-27T19:47:19.656733] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-27T19:47:19.656789] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-27T19:47:20.017440] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:47:20.415019] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-27T19:47:20.790765] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-27T19:47:20.802012] [INFO ] [REMOTE ] MA: Full fetch complete (76377 records). [2025-10-27T19:47:20.802188] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-27T19:47:21.216068] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-27T19:47:21.349263] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-27T19:47:21.349368] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-27T19:47:21.350533] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-27T19:47:21.350616] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-27T19:47:21.354382] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-27T19:47:21.367527] [DEBUG] [LOCAL ] MA: Trimmed 76377 records to 52417 (keeping 200 days of data) [2025-10-27T19:47:21.624411] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T19:47:21.729995] [DEBUG] [LOCAL ] MA: Primary data saved (52417 records). [2025-10-27T19:47:21.730152] [INFO ] [MAIN ] MA: Full history saved. [2025-10-27T19:47:21.730864] [INFO ] [MAIN ] Update Progress: 1297/2366 symbols completed. MA took 36.3s. Estimated remaining: 2h 17m 54s. Rate: 7.8 symbols/min [2025-10-27T19:47:21.903593] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:47:21.946789] [DEBUG] [LOCAL ] MAN: Loaded 44967 existing records from primary storage. [2025-10-27T19:47:21.947092] [INFO ] [MAIN ] MAN: Loaded 44967 existing records. [2025-10-27T19:47:22.020880] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-27T19:47:22.130961] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:47:22.131118] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-27T19:47:22.131170] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-27T19:47:22.131530] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-27T19:47:22.131569] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-27T19:47:22.487682] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:47:22.507254] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-27T19:47:22.814930] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-27T19:47:23.546889] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T19:47:23.614966] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-27T19:47:24.105388] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-27T19:47:24.414928] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-10-27T19:47:24.476929] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-27T19:47:25.214962] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-27T19:47:25.853035] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T19:47:26.014909] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-10-27T19:47:26.139759] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T19:47:26.814952] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-27T19:47:27.531305] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T19:47:27.614917] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-10. [2025-10-27T19:47:28.346548] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T19:47:28.414907] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-27T19:47:29.100214] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-27T19:47:29.109392] [INFO ] [REMOTE ] MAC: Full fetch complete (71500 records). [2025-10-27T19:47:29.109524] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-10-27T19:47:29.216309] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-27T19:47:29.497862] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-10-27T19:47:29.497953] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-10-27T19:47:29.498946] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-10-27T19:47:29.499011] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-10-27T19:47:29.500381] [DEBUG] [LOCAL ] MAC: Trimmed 71500 records to 49449 (keeping 200 days of data) [2025-10-27T19:47:29.804858] [DEBUG] [LOCAL ] MAC: Primary data saved (49449 records). [2025-10-27T19:47:29.805020] [INFO ] [MAIN ] MAC: Full history saved. [2025-10-27T19:47:29.805595] [INFO ] [MAIN ] Update Progress: 1298/2366 symbols completed. MAC took 33.3s. Estimated remaining: 2h 17m 47s. Rate: 7.8 symbols/min [2025-10-27T19:47:29.986571] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T19:47:30.023011] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-27T19:47:30.025352] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:47:30.055636] [DEBUG] [LOCAL ] MANU: Loaded 27474 existing records from primary storage. [2025-10-27T19:47:30.055948] [INFO ] [MAIN ] MANU: Loaded 27474 existing records. [2025-10-27T19:47:30.235003] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:47:30.235233] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-27T19:47:30.235280] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-27T19:47:30.235550] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-27T19:47:30.235589] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-27T19:47:30.599691] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:47:30.731042] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T19:47:30.814916] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-27T19:47:31.221907] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-27T19:47:31.614929] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-27T19:47:31.712859] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T19:47:32.414947] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-27T19:47:33.060435] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T19:47:33.214941] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-27T19:47:33.782957] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T19:47:34.014937] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-27T19:47:34.234269] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T19:47:34.814959] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-27T19:47:35.614932] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-27T19:47:35.652980] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T19:47:35.786936] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-27T19:47:36.414953] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-27T19:47:36.675915] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T19:47:37.214958] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-27T19:47:37.796845] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-27T19:47:38.014955] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-27T19:47:38.780340] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-27T19:47:38.814902] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-27T19:47:39.430133] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T19:47:39.614941] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-27T19:47:40.292977] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-27T19:47:40.414955] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-27T19:47:40.972504] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T19:47:41.214947] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-27T19:47:41.578165] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T19:47:42.014933] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-27T19:47:42.055960] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-27T19:47:42.814938] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-27T19:47:43.269212] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T19:47:43.614932] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-27T19:47:44.048428] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T19:47:44.414958] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-27T19:47:45.220728] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-27T19:47:45.225486] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-27T19:47:45.792621] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-27T19:47:46.014940] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-27T19:47:46.126495] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-27T19:47:46.814937] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-27T19:47:47.388256] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-27T19:47:47.614932] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-27T19:47:47.890486] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T19:47:48.414963] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-27T19:47:48.864874] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T19:47:49.214953] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-27T19:47:50.014923] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-27T19:47:50.139157] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-27T19:47:50.148738] [INFO ] [REMOTE ] MAN: Full fetch complete (63016 records). [2025-10-27T19:47:50.148861] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-27T19:47:50.528635] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-27T19:47:50.528870] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-27T19:47:50.529808] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-27T19:47:50.529891] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-27T19:47:50.531282] [DEBUG] [LOCAL ] MAN: Trimmed 63016 records to 44314 (keeping 200 days of data) [2025-10-27T19:47:50.637742] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T19:47:50.680110] [INFO ] [REMOTE ] MAGN: Full fetch complete (51778 records). [2025-10-27T19:47:50.680296] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-27T19:47:50.819209] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-27T19:47:51.122808] [DEBUG] [LOCAL ] MAN: Primary data saved (44314 records). [2025-10-27T19:47:51.125614] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-27T19:47:51.132007] [INFO ] [MAIN ] Update Progress: 1299/2366 symbols completed. MAN took 29.4s. Estimated remaining: 2h 17m 50s. Rate: 7.7 symbols/min [2025-10-27T19:47:51.401711] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:47:51.402465] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-27T19:47:51.402600] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-27T19:47:51.403852] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-27T19:47:51.404012] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-27T19:47:51.405429] [DEBUG] [LOCAL ] MAGN: Trimmed 51778 records to 35837 (keeping 200 days of data) [2025-10-27T19:47:51.628686] [DEBUG] [LOCAL ] MAGN: Primary data saved (35837 records). [2025-10-27T19:47:51.628920] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-27T19:47:51.642925] [INFO ] [MAIN ] Update Progress: 1300/2366 symbols completed. MAGN took 37.4s. Estimated remaining: 2h 17m 36s. Rate: 7.7 symbols/min [2025-10-27T19:47:51.680080] [DEBUG] [LOCAL ] MAS: Loaded 52954 existing records from primary storage. [2025-10-27T19:47:51.691473] [INFO ] [MAIN ] MAS: Loaded 52954 existing records. [2025-10-27T19:47:52.000316] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:47:52.022886] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:47:52.023864] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-27T19:47:52.044513] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-27T19:47:52.068539] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T19:47:52.077105] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-27T19:47:52.077362] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-27T19:47:52.086237] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-27T19:47:52.098192] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-27T19:47:52.126932] [INFO ] [REMOTE ] MAIN: Full fetch complete (60332 records). [2025-10-27T19:47:52.149574] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-27T19:47:52.420473] [DEBUG] [LOCAL ] MATV: Loaded 35439 existing records from primary storage. [2025-10-27T19:47:52.470891] [INFO ] [MAIN ] MATV: Loaded 35439 existing records. [2025-10-27T19:47:52.893531] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:47:52.921541] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-27T19:47:52.999533] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:47:53.048251] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-27T19:47:53.048671] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-27T19:47:53.064303] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-27T19:47:53.097194] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-27T19:47:53.191535] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-27T19:47:53.200346] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-27T19:47:53.206734] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-27T19:47:53.206852] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-27T19:47:53.254031] [DEBUG] [LOCAL ] MAIN: Trimmed 60332 records to 41726 (keeping 200 days of data) [2025-10-27T19:47:53.266167] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T19:47:53.316793] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-27T19:47:53.768559] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:47:53.811823] [DEBUG] [LOCAL ] MAIN: Primary data saved (41726 records). [2025-10-27T19:47:53.811935] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-27T19:47:53.812010] [INFO ] [MAIN ] Update Progress: 1301/2366 symbols completed. MAIN took 34.6s. Estimated remaining: 2h 17m 24s. Rate: 7.8 symbols/min [2025-10-27T19:47:53.986985] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:47:54.018553] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-27T19:47:54.019229] [DEBUG] [LOCAL ] MATX: Loaded 32268 existing records from primary storage. [2025-10-27T19:47:54.020344] [INFO ] [MAIN ] MATX: Loaded 32268 existing records. [2025-10-27T19:47:54.210594] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:47:54.210800] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-27T19:47:54.210862] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-27T19:47:54.211037] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-27T19:47:54.211077] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-27T19:47:54.584695] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:47:54.605833] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-27T19:47:54.647108] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T19:47:54.814939] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-27T19:47:55.017406] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T19:47:55.614959] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-27T19:47:56.226159] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T19:47:56.414997] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-27T19:47:57.214931] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-27T19:47:57.375093] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-27T19:47:57.404853] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-27T19:47:58.014957] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-27T19:47:58.169263] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T19:47:58.814928] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-27T19:47:59.437621] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T19:47:59.614945] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-27T19:48:00.416879] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-27T19:48:00.419342] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T19:48:01.214940] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-27T19:48:01.769083] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-27T19:48:01.775420] [INFO ] [REMOTE ] MANU: Full fetch complete (39425 records). [2025-10-27T19:48:01.775522] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-27T19:48:02.035011] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-27T19:48:02.167782] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-27T19:48:02.167894] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-27T19:48:02.168735] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-27T19:48:02.168798] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-27T19:48:02.169628] [DEBUG] [LOCAL ] MANU: Trimmed 39425 records to 26885 (keeping 200 days of data) [2025-10-27T19:48:02.332739] [DEBUG] [LOCAL ] MANU: Primary data saved (26885 records). [2025-10-27T19:48:02.332865] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-27T19:48:02.332941] [INFO ] [MAIN ] Update Progress: 1302/2366 symbols completed. MANU took 32.5s. Estimated remaining: 2h 17m 17s. Rate: 7.8 symbols/min [2025-10-27T19:48:02.507349] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:48:02.539540] [DEBUG] [LOCAL ] MAX: Loaded 31092 existing records from primary storage. [2025-10-27T19:48:02.539875] [INFO ] [MAIN ] MAX: Loaded 31092 existing records. [2025-10-27T19:48:02.714760] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:48:02.714994] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-27T19:48:02.715042] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-27T19:48:02.715266] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-27T19:48:02.715321] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-27T19:48:03.063881] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:48:03.064318] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-27T19:48:03.124250] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-27T19:48:03.614941] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-27T19:48:03.870347] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-27T19:48:03.979803] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (3.56 seconds). [2025-10-27T19:48:04.414976] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-27T19:48:04.540284] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T19:48:04.756776] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T19:48:05.214941] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-27T19:48:06.014964] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-27T19:48:06.325993] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-27T19:48:06.694883] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-27T19:48:06.814916] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-27T19:48:06.983273] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-27T19:48:07.615042] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-27T19:48:07.773987] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-27T19:48:08.415027] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-27T19:48:08.546480] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-27T19:48:09.214958] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-27T19:48:09.564406] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T19:48:10.015019] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-27T19:48:10.732013] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T19:48:10.814961] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-27T19:48:10.995573] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-27T19:48:11.614953] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-27T19:48:12.222216] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T19:48:12.414930] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-27T19:48:12.604963] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T19:48:13.214950] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-27T19:48:14.014968] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-27T19:48:14.202533] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-27T19:48:14.285583] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-27T19:48:14.814935] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-27T19:48:14.910328] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T19:48:15.614970] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-27T19:48:16.360384] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-27T19:48:16.414996] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-27T19:48:16.577583] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-27T19:48:17.214947] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-27T19:48:17.318687] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T19:48:18.015002] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-27T19:48:18.218157] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-27T19:48:18.814996] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-27T19:48:18.892343] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T19:48:19.614917] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-27T19:48:20.009227] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T19:48:20.414950] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-27T19:48:20.797691] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T19:48:21.214951] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-27T19:48:21.918591] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-27T19:48:21.928350] [INFO ] [REMOTE ] MAS: Full fetch complete (75422 records). [2025-10-27T19:48:21.928465] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-27T19:48:22.024768] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-27T19:48:22.319394] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-27T19:48:22.319530] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-27T19:48:22.320570] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-27T19:48:22.320670] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-27T19:48:22.322258] [DEBUG] [LOCAL ] MAS: Trimmed 75422 records to 52162 (keeping 200 days of data) [2025-10-27T19:48:22.444522] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T19:48:22.666316] [DEBUG] [LOCAL ] MAS: Primary data saved (52162 records). [2025-10-27T19:48:22.666464] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-27T19:48:22.666565] [INFO ] [MAIN ] Update Progress: 1303/2366 symbols completed. MAS took 31.5s. Estimated remaining: 2h 17m 19s. Rate: 7.7 symbols/min [2025-10-27T19:48:22.817708] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-27T19:48:22.835419] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:48:22.875824] [DEBUG] [LOCAL ] MBC: Loaded 44511 existing records from primary storage. [2025-10-27T19:48:22.876101] [INFO ] [MAIN ] MBC: Loaded 44511 existing records. [2025-10-27T19:48:23.052703] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:48:23.052910] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-27T19:48:23.052983] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-27T19:48:23.053315] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-27T19:48:23.053433] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-27T19:48:23.239959] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T19:48:23.292037] [INFO ] [REMOTE ] MATX: Full fetch complete (43998 records). [2025-10-27T19:48:23.324025] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-27T19:48:23.582927] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:48:23.623505] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-27T19:48:23.818547] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-27T19:48:23.818625] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-27T19:48:23.819459] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-27T19:48:23.819541] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-27T19:48:23.820499] [DEBUG] [LOCAL ] MATX: Trimmed 43998 records to 31546 (keeping 200 days of data) [2025-10-27T19:48:24.013796] [DEBUG] [LOCAL ] MATX: Primary data saved (31546 records). [2025-10-27T19:48:24.013931] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-27T19:48:24.014009] [INFO ] [MAIN ] Update Progress: 1304/2366 symbols completed. MATX took 30.2s. Estimated remaining: 2h 17m 6s. Rate: 7.7 symbols/min [2025-10-27T19:48:24.183905] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:48:24.206301] [DEBUG] [LOCAL ] MBI: Loaded 24183 existing records from primary storage. [2025-10-27T19:48:24.206537] [INFO ] [MAIN ] MBI: Loaded 24183 existing records. [2025-10-27T19:48:24.326048] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T19:48:24.409987] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:48:24.410217] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-27T19:48:24.410266] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-27T19:48:24.410490] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-27T19:48:24.410546] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-27T19:48:24.421520] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-27T19:48:24.767993] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:48:24.789156] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T19:48:25.214937] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-27T19:48:25.524718] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-27T19:48:26.014922] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-27T19:48:26.312508] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-27T19:48:26.814992] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-27T19:48:27.256965] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-27T19:48:27.263369] [INFO ] [REMOTE ] MAX: Full fetch complete (45050 records). [2025-10-27T19:48:27.263471] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-27T19:48:27.623220] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-27T19:48:27.639721] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-27T19:48:27.640397] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-27T19:48:27.641223] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-27T19:48:27.641377] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-27T19:48:27.642372] [DEBUG] [LOCAL ] MAX: Trimmed 45050 records to 30512 (keeping 200 days of data) [2025-10-27T19:48:27.821879] [DEBUG] [LOCAL ] MAX: Primary data saved (30512 records). [2025-10-27T19:48:27.822117] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-27T19:48:27.822257] [INFO ] [MAIN ] Update Progress: 1305/2366 symbols completed. MAX took 25.5s. Estimated remaining: 2h 16m 56s. Rate: 7.7 symbols/min [2025-10-27T19:48:27.883868] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-27T19:48:27.928834] [INFO ] [REMOTE ] MATV: Full fetch complete (51922 records). [2025-10-27T19:48:27.945991] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-27T19:48:28.160766] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:48:28.417002] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-27T19:48:28.433725] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-27T19:48:28.434676] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-27T19:48:28.448106] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-27T19:48:28.449537] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-27T19:48:28.450676] [DEBUG] [LOCAL ] MC: Loaded 44204 existing records from primary storage. [2025-10-27T19:48:28.451580] [INFO ] [MAIN ] MC: Loaded 44204 existing records. [2025-10-27T19:48:28.523543] [DEBUG] [LOCAL ] MATV: Trimmed 51922 records to 34605 (keeping 200 days of data) [2025-10-27T19:48:28.729889] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T19:48:28.735175] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:48:28.742521] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-27T19:48:28.742834] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-27T19:48:28.746916] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-27T19:48:28.747668] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-27T19:48:29.215697] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-27T19:48:29.239697] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:48:29.261455] [DEBUG] [LOCAL ] MATV: Primary data saved (34605 records). [2025-10-27T19:48:29.261607] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-27T19:48:29.261720] [INFO ] [MAIN ] Update Progress: 1306/2366 symbols completed. MATV took 37.6s. Estimated remaining: 2h 16m 43s. Rate: 7.8 symbols/min [2025-10-27T19:48:29.432416] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:48:29.445109] [DEBUG] [LOCAL ] MCB: Loaded 11581 existing records from primary storage. [2025-10-27T19:48:29.445305] [INFO ] [MAIN ] MCB: Loaded 11581 existing records. [2025-10-27T19:48:29.630571] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:48:29.630877] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-27T19:48:29.630961] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-27T19:48:29.631146] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-27T19:48:29.631267] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-27T19:48:29.870766] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T19:48:30.019265] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-27T19:48:30.079027] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:48:30.096547] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-27T19:48:30.815000] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-27T19:48:31.378624] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-27T19:48:31.582511] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-27T19:48:31.614931] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-27T19:48:32.414987] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-27T19:48:32.864888] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-27T19:48:33.210243] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T19:48:33.214890] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-27T19:48:33.758747] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-27T19:48:34.014965] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-27T19:48:34.814999] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-27T19:48:35.116464] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-27T19:48:35.614960] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-27T19:48:35.860700] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-27T19:48:36.414956] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-27T19:48:36.571308] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T19:48:37.214945] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-27T19:48:37.519436] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-27T19:48:38.014966] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-27T19:48:38.491277] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T19:48:38.534230] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-27T19:48:38.814939] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-27T19:48:39.614944] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-27T19:48:40.347332] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T19:48:40.414911] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-27T19:48:40.718750] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T19:48:41.214924] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-27T19:48:41.521812] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T19:48:41.729988] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-27T19:48:42.014920] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-27T19:48:42.815021] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-27T19:48:43.506615] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-27T19:48:43.565764] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T19:48:43.614909] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-27T19:48:44.414917] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-27T19:48:44.532038] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-27T19:48:45.214938] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-27T19:48:45.553433] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T19:48:45.626469] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-27T19:48:46.014942] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-27T19:48:46.814957] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-27T19:48:47.065180] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-27T19:48:47.614954] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-27T19:48:47.864046] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-27T19:48:48.414952] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-27T19:48:48.949910] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-27T19:48:48.962684] [INFO ] [REMOTE ] MBC: Full fetch complete (63065 records). [2025-10-27T19:48:48.962895] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-27T19:48:49.220213] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-27T19:48:49.350439] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-27T19:48:49.350567] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-27T19:48:49.351555] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-27T19:48:49.351619] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-27T19:48:49.352936] [DEBUG] [LOCAL ] MBC: Trimmed 63065 records to 43734 (keeping 200 days of data) [2025-10-27T19:48:49.448143] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T19:48:49.624571] [DEBUG] [LOCAL ] MBC: Primary data saved (43734 records). [2025-10-27T19:48:49.624726] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-27T19:48:49.625441] [INFO ] [MAIN ] Update Progress: 1307/2366 symbols completed. MBC took 27.0s. Estimated remaining: 2h 16m 45s. Rate: 7.7 symbols/min [2025-10-27T19:48:49.789758] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:48:49.789920] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-27T19:48:49.789956] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-27T19:48:49.790064] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-27T19:48:49.790104] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-27T19:48:49.790144] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-27T19:48:49.790174] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-27T19:48:50.014961] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-27T19:48:50.154335] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:48:50.757565] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T19:48:50.814944] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-27T19:48:50.856469] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-27T19:48:51.614947] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-27T19:48:52.414928] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-27T19:48:52.692525] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-27T19:48:52.739187] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-27T19:48:53.214937] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-27T19:48:53.607971] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T19:48:54.014918] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-27T19:48:54.072522] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T19:48:54.076032] [INFO ] [REMOTE ] MCB: Full fetch complete (16918 records). [2025-10-27T19:48:54.076127] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-27T19:48:54.456704] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-27T19:48:54.456785] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-27T19:48:54.457138] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-27T19:48:54.457176] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-27T19:48:54.457692] [DEBUG] [LOCAL ] MCB: Trimmed 16918 records to 11290 (keeping 200 days of data) [2025-10-27T19:48:54.524450] [DEBUG] [LOCAL ] MCB: Primary data saved (11290 records). [2025-10-27T19:48:54.524577] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-27T19:48:54.524678] [INFO ] [MAIN ] Update Progress: 1308/2366 symbols completed. MCB took 25.3s. Estimated remaining: 2h 16m 35s. Rate: 7.7 symbols/min [2025-10-27T19:48:54.711638] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:48:54.719118] [DEBUG] [LOCAL ] MCI: Loaded 6261 existing records from primary storage. [2025-10-27T19:48:54.719312] [INFO ] [MAIN ] MCI: Loaded 6261 existing records. [2025-10-27T19:48:54.815873] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-27T19:48:54.892566] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:48:54.892775] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-27T19:48:54.892824] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-27T19:48:54.893053] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-27T19:48:54.893111] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-27T19:48:55.248055] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:48:55.303537] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T19:48:55.614969] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-27T19:48:56.414938] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-27T19:48:56.749916] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-27T19:48:56.816443] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-27T19:48:57.006064] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-27T19:48:57.214951] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-27T19:48:58.014945] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-27T19:48:58.814929] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-27T19:48:58.943744] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-27T19:48:59.335211] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-27T19:48:59.487772] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T19:48:59.614917] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-27T19:49:00.414986] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-27T19:49:01.214963] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-27T19:49:02.015012] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-27T19:49:02.404761] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-10-27T19:49:02.815020] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-27T19:49:03.323938] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (2.91 seconds). [2025-10-27T19:49:03.614957] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-27T19:49:04.222436] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (3.01 seconds). [2025-10-27T19:49:04.230457] [INFO ] [REMOTE ] MC: Full fetch complete (63109 records). [2025-10-27T19:49:04.230599] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-27T19:49:04.345759] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-27T19:49:04.416300] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-27T19:49:04.631268] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-27T19:49:04.631345] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-27T19:49:04.632266] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-27T19:49:04.632328] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-27T19:49:04.633564] [DEBUG] [LOCAL ] MC: Trimmed 63109 records to 43384 (keeping 200 days of data) [2025-10-27T19:49:04.895170] [DEBUG] [LOCAL ] MC: Primary data saved (43384 records). [2025-10-27T19:49:04.895376] [INFO ] [MAIN ] MC: Full history saved. [2025-10-27T19:49:04.895474] [INFO ] [MAIN ] Update Progress: 1309/2366 symbols completed. MC took 37.1s. Estimated remaining: 2h 16m 29s. Rate: 7.7 symbols/min [2025-10-27T19:49:05.080787] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-27T19:49:05.097950] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:49:05.123532] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-27T19:49:05.128388] [INFO ] [REMOTE ] MBI: Full fetch complete (35531 records). [2025-10-27T19:49:05.128489] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-27T19:49:05.223675] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-27T19:49:05.238274] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T19:49:05.428022] [DEBUG] [LOCAL ] MCK: Loaded 38481 existing records from primary storage. [2025-10-27T19:49:05.449772] [INFO ] [MAIN ] MCK: Loaded 38481 existing records. [2025-10-27T19:49:05.717426] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-27T19:49:05.719332] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-27T19:49:05.737965] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-27T19:49:05.739592] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-27T19:49:05.743837] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:49:05.744319] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-27T19:49:05.744517] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-27T19:49:05.744703] [DEBUG] [LOCAL ] MBI: Trimmed 35531 records to 23562 (keeping 200 days of data) [2025-10-27T19:49:05.745032] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-27T19:49:05.745139] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-27T19:49:06.027173] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-27T19:49:06.232530] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:49:06.252375] [DEBUG] [LOCAL ] MBI: Primary data saved (23562 records). [2025-10-27T19:49:06.252576] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-27T19:49:06.252705] [INFO ] [MAIN ] Update Progress: 1310/2366 symbols completed. MBI took 42.2s. Estimated remaining: 2h 16m 17s. Rate: 7.7 symbols/min [2025-10-27T19:49:06.441905] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:49:06.453891] [DEBUG] [LOCAL ] MCN: Loaded 8104 existing records from primary storage. [2025-10-27T19:49:06.454195] [INFO ] [MAIN ] MCN: Loaded 8104 existing records. [2025-10-27T19:49:06.644820] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:49:06.645166] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-27T19:49:06.645223] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-27T19:49:06.645412] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-27T19:49:06.645455] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-27T19:49:06.823098] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-27T19:49:06.914017] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-27T19:49:07.050615] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:49:07.469435] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-27T19:49:07.614949] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-27T19:49:08.031391] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-27T19:49:08.414930] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-27T19:49:08.524927] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T19:49:09.214939] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-27T19:49:10.014954] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-27T19:49:10.607620] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-27T19:49:10.654037] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T19:49:10.753378] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T19:49:10.814939] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-27T19:49:11.565405] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T19:49:11.614980] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-27T19:49:12.155262] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-27T19:49:12.414942] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-27T19:49:13.214997] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-27T19:49:14.014976] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-27T19:49:14.144094] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T19:49:14.760739] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-27T19:49:14.799567] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-27T19:49:14.814897] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-27T19:49:15.614997] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-27T19:49:16.184176] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T19:49:16.216897] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T19:49:16.414959] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-27T19:49:17.214957] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-27T19:49:17.622207] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T19:49:17.817917] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T19:49:18.014993] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-27T19:49:18.403469] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-27T19:49:18.814965] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-27T19:49:19.423450] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-27T19:49:19.614963] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-27T19:49:20.323905] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-27T19:49:20.414940] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-27T19:49:21.214973] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-27T19:49:22.014982] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-27T19:49:22.185500] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-27T19:49:22.589969] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T19:49:22.753967] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-27T19:49:22.814934] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-27T19:49:23.551320] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-27T19:49:23.614941] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-27T19:49:24.106627] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-27T19:49:24.414963] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-27T19:49:25.132188] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T19:49:25.134014] [INFO ] [REMOTE ] MCN: Full fetch complete (11506 records). [2025-10-27T19:49:25.134083] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-27T19:49:25.220235] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-27T19:49:25.496885] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-27T19:49:25.496969] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-27T19:49:25.497265] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-27T19:49:25.497304] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-27T19:49:25.497762] [DEBUG] [LOCAL ] MCN: Trimmed 11506 records to 7854 (keeping 200 days of data) [2025-10-27T19:49:25.542135] [DEBUG] [LOCAL ] MCN: Primary data saved (7854 records). [2025-10-27T19:49:25.542261] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-27T19:49:25.542347] [INFO ] [MAIN ] Update Progress: 1311/2366 symbols completed. MCN took 19.3s. Estimated remaining: 2h 16m 18s. Rate: 7.7 symbols/min [2025-10-27T19:49:25.704707] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:49:25.741777] [DEBUG] [LOCAL ] MCO: Loaded 40099 existing records from primary storage. [2025-10-27T19:49:25.742066] [INFO ] [MAIN ] MCO: Loaded 40099 existing records. [2025-10-27T19:49:25.913474] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:49:25.913693] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-27T19:49:25.913750] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-27T19:49:25.913928] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-27T19:49:25.913964] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-27T19:49:26.020157] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-27T19:49:26.265618] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:49:26.594349] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-27T19:49:26.621263] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-27T19:49:26.623163] [INFO ] [REMOTE ] MCI: Full fetch complete (9782 records). [2025-10-27T19:49:26.623261] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-27T19:49:26.820130] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-27T19:49:27.006978] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-27T19:49:27.007051] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-27T19:49:27.007285] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-27T19:49:27.007327] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-27T19:49:27.007769] [DEBUG] [LOCAL ] MCI: Trimmed 9782 records to 6120 (keeping 200 days of data) [2025-10-27T19:49:27.043260] [DEBUG] [LOCAL ] MCI: Primary data saved (6120 records). [2025-10-27T19:49:27.043381] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-27T19:49:27.043459] [INFO ] [MAIN ] Update Progress: 1312/2366 symbols completed. MCI took 32.5s. Estimated remaining: 2h 16m 5s. Rate: 7.7 symbols/min [2025-10-27T19:49:27.211464] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:49:27.221703] [DEBUG] [LOCAL ] MCR: Loaded 8940 existing records from primary storage. [2025-10-27T19:49:27.221933] [INFO ] [MAIN ] MCR: Loaded 8940 existing records. [2025-10-27T19:49:27.393493] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:49:27.393736] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-27T19:49:27.393788] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-27T19:49:27.394027] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-27T19:49:27.394082] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-27T19:49:27.624519] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-27T19:49:27.766755] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:49:28.044991] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-27T19:49:28.415002] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-27T19:49:28.644394] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T19:49:28.655892] [INFO ] [REMOTE ] MCD: Full fetch complete (77119 records). [2025-10-27T19:49:28.656086] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-27T19:49:28.852582] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-27T19:49:28.853472] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:49:28.853544] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:49:28.853616] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-27T19:49:28.853722] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-27T19:49:28.853769] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-27T19:49:28.853854] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-27T19:49:28.853929] [INFO ] [MAIN ] Update Progress: 1313/2366 symbols completed. MCD took 39.2s. Estimated remaining: 2h 15m 53s. Rate: 7.7 symbols/min [2025-10-27T19:49:29.040026] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-27T19:49:29.043147] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:49:29.073974] [DEBUG] [LOCAL ] MCS: Loaded 21485 existing records from primary storage. [2025-10-27T19:49:29.074342] [INFO ] [MAIN ] MCS: Loaded 21485 existing records. [2025-10-27T19:49:29.219413] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-27T19:49:29.255274] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:49:29.255475] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-27T19:49:29.255520] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-27T19:49:29.255718] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-27T19:49:29.255774] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-27T19:49:29.621625] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:49:29.814738] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T19:49:30.014935] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-27T19:49:30.814918] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-27T19:49:30.882953] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T19:49:31.614940] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-27T19:49:31.845903] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-27T19:49:32.414948] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-27T19:49:32.628886] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-27T19:49:33.214947] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-27T19:49:33.806371] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T19:49:33.812877] [INFO ] [REMOTE ] MCK: Full fetch complete (56445 records). [2025-10-27T19:49:33.813017] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-27T19:49:34.023757] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-27T19:49:34.223675] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-27T19:49:34.223779] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-27T19:49:34.224847] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-27T19:49:34.224960] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-27T19:49:34.241272] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-27T19:49:34.247092] [DEBUG] [LOCAL ] MCK: Trimmed 56445 records to 37561 (keeping 200 days of data) [2025-10-27T19:49:34.478122] [DEBUG] [LOCAL ] MCK: Primary data saved (37561 records). [2025-10-27T19:49:34.478261] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-27T19:49:34.478677] [INFO ] [MAIN ] Update Progress: 1314/2366 symbols completed. MCK took 29.6s. Estimated remaining: 2h 15m 43s. Rate: 7.8 symbols/min [2025-10-27T19:49:34.644879] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:49:34.668118] [DEBUG] [LOCAL ] MCY: Loaded 23761 existing records from primary storage. [2025-10-27T19:49:34.668362] [INFO ] [MAIN ] MCY: Loaded 23761 existing records. [2025-10-27T19:49:34.820542] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-27T19:49:34.844990] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:49:34.845266] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-27T19:49:34.845313] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-27T19:49:34.845485] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-27T19:49:34.845522] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-27T19:49:34.933019] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-27T19:49:35.213540] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:49:35.614980] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-27T19:49:35.645517] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T19:49:36.213107] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-27T19:49:36.414935] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-27T19:49:36.531075] [DEBUG] [REMOTE ] MCY: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-27T19:49:36.531316] [WARN ] [REMOTE ] MCY: No data returned for month 2025-01 [2025-10-27T19:49:36.531403] [FATAL] [REMOTE ] MCY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:49:36.531475] [FATAL] [MAIN ] MCY: Failed to fetch primary data. [2025-10-27T19:49:36.531541] [WARN ] [MAIN ] MCY: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:49:36.531610] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-27T19:49:36.531701] [DEBUG] [LOCAL ] MCY: No primary data file found to delete. [2025-10-27T19:49:36.531752] [INFO ] [LOCAL ] MCY: Starting deletion of derivative data. [2025-10-27T19:49:36.531916] [DEBUG] [LOCAL ] MCY: Deleted derivative data file. [2025-10-27T19:49:36.532006] [INFO ] [MAIN ] Update Progress: 1315/2366 symbols completed. MCY took 2.1s. Estimated remaining: 2h 15m 31s. Rate: 7.8 symbols/min [2025-10-27T19:49:36.698513] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:49:36.736178] [DEBUG] [LOCAL ] MD: Loaded 39054 existing records from primary storage. [2025-10-27T19:49:36.736441] [INFO ] [MAIN ] MD: Loaded 39054 existing records. [2025-10-27T19:49:36.908695] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:49:36.908885] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-27T19:49:36.908930] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-27T19:49:36.909250] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-27T19:49:36.909305] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-27T19:49:37.220121] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-27T19:49:37.288199] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:49:37.961518] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-27T19:49:38.014900] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-27T19:49:38.799934] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-27T19:49:38.814903] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-27T19:49:39.463252] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-27T19:49:39.614926] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-27T19:49:40.414935] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-27T19:49:40.600039] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T19:49:41.214949] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-27T19:49:41.266459] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-27T19:49:42.014929] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-27T19:49:42.494622] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-27T19:49:42.605480] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T19:49:42.814951] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-27T19:49:43.614945] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-27T19:49:44.403920] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-27T19:49:44.414897] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-27T19:49:44.513088] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-27T19:49:44.515494] [INFO ] [REMOTE ] MCR: Full fetch complete (13414 records). [2025-10-27T19:49:44.515593] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-27T19:49:44.879423] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-27T19:49:44.879497] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-27T19:49:44.879810] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-27T19:49:44.879870] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-27T19:49:44.880320] [DEBUG] [LOCAL ] MCR: Trimmed 13414 records to 8810 (keeping 200 days of data) [2025-10-27T19:49:44.930107] [DEBUG] [LOCAL ] MCR: Primary data saved (8810 records). [2025-10-27T19:49:44.930229] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-27T19:49:44.930302] [INFO ] [MAIN ] Update Progress: 1316/2366 symbols completed. MCR took 17.9s. Estimated remaining: 2h 15m 24s. Rate: 7.8 symbols/min [2025-10-27T19:49:45.101279] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:49:45.108963] [DEBUG] [LOCAL ] MDST: Loaded 6257 existing records from primary storage. [2025-10-27T19:49:45.109181] [INFO ] [MAIN ] MDST: Loaded 6257 existing records. [2025-10-27T19:49:45.220026] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-27T19:49:45.295071] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:49:45.295438] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-27T19:49:45.295494] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-27T19:49:45.295753] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-27T19:49:45.295812] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-27T19:49:45.666748] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:49:45.946726] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T19:49:46.014915] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-27T19:49:46.116384] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-27T19:49:46.544110] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-27T19:49:46.814928] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-27T19:49:47.382510] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-27T19:49:47.614911] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-27T19:49:48.414952] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-27T19:49:48.640386] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T19:49:49.214968] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-27T19:49:49.442153] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-27T19:49:49.818001] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T19:49:50.014966] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-27T19:49:50.814988] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-27T19:49:51.364563] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T19:49:51.614962] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-27T19:49:51.892444] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-27T19:49:51.990096] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-27T19:49:52.414974] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-27T19:49:53.214939] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-27T19:49:53.578228] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-27T19:49:54.021217] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-27T19:49:54.026245] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T19:49:54.567159] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-27T19:49:54.814937] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-27T19:49:55.614985] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-27T19:49:56.181080] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-27T19:49:56.414924] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-27T19:49:56.584560] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-27T19:49:56.830106] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-27T19:49:57.214940] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-27T19:49:58.014945] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-27T19:49:58.754177] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-27T19:49:58.780949] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-27T19:49:58.814907] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-27T19:49:59.614934] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-27T19:49:59.949887] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T19:50:00.414938] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-27T19:50:01.214926] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-27T19:50:01.468148] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-27T19:50:02.014984] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-27T19:50:02.814959] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-27T19:50:02.869410] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T19:50:03.070185] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-10-27T19:50:03.217743] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-27T19:50:03.614928] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-27T19:50:04.414925] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-27T19:50:04.479763] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-27T19:50:05.214925] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-27T19:50:05.374499] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-27T19:50:05.381353] [INFO ] [REMOTE ] MCS: Full fetch complete (30701 records). [2025-10-27T19:50:05.381503] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-27T19:50:05.697985] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-27T19:50:05.717447] [INFO ] [REMOTE ] MDST: Full fetch complete (8918 records). [2025-10-27T19:50:05.733134] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-27T19:50:05.962980] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-27T19:50:05.974475] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-27T19:50:05.985435] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-27T19:50:05.993364] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-27T19:50:06.020160] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-27T19:50:06.023718] [DEBUG] [LOCAL ] MCS: Trimmed 30701 records to 21024 (keeping 200 days of data) [2025-10-27T19:50:06.285200] [DEBUG] [LOCAL ] MCS: Primary data saved (21024 records). [2025-10-27T19:50:06.326921] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-27T19:50:06.340083] [INFO ] [MAIN ] Update Progress: 1317/2366 symbols completed. MCS took 37.5s. Estimated remaining: 2h 15m 27s. Rate: 7.7 symbols/min [2025-10-27T19:50:06.340279] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-27T19:50:06.340512] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-27T19:50:06.340796] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-27T19:50:06.340856] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-27T19:50:06.341254] [DEBUG] [LOCAL ] MDST: Trimmed 8918 records to 6157 (keeping 200 days of data) [2025-10-27T19:50:06.378591] [DEBUG] [LOCAL ] MDST: Primary data saved (6157 records). [2025-10-27T19:50:06.378746] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-27T19:50:06.378836] [INFO ] [MAIN ] Update Progress: 1318/2366 symbols completed. MDST took 21.4s. Estimated remaining: 2h 15m 13s. Rate: 7.8 symbols/min [2025-10-27T19:50:06.521332] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T19:50:06.814999] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-27T19:50:07.771880] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-27T19:50:07.780902] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-27T19:50:08.212951] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T19:50:08.415022] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-27T19:50:09.221072] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T19:50:09.229053] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-27T19:50:09.598629] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T19:50:10.015008] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-27T19:50:10.682947] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-27T19:50:10.691625] [INFO ] [REMOTE ] MD: Full fetch complete (55357 records). [2025-10-27T19:50:10.691819] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-27T19:50:11.113410] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-27T19:50:11.113489] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-27T19:50:11.114374] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-27T19:50:11.114438] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-27T19:50:11.115566] [DEBUG] [LOCAL ] MD: Trimmed 55357 records to 38402 (keeping 200 days of data) [2025-10-27T19:50:11.336413] [DEBUG] [LOCAL ] MD: Primary data saved (38402 records). [2025-10-27T19:50:11.336550] [INFO ] [MAIN ] MD: Full history saved. [2025-10-27T19:50:11.336984] [INFO ] [MAIN ] Update Progress: 1319/2366 symbols completed. MD took 34.8s. Estimated remaining: 2h 15m 3s. Rate: 7.8 symbols/min [2025-10-27T19:50:11.948060] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-27T19:50:11.961213] [INFO ] [REMOTE ] MCO: Full fetch complete (58493 records). [2025-10-27T19:50:11.961420] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-27T19:50:12.358766] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-27T19:50:12.358841] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-27T19:50:12.359830] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-27T19:50:12.359892] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-27T19:50:12.361029] [DEBUG] [LOCAL ] MCO: Trimmed 58493 records to 39288 (keeping 200 days of data) [2025-10-27T19:50:12.616235] [DEBUG] [LOCAL ] MCO: Primary data saved (39288 records). [2025-10-27T19:50:12.616416] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-27T19:50:12.616525] [INFO ] [MAIN ] Update Progress: 1320/2366 symbols completed. MCO took 47.1s. Estimated remaining: 2h 14m 50s. Rate: 7.8 symbols/min [2025-10-27T19:50:13.162064] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:50:13.332236] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:50:13.336026] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:50:13.358009] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:50:13.364258] [DEBUG] [LOCAL ] MDV: Loaded 8375 existing records from primary storage. [2025-10-27T19:50:13.364956] [INFO ] [MAIN ] MDV: Loaded 8375 existing records. [2025-10-27T19:50:13.489047] [DEBUG] [LOCAL ] MEC: Loaded 17160 existing records from primary storage. [2025-10-27T19:50:13.500359] [INFO ] [MAIN ] MEC: Loaded 17160 existing records. [2025-10-27T19:50:13.685191] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:50:13.740480] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-27T19:50:13.757837] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-27T19:50:13.757684] [DEBUG] [LOCAL ] MDT: Loaded 54458 existing records from primary storage. [2025-10-27T19:50:13.769747] [DEBUG] [LOCAL ] MDU: Loaded 48743 existing records from primary storage. [2025-10-27T19:50:13.785014] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-27T19:50:13.790860] [INFO ] [MAIN ] MDT: Loaded 54458 existing records. [2025-10-27T19:50:13.791212] [INFO ] [MAIN ] MDU: Loaded 48743 existing records. [2025-10-27T19:50:13.809401] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-27T19:50:14.038094] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:50:14.179604] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-27T19:50:14.223478] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-27T19:50:14.370124] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:50:14.393755] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-27T19:50:14.359060] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-27T19:50:14.409745] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-27T19:50:14.445871] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-27T19:50:14.492787] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:50:14.481933] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-27T19:50:14.529868] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-27T19:50:14.580443] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-27T19:50:14.689142] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-27T19:50:14.787092] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-27T19:50:14.792543] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-27T19:50:15.227995] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:50:15.278896] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-27T19:50:15.663851] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:50:15.745416] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-27T19:50:15.907894] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:50:15.940189] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:50:15.940751] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-27T19:50:15.941339] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-27T19:50:16.105260] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-27T19:50:16.107128] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-27T19:50:16.368066] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-27T19:50:16.371245] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-27T19:50:16.783600] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-27T19:50:16.785519] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-27T19:50:16.975611] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T19:50:16.978219] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-27T19:50:17.023121] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-27T19:50:17.214962] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-27T19:50:17.335526] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-27T19:50:17.633904] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-27T19:50:17.655855] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T19:50:18.014924] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-27T19:50:18.755525] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-27T19:50:18.814954] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-27T19:50:19.614954] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-27T19:50:19.968249] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-27T19:50:20.056791] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-27T19:50:20.414993] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-27T19:50:20.458884] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T19:50:21.214960] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-27T19:50:21.744198] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-27T19:50:21.967812] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-27T19:50:22.014917] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-27T19:50:22.814941] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-27T19:50:23.614926] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-27T19:50:23.772137] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T19:50:23.944526] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T19:50:24.363120] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-27T19:50:24.414898] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-27T19:50:24.885259] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-27T19:50:25.214941] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-27T19:50:25.648867] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-27T19:50:26.014947] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-27T19:50:26.814967] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-27T19:50:27.614921] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-27T19:50:27.913432] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-27T19:50:28.185211] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T19:50:28.306119] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T19:50:28.414918] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-27T19:50:29.214959] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-27T19:50:29.859160] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T19:50:30.014939] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-27T19:50:30.656547] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-27T19:50:30.814971] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-27T19:50:30.849699] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T19:50:31.614937] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-27T19:50:31.968024] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T19:50:32.414962] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-27T19:50:32.895702] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-27T19:50:32.897725] [INFO ] [REMOTE ] MDV: Full fetch complete (11711 records). [2025-10-27T19:50:32.897805] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-27T19:50:33.219481] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-27T19:50:33.294033] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-27T19:50:33.294161] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-27T19:50:33.294471] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-27T19:50:33.294534] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-27T19:50:33.295348] [DEBUG] [LOCAL ] MDV: Trimmed 11711 records to 8221 (keeping 200 days of data) [2025-10-27T19:50:33.344618] [DEBUG] [LOCAL ] MDV: Primary data saved (8221 records). [2025-10-27T19:50:33.344845] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-27T19:50:33.345046] [INFO ] [MAIN ] Update Progress: 1321/2366 symbols completed. MDV took 20.7s. Estimated remaining: 2h 14m 53s. Rate: 7.7 symbols/min [2025-10-27T19:50:33.524157] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:50:33.551349] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-27T19:50:33.580910] [DEBUG] [LOCAL ] MED: Loaded 21277 existing records from primary storage. [2025-10-27T19:50:33.581155] [INFO ] [MAIN ] MED: Loaded 21277 existing records. [2025-10-27T19:50:33.752961] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:50:33.753176] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-27T19:50:33.753221] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-27T19:50:33.753493] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-27T19:50:33.753549] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-27T19:50:34.020058] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-27T19:50:34.118327] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:50:34.129700] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T19:50:34.814953] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-27T19:50:35.232939] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-27T19:50:35.614944] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-27T19:50:36.057819] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T19:50:36.414973] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-27T19:50:36.606888] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-27T19:50:37.214970] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-27T19:50:38.022558] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-27T19:50:38.025679] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T19:50:38.287881] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-27T19:50:38.814937] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-27T19:50:39.423084] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T19:50:39.614950] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-27T19:50:40.326630] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (0.71 s