Frequentist Guarantees of Distributed (Non)-Bayesian Inference (JMLR, 2026)