Similar Items: Frequentist Guarantees of Distributed (Non)-Bayesian Inference