Finite Neural Networks as Mixtures of Gaussian Processes: From Provable Error Bounds to Prior Selection (Journal of Machine Learning Research, 2026)