It Just Takes Two: Scaling Amortized Inference to Large Sets (ArXiv cs.LG Recent Papers, 2026)