If You Can, You Can Latent Variable Models