What is the benefit of using Neural Networks as opposed to Gaussian Processes?

I just read this paper (PDF) by MacKay, which I thought was very interesting.

With so much emphasis on neural networks recently, what are examples of problems where they really excel over Gaussian Processes (which can often be capable of identical mechanics)?