Using copyrighted images to train and algorithm?

Is it legal to use copyrighted images to train a learning algorithm? Assuming you don't publicly display the photos.

If it isn't legal, then how often does this issue actually come up in practice? I mean how would someone know if you used copyrighted photos for training?

Thanks /r/ml!

edit: should be 'an algorithm' in the title