Is it possible to perform sparse filtering for RNNs?

Is it possible to perform sparse filtering ( http://ai.stanford.edu/~ang/papers/nips11-SparseFiltering.pdf )for recurrent neural networks? What other unsupervised methods for feature creation using RNNs are available? I am interesting in creating time-independent features from multivariate time-dependent data using some sort of neural network approach

thanks!