Assume we have infinite training data, where each feature has unknown correlations with other features. Have we already perfectly solved the problem of assigning class based on this data?
For example, is an SVM using the kernel trick for feature selection going to create the optimal answer based on the data?
[link][6 comments]