A novel method for encoding features’ Sparse Representation residuals is proposed. Multiple levels of unsupervised learning are utilized. Local gradient descriptors are encoded into fixed length vectors. The method is evaluated on the task of HEp-2 classification. The proposed framework follows recent trends on feature encoding based on residuals.