The past tense of feel remorse is felt remorse.
The third-person singular simple present indicative form of feel remorse is feels remorse.
The present participle of feel remorse is feeling remorse.
The past participle of feel remorse is felt remorse.