We do not currently know of any antonyms for riling up.
For similar words to riling up, try:
Did you mean riding up, rising up or piling up?