We do not currently know of any antonyms for be a regular visitor to.
For similar words to be a regular visitor to, try: