We do not currently know of any antonyms for make a beginning.
For similar words to make a beginning, try: