Seems need to create a clone and remove the old one based on the answer from https://stackoverflow.com/a/42231765
# create a clone environment
conda create --name new_name --clone old_name
# remove the old one
conda remove --name old_name --all # or its alias: `conda env remove --name old_name`