Harming the Environment
These two booms are entirely separate phenomena. However, since they actually occur in quick succession, they seem like one single sound. Any aircraft that is in supersonic flight emits continuous booms as it speeds through the sky. All of this might sound good and adds to all the drama at any air show, but in regular use, the novelty simply tends to wear off.
In addition, there is the issue of the negative impact it has on wildlife- this could be injury or shock in the short term. Over time, wildlife might also abandon that entire habitat. Thus, it really isn’t a surprise that some factions do not consider supersonic flight for commercial uses a very beneficial change.