It would be nice if Mastodon automatically untagged people when you reply to a thread they haven't participated in for N messages
Until that feature is implemented you can mute a thread if it becomes a problem.
Click on the three horizontal dots and select 'Mute Conversation'.
The social network of the future: No ads, no corporate surveillance, ethical design, and decentralization! Own your data with Mastodon!