The problem then is that by responding, you’re engaging with it which typically helps it spread in the algorithms*. Ideally there should be multiple downvote options - maybe separate it out as “misinformation” vs “bad opinion” or something. Removing downvotes and banning users who disagree is the typical cult strategy (recall the classic cult sub, r/thedonald, was notorious for this). If you’re worried about downvotes being used to silence people, maybe another way to mitigate that would be a “sort by downvoted” option so that being downvoted a lot could actually put you at the top of at least that feed.
*On Lemmy, notice the following:
Active (default): Calculates a rank based on the score and time of the latest comment, with decay over time
At least it’s not driving straight into a tree, I call that an improvement.