Actually it’s worse than nothing. Youtube promotes comments based on engagement, so while only an upvote increases the tally, voting at all still makes it more visible.