Thankfully you can stop it. Go to your watch history and remove videos that are messing up your recommendations.