I think the federation system is quite a barricade for some people. I recently changed over to Lemmy from Reddit, and it was quite challenging to first understand how it worked. Also I am not sure that I even now understand how this works fully.

Also the smaller community on Lemmy might be a turn-off for some people.