If anything, I've seen people walk away from trying after having seen how much time it would take. Says more about the people in T50 than the entertainment value or popularity of the game (would be a different issue if people could see how many people who actually play it, and what they do; most players haven't even discovered all the PvP events and otherwise yet). Unfortunately, a lot of people already dismiss it as a grindfest, and that ain't helping.
As for the ladder, yes, you would need to spend some time. Just not nearly enough, and the main things would be that it would be an actual close fight with other people, and anyone could get into it when they decide to.