Baseball and hockey have minor league systems where even decent players spend a fair amount of time before getting up to the big time. Unless you're a big time draft pick with a large signing bonus, it might be a while before you cash in. You're a suburban kid who grew up well off and you don't look at sports as a way out. You play what you enjoy most.
You're an athletic kid growing up in a poor urban setting and sports presents a way out, but you might gravitate toward a sport that offers more of an immediate payoff.
I don't think that's the whole reason, but maybe it's one factor.