This actually begs the question concerning a great many individuals with voting responsibilities (that's not a snarky comment).
And frankly, receiving a ballot by definition makes one the arbiter of whether a player is deserving or not. It's a significant burden. Whether one agrees with Fay's actions or not (and I dont), I think its clear he made his decision with this burden in mind and was trying to fulfill his obligation to the best of his ability.