The problem with bringing him back is that he isn't very good anymore and is holding Todd Frazier back