Because the hitter is rewarded for swinging at a bad pitch and the pitcher is penalized for getting the hitter to chase. It should be treated just like any other wild pitch or passed ball--any runners can advance, but batter is out.
I hear you logically, but then when first base is occupied, it suddenly doesn't matter if the catcher catches the ball to "finalize the out?"