This reminds me of when I was at a restaurant once and this couple in their thirties walked in. The host walked them over to a table near some children who were playing the video games/claw machine and the woman asked "Are there any sections without kids?" The waiter hesitated for a second, then reminded her "This is a family restaurant, m'am."
I can't identify with people who expect young kids to go to a ball game and not say a word. They're kids. Unless they are touching you, shooting spitballs at the back of your head, or yelling directly into your ear I don't see what the big deal is. It's a ballgame, not the opera.