We have done the Outerbanks thrice(people need to use thrice more). My advice with a little one: you and your wife, rest up during the day and take off at dark. Drive overnight. Take turns when necessary. Let the kid sleep. Chew up as much mileage overnight. You can be most of the way across Virginia when the sun comes up. If you are going somewhere to sit at the beach and watch the water, and relax, driving overnight isn't a big deal.