See:
Miami Hurricanes pre-Schnellenberger
Florida Gators pre-Spurrier
Virginia Tech pre-Beamer
Florida State pre-Bowden
All had marginal football programs before and are now national powers (to varying degrees). Not that this is the norm, but history has shown that previously marginal programs can achieve sustained success.