Originally Posted by Strikes Out Looking
Most of the advice above was pretty good. To get to Fells Point, you can take a water taxi from inner harbor. It's fairly cheap.
I've also taken the Baltimore Duck tour. It's a vehicle that goes on land and water and leaves from a spot between the inner harbor mall and the science museum (just a few blocks from your hotel). It's about an 1 and 1/2 hour tour and gives a really good description of Baltimore's downtown area.
I'll second the duck tour. It's pretty interesting. The one in Boston is good too.