Ben never met or spoke to Jacob before, but Richard has. I think the commands were given through him.
With Jack Sparrow? I agree though. The Black Rock was a slave ship and Richard has been on the Island for a long time so it fits.Was Richard in bondage perhaps on the Black Pearl?