I've said this before, but Paul Geremia is an extraordinary acoustic blues guitarist, songwriter, and singer and is definitely worth checking out.
The address is 23 Marlborough Street in Newport, RI. They have decent food.
It's been a while since I've been there, but I remember that the mapquest directions worked pretty well.