I was up there for a conference ~3 weeks ago, and I'd say BRING A FREAKIN' COAT. Seriously, forget the bike; bring provisions and survival gear.....
That said, I had a
delightful dinner at a place on Rue Saint-Jean called Portofino (
http://portofino.ca/en/). Great Italian food, wonderful atmosphere and vibe, fantastic wait staff. I also stayed at a delightful, very reasonable historic hotel (
http://www.manoir-victoria.com/index.php/en/) a ~half block away from the restaurant. Anyway, check them out if you feel so inclined. Bring a freaking parka!