Big blues and blues poorly cared for do taste fishy. But if you keep them on ice, gut them immediately and clean the dark meat out near the lateral line like catmandoo said, they are spectacular! If you are really fishy fish sensitive, coat them lightly in mayo before cooking them and the fishy taste is somehow removed...
Catmandoo, my dad's place is almost across the river from Point Lookout... He's just up the Potomac River off Cod Creek. 15 minutes to Point Look Out. We fish alot around Smith Point light house which is on the opposite side of the mouth of the river. Point Lookout has a real steep drop off, just up river is Corn Harbor, some great flounder fishing there, they just aren't quite as big as the ones in Wachapreague Bay. We'll be hitting the trophy stripers shortly when they make their spawning runs in the morning and fish for croaker in the evenings. Now croaker are some great eating fish!
A couple pictures of Smith Point Light:
