I too can tell when a cormorant has been around. My fish get spooked just like you said. When I see this I make extra passes during the day to look for him. Sure enough, I always spot one.