I don't know that there's a legal basis, Sunil, although I have heard there is. I am sure there are those who would think "No fishing? To heck with that - I saw that other guy fishing!" So I just try to make it clear folks should stay off my property - not try to tell them what they shouldn't do if they trespassed anyway.
If ewest or anyone else knows an actual legal position on this, I would be interested to learn it.