Try talking to them softly next time, and it may work out better for you!
Sounds like you did as well as most on sunday. You say your depth range is 80-110. In the morning, start shallow (30-50 ft). Then go deeper as the day goes on, or the bait warrants. If you are marking fish at 180 (its probablly bait) drop it down to 180! Remember the throw back decreases the depth your lure is at, so adjust accordingly to be at the depth the fish are haunting.
Good luck.
Neal