Try fishing for them right on the surface in the early morning hours, when it is still dark. Save the downriggin' for later in the day. I use an 8 ounce banana weight and let out just 20' of line.