Are you threading the main line through the weight? From your description it sounds like you might be. That will make it much harder to feel the bit. Either clamp the weight to a tag end from a knot on the swivel, or better, thread a second swivel onto the main line above the first swivel, tie 3 inches of line to that, and clamp your weight to that. That will probably make more difference than anything else.