Toms have pretty large territories but still enough to give you pause when you see one that close. If everything is locked up I doubt you will have any problems though. Cats are always around if you see them or not. Probably been there for a lot more time than you know and hasn't caused any problems yet. And yes........I know it is tough to say wait until something happens but with the precautions you are already taking I doubt you will have any issues. Never heard of one breaking down a barn door to get at any livestock. Might even get a cool mount if you happen to get lucky.