Same thing is going on at my neighbors. Flickers punched several holes through south siding that was soft from rot. He covered those holes with patches but left a small hole uncovered. Nuthatches came in and started to enlarge the hole and pull insulation out. Surprised me to see nuthatches drilling away just like tiny woodpeckers.