The mushroom is just the fruit of the mycelium, an organism consisting of a (sometimes very) widespread network of very fine, root-like hairs. Pulling up the mushroom has no more effect on the health, or the productivity, of this organism than the picking an apple has on its tree.