So, GMO would include grafting of fruit trees as that does not occur naturally. Many food crops are/were made by human-directed crossing of species of plants.

Certainly, too, GMO would include triploid fish so we should stop using those?

I can see your definition works at the far ends modifications but it gets grayer as one moves towards the middle of the distribution.