Yup, while the organ grinder was raiding your freedom, personal finances and future you were worshipping the monkey. The real irony is you'd still be entranced by the monkey if given a chance. Instead you complain that a miracle didn't come along and cure you from the monkey. Maybe this is what they mean by "a monkey on your back"?