Is this on me? Am I to blame for this boy's problems?

I don't think you were wrong at all. It's sad that the boy is in the middle but that should be on his grandmother, not on you at all. You were protecting yourself by cutting all ties. If someone accused me of being a child molester I wouldn't have anything to do with them either.