Have you considered “pecking” the center of the holes and drilling them out with a drill bit?
I have not tried it yet but this is my theory to CAM this in Fusion 360: