Skill Retrait

Because I had controlled metamorphosis diamond slotted in the three, and had some skills selected in the radius, I was unable to respec as I had a slotted jewel.
After refunding those skills to be able to remove the said gem, I lost the right to the free respec.

What is up with that?