Passive Skill Tree Refunds Disabled on Gem Removal

While refunding a line of skills in the passive skill tree, I had to take a gem out of the socket to continue refunding.

As soon as I did, the refunding stopped, and every time I tried to reenter the refund page, it was just the regular passive page with no refunding.