Menuing issues in town

A new bug happened to me since 0.4: when I load the game, everything works fine.

But after a few minutes, interactions with NPCs become wonky. Clicking on The Hooded One immediately opens the passive tree, without allowing me to pick a conversation or identify items.
When a vendor has a reward, the reward is unclickable.
In shop menus or in my stash, ctrl+click doesn't work to send items from one side to the next, it has to be done manually.

Logging out and back in doesn't solve the issue. Closing PoE2 entirely and then launching it again fixes it all temporarily.

In some more extreme cases, the entire keyboard become unresponsive and I can neither move nor quit (while the mouse still works normally), although I'm not sure if it's the same issue or a different one.

OS is Bazzite, all up-to-date to the latest versions. No other issue in any other game, and there was no issue in PoE2 0.2 (I skipped 0.3).

EDIT: well, the following day I played for 5h and didn't have any of these issues. Something from the latest patch?
Will update if the issue comes back.