I just started playing the game last week. I wanted to give CDPR a chance to patch the game and get it working better. Generally I think the game is pretty playable and fun. Basically the Witcher game in a new theme.
There are still some bugs (I randomly get "Insert CD" errors, one quest breaks if you kill a "boss" before another event in the questline, vehicles won't drive once in awhile), but generally the game is in a pretty good state on the XBOX Series X.
The voice acting is a mixed bag, the graphics sometimes are great, other times strangely pixilated or lots of jarring draw-in. The vehicle handling seems mushy to me, and the NPCs are not nearly as vibrant as they are in Witcher 3. I am waiting for an NPC to go "Pan peran, pan peran."
I think the game is worth playing. Not great, but not bad either.