From your linked post: "LLMs sometimes struggle to give legal moves. In these experiments, I try 10 times and if there’s still no legal move, I just pick one at random."
Yeah but it didn't do squat. The effective thing was a subtle prompt mod that boosted performance tremendously. I've been surprised by this forums unwillingness to read this thing...
https://dynomight.net/more-chess/