I’m pretty sure the big bois don’t do it because it would undermine “confidence”.
Seeing a model output “Oh I should just delete blah. Wait blah is a production service, I shouldn’t touch that. Maybe I can gain access to blah? Oh the aws cli isn’t signed in to blah. I see kubectl has access to blah though! Wait, I should ask user permission first.”
Idk I feel like the more likely answer is to prevent distillation. Having the thinking is definitely better UX (oftentimes, I don’t know if Codex is just hanging, which it often does, or working in silence).
You can double click on the 'thinking' text and it will expand and you can read it. The problem is that it will often have multiple thinking/tool call sections and it can be a needle/haystack problem to find the one with the thinking you are interested in.
Ah, but you CAN see the thinking if you are willing to risk your account being banned. You just have to expose a "tool" with a specially crafted definition.
Probably important to call out this part of the post:
Zero-shot vs. Fine-tuning: Out-of-the-box base models score ~0.35 on the typed-decisions benchmark (near random). The 0.766 score is achieved by fine-tuning on the benchmark's train split. Treat Laya as a fast foundation model to specialize, not as an omniscient zero-shot oracle.
This is something I actually cover in the follow-up project's how-to. Ask the AI to sense check the info you've supplied. It can tell you "hey, maybe you should mention venue address".
The wizards don’t become sourcerers themselves - they become enthusiastic users of someone else’s sourcery. Their years of learning don’t protect them from mistaking access to power for mastery of it.
He assumed that the payment is the same meaning the principal for the same house went down and so this is neutral. If your payment is the same it doesn't matter what is principal vs interest. In the best cases rates go down in the future and then you refinance and your payment goes way down.
House prices tend to be "sticky", so that assumption is probably wrong. People who own a house often cannot afford to sell for the current value since it won't pay off their loan and leave enough money left over for a replacement house so they avoid moving. Eventually things get bad enough that they "sell short", but that takes a credit hit so you don't want to do that until the loss is large (and in turn you gain more).
It seems every question is great on the presentations I'm listening to, which is practically impossible. It's most likely a bell-shaped curve on the greatness scale. We should be hearing "that's a bad question" every now and then.
reply