Hacker Newsnew | past | comments | ask | show | jobs | submit | anon291's commentslogin

Christian and Buddhist monastic traditions are so uncannily similar it's difficult to really think they developed without influence. That's my opinion. Even the Europeans who first set foot in Asia during the age of discovery thought they were being played tricks on, so I don't think it's that wild an idea

The problem isn't really the wildness of the idea (or its direct implications). The problem is that there is almost 2,000 years of culture and the metaphysical beliefs of well-more than half of the human population predicated upon their beliefs being entirely unique and an off-shoot of Judaism and not a fundamentally different syncretic import from the east.

Earlier today, I was listening to Evangelical Christian Radio while doing errands (my phone is broken and I live deep in Red America) and the pastor, Alistair Begg, was making the argument that the synoptic gospels are totally unique in what they are. The format is unprecedented. They're not biographies. They're not systematic theology. It's just a direct witness to Jesus Christ. And so on. Therefore, they're historically valid and true, etc.

But if you have read the Pali Canon or other collections of sutras and agamas, it's almost blindingly obvious that the structure of the pericopic episodes found in the synoptic gospels aren't really unique at all.

As a random example:

From Majjhima Nikaya 55 (trans. Thanissaro): I have heard that on one occasion the Blessed One was staying near Rājagaha, in Jīvaka Komārabhacca’s mango grove. Then Jīvaka Komārabhacca went to the Blessed One and, on arrival, having bowed down to him, sat to one side. As he was sitting there he said to the Blessed One, “Lord, I have heard it said that ‘They slaughter animals for the sake of Gotama the contemplative. Gotama the contemplative knowingly eats the meat prepared for his sake in dependence on that action.’ Those who say, ‘They slaughter animals for the sake of Gotama the contemplative. Gotama the contemplative knowingly eats the meat prepared for his sake in dependence on that action’: Are they speaking in line with what the Blessed One has said, are they not slandering the Blessed One with what is unfactual, and are they speaking in line with the Dhamma so that no one whose thinking is in line with the Dhamma would have grounds for criticizing them?”

Compared to say, Mark 7 (trans. NIV):

The Pharisees and some of the teachers of the law who had come from Jerusalem gathered around Jesus and saw some of his disciples eating food with hands that were defiled, that is, unwashed. (The Pharisees and all the Jews do not eat unless they give their hands a ceremonial washing, holding to the tradition of the elders. When they come from the marketplace they do not eat unless they wash. And they observe many other traditions, such as the washing of cups, pitchers and kettles. So the Pharisees and teachers of the law asked Jesus, “Why don’t your disciples live according to the tradition of the elders instead of eating their food with defiled hands?”

And so on and so forth. The parallels don't end there, but I've probably gone on long enough of a rant. And this wouldn't even be the first time something like that happened in the Greek world. Pyrrho very likely did something very similar. Plus, the phenomena has modern equivalents as well. Look at how many mindfulness courses and therapy interventions in the West just file the serial numbers off of Buddhism (e.g. CBT, ACT).

So yeah. The pieces are all there, but literally be damned by others if you put them together.


People keep highlighting very minor and accidental similarities, like the OP, or some surface-level similarities between the two texts you cite. Yet they seem to ignore essential and basic differences, not only about the Divine Nature but also about very basic questions like whether change is real or illusory, or whether a person exists from moment to moment. I just listed a bunch of them in my previous post. I don't see how anyone can realistically claim Christianity is syncretic with anything eastern. And historically, it was persecuted for three centuries precisely because it refused to be syncretic -- the Romans were happy to tolerate additions to their partheon but couldn't abide Christianity's claims to exclusivity.

Thanks for illustrating my point.

You didn't actually point to anything substantial; you kind of hand-waved at what you presumed "eastern religions" posit, but there are literally hundreds of eastern religions and philosophies that do in fact have very different attitudes towards the divine and basic metaphysics. The very first sutta of the Dīgha Nikāya--the Brahmajāla Sutta--has a section where the Buddha directly enumerates and engages with 62 of them present just in his neck of the world. Sectarianism, too, is as prevalent in the East as it is in the West. None of these things are monoliths. The world is large.

I honestly don't think you have the wisdom, the charity, or breadth of experience to understand or appreciate anything that I've written. And that's okay. You have a very real and meaningful investment in dismissing a priori the claims that I'm making, which is entirely understandable, especially for a Catholic who takes their faith seriously, as it would be for anyone else whose beliefs are jeopardized by implication. That's exactly the firewall that I'm talking about.

I don't expect the firewall to fail, in any case, so don't worry there. Catholicism is lindy. And if that firewall ever does fall and any of what I've written is integrated into the Standard Narrative, I'm sure Catholicism will also adjust to it, just like they've done every other time it has happened.


You seem to be responding to something I didn't say. I have no doubt that "there are literally hundreds of eastern religions and philosophies", or that the Buddha is reported as engaging with them.

In your previous post, you claimed something different:

>>> [T]here is almost 2,000 years of culture and the metaphysical beliefs of well-more than half of the human population predicated upon their beliefs being entirely unique and an off-shoot of Judaism and not a fundamentally different syncretic import from the east.

This is a different claim entirely.

Christianity is not 'a syncretic import from the east'. One way we know this is by looking at its differences with eastern ideas. What would first-century Christianity make of the denial of diachronic identity (the self is an illusion), or the denial of the idea that God is personal? You accuse me of 'hand waving'. I'm not sure where I do this. Am I wrong to claim that the ideas I listed are associated with the east? Does the undoubted fact that there are hundreds of eastern religions and philosophies undermine the claim?

Do you agree with my point that Christianity "was persecuted for three centuries precisely because it refused to be syncretic -- the Romans were happy to tolerate additions to their pantheon but couldn't abide Christianity's claims to exclusivity"?

There's quite a bit of mind-reading (in the CBT sense of the word) in your post that I don't really want to respond to because it doesn't advance the argument.


>Christianity is not 'a syncretic import from the east'. One way we know this is by looking at its differences with eastern ideas. What would first-century Christianity make of the denial of diachronic identity (the self is an illusion), or the denial of the idea that God is personal?

You're still doing the exact same thing. "Eastern ideas" is a leaky set and faulty abstraction. You have pointed to no actual bounded idea or ideology within that set. You proceed to attribute two ideas--the illusory self and non-theism--to that set, again without referent to anything.

>Am I wrong to claim that the ideas I listed are associated with the east? Does the undoubted fact that there are hundreds of eastern religions and philosophies undermine the claim?

You're wrong to claim that association is in any way relevant to what I've written. If I said "Christianity believes that Jesus visited North America" it would be rightly seen as the words of someone who had so little understanding and charity to the concept and diversity of Christianity that it would fall into the "not even wrong" category.

>Do you agree with my point that Christianity "was persecuted for three centuries precisely because it refused to be syncretic -- the Romans were happy to tolerate additions to their pantheon but couldn't abide Christianity's claims to exclusivity"?

I do contest that -- specifically because proto-Rabbinic Judaism was specifically categorized as a monotheistic religion that was largely recognized and exempted from Roman suppression because of its connection with temple Judaism. That Christians were persecuted by the Romans was not solely due to their monotheistic (or rather anti-polytheistic) beliefs, but that it was rapidly becoming expressly a gentile and proselytizing religion.

In any case, you first argue (wrongly) that "eastern ideas" can't be syncretic to Christianity because of a lack of personal deity, then you argue that Christianity is unique and was persecuted specifically because it denied personal deities.

In one breath, you treat theism as the relevant dividing line between Christianity and “eastern ideas”; in the next, you treat religious exclusivity as the relevant dividing line between Christianity and Rome. But those are entirely different axes, and neither establishes anything about the historical provenance of the ideas under discussion.

I would really like to continue to be charitable to and engage with you, but you have a continued fixation on the Roman attitudes of 1st century CE as evidence of an argument based on what was happening in the Mediterranean world in the 2nd century BCE--again, entirely reasonable from someone catechized within the Church--and the ability for you to even provisionally evaluate my argument on its own terms seems insurmountable. You've a priori stated more than once "Christianity is not 'a syncretic import from the east'" which already shows that this isn't really a dialogue.

I think you presume that I am ignorant of Catholicism and the history of orthodoxy. I'm not. I was raised by a traditionalist father who ran around with SSPX back in the 80s and then the FSSP. I ceased being Catholic for the same reason Cardinal Newman said "To be deep in history is to cease being protestant." Well, it turns out that history is much, much deeper than Newman supposed and doesn't end with Polycarp, Clement, and Ignatius.

If you honestly want to seriously engage with my position, here are the questions that would help clarify where we actually disagree. You obviously don't need to answer all of them if you don't want to (and there's a non-trivial possibility you won't even have read this far before noping out), but these are the substantive points I don't think you've addressed:

Where is your evidence that the Buddhist traditions relevant to this discussion posit that “the self is an illusion” in the undifferentiated sense you're invoking? Which Buddhist school, which period, and which text or tradition are you talking about? If you're going to use that proposition as evidence that Christianity could not have incorporated Buddhist material, you need to establish what Buddhist position you're actually comparing it to.

Likewise, what do you mean by “Buddhism denies that God is personal”? Which Buddhist traditions, which period, and which conception of God are you referring to? Why should the theological position of those particular traditions be treated as representative of “eastern ideas” generally?

How do you explain the independent emergence of a gender-inclusive monastic tradition in Christianity that so strongly resembles the general form of Buddhist monasticism found throughout its various sects, especially given that we have evidence of Buddhist missionary activity in the region predating the emergence of Christianity? If you think the resemblance is coincidental, what is your positive account of the parallel development? What historical mechanism do you propose produced the same unusual institutional configuration independently?

What is your explanation for the specific structural and narrative parallels between Christian ascetic literature and Buddhist material that predate or are plausibly independent of the Christian tradition? It appears you might have inferred that I was speaking about the content of Mark 7 and MN 55, but I wasn't. I was speaking specifically about the recurring structure found in both. I'm not asking whether Christianity ultimately gives those narratives a different theological interpretation. I'm asking what you think accounts for the historical similarities.

How do you account for the presence of Indian philosophical material in the Hellenistic world independently of Christianity? In particular, what do you make of the evidence concerning Pyrrho and the Greek encounters with Indian philosophers? If you reject the possibility of influence on early Christian intellectual culture, what is your explanation for why those demonstrable pre-Christian channels of transmission are irrelevant to the hypothesis?

If your position is that these similarities are insufficient to establish influence, what evidence would you regard as sufficient to establish influence in principle? And, applying that standard consistently, which of the existing pieces of evidence fail it, and why?


>>Christianity is not 'a syncretic import from the east'. One way we know this is by looking at its differences with eastern ideas. What would first-century Christianity make of the denial of diachronic identity (the self is an illusion), or the denial of the idea that God is personal?

> You're still doing the exact same thing. "Eastern ideas" is a leaky set and faulty abstraction. You have pointed to no actual bounded idea or ideology within that set. You proceed to attribute two ideas--the illusory self and non-theism--to that set, again without referent to anything.

You wrote:

>>>>> The problem is that there is almost 2,000 years of culture and the metaphysical beliefs of well-more than half of the human population predicated upon their beliefs being entirely unique and an off-shoot of Judaism and not a fundamentally different syncretic import *from the east*.

This claim is predicated on the term "east" (in its philosophical sense) refering to something real. If it's impossible to associate concepts with 'the east', then your own assertion is as meaningless as mine.

In any case, the word 'east' (in this sense) can't be accurate in the way 'grass' or 'human being' can be accurate. It has multiple meanings, unlike them. But it doesn't follow from this that it has no meaning. One can assert things of 'the east', in the way that one can assert things of 'communism' or 'protestantism' or 'long-haul flight' -- other terms where one could argue over the meaning. If we can't assert things of the east, then we can't assert things of those terms either.

But we can assert things of these terms. There is a common agreement about what they mean that's sufficient for meaning to be shared. We can say 'Protestantism teaches salvation by faith alone', or 'Communism calls for the abolition of private property', or 'transatlantic flights are long haul', even though there may be some examples of all of these where the predications are wrong.

It's the same for the term under discussion. Most if not all of the meanings of 'the east' used in discourse today[0] contain the ideas I asserted (illusory self, etc). Therefore your argument -- that my assertion that certain ideas are 'eastern' is meaningless -- fails. Had it succeeded, it would have fatally undermined your main assertion.

>> Am I wrong to claim that the ideas I listed are associated with the east? Does the undoubted fact that there are hundreds of eastern religions and philosophies undermine the claim?

> You're wrong to claim that association is in any way relevant to what I've written.

Re-read your words I just quoted, which is what I object to, and which I keep trying to come back to. Is the association really "not relevant"? I have asserted that a) certain ideas are commonly and correctly associated with 'the east'; that b) said ideas are anathema to Christianity, in fundamental ways, and therefore c) your claim that Christianity is a 'syncretic import from the east' is false. That is pretty much my whole argument[1]. If you can show that either of my premises is wrong, you nullify my objection to your statement. It's not only relevant, it's central.

> If I said "Christianity believes that Jesus visited North America" it would be rightly seen as the words of someone who had so little understanding and charity to the concept and diversity of Christianity that it would fall into the "not even wrong" category.

I could easily deny that though. Only one tiny and very new sect believes it. You can't claim that about my assertions, you've merely claimed they're not relevant.

> You've a priori stated more than once "Christianity is not 'a syncretic import from the east'" which already shows that this isn't really a dialogue

I was responding to your point where you stated the opposite. The disagreement, or the dialogue, is over which belief is true.

> If your position is that these similarities are insufficient to establish influence, what evidence would you regard as sufficient to establish influence in principle? And, applying that standard consistently, which of the existing pieces of evidence fail it, and why?

There is influence in a certain sense, clearly. But your statement is much stronger. You asserted that Christianity is a syncretic import from the east, not that it was influenced by it in some sense, which is obviously true.

[0] Remembering that words exist by convention!

[1] This includes my statement about the Roman persecutions. My point when bringing this up was to show that Christianity considered itself the only way for everybody, which also undermines your assertion that it's syncretic, and is also a major difference from the east. My point was not that monotheism or anti-syncretism was the cause of the persecution. I'm neither asserting nor denying this: it's not relevant to the discussion.

(EDITED slightly to hopefully improve clarity a bit)


I think I've used enough of my time and more than illustrated my original points.

I wish you well, and hope your faith grows to be as secure as St. Thomas Aquinas's before his death and not as Bellarmine's during his life.


As an interested reader and not participant in this discussion, thanks for taking the time. I found what you had to say above informative.

Thanks for letting me know that there was at least one other reader. It means a lot.

If you're at all interested in looking into the topic more deeply, I'd highly recommend this paper, showing just how deeply transmission west into the Hellenic world occurred, including bilingual koine Greek and Aramaic translations of Buddhist material:

https://www.researchgate.net/publication/345171245_When_the_...

There are possibly deeper, more controversial parallels--Naraka (Hell), punarjanman aka reincarnation (gennēthē anōthen or "born again"), Dhamma (Logos), the Triratna (the Trinity), dukkha/kamma (Khowba (חובא) -> opheilema/harmatia or debt/trespass), āpatti-paṭidesanā (confession), arhat (hagios or saints), etc. ad nauseam--but as you've seen, even provisionally entertaining these notions is beyond the ken for most in the West, whether academic, religious, or otherwise. Elsewhere in Buddhist thought there are also forms like Pure Land that end up resembling certain strains of later Christian forms, despite independent genesis.

But ultimately, whether my perspective is true or not, or whether the metaphysical claims between the traditions differ (they do, especially at this point in time), the right course of living isn't really that different broadly between the two traditions--focus on one's own conduct rather than others, do good for others in the world and not merely oneself, forgive others, and always keep in mind that there is a moral law in the universe that is inescapable in its consequences. If you struggle to do it yourself, find others pursuing the same goals, and you'll eventually find the way.


Yep likewise, wish you well. (And what do you expect of a Jesuit? :) )

I specifically stick to monasticism because Christianity is the odd one out of all the abrahamic religions in advocating for monasticism, and monasticism started in Egypt which had significant enough presence of Buddhists.

As far as I am aware, Christianity is the only non Indian religion to advocate for monasticism or asceticism. It's really only Jainism and Buddhism that advocate for it other than Christianity (Hinduism picked it up from Jainism and Buddhism).

That being said, your reaction is exactly what the guy above was saying was an issue.

You conflate Buddhism with Roman polytheism. Buddhism is not dogmatic. Buddha is a man who saw idolatry all around him and quickly determined it was ineffective and false. A core part of Christianity is that God needs to reveal himself. Being before Christ, Buddha would not have known about the resurrection or that such a thing was possible. He made some observations and literally said if he was wrong ignore him. While many modern day incarnations of Buddhism are dogmatic and some have descended back into the very superstition the Buddha advocated against, the core story of Buddha is complete the opposite of Roman polytheism.

Again we see the parallel with Christianity where a bunch of people were marginalized for advocating against Hindu Polytheism, with Buddhism eventually winning the support of the great empire of the time (the mauryans).


Thanks. Very briefly, I haven't commented on Buddhism or the Buddha's teaching at all (except to agree with the other guy's claim that the Buddha engaged with many philosophies), and have been very careful to avoid doing so. My beef is specifically with the claim that Christianity is syncretic, and with the unsaid implication in the OP that all religions basically teach the same thing.

> and with the unsaid implication in the OP that all religions basically teach the same thing

I read the entirety of 3m4r's posts in that thread and nowhere did I see any hint of such an implication


I should have been clearer, I was referring to the blogpost as "OP", not to 3m4r.

Sorry, my mistake then

I personally think thinking is basically variable but rate precision. If you are in a 4bit mode but need 2x as many tokens you're just doing fp8 with hoops( of course 4bit multiply is faster)

Fair enough mental model, except my GPU can’t load the 8bit version and paging from disk makes it way more than 1/2 speed.

Modern 'classical' music is a myth. In their day, classical composers were essentially pop performers. Women used to throw their undergarments at mozart...

Today classical music is filled with people who want to pretend to be superior to pop musicians because they keep their repertoire confined to academically acceptable areas.

And then the LARPers that want to make new music make complete and utter arhythmic and atonal trash that demands humans subdue our own aural feelings of beauty.

You'll find classical musicians who complain about this stuff are usually incompetent musicians who really stretch the definition of artist.

Sorry spent almost a decade of my young life in a somewhat competitive music school environment. Lots of the other kids were upset I played what I wanted to and people liked it.

Actual modern composers in the classical tradition (I.e. people alive today who compose music that is similar in feel to older composers) are well compensated because they're often hired to score films, video games, and other capitalist interests that the supposedly 'real' classical musicians would scoff their noses at.


> Today classical music is filled with people who want to pretend to be superior to pop musicians because they keep their repertoire confined to academically acceptable areas.

As somebody with classical training and a brother in the industry, it pains me to read this misinformed opinion of yours. Top-tier symphonies world round are doing crossover concerts with pop artists, play pop songs, modern and experimental music, and regularly feature works by living composers. In my high school orchestra, circa '98, we played stuff like music from Star Wars and West Side Story -- not just the ancients.

Down the foodchain, it gets even weirder. The favorite gig I played involved interpretive dance featuring waterboarding, gallons of fake blood, a live chicken race, and more.

Where you certainly will find a subset of afficionados of any genre who scoff at anything but their extremely narrow definition of "good music," if you take the time to rub elbows with mature classical musicians you'll find many to most of them quite open minded.

Your experience with young artists, finding them to be idealistic and purist, does not extend to the whole field. I know people who only listen to a single narrow genre or decade of pop music. How are they different?

Edit to add:

> And then the LARPers that want to make new music make complete and utter arhythmic and atonal trash that demands humans subdue our own aural feelings of beauty.

Oh, no. No, no no. I've been to a circuit-bent punk show. I recently went to an ambient music festival. I've heard glitch pop. Angine de Poitrine is blowing up because they use a semitonal guitar (though as a bit of a noise snob, I find their use of semitones milquetoast and rather uninspired).

Here you are, narrowly defining music, and excluding what you dislike. But it's not just "classical" living composers doing this.


One thing I've observed is that a subset of that weird and interesting music is only possible due to the availability of musicians who have gone through the classical training. Having access to players who are capable of doing anything you ask, is what allows composers to be even more adventuresome, for two reasons. One is the sheer ability to play the stuff, and the other is the efficiency of doing it with a minimum of rehearsal.

The same has been true to some extent in the past for popular music. Up through maybe the 70s and even 80s, a lot of the instrumental parts for the "hits" were recorded by trained jazz musicians.


> Top-tier symphonies world round are doing crossover concerts with pop artists

And they have been for a long time:

https://en.wikipedia.org/wiki/Concerto_for_Group_and_Orchest...


As classic as that collaboration now is, the RPO was not top-tier at the time of it.

> I know people who only listen to a single narrow genre or decade of pop music. How are they different?

No one mistakes a pop artist or afficianado for some great connoisseur of culture.


My understanding is that many of the classical-heavy orchestra schedules are driven by donor expectations.

I've heard this argument many times, there's a grain of truth and I strongly agree RE 'arhythmic and atonal trash', but it strikes me as disingenuous.

Classical music was somewhat elitist even at the time, coexisting with popular/folk music traditions. The Romantic period definitely saw music and art break away for traditional forms and conservative mores, but it wasn't a free for all.

The people who enjoy classical music today are largely the same people who enjoyed it at the time. Educated and 'enlightened' upper/middle classes, who sought music celebrating their aspirations. Freedom from political oppression and aristocratic control. A world where people could succeed based on talent, hard work, intelligence, and propriety. Where the middle class would have the power to reshape government and social institutions to advance their interests rather than those of the nobility. A personal experience of the religious rather than state ordained. The music pivots to natural, romantic, mystical themes as these people lost faith that industrialization will deliver for them.

Compare modern popular music which deals with universal themes - love, loss, sex, money, partying. You can enjoy pop music and still feel that these themes are not important to you.

People don't fake enjoying classical music to convince you that they're smart and cultured. They just gravitate to music which represents their idea of smart and cultured. The same is true for a lot of art.


The idea that classical composers (before about Liszt) were the "pop music" of their day is uninformed. Consider 1) the size of the venues that Mozart or Haydn's secular music was performed in, and 2) the fact that the bulk of the population was peasantry who wouldn't be admitted to such venues in a time of strict class distinctions.

Outside church settings, classical music of the Baroque, Classical and early Romantic eras was for the elites, and the masses had their own musics. This only changed gradually over the 19th century.

It's also weird to still be hung up on atonality in the contemporary classical world, when the pop-music world has for decades now had acts like Merzbow that are often farther out into noise.


Merzbow is not pop music, or arguably even music at all.

>I threw all my past music career in the garbage. There was no longer any need for concepts like 'career' and 'skill'. I stopped playing music and went in search of an alternative. — Masami Akita

Pulse Demon is the only Merzbow album with any cultural importance, and that's mostly because the eye-catching cover art let it replace Lou Reed's Metal Machine Music as the default "check out how extreme this is" meme album. Only a tiny minority of music listeners will enjoy listening to it, and there is no establishment pushing it as the future of music.


Merzbow gets booked for popular-music festivals regularly, and plenty of other artists have credited him. The Japanese noise scene even inspired a Detroit noise scene through the 1990s and early millennium.

I don't care for the genre myself, but having been to events and seen pleasurable crowd reactions and met people who traveled some distance for it, I can't deny it has at least some real following. Who cares if it isn't discussed as the future of music? There are punk, metal, and hardcore subgenres that draw the same narrow audiences and don't aim to shake the world, but claiming that disqualifies them as part of the popular-music world would be silly.


Pop music is also mostly trash too, but no one pretends otherwise. At least they have the decency to use auto tune.

> Today classical music is filled with people who want to pretend to be superior to pop musicians because they keep their repertoire confined to academically acceptable areas.

What an incredibly cynical take. I’ve done several chamber music collaborations with a violist who also plays pop music gigs on keyboards.

There are arrogant pricks in classical music. And in software engineering and every other discipline. Personality is orthogonal to field of interest.

Anyway you complain that classical musicians look down on pop music while you yourself do the same about modern composers.


> while you yourself do the same about modern composers.

I literally gave several examples of modern genres in which classical composers still produce good work. I just said they're unlikely to be found in academia


Yeah as someone whose family left this, you guys are crazy

I mean at every layer in a transformer, the attention mechanism does a massive state transfer between tokens.

In a recurrent transformer, instead of projecting from the latent space to token space after a fixed depth, you take the latent embeddings and then run them again through the transformer. This causes more time to think because there's more mixing. You can run that as many times as you want for more thinking before projecting the embeddings back to word space.

Personally I believe this is similar to how humans think. The brain is a fixed size yet if we think longer we seem to be able to do more than if we just react instantaneously. This is because the brain feeds the results of our musings back into itself for further thought.


The tokens inside the transformer are only projected into token space to train them. In reality they ought to be treated as their own thing. What's really gone on is you've trained the final projection to be sensible rather than trained the llm to think using words. This seems to escape a lot of people. You can throw random empty tokens into transformers to get them to think more. More tokens means more attention mixing which means a larger dimensional space in which to think essentially.

The hidden states of the tokens likely contain more semantic information than can be extracted by the final projection into token space.

Actually, how does chain of thought work? Is the LLM actually creating the tokens and then re-reading them, or is the there still a full hidden state under the hood and then the UI just prints that projection?

Can't tell you what's happening in a closed model, but in case of open ones it's just a text stream, same "take all previous tokens, compute next token" mechanism applies. Thinking vs Response is just a state change like between a system message and a user message.

Closed models probably do the same thing internally. What is shown externally is different though: you get a summary of the chain of thought, not the thoughts itself. This is done to prevent distillation.

The latest look we had at a frontier chain of thought is probably in the Huggingface incident report - I haven't actually read it yet but I saw the BlackHat talk, and it included some snippets. The thoughts look like they are approaching neuralese. The words are still understandable but the grammar is weird, simplified. In comparison, Qwen 3.8 27b thinks in valid English.


I do the same thing in my head. There is no underlying logic to an llm. Logic is an external construct alien to human like forms of reasoning.

Why? I talk in my head and then enunciate only that which is relevant. My speech rate inside is incredibly fast.

The purpose of the scratch pad is very often to refer back to it later.

Should have said it was post preschool psychosis

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: