Nothing you've said about reasoning here is exclusive to LLMs. Human reasoning is also never guaranteed to be deterministic, excluding most correct solutions. As OP says, they may not be reasoning under the hood but if the effect is the same as a tool, does it matter?
I'm not sure if I'm up to date on the latest diffusion work, but I'm genuinely curious how you see them potentially making LLMs more deterministic? These models usually work by sampling too, and it seems like the transformer architecture is better suited to longer context problems than diffusion
The way I imagine greedy sampling for autoregressive language models is guaranteeing a deterministic result at each position individually. The way I'd imagine it for diffusion language models is guaranteeing a deterministic result for the entire response as a whole. I see diffusion models potentially being more promising because the unit of determinism would be larger, preserving expressivity within that unit. Additionally, diffusion language models iterate multiple times over their full response, whereas autoregressive language models get one shot at each token, and before there's even any picture of the full response. We'll have to see what impact this has in practice; I'm only cautiously optimistic.
I guess it depends on the definition of deterministic, but I think you're right and there's strong reason to expect this will happen as they develop. I think the next 5 - 10 years will be interesting!
Switzerland's draw is the money. It's true that a significant proportion of the population is foreign born, but the whole country is smaller than some tier 2 cities in China and many foreigners do not stay longterm. If China paid Swiss-level salaries there would be more people going for sure, but the country is so big that at a relative level I'm not sure if the proportion would change significantly
Yes because these descriptions are meant to foster dehumanization and detachment, which is very useful in military and scientific study contexts. That's why they also sound unnatural in casual conversation
A lot of mechanisation, especially in the modern world, is not deterministic and is not always 100% right; it's a fundamental "physics at scale" issue, not something new to LLMs. I think what happened when they first appeared was that people immediately clung to a superintelligence-type AI idea of what LLMs were supposed to do, then realised that's not what they are, then kept going and swung all the way over to "these things aren't good at anything really" or "if they only fix this ONE issue I have with them, they'll actually be useful"
After using Rust for many years now, I feel that a mutable global variable is the perfect example of a "you were so busy figuring out whether you could, you never stopped to consider whether you should".
Moving back to a language that does this kind of thing all the time now, it seems like insanity to me wrt safety in execution
Global mutable state is like a rite of passage for devs.
Novices start slapping global variables everywhere because it makes things easy and it works, until it doesn't and some behaviour breaks because... I don't even know what broke it.
On a smaller scale, mutable date handling libraries also provide some memorable WTF debugging moments until one learns (hopefully) that adding 10 days to a date should probably return a new date instance in most cases.
* old Toblerone Matterhorn logo unfortunately :( They've had to remove the mountain from branding since the chocolate is no longer produced in Switzerland. Still, I love finding the bear in the older boxes still floating around.
> no mental bandwidth for things like spiritual constipation
That's a feature, not a bug. Fighting for life has more meaning and purpose that yearning for death. We're designed for it. It has only recently become atypical.
You're conflating 2 issues here: judgement of adult attempts at a new language and the time required to learn it. The first is just a cultural thing, although it is sometimes valid for understanding a speaker (cases in Slavic languages, pronunciation in a homonym-heavy language like French, tones in Asian languages). Problem is that it's oftentimes more "cultural" than "valid" critique, which helps no one.
The second problem is more practical and it's not the only difference between child and adult speakers; the vocabulary required in most day-to-day settings for a child is considerably easier to master than the adult equivalent, regardless of language (describing symptoms to your doctor or getting through a bank or tax appointment will be much more difficult than describing the weather or what you want for lunch). Adults in general are just as good as children at learning new languages, it's just that life has different requirements from that age group.
Edit: that said, I actually am agreeing with your general sentiment
Sure some few adults can learn languages as fast as kids, but you completely missed my main points around gatekeeping that language skills always has on adults and less so on kids.
Because statements like the original I was replying to of "no time for gatekeeping" are simply not true, but more like the poster doesn't notice it because he (or his kids) are not affected by that gatekeeping.
> Sure some few adults can learn languages as fast as kids, but you completely missed my main points around gatekeeping that language skills always has on adults and less so on kids.
Adults in general are actually way faster at learning languages than kids if you control for time actually spent learning the language, but generally adults are required to fit language learning in around a full time job (and are also full of shame/embarrassment)
Can't concur. As a kid I learned foreign languages effortlessly, compared to now as an expat. And every other expat here my age shares the same experiences, where their 8 year old already speak the host country's language better than they do.
As another expat, I'd concur with him, with an asterisk. The thing is - your kids are surrounded by the language nonstop. Depending on your situation it may be spoken at school, certainly spoken by some of their friends, teachers, and so on endlessly. But "you" (speaking in generalities of expats and not necessarily literally you)? Unless you happen to have a local wife, then you probably speak it extremely rarely, there's a reasonable chance you can't even read it if it's non-latin, and there's no real need to move beyond that.
Living in one country for a rather long time, my fluency was basically non-existent beyond simple greetings, shopping/eating, and other basic necessities. By contrast somewhat recently I've taken a major interest in another language, one that's generally considered extremely difficult, and I've reached at least basic fluency in about 3 years. The difference? I immersed myself in the other language, my music playlist is overwhelmingly in that language, I've watched endless series and movies in that language, I've made efforts to read books in the other language, and any time I find another speaker I make sure to use the opportunity to talk with him in that language, and so on. If I was in a country where it was the native language, then I'd probably be near fluent by now.
