Hacker Newsnew | past | comments | ask | show | jobs | submit | xchip's commentslogin

"This transforms a vector of arbitrary real numbers into values between 0 and 1 that sum to 1"

Not really, softmax transforms logits (logariths of probabilities) into probabilities.

Probabilities → logits → back again.

Start with p = [0.6, 0.3, 0.1]. Logits = log(p) = [-0.51, -1.20, -2.30]. Softmax(logits) = original p.

NN prefer to output logits because they are linear and go from -inf to +inf.


Softmax is defined over an arbitrary vector of raw real numbers. Stating that those inputs are "logits" is applying post-hoc semantics to what the model is learning. One of the key properties of a softmax is scale invariance, (e.g. softmax([-1, 1, 3, 5]) == softmax([9, 11, 13, 15])) and so it is easiest to just think of it as operating on a vector of unnormalized raw scores, which is the more colloquial definition of logit.

(also, log(p) is not the formal definition of a logit)


Logit is log odds, not log probability: logit(p) = log(p / 1 - p)

It's still true that softmax transforms arbitrary vectors into probability vectors.

In your example you'll also get the original `p` with just `exp(logits)`. Softmax normalizes the output to sum to one, so it can output a probability vector even if the input is _not_ simply `log(p)`.


Feels like a bailout. Belgium’s playbook is simple: skip maintenance, let it decay, then replace it on the taxpayer’s dime.

No, it was a deliberate strategy from the green party that were very anti-nuclear. They replaced it with gas power plants. And if you think this is a joke, no it isn't.

I'm sure this article could be a tweet.

If they care so much about child safety they should check first the Epstein files.


Impressive, you did better than the guys of the c++ standard


Thank you! That means a lot.

My goal wasn't to replace the C++ Standard Library, but to address fields it doesn't fully cover, like embedded frameworks where every byte matters. The Standard Library is great for general-purpose computing, but for 'Silicon-Logic Parity' and high-density memory constraints, we needed a more vertical and unified approach for our project.

Glad you appreciated the design!


They updated it recently to fix the stuttering in the Disney app, and that issue had been there for a year or so. And they did that probably because Disney paid them.

It's a corporation, they don't work for free.


That is how Napoleon got defeated in Russia. Russians decided not to engage in battle and let the winter solve the problem for them.


Thanks!


What is your body count now?


gmail sucks, I'm getting 2-3 spam emails a day, am I the only one?


I wouldn't know, I don't look at my spam folder.


Gmail spam filtering is poor enough that a lot of obvious spam reaches the inbox as well. The quality of the spam filter alone is a good enough reason to move off gmail.


I just mark as spam and move on. Maybe my email isn't on as many spam lists.


If you only get 2-3 you are lucky :)


I have almost zero spam (that isn't filtered properly). Once in a while I catch a false positive in the spam folder but that's about it.


Maybe 10 annually.


Consider applying for YC's Summer 2026 batch! Applications are open till May 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: