Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Llama3.1-405B benchmarks at a level that I would certainly consider comparable to other SOTA models, as long as multimodality isn’t needed.

Regardless, OpenAI provides access to quite a few of their older models through the API, since the API lets you pass in a specific model version. I’m sure the older models won’t be available forever, but that is a much more stable target for researchers than just opening the ChatGPT website and typing in things.



ChatGPT specifically is more than just a chat interface on top of got-4.

Their system prompt includes the current date and time among other information, making it very very hard to run reproducible experiments against it.

But it’s the tool most people are using.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: