Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

My take from this is that 85% of times we don't need a powerfull LLM like 4o.

Or am I reading this wrong? :)



You're reading it right. They have developed a system that automatically decides which model is sufficient, depending on your inputs, saving you costs even within one conversation stream.

The OpenAI-compatible API allows you to talk to the router like a regular GPT model.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: