llm-router becomes Bosco

Yes, llm-router has a new sexy name !

It is now Bosco :

GitHub - AutreMachine/bosco: Router and proxy for OpenAI compatible LLMs machines - 1 url to rule them all ! Now compatible with JEV !

Router and proxy for OpenAI compatible LLMs machines - 1 url to rule them all ! Now compatible with JEV ! - AutreMachine/bosco

GitHub

And one more thing...

There is now a Substitutions tab : you can now add a substitution for a LLM.

For instance : qwen 3.8 27b => qwen 3.8 14b

Now, if a request for qwen 3.8 27b comes in the pool, and no machine is able to respond, Bosco will look for an available machine with qwen 3.8 14b instead.

The idea ? Trying to serve a client a "good enough" answer even when no machine is available.

This way, you can make your llm pool more efficient.