r/OpenSourceAI • u/conifer_v11 • 2d ago

Opensource Openrouter

Project: https://github.com/ConiferKit/use-conifer

Current routing options were charging 5% fees for byok plus provider fees (openrouter) or were built in heavy python packages with ecosystem restraints. I wanted to be completely free in terms of use, and not have to pay extra for tokens.

There's a maintained gateway with 100+ models from one api endpoint. I'm also talking to infra providers to get us access to pre-release models and discount prices. Everything is served at market price. BYOK is free, you can hook into self-hosted setups for free, and there's fallbacks + extra rate limits + server redundancy.

Took me ~3 months to build and looking for help maintaining!
Lmk any issues or feedback

7 Upvotes

90% Upvoted

9 comments sorted by

View all comments

1

u/p3r3lin 2d ago

How do you compare to https://github.com/BerriAI/litellm ? When to choose either?

1

u/RogerAI-fm 1d ago

Or even rogerai, but I guess that is any person can be a provider.