Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

We seriously need a service that is as cheap and fast as the OpenAI/Anthropic APIs but allow us to run the various community-fine-tuned versions of Mixtral and LLaMA 3 that are not/less censored.



https://openrouter.ai is exactly that, and they even support payments with crypto.


>and they even support payments with crypto.

What a value proposition! ;-)


The true meaning of BlockchAIn.


Coinbase commerce? That's hardly crypto and I am not sure if it's better or worse than traditional payments.


Such services already exists. I don't want to promote any in particular, but if you do a research on pay-as-you-go inference of e.g. mixtral or llama3 you will find offerings that offer an API and charge just cents for XY amount of tokens, exactly as OpenAI does.


I addition to those mentioned by others, there is featherless.ai


You can use HuggingFace, PerplexityAI, Anyscale, TogetherAI. There are a bunch of options. Many offer OpenAI compatible APIs too.


I believe openrouter.ai has a few.


or crowd run, like through petals or kobald's ai horde.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: