EdgeLLama pinned «Setup isn’t straightforward right now but there are 61 nodes on the network already (these are M1/M2s serving a Mistral-7B finetune): https://hyperspace.computer/node»
This is a full ChatGPT decentralized AI replacement which works today. You can click and choose "Community Node" on a repo in hyperspace.computer and the inference will be run on the P2P connected nodes and the result returned back to you. Has some bugs, but it's a start..
EdgeLLama will be rolling out starting Dec 7th. Thank you for your patience. If you are in SF, join us here for a quick meet and greet. We will be hosting chats on Twitter Spaces as well for those who can’t make it in person.
Here is our “BitTorrent for AI” paper outlining the design further: https://twitter.com/varun_mathur/status/1726381112090591594?s=46&t=NvcypMf3Hn8aFb3mBnMjsw