@pup_hime@halcy yeah, they failed to become the AI supplier, everyone who wants to run a LLM can just do that locally now, and also now to investors it seems like they wasted billions of dollars
@noiob@pup_hime local isn't entirely possible yet for the bigger versions of the DeepSeek model (the ones that actually manage to get to o1 performance), and even o1 has substantial room to grow, so I'd assume that for now, there's still room for hosted inference, and OpenAI can now potentially do that at substantially lower cost, if the ideas from that model transfer to theirs.
Awoo.space is a Mastodon instance where members can rely on a team of moderators to help resolve conflict, and limits federation with other instances using a specific access list to minimize abuse.
While mature content is allowed here, we strongly believe in being able to choose to engage with content on your own terms, so please make sure to put mature and potentially sensitive content behind the CW feature with enough description that people know what it's about.
Before signing up, please read our community guidelines. While it's a very broad swath of topics it covers, please do your best! We believe that as long as you're putting forth genuine effort to limit harm you might cause – even if you haven't read the document – you'll be okay!
@noiob @pup_hime local isn't entirely possible yet for the bigger versions of the DeepSeek model (the ones that actually manage to get to o1 performance), and even o1 has substantial room to grow, so I'd assume that for now, there's still room for hosted inference, and OpenAI can now potentially do that at substantially lower cost, if the ideas from that model transfer to theirs.