Asklemmy

Open source AI models?

The open source researchers that took the meta weights and ran with them, and then superseded them, was how I read it. It was the overall innovations that made patching as effective if not more than recompiling from scratch.

I am curious how long this memo lasts as a real leak. Like I haven't tried digging below the surface of information as presented, but most of this is indistinguishable from magic in actual practice. Like even open source, does not mean I have a chance in hell of compiling on my own, and modifying is completely absurd at this point. I wouldn't mind learning, but I know I'm out of my depth on that one. Could this leak be a false flag or public passivation for political reasons? Making the publicly available options sound advanced and capable takes a lot of pressure off of proprietary efforts right as they are hitting a larger public focus.

If you read the memo they talk about meta as possible benefiter of open source advances

A wild guess, but could it be Microsoft?

I mean they are already creating use cases and integrating them in their apps, especially their business suite.

While Google and OpenAI are ahead in AI innovation, I feel Microsoft is getting ahead in implementation and actual end user scenarios.

Microsoft office offerings are still much larger than Google's, plus they capture Dev's needs with GitHub CoPilot and VS/ VSCode integrations.

I feel like by the time Google will be ready or OpenAI's contract with MS ends, both of these companies will lag sufficiently behind MS in real world.

Meta. They are smashing it with small customisable, specialised models.

Listen to the latest lex fridman podcast with zuck. I found it quite fascinating.

And then there’s worrying about not wearing the same thing twice. My god! Don’t know how you do it.