froztbyte

dammit it's barely days since my open source veneer side comment and then this happens. I'm dubious of even giving a tiny bit of goodwill because with this set of orgs on task and the resources they can muster, surely piddly little things like setting up some infra for publishing and management is in the hours to maybe days spectrum...

casey's words:

Roblox has already contributed an open-source model for detecting abuse, racism, and sexual content in audio clips

that roblox post that casey links to:

That will likely be open sourced by the end of the first quarter of 2025

I have no mouth and I must scream

this is fantastic, more of this kind of thing is definitely good

as I read it, it's an attempt at reference to economy of scale under the thesis "AI silicon will keep getting cheaper because more and more people will produce it" as the main underpinning for how to reduce their unit economics. which, y'know, great! that's exactly what people like to hear about manufacturing and such! lovely! it's only expensive because it's the start! oh, the woe of the inventor, the hard and expensive path of the start!

except that doesn't hold up in any reasonable manner.

they're not using J Random GPU, they're using top-end purpose-focused shit that's come into existing literally as co-evolution feedback from the fucking industry that is using it. even some hypothetical path where we do just suddenly have a glut of cheap model-training silicon everywhere, imo it's far far far more likely to be an esp32 situation than a "yeah this gtx17900 cost me like 20 bucks" situation. even the "consumer high end" of "sure your phone has a gpu in it" is still very suboptimal for doing the kind of shit they're doing (even if you could probably make a great cursed project out of a cluster of phones doing model training or whatever)

falls into the same vein of shit as "a few thousand days" imo - something that's a great soundbite, easily digestible market speak, but if you actually look at the substance it's comprehensive nonsense

(I’ll read the rest of it later as my brain boots and the day’s bullshit allows on time)

merely from seeing the domain and author, probably all of it - casey newton’s got a real bad case of access syndrome, and keeps writing fluff/puff pieces uncritically amplifying tons of bayfucker nonsense

(it’s even beyond the usual levels of what one may refer to as useful idiot)

......I did it again. I looked.

oof.

others have said the bits that matter already, but for my part: what in the fuck kind of post is this

Google appears to have faked AI output in a commercial set to run during the Super Bowl.

google? lying in their autoplag ads? a fine tradition

... that the Gouda stat was “not a hallucination,” adding that “Gemini is grounded in the Web.”

it's astounding how much this shows a lack of knowledge/grok regarding their own goddamn operations on the current web

Look, I get your perspective, but zooming out there is a context that nobody’s mentioning

I'm aware of that yeah, but it's not a field I'm actively engaged in atm and not likely to be any time soon either (from no desire to work in it follows no desire to wade through the pool of scum). but also not really the place to be looking for insight. it is the place wherein to ridicule the loons and boosters

we should expect somebody to eventually demonstrate that the Transformers paradigm sucks

been wondering whether that or the next winter will get here first.

If you want to critique something, critique the gradient worship

did that a couple of years ago already, part of why I was already nice and burned out on so much of this nonsense when midjourney/stablediffusion started kicking around

it’s like whenever Chinese folks do anything the rest of the blogosphere goes into panic

[insert condensed comment about mentality of US/SFBA-influenced tech sector (and, really, it is US specifically; eurozone's a somewhat different beast), american exceptionalism, sinophobia, and too-fucking-many years of "founder" stories]

it really is tedious though, yeah. when it happens, I try to just avoid some feeds. limited spoons.

but I’m so fucking tired of mathlessness

as you know, the bayfucker way (for getting on close to 20y now) is to get big piles of money and try to outspend your competition. why bother optimising or thinking about things if you can just throw another 87345243 computers at the problem? (I do still agree with you, but see above re desire and intent)

re the open source thing: it's a wider problem than just that, and admittedly I'm peeved about it from this larger scope. I didn't expound on it in my previous comment because (as above) largely not really the place. that said, soapbox:

there's a thing I've been noticing as a creeping trend lately. I call it "open source veneer", which is still a bit imprecise[0] but I think you'll get what I mean. it's the phenomenon of shit like this. of "projects" on github that are no more than a fancy readme and some "contributors" and whatnot, but no actual code (or ability to make full use of what is provided). of companies that build "open source" and then as soon as something (usually VC-/"earnings"-related decisions) happens, the entire project gets deeply buried (links disappear off main sites, leaving product/service only), actively hobbled ("oh you want to set this up yourself? glhf gfy", done in oh so many ways[1]), or often even entirely disappeared[2]

[0] - still working through the thought, should probably write about it soon

[1] - backend codebases lagging because "not feature priority", entirely missing documentation, wholly missing key sections of code which are "conveniently" left out, etc etc; examples off the top of my head: zotero, signal, firefox weave for a while. there's plenty more if you look

[2] - been noticing this especially frequently with some security stuff, but it's hardly the only example set

shot:

majority of it on the actual training (hardware, ...)

chaser:

And that’s (supposedly) only $6M for Deepseek.

citation:

After experimentation with models with clusters of thousands of GPUs, High Flyer made an investment in 10,000 A100 GPUs in 2021 before any export restrictions. That paid off. As High-Flyer improved, they realized that it was time to spin off “DeepSeek” in May 2023 with the goal of pursuing further AI capabilities with more focus.

So where is the lie?

your post is asking a lot of questions already answered by your posting

[to the tune of Fort Minor's Remember The Name]

10% senseless, 20% post
15% concentrated spirit of boast
5% reading, 50% pain
and a 100% reason to not post here again

literally begging people to relearn the terms shareware and freeware