this post was submitted on 13 Oct 2024
192 points (98.0% liked)

TechTakes

1335 readers
141 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] EnderMB 4 points 4 days ago* (last edited 4 days ago) (3 children)

"sigh"

(Preface: I work in AI)

This isn't news. We've known this for many, many years. It's one of the reasons why many companies didn't bother using LLM's in the first place, that paired with the sheer amount of hallucinations you'll get that'll often utterly destroy a company's reputation (lol Google).

With that said, for commercial services that use LLM's, it's absolutely not true. The models won't reason, but many will have separate expert agents or API endpoints that it will be told to use to disambiguate or better understand what is being asked, what context is needed, etc.

It's kinda funny, because many AI bros rave about how LLM's are getting super powerful, when in reality the real improvements we're seeing is in smaller models that teach a LLM about things like Personas, where to seek expert opinion, what a user "might" mean if they misspell something or ask for something out of context, etc. The LLM's themselves are only slightly getting better, but the thing that preceded them is propping them up to make them better

IMO, LLM's are what they are, a good way to spit information out fast. They're an orchestration mechanism at best. When you think about them this way, every improvement we see tends to make a lot of sense. The article is kinda true, but not in the way they want it to be.

[–] [email protected] 20 points 4 days ago (2 children)

(Preface: I work in AI)

Are they a serious researcher in ML with insights into some of the most interesting and complicated intersections of computer science and analytical mathematics, or a promptfondler that earns 3x the former's salary for a nebulous AI startup that will never create anything of value to society? Read on to find out!

[–] [email protected] 10 points 4 days ago (1 children)

Read on to find out!

do i have to

[–] [email protected] 11 points 4 days ago (1 children)

Welcome to the future! Suffering is mandatory!

[–] [email protected] 14 points 4 days ago

as a professional abyss-starer, I'm going to talk to my union about this

[–] EnderMB 4 points 4 days ago (1 children)

I'm a Software Engineer at Amazon, and have worked on compositional and large language models for the last four years. I'm not a researcher, but I do work in applied and research science. My work is mostly to facilitate the science work and create scalable ways to make experiments work.

[–] CookieOfFortune 2 points 4 days ago (1 children)

Is thereA specific reason you picked Amazon?

[–] EnderMB 2 points 4 days ago (1 children)

Money, mostly.

Aside from that, I joined fully aware of how cutthroat it is, and naively assumed that because I had succeeded in other places I'd be fine here. The churn is 100% real.

I'm still grateful to have worked here. It sounds cool to say I work in AI, I have enough money saved to take 2+ years off if I wanted, and it's been good to work on something that millions of people use - regardless of my own thoughts on if it's useful/good or not.

[–] CookieOfFortune 1 points 4 days ago* (last edited 4 days ago) (1 children)

Did they pay more than competitors? How did it compare?

[–] EnderMB 1 points 3 days ago (1 children)

Outside of big tech and quants, yes. In the UK especially, salaries vary wildly. Some amazing software engineers might be lucky to make £50k, while someone in big tech might make that in RSU's alone in a given year, with a salary twice as big again.

With that said, I'd find a middle ground to be nice, decent pay for decent WLB.

[–] CookieOfFortune 1 points 3 days ago (1 children)

Wait 150k-200k is considered good in the UK? I’d have thought you’d be getting offers in the millions/year.

[–] EnderMB 1 points 3 days ago* (last edited 3 days ago)

The average salary for London is ~£60k, and substantially less outside (I'm not from London).

Salaries here are much lower than that of the US, and lower than some European countries. Despite all of this, it also means that if you save enough from a high-paying job you can supplement your income from your interest and pursue other things.

Tax is also very high, but the other side of this is that healthcare is free, and worker protections are higher than in the US.

IMO, moving to the UK or parts of Europe is something many people in tech should do once they've earned seven figures in tech in the US. Despite lower income, they could probably live off of their interest and retire somewhere with an arguably equal quality of life.

[–] [email protected] 9 points 4 days ago* (last edited 4 days ago) (2 children)

what a user “might” mean if they misspell something

this but with extra wasabi

[–] [email protected] 10 points 4 days ago (1 children)

*trying desperately not to say the thing* what if AI could automatically... round out... spelling

[–] [email protected] 6 points 4 days ago

It hurts when they're so close!

[–] EnderMB 1 points 4 days ago

You may laugh, but there's very real applications that are quite interesting, particularly in how AI can help someone with a severe speech impediment, or in understanding someone who might not speak/write in English as their primary language. Persona agents are quite interesting, and might actually be a useful application for LLM's.

[–] [email protected] 7 points 4 days ago* (last edited 4 days ago) (2 children)

(Preface: I work in AI)

Preface: repent for your sins in sackcloth and ashes.

IMO, LLM’s are what they are, a good way to spit information out fast.

Buh bye now.

[–] [email protected] 18 points 4 days ago

while true; do fortune; done is a good way to spit information out fast.

[–] EnderMB 4 points 4 days ago

This is why people don't like Lemmy.