this post was submitted on 05 Jul 2024
42 points (97.7% liked)

TechTakes

1441 readers
73 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 5 points 4 months ago (6 children)

So, you know LLM has a context window right? That means context overflow is a valid LLM attack strategy if you are somehow able to send more stuff than what is allowed.

[–] [email protected] 7 points 4 months ago (5 children)
[–] [email protected] 5 points 4 months ago* (last edited 4 months ago) (4 children)

Nothing? I'm pointing out another way to "attack" some LLM?

[–] [email protected] 9 points 4 months ago (2 children)

Probably would have been easier when the context window wasn't 128k.

Though what the point would be should someone actually achieve that eludes me a bit.

[–] [email protected] 10 points 4 months ago (1 children)

I don't know man. Maybe a chat bot for help center that forgot they shouldn't give refund or non existent promotion?

[–] [email protected] 1 points 4 months ago

I have LLMs translate novels, I can tell when they run over the window because they forget characters' gender half way through, things like that. Lots of legal documents are even longer, maybe.

load more comments (1 replies)
load more comments (1 replies)
load more comments (1 replies)