this post was submitted on 14 Sep 2024
603 points (97.8% liked)

Technology

59679 readers
3226 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

Surprised pikachu face

you are viewing a single comment's thread
view the rest of the comments
[–] mayo 39 points 2 months ago (1 children)

Another good resource to help people find models https://llm.extractum.io

[–] Blaster_M 20 points 2 months ago (1 children)
[–] utopiah 10 points 2 months ago (1 children)

I like Ollama, and recommend it to tinker, but I admit this "LLM Explorer" is quite neat thanks to sections like "LLMs Fit 16GB VRAM"

Ollama just works but it doesn't help to pick which model best fits your needs.

[–] Knock_Knock_Lemmy_In 2 points 2 months ago (2 children)

pick which model best fits your needs.

What is the need I have to put the effort in to install all this locally. Websites win in terms of convenience.

[–] utopiah 2 points 2 months ago (1 children)

I don't think I understand your point, are you saying there is no benefit in running locally and that Websites or APIs are more convenient?

[–] Knock_Knock_Lemmy_In 1 points 2 months ago

I already have stable diffusion on a local machine. I was trying to find motivation to install a LLM locally. You answered my question in a different response

use cases where customization helps while quality does matter much due to scale, i.e spam, then LLMs and related tools are amazing.

[–] morriscox 2 points 2 months ago (1 children)

I want to work on my stuff in peace and in private without worrying about a company grabbing my stuff and using it for themselves and to give/sell it to other outfits, including the government. "If you have nothing to hide..." is bullshit and needs to die.

[–] Knock_Knock_Lemmy_In 1 points 2 months ago

Good point. Everything you feed into chatgpt is stored for future reference.