this post was submitted on 14 Sep 2024
603 points (97.8% liked)

Technology

59607 readers
3435 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago
MODERATORS
L3s
[email protected]
[email protected]
L4s
enu
603
OpenAI is reportedly going all-in as a for-profit company (mashable.com)
submitted 2 months ago* (last edited 2 months ago) by [email protected] to c/technology
121 comments fedilink hide all child comments
 

Surprised pikachu face

you are viewing a single comment's thread
view the rest of the comments
[–] Blaster_M 20 points 2 months ago (1 children)

Or just straight up install https://ollama.com

[–] utopiah 10 points 2 months ago (1 children)

I like Ollama, and recommend it to tinker, but I admit this "LLM Explorer" is quite neat thanks to sections like "LLMs Fit 16GB VRAM"

Ollama just works but it doesn't help to pick which model best fits your needs.

[–] Knock_Knock_Lemmy_In 2 points 2 months ago (2 children)

pick which model best fits your needs.

What is the need I have to put the effort in to install all this locally. Websites win in terms of convenience.

[–] utopiah 2 points 2 months ago (1 children)

I don't think I understand your point, are you saying there is no benefit in running locally and that Websites or APIs are more convenient?

[–] Knock_Knock_Lemmy_In 1 points 2 months ago

I already have stable diffusion on a local machine. I was trying to find motivation to install a LLM locally. You answered my question in a different response

use cases where customization helps while quality does matter much due to scale, i.e spam, then LLMs and related tools are amazing.

[–] morriscox 2 points 2 months ago (1 children)

I want to work on my stuff in peace and in private without worrying about a company grabbing my stuff and using it for themselves and to give/sell it to other outfits, including the government. "If you have nothing to hide..." is bullshit and needs to die.

[–] Knock_Knock_Lemmy_In 1 points 2 months ago

Good point. Everything you feed into chatgpt is stored for future reference.