AlmightySnoo

ollama should be much easier to setup!

ROCm is decent right now, I can do deep learning stuff and CUDA programming with it with an AMD APU. However, ollama doesn't work out-of-the-box yet with APUs, but users seem to say that it works with dedicated AMD GPUs.

As for Mixtral8x7b, ~~I couldn't run it on a system with 32GB of RAM and an RTX 2070S with 8GB of VRAM, I'll probably try with another system soon~~ [EDIT: I actually got the default version (mixtral:instruct) running with 32GB of RAM and 8GB of VRAM (RTX 2070S).] That same system also runs CodeLlama-34B fine.

So far I'm happy with Mistral 7b, it's extremely fast on my RTX 2070S, and it's not really slow when running in CPU-mode on an AMD Ryzen 7. Its speed is okayish (~1 token/sec) when I try it in CPU-mode on an old Thinkpad T480 with an 8th gen i5 CPU.

In the earth it grows, and in it we find sustenance and unity 🥔🙏

Buy Now Pay Later is what's exacerbating this. People are dumb, have short attention spans and most of them are statistically bad at basic math, so when they see a purchase that they can make without paying anything now they'll hit buy and they'll do it many times as the e-commerce platform will usually recommend other products to them they'll likely want, they won't do the calculation to see if they really can afford the split payments + the interest.

PSA: give open-source LLMs a try folks. If you're on Linux or macOS, ollama makes it incredibly easy to try most of the popular open-source LLMs like Mistral 7B, Mixtral 8x7B, CodeLlama etc... Obviously it's faster if you have a CUDA/ROCm-capable GPU, but it still works in CPU-mode too (albeit slow if the model is huge) provided you have enough RAM.

You can combine that with a UI like ollama-webui or a text-based UI like oterm.

Hmm I don't think it's because of that feature, because it only runs when you explicitly ask it to translate a page for you. You should probably check your extensions, see if you have some redundant ones (a mistake people make is use multiple ad-blockers/anti-trackers, when just uBlock Origin + Firefox's defaults are usually good enough).

The lemmy.ca link needs to be opened inside a browser so that you see the thread on that instance. If you try to open it on an app like Voyager it will probably try to redirect you to your local instance, but the problem is that some instances purged it, probably because it quotes literal calls to violence.

Can someone explain like what are the lemmy devs political stance ?

They're tankies, ie radical communists who support authoritarian regimes like North Korea and the CCP, and fully support Russia's invasion of Ukraine. The devs also onboarded someone who openly said many times on October 8th that "all Israelis are valid targets", "anything that moves and isn't Palestinian is a valid target" and "there's no such thing as an Israeli civilian" and he's still in their team. On their own instance lemmy.ml (their choice of the .ml TLD is a reference to Marxism-Leninism), if you mention the Tiananmen massacre you get banned for "orientalism", and if you say that Hamas are terrorists you also get banned for "bothsidesing (sic)".

Does that leave a stain on Lemmy, the open-source project? Yes, for sure, it leaves Lemmy with a very questionable governance, and weird decisions like the absence of any prioritization of work on moderation tools and the very weird and completely random fact that they suddenly disabled sign-up captchas last summer leading to a bot infestation of most instances. Coincidentally, tankie instances like lemmygrad and hexbears rely on brigading, bots, and cyber-harassment to spread their poison, and strong moderation tools would hinder them a lot.

Now does that make it impossible for Lemmy to succeed? No, it's again an open-source project, and it can be forked away from the tankies at any time. In fact, there's even a highly credible rewrite in Java currently whose goal is to be 100% API-compatible with Lemmy: https://sublinks.org/ (see the announcement here: https://lemmy.world/post/11005411 )

Yup, Firefox has it: https://browser.mt/ (it's now a native part of Firefox)

Microsoft really wants someone to remind it of these days: