I actually use an AMD card for running image generation and LLMs on my PC on Linux. It's actually not hard to set up.
Wait, did you replace pipewire-pulse with pulseaudio?
Some captchas have also just gotten obvious AI training. "Click on the living being in this image", "Select every image of the same object as in this example image". And the images you have to select look obviously AI generated.
I would guess making their phones seem more secure because people get less malware. I still think it's stupid tho.
Big difference is that that one setting was shown to you with a button press when you tried to install an app. With this, you need to remember or make a screenshot of where you need to go, open the settings app and then go there and toggle it on. It's just a lot more annoying to do and Samsung probably hopes that that will deter people from doing it.
But it also shows you a button to go straight to the toggle that lets you enable it when you try to install an app
Should have warned me that this is a saddest story 😔
The low quant versions of a 70B model are still way better than a high quant version of an 8B model tho. But yeah, performance might be ass, I don't have anything like a 4090, so I couldn't tell you. The main thing I do with these locally run models is use it for SillyTavern, which lets you kinda do roleplay with fictional characters. That's kinda fun sometimes. But I don't really use it much besides that either. Just testing how well different models perform and what I can run on my GPU is kinda fun in itself too tho.
Yeah, I prefer to use EXL2 models. GGUF models split across GPU and CPU are slow af, I tried that too. But I've seen mutliple people on Reddit claim that they run 70B models on cards like 4090s.
From the benchmarks it seems like it's actually a noticable improvement over Llama 3. Llama 3 was already a lot better than Llama 2 (from actually using it, not just benchmarks), so I'm really interested in how good this actually is in practice.
Pretty sure a good chunk of people are actually running 70B models tho
Pipewire-pulse (or whatever the package is called) is the drop-in replacement for pulseaudio that makes apps, that normally use pulseaudio, use pipewire instead. You can't have both installed. You can have pipewire and pulseaudio installed at the same time but your system can only use one of them at a time.