Falcon

I agree with revealJS, I recommend trying it with org-mode in eMacs with the plugin (plus you also get banner for free)

Alternatively, it also works with Jupyter.

This is what I use for every presentation I need to give.

Basically, RoCM and CUDA allows one to do math on the GPU. Most Linear Algebra operations (i.e. LLM or NNs and ML generally) can be parallelized over a GPU which is much more performant than CPU.

To perform calculations on GPU, one needs some sort of interface to to their programming language of choice, NVIDIA has CUDA which is in CPP with bindings to python: (pytorch, Tensorflow etc. ), Julia: Flux etc.

RoCM is AMDs solution, there bindings are young and not widely implemented.

My advice, play around with Flux RoCM and PyTorch RoCM just to get an idea. Suffice it to say, when I started doing RL and LLMs more seriously I gave up my colab and sold my AMDs to fund a 3060.

You want H2OGPT or just use Langchain with CLI

Just use flatpak and podman, in a punch you can proot into a different system / zfs data set / btrfs sublime

I just use and old laptop

Re your update.

My framework has been great, I’ve had no issues with it and I’m quite happy. Make sure to go with the matte screen though.

In saying that, I think I was happier with my thinkpad, but I have no good scientific reason for that, I suspect the nipple and keyboard are a big part of it.

Framework and ThinkPad have both been a really positive experience.

Also, if it’s just the DE, install sway / i3 and try that for a week. If you liked that it’s on literally every Linux distribution, even the BSDs.

Go with EndeavourOS. It won’t “just work”, but it will be the best compromise between confusing abstraction and low level frustrations.

Fedora is good but it abstracts a little too much away, this is great when you understand how software works, but it’s very confusing when you’re new to Linux and programming.

Arch is good, but you won’t be able to hid the ground running, you’d have to sacrifice a weekend to learn.

Go:

0. [Optional] Fedora
1. Endeavour
2. Arch
3. Learning

• Ghost BSD
• Void
• Gentoo

Tinkering with those in that order, after about 6 months, you’ll start to feel at home.

If and only if the trained model is accessible without licence.

E.g. I don’t want Amazon rolling out a Ilm for $100 a month based on freely accessible tutorials written by small developers.

But yeah duck copyright

Worth mentioning that one can use bubblewrap directly over chroot to get similar behaviour as well.

It’s often simpler to use distrobox but being able to rsync chroot a between devices can be very convenient.

I wish there was more variety.

You basically have BSD and Linux and in the Linux space {glibc/musl systemd/openrc/runit PKGBUILD,ebuild,deb,rpm} which seems like a lot but it’s the really niche stuff that’s fun to pull apart and play with.