this post was submitted on 24 Mar 2024
17 points (100.0% liked)

Jellyfin: The Free Software Media System

5855 readers
6 users here now

Current stable release: 10.10.3

Community Standards

Website

Forum

GitHub

Documentation

Feature Requests

Matrix (General Information & Help)

Matrix (Announcements)

Matrix (General Development)

Matrix (Off-Topic) - Come get to know the team and blow off steam!

Matrix Space - List of all the available rooms on Matrix.

Discord - Bridged to our Matrix rooms

founded 4 years ago
MODERATORS
 

Hi I have jellyfin installed in a VM with 24 cores and 32GiB RAM (VM also used for Docker). Whenever I attempt to play higher quality files, jellyfin crashes after a few minutes. I haven't seen it struggle with lower quality media. 

Here are some logs: FFmpeg.Transcode-2024-03-24_16-11-43_d48825174d455ae3ff859d8b28582853_ce3f3ebf.log upload_org.jellyfin.androidtv_0.16.7_20240324161053_d2befd034e424a3490e7ea55af1fe1f2.log Fmpeg.Transcode-2024-03-24_16-11-38_d48825174d455ae3ff859d8b28582853_dafa4555.log FFmpeg.DirectStream-2024-03-24_16-08-12_d48825174d455ae3ff859d8b28582853_dac7115f.log

I cannot for the life of me figure out whats wrong. I've tried disabling plugins, different clients, hard resets etc, but it still crashes.

Can someone enlighten me??  :(

top 35 comments
sorted by: hot top controversial new old
[–] [email protected] 4 points 9 months ago (1 children)

It looks like your using nvidia for transcodes. Try disabling hardware acceleration temporarily to test if it is related.

[–] sammeeeeeee 1 points 9 months ago

It's already off

[–] stankmut 4 points 9 months ago* (last edited 9 months ago) (1 children)

I have this issue whenever I have to deal with transcoding. The stream will usually die after a few minutes of watching. I haven't seen anything out of the ordinary in the logs. I've just resigned myself to lugging around the device I have that can direct stream the files.

[–] [email protected] 2 points 9 months ago (1 children)

Are you using software transcoding?

[–] stankmut 1 points 9 months ago* (last edited 9 months ago) (1 children)

It's supposed to be hardware transcoding with on an Intel cpu (using vaapi) . No idea if it's actually working.

[–] [email protected] 1 points 9 months ago

Check your CPU usage. If it is lower then it is working

[–] AMillionMonkeys 4 points 9 months ago (1 children)

If the crashes are seemingly at random when transcoding I would suspect overheating hardware. Transcoding uses more energy and produces more heat than playing directly. If it were a software issue it would either work or not.

[–] sammeeeeeee 3 points 9 months ago

IDRAC logs show normal temps

[–] [email protected] 3 points 9 months ago (2 children)

Why in a vm? What's that good for?

[–] sammeeeeeee 6 points 9 months ago (1 children)

I have a couple of vms on my server - truenas, pihole, etc. One is for my media - arrs in docker containers and Jellyfin installed (not at container as it wasn't binding to the media dir properly)

[–] [email protected] -3 points 9 months ago (1 children)
[–] [email protected] 6 points 9 months ago (2 children)

Why not in a VM? All my stuff runs in VM's.

[–] [email protected] 2 points 9 months ago (2 children)

Doesn't the vm produce an overhead? More power consumption and it can't use the full capabilities of the machine?

[–] [email protected] 5 points 9 months ago (2 children)

There are many benefits to VMs. You can limit how much RAM is available to each one, so one app doesn't eat all of your RAM. Same with CPU. Virtual Machines can be backed up, uploaded to remote storage, and restored. When it's time to do a big update on your main machine (either changing OS or getting new hardware), restoring VM's is super simple compared to the alternative.

[–] [email protected] 6 points 9 months ago (2 children)

You can limit them in docker as well

https://phoenixnap.com/kb/docker-memory-and-cpu-limit You can spin up the same container on another machine with one command.

Docker seems to be easier, not?

[–] [email protected] 2 points 9 months ago

Docker is great, and I have it running in multiple VM's. For me to restore everything without VM's would be a little tedious.

I'd have to search for Docker install instructions, follow the instructions like importing keys, adding the repository, doing the post-install stuff (adding my user to the docker group), etc. Not a big deal, but it's something.

Then I'd start copying data, making sure to keep the same folder structure so my compose files work. Then I start running all the commands to get all the containers back up and running (or in my case, creating 20+ stacks in Portainer).

This is all a bit tedious for me compared to opening the web interface for Proxmox, clicking on the backup (which is just "there" because it's on a hard drive (or a ZFS pool in my case)), and clicking "restore". Once restored it just boots up and my Docker stuff is good to go.

[–] sammeeeeeee 1 points 9 months ago

Can run multiple different os's - I have truenas, windows server, Ubuntu server for docker, etc

[–] [email protected] 2 points 9 months ago (1 children)

You can limit how much RAM is available to each one, so one app doesn’t eat all of your RAM. Same with CPU.

This can be done with containers and you don't get the overhead of virtualizing a whole operating system for every service/app you might be hosting.

Virtual Machines can be backed up, uploaded to remote storage, and restored.

This can also be done with containers in a more elegant way as there's no need to back up any VM/OS data.

E.g. I have a docker compose file that can nearly immediately stand up a container with the right settings/image, point it to my restored data and be up and running in no time. The best part is i don't need to back up the container/OS because that data is irrelevant.

When it’s time to do a big update on your main machine (either changing OS or getting new hardware), restoring VM’s is super simple compared to the alternative.

With the alternative you just restore your data and run docker-compose up -d. Docker will handle the process of building, starting and managing the service.

Simple example: Your minecraft server died but you have backups. You just restore the data to /docker/minecraft. Then (to keep things really simple) you just run:

docker run -d -p 25565:25565 --name minecraft -e EULA=TRUE -v /docker/minecraft:/data itzg/minecraft-server

and in a few minutes your server is ready to go.

[–] [email protected] 1 points 9 months ago

If that's the way you'd prefer to do it, I highly recommend taking that approach.

[–] thantik 2 points 9 months ago* (last edited 9 months ago) (1 children)

VMs can also do something called https://en.wikipedia.org/wiki/Kernel_same-page_merging - meaning a single machine could run something like 52 instances of Windows XP on 1gb of RAM

So for example, say I needed to run a bunch of ARK servers - I could put them all in VMs, and since they're all loading mostly the same assets, I could run a lot of them in the very tiny amount of memory.

[–] [email protected] 1 points 9 months ago

Thats crazy

[–] [email protected] -1 points 9 months ago

Why do you guys do it?

[–] [email protected] 1 points 9 months ago

I run it in a VM just like everything else. I use ePCI passthough for hardware

[–] [email protected] 3 points 9 months ago (1 children)

This is pretty basic but have you checked how many cores and how much memory you have allocated to your VM?

[–] sammeeeeeee 1 points 9 months ago (1 children)

It's in the first line

I have jellyfin installed in a VM with 24 cores and 32GiB RAM

[–] [email protected] 4 points 9 months ago (1 children)

Oh. I thought that was for the whole server. In that case, I'm all out of ideas.

[–] sammeeeeeee 1 points 9 months ago

Sorry my bad, could have written it clearer

[–] [email protected] 2 points 9 months ago (1 children)

I cant seem to open the second link, but what video driver version is running?

[–] sammeeeeeee 1 points 9 months ago* (last edited 9 months ago)

Pastebin wouldn't accept it (said it was nsfw - maybe because of killing processes?) so I used paste.io, which I now see is blocked by adblocking. I am not using Hardware transcoding, I am unsure where to find the driver version.

[–] [email protected] 2 points 9 months ago (1 children)

Are you using hardware decoding?

[–] sammeeeeeee 1 points 9 months ago
[–] [email protected] 1 points 9 months ago (1 children)

There's a couple things that stick out to me in these logs:

  1. the androidtv client logs show the crash was due to a time-out while waiting for the server to respond to a request for over 3 seconds.

  2. you included a DirectStream log, that's usually not too hard for even a Raspberry Pi to handle reasonably well

  3. the first log I looked at showed libx264 was using 36 threads

So my guess is that, due to video encoding not scaling all that well across larger numbers of threads, your server is being bogged down with this transcoding and isn't providing http responses fast enough to your client device(s).

A simple way to troubleshoot this would be to explicitly set the transcoding thread count to something a bit lower than what your server has, say 16 or 20, and see if that does any better.

An obvious potential fix would be to use hardware acceleration if it's available to you. I run my Jellyfin server off of a little N100 mini PC and it can transcode 4K HDR 70 Mbps video (tonemapping included) at about 45 fps due to the hw acceleration. That said, I know it can be tricky to set up in a VM and you may not have the HW accel capability in your server CPU anyhow.

[–] sammeeeeeee 2 points 9 months ago (1 children)

Wow, I never considered that too many cores may be the issue. I will for sure try that.

I believe my cpu is compatible, but I believe this is not iGPU transcoding. Pretty sure my server does have an iGPU (although I've never actually plugged in a screen so I can't be sure). I will research passing through either of those.

I also read that it's possible to use a different server for just transcoding. I have an old laptop I've been considering setting for that, but it's network speeds are shite.

[–] [email protected] 1 points 9 months ago (1 children)

@sammeeeeeee @entropicdrift not sure if Intel igpus are the same, but my ryzen 5700g igpu won't transcoded unless when it boots it has a monitor plugged in and powered on...

[–] sammeeeeeee 1 points 9 months ago

Oh well that's definitely not possible for me (unless idrac counts)