I'm not familiar with Quanta from before, but what a fantastic article. It explains the problem and the history in an engaging way that manages to be approachable to us without an academic background in CS while still retaining some academic substance. Very informative!
this post was submitted on 26 Jan 2025
84 points (100.0% liked)
Programming
18142 readers
136 users here now
Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!
Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.
Hope you enjoy the instance!
Rules
Rules
- Follow the programming.dev instance rules
- Keep content related to programming in some way
- If you're posting long videos try to add in some form of tldr for those who don't want to watch videos
Wormhole
Follow the wormhole through a path of communities [email protected]
founded 2 years ago
MODERATORS
Comments like this are valuable. I would not have read that but for your well written praise.
Is there anyone here who’s familiar with the paper(s) mentioned in the article? I’d actually like to read them, so if you do, it’d be great if you could share it with me. I couldn’t really find it in the article, unless it’s just hidden under one of their links.
I found the following paper with the authors mentioned:
https://arxiv.org/abs/2501.11582
But not sure if that’s it. It does have some semblance to the topic though. My search-fu isn’t really doing me great with just author names though.
Could this be used for filesystems? I know little about them but I remember NTFA requires defragmentation to keep performance and ext4 hasn't ever required that in my experience. No idea about BTRFS, XFS, and others. My inkling is that it would be quite useful, but maybe somebody else could make a more educated guess.
Just a sidenote about ntfs & ext4.
ntfs doesnt require defragmentation on SSDs, and it actually might lower the lifespan of your SSD because of the increase in unnecessary read/writes.
ext4 IIRC works just fine as long as your drive is at most 90% full and you keep that last 10% free.
Its been a while since i read up on that fact about ext4 so someone more experienced can correct me if im wrong
You are correct! And moreover, fragmentation was bad on HDDs because they are good at reading sequential data, so fragmentation limited performance by making reads more random. However, SSDs are the opposite and are more performant on random reads, so fragmentation actually benefits them! (some of the time)
Jacked up the first SSD I ever bought. Windows 7 (I think?), NTFS. Defragged it out of habit, even though I knew better. Yep, ran much slower, and it was obvious.
Seems like the answer is yeah!
That’s because the problem also applies to the arrangement of files on hard drives and in databases, where the items to be arranged could number in the billions.