Linux

48008 readers

852 users here now

From Wikipedia, the free encyclopedia

Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).

Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.

Rules

Posts must be relevant to operating systems running the Linux kernel. GNU/Linux or otherwise.
No misinformation
No NSFW content
No hate speech, bigotry, etc

Related Communities

Community icon by Alpár-Etele Méder, licensed under CC BY 3.0

founded 5 years ago

MODERATORS

[email protected]

209

What is the largest file transfer you have ever done? (startrek.website)

submitted 2 months ago by [email protected] to c/[email protected]

137 comments fedilink hide all child comments

I'm writing a program that wraps around dd to try and warn you if you are doing anything stupid. I have thus been giving the man page a good read. While doing this, I noticed that dd supported all the way up to Quettabytes, a unit orders of magnitude larger than all the data on the entire internet.

This has caused me to wonder what the largest storage operation you guys have done. I've taken a couple images of hard drives that were a single terabyte large, but I was wondering if the sysadmins among you have had to do something with e.g a giant RAID 10 array.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 9 points 2 months ago* (last edited 2 months ago) (2 children)

~15TB over the internet via 30Mbps uplink without any special considerations. Syncthing handled any and all network and power interruptions. I did a few power cable pulls myself.

[–] [email protected] 4 points 2 months ago (3 children)

I think it's crazy that not that long ago 30mbps was still pretty good, we now have 1gbps+ at residential addresses and it fairly common too

[–] [email protected] 3 points 2 months ago

I’ve got symmetrical gigabit in my apartment, with the option to upgrade to 5 or 8. I’d have to upgrade my equipment to use those speeds, but it’s nice to know I have the option.

[–] [email protected] 2 points 2 months ago* (last edited 2 months ago) (1 children)

Yeah, I also moved from 30Mb upload to 700Mb recently and it's just insane. It's also insane thinking I had a symmetric gigabit connection in Eastern Europe in the 2000s for fairly cheap. It was Ethernet though, not fiber. Patch cables and switches all the way to the central office. 🫠

Most people in Canada today have 50Mb upload at the most expensive connection tiers - on DOCSIS 3.x. Only over the last few years fiber began becoming more common but it's still fairly uncommon as it's the most expensive connection tier if at all available.

[–] [email protected] 2 points 2 months ago (1 children)

We might pay some of the most expensive internet in the world in Canada but at least we can't fault them for providing an unstable or unperformqnt service. Download llama models is where 1gbps really shines, you see a 7GB model? It's done before you are even back from the toilet. Crazy times.

[–] [email protected] 2 points 2 months ago* (last edited 2 months ago)

I should have know that the person on the internet noting 30Mbps was pretty good till recently is a fellow Canadian. 🍁 #ROBeLUS

BTW, TekSavvy recently started offering fiber seemingly on Bell's last mile.

[–] [email protected] 2 points 2 months ago

Fiber is so nice

[–] pete_the_cat 3 points 2 months ago (1 children)

How long did that take? A month or two? I've backfilled my NAS with about 40 TB before over a 1 gig fiber pipe in about a week or so of 24/7 downloading.

[–] [email protected] 3 points 2 months ago

Yeah, something like that. I verified it it with rsync after that, no errors.