this post was submitted on 08 Oct 2024
44 points (86.7% liked)

Technology

59990 readers
2301 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS
top 21 comments
sorted by: hot top controversial new old
[–] [email protected] 29 points 2 months ago

https://aws.amazon.com/s3/

Amazon Simple Storage Service (Amazon S3) is an object storage service

[–] FourPacketsOfPeanuts 24 points 2 months ago

Amazon's cloud based Simple Storage Service (hence the S3). It is, in ELI5 terms, a file storage service like Microsoft's OneDrive or Apple's iCloud. A bit like a harddrive reached over the internet. You transfer files to and from it.

That's grossly oversimplifying of course. S3 has some important technical differences to a straight up "cloud drive". And it comes with a mind boggling array of options so it can be customised to be the storage of all sorts of very large real world applications and websites.

[–] [email protected] 22 points 2 months ago (1 children)

It's worth noting that a number of other providers now sell S3-compatible storage services that are completely separate from Amazon, but let you interact with them using any of the S3 tools that have sprung up.

[–] [email protected] 4 points 2 months ago

There's also Minio which is compatible and self hostable.

[–] [email protected] 16 points 2 months ago* (last edited 2 months ago) (1 children)

S3 started as a place on the cloud to store and retrieve files. But it's evolved a lot over the years:

  • You can directly stream music and videos from it.
  • Along with a separate Content Distribution Network (CloudFront), you can have copies geographically replicated to be closer to end-users.
  • There's a separate service (Transfer), you can have multiple locations securely upload files to it. Examples are schools, retail outlets, enterprise divisions, news media, etc.
  • It has a built-in event system, so whenever a file is uploaded, it can trigger a function to process the content automatically. This makes it handy for applications where users upload content (like videos) that need to be automatically converted, then copied to another S3 'bucket' for streaming or download.
  • You can make a 'bucket' (think of it as a directory of files) become a webserver, accessible via HTTP. This makes it dead-easy to build web front-ends using React/Vue, etc. and deploy them there.
  • Also handy to host static HTML content, for things like blogs, portfolios, or galleries. A lot of static content generators like Hugo and Jekyll have direct upload to S3 built in.
  • If looking to archive or backup, you can designate files to be put into deep freeze on Glacier. This means they are stored, but you will likely not have to access them that often. Storage and access costs are lots cheaper.
  • There's a whole audit log/access control backend for regulated industries like finance, law, or healthcare.
  • You can set alarms so you are notified when there is a problem, and rules to prevent things like massive file uploads or DDOS downloads.
  • You can create what's called a 'pre-signed URL' so someone using it can securely access a file for a limited amount of time. Those without can't access it.
  • There's a command line tool, as well as programming toolkits in lots of languages that let your websites and apps directly integrate with it.
  • Cost-wise, it's pay-as-you-go with no monthly fee. So you can store a bunch of files up there and the bill at the end of the month is like, $0.23.
  • However, there is a fee for 'egress' traffic to the cloud, so if you want to put some content somewhere public and a lot of people access it, it can get expensive.
  • A bunch of third-party services have sprung up to offer basic S3-like access with zero egress fees, but they trade that fee for a basic monthly one (Backblaze B2, CloudFlare R2, Wasabi). Generally, they'll cost less, but you lose some of the above features.
  • There are tools that mount S3 buckets as local filesystems, so you can add/list/delete files as if they're local.

There's more, but that's the crux of it.

[–] toynbee 2 points 2 months ago

In one post, you summarized the majority of the CCP course I took a few years back.

[–] [email protected] 11 points 2 months ago (1 children)

A less secure version of S4, the Super Simple Storage Service.

http://www.supersimplestorageservice.com/

[–] [email protected] 2 points 2 months ago* (last edited 2 months ago) (1 children)

Excuse my dumbness, but how would it be useful if it's "write-only". You just put data in the cloud, never to be read again? I'm probably misunderstanding lol

Edit: nevermind, it's a joke website right?

[–] [email protected] 2 points 2 months ago

Yeah it's meant to be satire

[–] bamfic 9 points 2 months ago

An abomination before the lord

[–] mrnarwall 8 points 2 months ago (2 children)

As part of AWS? S3 stands for "simple storage solution" and it is used for storing data in the cloud. A typical s3 setup has a "bucket" which would act like a folder directory on your computer. At that point it can be pretty much however you want to set it up. In theory it can store anything, as long as it can be converted into a binary string, I believe. I havent worked in AWS in a few years, but I recall it being easy enough to use for storing files when handling file transfers with other microservices like Lambdas. You just need to configure a few things, like the bucket name, the "file name" (I say it that way, because you dont necessarily have to store files - and anything stored in s3 has to be converted to that binary string), and the

It can be even more than just simple storage when used with other microservices, the possibilities can be endless

[–] [email protected] 4 points 2 months ago (1 children)

So basically a "string" of bytes stored in AWS servers that can be exposed as anything really

[–] lando55 4 points 2 months ago

We're all just 1s and 0s on some level. Or quarks I guess? I don't know where we are now wrt elementary particle models.

[–] [email protected] 4 points 2 months ago (2 children)

S3 stands for "Simple Storage Service" not "Simple Storage Solution".. fake news :P

[–] [email protected] 2 points 2 months ago (1 children)

And it’s definitely not simple. I hate dealing with AWS at work, shit is overly complex where it doesn’t need to be.

[–] [email protected] 2 points 2 months ago

I agree. And the default AWS configs are very unsafe as well. But I didn't came up with the same, blame Amazon.

[–] mrnarwall 1 points 2 months ago

I have been exposed as a fraud and I will take my punishment! j/k, but worth noting

[–] monkinto 5 points 2 months ago (1 children)

The only thing I don't see mentioned in the explanations that already exist is that S3 is a pay for usage service.

I.E. You don't pay for a tier of storage you pay for the gb of storage used. If your usage increases your cost goes up and if your usage goes down your costs go down. Which makes it very easy to set and forget. No need to worry about keeping your data storage under a certain amount or to remember to switch to a lower tier to save money etc.

Granted that can backfire and result in a surprise bill way more than you were expecting but that is usually not an issue especially for medium to large size businesses.

[–] [email protected] 3 points 2 months ago

IIRC, other Cloud providers like Digital Ocean and Linode provide S3 storage solutions that have a flat fee for a certain GB amount of storage.

[–] [email protected] 2 points 2 months ago

It's a storage agnostic protocol for sending, receiving and enumerating to/from cloud storage. Think off it like email. Email service providers allow for a number of ways to access your email, be it pop3, IMAP or web. The underlying technology is abstracted away. In the same way cloud storage allows for web, s3 and/or WebDAV. Amongst others. And likewise the back end is abstracted away. The s3 client you use doesn't need to know how the data is actually stored. And there's some pretty whacky storage back ends.

[–] [email protected] 1 points 2 months ago

One of Amazon Web Service's service that stores data. It works in combination with a few other of their services.