this post was submitted on 07 Sep 2023
160 points (98.2% liked)

Lemmy.ca's Main Community

2758 readers
1 users here now

Welcome to lemmy.ca's c/main!

Since everyone on lemmy.ca gets subscribed here, this is the place to chat about the goings on at lemmy.ca, support-type items, suggestions, etc.

Announcements can be found at https://lemmy.ca/c/meta

For support related to this instance, use https://lemmy.ca/c/lemmy_ca_support

founded 3 years ago
MODERATORS
 

Hello everyone!

I'll be working on migrating our image uploads from local files over to object store this Sunday starting at about 11am PT.

This may require extended lemmy.ca downtime as pict-rs has to be stopped while the migration happens, but I'm hoping I can keep things running as read-only and run the migration off a second instance.

Updates will be posted here - https://status.lemmy.ca/maintenance/257501

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 5 points 1 year ago (1 children)

I did the migration last week. London DigitalOcean to Amsterdam Backblaze. Sticking to "stable" pictrs, so 0.4.2. I think the biggest issue for the migration is that it's single threaded. If there's a way to tell it to do many items at once - that would help a great deal. Might be worth looking into 0.5.x alpha releases.

The problem I see with your plan is running pictrs during migration - you will still get thumbnails generated during that time. All this will lead to split brain. Not too big of a deal as you simply won't have thumbnails for recent sites, but, technically speaking, you will still have data loss in terms of imaging. Might as well avoid the overhead of making a copy of the db.

$0.02

[–] [email protected] 5 points 1 year ago (1 children)

The problem I see with your plan is running pictrs during migration - you will still get thumbnails generated during that time. All this will lead to split brain. Not too big of a deal as you simply won’t have thumbnails for recent sites, but, technically speaking, you will still have data loss in terms of imaging. Might as well avoid the overhead of making a copy of the db.

Yep but I was thinking that losing some thumbnails was better than having image delivery completely off for hours.....

[–] [email protected] 4 points 1 year ago

Fair point 👍