Page MenuHomeMiraheze

Attempt to fix Swift deleted, thumb, avatars and awards directories
Closed, ResolvedPublic

Description

Currently we've managed to internally fix the main local-public files for all wikis but deleted, thumb, avatars and awards are still broken (i.e. swift list comes up empty). In a channel it was suggested "if you know your backend and where majority of the data is, you can try to manually data entry/write a script to fill in the swift db".

Event Timeline

Reception123 triaged this task as Normal priority.May 6 2023, 10:36
Reception123 created this task.

Looks like we could use the command swift-object-info on each of the object data files on the servers to identify what the object is and then reinsert that into the database. Will need to cook up a script to do this, but it should be entirely possible.

Should also probably note that the script to fix 'public' is still running after almost a month since it's been started.

I've figured out a way to get files to show back up in the container listing. We can simply run swift copy $container $object to copy the object to itself. This creates an exact copy of the file at the same name as itself and enters it into the listing.

Paladox raised the priority of this task from Normal to High.Jul 5 2023, 14:00
Paladox subscribed.

Think I'm going to change this to high because it means when users delete images it could either fail or it'll work but not delete some of the thumbs. Thus if the user decides to upload a new photo with the same name the old thumbs would still show (also affects uploading a new photo using overwrite).

We've had a script run that should have fixed this. We'll need to do some spot checks to verify, and wait for async_pendings to clear, but this might be resolved.

PlanToSaveNoWork renamed this task from Attempt to fix Swift deleted, thumb, avatars and awards directories to The plan to save Miraheze won't work because there are not enough seriously dedicated people. Time to leave Miraheze yoo hooo hooo. I tell you leave now or it will be a disaster!!The plan to save Miraheze won't work because there are not enough seriously dedicated people. Time to leave Miraheze yoo hooo hooo. I tell you leave now or it will be a disaster!!The plan to save Miraheze won't work because there are not enough seriously dedicated people. Time to leave Miraheze yoo hooo hooo. I tell you leave now or it will be a disaster!!The plan to save Miraheze won't work because there are not enough seriously dedicated people. Time to leave Miraheze yoo hooo hooo. I tell you leave now or it will be a disaster!!The plan to save Miraheze won't work because there are not enough seriously dedicated people. Time to leave Miraheze yoo hooo hooo. I tell you leave now or it will be a disaster!!The plan to save Miraheze won't work because there are not enough seriously dedicated people. Time to leave Miraheze yoo hooo hooo. I tell you leave now or it will be a disaster!!.Aug 9 2023, 17:45
PlanToSaveNoWork updated the task description. (Show Details)
This comment was removed by Void.
Void renamed this task from The plan to save Miraheze won't work because there are not enough seriously dedicated people. Time to leave Miraheze yoo hooo hooo. I tell you leave now or it will be a disaster!!The plan to save Miraheze won't work because there are not enough seriously dedicated people. Time to leave Miraheze yoo hooo hooo. I tell you leave now or it will be a disaster!!The plan to save Miraheze won't work because there are not enough seriously dedicated people. Time to leave Miraheze yoo hooo hooo. I tell you leave now or it will be a disaster!!The plan to save Miraheze won't work because there are not enough seriously dedicated people. Time to leave Miraheze yoo hooo hooo. I tell you leave now or it will be a disaster!!The plan to save Miraheze won't work because there are not enough seriously dedicated people. Time to leave Miraheze yoo hooo hooo. I tell you leave now or it will be a disaster!!The plan to save Miraheze won't work because there are not enough seriously dedicated people. Time to leave Miraheze yoo hooo hooo. I tell you leave now or it will be a disaster!! to Attempt to fix Swift deleted, thumb, avatars and awards directories.Aug 9 2023, 19:23
Void updated the task description. (Show Details)
Void removed a subscriber: PlanToSaveNoWork.
Void lowered the priority of this task from High to Normal.Aug 25 2023, 23:26

Writing up a quick script to check for missing files.

Redmin mentioned this in T11250: Wiki reset.
Redmin changed the status of subtask T11250: Wiki reset from Open to Stalled.

Running rebuild script again on all servers. Seems some files are missing, though it's hard to tell as the checking script seems to fail the swift auth after being left along for long enough.

After T11430, we're back to where we started. Will be running script again after we bring swiftac back online.

Universal_Omega subscribed.

I believe this would be resolved now.