Page MenuHomeMiraheze

DataDumpProject
ActivePublic

Members

  • This project does not have any members.
  • View All

Watchers

  • This project does not have any watchers.
  • View All

Details

Description

A project for issues related to the DataDump extension. Please note that this extension is still being developed, so more features will become available in the future.

Recent Activity

Sun, Feb 4

OrangeStar added a comment to T11780: Importing from WikiTide.

Please try to request the import at Special:RequestImportDump first.

Sun, Feb 4, 19:12 · MediaWiki (SRE)
PlatinumYellow triaged T11780: Importing from WikiTide as Normal priority.
Sun, Feb 4, 19:09 · MediaWiki (SRE)

Fri, Feb 2

MacFan4000 closed T11579: XML Data Dump Fails as Resolved.

Deleted them. https://wfhb.miraheze.org/wiki/Special:DataDump now has a successful xml dump.

Fri, Feb 2, 21:18 · MediaWiki (SRE), DataDump
Chuck.Beckett added a comment to T11579: XML Data Dump Fails.

Yes, deleting the first 20 revisions of the Main Page would be fine. Thanks.

Fri, Feb 2, 14:02 · MediaWiki (SRE), DataDump

Thu, Feb 1

MacFan4000 added a comment to T11579: XML Data Dump Fails.

The above revision IDs correspond to 20 revisions of the Main Page. Unfortunately I believe the only solution would be to manually delete the corrupted ones from the Database. Would this be okay with you @Chuck.Beckett?

Thu, Feb 1, 18:25 · MediaWiki (SRE), DataDump
MacFan4000 added a comment to T11579: XML Data Dump Fails.
macfan@mwtask181:~$ sudo -u www-data php /srv/mediawiki/1.40/maintenance/storage/checkStorage.php --wiki=wfhbwiki
Thu, Feb 1, 18:16 · MediaWiki (SRE), DataDump
Reception123 updated subscribers of T11579: XML Data Dump Fails.

Unfortunately there's no way until we manage to fix the issue. Hopefully @Universal_Omega will be able to look into it soon. If you'd like, in addition to our general periodic backups, I could do an SQL backup which would be stored separately on one of our servers (we can't share those as they contain private information)

Thu, Feb 1, 15:20 · MediaWiki (SRE), DataDump
Chuck.Beckett added a comment to T11579: XML Data Dump Fails.

Is there any workaround I can do to get a Wiki backup? It get's me nervous when I don't have a content backup as there's a lot of info in there on how we run our non-profit that isn't replicated elsewhere.

Thu, Feb 1, 15:18 · MediaWiki (SRE), DataDump

Jan 9 2024

Reception123 closed T11461: Image Dump Request for https://kearneysisters.miraheze.org/ as Declined.
NOTE: This is a mass message and not specific to any particular task.
Jan 9 2024, 08:22 · MediaWiki (SRE), DataDump

Jan 4 2024

Reception123 added a comment to T11579: XML Data Dump Fails.
Call to undefined method HistoryBlobStub::getItem()
from /srv/mediawiki/w/includes/historyblob/HistoryBlobStub.php(141)
#0 /srv/mediawiki/w/includes/Storage/SqlBlobStore.php(631): HistoryBlobStub->getText()
#1 /srv/mediawiki/w/includes/Storage/SqlBlobStore.php(546): MediaWiki\Storage\SqlBlobStore->decompressData(string, array)
#2 /srv/mediawiki/w/includes/Storage/SqlBlobStore.php(432): MediaWiki\Storage\SqlBlobStore->expandBlob(string, array, string)
#3 /srv/mediawiki/w/includes/Storage/SqlBlobStore.php(266): MediaWiki\Storage\SqlBlobStore->fetchBlobs(array, integer)
#4 /srv/mediawiki/w/includes/libs/objectcache/wancache/WANObjectCache.php(1758): MediaWiki\Storage\SqlBlobStore->MediaWiki\Storage\{closure}(boolean, integer, array, NULL, array)
#5 /srv/mediawiki/w/includes/libs/objectcache/wancache/WANObjectCache.php(1589): WANObjectCache->fetchOrRegenerate(string, integer, Closure, array, array)
#6 /srv/mediawiki/w/includes/Storage/SqlBlobStore.php(261): WANObjectCache->getWithSetCallback(string, integer, Closure, array)
#7 /srv/mediawiki/w/includes/Revision/RevisionStore.php(1189): MediaWiki\Storage\SqlBlobStore->getBlob(string, integer)
#8 /srv/mediawiki/w/includes/Revision/RevisionStore.php(1507): MediaWiki\Revision\RevisionStore->loadSlotContent(MediaWiki\Revision\SlotRecord, NULL, NULL, NULL, integer)
#9 [internal function]: MediaWiki\Revision\RevisionStore->MediaWiki\Revision\{closure}(MediaWiki\Revision\SlotRecord)
#10 /srv/mediawiki/w/includes/Revision/SlotRecord.php(324): call_user_func(Closure, MediaWiki\Revision\SlotRecord)
#11 /srv/mediawiki/w/includes/export/XmlDumpWriter.php(505): MediaWiki\Revision\SlotRecord->getContent()
#12 /srv/mediawiki/w/includes/export/XmlDumpWriter.php(329): XmlDumpWriter::{closure}()
#13 /srv/mediawiki/w/includes/export/XmlDumpWriter.php(503): XmlDumpWriter->invokeLenient(Closure, string)
#14 /srv/mediawiki/w/includes/export/XmlDumpWriter.php(402): XmlDumpWriter->writeSlot(MediaWiki\Revision\SlotRecord, integer)
#15 /srv/mediawiki/w/includes/export/WikiExporter.php(563): XmlDumpWriter->writeRevision(stdClass, array)
#16 /srv/mediawiki/w/includes/export/WikiExporter.php(501): WikiExporter->outputPageStreamBatch(Wikimedia\Rdbms\MysqliResultWrapper, stdClass)
#17 /srv/mediawiki/w/includes/export/WikiExporter.php(325): WikiExporter->dumpPages(string, boolean)
#18 /srv/mediawiki/w/includes/export/WikiExporter.php(185): WikiExporter->dumpFrom(string)
#19 /srv/mediawiki/w/maintenance/includes/BackupDumper.php(364): WikiExporter->allPages()
#20 /srv/mediawiki/w/maintenance/dumpBackup.php(82): BackupDumper->dump(integer, integer)
#21 /srv/mediawiki/w/maintenance/includes/MaintenanceRunner.php(681): DumpBackup->execute()
#22 /srv/mediawiki/w/maintenance/run.php(51): MediaWiki\Maintenance\MaintenanceRunner->run()
#23 {main}
Jan 4 2024, 20:36 · MediaWiki (SRE), DataDump
Reception123 closed T11587: Completing the transfer of Risk Universalis Wiki (Templates and Media Files (Images)) as Invalid.

@LegitSi 2MB is definitely not too large for Special:RequestImportDump. For images, you will need to find a way to export the actual images as XML files don't actually contain images. Please reopen this task if you have the images. For the XML, doing it here or with RequestImportDump is exactly the same thing in terms of overriding.

Jan 4 2024, 18:19 · MediaWiki (SRE), Configuration, DataDump, ImportDump
Reception123 updated subscribers of T11579: XML Data Dump Fails.

@Paladox any idea why this would fail?

Jan 4 2024, 18:17 · MediaWiki (SRE), DataDump

Jan 2 2024

Reception123 closed T11560: Requesting Image Backup for The Tanzanite Codex as Resolved.

Generation in progress.

Jan 2 2024, 18:46 · MediaWiki (SRE), DataDump
Reception123 triaged T11579: XML Data Dump Fails as Normal priority.
Jan 2 2024, 14:30 · MediaWiki (SRE), DataDump
Reception123 triaged T11587: Completing the transfer of Risk Universalis Wiki (Templates and Media Files (Images)) as Normal priority.
Jan 2 2024, 14:30 · MediaWiki (SRE), Configuration, DataDump, ImportDump
Reception123 added a comment to T11461: Image Dump Request for https://kearneysisters.miraheze.org/.

I would like to start by apologizing on the project's behalf that your task was not resolved within a reasonable time. The community has now decided via RfC to merge with WikiTide and former volunteers will be returning and new ones will likely join. A wait such as this one is unlikely to occur again.

Jan 2 2024, 14:29 · MediaWiki (SRE), DataDump

Dec 31 2023

Original_Authority added a comment to T11579: XML Data Dump Fails.

If there was an exception ID, it would be in a red box, sort of like a warning; this is probably something failing silently. A member of SRE will need to debug this.

Dec 31 2023, 16:26 · MediaWiki (SRE), DataDump

Dec 29 2023

LegitSi updated the task description for T11587: Completing the transfer of Risk Universalis Wiki (Templates and Media Files (Images)).
Dec 29 2023, 20:45 · MediaWiki (SRE), Configuration, DataDump, ImportDump
LegitSi created T11587: Completing the transfer of Risk Universalis Wiki (Templates and Media Files (Images)).
Dec 29 2023, 20:44 · MediaWiki (SRE), Configuration, DataDump, ImportDump
Chuck.Beckett added a comment to T11579: XML Data Dump Fails.

No exception ID. Not sure where I would see that; can you elaborate? I just used the data dump screen. Screen output looked like this:

Dec 29 2023, 15:21 · MediaWiki (SRE), DataDump
Original_Authority added projects to T11579: XML Data Dump Fails: DataDump, MediaWiki (SRE).
Dec 29 2023, 01:08 · MediaWiki (SRE), DataDump

Dec 26 2023

Agent_Isai triaged T11560: Requesting Image Backup for The Tanzanite Codex as Normal priority.
Dec 26 2023, 19:11 · MediaWiki (SRE), DataDump

Dec 22 2023

JuleKing2921 created T11561: Requesting Image Backup for U1GA Encyclopedia.
Dec 22 2023, 14:43 · MediaWiki, MediaWiki (SRE)
JuleKing2921 created T11560: Requesting Image Backup for The Tanzanite Codex.
Dec 22 2023, 14:41 · MediaWiki (SRE), DataDump

Dec 1 2023

Original_Authority added projects to T11461: Image Dump Request for https://kearneysisters.miraheze.org/: DataDump, MediaWiki (SRE).
Dec 1 2023, 09:43 · MediaWiki (SRE), DataDump

Oct 21 2023

MacFan4000 closed T11307: "You are only allowed to generate 1 dump(s)." as Invalid.

The message is pretty clear about what the issue is. If a dump of the selected type exists, then you must delete it first.

Oct 21 2023, 19:49 · MediaWiki (SRE), Production Error, DataDump, MediaWiki
Routhwick created T11307: "You are only allowed to generate 1 dump(s).".
Oct 21 2023, 18:58 · MediaWiki (SRE), Production Error, DataDump, MediaWiki
Agent_Isai closed T11304: Image dump request as Resolved.
Oct 21 2023, 04:54 · DataDump, MediaWiki (SRE), MediaWiki
Routhwick created T11304: Image dump request.
Oct 21 2023, 04:33 · DataDump, MediaWiki (SRE), MediaWiki

Sep 26 2023

Sweetzer added a comment to T11232: Wiki Backup dump fails repeatedly.

Thank you!

Sep 26 2023, 16:42 · DataDump, MediaWiki (SRE)
Paladox added a comment to T11232: Wiki Backup dump fails repeatedly.

https://github.com/miraheze/DataDump/commit/6534dc46b85fbdba9a4b35e859b35b627067feaf

Sep 26 2023, 13:54 · DataDump, MediaWiki (SRE)
Sweetzer closed T11232: Wiki Backup dump fails repeatedly as Resolved.
Sep 26 2023, 00:08 · DataDump, MediaWiki (SRE)
Sweetzer added a comment to T11232: Wiki Backup dump fails repeatedly.

Not sure what changed, but it worked as of today. Thank you!

Sep 26 2023, 00:08 · DataDump, MediaWiki (SRE)

Sep 20 2023

Redmin edited projects for T11232: Wiki Backup dump fails repeatedly, added: DataDump; removed MediaWiki.
Sep 20 2023, 10:28 · DataDump, MediaWiki (SRE)

Sep 15 2023

Paladox closed T11223: Unable to download Wiki dump as Resolved.

Fixed.

Sep 15 2023, 00:02 · DataDump, MediaWiki (SRE)

Sep 14 2023

Redmin triaged T11223: Unable to download Wiki dump as Normal priority.
Sep 14 2023, 19:55 · DataDump, MediaWiki (SRE)

Aug 27 2023

MacFan4000 closed T10982: Requesting image backup for the Ranchstory Wiki as Resolved.

I can’t provide anything other than what we already have provided via DaraDump.

Aug 27 2023, 13:34 · DataDump, MediaWiki (SRE)

Aug 26 2023

Runetree reopened T10982: Requesting image backup for the Ranchstory Wiki as "Open".

A host attempted to migrate our wiki but found the files provided were insufficient for migration. Could we request all the data from our wiki at https://ranchstory.miraheze.org/wiki/Main_Page be pulled so we can complete our migration?

Aug 26 2023, 21:32 · DataDump, MediaWiki (SRE)

Aug 25 2023

Jeb_CC added a comment to T11166: Image Dump of LGBTQIA Wiki.

Thank you so much!

Aug 25 2023, 22:29 · DataDump, MediaWiki (SRE)
MacFan4000 removed a watcher for DataDump: Rob_Kam.
Aug 25 2023, 19:57
MacFan4000 closed T11166: Image Dump of LGBTQIA Wiki as Resolved.

Available at https://www.lgbtqia.wiki/wiki/Special:DataDump.

Aug 25 2023, 17:49 · DataDump, MediaWiki (SRE)
Void triaged T11166: Image Dump of LGBTQIA Wiki as Normal priority.
Aug 25 2023, 06:55 · DataDump, MediaWiki (SRE)

Aug 24 2023

Jeb_CC created T11166: Image Dump of LGBTQIA Wiki.
Aug 24 2023, 07:56 · DataDump, MediaWiki (SRE)

Aug 9 2023

PlanToSaveNoWork added a comment to T11133: [trash].

**This is the truth Miraheze is burning like a house and the suppoesed firefighters are sitting relaxing having a coffee instead of helping

Aug 9 2023, 17:52 · Trash
PlanToSaveNoWork triaged T11133: [trash] as Unbreak Now! priority.
Aug 9 2023, 17:51 · Trash

Aug 7 2023

MacFan4000 closed T11093: Request to get the DataDump file of 政治罗盘球wiki as Resolved.

Dump started at https://zhpolcompball.miraheze.org/wiki/Special:DataDump.

Aug 7 2023, 16:41 · MediaWiki (SRE), DataDump

Aug 3 2023

LeagueOfNationsBall updated the task description for T11093: Request to get the DataDump file of 政治罗盘球wiki.
Aug 3 2023, 09:58 · MediaWiki (SRE), DataDump
LeagueOfNationsBall added a comment to T11093: Request to get the DataDump file of 政治罗盘球wiki.

Wikidumps that regularly obtain images need to be generated by Miraheze staff.

Aug 3 2023, 09:57 · MediaWiki (SRE), DataDump

Aug 2 2023

Honglan233 added a comment to T11093: Request to get the DataDump file of 政治罗盘球wiki.

Please specify the problem you are experiencing.

Aug 2 2023, 08:28 · MediaWiki (SRE), DataDump
Honglan233 added a project to T11093: Request to get the DataDump file of 政治罗盘球wiki: DataDump.
Aug 2 2023, 08:27 · MediaWiki (SRE), DataDump