Page MenuHomePhabricator

Feb 25 2019

Leucosticte created T13: Find a way to add the SHA-1 text content hash in base-36 in python, so we can fill in rev_sha1.
Feb 25 2019, 8:54 PM
Leucosticte added a project to T11: Figure out what our minimum viable product hardware setup will look like: Inclupedia-equipment.
Feb 25 2019, 7:23 PM · Inclupedia-equipment, Inclupedia

Feb 23 2019

Leucosticte added a member for Inclupedia-XML-reader: Leucosticte.
Feb 23 2019, 7:22 PM
Leucosticte added a member for Inclupedia-equipment: Leucosticte.
Feb 23 2019, 7:21 PM
Leucosticte renamed Inclupedia-equipment from Inclupedia-hardware to Inclupedia-equipment.
Feb 23 2019, 7:21 PM
Leucosticte changed the visibility for Inclupedia-equipment.
Feb 23 2019, 7:21 PM
Leucosticte changed the visibility for Inclupedia-XML-reader.
Feb 23 2019, 7:19 PM
Leucosticte added a comment to T2: Document whether/how all of the indexes in page, redirect, revision, and text are needed.

Invalid now that we're no longer using Revisionpedia.

Feb 23 2019, 7:18 PM · Inclupedia
Leucosticte closed T2: Document whether/how all of the indexes in page, redirect, revision, and text are needed as Invalid.
Feb 23 2019, 7:17 PM · Inclupedia
Leucosticte closed T5: Revise pullAndPushBot.py so that it (1) fills in primary key fields manually, (2) keeps track of which rev_id we're on and stores that in a cursor file, and (3) keeps track of which file it's on and moves on to the next file when it's done as Resolved.
Feb 23 2019, 7:16 PM · Inclupedia

Feb 12 2019

Leucosticte triaged T12: Create a hardware wishlist for MareLover as Normal priority.
Feb 12 2019, 6:02 PM
Leucosticte triaged T11: Figure out what our minimum viable product hardware setup will look like as Normal priority.
Feb 12 2019, 5:57 PM · Inclupedia-equipment, Inclupedia

Feb 11 2019

Leucosticte added a comment to T10: Resolve title collisions arising from page deletions and re-creations on Wikipedia.

Maybe we're just not going to worry about Wikipedia's page_ids, aside from having a rev_remote_page field that we update if needed whenever we do imports of XML dumps.

Feb 11 2019, 10:02 PM
Leucosticte triaged T10: Resolve title collisions arising from page deletions and re-creations on Wikipedia as Normal priority.
Feb 11 2019, 9:25 PM
Leucosticte triaged T9: Come up with a list of edge cases as Normal priority.
Feb 11 2019, 9:18 PM
Leucosticte triaged T8: Figure out what hardware we're going to use for the server(s) as Normal priority.
Feb 11 2019, 6:03 PM · Inclupedia
Leucosticte added a member for Forums: Leucosticte.
Feb 11 2019, 4:49 PM
Leucosticte renamed Inclupedia from Revisionpedia to Inclupedia.
Feb 11 2019, 4:49 PM
Leucosticte added projects to T6: Figure out what our plan is for email: Forums, Inclupedia.
Feb 11 2019, 4:48 PM · Inclupedia, Forums
Leucosticte changed the visibility for Forums.
Feb 11 2019, 4:47 PM
Leucosticte changed the visibility for Inclupedia.
Feb 11 2019, 4:46 PM

Feb 10 2019

Leucosticte committed R1:690799fcea87: Attempt to implement prepared statements; right now it's not working too well (authored by Leucosticte).
Attempt to implement prepared statements; right now it's not working too well
Feb 10 2019, 4:40 PM

Feb 9 2019

Leucosticte committed R1:898efb0b156c: Change to work without indexes (authored by Leucosticte).
Change to work without indexes
Feb 9 2019, 9:05 PM
Leucosticte updated the task description for T7: Find ways to tune MariaDB performance.
Feb 9 2019, 7:15 PM · Inclupedia
Leucosticte added a comment to T5: Revise pullAndPushBot.py so that it (1) fills in primary key fields manually, (2) keeps track of which rev_id we're on and stores that in a cursor file, and (3) keeps track of which file it's on and moves on to the next file when it's done.

So, preliminarily, what one needs to do is, in accordance with https://www.mediawiki.org/wiki/Manual:MWDumper#Performance_Tips

Feb 9 2019, 4:47 PM · Inclupedia
Leucosticte updated the task description for T7: Find ways to tune MariaDB performance.
Feb 9 2019, 4:41 PM · Inclupedia
Leucosticte triaged T7: Find ways to tune MariaDB performance as Unbreak Now! priority.
Feb 9 2019, 4:41 PM · Inclupedia
Leucosticte changed the visibility for T6: Figure out what our plan is for email.
Feb 9 2019, 4:28 PM · Inclupedia, Forums
Leucosticte added a comment to T3: Investigate, is MongoDB or something like that an option that would be better than adding more columns to the revision table?.

So I'm wondering, when/where/why would one use NoSQL? Is this for situations where there's a table that only has two columns?

Feb 9 2019, 4:02 PM · Inclupedia
Leucosticte added a parent task for T4: Add a rev_push_user field noting who the importing user is (or use MongoDB or something): T3: Investigate, is MongoDB or something like that an option that would be better than adding more columns to the revision table?.
Feb 9 2019, 3:56 PM
Leucosticte added a subtask for T3: Investigate, is MongoDB or something like that an option that would be better than adding more columns to the revision table?: T4: Add a rev_push_user field noting who the importing user is (or use MongoDB or something).
Feb 9 2019, 3:56 PM · Inclupedia
Leucosticte renamed T4: Add a rev_push_user field noting who the importing user is (or use MongoDB or something) from Add a field to rev_importer field noting who the importing user is (or use MongoDB or something) to Add a rev_push_user field noting who the importing user is (or use MongoDB or something).
Feb 9 2019, 3:55 PM
Leucosticte added a comment to T4: Add a rev_push_user field noting who the importing user is (or use MongoDB or something).

So I guess this is going to be an integer, although it could also be as I set it up before:

Feb 9 2019, 3:54 PM
Leucosticte added a comment to T2: Document whether/how all of the indexes in page, redirect, revision, and text are needed.

From https://github.com/Inclumedia/revisionpedia/blob/master/mediawiki-1.31.1/maintenance/tables.sql

Feb 9 2019, 3:02 PM · Inclupedia
Leucosticte changed the visibility for T1: Add a GPL license for Revisionbot.
Feb 9 2019, 2:53 PM
Leucosticte changed the visibility for T2: Document whether/how all of the indexes in page, redirect, revision, and text are needed.
Feb 9 2019, 2:50 PM · Inclupedia
Leucosticte added a comment to T3: Investigate, is MongoDB or something like that an option that would be better than adding more columns to the revision table?.

So what do you know about MongoDB/NoSQL, @MareLover ?

Feb 9 2019, 2:50 PM · Inclupedia
Leucosticte updated subscribers of T3: Investigate, is MongoDB or something like that an option that would be better than adding more columns to the revision table?.
Feb 9 2019, 2:49 PM · Inclupedia
Leucosticte changed the visibility for T3: Investigate, is MongoDB or something like that an option that would be better than adding more columns to the revision table?.
Feb 9 2019, 2:49 PM · Inclupedia
Leucosticte changed the visibility for T4: Add a rev_push_user field noting who the importing user is (or use MongoDB or something).
Feb 9 2019, 2:49 PM