[00:29:02] 10DBA, 10foundation.wikimedia.org: Drop the petition_data table from production - https://phabricator.wikimedia.org/T208979 (10Jdforrester-WMF) 05stalled>03Open Extension is now totally removed from prod. Delete away. [09:03:11] 10DBA, 10MediaWiki-General-or-Unknown, 10Readers-Web-Backlog (Readers-Web-Kanbanana-Board-2018-19-Q2): [Bug] Update old nonuniformly distributed page_random values - https://phabricator.wikimedia.org/T208909 (10Tbayer) [10:23:18] 10DBA: Missing row in enwiki.archive on sanitarium - https://phabricator.wikimedia.org/T208954 (10jcrespo) @anomie I do strongly believe that mediawiki has recently gone unsafe (regression) in the latest releases- this is one of the many replication issues we had recently- we should search recent commits for uns... [12:01:27] 10DBA: Checking archive tables across the databases - https://phabricator.wikimedia.org/T209048 (10Banyek) [13:59:40] 10DBA: Checking archive tables across the databases - https://phabricator.wikimedia.org/T209048 (10Banyek) The hard part is that on sanitarium we have filters on archive tables, so compare.py will return error [14:34:02] 10DBA, 10Patch-For-Review: Missing row in enwiki.archive on sanitarium - https://phabricator.wikimedia.org/T208954 (10Anomie) >>! In T208954#4731251, @jcrespo wrote: > @anomie I do strongly believe that mediawiki has recently gone unsafe (regression) in the latest releases- this is one of the many replication... [14:40:06] 10DBA, 10Patch-For-Review, 10User-Banyek, 10Wikimedia-Incident: Compare a few tables per section between hosts and DC - https://phabricator.wikimedia.org/T207253 (10Anomie) > The idea is to check some important (but not to big tables) that are likely to have many changes during the day, so we can detect di... [14:53:44] 10DBA, 10User-Banyek: Checking archive tables across the databases - https://phabricator.wikimedia.org/T209048 (10Banyek) [14:56:56] o/ jynus_ banyek, sorry to both you both. We just unearthed a 14 year old bug with Tim Starling's help. The bug caused poorly distributed page_random values to be saved in the database for about 10 months and we need help in updating these fields. Tim Starling thought the change would be "pretty easy" to make but it's not our area of expertise. Can you help us? The ticket is [14:56:56] https://phabricator.wikimedia.org/T208909 [14:57:17] 14 years :D [14:57:35] I have to leave soon, but I'll take a look [14:57:44] jynus_ banyek HaeB has even drafted a proposal query in the mentioned ticket but it needs some validation by DBA experts [14:57:57] thank you banyek ! [14:58:14] next week we'll be in better shape as all the three of us will be here [14:59:21] banyek: do you know how long a query like this would take to run and complete on the database and replicas? We'd like to understand the timeline because we have crucial work that depends on this change (hence all the rush around it). [15:01:15] banyek: according to Tim Starling, this change shouldn't even require an update to MysqlUpdater.php. It's a database query only fix. [15:01:21] I have to leave in 10 - kindergarten stuff - so I can't look into this now, but I read around, and we can sync tomorrow, is that good? [15:03:32] banyek: that would be good. We're just trying to understand what the timelines for a change like this would be given how high priority it is. Thank you for checking it out! What timezone are you in? [15:05:05] banyek: I'll verify you're on the thread of discussion for additional background. The thread is titled "page_random investigation and next steps". [15:08:32] My timezone is CET [15:08:36] UTC+1 [15:10:12] banyek: i'm in utc and working with niedzielski and HaeB on this change. i can be around in the morning whenever you're ready [15:10:55] 👍 perfect [15:11:17] thanks banyek !! please let phuedx / HaeB / myself know if we can provide any additional detail! [15:11:42] thank banyek ! (i'm Tbayer on Phab btw) [15:12:10] ok, I'll read around if I can do anything [15:12:13] now I have too leave [15:12:16] see you tomorrow [15:14:56] thank banyek !!! [15:51:42] 10DBA, 10Analytics, 10Data-Services: Add index to `comment_id` field in `comment` table (all wikis) - https://phabricator.wikimedia.org/T209031 (10Nuria) [16:03:07] 10DBA, 10Analytics, 10Data-Services: Add index to `comment_id` field in `comment` table (all wikis) - https://phabricator.wikimedia.org/T209031 (10Krenair) >>! In T209031#4732318, @Nuria wrote: > @Krenair: we are looking how to best import the public dataset from labs, we have already looked into scooping da... [16:38:46] 10DBA, 10Operations, 10Patch-For-Review, 10User-Banyek: Implement parsercache service on pc[12]0(07|08|09|10) and replace leased pc[12]00[456] - https://phabricator.wikimedia.org/T208383 (10jcrespo) While it looks good, please wait to have at least one positive review unless there is an emergency- as all t... [16:47:58] 10DBA, 10Operations, 10Patch-For-Review, 10User-Banyek: Implement parsercache service on pc[12]0(07|08|09|10) and replace leased pc[12]00[456] - https://phabricator.wikimedia.org/T208383 (10jcrespo) I voted +1 but check if you can fix some minor style things I suggest so all mariadb roles look similar. Oth... [17:21:27] 10DBA, 10MediaWiki-General-or-Unknown, 10Readers-Web-Backlog (Readers-Web-Kanbanana-Board-2018-19-Q2): [Bug] Update old nonuniformly distributed page_random values - https://phabricator.wikimedia.org/T208909 (10jcrespo) I was asked to participate on this task explicitly: I have no idea what this task is abo... [17:28:56] !log depooling labsdb1009 (T189158) [17:28:57] banyek: Not expecting to hear !log here [17:28:57] T189158: Change `image` view to properly expose the new `img_description_id` field - https://phabricator.wikimedia.org/T189158 [17:41:27] 10DBA, 10MediaWiki-General-or-Unknown, 10Readers-Web-Backlog (Readers-Web-Kanbanana-Board-2018-19-Q2): [Bug] Update old nonuniformly distributed page_random values - https://phabricator.wikimedia.org/T208909 (10jcrespo) //Update from the airport// for the practical bits- send a patch with a foreachwiki php s... [20:24:36] 10DBA, 10Data-Services, 10Datasets-General-or-Unknown: Archive and drop education program (ep_*) tables on all wikis - https://phabricator.wikimedia.org/T174802 (10greg) >>! In T174802#4627359, @Urbanecm wrote: > I think we should wait for some time before dropping the data. I exported the data from EP to wi... [20:27:30] 10DBA, 10Data-Services, 10Datasets-General-or-Unknown: Archive and drop education program (ep_*) tables on all wikis - https://phabricator.wikimedia.org/T174802 (10Urbanecm) Personally, I have no problem with dropping the data - I have transfered the data for cs.wiki and I don't care much about other wikis.... [20:31:49] 10DBA, 10MediaWiki-General-or-Unknown, 10Readers-Web-Backlog (Readers-Web-Kanbanana-Board-2018-19-Q2): [Bug] Update old nonuniformly distributed page_random values - https://phabricator.wikimedia.org/T208909 (10Niedzielski) Thanks for the feedback, @jcrespo. @pmiazga and @phuedx are working on a new PHP MySQ... [21:22:46] 10DBA, 10Cloud-Services, 10Patch-For-Review: Make watchlist table available as curated foo_p.watchlist_count on labsdb - https://phabricator.wikimedia.org/T59617 (10Framawiki) Ouch, just found that [[ https://fr.wikipedia.org/w/index.php?title=Wikip%C3%A9dia:Rapports/Pages_les_plus_suivies&action=history | m... [22:20:50] 10DBA, 10MediaWiki-General-or-Unknown, 10Readers-Web-Backlog (Readers-Web-Kanbanana-Board-2018-19-Q2): [Bug] Update old nonuniformly distributed page_random values - https://phabricator.wikimedia.org/T208909 (10Jdlrobson) Team has async estimated this as a super risky 13. https://wikimedia.slack.com/archives...