[01:43:56] 10Project-Admins: Rename Wikimedia project tags in Phab (#Wikisource; #Wiktionary) to clarify that they are not about language specific instances? - https://phabricator.wikimedia.org/T196740 (10Aklapper) Some recent examples for people adding the #Wikisource or #Wiktionary tag to tasks, though the task was about... [01:44:18] 10Project-Admins: There should be wikibooks, wikiquote and wikivoyage community projects - https://phabricator.wikimedia.org/T93486 (10Aklapper) [01:44:21] 10Project-Admins: Rename Wikimedia project tags in Phab (#Wikisource; #Wiktionary) to clarify that they are not about language specific instances? - https://phabricator.wikimedia.org/T196740 (10Aklapper) [02:20:02] 10Gerrit, 10Phabricator, 10Developer-Advocacy: Decrease issues created many years ago with no recent activity (aka stale tickets) - https://phabricator.wikimedia.org/T248034 (10Aklapper) > Define what a stale patchset/phab ticket is "e.g. has seen no activity in 2 years" Should probably reopen T113706 (I d... [02:22:29] 10Gerrit, 10Phabricator, 10Developer-Advocacy: Decrease issues created many years ago with no recent activity (aka stale tickets) - https://phabricator.wikimedia.org/T248034 (10Aklapper) > Recently patches were raised on 5 year+ old tickets in one of my repos where patches were not welcomed wasting voluntee... [09:11:51] 10Project-Admins, 10User-Majavah: Create project Tool-MajavahBot - https://phabricator.wikimedia.org/T248829 (10Majavah) [09:25:31] 10Project-Admins, 10User-Majavah: Create project Tool-MajavahBot - https://phabricator.wikimedia.org/T248829 (10Peachey88) 05Open→03Resolved a:03Peachey88 Created #Tool-MajavahBot, Please enjoy your new project. [09:27:22] 10Project-Admins, 10User-Majavah: Create project Tool-MajavahBot - https://phabricator.wikimedia.org/T248829 (10Peachey88) Please remember to [[ https://phabricator.wikimedia.org/project/edit/4678/ | update the description of your project ]] to add further details about your bot please. [09:40:23] (03PS1) 10Giuseppe Lavagetto: Switch operations-puppet to buster [integration/config] - 10https://gerrit.wikimedia.org/r/584556 [09:52:56] 10Gerrit, 10Quality-and-Test-Engineering-Team (QTE), 10User-zeljkofilipin: Cannot push to gerrit - https://phabricator.wikimedia.org/T248710 (10zeljkofilipin) 05Invalid→03Open @Aklapper I don't think this is resolved yet. @Gbahdeyboh still did not push a commit to mediawiki/core master branch. https://g... [11:04:36] 10Gerrit, 10Wikimedia-GitHub: Last MW Core Security Release tags haven't pushed through to github - https://phabricator.wikimedia.org/T248842 (10Reedy) [11:05:26] 10Gerrit, 10Release-Engineering-Team, 10Wikimedia-GitHub: Last MW Core Security Release tags haven't pushed through to github - https://phabricator.wikimedia.org/T248842 (10Reedy) [11:36:52] 10Gerrit, 10Release-Engineering-Team, 10Wikimedia-GitHub: Last MW Core Security Release tags haven't pushed through to github - https://phabricator.wikimedia.org/T248842 (10Aklapper) I would have expected this to be listed on https://www.mediawiki.org/wiki/Release_checklist however that page now says it is o... [11:37:09] 10Project-Admins: Rename Wikimedia project tags in Phab (#Wikisource; #Wiktionary) to clarify that they are not about language specific instances? - https://phabricator.wikimedia.org/T196740 (10Billinghurst) Having the plural itself would be an advantage, and maybe sufficient to change the thinking. Having the... [11:45:36] 10Gerrit, 10Release-Engineering-Team, 10Wikimedia-GitHub: Last MW Core Security Release tags haven't pushed through to github - https://phabricator.wikimedia.org/T248842 (10Reedy) They exist on gerrit, as per {T240398}... But something seemingly wrong with the replication through to github [11:53:38] 10Gerrit, 10Release-Engineering-Team, 10Wikimedia-GitHub: Last MW Core Security Release tags haven't pushed through to github - https://phabricator.wikimedia.org/T248842 (10Reedy) ` $ ssh -p 29418 gerrit.wikimedia.org replication start --wait mediawiki/core Replicate mediawiki/core ref ..all.. to gerrit2001.... [12:59:24] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Scap, 10Patch-For-Review: Scap fails if --canary-wait-time isn't used - https://phabricator.wikimedia.org/T248467 (10LarsWirzenius) 05Open→03Resolved The fix has been merged. [12:59:27] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Scap: Make scap release with --canary-wait-time and integration test changes - https://phabricator.wikimedia.org/T246455 (10LarsWirzenius) [14:03:20] 10Gerrit, 10Operations, 10Traffic, 10HTTPS, 10Security: Harden apache SSL/TLS settings for gerrit.wikimedia.org - https://phabricator.wikimedia.org/T221499 (10Reedy) [14:04:00] 10Gerrit, 10Operations, 10Traffic, 10HTTPS, 10Security: Harden apache SSL/TLS settings for gerrit.wikimedia.org - https://phabricator.wikimedia.org/T221499 (10Reedy) 05Open→03Resolved a:03Krenair [14:07:51] PROBLEM - Work requests waiting in Zuul Gearman server on contint1001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [150.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [14:10:39] RECOVERY - Work requests waiting in Zuul Gearman server on contint1001 is OK: OK: Less than 100.00% above the threshold [90.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [14:13:52] 10Gerrit, 10Quality-and-Test-Engineering-Team (QTE), 10User-zeljkofilipin: Cannot push to gerrit - https://phabricator.wikimedia.org/T248710 (10zeljkofilipin) a:03Gbahdeyboh [14:19:30] 10Gerrit, 10Phabricator, 10Developer-Advocacy: Decrease issues created many years ago with no recent activity (aka stale tickets) - https://phabricator.wikimedia.org/T248034 (10Jdlrobson) >>! In T248034#6009026, @Aklapper wrote: >> Recently patches were raised on 5 year+ old tickets in one of my repos where... [14:50:21] 10Continuous-Integration-Config, 10MediaWiki-Configuration, 10Wikimedia-Incident: Consider having a linter that could catch config file entries that set unused variables - https://phabricator.wikimedia.org/T248866 (10mmodell) [14:59:25] hello. I wanted to follow up on https://phabricator.wikimedia.org/T248002. I am also happy to submit a patch so if there is any manual I should be reading, please let me know. thanks! [15:03:58] sukhe: I suspect there's no manual [15:07:06] Reedy: or other similar configurations, which I couldn't find :P [15:10:20] 10Phabricator, 10Developer-Advocacy: Decrease issues created many years ago with no recent activity (aka stale tickets) - https://phabricator.wikimedia.org/T248034 (10hashar) [15:10:27] (03PS6) 10Krinkle: Add 'assert-no-mediawiki-errors' back to mediawiki quibble jobs [integration/config] - 10https://gerrit.wikimedia.org/r/575311 (https://phabricator.wikimedia.org/T246358) [15:11:00] (03PS7) 10Krinkle: jjb: Add 'assert-no-mediawiki-errors' to mediawiki quibble jobs [integration/config] - 10https://gerrit.wikimedia.org/r/575311 (https://phabricator.wikimedia.org/T246358) [15:12:41] sukhe: I suspect, the answer is creating some docker image that consumes tox-docker and adds your extra stuff [15:14:47] Reedy: yeah, makes sense. I did have a look at existing configurations but got lost. I guess I should try again [15:14:55] heh [15:15:05] We do similar stuff for PHP jobs, where we add building blocks [15:16:49] thanks, will start there [15:17:46] unless it gets taken care of by more smarter people here, which would be great! [15:23:57] I was looking if we had any examples of anyone doing it with tox-docker, but I don't see one [15:24:08] 10Gerrit, 10Release-Engineering-Team, 10Wikimedia-GitHub: Last MW Core Security Release tags haven't pushed through to github - https://phabricator.wikimedia.org/T248842 (10hashar) Gerrit replication config for github does mention pushing tags: ` name=replication.config,lang=ini [remote "github"] ... push... [15:25:11] 10Gerrit, 10Release-Engineering-Team, 10Wikimedia-GitHub: Last MW Core Security Release tags haven't pushed through to github - https://phabricator.wikimedia.org/T248842 (10Reedy) >>! In T248842#6010863, @hashar wrote: > Which was an unsigned / unannotated tag. Maybe the replication fails on signed tags? It... [15:26:32] Reedy: I thought it was thanks for looking [15:26:40] er, I thought it just me. thanks for checking [15:30:43] 10Beta-Cluster-Infrastructure, 10MediaWiki-Revision-backend, 10User-DannyS712: BetaCluster: ExternalStoreException - Unable to store text to external storage - https://phabricator.wikimedia.org/T228088 (10daniel) From looking at ExternalStoreAccess::insert(), it seems like this may be caused by the database... [15:45:18] 10Continuous-Integration-Infrastructure (phase-out-jessie), 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)): Replace integration-trigger-01 with running the dummy job on contint1001 agent - https://phabricator.wikimedia.org/T247109 (10hashar) 05R... [15:45:18] 10Continuous-Integration-Infrastructure (phase-out-jessie), 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Cloud-VPS (Debian Jessie Deprecation): "integration" Cloud VPS project jessie deprecation - https://phabricator.wikimedia.org/T236576 (... [15:58:08] 10Project-Admins, 10Parsoid: Merge Parsoid and Parsoid-PHP project - https://phabricator.wikimedia.org/T241377 (10cscott) Merging MediaWiki-Parser and Parsoid can/should be a separate task. Won't happen at the same time as this task. [16:04:39] (03PS4) 10Jforrester: layout: [labs/tools/qrcode-generator] Setup gate-and-submit-l10n [integration/config] - 10https://gerrit.wikimedia.org/r/584214 (https://phabricator.wikimedia.org/T242191) (owner: 10Jayprakash12345) [16:05:01] (03CR) 10Jforrester: [C: 03+2] layout: [labs/tools/qrcode-generator] Setup gate-and-submit-l10n [integration/config] - 10https://gerrit.wikimedia.org/r/584214 (https://phabricator.wikimedia.org/T242191) (owner: 10Jayprakash12345) [16:05:59] (03Merged) 10jenkins-bot: layout: [labs/tools/qrcode-generator] Setup gate-and-submit-l10n [integration/config] - 10https://gerrit.wikimedia.org/r/584214 (https://phabricator.wikimedia.org/T242191) (owner: 10Jayprakash12345) [16:06:42] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Patch-For-Review, 10Puppet, 10User-brennen: logspam-watch: fatal.log no longer exists - https://phabricator.wikimedia.org/T248337 (10brennen) 05Open→03Resolved [16:07:21] !log T242191 layout: [labs/tools/qrcode-generator] Setup gate-and-submit-l10n [16:07:23] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:07:23] T242191: QRCode-Generator: Add internationalization - https://phabricator.wikimedia.org/T242191 [16:12:32] (03CR) 10Jforrester: [C: 03+2] Switch operations-puppet to buster [integration/config] - 10https://gerrit.wikimedia.org/r/584556 (owner: 10Giuseppe Lavagetto) [16:13:22] (03CR) 10Jforrester: [C: 03+2] Archive ExtTab extension [integration/config] - 10https://gerrit.wikimedia.org/r/584167 (https://phabricator.wikimedia.org/T248759) (owner: 10DannyS712) [16:15:15] (03Merged) 10jenkins-bot: Switch operations-puppet to buster [integration/config] - 10https://gerrit.wikimedia.org/r/584556 (owner: 10Giuseppe Lavagetto) [16:15:23] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)): Build a Seakeeper MVP - https://phabricator.wikimedia.org/T248876 (10LarsWirzenius) [16:15:46] (03Merged) 10jenkins-bot: Archive ExtTab extension [integration/config] - 10https://gerrit.wikimedia.org/r/584167 (https://phabricator.wikimedia.org/T248759) (owner: 10DannyS712) [16:16:33] !log T248759 layout: [mediawiki/extensions/ExtTab] Archive [16:16:35] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:16:35] T248759: Archive the ExtTab extension - https://phabricator.wikimedia.org/T248759 [16:17:37] !log Docker: Publish operations-puppet:0.7.0 [16:17:38] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:20:02] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)): Build a Seakeeper MVP - https://phabricator.wikimedia.org/T248876 (10LarsWirzenius) [16:21:35] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Scap: Make scap release with --canary-wait-time and integration test changes - https://phabricator.wikimedia.org/T246455 (10LarsWirzenius) [16:21:53] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Scap, 10Wikimedia-Incident: Make scap skip restarting php-fpm when using --force - https://phabricator.wikimedia.org/T243009 (10LarsWirzenius) [16:22:11] 10Deployments, 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)): Script dropping of old staging branches for train - https://phabricator.wikimedia.org/T247076 (10LarsWirzenius) [16:22:31] 10Deployments, 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)): Write script to apply security patches - https://phabricator.wikimedia.org/T247075 (10LarsWirzenius) [16:22:43] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Scap, 10Python3-Porting: Port scap to Python 3 - https://phabricator.wikimedia.org/T246025 (10LarsWirzenius) [16:22:57] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Release Pipeline: Document pipelinelib - https://phabricator.wikimedia.org/T239423 (10LarsWirzenius) [16:23:15] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)): Draft proposal for re-implementing pipelinelib for non-jenkins - https://phabricator.wikimedia.org/T246665 (10LarsWirzenius) [16:23:37] 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)): Create a threat model for new CI - https://phabricator.wikimedia.org/T240679 (10LarsWirzenius) [16:23:54] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)): Arrange PGP keysigning at All Hands 2020 - https://phabricator.wikimedia.org/T242340 (10LarsWirzenius) [16:24:06] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)): Learn Go - https://phabricator.wikimedia.org/T234543 (10LarsWirzenius) [16:24:08] (03PS1) 10Jforrester: jjb: Switch jobs to operations-puppet:0.7.0 [integration/config] - 10https://gerrit.wikimedia.org/r/584628 [16:24:43] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)): Build a Seakeeper MVP - https://phabricator.wikimedia.org/T248876 (10LarsWirzenius) p:05Triage→03Medium [16:24:56] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)): Draft proposal for re-implementing pipelinelib for non-jenkins - https://phabricator.wikimedia.org/T246665 (10LarsWirzenius) p:05High→03Medium [16:25:21] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Scap, 10Wikimedia-Incident: Make scap skip restarting php-fpm when using --force - https://phabricator.wikimedia.org/T243009 (10LarsWirzenius) p:05High→03Medium [16:25:21] !log jjb: Sweitch operations-puppet-wmf-style-guide over to buster [16:25:22] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:27:44] !log jjb: Created operations-puppet-tests-buster-docker [16:27:45] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:30:41] (03PS2) 10Jforrester: jjb: Switch jobs to operations-puppet:0.7.0 [integration/config] - 10https://gerrit.wikimedia.org/r/584628 [16:30:43] (03PS1) 10Jforrester: zuul: [operations/puppet] Add operations-puppet-tests-buster-docker as experimental [integration/config] - 10https://gerrit.wikimedia.org/r/584630 [16:30:45] (03PS1) 10Jforrester: zuul: [operations/puppet] Use buster instead of stretch image [integration/config] - 10https://gerrit.wikimedia.org/r/584631 [16:30:47] (03PS1) 10Jforrester: jjb: Drop operations-puppet-tests-stretch-docker, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/584632 [16:30:56] (03CR) 10Jforrester: [C: 03+2] jjb: Switch jobs to operations-puppet:0.7.0 [integration/config] - 10https://gerrit.wikimedia.org/r/584628 (owner: 10Jforrester) [16:31:14] (03PS2) 10Jforrester: zuul: [operations/puppet] Add buster as experimental [integration/config] - 10https://gerrit.wikimedia.org/r/584630 [16:32:18] (03Merged) 10jenkins-bot: jjb: Switch jobs to operations-puppet:0.7.0 [integration/config] - 10https://gerrit.wikimedia.org/r/584628 (owner: 10Jforrester) [16:33:15] (03CR) 10jerkins-bot: [V: 04-1] zuul: [operations/puppet] Add buster as experimental [integration/config] - 10https://gerrit.wikimedia.org/r/584630 (owner: 10Jforrester) [16:33:51] 10Project-Admins: Create Project: Section-Name-Diff - https://phabricator.wikimedia.org/T246484 (10MBinder_WMF) Hey, folks. Sorry I'm late to this, for some reason I either wasn't getting or wasn't noticing my notifications on this task. Glad you resolved it! Couple of things: - I'm glad this didn't end up a... [16:35:33] (03CR) 10Jforrester: [C: 03+2] zuul: [operations/puppet] Add buster as experimental [integration/config] - 10https://gerrit.wikimedia.org/r/584630 (owner: 10Jforrester) [16:36:30] (03Merged) 10jenkins-bot: zuul: [operations/puppet] Add buster as experimental [integration/config] - 10https://gerrit.wikimedia.org/r/584630 (owner: 10Jforrester) [16:37:12] !log https://gerrit.wikimedia.org/r/#/c/584628/ [16:37:14] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:37:18] Bah. [16:37:27] !log zuul: [operations/puppet] Add buster as experimental [16:37:28] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:45:07] 10Release-Engineering-Team, 10Projects-Cleanup: Delete gerrit repository wikimedia/security/automated-scanning - https://phabricator.wikimedia.org/T247468 (10hashar) 05Open→03Resolved https://github.com/wikimedia/security-automated-scanning does not exist :) The repository is read-only in Gerrit: https://... [16:47:36] (03PS2) 10Jforrester: zuul: [operations/puppet] Use buster instead of stretch image [integration/config] - 10https://gerrit.wikimedia.org/r/584631 [16:47:38] (03PS2) 10Jforrester: jjb: Drop operations-puppet-tests-stretch-docker, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/584632 [16:47:56] (03CR) 10Jforrester: [C: 03+2] zuul: [operations/puppet] Use buster instead of stretch image [integration/config] - 10https://gerrit.wikimedia.org/r/584631 (owner: 10Jforrester) [16:48:55] (03Merged) 10jenkins-bot: zuul: [operations/puppet] Use buster instead of stretch image [integration/config] - 10https://gerrit.wikimedia.org/r/584631 (owner: 10Jforrester) [16:49:03] !log zuul: [operations/puppet] Use buster instead of stretch job [16:49:04] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:51:36] (03CR) 10Jforrester: "(Keeping for a moment, in case we need to revert.)" [integration/config] - 10https://gerrit.wikimedia.org/r/584632 (owner: 10Jforrester) [16:56:33] (03PS1) 10Thcipriani: deployment-calendar: Add train triage on Wednesday [tools/release] - 10https://gerrit.wikimedia.org/r/584640 [16:59:03] (03PS8) 10Jforrester: jjb: Add 'assert-no-mediawiki-errors' to mediawiki quibble jobs [integration/config] - 10https://gerrit.wikimedia.org/r/575311 (https://phabricator.wikimedia.org/T246358) (owner: 10Krinkle) [17:02:19] (03PS9) 10Jforrester: jjb: Add 'assert-no-mediawiki-errors' to mediawiki quibble jobs [integration/config] - 10https://gerrit.wikimedia.org/r/575311 (https://phabricator.wikimedia.org/T246358) (owner: 10Krinkle) [17:03:20] 10Continuous-Integration-Config, 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Quibble, 10Patch-For-Review, 10Regression: Jenkins no longer fails build if mw-error.log or mw-dberror.log are non-empty - https://phabricator.wikimedia.org/T246358 (10Jdforrester-WMF) [17:04:36] !log jjb: Add 'wikibase-client-docker' to wikibase-*-docker as a test T246358 [17:04:38] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:04:39] T246358: Jenkins no longer fails build if mw-error.log or mw-dberror.log are non-empty - https://phabricator.wikimedia.org/T246358 [17:05:07] sukhe: As James is active atm.. Have you explicitly asked him? :) [17:06:09] Asked me what? [17:06:25] James_F: How to do https://phabricator.wikimedia.org/T248002 [17:06:41] (03CR) 10Lars Wirzenius: "The time slot is a little for Europeans, but Mukunda suggested just now that if the backup conductor is from the US, they could do the tri" [tools/release] - 10https://gerrit.wikimedia.org/r/584640 (owner: 10Thcipriani) [17:06:47] I think, take tox-docker, create something that includes it, and add a few packages just for that repo/testing [17:07:03] Oh! OK, two ways, either change tox-docker itself or add a bespoke new image, yeah. [17:07:30] It comes down to a judgement as to if other things will need that in the future enough to justify bloating the image for all, vs. the added complexity of Yet Another Damn CI Image. ;-) [17:07:30] Adding stuff to tox docker wouldn't be the end of the world... But I dont' know how much "bloat" the packages sukhe wants to add would add [17:07:49] * James_F nods. [17:07:56] PROBLEM - Free space - all mounts on integration-agent-docker-1003 is CRITICAL: (Service Check Timed Out) [17:09:55] Though, I imagine gcc and it's dependancies would add quite a bit :D [17:10:10] Yeah, just a tad. [17:10:24] locally... [17:10:25] After this operation, 146 MB of additional disk space will be used. [17:10:31] For python3-dev libpq-dev gcc [17:10:32] sukhe: I can build you a custom image, no problem. [17:10:38] on a VM that might have some of the stuff, but hasn't most [17:10:43] 33 new packages [17:10:43] 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)): Install additional packages for censorship-monitoring CI environment - https://phabricator.wikimedia.org/T248002 (10Jdforrester-WMF) a:03Jdforrester-WMF [17:12:22] !log jjb: Add 'assert-no-mediawiki-errors' to mediawiki-quibble-api-testing-vendor-*-php72-docker as a test T246358 [17:12:25] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:12:25] T246358: Jenkins no longer fails build if mw-error.log or mw-dberror.log are non-empty - https://phabricator.wikimedia.org/T246358 [17:12:46] RECOVERY - Free space - all mounts on integration-agent-docker-1003 is OK: OK: All targets OK [17:16:12] 10Gerrit, 10Quality-and-Test-Engineering-Team (QTE), 10User-zeljkofilipin: Cannot push to gerrit - https://phabricator.wikimedia.org/T248710 (10Gbahdeyboh) >>! In T248710#6009665, @zeljkofilipin wrote: > @Aklapper I don't think this is resolved yet. @Gbahdeyboh still did not push a commit to mediawiki/core m... [17:17:20] 10Gerrit, 10Quality-and-Test-Engineering-Team (QTE), 10User-zeljkofilipin: Cannot push to gerrit - https://phabricator.wikimedia.org/T248710 (10Gbahdeyboh) Here's the patch https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/584646/ [17:19:48] 10Gerrit, 10Quality-and-Test-Engineering-Team (QTE), 10User-zeljkofilipin: Cannot push to gerrit - https://phabricator.wikimedia.org/T248710 (10Gbahdeyboh) 05Open→03Resolved [17:31:26] !log jjb: Deployed 'assert-no-mediawiki-errors' to all quibble jobs T246358 [17:31:29] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:31:29] T246358: Jenkins no longer fails build if mw-error.log or mw-dberror.log are non-empty - https://phabricator.wikimedia.org/T246358 [17:31:50] (03PS1) 10Jforrester: dockerfiles: Provide tox-censorshipmonitoring [integration/config] - 10https://gerrit.wikimedia.org/r/584656 (https://phabricator.wikimedia.org/T248002) [17:31:53] (03PS1) 10Jforrester: jjb: Provide censorshipmonitoring-tox-docker job [integration/config] - 10https://gerrit.wikimedia.org/r/584657 (https://phabricator.wikimedia.org/T248002) [17:31:55] (03PS1) 10Jforrester: layout: [operations/software/censorship-monitoring] Custom job [integration/config] - 10https://gerrit.wikimedia.org/r/584658 (https://phabricator.wikimedia.org/T248002) [17:32:02] (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/575311 (https://phabricator.wikimedia.org/T246358) (owner: 10Krinkle) [17:32:43] 10Release-Engineering-Team (Code Health), 10Release-Engineering-Team-TODO (201908), 10Graphoid, 10Operations, and 2 others: graphoid: Code stewardship request - https://phabricator.wikimedia.org/T211881 (10kaldari) @Milimetric - If you are working on migrating Graphoid to Node 10, please create a Phabricat... [17:32:46] 10Continuous-Integration-Config, 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Quibble, 10Patch-For-Review, 10Regression: Jenkins no longer fails build if mw-error.log or mw-dberror.log are non-empty - https://phabricator.wikimedia.org/T246358 (10Jdforrester-WMF) [17:33:10] (03Merged) 10jenkins-bot: jjb: Add 'assert-no-mediawiki-errors' to mediawiki quibble jobs [integration/config] - 10https://gerrit.wikimedia.org/r/575311 (https://phabricator.wikimedia.org/T246358) (owner: 10Krinkle) [17:38:35] (03CR) 10Jforrester: [C: 03+2] dockerfiles: Provide tox-censorshipmonitoring [integration/config] - 10https://gerrit.wikimedia.org/r/584656 (https://phabricator.wikimedia.org/T248002) (owner: 10Jforrester) [17:39:22] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Patch-For-Review: Install additional packages for censorship-monitoring CI environment - https://phabricator.wikimedia.org/T248002 (10Jdforrester-WMF) [17:40:49] (03Merged) 10jenkins-bot: dockerfiles: Provide tox-censorshipmonitoring [integration/config] - 10https://gerrit.wikimedia.org/r/584656 (https://phabricator.wikimedia.org/T248002) (owner: 10Jforrester) [17:41:33] !log Docker: Publishing tox-censorshipmonitoring:0.1.0 T248002 [17:41:35] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:41:36] T248002: Install additional packages for censorship-monitoring CI environment - https://phabricator.wikimedia.org/T248002 [17:42:29] (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/584657 (https://phabricator.wikimedia.org/T248002) (owner: 10Jforrester) [17:44:39] oh wow, thanks James_F! much appreciated [17:44:43] (sorry was having lunch) [17:44:44] Reedy: thanks! [17:45:36] (03Merged) 10jenkins-bot: jjb: Provide censorshipmonitoring-tox-docker job [integration/config] - 10https://gerrit.wikimedia.org/r/584657 (https://phabricator.wikimedia.org/T248002) (owner: 10Jforrester) [17:46:35] (03CR) 10Jforrester: [C: 03+2] layout: [operations/software/censorship-monitoring] Custom job [integration/config] - 10https://gerrit.wikimedia.org/r/584658 (https://phabricator.wikimedia.org/T248002) (owner: 10Jforrester) [17:47:35] sukhe: Happy to help. [17:47:44] (03Merged) 10jenkins-bot: layout: [operations/software/censorship-monitoring] Custom job [integration/config] - 10https://gerrit.wikimedia.org/r/584658 (https://phabricator.wikimedia.org/T248002) (owner: 10Jforrester) [17:48:03] James_F: thank you [17:48:24] !log Zuul: [operations/software/censorship-monitoring] Switch to custom job T248002 [17:48:27] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:48:27] T248002: Install additional packages for censorship-monitoring CI environment - https://phabricator.wikimedia.org/T248002 [17:49:39] sukhe: CI load is a bit heavy right now. Should start first test run in a little while. [17:51:08] James_F: ok! [17:57:41] sukhe: Tah-dah: https://integration.wikimedia.org/ci/job/censorshipmonitoring-tox-docker/1/console [17:57:49] James_F: thanks! completed successfully [17:57:56] thanks for all your help. I was lost... [17:58:00] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Patch-For-Review: Install additional packages for censorship-monitoring CI environment - https://phabricator.wikimedia.org/T248002 (10Jdforrester-WMF) 05Open→... [17:58:17] No worries. Our current ("legacy") CI system is a mess. [17:59:13] (03CR) 10Jforrester: [C: 03+2] jjb: Drop operations-puppet-tests-stretch-docker, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/584632 (owner: 10Jforrester) [18:00:17] (03Merged) 10jenkins-bot: jjb: Drop operations-puppet-tests-stretch-docker, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/584632 (owner: 10Jforrester) [18:11:03] PROBLEM - Work requests waiting in Zuul Gearman server on contint1001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [150.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [18:13:53] Krinkle: T248891 :-( [18:13:54] T248891: Error: Trying to access array offset on value of type null (includes/deferred/DeferredUpdates.php:237) on PHP 7.4 - https://phabricator.wikimedia.org/T248891 [18:14:47] RECOVERY - Work requests waiting in Zuul Gearman server on contint1001 is OK: OK: Less than 100.00% above the threshold [90.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [18:15:34] 10Deployments, 10MediaWiki-SWAT-deployments: Figure out what to do with `fatalmonitor` script - https://phabricator.wikimedia.org/T234345 (10Lucas_Werkmeister_WMDE) 05Open→03Resolved a:03brennen It looks like we //finally// have a suitable replacement: `logspam-watch`, as documented in [Special:Diff/1860... [18:19:34] did something change in CI? I’m seeing “MediaWiki emitted some errors. Check output above.” messages that don’t look familiar [18:19:40] (e. g. in https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-php72-noselenium-docker/7161/console) [18:19:45] is that a new check? [18:23:32] I guess that would have been the fix for https://phabricator.wikimedia.org/T246358 [18:24:11] merged a few hours ago it seems [18:29:55] 10Gerrit, 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO, 10Developer Productivity, 10User-zeljkofilipin: PolyGerrit 2.15 UI does not support custom dashboards (supported from in 2.16+) - https://phabricator.wikimedia.org/T220801 (10Krinkle) [18:31:45] 10Gerrit, 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Developer Productivity, and 2 others: Upgrade to Gerrit 2.16.13 - https://phabricator.wikimedia.org/T200739 (10Krinkle) Tagged #developer_productivity as most teams I work with are unab... [18:32:06] Lucas_WMDE: See two lines above you. T248891. [18:32:07] T248891: Error: Trying to access array offset on value of type null (includes/deferred/DeferredUpdates.php:237) on PHP 7.4 - https://phabricator.wikimedia.org/T248891 [18:34:10] that looks nothing like the errors I saw [18:34:26] though it seems to be fall-out from the same underlying task? [18:36:37] Yes. [18:49:36] 10Phabricator: Translation of phabricator is outdated in Brazilian Portuguese - https://phabricator.wikimedia.org/T248902 (10DannyS712) [18:54:19] 10Release-Engineering-Team-TODO, 10Operations, 10Projects-Cleanup, 10Traffic, and 2 others: Retire fixcopyright.wikimedia.org - https://phabricator.wikimedia.org/T238803 (10CCicalese_WMF) @Pchelolo Do you have any insight on the job queue question? Thanks! [18:54:42] @James_F how is your day looking? do you think we can get https://gerrit.wikimedia.org/r/#/q/Iebdc0d36081f7c942c37df1f465d2256263faae8 out today? [18:54:45] I can be around to test [18:55:07] Jdlrobson: Sure. I'm looking at a UBN right now, but in an hour's time? [18:55:15] 10Release-Engineering-Team-TODO, 10Operations, 10Projects-Cleanup, 10Traffic, and 2 others: Retire fixcopyright.wikimedia.org - https://phabricator.wikimedia.org/T238803 (10Pchelolo) > Purge jobs for this wiki from the JobQueue. There's no need to do this step in WMF Kafka-based jobqueue. [18:55:16] totally i was thinking 4pm SWAT window [18:55:31] but if you can do earlier that works for me too. Good luck with the UBN! [18:55:40] Thanks. [18:55:58] (03PS4) 10Brennen Bearnes: Add install script to work around shell issues [releng/dev-images] - 10https://gerrit.wikimedia.org/r/584111 (https://phabricator.wikimedia.org/T246953) (owner: 10Kosta Harlan) [18:57:15] 10Gerrit, 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Developer Productivity, and 2 others: Upgrade to Gerrit 2.16.13 - https://phabricator.wikimedia.org/T200739 (10Dvorapa) Is there also any plan to move to 3.0 or 3.1? As Gerrit team supp... [18:59:36] 10Release-Engineering-Team-TODO, 10Operations, 10Projects-Cleanup, 10Traffic, and 2 others: Retire fixcopyright.wikimedia.org - https://phabricator.wikimedia.org/T238803 (10CCicalese_WMF) [19:00:37] 10Release-Engineering-Team-TODO, 10Operations, 10Projects-Cleanup, 10Traffic, and 2 others: Retire fixcopyright.wikimedia.org - https://phabricator.wikimedia.org/T238803 (10CCicalese_WMF) [19:00:56] 10MediaWiki-Codesniffer, 10MediaWiki-General, 10Patch-For-Review, 10User-DannyS712: Add global $wgUser to DeprecatedGlobalVariablesSniff - https://phabricator.wikimedia.org/T244452 (10DannyS712) {{ping}} now that wgUser is officially deprecated in MW 1.35, can the sniff be added for the next release of cod... [19:01:25] 10Release-Engineering-Team-TODO, 10Operations, 10Projects-Cleanup, 10Traffic, and 2 others: Retire fixcopyright.wikimedia.org - https://phabricator.wikimedia.org/T238803 (10CCicalese_WMF) [19:01:41] 10MediaWiki-Codesniffer, 10User-DannyS712: Update UnrecognizedAnnotation following new stable interface policy - https://phabricator.wikimedia.org/T247836 (10DannyS712) 05Open→03Resolved [19:09:54] (03PS4) 10DannyS712: Add global $wgUser to DeprecatedGlobalVariablesSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/583607 (https://phabricator.wikimedia.org/T244452) [19:15:44] 10Project-Admins: Create Project: Section-Name-Diff - https://phabricator.wikimedia.org/T246484 (10Aklapper) >>! In T246484#6011312, @MBinder_WMF wrote: > - There is already a Herald for #community-tech here: {H260}. I think the new one should probably be merged into that one. What do you think, @Aklapper ? H3... [19:20:17] (03CR) 10Brennen Bearnes: [C: 03+1] "One minor comment inline. Otherwise I think this looks ok, but I have to admit I'm now a little lost in the tangle of what settings live " (031 comment) [releng/dev-images] - 10https://gerrit.wikimedia.org/r/582498 (https://phabricator.wikimedia.org/T247072) (owner: 10Kosta Harlan) [19:23:31] 10Continuous-Integration-Infrastructure, 10Developer Productivity, 10Technical-Debt: Automatically delete old jobs not (or no longer) managed by JJB - https://phabricator.wikimedia.org/T91410 (10Krinkle) [19:24:54] 10Continuous-Integration-Infrastructure, 10Developer Productivity, 10Technical-Debt: Automatically delete old jobs not (or no longer) managed by JJB - https://phabricator.wikimedia.org/T91410 (10Krinkle) Tagging dev-prod as it makes it quite difficult for developers to find logs from "master" commits. This i... [19:25:02] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team-TODO, 10Developer Productivity, 10Technical-Debt: Automatically delete old jobs not (or no longer) managed by JJB - https://phabricator.wikimedia.org/T91410 (10Krinkle) [19:35:16] (03CR) 10Kosta Harlan: "> Patch Set 5: Code-Review+1" (031 comment) [releng/dev-images] - 10https://gerrit.wikimedia.org/r/582498 (https://phabricator.wikimedia.org/T247072) (owner: 10Kosta Harlan) [19:37:18] (03PS10) 10Hashar: Scap3 deploy repo for zuul [integration/zuul/deploy] - 10https://gerrit.wikimedia.org/r/577846 (https://phabricator.wikimedia.org/T215458) (owner: 1020after4) [19:37:27] 10Release-Engineering-Team (Pipeline), 10Analytics, 10Analytics-Kanban, 10Release Pipeline, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10Ottomata) [19:37:46] (03CR) 10Hashar: "I have dropped the Depends-On on the puppet change. We need the deploy repo to have some content first ;)" [integration/zuul/deploy] - 10https://gerrit.wikimedia.org/r/577846 (https://phabricator.wikimedia.org/T215458) (owner: 1020after4) [19:39:11] (03PS11) 10Hashar: Scap3 deploy repo for zuul [integration/zuul/deploy] - 10https://gerrit.wikimedia.org/r/577846 (https://phabricator.wikimedia.org/T215458) (owner: 1020after4) [19:39:25] 10Project-Admins: Create Project: Section-Name-Diff - https://phabricator.wikimedia.org/T246484 (10MBinder_WMF) > H359 does not add Community-Tech so it should not be merged. H260 could be edited to add Community-Tech to Section-Name-Diff tasks, though it'll have the side effect that an existing tag "Community-T... [19:39:29] (03CR) 10Hashar: "Restored the depends on Ie6d5988b2404ebb175a7ebdb224516934b98c88d , I got confused :/" [integration/zuul/deploy] - 10https://gerrit.wikimedia.org/r/577846 (https://phabricator.wikimedia.org/T215458) (owner: 1020after4) [19:40:59] 10Gerrit, 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Developer Productivity, and 2 others: Upgrade to Gerrit 2.16.13 - https://phabricator.wikimedia.org/T200739 (10Aklapper) >>! In T200739#6012182, @Dvorapa wrote: > Is there also any plan... [20:14:25] 10Project-Admins: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706 (10CBogen) I'd like to request access to create projects as the new Program Manager for the Structured Data team, so that I can accommodate their requests for new tags, etc. Thank you! [20:22:16] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)): Document how to migrate a service to kubernetes - https://phabricator.wikimedia.org/T248916 (10jeena) [20:29:01] Hi there – I think I'm being impacted by the patch that was merged for T246358 (https://phabricator.wikimedia.org/T246358). I had to rebase a patch that was all JS and CSS code, but now PHP tests are failing that previously passed, due to the presence of an mw-error.log output (created by wikibase lexeme tests I think). Patch is here: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/MachineVision/+/581645. Any [20:29:01] suggestions on what can be done about this? [20:29:01] T246358: Jenkins no longer fails build if mw-error.log or mw-dberror.log are non-empty - https://phabricator.wikimedia.org/T246358 [20:32:17] (03PS5) 10Jforrester: Add global $wgUser to DeprecatedGlobalVariablesSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/583607 (https://phabricator.wikimedia.org/T244452) (owner: 10DannyS712) [20:32:24] (03CR) 10Jforrester: [C: 03+2] Add global $wgUser to DeprecatedGlobalVariablesSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/583607 (https://phabricator.wikimedia.org/T244452) (owner: 10DannyS712) [20:33:26] (03Merged) 10jenkins-bot: Add global $wgUser to DeprecatedGlobalVariablesSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/583607 (https://phabricator.wikimedia.org/T244452) (owner: 10DannyS712) [20:33:57] (03PS1) 10Jeena Huneidi: Add publish pipeline for helloworldoid [integration/config] - 10https://gerrit.wikimedia.org/r/584701 (https://phabricator.wikimedia.org/T248916) [20:35:04] (03PS2) 10Jeena Huneidi: Add publish pipeline for helloworldoid [integration/config] - 10https://gerrit.wikimedia.org/r/584701 (https://phabricator.wikimedia.org/T248916) [20:36:26] !log Reverting T246358 work on JJB to fix T248891. [20:36:29] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:36:30] T246358: Jenkins no longer fails build if mw-error.log or mw-dberror.log are non-empty - https://phabricator.wikimedia.org/T246358 [20:36:30] T248891: Error: Trying to access array offset on value of type null (includes/deferred/DeferredUpdates.php:237) on PHP 7.4 - https://phabricator.wikimedia.org/T248891 [20:36:53] EricGardner: Reverting now. Should be fixed in a few seconds' time. [20:37:29] (03PS1) 10Jforrester: jjb: Revert "Add 'assert-no-mediawiki-errors' to mediawiki quibble jobs" [integration/config] - 10https://gerrit.wikimedia.org/r/584703 (https://phabricator.wikimedia.org/T248891) [20:37:29] James_F great, thanks! I'll recheck everything in a bit to see if there is any change [20:37:57] EricGardner: Recheck should now work everywhere; all 108 jobs rolled over. [20:38:09] (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/584703 (https://phabricator.wikimedia.org/T248891) (owner: 10Jforrester) [20:38:52] * James_F can't wait for REL1_31 EOL so he can kill half the CI jobs for old PHP flavours. [20:39:21] 10MediaWiki-Codesniffer, 10MediaWiki-extensions-Other: Fixing errors/warnings found by phpcbf shows error for MSSQLBackCompat - https://phabricator.wikimedia.org/T248919 (10Zoranzoki21) [20:39:53] (03Merged) 10jenkins-bot: jjb: Revert "Add 'assert-no-mediawiki-errors' to mediawiki quibble jobs" [integration/config] - 10https://gerrit.wikimedia.org/r/584703 (https://phabricator.wikimedia.org/T248891) (owner: 10Jforrester) [20:40:34] (03CR) 10jerkins-bot: [V: 04-1] Add publish pipeline for helloworldoid [integration/config] - 10https://gerrit.wikimedia.org/r/584701 (https://phabricator.wikimedia.org/T248916) (owner: 10Jeena Huneidi) [22:10:13] James_F: how's the ubn going? OK for me to put https://gerrit.wikimedia.org/r/#/q/Iebdc0d36081f7c942c37df1f465d2256263faae8 in the swat window? [22:10:41] Jdlrobson: See my ping an hour ago in -operations asking if you were OK for me to deploy. :-) [22:11:15] PROBLEM - Work requests waiting in Zuul Gearman server on contint1001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [150.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [22:26:47] James_F: oh sorry i missed that :D [22:35:07] 10Deployments, 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10Epic: [EPIC] The future of MediaWiki deployment: Tooling - https://phabricator.wikimedia.org/T94620 (10mmodell) 05Open→03Resolved a:03mmodell I'm going to close this as it's no longer actively worked o... [22:35:09] 10Deployments, 10Services (watching): Use semantic versioning for services (for consistency with mediawiki core) - https://phabricator.wikimedia.org/T102550 (10mmodell) [22:37:26] 10Release-Engineering-Team (Pipeline), 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Release Pipeline (Blubber): Blubber policy should be verified after expansion - https://phabricator.wikimedia.org/T248927 (10thcipriani) [22:37:29] 10Scap (Scap3-MediaWiki-MVP), 10releng-201617-q4, 10scap2, 10Operations: Make scap able to depool/repool servers via the conftool API - https://phabricator.wikimedia.org/T104352 (10mmodell) I think this one should be resolved now? [22:37:42] 10Release-Engineering-Team (Pipeline), 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Release Pipeline (Blubber): Blubber policy should be verified after expansion - https://phabricator.wikimedia.org/T248927 (10thcipriani) Tentatively assigning to dduvall per IRC discussion [22:37:43] RECOVERY - Work requests waiting in Zuul Gearman server on contint1001 is OK: OK: Less than 100.00% above the threshold [90.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [23:02:58] 10phan-taint-check-plugin, 10Security-Team, 10MW-1.35-notes (1.35.0-wmf.26; 2020-03-31), 10Patch-For-Review, and 2 others: Phan warning in "includes/specials/SpecialMobileDiff.php" - working around by disabling - https://phabricator.wikimedia.org/T248360 (10Jdlrobson) 05Open→03Resolved a:03Jdlrobson [23:07:46] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10MediaWiki-Docker, 10MW-1.35-notes (1.35.0-wmf.26; 2020-03-31), 10User-brennen: TimedMediaHandler's ffmpeg processes get stuck when using resource limits on Docker image - https://phabricator.wikimedia.org/T246942 (10brennen) a:05brennen→03kost...