[00:02:43] 10Phabricator, 10Wikimedia-Hackathon-2018: Build a bot that pushes Phabricator updates to Google Chat - https://phabricator.wikimedia.org/T189313#4038677 (10Platonides) The proprietary nature of Google Chat isn't just a philosophical issue with regards to using the service. It also means that the features (in... [00:32:09] 10Phabricator, 10Release-Engineering-Team (Kanban), 10Phlogiston: Phlogiston reports don't have new data since mid-February - https://phabricator.wikimedia.org/T188149#4055358 (10JAufrecht) If you can throw in the new column, I can modify the script to work with either kind of data. [00:37:06] 10Phabricator, 10Release-Engineering-Team (Kanban), 10Phlogiston: Phlogiston reports don't have new data since mid-February - https://phabricator.wikimedia.org/T188149#4055367 (10mmodell) Actually I see now that the metadata column is already there, it's the 10th one, specifically. For reference, the query... [00:37:46] PROBLEM - SSH on integration-slave-docker-1014 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:42:35] RECOVERY - SSH on integration-slave-docker-1014 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u4 (protocol 2.0) [01:01:32] Project mwext-phpunit-coverage-publish build #2251: 04FAILURE in 3.4 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/2251/ [01:01:33] Project mwext-phpunit-coverage-publish build #2252: 04STILL FAILING in 0.54 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/2252/ [01:01:34] Project mwext-phpunit-coverage-publish build #2253: 04STILL FAILING in 1 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/2253/ [01:01:37] Project mwext-phpunit-coverage-publish build #2254: 04STILL FAILING in 2.7 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/2254/ [01:03:37] fun [01:07:59] Yippee, build fixed! [01:07:59] Project mwext-phpunit-coverage-publish build #2255: 09FIXED in 6 min 21 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/2255/ [02:09:23] (03PS4) 10Thcipriani: Add totals to deploy-notes [tools/release] - 10https://gerrit.wikimedia.org/r/416873 [02:10:36] (03CR) 10Thcipriani: Add totals to deploy-notes (031 comment) [tools/release] - 10https://gerrit.wikimedia.org/r/416873 (owner: 10Thcipriani) [02:11:17] 10Phabricator, 10Release-Engineering-Team (Kanban), 10Phlogiston: Phlogiston reports don't have new data since mid-February - https://phabricator.wikimedia.org/T188149#4055500 (10JAufrecht) It's much easier to change Phlogiston than the dump, because it runs outside of any security profile and doesn't requir... [02:21:01] 10Scap, 10Patch-For-Review: Support git-lfs - https://phabricator.wikimedia.org/T180627#4055517 (10awight) I'm trying to check that in, and run: ``` cd submodules/assets git config -f .lfsconfig lfs.url https://gerrit.wikimedia.org/r/scoring/ores/assets/info/lfs git add .lfsconfig git commit -m "Force LFS URL... [02:44:42] !log beta-scap-eqiad stuck 14 hours, had to do disconnect reconnect dance [02:44:44] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [03:23:13] (03PS1) 10Samwilson: Add TemplateWizard dependencies [integration/config] - 10https://gerrit.wikimedia.org/r/419967 [03:24:41] PROBLEM - Free space - all mounts on deployment-tin is CRITICAL: CRITICAL: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)deployment-prep.deployment-tin.diskspace._srv.byte_percentfree (<40.00%) WARN: deployment-prep.deployment-tin.diskspace.root.byte_percentfree (<20.00%) [03:56:49] PROBLEM - Free space - all mounts on deployment-mediawiki04 is CRITICAL: CRITICAL: deployment-prep.deployment-mediawiki04.diskspace.root.byte_percentfree (<10.00%) [04:06:51] RECOVERY - Free space - all mounts on deployment-mediawiki04 is OK: OK: All targets OK [04:47:30] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 80.00% of data above the critical threshold [10.0] [05:01:05] 10Project-Admins: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706#4055581 (10mmodell) >>! In T706#4054251, @MBinder_WMF wrote: > Request to add @LGoto so that she can manage boards Done [06:02:29] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [06:12:30] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [07:25:46] 10MediaWiki-Codesniffer: Add rule for unused variables - https://phabricator.wikimedia.org/T114846#1707678 (10MaxSem) In the light of Phan being available, it this still relevant? [08:33:13] (03CR) 10Hashar: "The jsduck container is there to run... jsduck ! It does not include nodejs/npm so that is not going to work." [integration/config] - 10https://gerrit.wikimedia.org/r/419941 (https://phabricator.wikimedia.org/T138401) (owner: 10Jdlrobson) [08:47:20] 10Continuous-Integration-Config: Jenkins randomly fails tests for AbuseFilter - https://phabricator.wikimedia.org/T189411#4055719 (10hashar) [08:48:42] 10Continuous-Integration-Config, 10AbuseFilter: Jenkins randomly fails tests for AbuseFilter - https://phabricator.wikimedia.org/T189411#4041051 (10hashar) The qunit fails because some Wikibase test is flapping. The php55lint failures are due to either T179963 or T189365 [08:50:08] PROBLEM - Puppet errors on integration-slave-jessie-1004 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [08:50:58] PROBLEM - Puppet errors on integration-slave-jessie-1001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [09:11:30] 10Scap, 10Patch-For-Review: Support git-lfs - https://phabricator.wikimedia.org/T180627#4055745 (10Paladox) @awight, did you download commit-msg? It should only go into /.git/hooks Also will this .lfsconfig Actually work? In @mmodell example he did git config without specifying a file. [09:14:05] PROBLEM - Puppet errors on deployment-mira is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [09:16:43] (03PS3) 10Hashar: gate-and-submit to only accept open changes [integration/config] - 10https://gerrit.wikimedia.org/r/419686 (https://phabricator.wikimedia.org/T188290) [09:18:28] (03CR) 10Hashar: [C: 032] gate-and-submit to only accept open changes [integration/config] - 10https://gerrit.wikimedia.org/r/419686 (https://phabricator.wikimedia.org/T188290) (owner: 10Hashar) [09:18:36] PROBLEM - Puppet errors on deployment-tin is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [09:19:39] (03Merged) 10jenkins-bot: gate-and-submit to only accept open changes [integration/config] - 10https://gerrit.wikimedia.org/r/419686 (https://phabricator.wikimedia.org/T188290) (owner: 10Hashar) [09:33:12] (03CR) 10Hashar: [C: 032] "Blablabla for T188290" [integration/config] - 10https://gerrit.wikimedia.org/r/414678 (owner: 10Hashar) [09:34:53] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban), 10Patch-For-Review: User commenting on a merge change that it had Cr+2 cause it to enter gate-and-submit again - https://phabricator.wikimedia.org/T188290#4055783 (10hashar) 05Open>03Resolved a:03hashar I have commented on https://ge... [09:57:44] poke legoktm for the explanation below [09:57:59] zeljkof: so yeah there are bunch of jobs pilling up in the coverage pipeline since yesterday [09:58:34] I have been looking at it for the past hour [09:58:44] the reason is https://gerrit.wikimedia.org/r/#/c/419674/ [09:59:10] that adds a mutex in zuul to only have ONE and only ONE build of mwext-phpunit-coverage-patch at any given time [10:00:05] Gerrit change https://gerrit.wikimedia.org/r/#/c/419804/ had a PS1 triggering the build [10:00:14] err PS2 [10:00:19] then immediately after a PS3 got sent [10:00:30] that cancelled the mwext-phpunit-coverage-patch job for PS2 [10:00:35] BUT DID NOT RELEASE THE MUTEX [10:00:53] ---> that job can not be triggered anymore since the mutex is held [10:01:27] luckily someone from BMW (the car manufacturer) got it by the same issue a year ago and backported a patch for zuul 2.x https://review.openstack.org/#/c/432211/ [10:01:39] so in short: I got cherry-pick/upgrade zuul [10:01:42] that is the long story [10:02:21] hashar: :D [10:02:27] BMW to the rescue! ;) [10:07:22] 10Continuous-Integration-Infrastructure, 10Zuul: Zuul coverage pipeline is no more processing mwext-phpunit-coverage-patch jobs - https://phabricator.wikimedia.org/T189859#4055844 (10hashar) [10:07:58] (03CR) 10Hashar: [C: 032] "On our Zuul version, when a job get cancelled the mutex is not released which causes a deadlock. Good news, there is a Zuul fix for it." [integration/config] - 10https://gerrit.wikimedia.org/r/419674 (https://phabricator.wikimedia.org/T72597) (owner: 10Hashar) [10:09:18] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Zuul: Update zuul to latest pre 3.0 commit - https://phabricator.wikimedia.org/T158243#4055856 (10hashar) Lack of upgrade caused T189859 [10:09:40] filled as https://phabricator.wikimedia.org/T189859 [10:32:28] (03PS1) 10Hashar: Fix missing mutex release when aborting builds [integration/zuul] (patch-queue/debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/419998 [10:33:16] (03Abandoned) 10Hashar: wmf: debug log for GerritSource._updateChange [integration/zuul] (patch-queue/debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/411321 (https://phabricator.wikimedia.org/T187567) (owner: 10Hashar) [10:33:44] (03PS2) 10Hashar: Fix missing mutex release when aborting builds [integration/zuul] (patch-queue/debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/419998 [10:35:54] (03PS1) 10Tonina Zhelyazkova: AdvancedSearch depends on Translate extension [integration/config] - 10https://gerrit.wikimedia.org/r/420000 (https://phabricator.wikimedia.org/T166851) [10:38:44] 10Continuous-Integration-Infrastructure, 10Zuul: Zuul coverage pipeline is no more processing mwext-phpunit-coverage-patch jobs - https://phabricator.wikimedia.org/T189859#4055928 (10hashar) [10:39:14] (03Abandoned) 10Hashar: Fix missing mutex release when aborting builds [integration/zuul] (patch-queue/debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/419998 (owner: 10Hashar) [10:39:58] 10Continuous-Integration-Infrastructure, 10Upstream, 10Zuul: Zuul coverage pipeline is no more processing mwext-phpunit-coverage-patch jobs - https://phabricator.wikimedia.org/T189859#4055844 (10hashar) [10:42:38] (03PS1) 10Hashar: Fix missing mutex release when aborting builds [integration/zuul] (patch-queue/debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/420001 [10:43:45] (03CR) 10Hashar: [C: 032] "That is what we are have been running for a few weeks, so might as well merge it." [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/411322 (https://phabricator.wikimedia.org/T187567) (owner: 10Hashar) [10:44:57] (03Merged) 10jenkins-bot: 2.5.1-wmf3: fix patchset comparaison [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/411322 (https://phabricator.wikimedia.org/T187567) (owner: 10Hashar) [10:46:34] (03PS1) 10Hashar: 2.5.1-wmf4: drop log/fix mutex release on job cancel [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/420002 (https://phabricator.wikimedia.org/T189859) [10:53:53] !log Upgrading zuul to zuul_2.5.1-wmf4 to resolve a mutex deadlock T189859 [10:53:58] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:53:58] T189859: Zuul coverage pipeline is no more processing mwext-phpunit-coverage-patch jobs - https://phabricator.wikimedia.org/T189859 [11:08:32] 10Scap, 10Packaging, 10Patch-For-Review: SCAP: Upload debian package version 3.7.7-1 - https://phabricator.wikimedia.org/T189306#4056038 (10fgiunchedi) I'm ready to go with the upgrade, @mmodell please ping me on irc when a time suits (cc @thcipriani ) [11:09:24] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Selenium tests should be easier to run - https://phabricator.wikimedia.org/T182691#4056040 (10zeljkofilipin) a:03zeljkofilipin [11:11:14] !log zuul: reenqueue all coverage jobs lost when restarting Zuul [11:11:16] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [11:12:13] 10Continuous-Integration-Infrastructure, 10Patch-For-Review, 10Upstream, 10Zuul: Zuul coverage pipeline is no more processing mwext-phpunit-coverage-patch jobs - https://phabricator.wikimedia.org/T189859#4056046 (10hashar) https://people.wikimedia.org/~hashar/debs/zuul_2.5.1-wmf4/ will get it uploaded via... [11:12:23] 10Continuous-Integration-Infrastructure, 10Operations, 10Packaging, 10Zuul: Upload new zuul and jenkins-debian-glue packages to apt.wikimedia.org - https://phabricator.wikimedia.org/T186786#3955291 (10hashar) [11:12:26] 10Continuous-Integration-Infrastructure, 10Patch-For-Review, 10Upstream, 10Zuul: Zuul coverage pipeline is no more processing mwext-phpunit-coverage-patch jobs - https://phabricator.wikimedia.org/T189859#4056048 (10hashar) [11:13:33] 10Continuous-Integration-Infrastructure, 10Operations, 10Packaging, 10Zuul: Upload new zuul and jenkins-debian-glue packages to apt.wikimedia.org - https://phabricator.wikimedia.org/T186786#3955291 (10hashar) [11:14:15] 10Continuous-Integration-Infrastructure, 10Operations, 10Packaging, 10Zuul: Upload new zuul and jenkins-debian-glue packages to apt.wikimedia.org - https://phabricator.wikimedia.org/T186786#4056054 (10hashar) I have bumped Zuul to zuul_2.5.1-wmf4 for T189859 and thus updated this task description. [11:14:49] (03CR) 10Hashar: [C: 032] "Deployed :)" [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/420002 (https://phabricator.wikimedia.org/T189859) (owner: 10Hashar) [11:15:19] 10Continuous-Integration-Infrastructure, 10Patch-For-Review, 10Upstream, 10Zuul: Zuul coverage pipeline is no more processing mwext-phpunit-coverage-patch jobs - https://phabricator.wikimedia.org/T189859#4056069 (10hashar) 05Open>03Resolved a:03hashar [11:15:35] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Upstream, 10Zuul: Zuul coverage pipeline is no more processing mwext-phpunit-coverage-patch jobs - https://phabricator.wikimedia.org/T189859#4055844 (10hashar) [11:16:03] (03Merged) 10jenkins-bot: 2.5.1-wmf4: drop log/fix mutex release on job cancel [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/420002 (https://phabricator.wikimedia.org/T189859) (owner: 10Hashar) [11:19:40] (03PS7) 10Hashar: Migrate VisualEditor screenshot job to Docker [integration/config] - 10https://gerrit.wikimedia.org/r/416958 (https://phabricator.wikimedia.org/T189122) [11:41:23] 10Continuous-Integration-Infrastructure, 10Front-end-Standards-Group, 10MediaWiki-extensions-General, 10Services (designing): Decide whether we want the package-lock.json to commit or ignore - https://phabricator.wikimedia.org/T179229#4056097 (10Mvolz) >>! In T179229#4054220, @Pchelolo wrote: > We've recen... [11:55:47] (03CR) 10WMDE-Fisch: [C: 031] "+420000" [integration/config] - 10https://gerrit.wikimedia.org/r/420000 (https://phabricator.wikimedia.org/T166851) (owner: 10Tonina Zhelyazkova) [11:59:48] (03CR) 10Thiemo Kreuz (WMDE): [C: 031] AdvancedSearch depends on Translate extension [integration/config] - 10https://gerrit.wikimedia.org/r/420000 (https://phabricator.wikimedia.org/T166851) (owner: 10Tonina Zhelyazkova) [12:14:39] PROBLEM - Free space - all mounts on deployment-tin is CRITICAL: CRITICAL: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)deployment-prep.deployment-tin.diskspace._srv.byte_percentfree (<40.00%) WARN: deployment-prep.deployment-tin.diskspace.root.byte_percentfree (<10.00%) [12:44:22] Project beta-scap-eqiad build #199718: 04FAILURE in 41 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/199718/ [12:46:11] !log deployment-tin: sudo chown mwdeploy:mwdeploy /srv/mediawiki/.git/objects/pack/* # some pack of 6GB belonged to root [12:46:13] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [12:47:56] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Selenium tests should be easier to run - https://phabricator.wikimedia.org/T182691#4056219 (10zeljkofilipin) Filtering tests using `--spec` looked promising, but it does not work in all cases. đŸ˜• Reported upstream [[ https://github.com/webdriverio/webd... [12:50:35] !log deployment-tin: deleting /srv/grafana (no more in Gerrit) [12:50:37] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [12:56:35] !log deployment-tin: setting /srv/deployment files/dir to be group owned by wikidev and group writable [12:56:37] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [12:56:50] !log deployment-tin: ran git remote prune origin / git gc on all /srv/deployment git repositories [12:56:51] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [12:58:57] Yippee, build fixed! [12:58:57] Project beta-scap-eqiad build #199719: 09FIXED in 5 min 18 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/199719/ [12:59:42] PROBLEM - Free space - all mounts on deployment-tin is CRITICAL: CRITICAL: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)deployment-prep.deployment-tin.diskspace._srv.byte_percentfree (<10.00%) WARN: deployment-prep.deployment-tin.diskspace.root.byte_percentfree (<10.00%) [13:04:59] 10Gerrit: "git clone" URL shown on gitiles is incorrect, triggers "Permission denied (publickey)" error - https://phabricator.wikimedia.org/T189182#4034375 (10Paladox) Apparently in gitiles it seems to only generate the ssh url without the users username. [13:46:37] There's going to be a brief nodepool interruption while I test some database pool changes… worst case I'll revert everything in a few minutes. [13:58:29] PROBLEM - nodepoold running on labnodepool1001 is CRITICAL: PROCS CRITICAL: 0 processes with UID = 113 (nodepool), regex args ^/usr/bin/python /usr/bin/nodepoold -d [14:01:25] ^ that's me [14:04:38] ACKNOWLEDGEMENT - nodepoold running on labnodepool1001 is CRITICAL: PROCS CRITICAL: 0 processes with UID = 113 (nodepool), regex args ^/usr/bin/python /usr/bin/nodepoold -d amusso temp stop for openstack maintenance [14:10:07] (03CR) 10Hashar: [C: 032] AdvancedSearch depends on Translate extension [integration/config] - 10https://gerrit.wikimedia.org/r/420000 (https://phabricator.wikimedia.org/T166851) (owner: 10Tonina Zhelyazkova) [14:11:20] (03Merged) 10jenkins-bot: AdvancedSearch depends on Translate extension [integration/config] - 10https://gerrit.wikimedia.org/r/420000 (https://phabricator.wikimedia.org/T166851) (owner: 10Tonina Zhelyazkova) [14:27:29] RECOVERY - nodepoold running on labnodepool1001 is OK: PROCS OK: 1 process with UID = 113 (nodepool), regex args ^/usr/bin/python /usr/bin/nodepoold -d [14:29:08] (03PS6) 10Zfilipin: WIP Create selenium-core-jessie daily Jenkins job [integration/config] - 10https://gerrit.wikimedia.org/r/415027 (https://phabricator.wikimedia.org/T185011) [14:29:54] (03CR) 10jerkins-bot: [V: 04-1] WIP Create selenium-core-jessie daily Jenkins job [integration/config] - 10https://gerrit.wikimedia.org/r/415027 (https://phabricator.wikimedia.org/T185011) (owner: 10Zfilipin) [14:33:46] nodepool is back on but will take another few minutes before it starts actually creating VMs [14:36:16] (03CR) 10Hashar: [C: 032] The quibble script is the ENTRYPOINT [integration/quibble] - 10https://gerrit.wikimedia.org/r/403540 (owner: 10Hashar) [14:36:39] (03Merged) 10jenkins-bot: The quibble script is the ENTRYPOINT [integration/quibble] - 10https://gerrit.wikimedia.org/r/403540 (owner: 10Hashar) [14:44:14] (03PS5) 10WMDE-leszek: Run node selenium tests as part of WikibaseLexeme CI build [integration/config] - 10https://gerrit.wikimedia.org/r/419479 (https://phabricator.wikimedia.org/T189677) [14:51:45] 10Phabricator: "Create Task" menu should be present on Workboard - https://phabricator.wikimedia.org/T189876#4056566 (10dbarratt) [14:54:24] (03PS1) 10Zfilipin: WIP Create selenium-MediaWiki-jessie daily Jenkins job [integration/jenkins] - 10https://gerrit.wikimedia.org/r/420040 (https://phabricator.wikimedia.org/T185011) [14:58:40] 10Phabricator (Upstream), 10Upstream: Should be easy to create new cards in a certain column on the project workboard - https://phabricator.wikimedia.org/T86076#4056614 (10Aklapper) a:05Qgil>03None [14:59:01] 10Phabricator: "Create Task" menu should be present on Workboard - https://phabricator.wikimedia.org/T189876#4056618 (10Aklapper) Anyone can add such a link in the side bar by editing the sidebar - see T91829#2037969 [14:59:09] 10Phabricator: "Create Task" menu should be present on Workboard - https://phabricator.wikimedia.org/T189876#4056621 (10Aklapper) [14:59:15] 10Phabricator (Upstream), 10Upstream: There is no easy way to file a Task from a Project page - https://phabricator.wikimedia.org/T91829#1097038 (10Aklapper) [15:00:08] 10Phabricator: "Create Task" menu should be present on Workboard - https://phabricator.wikimedia.org/T189876#4056566 (10Aklapper) > The "Create Task" drop down should exist (like it does on this issue page). It does, at least for me, in the `Favorites` menu. [15:01:06] (03PS7) 10Zfilipin: WIP Create selenium-core-jessie daily Jenkins job [integration/config] - 10https://gerrit.wikimedia.org/r/415027 (https://phabricator.wikimedia.org/T185011) [15:02:07] (03CR) 10jerkins-bot: [V: 04-1] WIP Create selenium-core-jessie daily Jenkins job [integration/config] - 10https://gerrit.wikimedia.org/r/415027 (https://phabricator.wikimedia.org/T185011) (owner: 10Zfilipin) [15:05:57] (03Abandoned) 10Jdlrobson: Use `npm run docs` not jsduck [integration/config] - 10https://gerrit.wikimedia.org/r/419941 (https://phabricator.wikimedia.org/T138401) (owner: 10Jdlrobson) [15:06:39] 10Phabricator: "Create Task" menu should be present on Workboard - https://phabricator.wikimedia.org/T189876#4056658 (10dbarratt) ooo! good call. thanks! [15:17:41] (03CR) 10Zfilipin: WIP Create selenium-core-jessie daily Jenkins job (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/415027 (https://phabricator.wikimedia.org/T185011) (owner: 10Zfilipin) [15:19:54] 10Phabricator, 10Wikimedia-Hackathon-2018: Build a bot that pushes Phabricator updates to Google Chat - https://phabricator.wikimedia.org/T189313#4056690 (10dbarratt) [15:27:44] PROBLEM - Puppet errors on deployment-redis01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [15:29:12] PROBLEM - Puppet errors on deployment-snapshot01 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [15:30:48] (03PS8) 10Zfilipin: WIP Create selenium-core-jessie daily Jenkins job [integration/config] - 10https://gerrit.wikimedia.org/r/415027 (https://phabricator.wikimedia.org/T185011) [15:31:04] (03Abandoned) 10Zfilipin: WIP Create selenium-MediaWiki-jessie daily Jenkins job [integration/jenkins] - 10https://gerrit.wikimedia.org/r/420040 (https://phabricator.wikimedia.org/T185011) (owner: 10Zfilipin) [15:33:43] PROBLEM - Puppet errors on deployment-redis02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [15:57:52] (03PS9) 10Zfilipin: WIP Create selenium-core-jessie daily Jenkins job [integration/config] - 10https://gerrit.wikimedia.org/r/415027 (https://phabricator.wikimedia.org/T185011) [16:00:02] (03PS10) 10Zfilipin: WIP Create selenium-core-jessie daily Jenkins job [integration/config] - 10https://gerrit.wikimedia.org/r/415027 (https://phabricator.wikimedia.org/T185011) [16:25:28] (03CR) 10Addshore: Run node selenium tests as part of WikibaseLexeme CI build (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/419479 (https://phabricator.wikimedia.org/T189677) (owner: 10WMDE-leszek) [16:26:20] (03CR) 10Addshore: [C: 04-1] Run node selenium tests as part of WikibaseLexeme CI build (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/419479 (https://phabricator.wikimedia.org/T189677) (owner: 10WMDE-leszek) [16:29:07] (03PS1) 10Umherirrender: Check for use statement with non-compound name [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/420063 (https://phabricator.wikimedia.org/T189323) [16:29:41] (03PS2) 10Umherirrender: Check for use statement with non-compound name [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/420063 (https://phabricator.wikimedia.org/T189323) [16:31:42] (03PS6) 10WMDE-leszek: Run node selenium tests as part of WikibaseLexeme CI build [integration/config] - 10https://gerrit.wikimedia.org/r/419479 (https://phabricator.wikimedia.org/T189677) [16:33:16] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Patch-For-Review, 10User-zeljkofilipin, 10Wikimedia-Incident: Create selenium-MediaWiki-jessie daily Jenkins job - https://phabricator.wikimedia.org/T185011#4056938 (10zeljkofilipin) >>! In T185011#4000693, @zeljkofilipin wrote: > I have just... [16:34:47] (03CR) 10WMDE-leszek: Run node selenium tests as part of WikibaseLexeme CI build (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/419479 (https://phabricator.wikimedia.org/T189677) (owner: 10WMDE-leszek) [16:52:16] (03PS11) 10Zfilipin: WIP Create selenium-core-jessie daily Jenkins job [integration/config] - 10https://gerrit.wikimedia.org/r/415027 (https://phabricator.wikimedia.org/T185011) [17:03:32] PROBLEM - puppet last run on contint2001 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [17:28:32] RECOVERY - puppet last run on contint2001 is OK: OK: Puppet is currently enabled, last run 46 seconds ago with 0 failures [17:39:20] (03PS12) 10Zfilipin: WIP Create selenium-core-jessie daily Jenkins job [integration/config] - 10https://gerrit.wikimedia.org/r/415027 (https://phabricator.wikimedia.org/T185011) [17:49:22] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q4, 10VisualEditor, and 3 others: Migrate language-screenshots-VisualEditor off of Nodepool to Docker containers - https://phabricator.wikimedia.org/T189122#4057197 (10zeljkofilipin) After 6 hours and a... [17:52:40] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q4, 10VisualEditor, and 3 others: Migrate language-screenshots-VisualEditor off of Nodepool to Docker containers - https://phabricator.wikimedia.org/T189122#4057217 (10zeljkofilipin) I'm not even sure h... [18:39:23] PROBLEM - Puppet errors on deployment-mx is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [18:41:54] no_justification oh woo hoo [18:42:00] we can view who is a member off [18:42:01] http://gerrit-new.wmflabs.org/r/admin/groups/2 [18:42:02] now [18:42:17] it's the "Non-Interactive Users" [18:42:22] which is hidden to non admins [18:42:50] oh [18:42:52] never mind [18:42:57] you can already view it [18:47:08] (03PS1) 10Umherirrender: Improve ClassMatchesFilenameSniff::isMaintenanceScript [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/420105 [19:52:31] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 80.00% of data above the critical threshold [10.0] [19:56:15] 10Continuous-Integration-Infrastructure, 10Front-end-Standards-Group, 10MediaWiki-extensions-General, 10Services (designing): Decide whether we want the package-lock.json to commit or ignore - https://phabricator.wikimedia.org/T179229#3717425 (10mobrovac) The problem with native dependencies seems a pretty... [20:11:59] (03PS1) 10Umherirrender: build: Update composer/semver to 1.4.2 [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/420116 [20:39:02] PROBLEM - Puppet errors on deployment-mediawiki07 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [21:00:21] https://gerrit-review.googlesource.com/c/gerrit/+/166730 is gaining filter on the includedIn dialog :) [21:00:35] so you can search it now. [21:19:28] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.31-release-notes (WMF-deploy-2018-03-20 (1.31.0-wmf.26)), 10Patch-For-Review, and 2 others: Create selenium-MediaWiki-jessie daily Jenkins job - https://phabricator.wikimedia.org/T185011#3903268 (10Krinkle) >>! In T185011#4057264, @gerritb... [21:42:47] no_justification https://phabricator.wikimedia.org/F15624906 :) [21:42:51] that looks really good [21:42:53] and works too [21:43:04] useful if you have 100's of branches [22:12:28] 10Gerrit, 10Release-Engineering-Team (Someday), 10Operations: Setup reply emails for gerrit - https://phabricator.wikimedia.org/T158915#4057775 (10Paladox) [23:09:55] PROBLEM - Puppet errors on deployment-aqs01 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [23:44:55] RECOVERY - Puppet errors on deployment-aqs01 is OK: OK: Less than 1.00% above the threshold [0.0] [23:51:33] (03PS1) 10MaxSem: Remove ArticleCreationWorkflow, undeployed [tools/release] - 10https://gerrit.wikimedia.org/r/420136