[00:09:39] 10Project-Admins, 10cloud-services-team (Kanban): Create #acl*wmcs-team - https://phabricator.wikimedia.org/T255731 (10bd808) [00:09:51] 10Project-Admins, 10cloud-services-team (Kanban): Create #acl*wmcs-team - https://phabricator.wikimedia.org/T255731 (10bd808) p:05Triage→03Medium [00:14:07] 10Project-Admins, 10cloud-services-team (Kanban): Create #acl*wmcs-team - https://phabricator.wikimedia.org/T255731 (10bd808) [04:43:13] 10Gerrit, 10DBA: Make sure `reviewdb-test` database (used forgerrit upgrade testing) gets torn down - https://phabricator.wikimedia.org/T255715 (10Marostegui) a:03jcrespo Thanks for the new ticket. As Jaime handled the initial DB and grants ticket, I am going to assign this to him as he has probably all the... [07:43:54] 10Phabricator, 10itWikiCon-2020: Create a countdown for itWikiCon 2020 call for papers - https://phabricator.wikimedia.org/T255668 (10Aklapper) 05Open→03Resolved a:03Aklapper Ah! I had forgotten this exists. :D Created now at https://phabricator.wikimedia.org/C3 and you both should be able to edit it. [07:53:19] 10Continuous-Integration-Infrastructure (phase-out-jessie), 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10Operations, 10Patch-For-Review: Migrate contint* hosts to Buster - https://phabricator.wikimedia.org/T224591 (10hashar) The easy trick is to have the rsync da... [08:00:30] 10Phabricator, 10itWikiCon-2020: Create a countdown for itWikiCon 2020 call for papers - https://phabricator.wikimedia.org/T255668 (10Majavah) 05Resolved→03Open @Aklapper Countdown has an application policy preventing users who are not Phab admins in even seeing it. [08:17:44] 10Gerrit, 10DBA, 10Patch-For-Review: Make sure `reviewdb-test` database (used forgerrit upgrade testing) gets torn down - https://phabricator.wikimedia.org/T255715 (10jcrespo) Waiting to proceed on @Dzahn's ok +private report revert: https://gerrit.wikimedia.org/r/c/operations/puppet/+/606387 [08:31:14] 10Phabricator, 10itWikiCon-2020: Create a countdown for itWikiCon 2020 call for papers - https://phabricator.wikimedia.org/T255668 (10Aklapper) a:05Aklapper→03None Uh, thanks for catching that. Indeed, https://phabricator.wikimedia.org/applications/view/PhabricatorCountdownApplication/ (admin-only link) sh... [09:01:06] 10Continuous-Integration-Infrastructure (phase-out-jessie), 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10Operations, 10Patch-For-Review: Migrate contint* hosts to Buster - https://phabricator.wikimedia.org/T224591 (10hashar) Actually we do not need any name mappi... [09:11:47] 10Gerrit: Allow wmf-deployment to remove votes from changes in wmf branches - https://phabricator.wikimedia.org/T229122 (10Urbanecm) Ping? :) [10:10:10] (03Abandoned) 10DannyS712: Enable abandoning patches for users in Trusted-Contributors group [sandbox] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/585913 (https://phabricator.wikimedia.org/T249423) (owner: 10Zoranzoki21) [10:10:20] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.35.0-wmf.37 deployment blockers - https://phabricator.wikimedia.org/T254174 (10LarsWirzenius) a:05brennen→03LarsWirzenius Taking this task again. So far, logstash looks fai... [10:26:31] 10Beta-Cluster-Infrastructure: SSH host key for deployment-imagescaler01.deployment-prep.eqiad.wmflabs changed? - https://phabricator.wikimedia.org/T254786 (10LarsWirzenius) I reported my problem badly and confusingly, sorry. As part of making a Scap release, I need to test Scap on the beta cluster. One step in... [10:27:09] 10Beta-Cluster-Infrastructure: SSH host key for deployment-imagescaler01.deployment-prep.eqiad.wmflabs changed? - https://phabricator.wikimedia.org/T254786 (10LarsWirzenius) The host key change error message has gone away in the meanwhile. I'll retitle the task. [10:27:41] 10Beta-Cluster-Infrastructure: Updating Scap on beta cluster hosts with cumin fails - https://phabricator.wikimedia.org/T254786 (10LarsWirzenius) [10:34:49] (03CR) 10Hashar: Define python deps in setup.cfg (032 comments) [integration/quibble] - 10https://gerrit.wikimedia.org/r/604702 (https://phabricator.wikimedia.org/T235118) (owner: 10Hashar) [10:36:50] 10Phabricator, 10Quality-and-Test-Engineering-Team (QTE): Error in pushing code to Gerrit for the phab-deployment repository - https://phabricator.wikimedia.org/T255761 (10Vidhi-Mody) [10:38:05] 10Phabricator, 10Quality-and-Test-Engineering-Team (QTE): Error in pushing code to Gerrit for the phab-deployment repository - https://phabricator.wikimedia.org/T255761 (10Vidhi-Mody) [10:38:07] 10Phabricator, 10Quality-and-Test-Engineering-Team (QTE), 10User-zeljkofilipin: Upgrade WebdriverIO in the phab-deployment repository - https://phabricator.wikimedia.org/T255471 (10Vidhi-Mody) [10:40:16] 10Beta-Cluster-Infrastructure: Special:Import fails to load on beta cluster - https://phabricator.wikimedia.org/T255762 (10Majavah) [10:41:36] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Scap: Announce scap --canary-wait time changes - https://phabricator.wikimedia.org/T250141 (10LarsWirzenius) [10:42:08] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Scap: Announce scap --canary-wait time changes - https://phabricator.wikimedia.org/T250141 (10LarsWirzenius) [10:43:18] (03PS1) 10Hashar: doc: move build_sphinx -W to setup.cfg [integration/quibble] - 10https://gerrit.wikimedia.org/r/606405 [10:43:56] (03CR) 10Hashar: Define python deps in setup.cfg (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/604702 (https://phabricator.wikimedia.org/T235118) (owner: 10Hashar) [10:46:58] 10Continuous-Integration-Config, 10Code-Health-Metrics, 10Product-Infrastructure-Team-Backlog, 10Services, 10Patch-For-Review: Enable codehealth pipeline for node services - https://phabricator.wikimedia.org/T240989 (10MSantos) @kostajh thanks for the initial feedback and work on this, I have been testin... [10:49:32] 10Continuous-Integration-Config, 10Code-Health-Metrics, 10Product-Infrastructure-Team-Backlog, 10Services, 10Patch-For-Review: Enable codehealth pipeline for node services - https://phabricator.wikimedia.org/T240989 (10kostajh) @MSantos yeah, this is annoying, so what we need to do in the `mediawiki-serv... [10:49:57] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Scap: Announce scap --canary-wait time changes - https://phabricator.wikimedia.org/T250141 (10LarsWirzenius) [10:50:53] all deployers: scap sync --canary-wait-time option is available (https://phabricator.wikimedia.org/T217924) [10:51:36] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Scap: Announce scap --canary-wait time changes - https://phabricator.wikimedia.org/T250141 (10LarsWirzenius) [10:52:40] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Scap: Announce scap --canary-wait time changes - https://phabricator.wikimedia.org/T250141 (10LarsWirzenius) Announced everywhere. I think this is done. [10:52:46] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Scap: Announce scap --canary-wait time changes - https://phabricator.wikimedia.org/T250141 (10LarsWirzenius) 05Open→03Resolved [10:52:48] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Scap: Make scap release with --canary-wait-time and integration test changes - https://phabricator.wikimedia.org/T246455 (10LarsWirzenius) [10:53:42] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Scap: Make scap release with --canary-wait-time and integration test changes - https://phabricator.wikimedia.org/T246455 (10LarsWirzenius) 05Open→03Resolved Released, used in train, announced, done. [10:55:08] (03PS2) 10MSantos: Add run.sh script with minimal setup for scanner [integration/config] - 10https://gerrit.wikimedia.org/r/606241 (https://phabricator.wikimedia.org/T240989) [10:55:29] (03CR) 10MSantos: Add run.sh script with minimal setup for scanner (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/606241 (https://phabricator.wikimedia.org/T240989) (owner: 10MSantos) [10:56:07] 10Beta-Cluster-Infrastructure, 10MediaWiki-Export-or-Import, 10Regression, 10User-DannyS712: Special:Import fails to load on beta cluster - https://phabricator.wikimedia.org/T255762 (10DannyS712) a:03DannyS712 Caused by {68c433bd23bd134883225f03626a94a16fc16bda} - see https://gerrit.wikimedia.org/r/#/c/m... [10:59:49] 10Beta-Cluster-Infrastructure, 10MediaWiki-Export-or-Import, 10Patch-For-Review, 10Regression, 10User-DannyS712: Special:Import fails to load on beta cluster - https://phabricator.wikimedia.org/T255762 (10DannyS712) p:05Triage→03High [11:02:00] (03CR) 10Kosta Harlan: Add run.sh script with minimal setup for scanner (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/606241 (https://phabricator.wikimedia.org/T240989) (owner: 10MSantos) [11:02:09] (03PS5) 10Hashar: Integration job for Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/604785 (https://phabricator.wikimedia.org/T235118) [11:02:51] (03CR) 10Hashar: "Made docker to mount the log directory to "/workspace/log" which is the default for Quibble instead of "/log" (the default for most jobs)." [integration/config] - 10https://gerrit.wikimedia.org/r/604785 (https://phabricator.wikimedia.org/T235118) (owner: 10Hashar) [11:04:06] (03CR) 10Hashar: "> The log from the job says "17:32:08 No artifacts found that match the file pattern "log/". Configuration error?", does it matter?" [integration/quibble] - 10https://gerrit.wikimedia.org/r/605939 (https://phabricator.wikimedia.org/T235118) (owner: 10Hashar) [11:11:44] (03CR) 10Hashar: "Quibble does not use /srv/git as a cloning cache bah ;-(" [integration/config] - 10https://gerrit.wikimedia.org/r/604785 (https://phabricator.wikimedia.org/T235118) (owner: 10Hashar) [11:20:59] (03CR) 10Jcrespo: [C: 04-1] "@privacybatm should I update this patch to point to the new repo or did you send another patch?" [integration/config] - 10https://gerrit.wikimedia.org/r/598492 (https://phabricator.wikimedia.org/T253219) (owner: 10Jcrespo) [11:27:56] (03CR) 10MSantos: [C: 04-1] WIP: Codehealth pipeline NodeJS configuration (033 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/606253 (https://phabricator.wikimedia.org/T240989) (owner: 10Kosta Harlan) [11:33:21] (03CR) 10Kosta Harlan: WIP: Codehealth pipeline NodeJS configuration (033 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/606253 (https://phabricator.wikimedia.org/T240989) (owner: 10Kosta Harlan) [11:51:09] (03CR) 10Awight: [C: 03+2] "Thanks for looking into my uninformed comments :-) This looks like an excellent next step!" [integration/quibble] - 10https://gerrit.wikimedia.org/r/604702 (https://phabricator.wikimedia.org/T235118) (owner: 10Hashar) [11:51:46] (03CR) 10Awight: [C: 03+2] "Neat!" [integration/quibble] - 10https://gerrit.wikimedia.org/r/606405 (owner: 10Hashar) [11:51:58] (03Merged) 10jenkins-bot: Define python deps in setup.cfg [integration/quibble] - 10https://gerrit.wikimedia.org/r/604702 (https://phabricator.wikimedia.org/T235118) (owner: 10Hashar) [11:52:40] (03Merged) 10jenkins-bot: doc: move build_sphinx -W to setup.cfg [integration/quibble] - 10https://gerrit.wikimedia.org/r/606405 (owner: 10Hashar) [11:55:24] 10Beta-Cluster-Infrastructure, 10MediaWiki-Export-or-Import, 10Patch-For-Review, 10Regression, 10User-DannyS712: Special:Import fails to load on beta cluster - https://phabricator.wikimedia.org/T255762 (10DannyS712) 05Open→03Resolved [12:00:18] (03PS3) 10MSantos: Add run.sh script with minimal setup for scanner [integration/config] - 10https://gerrit.wikimedia.org/r/606241 (https://phabricator.wikimedia.org/T240989) [12:00:52] (03CR) 10MSantos: Add run.sh script with minimal setup for scanner (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/606241 (https://phabricator.wikimedia.org/T240989) (owner: 10MSantos) [12:05:34] 10Phabricator, 10Quality-and-Test-Engineering-Team (QTE), 10User-zeljkofilipin: Error in pushing code to Gerrit for the phab-deployment repository - https://phabricator.wikimedia.org/T255761 (10zeljkofilipin) p:05Triage→03Medium [12:06:00] 10Phabricator, 10Quality-and-Test-Engineering-Team (QTE), 10User-zeljkofilipin: Error in pushing code to Gerrit for the phab-deployment repository - https://phabricator.wikimedia.org/T255761 (10zeljkofilipin) a:03zeljkofilipin [12:07:27] 10Beta-Cluster-Infrastructure, 10MediaWiki-Export-or-Import, 10Regression, 10User-DannyS712: Special:Import fails to load on beta cluster - https://phabricator.wikimedia.org/T255762 (10DannyS712) [12:08:27] 10Phabricator, 10User-DannyS712: Unable to set final story points for spike - https://phabricator.wikimedia.org/T255765 (10DannyS712) [12:13:55] (03CR) 10Kosta Harlan: [C: 03+1] Add run.sh script with minimal setup for scanner [integration/config] - 10https://gerrit.wikimedia.org/r/606241 (https://phabricator.wikimedia.org/T240989) (owner: 10MSantos) [12:21:53] (03PS6) 10Hashar: Integration job for Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/604785 (https://phabricator.wikimedia.org/T235118) [12:23:22] (03CR) 10Hashar: Integration job for Quibble (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/604785 (https://phabricator.wikimedia.org/T235118) (owner: 10Hashar) [12:41:51] 10Gerrit, 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Patch-For-Review, 10ci-test-error (WMF-deployed Build Failure): Jenkins job failing intermittently due to Gerrit HTTP 502 errors when interacting with repos - https://phabricator.wikimedia.org/T246763 (10Lucas_Werkmeister_WMDE) Also at... [13:10:23] 10Release-Engineering-Team (Pipeline), 10CX-cxserver, 10serviceops, 10Language-Team (Language-2020-Focus-Sprint): Migrate apertium to the deployment pipeline - https://phabricator.wikimedia.org/T255672 (10KartikMistry) [13:23:02] PROBLEM - Free space - all mounts on deployment-snapshot01 is CRITICAL: CRITICAL: deployment-prep.deployment-snapshot01.diskspace._data.byte_percentfree (No valid datapoints found)deployment-prep.deployment-snapshot01.diskspace.root.byte_percentfree (<10.00%) [13:33:03] RECOVERY - Free space - all mounts on deployment-snapshot01 is OK: OK: deployment-prep.deployment-snapshot01.diskspace._data.byte_percentfree (No valid datapoints found) [14:01:23] (03CR) 10Thcipriani: [C: 03+2] Use ExpandIncludesAndCopies in tests [blubber] - 10https://gerrit.wikimedia.org/r/602517 (owner: 10Jeena Huneidi) [14:02:13] 10Beta-Cluster-Infrastructure, 10Product-Infrastructure-Team-Backlog, 10Push-Notification-Service, 10MW-1.35-notes (1.35.0-wmf.38; 2020-06-23): [BETA] Two push notification request jobs are executed for a single event - https://phabricator.wikimedia.org/T255068 (10Mholloway) [14:04:40] (03Merged) 10jenkins-bot: Use ExpandIncludesAndCopies in tests [blubber] - 10https://gerrit.wikimedia.org/r/602517 (owner: 10Jeena Huneidi) [14:42:25] 10Beta-Cluster-Infrastructure: Updating Scap on beta cluster hosts with cumin fails - https://phabricator.wikimedia.org/T254786 (10Andrew) This looks like it's something interesting! The project contains two logstash hosts: deployment-logstash2 and deployment-logstash03; cumin is generalizing that to deployment... [14:45:55] 10Beta-Cluster-Infrastructure, 10SRE-tools, 10cloud-services-team (Kanban): cumin pattern-match fail with oddly named groups of hosts - https://phabricator.wikimedia.org/T255780 (10Andrew) [14:50:28] 10Beta-Cluster-Infrastructure, 10SRE-tools, 10cloud-services-team (Kanban): cumin pattern-match fail with oddly named groups of hosts - https://phabricator.wikimedia.org/T255780 (10Andrew) crap, it looks like this bug is in clustershell [14:52:59] 10Continuous-Integration-Config, 10Readers-Web-Backlog (Kanbanana-2019-20-Q4), 10Vue.js (Vue.js-Search): Install Jest for unit tests for Vue.js search - https://phabricator.wikimedia.org/T249301 (10Jdrewniak) 05Open→03Resolved There's just [[ https://github.com/wikimedia/wvui/pull/7/commits/58ad328614f13... [14:58:43] (03PS4) 10Jforrester: dockerfiles: [java8-sonar-scanner] Add a generic run.sh script [integration/config] - 10https://gerrit.wikimedia.org/r/606241 (https://phabricator.wikimedia.org/T240989) (owner: 10MSantos) [14:58:56] (03CR) 10Jforrester: [C: 03+2] "Let's give it a go." [integration/config] - 10https://gerrit.wikimedia.org/r/606241 (https://phabricator.wikimedia.org/T240989) (owner: 10MSantos) [15:00:51] (03Merged) 10jenkins-bot: dockerfiles: [java8-sonar-scanner] Add a generic run.sh script [integration/config] - 10https://gerrit.wikimedia.org/r/606241 (https://phabricator.wikimedia.org/T240989) (owner: 10MSantos) [15:17:13] 10Gerrit, 10DBA, 10Patch-For-Review: Make sure `reviewdb-test` database (used forgerrit upgrade testing) gets torn down - https://phabricator.wikimedia.org/T255715 (10Dzahn) Since we won't need a mysql/mariadb db anymore for Gerrit after the upgrade is complete, this ticket might as well be used to drop the... [15:20:01] 10Beta-Cluster-Infrastructure, 10SRE-tools, 10cloud-services-team (Kanban): cumin pattern-match fail with oddly named groups of hosts - https://phabricator.wikimedia.org/T255780 (10Andrew) This is upstream issue https://github.com/cea-hpc/clustershell/issues/293 It was first reported several years ago; the... [15:20:08] 10Beta-Cluster-Infrastructure: Updating Scap on beta cluster hosts with cumin fails - https://phabricator.wikimedia.org/T254786 (10Andrew) [15:20:10] 10Beta-Cluster-Infrastructure, 10SRE-tools, 10cloud-services-team (Kanban): cumin pattern-match fail with oddly named groups of hosts - https://phabricator.wikimedia.org/T255780 (10Andrew) 05Open→03Stalled [15:21:24] 10Beta-Cluster-Infrastructure: Updating Scap on beta cluster hosts with cumin fails - https://phabricator.wikimedia.org/T254786 (10Andrew) The short story here is: clustershell (and, hence, cumin) can't cope with different levels of zero-padding in hostnames. No short-term fix is coming for this, so I suggest r... [15:22:00] PROBLEM - Parsoid on deployment-parsoid11 is CRITICAL: connect to address 172.16.1.115 and port 8000: Connection refused [15:29:39] 10Beta-Cluster-Infrastructure, 10Product-Infrastructure-Team-Backlog, 10Push-Notification-Service, 10MW-1.35-notes (1.35.0-wmf.38; 2020-06-23): [BETA] Two push notification request jobs are executed for a single event - https://phabricator.wikimedia.org/T255068 (10Mholloway) I've updated the description wi... [15:34:56] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.35.0-wmf.37 deployment blockers - https://phabricator.wikimedia.org/T254174 (10LarsWirzenius) 05Open→03Resolved Things still haven't blown up, I'm declaring train done for... [15:40:13] 10Gerrit, 10DBA, 10Patch-For-Review: Make sure `reviewdb-test` database (used forgerrit upgrade testing) gets torn down - https://phabricator.wikimedia.org/T255715 (10jcrespo) It is all ok, let's rename the task to state so and wait for the upgrade + some time to act on it. [15:40:47] 10Gerrit, 10DBA, 10Patch-For-Review: Make sure `reviewdb-test` database (used forgerrit upgrade testing) gets torn down - https://phabricator.wikimedia.org/T255715 (10jcrespo) 05Open→03Stalled [15:49:12] 10Beta-Cluster-Infrastructure, 10Product-Infrastructure-Team-Backlog, 10Push-Notification-Service, 10MW-1.35-notes (1.35.0-wmf.38; 2020-06-23): [BETA] Two push notification request jobs are executed for a single event - https://phabricator.wikimedia.org/T255068 (10Pchelolo) This is an artifact of the trans... [15:59:30] (03Abandoned) 10Hashar: Don't force removing parent directories [integration/quibble] - 10https://gerrit.wikimedia.org/r/594800 (https://phabricator.wikimedia.org/T211702) (owner: 10Awight) [16:00:50] (03CR) 10Kosta Harlan: "James, before I go much further on this could you please let me know if I'm going about it all wrong since mediawiki/services/push-notific" [integration/config] - 10https://gerrit.wikimedia.org/r/606253 (https://phabricator.wikimedia.org/T240989) (owner: 10Kosta Harlan) [16:02:33] (03PS7) 10Hashar: Integration job for Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/604785 (https://phabricator.wikimedia.org/T235118) [16:02:51] (03PS3) 10Kosta Harlan: Codehealth pipeline NodeJS configuration [integration/config] - 10https://gerrit.wikimedia.org/r/606253 (https://phabricator.wikimedia.org/T240989) [16:02:53] (03CR) 10Kosta Harlan: Codehealth pipeline NodeJS configuration (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/606253 (https://phabricator.wikimedia.org/T240989) (owner: 10Kosta Harlan) [16:05:10] (03CR) 10Kosta Harlan: Codehealth pipeline NodeJS configuration (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/606253 (https://phabricator.wikimedia.org/T240989) (owner: 10Kosta Harlan) [16:05:46] (03PS8) 10Hashar: Integration job for Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/604785 (https://phabricator.wikimedia.org/T235118) [16:06:08] (03CR) 10Hashar: [C: 03+2] "Dropped the Depends-On and added it to Zuul layout ;)" [integration/config] - 10https://gerrit.wikimedia.org/r/604785 (https://phabricator.wikimedia.org/T235118) (owner: 10Hashar) [16:07:14] (03Merged) 10jenkins-bot: Integration job for Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/604785 (https://phabricator.wikimedia.org/T235118) (owner: 10Hashar) [16:07:48] (03CR) 10Hashar: "recheck" [integration/quibble] - 10https://gerrit.wikimedia.org/r/605939 (https://phabricator.wikimedia.org/T235118) (owner: 10Hashar) [16:30:22] 10Continuous-Integration-Infrastructure (phase-out-jessie), 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10Operations, 10Patch-For-Review: Migrate contint* hosts to Buster - https://phabricator.wikimedia.org/T224591 (10Dzahn) >>! In T224591#6235038, @MoritzMuehlenh... [16:33:05] fun thing [16:33:12] we run bunch of PHPUnit tests twice ;) [16:34:30] gotta make sure they're not flaky [16:37:31] (03CR) 10Privacybatm: "> Patch Set 3:" [integration/config] - 10https://gerrit.wikimedia.org/r/598492 (https://phabricator.wikimedia.org/T253219) (owner: 10Jcrespo) [16:37:53] 10Continuous-Integration-Infrastructure (phase-out-jessie), 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10Operations, 10Patch-For-Review: Migrate contint* hosts to Buster - https://phabricator.wikimedia.org/T224591 (10Dzahn) I just noticed the permissions of files... [16:44:32] !log Docker: Publishing java8-sonar-scanner:0.6.1 for T240989 [16:46:48] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:46:48] T240989: Enable codehealth pipeline for node services - https://phabricator.wikimedia.org/T240989 [16:48:31] 10Phabricator, 10Discourse, 10MediaWiki-extension-requests: Support diagrams on Phabricator and mediawiki.org - https://phabricator.wikimedia.org/T183689 (10apaskulin) It would be great to having a diagram generation tool on mediawiki.org. Of the three extensions listed, the Mermaid extension is the only one... [16:51:15] (03PS1) 10Jforrester: jjb: Upgrade sonar-scanner image to latest [integration/config] - 10https://gerrit.wikimedia.org/r/606471 [16:51:17] (03PS1) 10Jforrester: jjb: Provide node-codehealth-patch job [integration/config] - 10https://gerrit.wikimedia.org/r/606472 (https://phabricator.wikimedia.org/T251441) [16:51:59] 10Beta-Cluster-Infrastructure, 10Product-Infrastructure-Team-Backlog, 10Push-Notification-Service, 10MW-1.35-notes (1.35.0-wmf.38; 2020-06-23): [BETA] Two push notification request jobs are executed for a single event - https://phabricator.wikimedia.org/T255068 (10hnowlan) I've shut off the older instances... [16:56:22] !log disabled non-docker cpjobqueue instance in deployment-prep [16:56:30] PROBLEM - Host deployment-changeprop is DOWN: CRITICAL - Host Unreachable (172.16.5.21) [16:56:30] PROBLEM - Host deployment-cpjobqueue is DOWN: CRITICAL - Host Unreachable (172.16.4.124) [16:56:31] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:58:57] 10Project-Admins, 10Quality-and-Test-Engineering-Team (QTE), 10User-zeljkofilipin: Create personal Phabricator project tags for Soham and Vidhi-Mody - https://phabricator.wikimedia.org/T255647 (10Aklapper) 05Open→03Resolved a:03Aklapper Requested public projects #user-vidhi-mody and #user-soham have be... [16:59:01] 10Phabricator (Upstream), 10Upstream: Per-user projects for personal work in progress tracking - https://phabricator.wikimedia.org/T555 (10Aklapper) [17:26:56] (03CR) 10MSantos: Codehealth pipeline NodeJS configuration (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/606253 (https://phabricator.wikimedia.org/T240989) (owner: 10Kosta Harlan) [17:29:08] (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/606471 (owner: 10Jforrester) [17:30:01] (03Abandoned) 10Jforrester: jjb: Provide node-codehealth-patch job [integration/config] - 10https://gerrit.wikimedia.org/r/606472 (https://phabricator.wikimedia.org/T251441) (owner: 10Jforrester) [17:30:10] (03Merged) 10jenkins-bot: jjb: Upgrade sonar-scanner image to latest [integration/config] - 10https://gerrit.wikimedia.org/r/606471 (owner: 10Jforrester) [17:33:26] (03PS4) 10Jforrester: jjb: Codehealth pipeline NodeJS configuration [integration/config] - 10https://gerrit.wikimedia.org/r/606253 (https://phabricator.wikimedia.org/T240989) (owner: 10Kosta Harlan) [17:34:05] (03CR) 10Jforrester: [C: 03+2] "jjb part deployed; let's land this and see if it works." [integration/config] - 10https://gerrit.wikimedia.org/r/606253 (https://phabricator.wikimedia.org/T240989) (owner: 10Kosta Harlan) [17:35:01] (03Merged) 10jenkins-bot: jjb: Codehealth pipeline NodeJS configuration [integration/config] - 10https://gerrit.wikimedia.org/r/606253 (https://phabricator.wikimedia.org/T240989) (owner: 10Kosta Harlan) [17:36:40] !log Zuul: [mediawiki/services/push-notifications] Enable new node codehealth job T240989 T251441 [18:00:05] 10Project-Admins, 10Math, 10PM: Organize the open tasks for Project Math - https://phabricator.wikimedia.org/T239359 (10Physikerwelt) > I guess "labels" = "project tags"? That means to create #Math-Chemistry and #Math-Macro-Proposals or something like that? In any case, we will need project descriptions for... [18:28:04] !log integration-castor03: remove labstore::traffic_shaping::egress: 100mbps in horizon. It is now applied project wide via puppet.git # T232644 T255371 [18:28:07] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:28:07] T232644: Check bandwidth limitation on integration-castor03.integration.eqiad.wmflabs / cloudvirt1002 - https://phabricator.wikimedia.org/T232644 [18:28:08] T255371: publish-to-doc job is close to its timeout, with some builds lost - https://phabricator.wikimedia.org/T255371 [18:48:16] (03PS1) 10Hashar: Run Quibble fullrun job after tox [integration/config] - 10https://gerrit.wikimedia.org/r/606492 (https://phabricator.wikimedia.org/T235118) [18:49:30] (03CR) 10Hashar: "That gives us faster feedback when a linter fails for example." [integration/config] - 10https://gerrit.wikimedia.org/r/606492 (https://phabricator.wikimedia.org/T235118) (owner: 10Hashar) [18:52:01] (03CR) 10Hashar: [C: 03+1] Replace fabfile.py with a shell script (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/605434 (https://phabricator.wikimedia.org/T236689) (owner: 10Krinkle) [19:13:01] (03PS1) 10Kosta Harlan: jjb: Use run.sh entrypoint for NodeJS codehealth job [integration/config] - 10https://gerrit.wikimedia.org/r/606495 (https://phabricator.wikimedia.org/T240989) [19:31:42] (03PS5) 10Hashar: Replace fabfile.py with a shell script [integration/config] - 10https://gerrit.wikimedia.org/r/605434 (https://phabricator.wikimedia.org/T236689) (owner: 10Krinkle) [19:32:55] (03CR) 10Hashar: [C: 03+1] Replace fabfile.py with a shell script (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/605434 (https://phabricator.wikimedia.org/T236689) (owner: 10Krinkle) [19:33:04] (03CR) 10Hashar: [C: 03+1] Replace fabfile.py with a shell script [integration/config] - 10https://gerrit.wikimedia.org/r/605434 (https://phabricator.wikimedia.org/T236689) (owner: 10Krinkle) [19:34:23] (03CR) 10Krinkle: [C: 03+1] "Thanks!" [integration/config] - 10https://gerrit.wikimedia.org/r/605434 (https://phabricator.wikimedia.org/T236689) (owner: 10Krinkle) [20:01:09] 10Beta-Cluster-Infrastructure, 10SRE-tools, 10cloud-services-team (Kanban): cumin pattern-match fail with oddly named groups of hosts - https://phabricator.wikimedia.org/T255780 (10Volans) [20:27:43] 10MediaWiki-Codesniffer, 10MediaWiki-General, 10I18n: Sort special page alises alphabetically - https://phabricator.wikimedia.org/T255826 (10Huji) p:05Triage→03Low a:03Huji [20:27:58] 10MediaWiki-Codesniffer, 10MediaWiki-General, 10I18n, 10User-Huji: Sort special page alises alphabetically - https://phabricator.wikimedia.org/T255826 (10Huji) [20:40:19] (03CR) 10Hashar: [C: 03+1] "All good to me. Will let James do the final go to let him test it even more ;] Thank you Timo!" [integration/config] - 10https://gerrit.wikimedia.org/r/605434 (https://phabricator.wikimedia.org/T236689) (owner: 10Krinkle) [21:14:02] PROBLEM - Free space - all mounts on deployment-snapshot01 is CRITICAL: CRITICAL: deployment-prep.deployment-snapshot01.diskspace._data.byte_percentfree (No valid datapoints found)deployment-prep.deployment-snapshot01.diskspace.root.byte_percentfree (<10.00%) [21:19:56] (03PS2) 10Jforrester: jjb: [nodejs-codehealth-*] Use run.sh entrypoint [integration/config] - 10https://gerrit.wikimedia.org/r/606495 (https://phabricator.wikimedia.org/T240989) (owner: 10Kosta Harlan) [21:23:00] (03CR) 10Jforrester: "Deployed, but this still isn't triggering the run?" [integration/config] - 10https://gerrit.wikimedia.org/r/606495 (https://phabricator.wikimedia.org/T240989) (owner: 10Kosta Harlan) [21:24:00] RECOVERY - Free space - all mounts on deployment-snapshot01 is OK: OK: deployment-prep.deployment-snapshot01.diskspace._data.byte_percentfree (No valid datapoints found) [22:24:16] 10Phabricator, 10Release-Engineering-Team-TODO, 10Developer Productivity: Enhance phabricator project progress reporting - https://phabricator.wikimedia.org/T255703 (10mmodell) These are some metrics that @Naike mentioned to me: * Created versus resolved tickets * Ticket assignees per workboard *... [22:37:34] 10Release-Engineering-Team (Pipeline), 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Release Pipeline: Make pipelinelib able to update deployment chart image tags - https://phabricator.wikimedia.org/T255835 (10jeena) [22:38:44] 10Release-Engineering-Team (Pipeline), 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Release Pipeline: Make pipelinelib able to update deployment chart image tags - https://phabricator.wikimedia.org/T255835 (10jeena) [22:40:22] 10Phabricator, 10Release-Engineering-Team-TODO, 10Developer Productivity: Enhance phabricator project progress reporting - https://phabricator.wikimedia.org/T255703 (10Dzahn) Some of these (f.e. definitely 'created vs resolved') already exist in https://wikimedia.biterg.io Others might exist or can be add... [22:43:24] 10Phabricator, 10Release-Engineering-Team-TODO, 10Developer Productivity: Enhance phabricator project progress reporting - https://phabricator.wikimedia.org/T255703 (10Dzahn) {F31870847}