[00:20:06] Project beta-update-databases-eqiad build #30031: 04STILL FAILING in 6.3 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30031/ [00:20:06] Project beta-update-databases-eqiad build #30031: 04STILL FAILING in 6.3 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30031/ [00:20:22] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [10.0] [00:20:22] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [10.0] [00:25:22] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [00:25:22] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [00:58:49] 10Project-Admins, 10Epic: Replace all "tracking" tasks with tags/projects (if unbounded), relabel them to outcome tasks (if bounded), or kill them entirely (if pointless) - https://phabricator.wikimedia.org/T192655 (10Aklapper) [00:58:49] 10Project-Admins, 10Epic: Replace all "tracking" tasks with tags/projects (if unbounded), relabel them to outcome tasks (if bounded), or kill them entirely (if pointless) - https://phabricator.wikimedia.org/T192655 (10Aklapper) [00:58:51] 10Project-Admins: replace schema change tracking task T51188 by project #blocked-on-schema-change - https://phabricator.wikimedia.org/T97412 (10Aklapper) 05stalled>03Resolved [00:58:51] 10Project-Admins: replace schema change tracking task T51188 by project #blocked-on-schema-change - https://phabricator.wikimedia.org/T97412 (10Aklapper) 05stalled>03Resolved [00:58:53] 10Project-Admins: replace schema change tracking task T51188 by project #blocked-on-schema-change - https://phabricator.wikimedia.org/T97412 (10Aklapper) Indeed, #blocked-on-schema-change has superseded this. Thanks for catching! [00:58:53] 10Project-Admins: replace schema change tracking task T51188 by project #blocked-on-schema-change - https://phabricator.wikimedia.org/T97412 (10Aklapper) Indeed, #blocked-on-schema-change has superseded this. Thanks for catching! [01:20:01] Project beta-update-databases-eqiad build #30032: 04STILL FAILING in 1.5 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30032/ [01:20:01] Project beta-update-databases-eqiad build #30032: 04STILL FAILING in 1.5 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30032/ [02:20:06] Project beta-update-databases-eqiad build #30033: 04STILL FAILING in 6.3 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30033/ [02:20:06] Project beta-update-databases-eqiad build #30033: 04STILL FAILING in 6.3 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30033/ [02:24:39] Krenair: ^^ [02:24:39] Krenair: ^^ [02:24:52] Reedy: Looks like one of your changes ^^? [02:24:52] Reedy: Looks like one of your changes ^^? [02:25:07] (Re the wikimedia passwords class that was added) [02:25:07] (Re the wikimedia passwords class that was added) [02:34:09] looking [02:34:09] looking [02:34:20] Thanks legoktm [02:34:20] Thanks legoktm [02:34:39] that means for whatever reason, mw/vendor wasn't pulled [02:34:39] that means for whatever reason, mw/vendor wasn't pulled [02:34:46] orr [02:34:46] orr [02:34:47] wait [02:34:47] wait [02:35:18] * paladox off to bed [02:35:19] ACTION off to bed [02:37:09] patch submitted [02:37:09] patch submitted [02:37:28] [18:37:19] (PS1) Legoktm: Install wikimedia/password-blacklist 0.1.3 (fix-up) [core] - https://gerrit.wikimedia.org/r/475682 [02:37:28] [18:37:19] (PS1) Legoktm: Install wikimedia/password-blacklist 0.1.3 (fix-up) [core] - https://gerrit.wikimedia.org/r/475682 [03:20:02] Project beta-update-databases-eqiad build #30034: 04STILL FAILING in 2.5 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30034/ [03:20:02] Project beta-update-databases-eqiad build #30034: 04STILL FAILING in 2.5 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30034/ [04:20:06] Project beta-update-databases-eqiad build #30035: 04STILL FAILING in 6 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30035/ [04:20:06] Project beta-update-databases-eqiad build #30035: 04STILL FAILING in 6 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30035/ [05:20:11] Project beta-update-databases-eqiad build #30036: 04STILL FAILING in 10 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30036/ [05:20:11] Project beta-update-databases-eqiad build #30036: 04STILL FAILING in 10 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30036/ [06:29:19] Project beta-update-databases-eqiad build #30037: 04STILL FAILING in 1.5 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30037/ [06:29:19] Project beta-update-databases-eqiad build #30037: 04STILL FAILING in 1.5 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30037/ [07:20:06] Project beta-update-databases-eqiad build #30038: 04STILL FAILING in 6 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30038/ [07:20:06] Project beta-update-databases-eqiad build #30038: 04STILL FAILING in 6 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30038/ [07:57:38] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Kanban), 10Cloud-Services, 10Epic, 10Patch-For-Review: Migrate deployment-prep to eqiad1 - https://phabricator.wikimedia.org/T208101 (10fgiunchedi) >>! In T208101#4770736, @Krenair wrote: > @fgiunchedi: Why is puppet disabled on deployment-mediaw... [07:57:38] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Kanban), 10Cloud-Services, 10Epic, 10Patch-For-Review: Migrate deployment-prep to eqiad1 - https://phabricator.wikimedia.org/T208101 (10fgiunchedi) >>! In T208101#4770736, @Krenair wrote: > @fgiunchedi: Why is puppet disabled on deployment-mediaw... [08:20:02] Project beta-update-databases-eqiad build #30039: 04STILL FAILING in 1.7 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30039/ [08:20:02] Project beta-update-databases-eqiad build #30039: 04STILL FAILING in 1.7 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30039/ [09:20:06] Project beta-update-databases-eqiad build #30040: 04STILL FAILING in 5.9 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30040/ [09:20:06] Project beta-update-databases-eqiad build #30040: 04STILL FAILING in 5.9 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30040/ [10:10:44] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Kanban), 10Cloud-Services, 10Epic, 10Patch-For-Review: Migrate deployment-prep to eqiad1 - https://phabricator.wikimedia.org/T208101 (10Krenair) Thanks @fgiunchedi [10:10:44] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Kanban), 10Cloud-Services, 10Epic, 10Patch-For-Review: Migrate deployment-prep to eqiad1 - https://phabricator.wikimedia.org/T208101 (10Krenair) Thanks @fgiunchedi [10:20:02] Project beta-update-databases-eqiad build #30041: 04STILL FAILING in 1.4 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30041/ [10:20:02] Project beta-update-databases-eqiad build #30041: 04STILL FAILING in 1.4 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30041/ [10:56:15] 10Release-Engineering-Team, 10Language-strategy, 10MediaWiki-extensions-WikimediaIncubator, 10incubator.wikimedia.org, and 2 others: Make creating a new Language project easier - https://phabricator.wikimedia.org/T165585 (10Hydriz) I have looked through all the comments, but I still don't see any actions r... [10:56:15] 10Release-Engineering-Team, 10Language-strategy, 10MediaWiki-extensions-WikimediaIncubator, 10incubator.wikimedia.org, and 2 others: Make creating a new Language project easier - https://phabricator.wikimedia.org/T165585 (10Hydriz) I have looked through all the comments, but I still don't see any actions r... [11:11:53] 10Release-Engineering-Team, 10Language-strategy, 10MediaWiki-extensions-WikimediaIncubator, 10incubator.wikimedia.org, and 2 others: Make creating a new Language project easier - https://phabricator.wikimedia.org/T165585 (10Amire80) Soon, when we start the technical architecture work. (I'm not totally sure... [11:11:53] 10Release-Engineering-Team, 10Language-strategy, 10MediaWiki-extensions-WikimediaIncubator, 10incubator.wikimedia.org, and 2 others: Make creating a new Language project easier - https://phabricator.wikimedia.org/T165585 (10Amire80) Soon, when we start the technical architecture work. (I'm not totally sure... [11:19:39] 10Release-Engineering-Team, 10Language-strategy, 10incubator.wikimedia.org, 10Epic, 10I18n: Make creating a new Language project easier - https://phabricator.wikimedia.org/T165585 (10Hydriz) Per last comment, re-add the tag when the technical architecture has actually started. [11:19:40] 10Release-Engineering-Team, 10Language-strategy, 10incubator.wikimedia.org, 10Epic, 10I18n: Make creating a new Language project easier - https://phabricator.wikimedia.org/T165585 (10Hydriz) Per last comment, re-add the tag when the technical architecture has actually started. [11:20:06] Project beta-update-databases-eqiad build #30042: 04STILL FAILING in 6.1 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30042/ [11:20:07] Project beta-update-databases-eqiad build #30042: 04STILL FAILING in 6.1 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30042/ [12:09:03] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Release-Engineering-Team (Kanban), 10Zuul: Deploy Zuul 2.5.1-wmf5 - https://phabricator.wikimedia.org/T208426 (10akosiaris) Should we also merge https://gerrit.wikimedia.org/r/#/c/integration/zuul/+/465324/ and release 2.5.1-wmf6 ? I 'll upload it to apt... [12:09:03] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Release-Engineering-Team (Kanban), 10Zuul: Deploy Zuul 2.5.1-wmf5 - https://phabricator.wikimedia.org/T208426 (10akosiaris) Should we also merge https://gerrit.wikimedia.org/r/#/c/integration/zuul/+/465324/ and release 2.5.1-wmf6 ? I 'll upload it to apt... [12:20:02] Project beta-update-databases-eqiad build #30043: 04STILL FAILING in 2 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30043/ [12:20:02] Project beta-update-databases-eqiad build #30043: 04STILL FAILING in 2 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30043/ [12:45:29] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Find top 15 target projects that could use Selenium tests to prevent incidents - https://phabricator.wikimedia.org/T199133 (10zeljkofilipin) >>! In T199133#4766085, @Ladsgroup wrote: > So there are three different things called ORES here: > - ORES ser... [12:45:29] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Find top 15 target projects that could use Selenium tests to prevent incidents - https://phabricator.wikimedia.org/T199133 (10zeljkofilipin) >>! In T199133#4766085, @Ladsgroup wrote: > So there are three different things called ORES here: > - ORES ser... [13:20:07] Project beta-update-databases-eqiad build #30044: 04STILL FAILING in 6.5 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30044/ [13:20:07] Project beta-update-databases-eqiad build #30044: 04STILL FAILING in 6.5 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30044/ [13:29:30] 10Beta-Cluster-Infrastructure: Unable to create account due to IP restriction - https://phabricator.wikimedia.org/T210296 (10Krenair) 05Open>03Resolved a:03Krenair works now [13:29:30] 10Beta-Cluster-Infrastructure: Unable to create account due to IP restriction - https://phabricator.wikimedia.org/T210296 (10Krenair) 05Open>03Resolved a:03Krenair works now [13:35:08] 10Release-Engineering-Team (Kanban), 10Code-Health-Metrics, 10Patch-For-Review, 10User-zeljkofilipin: Code health metrics spike - https://phabricator.wikimedia.org/T207046 (10zeljkofilipin) [13:35:08] 10Release-Engineering-Team (Kanban), 10Code-Health-Metrics, 10Patch-For-Review, 10User-zeljkofilipin: Code health metrics spike - https://phabricator.wikimedia.org/T207046 (10zeljkofilipin) [13:36:11] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Find top 15 target projects that could use Selenium tests to prevent incidents - https://phabricator.wikimedia.org/T199133 (10Ladsgroup) >>! In T199133#4773545, @zeljkofilipin wrote: > The only mention of ORES at Developers/Maintainers page is about th... [13:36:11] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Find top 15 target projects that could use Selenium tests to prevent incidents - https://phabricator.wikimedia.org/T199133 (10Ladsgroup) >>! In T199133#4773545, @zeljkofilipin wrote: > The only mention of ORES at Developers/Maintainers page is about th... [13:39:17] 10Release-Engineering-Team (Kanban), 10Code-Health-Metrics, 10Patch-For-Review, 10User-zeljkofilipin: Code health metrics spike - https://phabricator.wikimedia.org/T207046 (10zeljkofilipin) [13:39:17] 10Release-Engineering-Team (Kanban), 10Code-Health-Metrics, 10Patch-For-Review, 10User-zeljkofilipin: Code health metrics spike - https://phabricator.wikimedia.org/T207046 (10zeljkofilipin) [13:42:15] 10Release-Engineering-Team (Kanban), 10Code-Health-Metrics, 10Patch-For-Review, 10User-zeljkofilipin: Code health metrics spike - https://phabricator.wikimedia.org/T207046 (10zeljkofilipin) [13:42:15] 10Release-Engineering-Team (Kanban), 10Code-Health-Metrics, 10Patch-For-Review, 10User-zeljkofilipin: Code health metrics spike - https://phabricator.wikimedia.org/T207046 (10zeljkofilipin) [13:44:12] 10Release-Engineering-Team (Kanban), 10Code-Health-Metrics, 10Patch-For-Review, 10User-zeljkofilipin: Code health metrics spike - https://phabricator.wikimedia.org/T207046 (10zeljkofilipin) [13:44:12] 10Release-Engineering-Team (Kanban), 10Code-Health-Metrics, 10Patch-For-Review, 10User-zeljkofilipin: Code health metrics spike - https://phabricator.wikimedia.org/T207046 (10zeljkofilipin) [13:45:43] 10Continuous-Integration-Infrastructure (Slipway), 10Wikidata, 10Wikidata Query UI, 10Wikimedia-Portals: Migrate wikidata-query-gui-build and wikimedia-portals-build to Docker containers - https://phabricator.wikimedia.org/T210286 (10hashar) That sounds great and awesome :-] I will look at wikimedia/porta... [13:45:43] 10Continuous-Integration-Infrastructure (Slipway), 10Wikidata, 10Wikidata Query UI, 10Wikimedia-Portals: Migrate wikidata-query-gui-build and wikimedia-portals-build to Docker containers - https://phabricator.wikimedia.org/T210286 (10hashar) That sounds great and awesome :-] I will look at wikimedia/porta... [13:57:16] 10RelEng-Archive-FY201718-Q1, 10Growth-Team, 10StructuredDiscussions: Flow reply_moderation browser test has erroneous selector for "3rd comment on the topic" - https://phabricator.wikimedia.org/T85201 (10Liuxinyu970226) [13:57:16] 10RelEng-Archive-FY201718-Q1, 10Growth-Team, 10StructuredDiscussions: Flow reply_moderation browser test has erroneous selector for "3rd comment on the topic" - https://phabricator.wikimedia.org/T85201 (10Liuxinyu970226) [13:57:18] 10Release-Engineering-Team (Kanban), 10Code-Health-Metrics, 10Patch-For-Review, 10User-zeljkofilipin: Code health metrics spike - https://phabricator.wikimedia.org/T207046 (10zeljkofilipin) I've found a couple of bots so far, Reviewer-bot and jenkins-bot, see [[ https://gerrit.wikimedia.org/r/c/integration... [13:57:18] 10Release-Engineering-Team (Kanban), 10Code-Health-Metrics, 10Patch-For-Review, 10User-zeljkofilipin: Code health metrics spike - https://phabricator.wikimedia.org/T207046 (10zeljkofilipin) I've found a couple of bots so far, Reviewer-bot and jenkins-bot, see [[ https://gerrit.wikimedia.org/r/c/integration... [14:10:42] 10Release-Engineering-Team (Kanban), 10LDAP-Access-Requests: LDAP requests for Jeena Huneidi - https://phabricator.wikimedia.org/T210028 (10jcrespo) The reasoning to wait is that it simplifies its addition, not to add the account as an LDAP-only account later to change into a production access one. [14:10:42] 10Release-Engineering-Team (Kanban), 10LDAP-Access-Requests: LDAP requests for Jeena Huneidi - https://phabricator.wikimedia.org/T210028 (10jcrespo) The reasoning to wait is that it simplifies its addition, not to add the account as an LDAP-only account later to change into a production access one. [14:16:22] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [10.0] [14:16:22] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [10.0] [14:20:02] Project beta-update-databases-eqiad build #30045: 04STILL FAILING in 1.4 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30045/ [14:20:02] Project beta-update-databases-eqiad build #30045: 04STILL FAILING in 1.4 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30045/ [14:24:32] 10Release-Engineering-Team (Kanban), 10Code-Health-Metrics, 10Patch-For-Review, 10User-zeljkofilipin: Code health metrics spike - https://phabricator.wikimedia.org/T207046 (10zeljkofilipin) There is also [[ https://www.mediawiki.org/wiki/Selenium/Ruby/Cindy_The_Browser_Test_Bot | Cindy The Browser Test Bot... [14:24:32] 10Release-Engineering-Team (Kanban), 10Code-Health-Metrics, 10Patch-For-Review, 10User-zeljkofilipin: Code health metrics spike - https://phabricator.wikimedia.org/T207046 (10zeljkofilipin) There is also [[ https://www.mediawiki.org/wiki/Selenium/Ruby/Cindy_The_Browser_Test_Bot | Cindy The Browser Test Bot... [14:26:23] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [14:26:23] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [14:32:47] hashar: `docker pull docker-registry.wikimedia.org/releng/java8` works fine, but when I run `docker-pkg --debug ~/src/integration/config/dockerfiles/java8-sonar-scanner -c ~/src/integration/config/dockerfiles/config.yaml` I get `ERROR - Unexpected error building image docker-registry.wikimedia.org/releng/java8-sonar-scanner:0.1.0: Image docker-registry.wikimedia.org/releng/java8 not found (image.py:231)`, any ideas? [14:32:47] hashar: `docker pull docker-registry.wikimedia.org/releng/java8` works fine, but when I run `docker-pkg --debug ~/src/integration/config/dockerfiles/java8-sonar-scanner -c ~/src/integration/config/dockerfiles/config.yaml` I get `ERROR - Unexpected error building image docker-registry.wikimedia.org/releng/java8-sonar-scanner:0.1.0: Image docker-registry.wikimedia.org/releng/java8 not found (image.py:231)`, any ideas? [14:33:12] the Dockerfile template is here https://gerrit.wikimedia.org/r/c/integration/config/+/475496 [14:33:12] the Dockerfile template is here https://gerrit.wikimedia.org/r/c/integration/config/+/475496 [14:34:34] (03CR) 10Kosta Harlan: Add configuration for running PHP code analysis on SonarQube (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) (owner: 10Kosta Harlan) [14:34:34] (03CR) 10Kosta Harlan: Add configuration for running PHP code analysis on SonarQube (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) (owner: 10Kosta Harlan) [15:10:31] kostajh: no idea :/ Without the docker build output it is hard to debug :/ [15:10:31] kostajh: no idea :/ Without the docker build output it is hard to debug :/ [15:10:54] kostajh: but with --debug you should see the generated Dockerfile (it might be written to disk as well) [15:10:54] kostajh: but with --debug you should see the generated Dockerfile (it might be written to disk as well) [15:11:09] hashar: I think that's the output, I used `--debug` [15:11:09] hashar: I think that's the output, I used `--debug` [15:11:14] so I then copy paste that to the integration/config dockerfiles/java8-sonar-scanner/ directory, then invoke docker build directly [15:11:14] so I then copy paste that to the integration/config dockerfiles/java8-sonar-scanner/ directory, then invoke docker build directly [15:11:17] and get the output [15:11:17] and get the output [15:11:27] ok let me try [15:11:27] ok let me try [15:13:13] I am writing a patch for docker(pkg to have it log the build output to stdout/logfile [15:13:13] I am writing a patch for docker(pkg to have it log the build output to stdout/logfile [15:14:16] https://www.irccloud.com/pastebin/YzfEmJsP/ [15:14:16] https://www.irccloud.com/pastebin/YzfEmJsP/ [15:14:20] hashar ^ [15:14:20] hashar ^ [15:14:35] where would the generated dockerfile be? [15:14:35] where would the generated dockerfile be? [15:14:45] 2018-11-26 10:11:38,963 [docker-pkg-build] ERROR - Unexpected error building image docker-registry.wikimedia.org/releng/java8-sonar-scanner:0.1.0: Image docker-registry.wikimedia.org/releng/java8 not found (image.py:231) [15:14:45] 2018-11-26 10:11:38,963 [docker-pkg-build] ERROR - Unexpected error building image docker-registry.wikimedia.org/releng/java8-sonar-scanner:0.1.0: Image docker-registry.wikimedia.org/releng/java8 not found (image.py:231) [15:15:23] yeah, that's what I don't understand. Why is `releng/java8` not found? especially since `docker pull docker-registry.wikimedia.org/releng/java8` works? [15:15:23] yeah, that's what I don't understand. Why is `releng/java8` not found? especially since `docker pull docker-registry.wikimedia.org/releng/java8` works? [15:15:47] which is because you pass to docker-pkg the directory ~/src/integration/config/dockerfiles/java8-sonar-scanner [15:15:47] which is because you pass to docker-pkg the directory ~/src/integration/config/dockerfiles/java8-sonar-scanner [15:15:53] it thus scan solely that directory [15:15:53] it thus scan solely that directory [15:15:59] and there is thus no java8 image to be found [15:15:59] and there is thus no java8 image to be found [15:16:02] ah [15:16:02] ah [15:16:30] instead you should pass ~/src/integration/config/dockerfiles and then select the image(s) to be build with a glob: --select=*java8-sonar-scanner* [15:16:30] instead you should pass ~/src/integration/config/dockerfiles and then select the image(s) to be build with a glob: --select=*java8-sonar-scanner* [15:16:38] got it [15:16:39] got it [15:16:56] eventually docker pull docker-registry.wikimedia.org/releng/java8:0.4.3 [15:16:56] eventually docker pull docker-registry.wikimedia.org/releng/java8:0.4.3 [15:17:04] so you locally get the same version as what is in the registry [15:17:04] so you locally get the same version as what is in the registry [15:17:19] (because docker-pkg does not automatically pull, it would just attempt to rebuild the image locally) [15:17:19] (because docker-pkg does not automatically pull, it would just attempt to rebuild the image locally) [15:17:30] turns out I had the exact same problem as you friday evening :) [15:17:30] turns out I had the exact same problem as you friday evening :) [15:19:09] hashar: awesome, things are happening now :) [15:19:09] hashar: awesome, things are happening now :) [15:20:11] Project beta-update-databases-eqiad build #30046: 04STILL FAILING in 10 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30046/ [15:20:11] Project beta-update-databases-eqiad build #30046: 04STILL FAILING in 10 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30046/ [15:30:35] 2018-11-26 16:29:13,118 [docker-pkg-build] INFO - docker-registry.wikimedia.org/releng/java8-sonar-scanner:0.1.0: E: List directory /var/lib/apt/lists/partial is missing. - Acquire (13: Permission denied) [15:30:35] 2018-11-26 16:29:13,118 [docker-pkg-build] INFO - docker-registry.wikimedia.org/releng/java8-sonar-scanner:0.1.0: E: List directory /var/lib/apt/lists/partial is missing. - Acquire (13: Permission denied) [15:30:35] :) [15:30:36] :) [15:30:46] I got a rough patch for docker-pkg hurrah [15:30:46] I got a rough patch for docker-pkg hurrah [15:31:29] (03PS3) 10Kosta Harlan: Fix Dockerfile.template for sonar-scanner [integration/config] - 10https://gerrit.wikimedia.org/r/475496 (https://phabricator.wikimedia.org/T209849) [15:31:29] (03PS3) 10Kosta Harlan: Fix Dockerfile.template for sonar-scanner [integration/config] - 10https://gerrit.wikimedia.org/r/475496 (https://phabricator.wikimedia.org/T209849) [15:31:46] (03CR) 10Kosta Harlan: "Ready for review" [integration/config] - 10https://gerrit.wikimedia.org/r/475496 (https://phabricator.wikimedia.org/T209849) (owner: 10Kosta Harlan) [15:31:46] (03CR) 10Kosta Harlan: "Ready for review" [integration/config] - 10https://gerrit.wikimedia.org/r/475496 (https://phabricator.wikimedia.org/T209849) (owner: 10Kosta Harlan) [15:33:06] hashar: I think this is ready now [15:33:06] hashar: I think this is ready now [15:35:23] hashar: I think that error is because `USER` was not set to `root` during the install step [15:35:23] hashar: I think that error is because `USER` was not set to `root` during the install step [15:37:38] kostajh: yeah. And make sure to set USER nobody after [15:37:38] kostajh: yeah. And make sure to set USER nobody after [15:37:46] else the command will end up running as root :) [15:37:46] else the command will end up running as root :) [15:37:57] hashar: yes that's done [15:37:57] hashar: yes that's done [15:38:32] I'm trying to test the built image from https://gerrit.wikimedia.org/r/c/integration/config/+/475496, but I get `/run.sh: line 10: ZUUL_URL: unbound variable` [15:38:32] I'm trying to test the built image from https://gerrit.wikimedia.org/r/c/integration/config/+/475496, but I get `/run.sh: line 10: ZUUL_URL: unbound variable` [15:38:50] but maybe I'm not running the image properly. `docker run --rm -it docker-registry.wikimedia.org/releng/java8-sonar-scanner:0.1.0 ~/src/mediawiki/extensions/GrowthExperiments` [15:38:50] but maybe I'm not running the image properly. `docker run --rm -it docker-registry.wikimedia.org/releng/java8-sonar-scanner:0.1.0 ~/src/mediawiki/extensions/GrowthExperiments` [15:42:50] kostajh: yeah the images are build with CI in mind [15:42:50] kostajh: yeah the images are build with CI in mind [15:43:07] in CI Zuul pass a bunch of parameters to point to the git repo having the patch [15:43:07] in CI Zuul pass a bunch of parameters to point to the git repo having the patch [15:43:22] You would need: ZUUL_URL ZUUL_PROJECT ZUUL_REF [15:43:22] You would need: ZUUL_URL ZUUL_PROJECT ZUUL_REF [15:43:23] eg: [15:43:23] eg: [15:43:45] ZUUL_URL=https://gerrit.wikimedia.org/r/p ZUUL_PROJECT=mediawiki/extensions/GrowthExperiments ZUUL_REF=master [15:43:45] ZUUL_URL=https://gerrit.wikimedia.org/r/p ZUUL_PROJECT=mediawiki/extensions/GrowthExperiments ZUUL_REF=master [15:44:25] (for a change pending in Gerrit, for example 12345,99 you can use: ZUUL_REF=refs/changes/45/12345/99 [15:44:25] (for a change pending in Gerrit, for example 12345,99 you can use: ZUUL_REF=refs/changes/45/12345/99 [15:44:46] some of dockerfiles/ subdirectories have example-run.sh files that set those ZUUL_* env variable [15:44:46] some of dockerfiles/ subdirectories have example-run.sh files that set those ZUUL_* env variable [15:45:12] hashar: got it, thanks [15:45:12] hashar: got it, thanks [15:51:01] (03CR) 10Kosta Harlan: [C: 04-1] "I need to fix the override of the upstream image entrypoint." [integration/config] - 10https://gerrit.wikimedia.org/r/475496 (https://phabricator.wikimedia.org/T209849) (owner: 10Kosta Harlan) [15:51:01] (03CR) 10Kosta Harlan: [C: 04-1] "I need to fix the override of the upstream image entrypoint." [integration/config] - 10https://gerrit.wikimedia.org/r/475496 (https://phabricator.wikimedia.org/T209849) (owner: 10Kosta Harlan) [15:55:52] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: 5 of the 15 prioritized repositories have at least 1 end-to-end test - https://phabricator.wikimedia.org/T206621 (10zeljkofilipin) a:03zeljkofilipin [15:55:53] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: 5 of the 15 prioritized repositories have at least 1 end-to-end test - https://phabricator.wikimedia.org/T206621 (10zeljkofilipin) a:03zeljkofilipin [16:02:08] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Learn Docker basics - https://phabricator.wikimedia.org/T210412 (10zeljkofilipin) [16:02:08] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Learn Docker basics - https://phabricator.wikimedia.org/T210412 (10zeljkofilipin) [16:04:09] (03PS4) 10Kosta Harlan: Fix Dockerfile.template for sonar-scanner [integration/config] - 10https://gerrit.wikimedia.org/r/475496 (https://phabricator.wikimedia.org/T209849) [16:04:09] (03PS4) 10Kosta Harlan: Fix Dockerfile.template for sonar-scanner [integration/config] - 10https://gerrit.wikimedia.org/r/475496 (https://phabricator.wikimedia.org/T209849) [16:04:49] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Learn Docker basics - https://phabricator.wikimedia.org/T210412 (10zeljkofilipin) p:05Triage>03Normal [16:04:49] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Learn Docker basics - https://phabricator.wikimedia.org/T210412 (10zeljkofilipin) p:05Triage>03Normal [16:05:00] ok, I think I finally got it hashar, gehel :) [16:05:00] ok, I think I finally got it hashar, gehel :) [16:05:35] Docker didn't seem to like having an environment variable in the entrypoint. [16:05:35] Docker didn't seem to like having an environment variable in the entrypoint. [16:06:01] kostajh: https://gerrit.wikimedia.org/r/#/c/operations/docker-images/docker-pkg/+/475779 Log docker build output [16:06:01] kostajh: https://gerrit.wikimedia.org/r/#/c/operations/docker-images/docker-pkg/+/475779 Log docker build output [16:06:02] finally [16:06:02] finally [16:06:15] (03CR) 10Kosta Harlan: "Actually ready for review now. You can build this locally and run with something like `docker run --rm -it -v $(pwd)/src/mediawiki/extensi" [integration/config] - 10https://gerrit.wikimedia.org/r/475496 (https://phabricator.wikimedia.org/T209849) (owner: 10Kosta Harlan) [16:06:15] (03CR) 10Kosta Harlan: "Actually ready for review now. You can build this locally and run with something like `docker run --rm -it -v $(pwd)/src/mediawiki/extensi" [integration/config] - 10https://gerrit.wikimedia.org/r/475496 (https://phabricator.wikimedia.org/T209849) (owner: 10Kosta Harlan) [16:06:42] cool, that will be nice [16:06:42] cool, that will be nice [16:06:48] took me a while sorry [16:06:48] took me a while sorry [16:07:20] that patches as a few parent changes as well [16:07:20] that patches as a few parent changes as well [16:07:31] but in short the 'docker build' output would be written to the build log [16:07:31] but in short the 'docker build' output would be written to the build log [16:07:47] and the parent patches teach docker-pkg the flag '--option' which configure the logging at INFO level and to stdout [16:07:47] and the parent patches teach docker-pkg the flag '--option' which configure the logging at INFO level and to stdout [16:07:58] so docker-pkg --info should spam to stdout [16:07:58] so docker-pkg --info should spam to stdout [16:08:13] which would help figure out what fails [16:08:14] which would help figure out what fails [16:11:04] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Learn Docker basics - https://phabricator.wikimedia.org/T210412 (10zeljkofilipin) [16:11:04] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Learn Docker basics - https://phabricator.wikimedia.org/T210412 (10zeljkofilipin) [16:13:58] kostajh: will try to review/build/deploy tonight [16:13:59] kostajh: will try to review/build/deploy tonight [16:14:02] gotta run back home :/ [16:14:02] gotta run back home :/ [16:18:03] (03CR) 10Hashar: "I got it to build on my local machine. Will test it out and deploy (unless someone does it faster than me!)" [integration/config] - 10https://gerrit.wikimedia.org/r/475496 (https://phabricator.wikimedia.org/T209849) (owner: 10Kosta Harlan) [16:18:03] (03CR) 10Hashar: "I got it to build on my local machine. Will test it out and deploy (unless someone does it faster than me!)" [integration/config] - 10https://gerrit.wikimedia.org/r/475496 (https://phabricator.wikimedia.org/T209849) (owner: 10Kosta Harlan) [16:20:01] Project beta-update-databases-eqiad build #30047: 04STILL FAILING in 1.5 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30047/ [16:20:02] Project beta-update-databases-eqiad build #30047: 04STILL FAILING in 1.5 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30047/ [16:20:46] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Kanban), 10Cloud-Services, 10Epic, 10Patch-For-Review: Migrate deployment-prep to eqiad1 - https://phabricator.wikimedia.org/T208101 (10mobrovac) >>! In T208101#4768886, @Krenair wrote: > As for VE, URLs like https://en.wikipedia.beta.wmflabs.org... [16:20:46] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Kanban), 10Cloud-Services, 10Epic, 10Patch-For-Review: Migrate deployment-prep to eqiad1 - https://phabricator.wikimedia.org/T208101 (10mobrovac) >>! In T208101#4768886, @Krenair wrote: > As for VE, URLs like https://en.wikipedia.beta.wmflabs.org... [16:21:20] hashar: thanks! [16:21:20] hashar: thanks! [16:26:19] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Kanban), 10Cloud-Services, 10Epic, 10Patch-For-Review: Migrate deployment-prep to eqiad1 - https://phabricator.wikimedia.org/T208101 (10Krenair) >>! In T208101#4774370, @mobrovac wrote: >>>! In T208101#4768886, @Krenair wrote: >> As for VE, URLs... [16:26:19] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Kanban), 10Cloud-Services, 10Epic, 10Patch-For-Review: Migrate deployment-prep to eqiad1 - https://phabricator.wikimedia.org/T208101 (10Krenair) >>! In T208101#4774370, @mobrovac wrote: >>>! In T208101#4768886, @Krenair wrote: >> As for VE, URLs... [16:32:30] (03PS5) 10Kosta Harlan: Fix Dockerfile.template for sonar-scanner [integration/config] - 10https://gerrit.wikimedia.org/r/475496 (https://phabricator.wikimedia.org/T209849) [16:32:30] (03PS5) 10Kosta Harlan: Fix Dockerfile.template for sonar-scanner [integration/config] - 10https://gerrit.wikimedia.org/r/475496 (https://phabricator.wikimedia.org/T209849) [16:32:49] 10Scap, 10ORES, 10Scoring-platform-team: scap deploy --service-restart doesn't affect ORES celery - https://phabricator.wikimedia.org/T182912 (10thcipriani) I noticed that `ores/deploy` has the configuration `service_name: uwsgi-ores` set. `--service-restart` will only restart services listed there. You coul... [16:32:49] 10Scap, 10ORES, 10Scoring-platform-team: scap deploy --service-restart doesn't affect ORES celery - https://phabricator.wikimedia.org/T182912 (10thcipriani) I noticed that `ores/deploy` has the configuration `service_name: uwsgi-ores` set. `--service-restart` will only restart services listed there. You coul... [16:37:10] (03PS6) 10Kosta Harlan: Add configuration for running PHP code analysis on SonarQube [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) [16:37:10] (03PS6) 10Kosta Harlan: Add configuration for running PHP code analysis on SonarQube [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) [16:37:12] (03CR) 10Kosta Harlan: Add configuration for running PHP code analysis on SonarQube (035 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) (owner: 10Kosta Harlan) [16:37:12] (03CR) 10Kosta Harlan: Add configuration for running PHP code analysis on SonarQube (035 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) (owner: 10Kosta Harlan) [17:19:36] 10Continuous-Integration-Config, 10ORES, 10Scoring-platform-team: Migrate ORES CI to Stretch - https://phabricator.wikimedia.org/T186239 (10Ladsgroup) p:05Triage>03Low [17:19:36] 10Continuous-Integration-Config, 10ORES, 10Scoring-platform-team: Migrate ORES CI to Stretch - https://phabricator.wikimedia.org/T186239 (10Ladsgroup) p:05Triage>03Low [17:20:02] Project beta-update-databases-eqiad build #30048: 04STILL FAILING in 2 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30048/ [17:20:02] Project beta-update-databases-eqiad build #30048: 04STILL FAILING in 2 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30048/ [17:21:36] 10Continuous-Integration-Config, 10ORES, 10Scoring-platform-team: Daily build integration test to prove that ORES makefiles are sane - https://phabricator.wikimedia.org/T192606 (10Ladsgroup) p:05Triage>03Lowest [17:21:36] 10Continuous-Integration-Config, 10ORES, 10Scoring-platform-team: Daily build integration test to prove that ORES makefiles are sane - https://phabricator.wikimedia.org/T192606 (10Ladsgroup) p:05Triage>03Lowest [17:30:56] https://phabricator.wikimedia.org/T210420 [17:30:56] https://phabricator.wikimedia.org/T210420 [17:30:57] uh [17:30:57] uh [17:31:00] is that spam? [17:31:00] is that spam? [17:31:21] im not clicking on the link but looks like it is [17:31:21] im not clicking on the link but looks like it is [17:36:25] 10Release-Engineering-Team, 10Operations, 10Release Pipeline, 10Epic, 10Services (watching): Migrate production services to kubernetes using the pipeline - https://phabricator.wikimedia.org/T198901 (10greg) [17:36:25] 10Release-Engineering-Team, 10Operations, 10Release Pipeline, 10Epic, 10Services (watching): Migrate production services to kubernetes using the pipeline - https://phabricator.wikimedia.org/T198901 (10greg) [17:42:56] 10Release-Engineering-Team, 10Operations, 10Release Pipeline, 10Epic, 10Services (watching): Migrate production services to kubernetes using the pipeline - https://phabricator.wikimedia.org/T198901 (10Ladsgroup) [17:42:56] 10Release-Engineering-Team, 10Operations, 10Release Pipeline, 10Epic, 10Services (watching): Migrate production services to kubernetes using the pipeline - https://phabricator.wikimedia.org/T198901 (10Ladsgroup) [18:02:26] 10Release-Engineering-Team (Kanban), 10LDAP-Access-Requests: LDAP requests for Jeena Huneidi - https://phabricator.wikimedia.org/T210028 (10jcrespo) a:03jcrespo [18:02:26] 10Release-Engineering-Team (Kanban), 10LDAP-Access-Requests: LDAP requests for Jeena Huneidi - https://phabricator.wikimedia.org/T210028 (10jcrespo) a:03jcrespo [18:02:38] !log deploy ores:3cdaaa6 to beta [18:02:38] !log deploy ores:3cdaaa6 to beta [18:02:40] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:02:40] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:20:06] Project beta-update-databases-eqiad build #30049: 04STILL FAILING in 5.8 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30049/ [18:20:06] Project beta-update-databases-eqiad build #30049: 04STILL FAILING in 5.8 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30049/ [18:22:26] 10Release-Engineering-Team (Kanban): Onboarding Jeena Huneidi - https://phabricator.wikimedia.org/T209722 (10jeena) [18:22:26] 10Release-Engineering-Team (Kanban): Onboarding Jeena Huneidi - https://phabricator.wikimedia.org/T209722 (10jeena) [18:43:17] 10Release-Engineering-Team (Kanban), 10Operations, 10Release Pipeline, 10Patch-For-Review, 10Services (watching): Create Graphoid .pipeline files - https://phabricator.wikimedia.org/T203092 (10thcipriani) Created docker-registry.wikimedia.org/wikimedia/mediawiki-services-graphoid:20181126180555-productio... [18:43:17] 10Release-Engineering-Team (Kanban), 10Operations, 10Release Pipeline, 10Patch-For-Review, 10Services (watching): Create Graphoid .pipeline files - https://phabricator.wikimedia.org/T203092 (10thcipriani) Created docker-registry.wikimedia.org/wikimedia/mediawiki-services-graphoid:20181126180555-productio... [18:54:15] 10Beta-Cluster-Infrastructure: beta-update-databases-eqiad is failing with a composer problem - https://phabricator.wikimedia.org/T210341 (10Legoktm) a:03Legoktm Will be fixed shortly by https://gerrit.wikimedia.org/r/475682 - my mistake. [18:54:15] 10Beta-Cluster-Infrastructure: beta-update-databases-eqiad is failing with a composer problem - https://phabricator.wikimedia.org/T210341 (10Legoktm) a:03Legoktm Will be fixed shortly by https://gerrit.wikimedia.org/r/475682 - my mistake. [18:58:24] 10Release-Engineering-Team (Kanban), 10Operations, 10Release Pipeline, 10Patch-For-Review, 10Services (watching): Create Graphoid .pipeline files - https://phabricator.wikimedia.org/T203092 (10mobrovac) >>! In T203092#4774968, @thcipriani wrote: > The image complains about `Error: Cannot find module 'bun... [18:58:24] 10Release-Engineering-Team (Kanban), 10Operations, 10Release Pipeline, 10Patch-For-Review, 10Services (watching): Create Graphoid .pipeline files - https://phabricator.wikimedia.org/T203092 (10mobrovac) >>! In T203092#4774968, @thcipriani wrote: > The image complains about `Error: Cannot find module 'bun... [18:59:01] 10Release-Engineering-Team (Kanban), 10Operations, 10Release Pipeline, 10Core Platform Team Backlog (Watching / External), 10Services (watching): Create Graphoid .pipeline files - https://phabricator.wikimedia.org/T203092 (10mobrovac) [18:59:01] 10Release-Engineering-Team (Kanban), 10Operations, 10Release Pipeline, 10Core Platform Team Backlog (Watching / External), 10Services (watching): Create Graphoid .pipeline files - https://phabricator.wikimedia.org/T203092 (10mobrovac) [19:03:44] marxarelli: btw, https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/475682/ [19:03:44] marxarelli: btw, https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/475682/ [19:04:46] greg-g: oh good [19:04:46] greg-g: oh good [19:05:45] thcipriani: ^ did you already file a task for that beta update failure? [19:05:45] thcipriani: ^ did you already file a task for that beta update failure? [19:06:09] marxarelli: thcipriani Krenair beat you https://phabricator.wikimedia.org/T210341 [19:06:10] marxarelli: thcipriani Krenair beat you https://phabricator.wikimedia.org/T210341 [19:06:20] it seems likely that patch fixes the issue [19:06:20] it seems likely that patch fixes the issue [19:13:00] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Next), 10Wikimedia-Logstash, 10Jenkins, 10Patch-For-Review: Send Jenkins daemon logs to logstash - https://phabricator.wikimedia.org/T143733 (10herron) >>! In T143733#4767360, @hashar wrote: >>>! In T143733#4767255, @fgiunchedi wrote: >... [19:13:00] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Next), 10Wikimedia-Logstash, 10Jenkins, 10Patch-For-Review: Send Jenkins daemon logs to logstash - https://phabricator.wikimedia.org/T143733 (10herron) >>! In T143733#4767360, @hashar wrote: >>>! In T143733#4767255, @fgiunchedi wrote: >... [19:16:28] 10Release-Engineering-Team, 10Scoring-platform-team, 10Performance: Investigate PEP 503 repo for production deployment of python wheels - https://phabricator.wikimedia.org/T192478 (10Ladsgroup) By using [[https://wikitech.wikimedia.org/w/index.php?title=SSDD|SSDD]], this would be obsolete. Because the contai... [19:16:28] 10Release-Engineering-Team, 10Scoring-platform-team, 10Performance: Investigate PEP 503 repo for production deployment of python wheels - https://phabricator.wikimedia.org/T192478 (10Ladsgroup) By using [[https://wikitech.wikimedia.org/w/index.php?title=SSDD|SSDD]], this would be obsolete. Because the contai... [19:21:18] Yippee, build fixed! [19:21:18] Yippee, build fixed! [19:21:19] Project beta-update-databases-eqiad build #30050: 09FIXED in 1 min 18 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30050/ [19:21:19] Project beta-update-databases-eqiad build #30050: 09FIXED in 1 min 18 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30050/ [19:31:09] 10Release-Engineering-Team, 10Scoring-platform-team, 10Performance: Investigate PEP 503 repo for production deployment of python wheels - https://phabricator.wikimedia.org/T192478 (10Imarlier) @Ladsgroup I don't think that's correct. There still needs to be a way to install dependencies into containers at s... [19:31:09] 10Release-Engineering-Team, 10Scoring-platform-team, 10Performance: Investigate PEP 503 repo for production deployment of python wheels - https://phabricator.wikimedia.org/T192478 (10Imarlier) @Ladsgroup I don't think that's correct. There still needs to be a way to install dependencies into containers at s... [19:37:30] 10Release-Engineering-Team (Kanban), 10docker-pkg: Option to all Docker cache when building images - https://phabricator.wikimedia.org/T210438 (10hashar) [19:37:30] 10Release-Engineering-Team (Kanban), 10docker-pkg: Option to all Docker cache when building images - https://phabricator.wikimedia.org/T210438 (10hashar) [19:53:42] 10Release-Engineering-Team (Kanban): Onboarding Jeena Huneidi - https://phabricator.wikimedia.org/T209722 (10greg) Minus the stuff we'll do at the offsite (gpg keysigning party and adding key to pwstore) this is done! I'll leave it open until those things are complete. [19:53:42] 10Release-Engineering-Team (Kanban): Onboarding Jeena Huneidi - https://phabricator.wikimedia.org/T209722 (10greg) Minus the stuff we'll do at the offsite (gpg keysigning party and adding key to pwstore) this is done! I'll leave it open until those things are complete. [20:00:31] 10Continuous-Integration-Infrastructure, 10Gerrit: jenkins-bot no longer votes V-1 when a patch with C+2 can be rebased and passes all tests, but can't be submitted according to Gerrit - https://phabricator.wikimedia.org/T210442 (10matmarex) [20:00:31] 10Continuous-Integration-Infrastructure, 10Gerrit: jenkins-bot no longer votes V-1 when a patch with C+2 can be rebased and passes all tests, but can't be submitted according to Gerrit - https://phabricator.wikimedia.org/T210442 (10matmarex) [20:01:36] 10Release-Engineering-Team (Kanban), 10User-greg: Onboarding Jeena Huneidi - https://phabricator.wikimedia.org/T209722 (10greg) a:05jeena>03greg Stealing for the keysigning party. [20:01:36] 10Release-Engineering-Team (Kanban), 10User-greg: Onboarding Jeena Huneidi - https://phabricator.wikimedia.org/T209722 (10greg) a:05jeena>03greg Stealing for the keysigning party. [20:05:19] 10Phabricator, 10Wikimedia-Logstash, 10Patch-For-Review: Get phabricator error logs into logstash - https://phabricator.wikimedia.org/T141895 (10herron) 05Open>03Resolved a:03herron Phabricator apache error logs are now available in logstash [20:05:19] 10Phabricator, 10Wikimedia-Logstash, 10Patch-For-Review: Get phabricator error logs into logstash - https://phabricator.wikimedia.org/T141895 (10herron) 05Open>03Resolved a:03herron Phabricator apache error logs are now available in logstash [20:55:43] 10Release-Engineering-Team (Kanban), 10Operations, 10Release Pipeline, 10Core Platform Team Backlog (Watching / External), 10Services (watching): Create Graphoid .pipeline files - https://phabricator.wikimedia.org/T203092 (10thcipriani) >>! In T203092#4775052, @mobrovac wrote: >>>! In T203092#4774968, @t... [20:55:44] 10Release-Engineering-Team (Kanban), 10Operations, 10Release Pipeline, 10Core Platform Team Backlog (Watching / External), 10Services (watching): Create Graphoid .pipeline files - https://phabricator.wikimedia.org/T203092 (10thcipriani) >>! In T203092#4775052, @mobrovac wrote: >>>! In T203092#4774968, @t... [21:11:42] 10Phabricator, 10Wikimedia-Logstash, 10Patch-For-Review: Get phabricator error logs into logstash - https://phabricator.wikimedia.org/T141895 (10Aklapper) (Link for lazy people like me: https://logstash.wikimedia.org/app/kibana#/dashboard/apache2log and searching for `host:"phab1001"`) [21:11:42] 10Phabricator, 10Wikimedia-Logstash, 10Patch-For-Review: Get phabricator error logs into logstash - https://phabricator.wikimedia.org/T141895 (10Aklapper) (Link for lazy people like me: https://logstash.wikimedia.org/app/kibana#/dashboard/apache2log and searching for `host:"phab1001"`) [21:14:45] 10Gerrit, 10Release-Engineering-Team (Backlog), 10Wikimedia-Logstash, 10Patch-For-Review, 10Technical-Debt: Look into shoving gerrit logs into logstash - https://phabricator.wikimedia.org/T141324 (10herron) 05Resolved>03Open Reopening this because I'm not seeing any logs for `host:cobalt` in logstash... [21:14:45] 10Gerrit, 10Release-Engineering-Team (Backlog), 10Wikimedia-Logstash, 10Patch-For-Review, 10Technical-Debt: Look into shoving gerrit logs into logstash - https://phabricator.wikimedia.org/T141324 (10herron) 05Resolved>03Open Reopening this because I'm not seeing any logs for `host:cobalt` in logstash... [21:19:05] 10Release-Engineering-Team (Kanban), 10docker-pkg: Option to allow Docker cache when building images - https://phabricator.wikimedia.org/T210438 (10hashar) [21:19:05] 10Release-Engineering-Team (Kanban), 10docker-pkg: Option to allow Docker cache when building images - https://phabricator.wikimedia.org/T210438 (10hashar) [21:42:12] is beta cluster still in some kind of read only mode? Our browser tests are continuously failing with read only failures.. and can't tell if that's caching related. [21:42:12] is beta cluster still in some kind of read only mode? Our browser tests are continuously failing with read only failures.. and can't tell if that's caching related. [21:42:21] (https://integration.wikimedia.org/ci/view/Reading-Web/job/selenium-MinervaNeue/) [21:42:21] (https://integration.wikimedia.org/ci/view/Reading-Web/job/selenium-MinervaNeue/) [21:43:17] 10Release-Engineering-Team (Kanban), 10docker-pkg, 10Patch-For-Review: docker-pkg should attempt to pull dependent images from the registry - https://phabricator.wikimedia.org/T200720 (10hashar) a:03hashar [21:43:17] 10Release-Engineering-Team (Kanban), 10docker-pkg, 10Patch-For-Review: docker-pkg should attempt to pull dependent images from the registry - https://phabricator.wikimedia.org/T200720 (10hashar) a:03hashar [21:43:28] 10Release-Engineering-Team (Kanban), 10docker-pkg, 10Patch-For-Review: Option to allow Docker cache when building images - https://phabricator.wikimedia.org/T210438 (10hashar) a:03hashar [21:43:28] 10Release-Engineering-Team (Kanban), 10docker-pkg, 10Patch-For-Review: Option to allow Docker cache when building images - https://phabricator.wikimedia.org/T210438 (10hashar) a:03hashar [21:50:14] (03CR) 10Hashar: "I could not review/test tonight, I have been polishing up patches for docker-pkg to ease identifying build failures. An issue that has hit" [integration/config] - 10https://gerrit.wikimedia.org/r/475496 (https://phabricator.wikimedia.org/T209849) (owner: 10Kosta Harlan) [21:50:14] (03CR) 10Hashar: "I could not review/test tonight, I have been polishing up patches for docker-pkg to ease identifying build failures. An issue that has hit" [integration/config] - 10https://gerrit.wikimedia.org/r/475496 (https://phabricator.wikimedia.org/T209849) (owner: 10Kosta Harlan) [21:59:47] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Zuul: jenkins-bot no longer votes V-1 when a patch with C+2 can be rebased and passes all tests, but can't be submitted according to Gerrit - https://phabricator.wikimedia.org/T210442 (10hashar) [21:59:47] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Zuul: jenkins-bot no longer votes V-1 when a patch with C+2 can be rebased and passes all tests, but can't be submitted according to Gerrit - https://phabricator.wikimedia.org/T210442 (10hashar) [22:04:59] 10Gerrit, 10Release-Engineering-Team (Backlog), 10Wikimedia-Logstash, 10Patch-For-Review, 10Technical-Debt: Look into shoving gerrit logs into logstash - https://phabricator.wikimedia.org/T141324 (10thcipriani) >>! In T141324#4775672, @herron wrote: > Reopening this because I'm not seeing any logs for `h... [22:04:59] 10Gerrit, 10Release-Engineering-Team (Backlog), 10Wikimedia-Logstash, 10Patch-For-Review, 10Technical-Debt: Look into shoving gerrit logs into logstash - https://phabricator.wikimedia.org/T141324 (10thcipriani) >>! In T141324#4775672, @herron wrote: > Reopening this because I'm not seeing any logs for `h... [22:14:42] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Zuul: jenkins-bot no longer votes V-1 when a patch with C+2 can be rebased and passes all tests, but can't be submitted according to Gerrit - https://phabricator.wikimedia.org/T210442 (10hashar) [22:14:42] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Zuul: jenkins-bot no longer votes V-1 when a patch with C+2 can be rebased and passes all tests, but can't be submitted according to Gerrit - https://phabricator.wikimedia.org/T210442 (10hashar) [22:16:40] thcipriani marxarelli hashar i can invite you to the gerrit slack channel if you want? [22:16:40] thcipriani marxarelli hashar i can invite you to the gerrit slack channel if you want? [22:18:17] (03PS1) 10Urbanecm: Allow wikimedia-cz group to excercize owner privileges [labs/tools/urbanecmbot] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/475894 [22:18:17] (03PS1) 10Urbanecm: Allow wikimedia-cz group to excercize owner privileges [labs/tools/urbanecmbot] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/475894 [22:18:31] (03CR) 10Urbanecm: [V: 032 C: 032] "Test" [labs/tools/urbanecmbot] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/475894 (owner: 10Urbanecm) [22:18:31] (03CR) 10Urbanecm: [V: 032 C: 032] "Test" [labs/tools/urbanecmbot] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/475894 (owner: 10Urbanecm) [22:18:47] (03PS2) 10Urbanecm: Allow wikimedia-cz group to excercize owner privileges [labs/tools/urbanecmbot] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/475894 [22:18:47] (03PS2) 10Urbanecm: Allow wikimedia-cz group to excercize owner privileges [labs/tools/urbanecmbot] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/475894 [22:18:47] jdlrobson, no [22:18:48] jdlrobson, no [22:18:51] (03CR) 10Urbanecm: [V: 032 C: 032] Allow wikimedia-cz group to excercize owner privileges [labs/tools/urbanecmbot] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/475894 (owner: 10Urbanecm) [22:18:51] (03CR) 10Urbanecm: [V: 032 C: 032] Allow wikimedia-cz group to excercize owner privileges [labs/tools/urbanecmbot] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/475894 (owner: 10Urbanecm) [22:19:10] beta cluster is pretty much back to normal [22:19:11] beta cluster is pretty much back to normal [22:19:54] thanks Krenair [22:19:54] thanks Krenair [22:20:24] (03PS1) 10Urbanecm: Revert "Allow wikimedia-cz group to excercize owner privileges" [labs/tools/urbanecmbot] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/475895 [22:20:24] (03PS1) 10Urbanecm: Revert "Allow wikimedia-cz group to excercize owner privileges" [labs/tools/urbanecmbot] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/475895 [22:20:29] (03CR) 10Urbanecm: [V: 032 C: 032] Revert "Allow wikimedia-cz group to excercize owner privileges" [labs/tools/urbanecmbot] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/475895 (owner: 10Urbanecm) [22:20:29] (03CR) 10Urbanecm: [V: 032 C: 032] Revert "Allow wikimedia-cz group to excercize owner privileges" [labs/tools/urbanecmbot] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/475895 (owner: 10Urbanecm) [22:20:52] there are 2 or 3 unknowns but you're unlikely to run into them as a client [22:20:52] there are 2 or 3 unknowns but you're unlikely to run into them as a client [22:21:48] paladox: I hadn't seen anything about a slack channel, is their slack meant for for gerrit developers? or is it a place where we could bug them about problems we're having? :) [22:21:48] paladox: I hadn't seen anything about a slack channel, is their slack meant for for gerrit developers? or is it a place where we could bug them about problems we're having? :) [22:21:49] (03PS1) 10Urbanecm: Edit Project Config [labs/tools/map-of-monuments] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/475897 [22:21:49] (03PS1) 10Urbanecm: Edit Project Config [labs/tools/map-of-monuments] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/475897 [22:21:52] actually I can get rid of one of them now [22:21:52] actually I can get rid of one of them now [22:21:58] thcipriani both :) [22:21:58] thcipriani both :) [22:22:03] (03Abandoned) 10Urbanecm: Edit Project Config [labs/tools/map-of-monuments] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/475897 (owner: 10Urbanecm) [22:22:03] (03Abandoned) 10Urbanecm: Edit Project Config [labs/tools/map-of-monuments] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/475897 (owner: 10Urbanecm) [22:22:09] it was setup a few weeks ago when they had their hackathon. [22:22:09] it was setup a few weeks ago when they had their hackathon. [22:22:27] !log shutoff deployment-cache-text04, now replaced with deployment-cache-text05 in the new region - T210214 [22:22:27] !log shutoff deployment-cache-text04, now replaced with deployment-cache-text05 in the new region - T210214 [22:22:30] thcipriani it's invite only though. [22:22:30] thcipriani it's invite only though. [22:22:30] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:22:31] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:22:31] T210214: deployment-cache-text04 decomissioning - https://phabricator.wikimedia.org/T210214 [22:22:31] T210214: deployment-cache-text04 decomissioning - https://phabricator.wikimedia.org/T210214 [22:22:34] paladox: in that case it sounds like it could be useful :) [22:22:34] paladox: in that case it sounds like it could be useful :) [22:22:38] thank you [22:22:38] thank you [22:23:24] thcipriani done! [22:23:24] thcipriani done! [22:23:41] paladox: great, thanks [22:23:41] paladox: great, thanks [22:23:42] jdlrobson, can you clarify exactly what HTTP request is being made that returns a read only error? [22:23:42] jdlrobson, can you clarify exactly what HTTP request is being made that returns a read only error? [22:23:47] your welcome :) [22:23:47] your welcome :) [22:25:39] 10Beta-Cluster-Infrastructure: deployment-cache-text04 decomissioning - https://phabricator.wikimedia.org/T210214 (10Krenair) I intend to delete this in one week if no one needs anything from it. [22:25:39] 10Beta-Cluster-Infrastructure: deployment-cache-text04 decomissioning - https://phabricator.wikimedia.org/T210214 (10Krenair) I intend to delete this in one week if no one needs anything from it. [22:27:18] The remaining things from my point of view [22:27:18] The remaining things from my point of view [22:27:34] * Replacing deployment-zotero01 with the new v2 translation server thing that's now in prod [22:27:34] * Replacing deployment-zotero01 with the new v2 translation server thing that's now in prod [22:27:44] * Figuring out the confusion over deployment-redis* [22:27:44] * Figuring out the confusion over deployment-redis* [22:27:56] * Solving jdlrobson's mysterious read only thing? [22:27:57] * Solving jdlrobson's mysterious read only thing? [22:28:17] * (in a week) deleting the old deployment-cache-text04 [22:28:17] * (in a week) deleting the old deployment-cache-text04 [22:29:00] think that's it [22:29:00] think that's it [22:31:59] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Zuul: jenkins-bot no longer votes V-1 when a patch with C+2 can be rebased and passes all tests, but can't be submitted according to Gerrit - https://phabricator.wikimedia.org/T210442 (10hashar) One of the first thing Zuul does it attempting to merge the p... [22:31:59] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Zuul: jenkins-bot no longer votes V-1 when a patch with C+2 can be rebased and passes all tests, but can't be submitted according to Gerrit - https://phabricator.wikimedia.org/T210442 (10hashar) One of the first thing Zuul does it attempting to merge the p... [22:32:04] 10Gerrit: Add Urbanecm back to wikimedia-cz-events group - https://phabricator.wikimedia.org/T210461 (10Urbanecm) [22:32:04] 10Gerrit: Add Urbanecm back to wikimedia-cz-events group - https://phabricator.wikimedia.org/T210461 (10Urbanecm) [22:35:43] (03PS1) 10Urbanecm: Modify access rules [labs/tools/commons-mass-description] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/475902 [22:35:43] (03PS1) 10Urbanecm: Modify access rules [labs/tools/commons-mass-description] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/475902 [22:35:58] (03CR) 10Urbanecm: [V: 032 C: 032] Modify access rules [labs/tools/commons-mass-description] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/475902 (owner: 10Urbanecm) [22:35:58] (03CR) 10Urbanecm: [V: 032 C: 032] Modify access rules [labs/tools/commons-mass-description] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/475902 (owner: 10Urbanecm) [22:39:31] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Zuul: jenkins-bot no longer votes V-1 when a patch with C+2 can be rebased and passes all tests, but can't be submitted according to Gerrit - https://phabricator.wikimedia.org/T210442 (10hashar) Slightly related is T131008#3307337 @matmarex next time it h... [22:39:31] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Zuul: jenkins-bot no longer votes V-1 when a patch with C+2 can be rebased and passes all tests, but can't be submitted according to Gerrit - https://phabricator.wikimedia.org/T210442 (10hashar) Slightly related is T131008#3307337 @matmarex next time it h... [22:50:49] (03PS1) 10Hashar: gerrit: query solely for change not anything [integration/zuul] (patch-queue/debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/475904 (https://phabricator.wikimedia.org/T198968) [22:50:49] (03PS1) 10Hashar: gerrit: query solely for change not anything [integration/zuul] (patch-queue/debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/475904 (https://phabricator.wikimedia.org/T198968) [22:52:14] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Patch-For-Review, 10Zuul: Zuul get confused when querying a change that yields two entries - https://phabricator.wikimedia.org/T198968 (10hashar) It took me a while to come back to this task, I apologize. The patch above should fix it, I have to test it... [22:52:14] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Patch-For-Review, 10Zuul: Zuul get confused when querying a change that yields two entries - https://phabricator.wikimedia.org/T198968 (10hashar) It took me a while to come back to this task, I apologize. The patch above should fix it, I have to test it... [22:52:53] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Patch-For-Review, 10Zuul: Zuul get confused when querying a change that yields two entries - https://phabricator.wikimedia.org/T198968 (10hashar) + @seb35 for information since the bug has hit MediaWikiFarm. [22:52:53] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Patch-For-Review, 10Zuul: Zuul get confused when querying a change that yields two entries - https://phabricator.wikimedia.org/T198968 (10hashar) + @seb35 for information since the bug has hit MediaWikiFarm. [22:53:44] (03CR) 10Hashar: "I will look at testing it then rebuild the package and deploy the fix. See task for the annoyance but in short:" [integration/zuul] (patch-queue/debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/475904 (https://phabricator.wikimedia.org/T198968) (owner: 10Hashar) [22:53:44] (03CR) 10Hashar: "I will look at testing it then rebuild the package and deploy the fix. See task for the annoyance but in short:" [integration/zuul] (patch-queue/debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/475904 (https://phabricator.wikimedia.org/T198968) (owner: 10Hashar) [22:53:52] (03PS1) 10Urbanecm: Add job for urbanecmbot [integration/config] - 10https://gerrit.wikimedia.org/r/475905 [22:53:52] (03PS1) 10Urbanecm: Add job for urbanecmbot [integration/config] - 10https://gerrit.wikimedia.org/r/475905 [22:54:03] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Zuul: Zuul get confused when querying a change that yields two entries - https://phabricator.wikimedia.org/T198968 (10hashar) a:03hashar [22:54:03] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Zuul: Zuul get confused when querying a change that yields two entries - https://phabricator.wikimedia.org/T198968 (10hashar) a:03hashar [22:57:49] (03CR) 10jerkins-bot: [V: 04-1] Add job for urbanecmbot [integration/config] - 10https://gerrit.wikimedia.org/r/475905 (owner: 10Urbanecm) [22:57:49] (03CR) 10jerkins-bot: [V: 04-1] Add job for urbanecmbot [integration/config] - 10https://gerrit.wikimedia.org/r/475905 (owner: 10Urbanecm) [23:20:02] 10Gerrit, 10Release-Engineering-Team (Backlog), 10Wikimedia-Logstash, 10Patch-For-Review, 10Technical-Debt: Look into shoving gerrit logs into logstash - https://phabricator.wikimedia.org/T141324 (10herron) >>! In T141324#4775920, @thcipriani wrote: >>>! In T141324#4775672, @herron wrote: >> Reopening th... [23:20:02] 10Gerrit, 10Release-Engineering-Team (Backlog), 10Wikimedia-Logstash, 10Patch-For-Review, 10Technical-Debt: Look into shoving gerrit logs into logstash - https://phabricator.wikimedia.org/T141324 (10herron) >>! In T141324#4775920, @thcipriani wrote: >>>! In T141324#4775672, @herron wrote: >> Reopening th... [23:26:54] Krenair: it relates to the api [23:26:54] Krenair: it relates to the api [23:26:57] https://www.irccloud.com/pastebin/tb4CoLGr/ [23:26:57] https://www.irccloud.com/pastebin/tb4CoLGr/ [23:27:20] when selenium tries to edit pages [23:27:20] when selenium tries to edit pages [23:28:22] i'm seeing selenium failures across the board but can't replicate [23:28:22] i'm seeing selenium failures across the board but can't replicate [23:28:41] okay but what's the actual HTTP request it's making here? [23:28:41] okay but what's the actual HTTP request it's making here? [23:29:38] (03PS2) 10Urbanecm: Add job for urbanecmbot [integration/config] - 10https://gerrit.wikimedia.org/r/475905 [23:29:38] (03PS2) 10Urbanecm: Add job for urbanecmbot [integration/config] - 10https://gerrit.wikimedia.org/r/475905 [23:31:24] jdlrobson, we could have a naive attempt at triggering it ourselves by figuring out what wiki and page it's trying to edit and doing something similar [23:31:24] jdlrobson, we could have a naive attempt at triggering it ourselves by figuring out what wiki and page it's trying to edit and doing something similar [23:31:39] but really to debug this properly we should have the full request details :/ [23:31:39] but really to debug this properly we should have the full request details :/ [23:41:47] 10Release-Engineering-Team (Kanban), 10Scap: Update Debian Package for Scap to 3.8.9-1 - https://phabricator.wikimedia.org/T210469 (10thcipriani) p:05Triage>03Normal [23:41:47] 10Release-Engineering-Team (Kanban), 10Scap: Update Debian Package for Scap to 3.8.9-1 - https://phabricator.wikimedia.org/T210469 (10thcipriani) p:05Triage>03Normal [23:45:18] 10Release-Engineering-Team (Kanban), 10Scap, 10Patch-For-Review: Update Debian Package for Scap to 3.8.9-1 - https://phabricator.wikimedia.org/T210469 (10thcipriani) Adding @fgiunchedi since he usually has the honor of doing scap updates :) [23:45:18] 10Release-Engineering-Team (Kanban), 10Scap, 10Patch-For-Review: Update Debian Package for Scap to 3.8.9-1 - https://phabricator.wikimedia.org/T210469 (10thcipriani) Adding @fgiunchedi since he usually has the honor of doing scap updates :) [23:46:02] 10Release-Engineering-Team, 10Scap, 10Operations, 10Patch-For-Review: Update Debian Package for Scap to 3.8.9-1 - https://phabricator.wikimedia.org/T210469 (10thcipriani) [23:46:02] 10Release-Engineering-Team, 10Scap, 10Operations, 10Patch-For-Review: Update Debian Package for Scap to 3.8.9-1 - https://phabricator.wikimedia.org/T210469 (10thcipriani)