[00:02:01] 10Release-Engineering-Team, 10ci-test-error: Upgrade ruby version for CI tests - https://phabricator.wikimedia.org/T250538 (10hashar) 05Open→03Resolved a:03hashar The message comes from rubocop step to reproduce: ` name=.ruby-version.diff,lang=diff - 2.3.3 + 2.5 ` That file is used by `rbenv` to install... [00:14:31] 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO, 10Structured Data Engineering, 10Structured-Data-Backlog (Current Work), 10Wiki-Setup (Delete / Redirect): Close and delete TestCommons from production - https://phabricator.wikimedia.org/T213295 (10Reedy) When is it goin... [00:50:09] 10Phabricator: Create Herald Rule for #google-api-proxy / #community-tech - https://phabricator.wikimedia.org/T250541 (10Peachey88) [00:58:49] 10Continuous-Integration-Infrastructure, 10Zuul, 10Wikimedia-Incident: Add two more zuul-merger process - https://phabricator.wikimedia.org/T222645 (10hashar) [05:33:22] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Release, 10Train Deployments: 1.35.0-wmf.18 deployment blockers - https://phabricator.wikimedia.org/T233866 (10DannyS712) Assuming any remaining patch is no longer relevant at this point [05:43:36] 10Release-Engineering-Team-TODO (201912), 10Release, 10Train Deployments: 1.35.0-wmf.11 deployment blockers - https://phabricator.wikimedia.org/T233859 (10DannyS712) [05:43:52] 10Release-Engineering-Team (Kanban), 10RESTBase, 10VisualEditor, 10VisualEditor-MediaWiki, and 3 others: [{exception_id}] {exception_url} ErrorException from line 599 of /srv/mediawiki/php-1.34.0-wmf.4/extensions/VisualEditor/includes/ApiVisualEditor.php: PHP Notic... - https://phabricator.wikimedia.org/T223281 [07:43:06] (03CR) 10Awight: "> Have rolled back the new quibble release. :-(" [integration/quibble] - 10https://gerrit.wikimedia.org/r/588146 (https://phabricator.wikimedia.org/T211702) (owner: 10Awight) [07:52:16] Channel topic needs updating, the IRC log link is stale. [08:04:51] (03CR) 10Awight: "I think I see what happened. In my local test environment, the working directory is a few levels below a .git directory, so `git clean` w" [integration/quibble] - 10https://gerrit.wikimedia.org/r/588146 (https://phabricator.wikimedia.org/T211702) (owner: 10Awight) [08:44:22] (03PS1) 10Awight: Wipe repo with non-git commands [integration/quibble] - 10https://gerrit.wikimedia.org/r/589838 (https://phabricator.wikimedia.org/T211702) [08:44:40] (03CR) 10Awight: "Fixed in I31b385a99f589b" [integration/quibble] - 10https://gerrit.wikimedia.org/r/588146 (https://phabricator.wikimedia.org/T211702) (owner: 10Awight) [09:04:00] (03CR) 10Awight: "> the time limit code for phpunit is a bit wrong. :-)" [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) (owner: 10Awight) [09:11:46] 10Phabricator: Create Herald Rule for #google-api-proxy / #community-tech - https://phabricator.wikimedia.org/T250541 (10Aklapper) 05Open→03Resolved a:03Aklapper Uh, thanks. I have added #google-api-proxy to H260. (Heads-up to @MBinder_WMF) [12:26:48] 10Beta-Cluster-Infrastructure: test.wikimedia.beta.wmflabs.org pages not loading: Unknown database 'testwikidatawiki' - https://phabricator.wikimedia.org/T250555 (10AlexisJazz) [12:29:55] 10Beta-Cluster-Infrastructure, 10DBA: test.wikimedia.beta.wmflabs.org pages not loading: Unknown database 'testwikidatawiki' - https://phabricator.wikimedia.org/T250555 (10AlexisJazz) [12:51:02] 10Beta-Cluster-Infrastructure, 10DBA, 10Wikidata, 10Wikidata-Campsite, 10Wikimedia-General-or-Unknown: test.wikimedia.beta.wmflabs.org pages not loading: Unknown database 'testwikidatawiki' - https://phabricator.wikimedia.org/T250555 (10Reedy) There's no `testwikidatawiki` in beta. I'm guessing some prod... [12:52:00] 10Beta-Cluster-Infrastructure, 10Wikidata, 10Wikidata-Campsite, 10Wikimedia-General-or-Unknown: test.wikimedia.beta.wmflabs.org pages not loading: Unknown database 'testwikidatawiki' - https://phabricator.wikimedia.org/T250555 (10Marostegui) [13:10:41] PROBLEM - Parsoid on deployment-parsoid11 is CRITICAL: connect to address 172.16.1.115 and port 8000: Connection refused [13:46:27] (03CR) 10Awight: "One small thing worth mentioning: the progress report timer will probably fail spectacularly if we start nesting parallel jobs (as we shou" [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) (owner: 10Awight) [14:17:58] (03PS9) 10Daimona Eaytoy: dockerfiles: coverage: add pcov, use it if we're on PHPUnit 8+ [integration/config] - 10https://gerrit.wikimedia.org/r/567938 (https://phabricator.wikimedia.org/T234020) [14:18:25] (03PS23) 10Awight: Parallelism as a command object; parallelize short PHPUnits [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) [14:19:18] (03CR) 10jerkins-bot: [V: 04-1] Parallelism as a command object; parallelize short PHPUnits [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) (owner: 10Awight) [14:20:09] (03CR) 10Awight: "> One small thing worth mentioning: the progress report timer will" [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) (owner: 10Awight) [14:22:16] (03CR) 10Awight: "recheck" [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) (owner: 10Awight) [14:49:31] (03CR) 10Awight: "The failure looks like a race condition. I haven't been able to reproduce it locally, even in the tox docker container." [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) (owner: 10Awight) [14:53:47] (03PS1) 10Awight: [DNM] debugging in CI [integration/quibble] - 10https://gerrit.wikimedia.org/r/589860 [14:54:50] (03CR) 10jerkins-bot: [V: 04-1] [DNM] debugging in CI [integration/quibble] - 10https://gerrit.wikimedia.org/r/589860 (owner: 10Awight) [14:57:07] (03PS2) 10Awight: [DNM] debugging in CI [integration/quibble] - 10https://gerrit.wikimedia.org/r/589860 [14:57:55] (03CR) 10jerkins-bot: [V: 04-1] [DNM] debugging in CI [integration/quibble] - 10https://gerrit.wikimedia.org/r/589860 (owner: 10Awight) [16:42:40] 10Phabricator, 10Tool-MajavahBot, 10User-Majavah: H336: Include #Tool-MajavahBot - https://phabricator.wikimedia.org/T250562 (10Majavah) [16:59:32] 10Phabricator, 10Project-Admins, 10Tool-MajavahBot, 10User-Majavah: H336: Include #Tool-MajavahBot - https://phabricator.wikimedia.org/T250562 (10QEDK) [17:07:07] 10Phabricator, 10Tool-MajavahBot, 10User-Majavah: H336: Include #Tool-MajavahBot - https://phabricator.wikimedia.org/T250562 (10Zoranzoki21) Project admins can't manage Herald rules, so I removing it. @aklapper can you resolve this request? [17:51:35] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Jenkins: Enable ansicolor globally in Jenkins when plugin is released - https://phabricator.wikimedia.org/T233688 (10hashar) We have ansicolor 0.6.2 righ... [17:51:44] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Jenkins: Enable ansicolor globally in Jenkins when plugin is released - https://phabricator.wikimedia.org/T233688 (10hashar) p:05Triage→03Medium [17:58:53] (03CR) 10Awight: "I'm thinking the problem might be the class variables in StreamCapture." [integration/quibble] - 10https://gerrit.wikimedia.org/r/589860 (owner: 10Awight) [17:58:55] (03CR) 10Awight: "recheck" [integration/quibble] - 10https://gerrit.wikimedia.org/r/589860 (owner: 10Awight) [18:22:53] (03PS3) 10Awight: [DNM] debugging in CI [integration/quibble] - 10https://gerrit.wikimedia.org/r/589860 [18:23:44] (03CR) 10jerkins-bot: [V: 04-1] [DNM] debugging in CI [integration/quibble] - 10https://gerrit.wikimedia.org/r/589860 (owner: 10Awight) [19:05:46] 10LibUp: New version 0.9.0 available for grunt-banana-checker - https://phabricator.wikimedia.org/T250162 (10Umherirrender) Just as record: > It seems libup needs to run for many repos to update the php linter, so that could be combined That seems not the case as libup now updating banana only [19:39:03] RECOVERY - Host deployment-cache-text05 is UP: PING OK - Packet loss = 0%, RTA = 1.51 ms [19:39:44] PROBLEM - Free space - all mounts on deployment-logstash2 is CRITICAL: CRITICAL: deployment-prep.deployment-logstash2.diskspace._mnt.byte_percentfree (No valid datapoints found) deployment-prep.deployment-logstash2.diskspace._var_lib_elasticsearch.byte_percentfree (No valid datapoints found)deployment-prep.deployment-logstash2.diskspace.root.byte_percentfree (<100.00%) [19:41:28] RECOVERY - Host deployment-cache-upload05 is UP: PING OK - Packet loss = 0%, RTA = 0.99 ms [19:43:44] 10MediaWiki-Codesniffer: PHPCS complains about unused use statements if used in @method - https://phabricator.wikimedia.org/T250573 (10Reedy) [19:43:52] 10Beta-Cluster-Infrastructure: Migrate deployment-cache* boxes to buster - https://phabricator.wikimedia.org/T250006 (10Krenair) 05Open→03Resolved Tidied away old deployment-cache-upload05 / deployment-cache-text05 [19:44:02] PROBLEM - Host deployment-cache-text05 is DOWN: CRITICAL - Host Unreachable (172.16.4.21) [19:57:59] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Jessie Deprecation): Replace deployment-restbase0[12] - https://phabricator.wikimedia.org/T250574 (10Krenair) [19:58:13] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Jessie Deprecation): Replace deployment-restbase0[12] - https://phabricator.wikimedia.org/T250574 (10Krenair) a:03Krenair [20:14:51] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Jessie Deprecation), 10Patch-For-Review: Replace deployment-restbase0[12] - https://phabricator.wikimedia.org/T250574 (10Pchelolo) > TODO: Do I need a deployment-restbase04 too? I think we can live with just one, unless @Eevans would disagree. [20:23:10] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Jessie Deprecation): Migrate deployment-prep away from Debian Jessie to Debian Stretch/Buster - https://phabricator.wikimedia.org/T218729 (10Krenair) [20:23:59] 10MediaWiki-Codesniffer: PHPCS complains about unused use statements if used in @method - https://phabricator.wikimedia.org/T250573 (10Reedy) p:05Triage→03Lowest Probably decline this because `@method` is just a weird hack [20:33:57] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Jessie Deprecation): Migrate deployment-prep away from Debian Jessie to Debian Stretch/Buster - https://phabricator.wikimedia.org/T218729 (10Krenair) Just to remind everyone: We have one week left before the following would be running an unsupported OS, and I... [20:42:58] 10MediaWiki-Codesniffer, 10User-DannyS712: Add a sniff for visibility of constants - https://phabricator.wikimedia.org/T250576 (10DannyS712) [20:43:19] 10MediaWiki-Codesniffer, 10User-DannyS712: Add a sniff for visibility of constants - https://phabricator.wikimedia.org/T250576 (10DannyS712) p:05Triage→03Low Not going to work on this until I get some feedback regarding if this is a good idea [21:04:27] (03PS24) 10Awight: Parallelism as a command object; parallelize short PHPUnits [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) [21:04:29] (03PS4) 10Awight: [DNM] debugging in CI [integration/quibble] - 10https://gerrit.wikimedia.org/r/589860 [21:05:20] (03CR) 10jerkins-bot: [V: 04-1] Parallelism as a command object; parallelize short PHPUnits [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) (owner: 10Awight) [21:05:23] (03CR) 10jerkins-bot: [V: 04-1] [DNM] debugging in CI [integration/quibble] - 10https://gerrit.wikimedia.org/r/589860 (owner: 10Awight) [21:11:33] 10Beta-Cluster-Infrastructure, 10Cloud-VPS: Broken puppet in deployment-prep - https://phabricator.wikimedia.org/T248933 (10Krenair) 05Open→03Resolved a:03Andrew [21:13:22] 10MediaWiki-Codesniffer, 10User-DannyS712: Add a sniff for visibility of constants - https://phabricator.wikimedia.org/T250576 (10Umherirrender) That already exists, is active and is the thirdmost excluded one: `PSR12.Properties.ConstantVisibility.NotFound` https://tools.wmflabs.org/phpcs/ [21:14:58] 10MediaWiki-Codesniffer, 10User-DannyS712: Add a sniff for visibility of constants - https://phabricator.wikimedia.org/T250576 (10DannyS712) 05Open→03Invalid Whoops [21:16:18] 10MediaWiki-Codesniffer: PHPCS complains about unused use statements if used in @method - https://phabricator.wikimedia.org/T250573 (10Umherirrender) I would assume that phan allows to use full namespace here. The sniff also supports the old @type, than it could be possible to support @method as well [21:18:41] (03PS5) 10Awight: [DNM] debugging in CI [integration/quibble] - 10https://gerrit.wikimedia.org/r/589860 [21:29:09] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Jessie Deprecation): Migrate deployment-prep away from Debian Jessie to Debian Stretch/Buster - https://phabricator.wikimedia.org/T218729 (10Krenair) [21:34:08] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Jessie Deprecation): Determine purpose of deployment-memc0[67] - https://phabricator.wikimedia.org/T250585 (10Krenair) [21:34:28] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Jessie Deprecation): Determine purpose of deployment-memc0[67] - https://phabricator.wikimedia.org/T250585 (10Krenair) [21:35:15] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Jessie Deprecation): Migrate deployment-prep away from Debian Jessie to Debian Stretch/Buster - https://phabricator.wikimedia.org/T218729 (10Krenair) [21:49:02] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Jessie Deprecation): Migrate deployment-prep away from Debian Jessie to Debian Stretch/Buster - https://phabricator.wikimedia.org/T218729 (10Krenair) [21:50:56] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team-TODO, 10Wikimedia-Logstash, 10observability: logstash-beta.wmflabs.org does not receive any mediawiki events - https://phabricator.wikimedia.org/T233134 (10Krenair) >>! In T233134#5744752, @herron wrote: > Yes, we will need a second logstash stretch... [22:25:44] (03PS6) 10Awight: [DNM] debugging in CI [integration/quibble] - 10https://gerrit.wikimedia.org/r/589860 [22:36:27] (03Abandoned) 10Awight: [DNM] debugging in CI [integration/quibble] - 10https://gerrit.wikimedia.org/r/589860 (owner: 10Awight) [22:42:56] 10Phabricator, 10Repository-Admins: Request for adding Zoranzoki21 in #Repository-Admins - https://phabricator.wikimedia.org/T250119 (10Zoranzoki21) 05Declined→03Open @MGChecker "objects this refusal", so I will reopen this again. [22:53:52] 10Gerrit, 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10ci-test-error (WMF-deployed Build Failure): Jenkins job failing intermittently due to Gerrit HTTP 502 errors when cloning repos - https://phabricator.wikimedia.org/T246763 (10Krinkle) [22:54:16] 10Continuous-Integration-Config, 10MediaWiki-Core-Testing, 10Quibble, 10ci-test-error (WMF-deployed Build Failure): Jenkins build for MediaWiki should fail when "PHP Warning" is emitted - https://phabricator.wikimedia.org/T214552 (10Krinkle) [22:54:18] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10ci-test-error (WMF-deployed Build Failure): fatal: remote error: access denied or repository not exported: /mediawiki/extensions/ReadingL... - https://phabricator.wikimedia.org/T187897 [23:04:18] (03PS25) 10Awight: Parallelism as a command object; parallelize short PHPUnits [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) [23:10:49] (03CR) 10Awight: "PS 25: Deep dive into a stagnant lagoon fed by unix streams." [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) (owner: 10Awight)