[04:09:31] PROBLEM - Host deployment-maps05 is DOWN: CRITICAL - Host Unreachable (172.16.4.168) [04:09:32] PROBLEM - App Server Main HTTP Response on deployment-mediawiki-09 is CRITICAL: HTTP CRITICAL: HTTP/1.1 302 Found - string 'Wikipedia' not found on 'http://en.wikipedia.beta.wmflabs.org:80/wiki/Main_Page?debug=true' - 716 bytes in 0.478 second response time [04:55:59] 10Phabricator, 10DBA: Upgrade m3 to Buster and MariaDB 10.4 - https://phabricator.wikimedia.org/T259589 (10Marostegui) @mmodell Thursday is a non deployment day, so let's move this to Tuesday 18th if that's ok? So that would be Tuesday 18th at 05:00 AM UTC? [08:15:13] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Doxygen, and 2 others: mwext-doxygen-publish Doxygen 1.8.18 fails for Wikibase.gi... - https://phabricator.wikimedia.org/T254465 [08:28:50] (03PS2) 10Hashar: jjb: Define test pipeline for Wikispeech services. [integration/config] - 10https://gerrit.wikimedia.org/r/619038 (https://phabricator.wikimedia.org/T259911) (owner: 10Karl Wettin (WMSE)) [08:29:34] (03CR) 10Hashar: [C: 03+2] "Perfect! I have just amended the commit message to add the list of jobs being created :]" [integration/config] - 10https://gerrit.wikimedia.org/r/619038 (https://phabricator.wikimedia.org/T259911) (owner: 10Karl Wettin (WMSE)) [08:30:26] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Wikispeech-Jobrunner, and 4 others: Tell Jenkins and Zuul about the Speechoid pip... - https://phabricator.wikimedia.org/T259911 [08:30:34] (03Merged) 10jenkins-bot: jjb: Define test pipeline for Wikispeech services. [integration/config] - 10https://gerrit.wikimedia.org/r/619038 (https://phabricator.wikimedia.org/T259911) (owner: 10Karl Wettin (WMSE)) [08:31:03] !log Reloaded Zuul for Wikispeech services https://gerrit.wikimedia.org/r/c/integration/config/+/619038 [08:31:05] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:32:50] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Wikispeech-Jobrunner, and 4 others: Tell Jenkins and Zuul about the Speechoid pip... - https://phabricator.wikimedia.org/T259911 [08:34:39] (03CR) 10Hashar: [C: 03+2] dockerfiles: update most ENTRYPOINT to exec form [integration/config] - 10https://gerrit.wikimedia.org/r/618962 (owner: 10Hashar) [08:35:31] (03Merged) 10jenkins-bot: dockerfiles: update most ENTRYPOINT to exec form [integration/config] - 10https://gerrit.wikimedia.org/r/618962 (owner: 10Hashar) [08:36:09] !log Building docker images for https://gerrit.wikimedia.org/r/618962 "update most ENTRYPOINT to exec form" [08:36:10] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:44:38] 10Phabricator: Custom task forms for #WMNO-General - https://phabricator.wikimedia.org/T258787 (10jhsoby-WMNO) [08:58:55] (03CR) 10Hashar: "And of course there are some other issues:" [integration/config] - 10https://gerrit.wikimedia.org/r/618962 (owner: 10Hashar) [09:04:21] (03PS1) 10Hashar: dockefiles: properly update mtail and gdnsd [integration/config] - 10https://gerrit.wikimedia.org/r/619261 [09:04:39] (03CR) 10Hashar: [C: 03+2] dockefiles: properly update mtail and gdnsd [integration/config] - 10https://gerrit.wikimedia.org/r/619261 (owner: 10Hashar) [09:05:31] (03Merged) 10jenkins-bot: dockefiles: properly update mtail and gdnsd [integration/config] - 10https://gerrit.wikimedia.org/r/619261 (owner: 10Hashar) [09:10:12] !log Rebuilding images opereations-dns-lint and operations-puppet ( https://gerrit.wikimedia.org/r/619261 ) [09:10:14] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [09:54:12] (03PS1) 10Hashar: jjb: update operations-puppet [integration/config] - 10https://gerrit.wikimedia.org/r/619266 [09:54:15] (03PS1) 10Hashar: jjb: update operations-dns-lint-docker [integration/config] - 10https://gerrit.wikimedia.org/r/619267 [09:56:31] (03CR) 10Hashar: [C: 03+2] jjb: update operations-puppet [integration/config] - 10https://gerrit.wikimedia.org/r/619266 (owner: 10Hashar) [09:56:36] (03CR) 10Hashar: [C: 03+2] jjb: update operations-dns-lint-docker [integration/config] - 10https://gerrit.wikimedia.org/r/619267 (owner: 10Hashar) [09:57:40] (03Merged) 10jenkins-bot: jjb: update operations-puppet [integration/config] - 10https://gerrit.wikimedia.org/r/619266 (owner: 10Hashar) [09:57:46] (03Merged) 10jenkins-bot: jjb: update operations-dns-lint-docker [integration/config] - 10https://gerrit.wikimedia.org/r/619267 (owner: 10Hashar) [10:03:20] (03PS1) 10Hashar: jjb: update to convert ENTRYPOINT to exec form [integration/config] - 10https://gerrit.wikimedia.org/r/619268 [10:03:46] (03CR) 10Hashar: [C: 03+2] jjb: update to convert ENTRYPOINT to exec form [integration/config] - 10https://gerrit.wikimedia.org/r/619268 (owner: 10Hashar) [10:04:50] (03Merged) 10jenkins-bot: jjb: update to convert ENTRYPOINT to exec form [integration/config] - 10https://gerrit.wikimedia.org/r/619268 (owner: 10Hashar) [10:05:09] (03PS3) 10Hashar: dockerfiles: Provide composer-test-php73 [integration/config] - 10https://gerrit.wikimedia.org/r/618331 (owner: 10Jforrester) [10:05:45] (03CR) 10Hashar: [C: 03+2] "Rebased. The parent change was no more up to date / conflicted." [integration/config] - 10https://gerrit.wikimedia.org/r/618331 (owner: 10Jforrester) [10:06:44] (03Merged) 10jenkins-bot: dockerfiles: Provide composer-test-php73 [integration/config] - 10https://gerrit.wikimedia.org/r/618331 (owner: 10Jforrester) [10:09:48] 10Beta-Cluster-Infrastructure, 10The-Wikipedia-Library: Email spam from Betawiki - https://phabricator.wikimedia.org/T256297 (10Samwalton9) @Catrope Would it be possible for you to disable this extension on Beta Wiki? [10:14:40] !log Successfully tagged docker-registry.discovery.wmnet/releng/composer-test-php73:0.1.0 [10:14:42] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:15:44] (03CR) 10Hashar: "Successfully tagged docker-registry.discovery.wmnet/releng/composer-test-php73:0.1.0" [integration/config] - 10https://gerrit.wikimedia.org/r/618331 (owner: 10Jforrester) [10:18:06] (03CR) 10Hashar: [C: 03+2] jjb: Provide mwgate-composer-php73-docker [integration/config] - 10https://gerrit.wikimedia.org/r/618332 (owner: 10Jforrester) [10:18:18] (03CR) 10jerkins-bot: [V: 04-1] jjb: Provide mwgate-composer-php73-docker [integration/config] - 10https://gerrit.wikimedia.org/r/618332 (owner: 10Jforrester) [10:21:18] (03PS2) 10Hashar: jjb: Provide mwgate-composer-php73-docker [integration/config] - 10https://gerrit.wikimedia.org/r/618332 (owner: 10Jforrester) [10:22:03] (03CR) 10Hashar: [C: 03+2] "Job created" [integration/config] - 10https://gerrit.wikimedia.org/r/618332 (owner: 10Jforrester) [10:23:00] (03Merged) 10jenkins-bot: jjb: Provide mwgate-composer-php73-docker [integration/config] - 10https://gerrit.wikimedia.org/r/618332 (owner: 10Jforrester) [10:27:02] (03CR) 10Hashar: "We would want to test it first. IIRC Phan requires some specific version of php-ast isn't it?" [integration/config] - 10https://gerrit.wikimedia.org/r/618333 (owner: 10Jforrester) [10:54:55] (03Abandoned) 10Hashar: [WIP] mediawiki-tarball-builder job [integration/config] - 10https://gerrit.wikimedia.org/r/471036 (https://phabricator.wikimedia.org/T208527) (owner: 10Legoktm) [10:55:31] 10MediaWiki-Releasing, 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10Patch-For-Review, 10Security: Create jenkins job to build MediaWiki tarball releases - https://phabricator.wikimedia.org/T208527 (10hashar) [11:25:41] 10Continuous-Integration-Infrastructure, 10VisualEditor, 10Editing-team (FY2020-21 Kanban Board), 10ci-test-error (WMF-deployed Build Failure): Karma tests using Firefox in VisualEditor/VisualEditor repo are failing - https://phabricator.wikimedia.org/T259925 (10Esanders) I think we had this issue before w... [11:29:32] hashar: Have you seen T259925? Looks like something updated the browser version? (Sorry, too busy to help. :-() [11:29:32] T259925: Karma tests using Firefox in VisualEditor/VisualEditor repo are failing - https://phabricator.wikimedia.org/T259925 [12:23:40] 10Continuous-Integration-Infrastructure, 10VisualEditor, 10Editing-team (FY2020-21 Kanban Board), 10ci-test-error (WMF-deployed Build Failure): Karma tests using Firefox in VisualEditor/VisualEditor repo are failing - https://phabricator.wikimedia.org/T259925 (10hashar) CI wise, I have changed the job to u... [12:26:31] James_F: yeah got that one ;) easy [12:27:14] (03PS1) 10Hashar: jjb: rollback node10-test-browser to 0.6.0-s1 [2] [integration/config] - 10https://gerrit.wikimedia.org/r/619288 (https://phabricator.wikimedia.org/T240955) [12:28:11] (03CR) 10Hashar: "Jobs updated!" [integration/config] - 10https://gerrit.wikimedia.org/r/619288 (https://phabricator.wikimedia.org/T240955) (owner: 10Hashar) [12:28:27] James_F: I have rolled back the jobs. Looks like you already had the issue previously. ^^ just need a +2 ;) [12:32:05] (03CR) 10Hashar: [C: 03+2] jjb: rollback node10-test-browser to 0.6.0-s1 [2] [integration/config] - 10https://gerrit.wikimedia.org/r/619288 (https://phabricator.wikimedia.org/T240955) (owner: 10Hashar) [12:33:03] (03Merged) 10jenkins-bot: jjb: rollback node10-test-browser to 0.6.0-s1 [2] [integration/config] - 10https://gerrit.wikimedia.org/r/619288 (https://phabricator.wikimedia.org/T240955) (owner: 10Hashar) [12:33:40] 10Continuous-Integration-Infrastructure, 10VisualEditor, 10Editing-team (FY2020-21 Kanban Board), 10Patch-For-Review, and 2 others: Karma tests using Firefox in VisualEditor/VisualEditor repo are failing - https://phabricator.wikimedia.org/T259925 (10hashar) 05Open→03Resolved a:03hashar And indeed Fi... [12:35:21] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10VisualEditor, and 2 others: Firefox CI tests keep failing in VE with Firefox 68 - https://phabricator.wikimedia.org/T240955 (10hashar) [12:54:10] hashar: Thanks. [13:16:21] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10VisualEditor, 10Editing-team (Tracking): Firefox CI tests keep failing in VE with Firefox 68 - https://phabricator.wikimedia.org/T240955 (10hashar) We would need a way to reproduce the... [13:19:22] 10Gerrit: is:wip flag doesn't seem to be working in gerrit with reviewers - https://phabricator.wikimedia.org/T260054 (10Mvolz) [13:28:21] 10phan-taint-check-plugin: Use phan to ensure __CLASS__ doesn't end up in a filename - https://phabricator.wikimedia.org/T259986 (10Daimona) Perhaps in a dedicated plugin (and not taint-check) but yes, seems doable. Maybe it could be suitable for an upstream plugin, too. [13:47:13] 10Phabricator, 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Operations, 10Traffic, and 2 others: Phabricator downtime due to aphlict and websockets (aphlict current disabled) - https://phabricator.wikimedia.org/T238593 (10hashar) Went to https://phabric... [14:25:06] (03CR) 10Lars Wirzenius: "I haven't gone through the code changes in detail, but commit message or a doc update that explains a use case for this would be good." [blubber] - 10https://gerrit.wikimedia.org/r/619072 (owner: 10Dduvall) [14:28:26] 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10MediaWiki Train Development Environment: train-dev: Rename "vdc" to "train-dev" - https://phabricator.wikimedia.org/T259608 (10LarsWirzenius) I agree that train-dev/train-dev would be a little strange. As a first... [14:52:23] 10Beta-Cluster-Infrastructure, 10VPS-Projects, 10Puppet: Puppet failures on deployment-docker-changeprop01, deployment-docker-cpjobqueue01, deployment-push-notifications01, deployment-docker-mobileapps01, and deployment-docker-proton01 due to Docker version pinning - https://phabricator.wikimedia.org/T259812 (... [15:01:10] (03PS1) 10Umherirrender: Add PropertyCommentSniff to validate @var on class properties [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/619304 [15:17:48] 10Phabricator, 10Wikipedia-iOS-App-Backlog: Update Herald (H187) to include project 4661 - https://phabricator.wikimedia.org/T259938 (10MBinder_WMF) 05Open→03Resolved [15:17:51] (03PS1) 10Umherirrender: Fix handling of comment string for MissingReturnType [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/619307 [15:18:01] 10MediaWiki-Codesniffer, 10Wikidata: Evaluate the future of wikibase-codesniffer - https://phabricator.wikimedia.org/T253624 (10Addshore) So looking at the great analysis from @thiemowmde it looks like we could / should in order to be in the best position to get rid of wikbase-codesniffer: - Look at review an... [15:18:16] 10MediaWiki-Codesniffer, 10Wikidata, 10User-Addshore: Evaluate the future of wikibase-codesniffer - https://phabricator.wikimedia.org/T253624 (10Addshore) [15:18:23] 10Phabricator, 10Wikipedia-iOS-App-Backlog: Update Herald (H187) to include project 4831 - https://phabricator.wikimedia.org/T259939 (10MBinder_WMF) 05Open→03Resolved [15:19:15] 10Phabricator, 10Wikipedia-iOS-App-Backlog: Update Herald (H187) to include project 4862 - https://phabricator.wikimedia.org/T259940 (10MBinder_WMF) 05Open→03Resolved [15:19:37] 10Phabricator, 10Wikipedia-iOS-App-Backlog: Update Herald (H187) to include project 4863 - https://phabricator.wikimedia.org/T259941 (10MBinder_WMF) 05Open→03Resolved [15:26:38] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Operations: jenkins CI broken for operations/puppet - https://phabricator.wikimedia.org/T260063 (10thcipriani) Change from this morning seems innocuous 1bb229918b88bfdcd2eeea1c89002dfb1a63f401 but let's revert b629dc949c50... [15:27:23] (03PS1) 10Thcipriani: Revert "jjb: update operations-puppet" [integration/config] - 10https://gerrit.wikimedia.org/r/619311 (https://phabricator.wikimedia.org/T260063) [15:33:47] (03CR) 10Thcipriani: [C: 03+2] "deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/619311 (https://phabricator.wikimedia.org/T260063) (owner: 10Thcipriani) [15:34:54] (03Merged) 10jenkins-bot: Revert "jjb: update operations-puppet" [integration/config] - 10https://gerrit.wikimedia.org/r/619311 (https://phabricator.wikimedia.org/T260063) (owner: 10Thcipriani) [15:39:55] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Operations, 10Patch-For-Review: `releng/operations-puppet:0.7.5` docker image broke the `operations-puppet-tests-buster-docker` CI job - https://phabricator.wikimedia.org/T260063 (10thcipriani) [15:41:47] (03CR) 10Ahmon Dancy: "> Patch Set 1:" [blubber] - 10https://gerrit.wikimedia.org/r/619072 (owner: 10Dduvall) [15:48:45] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Analytics, 10Analytics-Kanban, 10Event-Platform: Set up Jenkins maven release job for wikimedia-event-utilities like analytics/refinery/source - https://phabricator.wikimedia.org/T259898 (10mforns) p:05Triage→03High [15:51:24] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10User-dancy, 10castor: Investigate again a central cache for package managers - https://phabricator.wikimedia.org/T147635 (10dancy) a:05dancy→03None [15:54:52] 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10MediaWiki Train Development Environment: train-dev: Rename "vdc" to "train-dev" - https://phabricator.wikimedia.org/T259608 (10dancy) a:05LarsWirzenius→03dancy [15:58:14] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Operations, 10Patch-For-Review: `releng/operations-puppet:0.7.5` docker image broke the `operations-puppet-tests-buster-docker` CI job - https://phabricator.wikimedia.org/T260063 (10hashar) **TLDR puppet 5.5.21 breaks it... [16:05:00] 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10MediaWiki Train Development Environment, 10User-dancy: train-dev: Rename "vdc" to "train-dev" - https://phabricator.wikimedia.org/T259608 (10dancy) [16:05:04] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Operations, 10Patch-For-Review: `releng/operations-puppet:0.7.5` docker image broke the `operations-puppet-tests-buster-docker` CI job - https://phabricator.wikimedia.org/T260063 (10hashar) If I got it right, our puppet... [16:15:16] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Operations, 10Patch-For-Review: `releng/operations-puppet:0.7.5` docker image broke the `operations-puppet-tests-buster-docker` CI job - https://phabricator.wikimedia.org/T260063 (10hashar) a:03hashar [16:23:42] 10MediaWiki-Releasing, 10Analytics: Create dashboard showing MediaWiki tarball download statistics - https://phabricator.wikimedia.org/T119772 (10mforns) 05Open→03Declined Declining, because we have the datasets from the pingback extension. Please, reopen if necessary. [16:44:10] 10MediaWiki-Releasing, 10Analytics: Create dashboard showing MediaWiki tarball download statistics - https://phabricator.wikimedia.org/T119772 (10CCicalese_WMF) Note that the pingback reports are still broken: https://phabricator.wikimedia.org/T246154. [17:08:47] 10Phabricator, 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Operations, 10Traffic, and 2 others: Phabricator downtime due to aphlict and websockets (aphlict current disabled) - https://phabricator.wikimedia.org/T238593 (10mmodell) >>! In T238593#6372927... [17:12:40] 10Beta-Cluster-Infrastructure, 10VPS-Projects, 10Puppet: Puppet failures on deployment-docker-changeprop01, deployment-docker-cpjobqueue01, deployment-push-notifications01, deployment-docker-mobileapps01, and deployment-docker-proton01 due to Docker version pinning - https://phabricator.wikimedia.org/T259812 (... [17:32:46] 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10MediaWiki Train Development Environment, 10Patch-For-Review, 10User-dancy: train-dev: Rename "vdc" to "train-dev" - https://phabricator.wikimedia.org/T259608 (10dancy) 05Open→03Resolved [17:33:02] 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10MediaWiki Train Development Environment, 10Patch-For-Review, 10User-dancy: train-dev: Rename "vdc" to "train-dev" - https://phabricator.wikimedia.org/T259608 (10dancy) p:05Triage→03Low [17:33:34] 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10MediaWiki Train Development Environment, 10Patch-For-Review, 10User-dancy: train-dev: Rename "vdc" to "train-dev" - https://phabricator.wikimedia.org/T259608 (10dancy) Re-opened since the 'vdc' subdir still e... [17:34:08] 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10MediaWiki Train Development Environment, 10Patch-For-Review, 10User-dancy: train-dev: Rename "vdc" to "train-dev" - https://phabricator.wikimedia.org/T259608 (10dancy) 05Resolved→03Open [17:43:47] PROBLEM - App Server Main HTTP Response on deployment-mediawiki-07 is CRITICAL: HTTP CRITICAL: HTTP/1.1 302 Found - string 'Wikipedia' not found on 'http://en.wikipedia.beta.wmflabs.org:80/wiki/Main_Page?debug=true' - 715 bytes in 0.058 second response time [18:21:33] 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10MediaWiki Train Development Environment: train-dev: Include sample security patches in deploy VM - https://phabricator.wikimedia.org/T260079 (10dancy) [18:24:30] 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10MediaWiki Train Development Environment: train-dev: Include sample security patches in deploy VM - https://phabricator.wikimedia.org/T260079 (10dancy) [19:44:23] (03PS1) 10Hashar: dockerfiles: rebuild operations-puppet for Gemfile [integration/config] - 10https://gerrit.wikimedia.org/r/619357 (https://phabricator.wikimedia.org/T260063) [19:45:59] (03CR) 10Hashar: [C: 03+2] dockerfiles: rebuild operations-puppet for Gemfile [integration/config] - 10https://gerrit.wikimedia.org/r/619357 (https://phabricator.wikimedia.org/T260063) (owner: 10Hashar) [19:47:06] (03Merged) 10jenkins-bot: dockerfiles: rebuild operations-puppet for Gemfile [integration/config] - 10https://gerrit.wikimedia.org/r/619357 (https://phabricator.wikimedia.org/T260063) (owner: 10Hashar) [19:50:06] 10Gerrit, 10Patch-For-Review: Use WMF Gerrit's logo as favicon - https://phabricator.wikimedia.org/T257218 (10Dzahn) The "green git logo" has won the poll with 56% approval and with the merge above it has now been deployed as the Gerrit favicon. This should mean the ticket is resolved, afaict. [20:09:45] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Operations, 10Patch-For-Review: `releng/operations-puppet:0.7.5` docker image broke the `operations-puppet-tests-buster-docker` CI job - https://phabricator.wikimedia.org/T260063 (10hashar) Thanks @cdanis for the reviews... [20:11:42] (03PS1) 10Hashar: jjb: update operations-puppet [2] [integration/config] - 10https://gerrit.wikimedia.org/r/619359 (https://phabricator.wikimedia.org/T260063) [20:15:46] (03CR) 10Hashar: [C: 03+2] "I have updated the jobs and did a recheck on a couple puppet patch that failed. They pass now ;)" [integration/config] - 10https://gerrit.wikimedia.org/r/619359 (https://phabricator.wikimedia.org/T260063) (owner: 10Hashar) [20:15:59] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Operations, 10Patch-For-Review: `releng/operations-puppet:0.7.5` docker image broke the `operations-puppet-tests-buster-docker` CI job - https://phabricator.wikimedia.org/T260063 (10hashar) 05Open→03Resolved I have u... [20:16:14] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Operations: `releng/operations-puppet:0.7.5` docker image broke the `operations-p... - https://phabricator.wikimedia.org/T260063 [20:16:42] (03Merged) 10jenkins-bot: jjb: update operations-puppet [2] [integration/config] - 10https://gerrit.wikimedia.org/r/619359 (https://phabricator.wikimedia.org/T260063) (owner: 10Hashar) [20:25:53] i will soon switch the backend and rsync source for releases.wikimedia.org. if you are a releaser please don't upload one to releases1001 like right now. i will send a mail today and then please start using releases1002. there will also be a warning in the MOTD [20:27:28] * hauskatze uploads a release to releases1001 as instructed by mutante [20:34:06] hauskatze: permission denied :) [20:36:38] indeed [21:17:27] 10Phabricator, 10DBA: Upgrade m3 to Buster and MariaDB 10.4 - https://phabricator.wikimedia.org/T259589 (10mmodell) @marostegui: That works for me. [22:02:59] PROBLEM - Host deployment-chromium01 is DOWN: CRITICAL - Host Unreachable (172.16.4.108) [22:12:45] 10Scap, 10Platform Engineering (Icebox): scap3 rollback does not depool servers before rolling back - https://phabricator.wikimedia.org/T239616 (10ssastry) [22:44:35] (03PS1) 10Krinkle: Enable CI for performance/WikimediaDebug repository [integration/config] - 10https://gerrit.wikimedia.org/r/619391 (https://phabricator.wikimedia.org/T260089) [22:44:55] (03CR) 10Krinkle: [C: 03+2] Enable CI for performance/WikimediaDebug repository [integration/config] - 10https://gerrit.wikimedia.org/r/619391 (https://phabricator.wikimedia.org/T260089) (owner: 10Krinkle) [22:45:49] (03Merged) 10jenkins-bot: Enable CI for performance/WikimediaDebug repository [integration/config] - 10https://gerrit.wikimedia.org/r/619391 (https://phabricator.wikimedia.org/T260089) (owner: 10Krinkle) [22:56:07] !log Cleaned up beta puppet to remove previously cherry-picked patches where are now merged. [22:56:09] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [23:00:53] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/619391 [23:00:55] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [23:01:41] !log puppetdb on deployment-puppetdb03 died Aug 8 22:12:28 due to out-of-memory; restarted. [23:01:43] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL