[07:06:20] PROBLEM - Free space - all mounts on integration-agent-docker-1008 is CRITICAL: CRITICAL: integration.integration-agent-docker-1008.diskspace._srv.byte_percentfree (<22.22%) [07:21:19] RECOVERY - Free space - all mounts on integration-agent-docker-1008 is OK: OK: All targets OK [08:28:26] PROBLEM - Host deployment-changeprop is DOWN: CRITICAL - Host Unreachable (172.16.5.21) [08:28:26] PROBLEM - Host deployment-cpjobqueue is DOWN: CRITICAL - Host Unreachable (172.16.4.124) [08:28:26] PROBLEM - Host deployment-chromium02 is DOWN: CRITICAL - Host Unreachable (172.16.4.14) [09:24:14] 10Beta-Cluster-Infrastructure, 10VPS-Projects, 10Puppet: Puppet failures on deployment-docker-changeprop01, deployment-docker-cpjobqueue01, deployment-push-notifications01, deployment-docker-mobileapps01, and deployment-docker-proton01 due to Docker version pinning - https://phabricator.wikimedia.org/T259812 (... [09:36:04] 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.36.0-wmf.3 deployment blockers - https://phabricator.wikimedia.org/T257971 (10Tacsipacsi) [09:48:16] 10Continuous-Integration-Infrastructure, 10Operations, 10Jenkins: Update Jenkins gpg release key in reprepro - https://phabricator.wikimedia.org/T259116 (10hashar) 05Open→03Resolved a:03akosiaris thank you [10:07:05] 10Continuous-Integration-Infrastructure, 10Operations, 10Jenkins: Update Jenkins gpg release key in reprepro - https://phabricator.wikimedia.org/T259116 (10akosiaris) >>! In T259116#6365994, @akosiaris wrote: >> I could not find where we store that key in puppet :-\ > > That's cause we don't store it. We ju... [10:22:49] 10Gerrit: `mediawiki-replication` Gerrit group is hidden - https://phabricator.wikimedia.org/T241461 (10hashar) 05Open→03Resolved a:03hashar The group is hidden since it is not meant to have any member. That is used to define which repository have to be replicated to Github. In puppet: ` lang=yaml,name=h... [10:26:17] 10Gerrit, 10Pywikibot: Recursive clone over ssh uses https for submodules - https://phabricator.wikimedia.org/T57654 (10hashar) 05Open→03Declined [10:59:45] (03CR) 10Privacybatm: [C: 03+1] "@Hashar, I understood debian glue tests the correctness of packaging on WMCS when the patch touches a file under debian directory." [integration/config] - 10https://gerrit.wikimedia.org/r/618756 (https://phabricator.wikimedia.org/T253736) (owner: 10Hashar) [11:00:36] PROBLEM - Host deployment-mcs01 is DOWN: CRITICAL - Host Unreachable (172.16.5.64) [11:03:20] (03CR) 10Hashar: [C: 03+2] "The job just build with cowbuilder as configured via puppet modules/package_builder. The result is captured in the Jenkins build artifact," [integration/config] - 10https://gerrit.wikimedia.org/r/618756 (https://phabricator.wikimedia.org/T253736) (owner: 10Hashar) [11:04:18] (03Merged) 10jenkins-bot: Add debian-glue to operations/software/transferpy [integration/config] - 10https://gerrit.wikimedia.org/r/618756 (https://phabricator.wikimedia.org/T253736) (owner: 10Hashar) [11:09:48] (03CR) 10Jcrespo: [C: 03+1] "I saw this late, but +1, will be quite useful." [integration/config] - 10https://gerrit.wikimedia.org/r/618756 (https://phabricator.wikimedia.org/T253736) (owner: 10Hashar) [11:30:10] (03PS1) 10Hashar: dockerfiles: update most ENTRYPOINT to exec form [integration/config] - 10https://gerrit.wikimedia.org/r/618962 [11:32:05] (03CR) 10Hashar: dockerfiles: Provide composer-test-php73 (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/618331 (owner: 10Jforrester) [11:32:20] (03PS2) 10Hashar: dockerfiles: Provide composer-test-php73 [integration/config] - 10https://gerrit.wikimedia.org/r/618331 (owner: 10Jforrester) [11:35:33] (03CR) 10Hashar: "That change is unrelated but would upgrade mtail (wmf1 > wmf2), probably trivial :)" [integration/config] - 10https://gerrit.wikimedia.org/r/618962 (owner: 10Hashar) [11:35:41] (03CR) 10Hashar: [C: 03+1] dockerfiles: Provide composer-test-php73 [integration/config] - 10https://gerrit.wikimedia.org/r/618331 (owner: 10Jforrester) [11:36:26] (03CR) 10Hashar: [C: 03+1] jjb: Provide mwgate-composer-php73-docker [integration/config] - 10https://gerrit.wikimedia.org/r/618332 (owner: 10Jforrester) [11:52:06] 10Gerrit, 10Release-Engineering-Team (Development services), 10Repository-Admins, 10User-MarcoAurelio: Decide whether requests for new Gerrit repos are handled on mediawiki.org or in Phabricator (currently it's both) - https://phabricator.wikimedia.org/T259147 (10MarcoAurelio) 05Open→03Resolved a:03Ma... [12:31:55] 10Continuous-Integration-Config, 10Code-Health-Metrics, 10Code-Health: Error in code coverage reports for extensions in codehealth-pipeline - https://phabricator.wikimedia.org/T232195 (10hashar) [12:31:59] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Patch-For-Review, 10User-DannyS712: mwext-codehealth-master-non-voting erase do... - https://phabricator.wikimedia.org/T259109 [12:32:11] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Patch-For-Review, 10User-DannyS712: mwext-codehealth-master-non-voting erase do... - https://phabricator.wikimedia.org/T259109 [12:34:43] 10Continuous-Integration-Config, 10Code-Health-Metrics, 10Code-Health: Error in code coverage reports for extensions in codehealth-pipeline - https://phabricator.wikimedia.org/T232195 (10hashar) I propose: * we reintroduce the `extension-coverage` template which will be in charge of publishing to doc.wikimed... [12:35:12] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Code-Health-Metrics, 10Code-Health: Error in code coverage reports for extensio... - https://phabricator.wikimedia.org/T232195 [12:47:52] 10MediaWiki-Releasing, 10MW-1.35-notes, 10MW-1.35-release: Write release announcement for 1.35.0-rc.1 - https://phabricator.wikimedia.org/T259882 (10Reedy) [12:54:54] 10MediaWiki-Releasing, 10MW-1.35-notes, 10MW-1.35-release: Write release announcement for 1.35.0-rc.1 - https://phabricator.wikimedia.org/T259882 (10Reedy) [12:57:05] 10Gerrit, 10Release-Engineering-Team (Development services), 10Repository-Admins, 10User-MarcoAurelio: Decide whether requests for new Gerrit repos are handled on mediawiki.org or in Phabricator (currently it's both) - https://phabricator.wikimedia.org/T259147 (10Aklapper) Thanks for the decision everybody! [13:22:08] 10MediaWiki-Releasing, 10MW-1.35-notes, 10MW-1.35-release: Write release announcement for 1.35.0-rc.1 - https://phabricator.wikimedia.org/T259882 (10Reedy) [13:23:20] 10MediaWiki-Releasing, 10MW-1.35-release: Release 1.35.0-rc.2 - https://phabricator.wikimedia.org/T259885 (10Reedy) [13:23:33] 10MediaWiki-Releasing, 10MW-1.35-release: Release 1.35.0-rc.2 - https://phabricator.wikimedia.org/T259885 (10Reedy) [13:23:49] 10MediaWiki-Releasing, 10MW-1.35-release: Write release announcement for 1.35.0-rc.2 - https://phabricator.wikimedia.org/T259886 (10Reedy) [13:35:23] 10MediaWiki-Releasing, 10MW-1.35-notes, 10MW-1.35-release: Write release announcement for 1.35.0-rc.1 - https://phabricator.wikimedia.org/T259882 (10Reedy) 05Open→03Resolved a:03Reedy [13:35:25] 10MediaWiki-Releasing, 10MW-1.35-notes, 10MW-1.35-release, 10Patch-For-Review: Release 1.35.0-rc.1 - https://phabricator.wikimedia.org/T259430 (10Reedy) [13:35:36] 10MediaWiki-Releasing, 10MW-1.35-notes, 10MW-1.35-release, 10Patch-For-Review: Release 1.35.0-rc.1 - https://phabricator.wikimedia.org/T259430 (10Reedy) 05Open→03Resolved a:03Reedy [13:35:38] 10MediaWiki-Releasing, 10MW-1.35-notes, 10MW-1.35-release, 10Platform Team Workboards (Initiatives): Release MW 1.35.0 - https://phabricator.wikimedia.org/T256375 (10Reedy) [14:03:31] 10Beta-Cluster-Infrastructure, 10VPS-Projects, 10Puppet: Puppet failures on deployment-docker-changeprop01, deployment-docker-cpjobqueue01, deployment-push-notifications01, deployment-docker-mobileapps01, and deployment-docker-proton01 due to Docker version pinning - https://phabricator.wikimedia.org/T259812 (... [14:26:47] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10phan: Phan CI jobs should emit a checkstyle XML file - https://phabricator.wikimedia.org/T259890 (10hashar) [14:27:59] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10phan, 10Jenkins: Create a jenkins section for phan - https://phabricator.wikimedia.org/T240748 (10hashar) 05Open... [14:44:44] 10Continuous-Integration-Config, 10Wikidata, 10Documentation, 10Doxygen, 10User-Addshore: Investigate auto generating LUA docs with doxygen - https://phabricator.wikimedia.org/T241478 (10hashar) It seems those plugins might not be that well maintained. There are some tools listed on the LUA users wiki a... [14:44:54] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Wikidata, 10Documentation, and 2 others: Investigate auto generating LUA docs with doxygen - https://phabricator.wikimedia.org/T241478 (10hashar) [14:57:27] (03CR) 10Cwhite: "> Patch Set 1:" [integration/config] - 10https://gerrit.wikimedia.org/r/618962 (owner: 10Hashar) [14:58:31] 10Continuous-Integration-Infrastructure, 10Operations, 10Jenkins: Update Jenkins gpg release key in reprepro - https://phabricator.wikimedia.org/T259116 (10hashar) [15:04:39] 10Phabricator: Phabricator reports and admin issue: "Unable to Connect to Notification Server" - https://phabricator.wikimedia.org/T259895 (10hashar) [15:05:26] 10Phabricator: Phabricator reports and admin issue: "Unable to Connect to Notification Server" - https://phabricator.wikimedia.org/T259895 (10hashar) [15:05:30] 10Phabricator, 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Operations, 10Traffic, and 2 others: Phabricator downtime due to aphlict and websockets (aphlict current disabled) - https://phabricator.wikimedia.org/T238593 (10hashar) [15:05:34] 10Phabricator: Phabricator reports and admin issue: "Unable to Connect to Notification Server" - https://phabricator.wikimedia.org/T259895 (10hashar) That is apparently known: T238593 ;) [15:06:53] 10Phabricator, 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Operations, 10Traffic, and 2 others: Phabricator downtime due to aphlict and websockets (aphlict current disabled) - https://phabricator.wikimedia.org/T238593 (10hashar) I filed a dupe of this... [15:10:33] (03CR) 10Hashar: "Cool. Lets hold the rebuilding until Monday :)" [integration/config] - 10https://gerrit.wikimedia.org/r/618962 (owner: 10Hashar) [15:17:38] (03CR) 10Hashar: "The release job is manually triggered and would surely need a few tweaks here and there." [integration/config] - 10https://gerrit.wikimedia.org/r/618801 (https://phabricator.wikimedia.org/T251609) (owner: 10Ottomata) [15:20:13] (03PS2) 10Hashar: Add wikimedia-event-utilities project and CI jobs [integration/config] - 10https://gerrit.wikimedia.org/r/618801 (https://phabricator.wikimedia.org/T251609) (owner: 10Ottomata) [15:22:28] (03PS1) 10Hashar: Add release job for wikimedia-event-utilities [integration/config] - 10https://gerrit.wikimedia.org/r/618998 (https://phabricator.wikimedia.org/T251609) [15:23:38] (03CR) 10Hashar: [C: 03+2] "I have split the release job to a standalone change: https://gerrit.wikimedia.org/r/c/integration/config/+/618998 Add release job for wiki" [integration/config] - 10https://gerrit.wikimedia.org/r/618801 (https://phabricator.wikimedia.org/T251609) (owner: 10Ottomata) [15:24:44] (03Merged) 10jenkins-bot: Add wikimedia-event-utilities project and CI jobs [integration/config] - 10https://gerrit.wikimedia.org/r/618801 (https://phabricator.wikimedia.org/T251609) (owner: 10Ottomata) [15:25:03] !log Reloaded Zuul for https://gerrit.wikimedia.org/r/618801 [15:25:04] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:32:12] (03PS1) 10Hashar: Add debian-glue to operations/debs/hue (non voting) [integration/config] - 10https://gerrit.wikimedia.org/r/618999 [15:34:28] (03CR) 10Hashar: [C: 03+2] Add debian-glue to operations/debs/hue (non voting) [integration/config] - 10https://gerrit.wikimedia.org/r/618999 (owner: 10Hashar) [15:35:28] (03Merged) 10jenkins-bot: Add debian-glue to operations/debs/hue (non voting) [integration/config] - 10https://gerrit.wikimedia.org/r/618999 (owner: 10Hashar) [15:37:22] (03CR) 10Ottomata: "Thanks Hashar!" [integration/config] - 10https://gerrit.wikimedia.org/r/618801 (https://phabricator.wikimedia.org/T251609) (owner: 10Ottomata) [15:37:48] (03CR) 10Ottomata: [C: 03+1] Add release job for wikimedia-event-utilities [integration/config] - 10https://gerrit.wikimedia.org/r/618998 (https://phabricator.wikimedia.org/T251609) (owner: 10Hashar) [15:44:18] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Analytics, 10Analytics-Kanban, 10Event-Platform: Set up Jenkins maven release job for wikimedia-event-utilities like analytics/refinery/source - https://phabricator.wikimedia.org/T259898 (10Ottomata) [17:24:12] 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10MediaWiki Train Development Environment: train-dev has no acceptance criteria or verification thereof - https://phabricator.wikimedia.org/T259907 (10LarsWirzenius) [18:04:03] 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.36.0-wmf.3 deployment blockers - https://phabricator.wikimedia.org/T257971 (10brennen) [18:26:36] 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.36.0-wmf.3 deployment blockers - https://phabricator.wikimedia.org/T257971 (10Aklapper) Not a blocker because no new problem, but numbers... [18:28:38] 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.36.0-wmf.3 deployment blockers - https://phabricator.wikimedia.org/T257971 (10dancy) >>! In T257971#6369302, @Aklapper wrote: > Not a bloc... [18:32:05] 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.36.0-wmf.3 deployment blockers - https://phabricator.wikimedia.org/T257971 (10brennen) > Not a blocker because no new problem, but numbers... [18:39:09] Hello releng team, could someone please update [[wikitech:Deployments]] with the schedule for next week? cc thcipriani brennen [18:39:31] I would do it myself, but I don't know if next week is an American train week or a European one, or who the conductors are [18:40:01] RoanKattouw: thank you for the reminder. Next week is a shortened week without a Friday, so I was working out what that means for train with deployers and forgot to post! [18:40:14] Oh I see [18:40:16] I will update Soon™ [18:40:19] Ooh that actually works out great for me [18:40:24] :) [18:40:38] Because that presumably means there will be an 11am PT window on Tuesday, right? (Which there isn't during American train weeks) [18:42:02] Oh wait sorry, I misread, I thought you said there wouldn't be a train. If there is a train and it's run by Americans then there wouldn't be a Tuesday 11am window [18:42:10] Anyway, I will await an update [18:42:50] sneak preview: It's an EU week, there should be an 11am PT window [18:42:59] * thcipriani updates [18:43:25] well, it's a EU + American, I forget what that yields [18:44:37] 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Release, 10Train Deployments: 1.36.0-wmf.4 deployment blockers - https://phabricator.wikimedia.org/T257972 (10thcipriani) p:05Triage→03Medium a:03hashar [18:48:57] Posted. [18:51:58] Thanks! [19:03:20] 10Release-Engineering-Team, 10Vue.js (Vue.js-Search): Work with RelEng to add PipelineBot to Vector - https://phabricator.wikimedia.org/T257582 (10Niedzielski) [19:15:06] 10Release-Engineering-Team, 10Vue.js (Vue.js-Search): Work with RelEng to add PipelineBot to Vector - https://phabricator.wikimedia.org/T257582 (10Niedzielski) [19:16:13] 10Release-Engineering-Team, 10Vue.js (Vue.js-Search): Work with RelEng to add PipelineBot to Vector - https://phabricator.wikimedia.org/T257582 (10Niedzielski) [19:16:56] 10Release-Engineering-Team, 10Vue.js (Vue.js-Search): Work with RelEng to add PipelineBot to Vector - https://phabricator.wikimedia.org/T257582 (10Niedzielski) [19:18:07] 10Release-Engineering-Team, 10Vue.js (Vue.js-Search): Work with RelEng to add PipelineBot to Vector - https://phabricator.wikimedia.org/T257582 (10Niedzielski) > Based on your description here, would it make sense generalize this to "publish built artifacts for production deployment" and RelEng can figure out... [19:19:41] 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10MediaWiki Train Development Environment: train-dev: Rename "vdc" to "train-dev" - https://phabricator.wikimedia.org/T259608 (10dancy) So we have the train-dev/vdc directory and also the 'vdc' hostname. Renaming... [19:33:16] 10Release-Engineering-Team, 10Vue.js (Vue.js-Search): Work with RelEng to add PipelineBot to Vector - https://phabricator.wikimedia.org/T257582 (10Niedzielski) [19:33:44] 10Release-Engineering-Team, 10Vue.js (Vue.js-Search): Work with RelEng to add PipelineBot to Vector - https://phabricator.wikimedia.org/T257582 (10Niedzielski) [20:30:04] 10Continuous-Integration-Infrastructure, 10VisualEditor: Karma tests using Firefox in VisualEditor/VisualEditor repo are failing - https://phabricator.wikimedia.org/T259925 (10matmarex) [20:33:58] 10Continuous-Integration-Infrastructure, 10VisualEditor: Karma tests using Firefox in VisualEditor/VisualEditor repo are failing - https://phabricator.wikimedia.org/T259925 (10matmarex) p:05Triage→03Unbreak! This is preventing us from merging changes, e.g. https://gerrit.wikimedia.org/r/c/VisualEditor/Visu... [21:09:55] 10Project-Admins, 10Unofficial-Apps-Wikipedia-Windows-8: Archive unofficial-apps-wikipedia-windows-8 tag ? - https://phabricator.wikimedia.org/T259930 (10TheDJ) [21:10:01] (03PS1) 10Karl Wettin (WMSE): jjb: Define test pipeline for Wikispeech services. [integration/config] - 10https://gerrit.wikimedia.org/r/619038 (https://phabricator.wikimedia.org/T259911) [21:13:55] (03CR) 10Karl Wettin (WMSE): "This is the first time I attempt something using Blubber and PipelineLib. Please excuse and let me know if I managed to mess things up in " [integration/config] - 10https://gerrit.wikimedia.org/r/619038 (https://phabricator.wikimedia.org/T259911) (owner: 10Karl Wettin (WMSE)) [21:21:34] !log Cherry picking latest version of https://gerrit.wikimedia.org/r/c/operations/puppet/+/601429, and enabling swift-object-expirer on deployment-ms-be05 via horizon hieradata. [21:21:36] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [21:23:29] 10Continuous-Integration-Infrastructure, 10VisualEditor, 10ci-test-error (WMF-deployed Build Failure): Karma tests using Firefox in VisualEditor/VisualEditor repo are failing - https://phabricator.wikimedia.org/T259925 (10Krinkle) [21:24:17] 10Continuous-Integration-Infrastructure, 10VisualEditor, 10ci-test-error (WMF-deployed Build Failure): Karma tests using Firefox in VisualEditor/VisualEditor repo are failing - https://phabricator.wikimedia.org/T259925 (10Krinkle) Can you reproduce the issue locally on the same repo with [fresh](https://gerr... [21:46:31] 10Gerrit: Gerrit shows error popup "Error 409 (Conflict): change is merged" - https://phabricator.wikimedia.org/T259790 (10Tgr) A similar error when trying to delete a draft comment (which I might have deleted already in another window, I think): ` An error occurred You might have not enough privileges. Error 4... [21:47:10] 10Continuous-Integration-Infrastructure, 10VisualEditor, 10ci-test-error (WMF-deployed Build Failure): Karma tests using Firefox in VisualEditor/VisualEditor repo are failing - https://phabricator.wikimedia.org/T259925 (10Esanders) Ran fine for me with fresh: ` Running "karma:firefox" (karma) task 07 08 2020... [21:50:38] PROBLEM - Parsoid on deployment-parsoid11 is CRITICAL: connect to address 172.16.1.115 and port 8000: Connection refused [22:15:36] 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.36.0-wmf.3 deployment blockers - https://phabricator.wikimedia.org/T257971 (10brennen) 05Open→03Resolved [22:19:39] 10Phabricator, 10Wikipedia-iOS-App-Backlog: Update Herald (H187) to include project 4661 - https://phabricator.wikimedia.org/T259938 (10LGoto) [22:21:48] 10Phabricator, 10Wikipedia-iOS-App-Backlog: Update Herald (H187) to include project 4831 - https://phabricator.wikimedia.org/T259939 (10LGoto) [22:22:50] 10Phabricator, 10Wikipedia-iOS-App-Backlog: Update Herald (H187) to include project 4862 - https://phabricator.wikimedia.org/T259940 (10LGoto) [22:23:39] 10Phabricator, 10Wikipedia-iOS-App-Backlog: Update Herald (H187) to include project 4863 - https://phabricator.wikimedia.org/T259941 (10LGoto) [22:23:50] 10Phabricator: Error message when trying to archive a Phabricator project without permissions only talks about creating projects - https://phabricator.wikimedia.org/T256103 (10DannyS712) [23:34:00] (03PS1) 10Dduvall: WIP: Support scratch images [blubber] - 10https://gerrit.wikimedia.org/r/619072 [23:54:18] PROBLEM - Host deployment-sentry01 is DOWN: CRITICAL - Host Unreachable (172.16.5.16)