[00:06:43] 10Release-Engineering-Team, 10Operations, 10SRE-Access-Requests: Request access to deployment cluster for Alaa Sarhan - https://phabricator.wikimedia.org/T223698 (10JJMC89) [03:38:54] PROBLEM - Free space - all mounts on deployment-fluorine02 is CRITICAL: CRITICAL: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<40.00%) [06:25:58] PROBLEM - Puppet errors on integration-slave-jessie-1002 is CRITICAL: (Service Check Timed Out) [07:08:53] RECOVERY - Free space - all mounts on deployment-fluorine02 is OK: OK: All targets OK [07:41:06] 10Gerrit, 10Release-Engineering-Team, 10VPS-project-libraryupgrader: Re-enable use of Gerrit HTTP token to push patchsets - https://phabricator.wikimedia.org/T218750 (10akosiaris) [07:54:18] (03PS1) 10Jforrester: Add Simon Legner to the CI whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/511122 [08:01:09] (03CR) 10Legoktm: [C: 03+2] Add Simon Legner to the CI whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/511122 (owner: 10Jforrester) [08:02:42] (03Merged) 10jenkins-bot: Add Simon Legner to the CI whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/511122 (owner: 10Jforrester) [08:03:43] !log deployed https://gerrit.wikimedia.org/r/511122 [08:03:44] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:05:05] 10Beta-Cluster-Infrastructure: Please create beta zhwikivoyage - https://phabricator.wikimedia.org/T223770 (10zhuyifei1999) [08:08:01] 10Continuous-Integration-Infrastructure, 10MediaWiki-extensions-General, 10Patch-For-Review: Create composer package that contains most of the MediaWiki extension phan config instead of copy/pasting it each time - https://phabricator.wikimedia.org/T186315 (10Legoktm) 05Open→03Resolved This is basically a... [08:08:32] 10Continuous-Integration-Infrastructure, 10MediaWiki-Vendor, 10Composer, 10Patch-For-Review, 10Security: security.sensiolabs.org is shutting down at the end of October 2018 - https://phabricator.wikimedia.org/T206442 (10Legoktm) 05Open→03Resolved https://php-security-checker.wmflabs.org/ [08:09:17] 10Continuous-Integration-Infrastructure, 10Wikimedia-General-or-Unknown, 10Core Platform Team (Code Health (TEC13)), 10Core Platform Team Kanban (Doing), and 3 others: Deprecate/obsolete $wgWikimediaJenkinsCI - https://phabricator.wikimedia.org/T200650 (10Legoktm) a:05Legoktm→03None Not currently worki... [08:36:47] 10Release-Engineering-Team (Kanban), 10Wikimedia-Hackathon-2019, 10User-zeljkofilipin: The first Selenium test for WikibaseCirrusSearch - https://phabricator.wikimedia.org/T223774 (10zeljkofilipin) [08:38:07] 10Release-Engineering-Team (Kanban), 10Discovery-Search, 10Wikimedia-Hackathon-2019, 10User-zeljkofilipin: The first Selenium test for WikibaseCirrusSearch - https://phabricator.wikimedia.org/T223774 (10Smalyshev) [09:48:16] 10MediaWiki-Releasing, 10Release-Engineering-Team (Kanban), 10MW-1.33-release: Branch REL1_33 for MediaWiki and deployed extensions - https://phabricator.wikimedia.org/T220653 (10Jdforrester-WMF) I've now also done this manually for the `extensions.git` and `skins.git` meta-repositories, which makes it easie... [10:00:23] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin, 10Wikimedia-Incident, 10Wikimedia-production-error: Investigate the spikes of "web request took longer than 60 seconds and timed out" during deployments - https://phabricator.wikimedia.org/T204871 (10Krinkle) [10:13:18] 10Beta-Cluster-Infrastructure, 10Operations, 10Traffic, 10HTTPS: https://sv.wikipedia.beta.wmflabs.org/ has invalid certificate - https://phabricator.wikimedia.org/T202564 (10Reedy) 05Open→03Resolved a:03Reedy >>! In T202564#5051923, @Krenair wrote: > @Zoranzoki21: they're just cherry-picks... specif... [10:13:28] 10Beta-Cluster-Infrastructure, 10Parsing-Team, 10VisualEditor, 10VisualEditor-MediaWiki, and 3 others: Swedish beta cluster wiki is busted (Parsoid/RESTBase not set up?) - https://phabricator.wikimedia.org/T191184 (10Reedy) [10:13:59] PROBLEM - Free space - all mounts on deployment-mwmaint01 is CRITICAL: CRITICAL: deployment-prep.deployment-mwmaint01.diskspace.root.byte_percentfree (<10.00%) [10:14:50] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin, 10Wikimedia-Incident, 10Wikimedia-production-error: Investigate the spikes of "web request took longer than 60 seconds and timed out" during deployments on HHVM - https://phabricator.wikimedia.org/T204871 (10Krinkle) [10:16:32] (03CR) 10Simon04: "Cool, thanks :)" [integration/config] - 10https://gerrit.wikimedia.org/r/511122 (owner: 10Jforrester) [10:19:02] RECOVERY - Free space - all mounts on deployment-mwmaint01 is OK: OK: All targets OK [10:29:01] 10Beta-Cluster-Infrastructure, 10Patch-For-Review: Please create beta zhwikivoyage - https://phabricator.wikimedia.org/T223770 (10Reedy) ` reedy@deployment-deploy01:/srv/mediawiki-staging$ mwscript extensions/WikimediaMaintenance/addWiki.php --wiki=aawiki zh wikivoyage zhwikivoyage zh.wikivoyage.org Creating d... [10:36:47] (03PS2) 10Dvorapa: [WIP] Test Pywikibot in Wikimedia CI [integration/config] - 10https://gerrit.wikimedia.org/r/510927 [10:39:05] (03CR) 10jerkins-bot: [V: 04-1] [WIP] Test Pywikibot in Wikimedia CI [integration/config] - 10https://gerrit.wikimedia.org/r/510927 (owner: 10Dvorapa) [11:01:37] 10Beta-Cluster-Infrastructure: Packages broke on deployment-mediawiki-07 - https://phabricator.wikimedia.org/T223801 (10Reedy) [11:23:54] PROBLEM - Work requests waiting in Zuul Gearman server on contint1001 is CRITICAL: CRITICAL: 57.14% of data above the critical threshold [140.0] https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [11:47:27] 10Beta-Cluster-Infrastructure: Packages broken on deployment-mediawiki-07 - https://phabricator.wikimedia.org/T223801 (10Reedy) [11:47:53] 10Beta-Cluster-Infrastructure, 10Wikimania-Hackathon-2019, 10Patch-For-Review: Please create beta zhwikivoyage - https://phabricator.wikimedia.org/T223770 (10Reedy) [11:48:12] 10Beta-Cluster-Infrastructure, 10Wikimedia-Hackathon-2019, 10Patch-For-Review: Please create beta zhwikivoyage - https://phabricator.wikimedia.org/T223770 (10Reedy) [11:48:23] PROBLEM - Puppet errors on integration-slave-docker-1021 is CRITICAL: CRITICAL: 2.25% of data above the critical threshold [3.0] [12:14:57] (03PS1) 10Noa wmde: Change Dockerfile and wikidata.yml to support running browser tests for the query service gui [integration/config] - 10https://gerrit.wikimedia.org/r/511308 (https://phabricator.wikimedia.org/T222200) [13:03:18] (03PS2) 10Alaa Sarhan: Change Dockerfile and wikidata.yml to support running browser tests for the query service gui [integration/config] - 10https://gerrit.wikimedia.org/r/511308 (https://phabricator.wikimedia.org/T222200) (owner: 10Noa wmde) [13:14:40] Looks like logstash-beta is broken / down? [13:42:10] PROBLEM - Work requests waiting in Zuul Gearman server on contint1001 is CRITICAL: CRITICAL: 35.71% of data above the critical threshold [140.0] https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [13:48:23] RECOVERY - Puppet errors on integration-slave-docker-1021 is OK: OK: Less than 1.00% above the threshold [2.0] [13:54:50] RECOVERY - Work requests waiting in Zuul Gearman server on contint1001 is OK: OK: Less than 30.00% above the threshold [90.0] https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [14:21:34] PROBLEM - Work requests waiting in Zuul Gearman server on contint1001 is CRITICAL: CRITICAL: 35.71% of data above the critical threshold [140.0] https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [14:37:38] (03PS1) 10Umherirrender: [SecurePoll] Add CentralAuth as dependency [integration/config] - 10https://gerrit.wikimedia.org/r/511332 [14:40:16] maintenance-disconnect-full-disks build 73741 integration-slave-docker-1054 (/var/lib/docker: 95%): OFFLINE due to disk space [14:45:34] (03CR) 10Daimona Eaytoy: [C: 03+1] "(Needed for Ie049465369b0b2b78eaeba71b44c1db19fc6228c)" [integration/config] - 10https://gerrit.wikimedia.org/r/511332 (owner: 10Umherirrender) [15:00:16] maintenance-disconnect-full-disks build 73745 integration-slave-docker-1054: OFFLINE due to disk space [15:03:52] RECOVERY - Work requests waiting in Zuul Gearman server on contint1001 is OK: OK: Less than 30.00% above the threshold [90.0] https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [15:03:59] busy zuul is busy [15:39:19] (03CR) 10Umherirrender: "It is also needed for Ie8f1aa6cef7802afa6a51088dd839bf3ddc8dd48" [integration/config] - 10https://gerrit.wikimedia.org/r/511332 (owner: 10Umherirrender) [15:43:34] !log Purging all images on Docker CI slaves [15:43:36] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:43:42] !log Purging webperformance.integration.eqiad.wmflabs /tmp directory (inodes full) [15:43:43] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:47:00] 10Beta-Cluster-Infrastructure, 10Operations, 10Traffic, 10HTTPS: https://sv.wikipedia.beta.wmflabs.org/ has invalid certificate - https://phabricator.wikimedia.org/T202564 (10Krenair) a:05Reedy→03Krenair yes [15:49:50] (03CR) 10Hashar: [C: 03+2] [SecurePoll] Add CentralAuth as dependency [integration/config] - 10https://gerrit.wikimedia.org/r/511332 (owner: 10Umherirrender) [15:51:47] (03Merged) 10jenkins-bot: [SecurePoll] Add CentralAuth as dependency [integration/config] - 10https://gerrit.wikimedia.org/r/511332 (owner: 10Umherirrender) [15:54:51] (03CR) 10Hashar: [C: 03+2] "Deployed!" [integration/config] - 10https://gerrit.wikimedia.org/r/511332 (owner: 10Umherirrender) [16:03:41] RECOVERY - Puppet staleness on webperformance is OK: OK: Less than 1.00% above the threshold [3600.0] [16:11:55] 10Continuous-Integration-Infrastructure, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata, 10Test-Coverage: generate Wikibase.git code coverage on Jenkins - https://phabricator.wikimedia.org/T88434 (10Lucas_Werkmeister_WMDE) >>! In T88434#4918803, @Legoktm wrote: > That's one possible option, yes. Or... [17:30:28] 10Continuous-Integration-Infrastructure, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata, 10Test-Coverage: generate Wikibase.git code coverage on Jenkins - https://phabricator.wikimedia.org/T88434 (10Lucas_Werkmeister_WMDE) For reference, over the past two years, 75% of Wikibase commits only touched... [17:37:28] PROBLEM - Work requests waiting in Zuul Gearman server on contint1001 is CRITICAL: CRITICAL: 35.71% of data above the critical threshold [140.0] https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [17:45:54] RECOVERY - Work requests waiting in Zuul Gearman server on contint1001 is OK: OK: Less than 30.00% above the threshold [90.0] https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [18:51:57] is gerritbot having problems? I just pushed four changes for https://phabricator.wikimedia.org/T223214 to Gerrit and no comment appeared in the task [18:52:22] wait, nevermind, they weren’t pushed 🤦 [18:53:43] yup, all working now, sorry for the noise [19:29:39] 10Continuous-Integration-Config, 10phan: Prepare phan-docker on CI for phan2.0.0 - https://phabricator.wikimedia.org/T223847 (10Umherirrender) [19:34:29] 10Phabricator (Upstream), 10Upstream: Can't preview new titles and/or changes to task titles on the Phabricator - https://phabricator.wikimedia.org/T190610 (10epriestley) Titles are plain text. The plain text in the input is always a completely faithful preview of the resulting title. Put another way, there... [20:40:39] 10Phabricator (Upstream), 10Upstream: Embedded JPEG image has wrong orientation - https://phabricator.wikimedia.org/T100299 (10epriestley) This is an issue with orientation metadata (usually EXIF?). The upstream task for this is . We're likely to use CSS `transform: rota... [20:46:44] 10Phabricator (Upstream), 10Upstream: Phabricator avatar SVG support - https://phabricator.wikimedia.org/T76096 (10epriestley) From a technical point of view, I think this is effectively a duplicate of T1016: if we added SVG support, all contexts (including avatars, attachments, cover photos, etc) would suppor... [20:58:56] 10Phabricator (Upstream), 10Upstream: Connect Pastes to their related tasks - https://phabricator.wikimedia.org/T98899 (10epriestley) See also T76095. Until recently, referencing an object with a full URI (`https://phabricator.wikimedia.org/Pxxx`) instead of a bare monogram (`Pxxx`) did not activate any specia... [21:05:25] 10Phabricator (Upstream), 10Upstream: Meme audio doesn't stop with preview regenerate - https://phabricator.wikimedia.org/T99759 (10epriestley) I've included this upstream along other planned improvements to sounds: . [21:25:54] PROBLEM - Work requests waiting in Zuul Gearman server on contint1001 is CRITICAL: CRITICAL: 57.14% of data above the critical threshold [140.0] https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [21:35:15] 10Phabricator, 10Phabricator (Upstream), 10Upstream: Disable policies on Differential - https://phabricator.wikimedia.org/T118669 (10epriestley) Differential has had policy support ("Visible To" and "Editable By") for a long time (upstream in ). Differential currently do... [21:40:00] RECOVERY - Work requests waiting in Zuul Gearman server on contint1001 is OK: OK: Less than 30.00% above the threshold [90.0] https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [21:48:31] (03PS2) 10Thcipriani: service-pipeline: Use registries defined by pipelinelib [integration/config] - 10https://gerrit.wikimedia.org/r/510605 (owner: 10Dduvall) [21:55:35] 10Phabricator (Upstream), 10Upstream: Correct KB into kB or KiB - https://phabricator.wikimedia.org/T125316 (10epriestley) The upstream is exceedingly unlikely to change this. Although "KB" is not a technically precise unit, it is widely understood by users and is the unit used by both MacOS ("KB" in "Size" co... [22:00:33] 10Phabricator (Upstream), 10Upstream: Cannot delete the 'copy' of a Conpherence room created - https://phabricator.wikimedia.org/T117401 (10epriestley) Administrators with CLI access can `bin/remove destroy Zxxx` to destroy a Conpherence (or most other types of object). Broadly, it is intentional (and an expl... [23:09:49] 10Phabricator (Upstream), 10Browser-Support-Google-Chrome, 10Upstream: Phabricator is showing a lot of scrollbars on comments (Google Chrome) - https://phabricator.wikimedia.org/T180887 (10epriestley) I'm not sure how to reproduce this. I don't see any scrollbars in Chrome on this task, or T180864, or locall... [23:25:50] 10Phabricator (Upstream), 10Upstream: Generic advanced search doesn't link maniphest advanced search - https://phabricator.wikimedia.org/T1375 (10epriestley) This is declined upstream and not likely to move forward. Although it may happen in some form as part of general search improvements alongside changes l... [23:29:23] 10Phabricator (Upstream), 10Upstream: "Unknown Object" in feed should say "Restricted Task" instead - https://phabricator.wikimedia.org/T105332 (10epriestley) This has shown "Restricted Task" for some time, I believe. {F29147312, size=full} If anything still shows "Unknown Object" instead of "Restricted Task... [23:33:43] 10Phabricator (Upstream), 10Upstream: Feature request: E-mail notification about adding SSH key(s) on Phabricator should provide better message like Gerrit - https://phabricator.wikimedia.org/T208163 (10epriestley) I'm not sure what makes the Gerrit message "better" here so I'm not sure what changes are desire... [23:39:10] 10Phabricator (Upstream), 10Upstream: Feature request: E-mail notification about adding SSH key(s) on Phabricator should provide better message like Gerrit - https://phabricator.wikimedia.org/T208163 (10Paladox) @epriestley i think he means that it includes the public ssh key in the email (which is a safety fe... [23:49:42] 10Phabricator (Upstream), 10Upstream: Feature request: E-mail notification about adding SSH key(s) on Phabricator should provide better message like Gerrit - https://phabricator.wikimedia.org/T208163 (10epriestley) Why is including the public key in the email a safety feature? (How does this make things safer?) [23:55:19] 10Phabricator (Upstream), 10Upstream: Feature request: E-mail notification about adding SSH key(s) on Phabricator should provide better message like Gerrit - https://phabricator.wikimedia.org/T208163 (10Paladox) It allows the user to know if it's there key or not without going to the UI. [23:59:51] PROBLEM - Free space - all mounts on deployment-fluorine02 is CRITICAL: CRITICAL: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<50.00%)