[03:14:40] (03CR) 10Jforrester: [C: 03+1] DonationInterface tests run on PHP7 and MediaWiki 1.31 [integration/config] - 10https://gerrit.wikimedia.org/r/499334 (owner: 10Ejegg) [06:38:45] (03PS1) 10QChris: Allow “Gerrit Managers” to import history [labs/tools/Isa] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/502078 [06:38:48] (03CR) 10QChris: [V: 03+2 C: 03+2] Allow “Gerrit Managers” to import history [labs/tools/Isa] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/502078 (owner: 10QChris) [06:39:21] (03PS1) 10QChris: Import done. Revoke import grants [labs/tools/Isa] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/502093 [06:39:24] (03CR) 10QChris: [V: 03+2 C: 03+2] Import done. Revoke import grants [labs/tools/Isa] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/502093 (owner: 10QChris) [07:43:19] PROBLEM - SSH on integration-slave-docker-1053 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:13:09] RECOVERY - SSH on integration-slave-docker-1053 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u8 (protocol 2.0) [08:33:52] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Read Continuous Delivery book - https://phabricator.wikimedia.org/T218984 (10zeljkofilipin) [08:54:23] (03PS2) 10Hashar: Emit a warning for EXT_DEPENDENCIES and SKIN_DEPENDENCIES [integration/quibble] - 10https://gerrit.wikimedia.org/r/501566 (https://phabricator.wikimedia.org/T220199) [09:00:46] 10Release-Engineering-Team, 10MediaWiki-Core-Testing, 10Patch-For-Review, 10Wikimedia-production-error (Shared Build Failure), 10phan: phan 1.2.6 is OOMing on MediaWiki core - https://phabricator.wikimedia.org/T219114 (10hashar) 05Open→03Resolved And https://gerrit.wikimedia.org/r/501794 changes phan... [09:08:47] (03CR) 10Hashar: "The cache is populated by rsync which is run inside a container and uses the 'nobody' user. However the /cache/ directory is owned by root" [integration/config] - 10https://gerrit.wikimedia.org/r/501867 (owner: 10Umherirrender) [09:09:12] 10Continuous-Integration-Infrastructure: Castor rsync causes: rsync: failed to set times on "/cache/.": Operation not permitted (1) - https://phabricator.wikimedia.org/T188488 (10hashar) From another comment I made: The cache is populated by rsync which is run inside a container and uses the 'nobody' user. How... [09:09:50] 10Continuous-Integration-Config, 10MediaWiki-Core-Testing, 10MediaWiki-extensions-MultimediaViewer, 10MobileFrontend, and 9 others: Audit tests/selenium/LocalSettings.php file aiming at possibly deprecating the feature - https://phabricator.wikimedia.org/T199939 (10zeljkofilipin) @Jdlrobson if you're block... [09:18:53] 10Continuous-Integration-Infrastructure: quibble-vendor-mysql-php73-docker fails on experimental run with filesystem error - https://phabricator.wikimedia.org/T220237 (10hashar) Indeed the image `docker-registry.wikimedia.org/releng/quibble-stretch-php73:0.0.31-1` has not been downloaded on any of the CI slaves... [09:48:24] (03PS1) 10Gehel: barricade: create CI jobs for barricade gerrit plugin [integration/config] - 10https://gerrit.wikimedia.org/r/502168 [09:49:54] (03CR) 10Gehel: [C: 04-1] "This is missing a project entry (similar to the one present in jjb/search.yaml). Since this isn't really a search platform project, I'm no" [integration/config] - 10https://gerrit.wikimedia.org/r/502168 (owner: 10Gehel) [09:50:15] (03CR) 10jerkins-bot: [V: 04-1] barricade: create CI jobs for barricade gerrit plugin [integration/config] - 10https://gerrit.wikimedia.org/r/502168 (owner: 10Gehel) [10:02:11] 10Continuous-Integration-Infrastructure: quibble-vendor-mysql-php73-docker fails on experimental run with filesystem error - https://phabricator.wikimedia.org/T220237 (10hashar) There is no such digest on the build host: ` contint1001:~$ sudo docker image ls --all --no-trunc|grep 769123a16e79cf3be7d995570273a376... [10:04:46] (03PS1) 10Hashar: docker: rebuild faulty releng/quibble-stretch-php73:0.0.31-1 [integration/config] - 10https://gerrit.wikimedia.org/r/502181 [10:05:10] (03PS2) 10Hashar: docker: rebuild faulty releng/quibble-stretch-php73:0.0.31-1 [integration/config] - 10https://gerrit.wikimedia.org/r/502181 (https://phabricator.wikimedia.org/T220237) [10:12:31] (03CR) 10Hashar: [C: 03+2] docker: rebuild faulty releng/quibble-stretch-php73:0.0.31-1 [integration/config] - 10https://gerrit.wikimedia.org/r/502181 (https://phabricator.wikimedia.org/T220237) (owner: 10Hashar) [10:14:38] (03Merged) 10jenkins-bot: docker: rebuild faulty releng/quibble-stretch-php73:0.0.31-1 [integration/config] - 10https://gerrit.wikimedia.org/r/502181 (https://phabricator.wikimedia.org/T220237) (owner: 10Hashar) [10:15:37] !log Building Docker image releng/quibble-stretch-php73:0.0.31-2 # T220237 [10:15:40] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:15:40] T220237: quibble-vendor-mysql-php73-docker fails on experimental run with filesystem error - https://phabricator.wikimedia.org/T220237 [10:24:12] 10Phabricator, 10Release-Engineering-Team (Backlog), 10Developer-Advocacy (Apr-Jun 2019): Create Phab account for "jenkins-bot / Gerrit Code Review" to set an avatar image to ease recognition in commit histories - https://phabricator.wikimedia.org/T173877 (10Peachey88) Do we need to rebuild identities (T7795... [10:25:54] (03PS1) 10Hashar: Update jjb jobs for releng/quibble-stretch-php73 [integration/config] - 10https://gerrit.wikimedia.org/r/502188 (https://phabricator.wikimedia.org/T220237) [10:26:16] (03CR) 10Hashar: [C: 03+2] Update jjb jobs for releng/quibble-stretch-php73 [integration/config] - 10https://gerrit.wikimedia.org/r/502188 (https://phabricator.wikimedia.org/T220237) (owner: 10Hashar) [10:27:27] 10Continuous-Integration-Infrastructure, 10Patch-For-Review: quibble-vendor-mysql-php73-docker fails on experimental run with filesystem error - https://phabricator.wikimedia.org/T220237 (10hashar) 05Open→03Resolved a:03hashar I have just rebuild the image. Should be good now :] [10:29:15] (03Merged) 10jenkins-bot: Update jjb jobs for releng/quibble-stretch-php73 [integration/config] - 10https://gerrit.wikimedia.org/r/502188 (https://phabricator.wikimedia.org/T220237) (owner: 10Hashar) [10:55:15] (03CR) 10Hashar: "Already done by David Causse via https://gerrit.wikimedia.org/r/#/c/integration/config/+/501507/ ? :)" (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/502168 (owner: 10Gehel) [10:56:03] (03CR) 10Hashar: [C: 03+2] [MassEditRegex] Add seccheck [integration/config] - 10https://gerrit.wikimedia.org/r/501859 (owner: 10Umherirrender) [10:57:34] (03Merged) 10jenkins-bot: [MassEditRegex] Add seccheck [integration/config] - 10https://gerrit.wikimedia.org/r/501859 (owner: 10Umherirrender) [10:59:56] (03CR) 10Hashar: [C: 03+2] Add phan to some skins [integration/config] - 10https://gerrit.wikimedia.org/r/501864 (owner: 10Umherirrender) [11:01:33] (03Merged) 10jenkins-bot: Add phan to some skins [integration/config] - 10https://gerrit.wikimedia.org/r/501864 (owner: 10Umherirrender) [11:45:41] (03Abandoned) 10Gehel: barricade: create CI jobs for barricade gerrit plugin [integration/config] - 10https://gerrit.wikimedia.org/r/502168 (owner: 10Gehel) [12:23:45] 10Gerrit, 10Release-Engineering-Team (Backlog), 10Patch-For-Review: Upgrade to Gerrit 2.16.7 - https://phabricator.wikimedia.org/T200739 (10hashar) [12:23:48] 10Release-Engineering-Team (Kanban), 10Zuul, 10Patch-For-Review: Update zuul's GitPython dep - https://phabricator.wikimedia.org/T214739 (10hashar) 05Open→03Resolved I have upgraded Zuul to 2.5.1-wmf6 (T208426): ` contint1001:~$ dpkg -L zuul|grep GitPython /usr/share/python/zuul/lib/python2.7/site-packag... [12:26:33] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Zuul, 10Patch-For-Review, 10Upstream: Zuul get confused when querying a change that yields two entries - https://phabricator.wikimedia.org/T198968 (10hashar) 05Open→03Resolved I have upgraded Zuul to 2.5.1-wmf6 (T208426).... [12:27:23] 10Continuous-Integration-Infrastructure, 10Operations-Software-Development, 10Patch-For-Review, 10cloud-services-team (Kanban): puppet broken on integration WMCS instances due to openstack Debian packages - https://phabricator.wikimedia.org/T218559 (10hashar) [12:27:31] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Zuul, 10Patch-For-Review, 10User-Addshore: Upgrade pbr for zuul - https://phabricator.wikimedia.org/T162787 (10hashar) 05Open→03Resolved I have upgraded Zuul to 2.5.1-wmf6 (T208426): ` contint1001:~$ zuul --version Zuul v... [12:27:52] 10Gerrit, 10Release-Engineering-Team (Backlog), 10Patch-For-Review: Upgrade to Gerrit 2.16.7 - https://phabricator.wikimedia.org/T200739 (10hashar) [12:27:59] 10Release-Engineering-Team (Kanban), 10Zuul, 10Patch-For-Review, 10Upstream: Patch zuul to remove /p/ from /info/refs call - https://phabricator.wikimedia.org/T214807 (10hashar) 05Open→03Resolved I have upgraded Zuul to 2.5.1-wmf6 (T162787). [12:29:19] PROBLEM - SSH on integration-slave-docker-1053 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:29:48] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Release-Engineering-Team (Kanban), 10Zuul, 10Patch-For-Review: Zuul cancels all changes when a change is manually merged - https://phabricator.wikimedia.org/T203846 (10hashar) I have upgraded Zuul to 2.5.1-wmf.6 (T208426). This is now pending verifica... [12:30:10] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Zuul, 10Patch-For-Review, 10User-Addshore: Upgrade pbr for zuul - https://phabricator.wikimedia.org/T162787 (10hashar) [12:30:12] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Release-Engineering-Team (Kanban), 10Zuul, 10Patch-For-Review: Deploy Zuul 2.5.1-wmf6 - https://phabricator.wikimedia.org/T208426 (10hashar) 05Open→03Resolved [12:35:33] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.33.0-wmf.24 deployment blockers - https://phabricator.wikimedia.org/T206678 (10Krinkle) [12:38:49] PROBLEM - Puppet errors on integration-slave-docker-1043 is CRITICAL: CRITICAL: 3.33% of data above the critical threshold [3.0] [12:40:52] PROBLEM - Puppet errors on integration-slave-jessie-1001 is CRITICAL: CRITICAL: 4.44% of data above the critical threshold [3.0] [12:44:07] 10Continuous-Integration-Infrastructure, 10Operations-Software-Development, 10Patch-For-Review, 10cloud-services-team (Kanban): puppet broken on integration WMCS instances due to openstack Debian packages - https://phabricator.wikimedia.org/T218559 (10hashar) 05Open→03Resolved a:03hashar Seems good now. [12:52:56] 10Continuous-Integration-Infrastructure, 10Operations: Upload Zuul 2.5.1-wmf6 package to apt.wikimedia.org - https://phabricator.wikimedia.org/T220380 (10hashar) [12:58:42] 10Continuous-Integration-Infrastructure (Slipway), 10Wikipedia-Android-App-Backlog: Migrate apps/android/wikipedia CI jobs to Docker containers - https://phabricator.wikimedia.org/T210277 (10hashar) 05Open→03Resolved a:03hashar The job no more exists since roughly Feb 19th 2019. [12:58:59] PROBLEM - Puppet errors on integration-slave-docker-1053 is CRITICAL: CRITICAL: 4.92% of data above the critical threshold [3.0] [12:59:07] RECOVERY - SSH on integration-slave-docker-1053 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u8 (protocol 2.0) [13:18:30] PROBLEM - Long lived cherry-picks on puppetmaster on deployment-puppetmaster03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [13:21:40] !log integration: fix cumin profiles that got renamed by 9e0aa8264659799e74c3e815ea39c640e5f05393 [13:21:42] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [13:26:16] awesome hashar! (re zuul upgrade) [13:31:40] looks like there was a regression with 2.15.12 (which is what caused our issue) [13:31:52] Apparently will be fixed with https://git.eclipse.org/r/#/c/140207/ [13:36:18] https://bugs.chromium.org/p/gerrit/issues/detail?id=10695 <-- that's the bug filed. [13:37:28] fun :) [13:39:15] !log Deleting integration-slave-docker-1045 again. It uses Stretch instead of Jessie [13:39:16] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [13:41:42] paladox: I don't think it is related :] [13:41:47] but maybe it can [13:41:50] oh [13:42:07] what we observed is bunch of threads were waiting for a reentrant lock on the accounts cache [13:42:35] yup [13:43:00] hashar what dosen't explain it, is why 2.15.12 managed to cause that more frequent then 2.15.11 [13:43:02] *) [13:43:29] yup. that is a mystery :] [13:43:39] PROBLEM - Host integration-slave-docker-1045 is DOWN: CRITICAL - Host Unreachable (172.16.1.110) [13:44:07] hashar though someone else had this problem [13:44:36] and even tryed fixing it but was reverted. [13:45:02] https://bugs.chromium.org/p/gerrit/issues/detail?id=7645 [13:45:49] zeljkof: so I think we should remove all the selenium-* tests . The ones that use Saucelabs and mediawiki-selenium :D [13:45:52] zeljkof: based on https://integration.wikimedia.org/ci/label/BrowserTests/ [13:46:12] bunch have been failling for a few months already [13:48:49] hashar: +1 [13:49:16] I think we should remove all ruby jobs :P https://phabricator.wikimedia.org/T220035 [14:02:48] 10Continuous-Integration-Infrastructure (Slipway), 10Librarization, 10Wikidata: Usage of composer validate on mediawiki/core and Wikibase* extensions - https://phabricator.wikimedia.org/T220388 (10hashar) [14:06:14] (03PS1) 10Hashar: Remove mwgate-composer-validate job (unused) [integration/config] - 10https://gerrit.wikimedia.org/r/502225 (https://phabricator.wikimedia.org/T220388) [14:10:34] (03PS2) 10Hashar: Remove composer-validate jobs (unused) [integration/config] - 10https://gerrit.wikimedia.org/r/502225 (https://phabricator.wikimedia.org/T220388) [14:10:52] RECOVERY - Puppet errors on integration-slave-jessie-1001 is OK: OK: Less than 1.00% above the threshold [2.0] [14:19:12] (03CR) 10Hashar: [C: 03+2] "Noop in Zuul :)" [integration/config] - 10https://gerrit.wikimedia.org/r/502225 (https://phabricator.wikimedia.org/T220388) (owner: 10Hashar) [14:19:39] 10Continuous-Integration-Infrastructure (Slipway), 10Librarization, 10Wikidata: Usage of composer validate on mediawiki/core and Wikibase* extensions - https://phabricator.wikimedia.org/T220388 (10hashar) [14:22:05] (03Merged) 10jenkins-bot: Remove composer-validate jobs (unused) [integration/config] - 10https://gerrit.wikimedia.org/r/502225 (https://phabricator.wikimedia.org/T220388) (owner: 10Hashar) [14:28:48] RECOVERY - Puppet errors on integration-slave-docker-1043 is OK: OK: Less than 1.00% above the threshold [2.0] [14:30:22] PROBLEM - SSH on integration-slave-docker-1053 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:33:47] 10MediaWiki-Codesniffer, 10MediaWiki-General-or-Unknown, 10MW-1.27-release (WMF-deploy-2015-09-29_(1.27.0-wmf.1)), 10MW-1.27-release (WMF-deploy-2015-10-06_(1.27.0-wmf.2)), and 2 others: Fix global variable and function prefixes in core - https://phabricator.wikimedia.org/T104501 (10Simetrical) @Legoktm Wh... [14:40:19] 10Release-Engineering-Team, 10Core Platform Team, 10Operations, 10Release Pipeline, and 2 others: TEC3:O3:O3.1:Q4 Goal - Move cpjobqueue, Wikidata Termbox SSR (new service), Kask (session storage service) and ORES (partially) through the production CD Pipeline - https://phabricator.wikimedia.org/T220398 (10... [14:40:35] 10Release-Engineering-Team, 10Core Platform Team, 10Operations, 10Release Pipeline, and 2 others: TEC3:O3:O3.1:Q4 Goal - Move cpjobqueue, Wikidata Termbox SSR (new service), Kask (session storage service) and ORES (partially) through the production CD Pipeline - https://phabricator.wikimedia.org/T220398 (10... [14:41:43] 10Release-Engineering-Team, 10Core Platform Team, 10Operations, 10Release Pipeline, and 2 others: Migrate cpjobqueue to kubernetes - https://phabricator.wikimedia.org/T220399 (10akosiaris) [14:41:48] 10Release-Engineering-Team, 10Core Platform Team, 10Operations, 10Release Pipeline, and 2 others: Migrate cpjobqueue to kubernetes - https://phabricator.wikimedia.org/T220399 (10akosiaris) p:05Triage→03Normal [14:42:00] 10Release-Engineering-Team, 10Core Platform Team, 10Operations, 10Release Pipeline, and 2 others: TEC3:O3:O3.1:Q4 Goal - Move cpjobqueue, Wikidata Termbox SSR (new service), Kask (session storage service) and ORES (partially) through the production CD Pipeline - https://phabricator.wikimedia.org/T220398 (10... [14:42:25] 10Release-Engineering-Team, 10Core Platform Team, 10Operations, 10Release Pipeline, and 2 others: Migrate ORES to kubernetes - https://phabricator.wikimedia.org/T220400 (10akosiaris) [14:42:56] 10Release-Engineering-Team, 10Core Platform Team, 10Operations, 10Release Pipeline, and 2 others: Introduce kask session storage service to kubernetes - https://phabricator.wikimedia.org/T220401 (10akosiaris) [14:43:06] 10Release-Engineering-Team, 10Core Platform Team, 10Operations, 10Release Pipeline, and 2 others: Introduce kask session storage service to kubernetes - https://phabricator.wikimedia.org/T220401 (10akosiaris) p:05Triage→03Normal [14:43:54] 10Release-Engineering-Team, 10Core Platform Team, 10Operations, 10Release Pipeline, and 2 others: Introduce wikidata termbox SSR to kubernetes - https://phabricator.wikimedia.org/T220402 (10akosiaris) [14:44:03] 10Release-Engineering-Team, 10Core Platform Team, 10Operations, 10Release Pipeline, and 2 others: Introduce wikidata termbox SSR to kubernetes - https://phabricator.wikimedia.org/T220402 (10akosiaris) p:05Triage→03Normal [14:44:08] 10Release-Engineering-Team, 10Core Platform Team, 10Operations, 10Release Pipeline, and 2 others: Migrate ORES to kubernetes - https://phabricator.wikimedia.org/T220400 (10akosiaris) p:05Triage→03Normal [14:46:13] 10Release-Engineering-Team, 10Core Platform Team, 10Operations, 10Release Pipeline, and 2 others: TEC3:O3:O3.1:Q4 Goal - Move cpjobqueue, Wikidata Termbox SSR (new service), Kask (session storage service) and ORES (partially) through the production CD Pipeline - https://phabricator.wikimedia.org/T220398 (10... [14:47:22] !log hard rebooting integration-slave-docker-1053 OOM / deadlocked [14:47:23] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:50:10] RECOVERY - SSH on integration-slave-docker-1053 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u8 (protocol 2.0) [15:26:02] (03PS1) 10Tpt: Adds VisualEditor and CodeMirror as dependencies of TEI extension [integration/config] - 10https://gerrit.wikimedia.org/r/502254 [15:43:14] (03CR) 10Hashar: [C: 03+2] Adds VisualEditor and CodeMirror as dependencies of TEI extension [integration/config] - 10https://gerrit.wikimedia.org/r/502254 (owner: 10Tpt) [15:44:48] (03Merged) 10jenkins-bot: Adds VisualEditor and CodeMirror as dependencies of TEI extension [integration/config] - 10https://gerrit.wikimedia.org/r/502254 (owner: 10Tpt) [16:18:56] RECOVERY - Puppet errors on integration-slave-docker-1053 is OK: OK: Less than 1.00% above the threshold [2.0] [16:19:44] (03CR) 10Mobrovac: [C: 03+1] docker: Provide a -deploy-node10-docker job template [integration/config] - 10https://gerrit.wikimedia.org/r/501687 (owner: 10Jforrester) [16:54:28] 10Release-Engineering-Team, 10Core Platform Team, 10Operations, 10Release Pipeline, and 3 others: Introduce kask session storage service to kubernetes - https://phabricator.wikimedia.org/T220401 (10Eevans) [16:57:46] 10Release-Engineering-Team, 10Core Platform Team, 10Operations, 10Release Pipeline, and 4 others: Introduce wikidata termbox SSR to kubernetes - https://phabricator.wikimedia.org/T220402 (10Lydia_Pintscher) [17:03:24] James_F, hey, did you use some trick or did you transpose that table by hand? [17:04:10] 10Phabricator, 10Release-Engineering-Team (Kanban): Calendar shows "Unhandled exception error: Expected a single result!" - https://phabricator.wikimedia.org/T220241 (10mmodell) p:05Triage→03Normal [17:08:35] (03CR) 10Tpt: "Thank you!" [integration/config] - 10https://gerrit.wikimedia.org/r/502254 (owner: 10Tpt) [17:08:46] Krenair: I copy-pasted it to LibreOffice, which meant first changing all content to escaped wikitext so it rendered as text in VE so I could swap it. Fun, huh/ [17:09:52] :( [17:11:34] It'd be relatively easy to build a transpose tool into VE, but the actual utility is so infrequent that it'd mostly get used for abuse, and it'd clutter the table UI even more. [17:12:23] yeah [17:12:32] just wondered if you had an easy trick [17:40:33] 10Release-Engineering-Team (Backlog), 10Quibble: Using Quibble with different backend than gerrit - https://phabricator.wikimedia.org/T216819 (10hashar) p:05Triage→03Low [17:41:04] (03PS1) 10Hashar: Basic reader for MediaWiki registration system [integration/quibble] - 10https://gerrit.wikimedia.org/r/502286 [18:01:13] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban), 10Quibble, 10Patch-For-Review: Quibble may need to rebuild localization cache before running tests - https://phabricator.wikimedia.org/T196347 (10Krinkle) [18:02:50] 10Continuous-Integration-Config, 10Release-Engineering-Team (Backlog), 10Wikimedia-Site-requests, 10Patch-For-Review, 10Technical-Debt: Clone mediawiki into mediawiki-config when running test's via jenkins - https://phabricator.wikimedia.org/T115713 (10Krinkle) [18:28:24] is there any way to reset gerrit branch to an older revision? I accidentally pushed to master a commit that I didn't intend to be there, but when I try to update it to state before that commit, I get "non-fast forward" error [18:28:56] is it a permission thing or gerrit just does not allow force pushes? [18:45:24] 10Release-Engineering-Team, 10Operations, 10Release Pipeline, 10serviceops, and 4 others: Introduce kask session storage service to kubernetes - https://phabricator.wikimedia.org/T220401 (10mobrovac) [18:46:20] 10Release-Engineering-Team, 10Operations, 10Release Pipeline, 10serviceops, and 2 others: TEC3:O3:O3.1:Q4 Goal - Move cpjobqueue, Wikidata Termbox SSR (new service), Kask (session storage service) and ORES (partially) through the production CD Pipeline - https://phabricator.wikimedia.org/T220398 (10mobrovac) [18:46:42] 10Release-Engineering-Team, 10Operations, 10Release Pipeline, 10serviceops: Migrate ORES to kubernetes - https://phabricator.wikimedia.org/T220400 (10mobrovac) [18:47:06] SMalyshev: yeah, there's a force-commit privilege that would need to be added to that repo. If you're the owner of the repo you should be able to add it IIRC. [18:47:18] er forcePush (not force-commit) [18:47:36] 10Release-Engineering-Team, 10Operations, 10Release Pipeline, 10serviceops, and 3 others: Migrate cpjobqueue to kubernetes - https://phabricator.wikimedia.org/T220399 (10mobrovac) [18:47:48] thcipriani: doesn't look like I can add anything there so I filed https://phabricator.wikimedia.org/T220437 [18:49:05] (03PS1) 10Paladox: Modify access rules [wikidata/query/blazegraph] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/502304 [18:49:10] thcipriani SMalyshev ^^ [18:49:19] 10Release-Engineering-Team, 10Operations, 10Release Pipeline, 10Wikidata, and 4 others: Introduce wikidata termbox SSR to kubernetes - https://phabricator.wikimedia.org/T220402 (10mobrovac) [18:49:37] https://gerrit.wikimedia.org/r/#/admin/groups/994,members appears empty [18:49:44] paladox: I see that wikidata-query-blazegraph does not have any members [18:49:50] wikidata-query does [18:49:59] not sure if it's right or not. [18:50:04] maybe we can just change the owner to wikidata-query [18:50:27] it does have a group that is a member [18:50:35] paladox: either that or add me to wikidata-query-blazegraph because I'm pretty much the only one working on this repo [18:51:06] (03PS1) 10Umherirrender: [ArticlePlaceholder] Add phan [integration/config] - 10https://gerrit.wikimedia.org/r/502306 [18:52:00] paladox: or just include wikidata-query into wikidata-query-blazegraph [18:52:06] not sure which is best... [18:52:24] 10Release-Engineering-Team, 10ChangeProp, 10Operations, 10Release Pipeline, and 5 others: Migrate cpjobqueue to kubernetes - https://phabricator.wikimedia.org/T220399 (10mobrovac) [18:52:34] either way is easier, though i guessing including "wikidata-query" in "wikidata-query-blazegraph" will work. [18:52:38] (03CR) 10Smalyshev: [C: 03+1] Modify access rules [wikidata/query/blazegraph] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/502304 (owner: 10Paladox) [18:52:40] SMalyshev: paladox it seems ldap/wmf is wikidata-query-blazegraph. (which means it has many members :)) What if we gave wikidata-query force-push and left the other rights the same? [18:53:07] Oh, that changes things, +1 to "wikidata-query force-push" [18:54:34] paladox: cool, want to abandon your change and make that change? or want me to take care of it? [18:54:40] yup [18:54:59] (03PS1) 10Paladox: Modify access rules [wikidata/query/blazegraph] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/502309 [18:55:03] thcipriani https://gerrit.wikimedia.org/r/#/c/wikidata/query/blazegraph/+/502309/ [18:55:09] (03Abandoned) 10Paladox: Modify access rules [wikidata/query/blazegraph] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/502304 (owner: 10Paladox) [18:55:33] (03CR) 10Smalyshev: [C: 03+1] Modify access rules [wikidata/query/blazegraph] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/502309 (owner: 10Paladox) [18:55:35] * thcipriani looks [18:56:24] (03CR) 10Thcipriani: [V: 03+2 C: 03+2] Modify access rules [wikidata/query/blazegraph] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/502309 (owner: 10Paladox) [18:56:37] ^ SMalyshev should be good now [18:56:42] paladox: thanks for your help! [18:56:50] your welcome :) [18:56:57] thcipriani: yep it worked, thanks! [19:07:17] (03PS1) 10Umherirrender: [BounceHandler] Add phan [integration/config] - 10https://gerrit.wikimedia.org/r/502314 [19:14:14] (03CR) 10Hashar: [C: 03+2] [BounceHandler] Add phan [integration/config] - 10https://gerrit.wikimedia.org/r/502314 (owner: 10Umherirrender) [19:15:42] (03Merged) 10jenkins-bot: [BounceHandler] Add phan [integration/config] - 10https://gerrit.wikimedia.org/r/502314 (owner: 10Umherirrender) [19:24:21] (03PS1) 10Umherirrender: [Calendar] Add phan [integration/config] - 10https://gerrit.wikimedia.org/r/502319 [19:26:41] (03PS1) 10Umherirrender: [Campaigns] Add dependency to MobileFrontend [integration/config] - 10https://gerrit.wikimedia.org/r/502320 [19:30:02] (03PS1) 10Umherirrender: [CharInsert] Add phan [integration/config] - 10https://gerrit.wikimedia.org/r/502322 [19:36:10] (03PS1) 10Umherirrender: [Citoid] Add phan [integration/config] - 10https://gerrit.wikimedia.org/r/502326 [19:42:41] (03CR) 10Hashar: [C: 03+2] "Deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/502314 (owner: 10Umherirrender) [19:45:54] hashar: Don't suppose I can convince you to build and deploy 501687? :-) [19:46:15] too lazy :) i need an URL to click on! :D [19:50:38] hashar: Sorry, https://gerrit.wikimedia.org/r/501687 :-P [19:51:01] argh [20:00:12] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.33.0-wmf.24 deployment blockers - https://phabricator.wikimedia.org/T206678 (10dduvall) [20:00:29] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.33.0-wmf.24 deployment blockers - https://phabricator.wikimedia.org/T206678 (10dduvall) 05Open→03Resolved [20:01:48] (03CR) 10Hashar: "We can avoid some repetition by merging the data structure from the generic node10 job and avoid repeating ourselves." (034 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/501687 (owner: 10Jforrester) [20:01:54] James_F: some hints :) [20:03:09] (03CR) 10Hashar: "Also, it would be nice to see a project actually generating a job." [integration/config] - 10https://gerrit.wikimedia.org/r/501687 (owner: 10Jforrester) [20:03:31] James_F: to my discharge, I have barely followed the node 10 migration effort. All credits goes to T.imo I guess [20:03:34] hashar: See the gerrit tree for a repo using it. [20:04:42] hashar: And yes, all your advice is the opposite of T.imo's. :-P [20:05:34] (03CR) 10Jforrester: docker: Provide a -deploy-node10-docker job template (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/501687 (owner: 10Jforrester) [20:06:04] !log (beta): Update mobileapps to cdb9928 (T220045 T219411 T219667) [20:06:10] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:06:10] T219411: External links no longer have arrow icon in Light theme. - https://phabricator.wikimedia.org/T219411 [20:06:11] T219667: Add wikibase entity id for image files to media endpoint - https://phabricator.wikimedia.org/T219667 [20:06:11] T220045: Stop getting base CSS from live ResourceLoader requests - https://phabricator.wikimedia.org/T220045 [20:06:21] James_F: fun :] [20:06:24] "node-6" violates entirely the naming scheme of "'-' separates different environment types". [20:06:36] I guess I'll just wait for what he says. [20:06:46] or I give it a more serious look tomorrow [20:06:51] sorry I haven't even read the other reviews [20:06:57] No worries. [20:07:15] :\ [20:42:13] 10Phabricator, 10Project-Admins: Can't manage columns on #fundraising-tech-ops board - https://phabricator.wikimedia.org/T220448 (10DStrine) [20:57:09] 10Phabricator, 10Project-Admins: Can't manage columns on #fundraising-tech-ops board - https://phabricator.wikimedia.org/T220448 (10greg) Huh, according to it's policy it's editable by #acl_sre-team and phab administrators. That's seems wrong? Do you have an acl I can use, or just put specific people and hope... [21:04:03] 10Phabricator, 10Project-Admins: Can't manage columns on #fundraising-tech-ops board - https://phabricator.wikimedia.org/T220448 (10DStrine) #acl_wmf-fr is pretty restrictive but includes us. Can you add that? [21:14:32] 10Phabricator, 10Project-Admins: Can't manage columns on #fundraising-tech-ops board - https://phabricator.wikimedia.org/T220448 (10greg) Try now! [21:19:10] 10Phabricator, 10Project-Admins: Can't manage columns on #fundraising-tech-ops board - https://phabricator.wikimedia.org/T220448 (10Aklapper) >>! In T220448#5095521, @greg wrote: > Huh, according to it's policy it's editable by #acl_sre-team and phab administrators. That's seems wrong? Sorry for that, looking... [21:19:54] (03CR) 10Kosta Harlan: "> Patch Set 2:" [integration/config] - 10https://gerrit.wikimedia.org/r/501685 (https://phabricator.wikimedia.org/T218598) (owner: 10Kosta Harlan) [21:45:13] maintenance-disconnect-full-disks build 62021 integration-slave-docker-1034 (/srv: 100%): OFFLINE due to disk space [21:47:54] PROBLEM - Free space - all mounts on integration-slave-docker-1034 is CRITICAL: CRITICAL: integration.integration-slave-docker-1034.diskspace._srv.byte_percentfree (<30.00%) [21:48:03] 10Phabricator, 10Project-Admins: Can't manage columns on #fundraising-tech-ops board - https://phabricator.wikimedia.org/T220448 (10DStrine) it works for me. @Xeno try renaming the column I just made [21:50:41] (03PS1) 10Jforrester: Skip php70 tests for wmf branches; we don't run it in prod [integration/config] - 10https://gerrit.wikimedia.org/r/502343 [21:51:24] \o/ [21:52:04] (03CR) 10jerkins-bot: [V: 04-1] Skip php70 tests for wmf branches; we don't run it in prod [integration/config] - 10https://gerrit.wikimedia.org/r/502343 (owner: 10Jforrester) [21:57:56] RECOVERY - Free space - all mounts on integration-slave-docker-1034 is OK: OK: All targets OK [22:00:10] /o\ [22:00:29] (03CR) 10Krinkle: "php70 is currently the default/generic flavour of php for jobs that aren't about the php version. We need to switch those to php72 first, " [integration/config] - 10https://gerrit.wikimedia.org/r/502343 (owner: 10Jforrester) [22:05:12] maintenance-disconnect-full-disks build 62025 integration-slave-docker-1034: OFFLINE due to disk space [22:07:45] 10Continuous-Integration-Config, 10MediaWiki-Core-Testing, 10MediaWiki-extensions-MultimediaViewer, 10MobileFrontend, and 9 others: Audit tests/selenium/LocalSettings.php file aiming at possibly deprecating the feature - https://phabricator.wikimedia.org/T199939 (10Jdlrobson) I have done exactly that. We a... [22:08:48] (03PS2) 10Jforrester: Skip php70 tests for wmf branches; we don't run it in prod [integration/config] - 10https://gerrit.wikimedia.org/r/502343 [22:10:26] (03CR) 10jerkins-bot: [V: 04-1] Skip php70 tests for wmf branches; we don't run it in prod [integration/config] - 10https://gerrit.wikimedia.org/r/502343 (owner: 10Jforrester) [22:11:15] 10Phabricator (2019-03-20): Phabricator feature request: As a colorblind user responsible for prioritization, I would like a way to differentiate tasks by priority on a project workboard that doesn't rely on colors. - https://phabricator.wikimedia.org/T202074 (10MBinder_WMF) Interesting, thanks @Aklapper [22:11:42] (03PS2) 10Hashar: Clone requirements from ext dependencies [integration/quibble] - 10https://gerrit.wikimedia.org/r/502286 (https://phabricator.wikimedia.org/T193824) [22:17:45] PROBLEM - Free space - all mounts on integration-slave-docker-1040 is CRITICAL: CRITICAL: integration.integration-slave-docker-1040.diskspace._srv.byte_percentfree (<10.00%) [22:19:54] (03CR) 10Hashar: "Given:" [integration/quibble] - 10https://gerrit.wikimedia.org/r/502286 (https://phabricator.wikimedia.org/T193824) (owner: 10Hashar) [22:22:42] RECOVERY - Free space - all mounts on integration-slave-docker-1040 is OK: OK: All targets OK [22:23:26] (03PS3) 10Hashar: Clone requirements from ext dependencies [integration/quibble] - 10https://gerrit.wikimedia.org/r/502286 (https://phabricator.wikimedia.org/T193824) [22:24:15] I felt inspired today and wrote a patch to Quibble to let it process and clone dependencies in extension.json ! :D https://gerrit.wikimedia.org/r/#/c/integration/quibble/+/502286/ [22:30:13] maintenance-disconnect-full-disks build 62030 integration-slave-docker-1034: OFFLINE due to disk space [22:32:56] PROBLEM - Free space - all mounts on integration-slave-docker-1043 is CRITICAL: CRITICAL: integration.integration-slave-docker-1043.diskspace._srv.byte_percentfree (<10.00%) [22:42:58] RECOVERY - Free space - all mounts on integration-slave-docker-1043 is OK: OK: All targets OK [22:46:31] !log cleaned docker images on integration-slave-docker-1030 and integration-slave-docker-1043 :) [22:46:32] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:55:14] maintenance-disconnect-full-disks build 62035 integration-slave-docker-1034: OFFLINE due to disk space [23:01:55] 10Continuous-Integration-Config, 10MediaWiki-Core-Testing, 10MediaWiki-extensions-MultimediaViewer, 10MobileFrontend, and 9 others: Audit tests/selenium/LocalSettings.php file aiming at possibly deprecating the feature - https://phabricator.wikimedia.org/T199939 (10Jdlrobson) Here's a concrete example, the... [23:20:11] maintenance-disconnect-full-disks build 62040 integration-slave-docker-1034: OFFLINE due to disk space [23:45:11] maintenance-disconnect-full-disks build 62045 integration-slave-docker-1034: OFFLINE due to disk space [23:57:40] (03PS1) 10Jdlrobson: Daily Minerva Selenium Node.js job [integration/config] - 10https://gerrit.wikimedia.org/r/502355 (https://phabricator.wikimedia.org/T174018) [23:57:42] (03PS1) 10Jdlrobson: Run Node.js browser tests in MobileFrontend [integration/config] - 10https://gerrit.wikimedia.org/r/502356 (https://phabricator.wikimedia.org/T174018) [23:58:30] (03CR) 10Jdlrobson: "Feel free to amend as necessary. JJB is not my strength." [integration/config] - 10https://gerrit.wikimedia.org/r/502355 (https://phabricator.wikimedia.org/T174018) (owner: 10Jdlrobson)