[00:01:42] 10Gerrit: Remove stale Gerrit identity for awight - https://phabricator.wikimedia.org/T219370 (10awight) 05Open→03Resolved a:03awight >>! In T219370#5063446, @Aklapper wrote: > Have you tried changing the email address on https://wikitech.wikimedia.org/wiki/Special:Preferences#mw-prefsection-personal alrea... [00:02:06] (03PS3) 10Effie Mouzeli: Add more tests for main [tools/scap] - 10https://gerrit.wikimedia.org/r/498340 (https://phabricator.wikimedia.org/T216518) [00:02:59] (03CR) 10PipelineBot: "pipeline-dashboard: service-pipeline-test" [tools/scap] - 10https://gerrit.wikimedia.org/r/498340 (https://phabricator.wikimedia.org/T216518) (owner: 10Effie Mouzeli) [00:03:04] (03CR) 10jerkins-bot: [V: 04-1] Add more tests for main [tools/scap] - 10https://gerrit.wikimedia.org/r/498340 (https://phabricator.wikimedia.org/T216518) (owner: 10Effie Mouzeli) [00:13:20] (03CR) 10Effie Mouzeli: "Jenkins is failing for an unrelated reason, flake8 and py27 for test_main succeed" (032 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/498340 (https://phabricator.wikimedia.org/T216518) (owner: 10Effie Mouzeli) [00:15:22] (03CR) 10Effie Mouzeli: Add more tests for main (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/498340 (https://phabricator.wikimedia.org/T216518) (owner: 10Effie Mouzeli) [01:09:33] (03PS5) 10Krinkle: zuul: Try to convert a 'branch' filter to 'skip-if' for consistency [integration/config] - 10https://gerrit.wikimedia.org/r/499682 [01:10:59] (03CR) 10jerkins-bot: [V: 04-1] zuul: Try to convert a 'branch' filter to 'skip-if' for consistency [integration/config] - 10https://gerrit.wikimedia.org/r/499682 (owner: 10Krinkle) [01:18:41] (03PS6) 10Krinkle: zuul: Try to convert a 'branch' filter to 'skip-if' for consistency [integration/config] - 10https://gerrit.wikimedia.org/r/499682 [01:27:07] (03PS7) 10Krinkle: zuul: Convert a 'branch' filter for php55 to 'skip-if' format [integration/config] - 10https://gerrit.wikimedia.org/r/499682 [01:27:10] (03CR) 10Krinkle: [C: 03+2] zuul: Convert a 'branch' filter for php55 to 'skip-if' format [integration/config] - 10https://gerrit.wikimedia.org/r/499682 (owner: 10Krinkle) [01:29:26] (03Merged) 10jenkins-bot: zuul: Convert a 'branch' filter for php55 to 'skip-if' format [integration/config] - 10https://gerrit.wikimedia.org/r/499682 (owner: 10Krinkle) [04:10:56] 10Release-Engineering-Team, 10Release Pipeline, 10docker-pkg, 10serviceops: service-pipeline-test jenkins job fails due to jessie-backports removal - https://phabricator.wikimedia.org/T219580 (10greg) Does the wikimedia-jessie base image need to be updated? [04:12:53] 10Project-Admins: Rename #Wikimedia-production-error tag or "Report Application Error" form to something less generic? - https://phabricator.wikimedia.org/T216795 (10greg) +1 [04:15:08] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.33.0-wmf.24 deployment blockers - https://phabricator.wikimedia.org/T206678 (10greg) a:03dduvall [05:21:48] PROBLEM - Free space - all mounts on deployment-fluorine02 is CRITICAL: CRITICAL: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<50.00%) [06:56:45] RECOVERY - Free space - all mounts on deployment-fluorine02 is OK: OK: All targets OK [07:25:17] 10Phabricator, 10Wikimedia-production-error: Analyze and amend (if necessary) workflow of user reporting and detecting large regressions/outages - https://phabricator.wikimedia.org/T219589 (10jcrespo) [07:26:32] 10Phabricator, 10Wikimedia-Incident: Analyze and amend (if necessary) workflow of user reporting and detecting large regressions/outages - https://phabricator.wikimedia.org/T219589 (10jcrespo) [07:30:26] 10Phabricator, 10Release-Engineering-Team, 10Operations, 10Wikimedia-Incident: Analyze and amend (if necessary) workflow of user reporting and detecting large regressions/outages - https://phabricator.wikimedia.org/T219589 (10jcrespo) Adding release engineering, although they should not own this, but so th... [08:28:17] 10Continuous-Integration-Config, 10Operations, 10Patch-For-Review, 10User-zeljkofilipin: npm 6 consistently fails with "Z_DATA_ERROR: invalid distance too far back" on some repos - https://phabricator.wikimedia.org/T215562 (10MoritzMuehlenhoff) >>! In T215562#5066711, @Krinkle wrote: > As such, it is effec... [08:43:27] 10Continuous-Integration-Config, 10MediaWiki-General-or-Unknown, 10Patch-For-Review, 10User-zeljkofilipin: `npm install` fails for mediawiki/core with EPEERINVALID when running on Node 11 - https://phabricator.wikimedia.org/T210506 (10zeljkofilipin) Could be resolved by T213268. New version of webdriverio... [08:43:47] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Testing, 10Patch-For-Review, 10User-zeljkofilipin: Upgrade webdriverio to version 5 - https://phabricator.wikimedia.org/T213268 (10zeljkofilipin) a:05zeljkofilipin→03None [10:32:58] 10Project-Admins: Move #International-Developer-Events under #Events_Team - https://phabricator.wikimedia.org/T219608 (10Qgil) [10:36:53] 10Project-Admins: Move #Direct_content_and_outreach_support_for_CE_teams under #Community-Relations - https://phabricator.wikimedia.org/T219609 (10Qgil) [10:39:54] 10Project-Admins: Move #Community_Videos_from_the_executive_director under #Community-Relations - https://phabricator.wikimedia.org/T219610 (10Qgil) [10:41:00] 10Project-Admins: Move #Direct_content_and_outreach_support_for_CE_teams under #Community-Relations - https://phabricator.wikimedia.org/T219609 (10Qgil) [10:49:12] 10Release-Engineering-Team (Kanban), 10Jenkins: jenkins: check experimental with Hosts: in ops/puppet triggers commit message validator linter error - https://phabricator.wikimedia.org/T219615 (10aborrero) [10:51:20] 10Release-Engineering-Team (Kanban), 10Jenkins: jenkins: check experimental with Hosts: in ops/puppet triggers commit message validator linter error - https://phabricator.wikimedia.org/T219615 (10aborrero) [11:03:58] Hello, I need someone to review https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/499994. It is a last-minute request to remove the cap for account creations at a GLAM event. [11:04:18] Details in https://phabricator.wikimedia.org/T219594 [11:07:22] zeljkof, maybe you are around? [11:07:35] Trizek: I am! [11:11:01] Trizek: reviewed [11:11:07] Great. Can you review my request above? :) [11:11:15] That would be <3 ! [11:11:22] is it okay to add to today’s EU SWAT or is 13:00-14:00 UTC already a bit late? [11:11:41] Lucas_WMDE: it's friday, no swat [11:11:45] argh [11:11:48] right [11:12:02] I was looking at Monday’s calendar, sorry [11:12:59] Trizek: the problems is that there are no deployments on Friday, and that patch requires a deployment [11:13:06] So if that's not possible, let's drop it. That's the organizes' fault. :) [11:13:18] it's possible in case of emergencies [11:13:26] They gave me the wrong IP. [11:13:28] but I can't really make that call [11:13:34] It it not an emergency. [11:13:37] Please decline. [11:13:40] this doesn't look like an emergency, rigth [11:13:54] Trizek: go ahead and abandon the commit [11:13:59] and close the ticket [11:15:31] I don't know how to abandon a commit. But I can close the task. :p [11:17:01] I’ve abandoned it [11:17:15] heh [11:17:18] perhaps you can find an account creator to help you out during the event? [11:17:24] sorry andre__ :) [11:17:31] Trizek: there's abandon button in gerrit :) [11:18:12] I think I'm blind, zeljkof [11:18:18] :D [11:18:27] there's many buttons, easy to miss :) [11:18:42] Lucas_WMDE, we have 10 account creators there (approximately). [11:19:13] But it is easier when users create their accounts, because they immediately get a welcome message that we will have to distribute manually. [11:19:18] We will survive. :) [11:19:50] okay :) [11:22:04] Thank you andre__, Lucas_WMDE and zeljkof! [11:22:36] you're welcome, sorry I couldn't actually help :) [11:31:10] 10Phabricator, 10Project-Admins: Move #Direct_content_and_outreach_support_for_CE_teams under #Community-Relations - https://phabricator.wikimedia.org/T219609 (10Aklapper) [11:31:16] 10Phabricator, 10Project-Admins: Move #International-Developer-Events under #Events_Team - https://phabricator.wikimedia.org/T219608 (10Aklapper) [11:47:25] Project beta-code-update-eqiad build #240673: 04FAILURE in 2 min 43 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/240673/ [11:48:44] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10Wikidata: Request access to beta cluster for Alaa Sarhan (Cloud VPS project deployment-prep) - https://phabricator.wikimedia.org/T219621 (10alaa_wmde) [11:49:04] gerrit went down and we had to restart it [11:49:23] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10Wikidata: Request access to beta cluster for Alaa Sarhan (Cloud VPS project deployment-prep) - https://phabricator.wikimedia.org/T219621 (10alaa_wmde) [11:50:59] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10Wikidata: Request access to beta cluster for Alaa Sarhan (Cloud VPS project deployment-prep) - https://phabricator.wikimedia.org/T219621 (10Krenair) which beta cluster stuff in particular? [11:54:21] Yippee, build fixed! [11:54:21] Project beta-code-update-eqiad build #240674: 09FIXED in 1 min 21 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/240674/ [11:59:26] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10Wikidata: Request access to beta cluster for Alaa Sarhan (Cloud VPS project deployment-prep) - https://phabricator.wikimedia.org/T219621 (10alaa_wmde) [12:00:22] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10Wikidata: Request access to beta cluster for Alaa Sarhan (Cloud VPS project deployment-prep) - https://phabricator.wikimedia.org/T219621 (10alaa_wmde) @Krenair right now I need access to Logstash on beta cluster for instance .. not sure how things... [12:03:33] !log added alaasarhan to deployment-prep T219621 [12:03:35] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [12:03:36] T219621: Request access to beta cluster for Alaa Sarhan (Cloud VPS project deployment-prep) - https://phabricator.wikimedia.org/T219621 [12:04:32] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10Wikidata: Request access to beta cluster for Alaa Sarhan (Cloud VPS project deployment-prep) - https://phabricator.wikimedia.org/T219621 (10Krenair) 05Open→03Resolved a:03Krenair okay, you'll find the credentials at deployment-deploy01:/root/... [12:08:26] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10Wikidata: Request access to beta cluster for Alaa Sarhan (Cloud VPS project deployment-prep) - https://phabricator.wikimedia.org/T219621 (10alaa_wmde) Thanks @Krenair [12:31:01] 10Continuous-Integration-Infrastructure: integration slaves: puppet error - php-xdebug fails to install, PHP package dependency issue - https://phabricator.wikimedia.org/T219625 (10Dzahn) [12:32:06] 10Continuous-Integration-Infrastructure: integration slaves: puppet errors - PHP package install problems - https://phabricator.wikimedia.org/T219625 (10Dzahn) [12:49:30] 10Phabricator (Upstream), 10Upstream: Disabled users should not display "Available" on their Phabricator userpages - https://phabricator.wikimedia.org/T138723 (10mmodell) @epriestley: Awesome thank you! [12:52:42] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban), 10Operations, 10puppet-compiler: operations-puppet-catalog-compiler-test fails due to commit message validator linter error - https://phabricator.wikimedia.org/T219615 (10hashar) [12:55:52] 10Release-Engineering-Team (Kanban): operations-puppet-catalog-compiler-test fails due to commit message validator linter error - https://phabricator.wikimedia.org/T219615 (10hashar) So looking at https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/499998/ I think you mixed up the jobs? When sending patches... [12:56:08] 10Release-Engineering-Team (Kanban): operations-puppet-catalog-compiler-test fails due to commit message validator linter error - https://phabricator.wikimedia.org/T219615 (10hashar) [13:04:44] 10commit-message-validator: commit-message-validator fail when an extra Hosts: header is mentioned - https://phabricator.wikimedia.org/T219629 (10hashar) [13:04:59] 10Release-Engineering-Team (Kanban): operations-puppet-catalog-compiler-test fails due to commit message validator linter error - https://phabricator.wikimedia.org/T219615 (10hashar) 05Open→03Invalid Sorry I have messed up the task :/ We should just close this one and fill a new task that is cleaned up :]... [13:05:51] 10commit-message-validator: commit-message-validator fail when an extra Hosts: header is mentioned - https://phabricator.wikimedia.org/T219629 (10hashar) [13:16:20] (03PS1) 10Hashar: Accept Hosts: meta header for puppet-compiler [integration/commit-message-validator] - 10https://gerrit.wikimedia.org/r/500042 (https://phabricator.wikimedia.org/T219629) [13:17:49] 10Release-Engineering-Team (Kanban), 10commit-message-validator, 10Patch-For-Review: commit-message-validator fail when an extra Hosts: header is mentioned - https://phabricator.wikimedia.org/T219629 (10hashar) a:03hashar [13:20:46] 10Gerrit: Remove stale Gerrit identity for awight - https://phabricator.wikimedia.org/T219370 (10hashar) Out of curiosity, what was the email in your wikitech preferences? Was it empty? [13:25:33] (03CR) 10Arturo Borrero Gonzalez: [C: 03+1] Accept Hosts: meta header for puppet-compiler [integration/commit-message-validator] - 10https://gerrit.wikimedia.org/r/500042 (https://phabricator.wikimedia.org/T219629) (owner: 10Hashar) [14:16:23] 10Project-Admins: Rename #Wikimedia-production-error tag or "Report Application Error" form to something less generic? - https://phabricator.wikimedia.org/T216795 (10Aklapper) 05Open→03Resolved a:03Krinkle I love it. Thanks so much for your thoughts and work! [14:29:42] 10Phabricator (Upstream), 10Upstream: Actions not showing in chronological order in "grouped" task actions - https://phabricator.wikimedia.org/T88186 (10Aklapper) 05Open→03Resolved > The actions grouped on T78441#1005181 could suggest that the task was first reopened and after that closed. https://phabric... [14:45:55] It looks like something went wrong with Puppet overnight in deployment-prep. [14:46:39] urldownloader02 and possibly various other hosts got reconfigured to point at the wrong puppetmaster. [14:46:50] 10Release-Engineering-Team, 10Release Pipeline, 10docker-pkg, 10serviceops, 10Patch-For-Review: Remve backports from wikimedia-jessie - https://phabricator.wikimedia.org/T219580 (10Joe) [14:47:29] 10Release-Engineering-Team, 10Release Pipeline, 10docker-pkg, 10serviceops, 10Patch-For-Review: Remve backports from wikimedia-jessie - https://phabricator.wikimedia.org/T219580 (10Joe) a:03Joe [14:48:26] okay not so much overnight as, well [14:48:33] Mar 28 11:59:31 deployment-urldownloader02 puppet-agent[28084]: (/Stage[main]/Base::Puppet/Base::Puppet::Config[main]/File[/etc/puppet/puppet.conf.d/10-main.conf]/content) -server = deployment-puppetmaster03.deployment-prep.eqiad.wmflabs [14:48:33] Mar 28 11:59:31 deployment-urldownloader02 puppet-agent[28084]: (/Stage[main]/Base::Puppet/Base::Puppet::Config[main]/File[/etc/puppet/puppet.conf.d/10-main.conf]/content) +server = labs-puppetmaster.wikimedia.org [14:50:59] Same thing on -acme-chief03 [14:51:26] others to check: -acme-chief04, -aqs01, -aqs03, -chromium02, -elastic07, -maps04, -prometheus02 [14:53:48] (9) deployment-acme-chief[03-04].deployment-prep.eqiad.wmflabs,deployment-aqs[01,03].deployment-prep.eqiad.wmflabs,deployment-chromium02.deployment-prep.eqiad.wmflabs,deployment-elastic07.deployment-prep.eqiad.wmflabs,deployment-maps04.deployment-prep.eqiad.wmflabs,deployment-prometheus02.deployment-prep.eqiad.wmflabs,deployment-urldownloader02.deployment-prep.eqiad.wmflabs [15:06:26] 10Gerrit, 10Upstream: Gerrit Change-Id should not be copied with "Change-Id: " prefix - https://phabricator.wikimedia.org/T195277 (10Ammarpad) >>! In T195277#5057648, @Dvorapa wrote: > Not for me True :). I misread something. [15:23:23] (03PS1) 10Hashar: Attempt to test Quibble job filters [integration/config] - 10https://gerrit.wikimedia.org/r/500065 [15:24:51] (03CR) 10jerkins-bot: [V: 04-1] Attempt to test Quibble job filters [integration/config] - 10https://gerrit.wikimedia.org/r/500065 (owner: 10Hashar) [15:47:51] (03Abandoned) 10Hashar: zuul: update Phantom42 email [integration/config] - 10https://gerrit.wikimedia.org/r/440746 (owner: 10Phantom42) [16:05:15] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.33.0-wmf.24 deployment blockers - https://phabricator.wikimedia.org/T206678 (10Catrope) [16:17:51] 10Continuous-Integration-Infrastructure: ffmpeg is no more in Jessie, have to rethink CI jobs / containers - https://phabricator.wikimedia.org/T219645 (10hashar) [16:19:21] 10Release-Engineering-Team, 10Release Pipeline, 10docker-pkg, 10serviceops, 10Patch-For-Review: Remove backports from wikimedia-jessie - https://phabricator.wikimedia.org/T219580 (10Aklapper) [16:21:35] 10Continuous-Integration-Infrastructure: ffmpeg is no more in Jessie, have to rethink CI jobs / containers - https://phabricator.wikimedia.org/T219645 (10hashar) Jobs triggered in Zuul: ` mediawiki-quibble-composer-mysql-php55-docker mediawiki-quibble-vendor-mysql-php55-docker quibble-composer-mysql-php55-docker... [16:31:56] 10Release-Engineering-Team (Kanban), 10Code-Health-Metrics, 10Patch-For-Review, 10User-zeljkofilipin: Generate baseline analysis of all extensions - https://phabricator.wikimedia.org/T219156 (10zeljkofilipin) There are 1721 repos in gerrit in total. The last time I've cloned them all there were 2004. [16:35:16] (03PS1) 10Hashar: jjb: remove php55 quibble jobs that are not triggered [integration/config] - 10https://gerrit.wikimedia.org/r/500078 (https://phabricator.wikimedia.org/T219645) [16:40:06] (03CR) 10PipelineBot: "pipeline-dashboard: service-pipeline-test" [tools/scap] - 10https://gerrit.wikimedia.org/r/498340 (https://phabricator.wikimedia.org/T216518) (owner: 10Effie Mouzeli) [16:43:48] 10Release-Engineering-Team, 10Release Pipeline, 10docker-pkg, 10serviceops, 10Patch-For-Review: Remove backports from wikimedia-jessie - https://phabricator.wikimedia.org/T219580 (10Joe) This is harder than expected, as bootstrap-vz automatically adds `{release}-updates` to `/etc/apt/sources.list`, see... [16:44:40] (03CR) 10BryanDavis: [C: 03+2] Accept Hosts: meta header for puppet-compiler [integration/commit-message-validator] - 10https://gerrit.wikimedia.org/r/500042 (https://phabricator.wikimedia.org/T219629) (owner: 10Hashar) [16:45:24] (03Merged) 10jenkins-bot: Accept Hosts: meta header for puppet-compiler [integration/commit-message-validator] - 10https://gerrit.wikimedia.org/r/500042 (https://phabricator.wikimedia.org/T219629) (owner: 10Hashar) [16:50:12] (03CR) 10Hashar: [C: 03+2] jjb: remove php55 quibble jobs that are not triggered [integration/config] - 10https://gerrit.wikimedia.org/r/500078 (https://phabricator.wikimedia.org/T219645) (owner: 10Hashar) [16:55:46] (03Merged) 10jenkins-bot: jjb: remove php55 quibble jobs that are not triggered [integration/config] - 10https://gerrit.wikimedia.org/r/500078 (https://phabricator.wikimedia.org/T219645) (owner: 10Hashar) [17:03:25] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Quibble: Upgrade CI jobs to Quibble 0.0.30 - https://phabricator.wikimedia.org/T219647 (10hashar) [17:04:10] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Quibble (marble): Quibble should clone repositories in parallel - https://phabricator.wikimedia.org/T211701 (10hashar) [17:04:12] 10Gerrit, 10Wikimedia-General-or-Unknown, 10Documentation, 10Epic, and 3 others: Update Gerrit /r/p/ links to /r/ - https://phabricator.wikimedia.org/T218844 (10hashar) [17:04:14] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Quibble: Upgrade CI jobs to Quibble 0.0.30 - https://phabricator.wikimedia.org/T219647 (10hashar) [17:04:22] 10Release-Engineering-Team (Kanban), 10Quibble, 10Patch-For-Review: Quibble should errors out when a git submodule fails - https://phabricator.wikimedia.org/T198980 (10hashar) [17:07:22] (03PS1) 10Hashar: docker: drop ffmpeg from Jessie, upgrade Quibble to 0.0.30 [integration/config] - 10https://gerrit.wikimedia.org/r/500081 (https://phabricator.wikimedia.org/T219645) [17:09:04] (03CR) 10Hashar: [C: 03+2] docker: drop ffmpeg from Jessie, upgrade Quibble to 0.0.30 [integration/config] - 10https://gerrit.wikimedia.org/r/500081 (https://phabricator.wikimedia.org/T219645) (owner: 10Hashar) [17:10:59] (03Merged) 10jenkins-bot: docker: drop ffmpeg from Jessie, upgrade Quibble to 0.0.30 [integration/config] - 10https://gerrit.wikimedia.org/r/500081 (https://phabricator.wikimedia.org/T219645) (owner: 10Hashar) [17:22:24] !log Building Ci docker images for quibble 0.0.30 T219647 T219645 [17:22:28] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:22:28] 10Release-Engineering-Team (Kanban), 10Code-Health-Metrics, 10Patch-For-Review, 10User-zeljkofilipin: Generate baseline analysis of all extensions - https://phabricator.wikimedia.org/T219156 (10zeljkofilipin) Extension 3D is not at https://sonarcloud.io/organizations/wmftest/projects so I'll use it as the... [17:22:28] T219645: ffmpeg is no more in Jessie, have to rethink CI jobs / containers - https://phabricator.wikimedia.org/T219645 [17:22:28] T219647: Upgrade CI jobs to Quibble 0.0.30 - https://phabricator.wikimedia.org/T219647 [17:22:43] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Quibble, 10Patch-For-Review: Upgrade CI jobs to Quibble 0.0.30 - https://phabricator.wikimedia.org/T219647 (10hashar) [17:22:45] 10Continuous-Integration-Infrastructure, 10Patch-For-Review: ffmpeg is no more in Jessie, have to rethink CI jobs / containers - https://phabricator.wikimedia.org/T219645 (10hashar) [17:23:25] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Quibble, 10Patch-For-Review: Upgrade CI jobs to Quibble 0.0.30 - https://phabricator.wikimedia.org/T219647 (10hashar) [17:23:27] 10Continuous-Integration-Infrastructure, 10Patch-For-Review: ffmpeg is no more in Jessie, have to rethink CI jobs / containers - https://phabricator.wikimedia.org/T219645 (10hashar) 05Open→03Resolved a:03hashar Since ffmpeg is no more needed on Jessie containers (it is only used for REL1_27 jobs) the fix... [17:26:04] and of course the build fail :( [17:30:04] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Quibble, 10Patch-For-Review: Upgrade CI jobs to Quibble 0.0.30 - https://phabricator.wikimedia.org/T219647 (10hashar) Some images fail to build and unfortunately the version of docker-pkg we have does not show the build output... [17:30:34] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Quibble, 10Patch-For-Review: Upgrade CI jobs to Quibble 0.0.30 - https://phabricator.wikimedia.org/T219647 (10hashar) Will try again later [17:30:50] !log some quibble 0.0.30 images fail to build for an unknown reason . Left to figure out after the week-end has passed.. [17:30:51] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:45:23] 10Continuous-Integration-Infrastructure, 10MediaWiki-Core-Testing, 10Wikimedia-production-error (Shared Build Failure), 10phan: mediawiki-core-php70-phan failing due to "Cannot allocate memory" - https://phabricator.wikimedia.org/T219657 (10Krinkle) [17:48:59] 10Continuous-Integration-Config, 10Code-Health-Metrics: Report results from SonarCloud to Gerrit - https://phabricator.wikimedia.org/T217008 (10kostajh) I met with @thcipriani about this today. In the short-term what we'll do is: 1. Modify the wmf-sonar-scanner-{name} job template to poll for analysis complet... [17:50:46] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Testing, 10User-zeljkofilipin: Add EditPage to wdio-mediawiki - https://phabricator.wikimedia.org/T219653 (10zeljkofilipin) a:03zeljkofilipin [17:50:53] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Testing, 10User-zeljkofilipin: Add EditPage to wdio-mediawiki - https://phabricator.wikimedia.org/T219653 (10zeljkofilipin) p:05Triage→03Normal [17:53:12] 10Continuous-Integration-Config, 10Code-Health-Metrics: Report results from SonarCloud to Gerrit - https://phabricator.wikimedia.org/T217008 (10kostajh) I forgot to mention; being able to post meaningful comments on the task with information about issues uncovered, for example, is going to take longer as we ne... [17:59:13] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Testing, 10User-zeljkofilipin: Add EditPage to wdio-mediawiki - https://phabricator.wikimedia.org/T219653 (10zeljkofilipin) For #revision-slider see [[ https://gerrit.wikimedia.org/r/c/mediawiki/extensions/RevisionSlider/+/499855/6/tests/selenium/pageobje... [18:06:33] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Testing, 10User-zeljkofilipin: Add EditPage to wdio-mediawiki - https://phabricator.wikimedia.org/T219653 (10WMDE-Fisch) At least for #two-column-edit-conflict-merge I need to do a "real manual" edit with the edit page to trigger the edit conflict. So usi... [18:08:10] (03PS4) 10Kosta Harlan: Add postmerge step to analyze master branch with sonar-scanner [integration/config] - 10https://gerrit.wikimedia.org/r/498887 (https://phabricator.wikimedia.org/T219156) [18:13:26] 10Release-Engineering-Team (Kanban), 10Code-Health-Metrics, 10Patch-For-Review, 10User-zeljkofilipin: Generate baseline analysis of all extensions - https://phabricator.wikimedia.org/T219156 (10zeljkofilipin) I might be doing something wrong. 🤔 I'm getting `Caused by: Project was never analyzed. A regular... [18:15:25] 10Release-Engineering-Team (Kanban), 10Code-Health-Metrics, 10Patch-For-Review, 10User-zeljkofilipin: Generate baseline analysis of all extensions - https://phabricator.wikimedia.org/T219156 (10kostajh) @zeljkofilipin try removing `-Dsonar.branch.target="master" -Dsonar.branch.name="master"` from the comma... [18:22:09] (03PS2) 10Krinkle: Remove my old email address from CI whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/497975 (owner: 10Jack Phoenix) [18:22:17] (03CR) 10Krinkle: [C: 03+2] Remove my old email address from CI whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/497975 (owner: 10Jack Phoenix) [18:22:32] 10Release-Engineering-Team (Kanban), 10Code-Health-Metrics, 10Patch-For-Review, 10User-zeljkofilipin: Generate baseline analysis of all extensions - https://phabricator.wikimedia.org/T219156 (10zeljkofilipin) I've searched for the error message and found [[ https://community.sonarsource.com/t/project-was-n... [18:23:45] (03Merged) 10jenkins-bot: Remove my old email address from CI whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/497975 (owner: 10Jack Phoenix) [18:23:53] 10Release-Engineering-Team (Kanban), 10Code-Health-Metrics, 10Patch-For-Review, 10User-zeljkofilipin: Generate baseline analysis of all extensions - https://phabricator.wikimedia.org/T219156 (10zeljkofilipin) >>! In T219156#5070375, @kostajh wrote: > @zeljkofilipin try removing `-Dsonar.branch.target="mast... [18:27:51] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.33.0-wmf.24 deployment blockers - https://phabricator.wikimedia.org/T206678 (10Catrope) [18:30:26] (03PS5) 10Kosta Harlan: Add postmerge step to analyze master branch with sonar-scanner [integration/config] - 10https://gerrit.wikimedia.org/r/498887 (https://phabricator.wikimedia.org/T219156) [18:31:43] (03CR) 10jerkins-bot: [V: 04-1] Add postmerge step to analyze master branch with sonar-scanner [integration/config] - 10https://gerrit.wikimedia.org/r/498887 (https://phabricator.wikimedia.org/T219156) (owner: 10Kosta Harlan) [18:47:06] (03PS6) 10Thcipriani: Add postmerge step to analyze master branch with sonar-scanner [integration/config] - 10https://gerrit.wikimedia.org/r/498887 (https://phabricator.wikimedia.org/T219156) (owner: 10Kosta Harlan) [18:48:37] (03CR) 10jerkins-bot: [V: 04-1] Add postmerge step to analyze master branch with sonar-scanner [integration/config] - 10https://gerrit.wikimedia.org/r/498887 (https://phabricator.wikimedia.org/T219156) (owner: 10Kosta Harlan) [18:50:37] (03PS7) 10Kosta Harlan: Add postmerge step to analyze master branch with sonar-scanner [integration/config] - 10https://gerrit.wikimedia.org/r/498887 (https://phabricator.wikimedia.org/T219156) [18:51:02] 10Release-Engineering-Team, 10Readers-Web-Backlog, 10Epic, 10MobileFrontend (MobileFrontend and MinervaNeue architecture): [EPIC] Generate compiled assets from continuous integration - https://phabricator.wikimedia.org/T158980 (10Niedzielski) 05Open→03Stalled I believe this is blocked on T199004. [18:51:13] 10Release-Engineering-Team, 10Readers-Web-Backlog, 10Epic, 10MobileFrontend (MobileFrontend and MinervaNeue architecture): [EPIC] Generate compiled assets from continuous integration - https://phabricator.wikimedia.org/T158980 (10Niedzielski) [18:59:01] PROBLEM - Long lived cherry-picks on puppetmaster on deployment-puppetmaster03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [19:05:00] (03CR) 10Thcipriani: [C: 03+2] Add postmerge step to analyze master branch with sonar-scanner [integration/config] - 10https://gerrit.wikimedia.org/r/498887 (https://phabricator.wikimedia.org/T219156) (owner: 10Kosta Harlan) [19:08:05] (03Merged) 10jenkins-bot: Add postmerge step to analyze master branch with sonar-scanner [integration/config] - 10https://gerrit.wikimedia.org/r/498887 (https://phabricator.wikimedia.org/T219156) (owner: 10Kosta Harlan) [19:10:18] 10Release-Engineering-Team (Watching / External), 10Operations, 10Release Pipeline, 10Core Platform Team Kanban (Done with CPT), 10Services (done): Track and install additional npm packages for all service container images - https://phabricator.wikimedia.org/T205911 (10mobrovac) 05Open→03Resolved a:... [19:12:02] !log reloading zuul to deploy https://gerrit.wikimedia.org/r/497975/ + https://gerrit.wikimedia.org/r/498887/ [19:12:03] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:13:43] any idea why this (https://gerrit.wikimedia.org/r/c/mediawiki/core/+/499884) is not going through after the +2? I can't find it in here (https://integration.wikimedia.org/zuul/) [19:14:30] * thcipriani looks [19:14:46] I'd just say rebase and reapply the C+2 [19:15:24] sure, I can try that. [19:19:38] dmaza: oh! I see what happened. https://tools.wmflabs.org/sal/log/AWnJg1F7A1BDhGjCgobV [19:19:48] I restarted gerrit right when that tried to merge. [19:20:19] oh.. so what now? [19:20:27] it seems taht rebase and +2 didn't do much [19:20:28] it'll merge fine when you reapply C+2 :P [19:20:33] ^ [19:20:50] It's in gate and submit now, as expected [19:20:56] Just gotta wait for the tests to be run etc [19:21:04] ah.. thank you thcipriani Reedy [19:21:10] Thanks! [19:21:11] I see it now [19:23:49] * paladox just fixed a bug i introduced into PolyGerrit! https://gerrit-review.googlesource.com/c/gerrit/+/219253 [19:25:34] 10Release-Engineering-Team (Kanban), 10Code-Health-Metrics, 10Patch-For-Review, 10User-zeljkofilipin: Generate baseline analysis of all extensions - https://phabricator.wikimedia.org/T219156 (10zeljkofilipin) List of extensions is at P8317. Let me know if I've missed any. [19:28:22] you broke it and then fixed it? a fine tradition [19:29:56] yup [19:30:04] 10Deployments, 10TechCom, 10I18n, 10Language-Team (Language-2019-April-June): Determine desired architecture to update localization strings for Wikimedia - https://phabricator.wikimedia.org/T206694 (10Pginer-WMF) [19:36:43] (03CR) 10Umherirrender: "The patch set to the extension is now merged, please provide the job. Thanks" [integration/config] - 10https://gerrit.wikimedia.org/r/496020 (owner: 10Umherirrender) [19:43:49] (03PS1) 10Umherirrender: [intersection] Add phan [integration/config] - 10https://gerrit.wikimedia.org/r/500106 [19:59:28] (03PS1) 10Umherirrender: [timeline] Add phan [integration/config] - 10https://gerrit.wikimedia.org/r/500111 [20:06:56] 10Release-Engineering-Team (Kanban), 10Code-Health-Metrics, 10Patch-For-Review, 10User-zeljkofilipin: Generate baseline analysis of all extensions - https://phabricator.wikimedia.org/T219156 (10zeljkofilipin) The script is at [[ https://github.com/zeljkofilipin/gerrit/blob/master/sonar-scanner.rb | sonar-s... [20:19:08] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [20:19:37] (03PS1) 10Umherirrender: [WikimediaMessages] Add dependencies for used classes [integration/config] - 10https://gerrit.wikimedia.org/r/500116 [20:24:16] (03PS1) 10Umherirrender: [TemplateSandbox] Add phan [integration/config] - 10https://gerrit.wikimedia.org/r/500119 [20:29:07] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [20:31:51] (03PS1) 10Umherirrender: [NavigationTiming] Add phan [integration/config] - 10https://gerrit.wikimedia.org/r/500124 [20:37:22] (03PS1) 10Umherirrender: [XAnalytics] Add phan [integration/config] - 10https://gerrit.wikimedia.org/r/500127 [21:47:05] (03PS2) 10Dduvall: WIP Allow configuration of pipeline [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/499918 [21:47:07] (03PS1) 10Dduvall: WIP Provide local system tests using Jenkins in Docker [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/500134 [21:50:32] (03CR) 10PipelineBot: "pipeline-dashboard: service-pipeline-test" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/499918 (owner: 10Dduvall) [21:50:34] (03CR) 10jerkins-bot: [V: 04-1] WIP Allow configuration of pipeline [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/499918 (owner: 10Dduvall) [21:51:15] (03CR) 10PipelineBot: "pipeline-dashboard: service-pipeline-test" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/500134 (owner: 10Dduvall) [21:58:16] (03PS2) 10Dduvall: WIP Provide local system tests using Jenkins in Docker [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/500134 [22:00:01] (03CR) 10PipelineBot: "pipeline-dashboard: service-pipeline-test" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/500134 (owner: 10Dduvall) [22:03:56] (03PS3) 10Dduvall: WIP Allow configuration of pipeline [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/499918 [22:05:33] (03CR) 10PipelineBot: "pipeline-dashboard: service-pipeline-test" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/499918 (owner: 10Dduvall) [22:09:06] (03PS4) 10Dduvall: WIP Allow configuration of pipeline [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/499918 [22:11:11] (03CR) 10PipelineBot: "pipeline-dashboard: service-pipeline-test" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/499918 (owner: 10Dduvall) [22:11:20] 10Release-Engineering-Team (Kanban), 10Developer Productivity, 10local-charts: Script SSHFS setup in local-charts - https://phabricator.wikimedia.org/T218364 (10brennen) p:05Triage→03Normal a:05brennen→03jeena [22:29:22] (03PS1) 10Hashar: docker: rebuild ci-jessie due to changes in apt repo [integration/config] - 10https://gerrit.wikimedia.org/r/500143 [22:29:52] (03CR) 10Hashar: "gotta diff and see what happens exactly but it should be harmless ;)" [integration/config] - 10https://gerrit.wikimedia.org/r/500143 (owner: 10Hashar) [22:40:27] (03PS3) 10Dduvall: WIP Provide local system tests using Jenkins in Docker [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/500134 [22:41:25] (03CR) 10PipelineBot: "pipeline-dashboard: service-pipeline-test" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/500134 (owner: 10Dduvall) [22:41:58] (03PS5) 10Dduvall: WIP Allow configuration of pipeline [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/499918 [22:44:33] (03PS2) 10Hashar: docker: rebuild ci-jessie due to changes in apt repo [integration/config] - 10https://gerrit.wikimedia.org/r/500143 (https://phabricator.wikimedia.org/T219683) [22:44:35] (03CR) 10PipelineBot: "pipeline-dashboard: service-pipeline-test" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/499918 (owner: 10Dduvall) [22:46:01] (03PS3) 10Hashar: docker: rebuild ci-jessie due to changes in apt repo [integration/config] - 10https://gerrit.wikimedia.org/r/500143 (https://phabricator.wikimedia.org/T219683) [22:46:38] (03PS4) 10Dduvall: WIP Provide local system tests using Jenkins in Docker [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/500134 [22:46:40] (03PS6) 10Dduvall: WIP Allow configuration of pipeline [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/499918 [22:47:49] (03CR) 10PipelineBot: "pipeline-dashboard: service-pipeline-test" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/500134 (owner: 10Dduvall) [22:48:27] (03CR) 10PipelineBot: "pipeline-dashboard: service-pipeline-test" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/499918 (owner: 10Dduvall) [23:43:19] 10Continuous-Integration-Infrastructure, 10MediaWiki-Core-Testing, 10Wikimedia-production-error (Shared Build Failure), 10phan: mediawiki-core-php70-phan failing due to "Cannot allocate memory" - https://phabricator.wikimedia.org/T219657 (10Krinkle) @hashar Perhaps we should make this job non-voting until... [23:45:09] 10Continuous-Integration-Infrastructure, 10MediaWiki-Core-Testing, 10Wikimedia-production-error (Shared Build Failure), 10phan: mediawiki-core-php70-phan failing due to "Cannot allocate memory" - https://phabricator.wikimedia.org/T219657 (10Krinkle)