[04:24:44] <wikibugs>	 10Continuous-Integration-Config, 10GapFinder, 10Research: Recommendation-api: tox-docker is failing - https://phabricator.wikimedia.org/T244675 (10Legoktm) If the tests should only be run against Python 2.7, then you need to set `envlist` to just py27 in tox.ini (https://gerrit.wikimedia.org/r/plugins/gitile...
[04:28:43] <wikibugs>	 10Release-Engineering-Team (CI & Testing services), 10Performance-Team, 10Upstream, 10phan: Constant inheritance not detected in phan, blocking merge of a patch - https://phabricator.wikimedia.org/T244633 (10Legoktm)
[05:33:15] <wikibugs>	 10Beta-Cluster-Infrastructure, 10ContentSecurityPolicy, 10Maps, 10Patch-For-Review: Beta Cluster points to maps-beta.wmflabs.org instead of maps.wikimedia.org, which CSP blocks - https://phabricator.wikimedia.org/T240960 (10Bawolff) I'm more thinking of the general use case - You can use maps extension out...
[06:58:27] <wikibugs>	 (03CR) 10Legoktm: [C: 03+2] Merge in cobertura-clover-transform from integration/jenkins [integration/config] - 10https://gerrit.wikimedia.org/r/571017 (owner: 10Legoktm)
[06:59:28] <wikibugs>	 (03Merged) 10jenkins-bot: Merge in cobertura-clover-transform from integration/jenkins [integration/config] - 10https://gerrit.wikimedia.org/r/571017 (owner: 10Legoktm)
[07:00:02] <legoktm>	 !log updating docker-pkg for https://gerrit.wikimedia.org/r/571017
[07:00:03] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[07:03:31] <legoktm>	 eh
[07:03:35] <legoktm>	 sigh
[07:03:51] <legoktm>	 2020-02-10 07:02:27,087 [docker-pkg-build] INFO -   Downloading https://files.pythonhosted.org/packages/60/85/668bca4a9ef474ca634c993e768f12bd99af1f06bb90bb2655bc538a967e/zipp-2.2.0.tar.gz (image.py:179)
[07:03:51] <legoktm>	 2020-02-10 07:02:27,127 [docker-pkg-build] INFO - Could not import setuptools which is required to install from a source distribution.
[07:03:51] <legoktm>	 Please install setuptools.
[07:18:37] <wikibugs>	 (03PS1) 10Legoktm: tox: Install setuptools before tox [integration/config] - 10https://gerrit.wikimedia.org/r/571127
[07:19:08] <wikibugs>	 (03CR) 10Legoktm: [C: 03+2] tox: Install setuptools before tox [integration/config] - 10https://gerrit.wikimedia.org/r/571127 (owner: 10Legoktm)
[07:20:00] <wikibugs>	 (03Merged) 10jenkins-bot: tox: Install setuptools before tox [integration/config] - 10https://gerrit.wikimedia.org/r/571127 (owner: 10Legoktm)
[07:20:22] <legoktm>	 !log updating tox docker-pkg image (try #2) https://gerrit.wikimedia.org/r/571127
[07:20:24] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[07:23:50] <legoktm>	 cool, it built now
[07:24:48] <legoktm>	 2020-02-10 07:23:01,804 [docker-pkg-build] INFO - Successfully built 3e79afe89736 (image.py:179)
[07:24:49] <legoktm>	 2020-02-10 07:23:01,864 [docker-pkg-build] INFO - Successfully tagged docker-registry.discovery.wmnet/releng/tox:0.4.1 (image.py:179)
[07:25:42] <wikibugs>	 (03PS2) 10Legoktm: jjb: Use cobertura-clover-transform from container [integration/config] - 10https://gerrit.wikimedia.org/r/571018
[07:40:03] <wikibugs>	 (03PS3) 10Legoktm: jjb: Use cobertura-clover-transform from container [integration/config] - 10https://gerrit.wikimedia.org/r/571018
[07:40:05] <wikibugs>	 (03PS2) 10Legoktm: tox: Install gettext [integration/config] - 10https://gerrit.wikimedia.org/r/571019 (https://phabricator.wikimedia.org/T241685)
[07:40:07] <wikibugs>	 (03PS1) 10Legoktm: Use tox:0.4.2 image in jobs [integration/config] - 10https://gerrit.wikimedia.org/r/571224
[07:40:20] <wikibugs>	 (03CR) 10Legoktm: [C: 03+2] jjb: Use cobertura-clover-transform from container [integration/config] - 10https://gerrit.wikimedia.org/r/571018 (owner: 10Legoktm)
[07:41:20] <wikibugs>	 (03PS1) 10Legoktm: Remove cobertura-clover-transform files [integration/jenkins] - 10https://gerrit.wikimedia.org/r/571225
[07:41:30] <wikibugs>	 (03Merged) 10jenkins-bot: jjb: Use cobertura-clover-transform from container [integration/config] - 10https://gerrit.wikimedia.org/r/571018 (owner: 10Legoktm)
[07:41:36] <wikibugs>	 (03CR) 10Legoktm: [C: 03+2] tox: Install gettext [integration/config] - 10https://gerrit.wikimedia.org/r/571019 (https://phabricator.wikimedia.org/T241685) (owner: 10Legoktm)
[07:42:53] <wikibugs>	 (03Merged) 10jenkins-bot: tox: Install gettext [integration/config] - 10https://gerrit.wikimedia.org/r/571019 (https://phabricator.wikimedia.org/T241685) (owner: 10Legoktm)
[07:43:24] <legoktm>	 !log updating tox docker-pkg image for gettext https://gerrit.wikimedia.org/r/571019
[07:43:25] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[08:11:06] <wikibugs>	 (03CR) 10Legoktm: [C: 03+2] Use tox:0.4.2 image in jobs [integration/config] - 10https://gerrit.wikimedia.org/r/571224 (owner: 10Legoktm)
[08:11:37] <wikibugs>	 (03Merged) 10jenkins-bot: Use tox:0.4.2 image in jobs [integration/config] - 10https://gerrit.wikimedia.org/r/571224 (owner: 10Legoktm)
[08:15:07] <wikibugs>	 (03PS1) 10Legoktm: Rebuild tox-mysqld [integration/config] - 10https://gerrit.wikimedia.org/r/571234
[08:15:09] <wikibugs>	 (03PS1) 10Legoktm: jjb: Update jobs to use tox-mysqld:0.4.2 [integration/config] - 10https://gerrit.wikimedia.org/r/571235
[08:15:41] <wikibugs>	 (03CR) 10Legoktm: [C: 03+2] Rebuild tox-mysqld [integration/config] - 10https://gerrit.wikimedia.org/r/571234 (owner: 10Legoktm)
[08:16:09] <wikibugs>	 10Beta-Cluster-Infrastructure, 10ContentSecurityPolicy, 10Maps, 10Patch-For-Review: Beta Cluster points to maps-beta.wmflabs.org instead of maps.wikimedia.org, which CSP blocks - https://phabricator.wikimedia.org/T240960 (10Bawolff)  >  > While making the maps URLs lazily added might work for some cases, I...
[08:16:52] <wikibugs>	 (03Merged) 10jenkins-bot: Rebuild tox-mysqld [integration/config] - 10https://gerrit.wikimedia.org/r/571234 (owner: 10Legoktm)
[08:17:15] <legoktm>	 !log updating tox-mysqld docker-pkg image https://gerrit.wikimedia.org/r/571234
[08:17:17] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[08:19:49] <wikibugs>	 10Continuous-Integration-Config, 10WMCZ-Tracker: Make a tox+gettext Docker image for Wikimedia Tracker - https://phabricator.wikimedia.org/T241685 (10Legoktm) 05Open→03Resolved a:03Legoktm
[08:20:02] <wikibugs>	 (03CR) 10Legoktm: [C: 03+2] jjb: Update jobs to use tox-mysqld:0.4.2 [integration/config] - 10https://gerrit.wikimedia.org/r/571235 (owner: 10Legoktm)
[08:21:08] <wikibugs>	 (03Merged) 10jenkins-bot: jjb: Update jobs to use tox-mysqld:0.4.2 [integration/config] - 10https://gerrit.wikimedia.org/r/571235 (owner: 10Legoktm)
[08:21:53] <wikibugs>	 (03PS3) 10Legoktm: Pass ZUUL_PROJECT as the gerrit project name for sonarqubebot [integration/config] - 10https://gerrit.wikimedia.org/r/564630 (owner: 10Kosta Harlan)
[08:22:49] <wikibugs>	 (03PS1) 10Volans: Add tox job for operations/homer/public [integration/config] - 10https://gerrit.wikimedia.org/r/571236 (https://phabricator.wikimedia.org/T244690)
[08:26:28] <wikibugs>	 (03CR) 10Legoktm: "Is the new git repository supposed to be frozen in the docker image? Currently it'll include the contents of image build time, not what ma" (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/568546 (owner: 10CRusnov)
[08:27:54] <wikibugs>	 (03CR) 10Legoktm: [C: 03+2] "INFO:jenkins_jobs.builder:Reconfiguring jenkins job mwcore-codehealth-patch" [integration/config] - 10https://gerrit.wikimedia.org/r/564630 (owner: 10Kosta Harlan)
[08:28:39] <wikibugs>	 (03CR) 10Legoktm: [C: 03+2] Add tox job for operations/homer/public [integration/config] - 10https://gerrit.wikimedia.org/r/571236 (https://phabricator.wikimedia.org/T244690) (owner: 10Volans)
[08:28:55] <wikibugs>	 (03Merged) 10jenkins-bot: Pass ZUUL_PROJECT as the gerrit project name for sonarqubebot [integration/config] - 10https://gerrit.wikimedia.org/r/564630 (owner: 10Kosta Harlan)
[08:29:26] <wikibugs>	 (03Merged) 10jenkins-bot: Add tox job for operations/homer/public [integration/config] - 10https://gerrit.wikimedia.org/r/571236 (https://phabricator.wikimedia.org/T244690) (owner: 10Volans)
[08:30:18] <legoktm>	 !log reloading zuul for https://gerrit.wikimedia.org/r/571236
[08:30:19] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[08:36:39] <kostajh>	 legoktm: thanks :)
[08:37:25] <legoktm>	 kostajh: anytime
[08:37:33] <legoktm>	 trying to clear through the backlog right now...
[08:41:44] <wikibugs>	 (03PS5) 10Legoktm: Whitelist SLF Bot for extension-SecureLinkFixer [integration/config] - 10https://gerrit.wikimedia.org/r/539724 (owner: 10MarcoAurelio)
[08:42:08] <wikibugs>	 (03CR) 10Legoktm: [C: 03+2] Whitelist SLF Bot for extension-SecureLinkFixer [integration/config] - 10https://gerrit.wikimedia.org/r/539724 (owner: 10MarcoAurelio)
[08:43:21] <wikibugs>	 (03Merged) 10jenkins-bot: Whitelist SLF Bot for extension-SecureLinkFixer [integration/config] - 10https://gerrit.wikimedia.org/r/539724 (owner: 10MarcoAurelio)
[08:44:13] <legoktm>	 !log reloading zuul for https://gerrit.wikimedia.org/r/539724
[08:44:14] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[08:51:12] <wikibugs>	 (03CR) 10DannyS712: [C: 03+1] "Looks good to go" [integration/config] - 10https://gerrit.wikimedia.org/r/570941 (https://phabricator.wikimedia.org/T201496) (owner: 10Jforrester)
[08:57:24] <wikibugs>	 (03PS1) 10Legoktm: Run php-compile-php74-docker as part of test/gate [integration/config] - 10https://gerrit.wikimedia.org/r/571242
[09:01:03] <wikibugs>	 (03CR) 10Legoktm: [C: 03+2] Run php-compile-php74-docker as part of test/gate [integration/config] - 10https://gerrit.wikimedia.org/r/571242 (owner: 10Legoktm)
[09:02:03] <wikibugs>	 (03Merged) 10jenkins-bot: Run php-compile-php74-docker as part of test/gate [integration/config] - 10https://gerrit.wikimedia.org/r/571242 (owner: 10Legoktm)
[09:02:19] <legoktm>	 !log reloading zuul for https://gerrit.wikimedia.org/r/571242
[09:02:20] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[09:09:20] <wikibugs>	 (03PS7) 10Legoktm: Coverage report for PHP extensions [integration/config] - 10https://gerrit.wikimedia.org/r/542071 (https://phabricator.wikimedia.org/T185583) (owner: 10Awight)
[09:09:22] <wikibugs>	 (03PS1) 10Legoktm: Fix run.sh permissions in php74-compile image [integration/config] - 10https://gerrit.wikimedia.org/r/571247
[09:09:24] <wikibugs>	 (03PS1) 10Legoktm: jjb: Use php74-compile:0.0.2 iamge [integration/config] - 10https://gerrit.wikimedia.org/r/571248
[09:09:54] <wikibugs>	 (03CR) 10Legoktm: [C: 03+2] Fix run.sh permissions in php74-compile image [integration/config] - 10https://gerrit.wikimedia.org/r/571247 (owner: 10Legoktm)
[09:10:35] <wikibugs>	 (03CR) 10Legoktm: "Since this stalled a bit, I rebased it and merged it into the existing php74-compile container. In a follow-up patch I'll create the jjb i" [integration/config] - 10https://gerrit.wikimedia.org/r/542071 (https://phabricator.wikimedia.org/T185583) (owner: 10Awight)
[09:10:58] <wikibugs>	 (03Merged) 10jenkins-bot: Fix run.sh permissions in php74-compile image [integration/config] - 10https://gerrit.wikimedia.org/r/571247 (owner: 10Legoktm)
[09:11:45] <legoktm>	 !log building php74-compile image https://gerrit.wikimedia.org/r/571247
[09:11:46] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[09:23:22] <wikibugs>	 (03PS2) 10Legoktm: jjb: Use php74-compile:0.0.3 image [integration/config] - 10https://gerrit.wikimedia.org/r/571248
[09:23:24] <wikibugs>	 (03PS8) 10Legoktm: Coverage report for PHP extensions [integration/config] - 10https://gerrit.wikimedia.org/r/542071 (https://phabricator.wikimedia.org/T185583) (owner: 10Awight)
[09:23:26] <wikibugs>	 (03PS1) 10Legoktm: Don't run autoreconf in php74-compile [integration/config] - 10https://gerrit.wikimedia.org/r/571251
[09:23:47] <wikibugs>	 (03CR) 10Legoktm: [C: 03+2] Don't run autoreconf in php74-compile [integration/config] - 10https://gerrit.wikimedia.org/r/571251 (owner: 10Legoktm)
[09:24:37] <wikibugs>	 (03Merged) 10jenkins-bot: Don't run autoreconf in php74-compile [integration/config] - 10https://gerrit.wikimedia.org/r/571251 (owner: 10Legoktm)
[09:25:01] <legoktm>	 !log building php74-compile image https://gerrit.wikimedia.org/r/571251
[09:25:03] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[09:30:05] <wikibugs>	 (03CR) 10Legoktm: [C: 03+2] "All repos now pass" [integration/config] - 10https://gerrit.wikimedia.org/r/571248 (owner: 10Legoktm)
[09:31:10] <wikibugs>	 (03Merged) 10jenkins-bot: jjb: Use php74-compile:0.0.3 image [integration/config] - 10https://gerrit.wikimedia.org/r/571248 (owner: 10Legoktm)
[09:34:32] <awight>	 legoktm: Hey, cool!  Let me know if I can help review any CI patches.
[09:35:00] <legoktm>	 :D
[09:35:04] <legoktm>	 I think I have it all working locally
[09:35:26] <awight>	 great.  I was pleasantly surprised that the code actually compiles :-)
[09:36:03] <awight>	 @all: Who's in charge of the release calendar at the moment?  I'd like to schedule a full scap of wmf.18 today, in order to update some i18n messages.
[09:36:52] <awight>	 Oho.  Maybe wmf.18 won't be released at all, which would solve my problem.
[09:37:07] <wikibugs>	 (03PS9) 10Legoktm: Coverage report for PHP extensions [integration/config] - 10https://gerrit.wikimedia.org/r/542071 (https://phabricator.wikimedia.org/T185583) (owner: 10Awight)
[09:37:09] <wikibugs>	 (03PS1) 10Legoktm: Add php74-compile-coverage-publish to postmerge pipeline [integration/config] - 10https://gerrit.wikimedia.org/r/571254
[09:37:51] <wikibugs>	 (03CR) 10Legoktm: [C: 03+2] "Seems to work locally. Let's give it a shot" [integration/config] - 10https://gerrit.wikimedia.org/r/542071 (https://phabricator.wikimedia.org/T185583) (owner: 10Awight)
[09:38:44] <wikibugs>	 (03Merged) 10jenkins-bot: Coverage report for PHP extensions [integration/config] - 10https://gerrit.wikimedia.org/r/542071 (https://phabricator.wikimedia.org/T185583) (owner: 10Awight)
[09:39:08] <legoktm>	 !log building php74-compile image https://gerrit.wikimedia.org/r/542071
[09:39:11] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[09:40:57] <wikibugs>	 (03CR) 10Legoktm: [C: 03+2] Add php74-compile-coverage-publish to postmerge pipeline [integration/config] - 10https://gerrit.wikimedia.org/r/571254 (owner: 10Legoktm)
[09:42:01] <wikibugs>	 (03Merged) 10jenkins-bot: Add php74-compile-coverage-publish to postmerge pipeline [integration/config] - 10https://gerrit.wikimedia.org/r/571254 (owner: 10Legoktm)
[09:42:20] <legoktm>	 !log reloading zuul for https://gerrit.wikimedia.org/r/571254
[09:42:21] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[09:47:36] <legoktm>	 awight: https://doc.wikimedia.org/cover/mediawiki-php-wikidiff2/
[09:49:29] <wikibugs>	 (03PS1) 10Legoktm: jjb: Use the correct script when trying to generate PHP ext coverage [integration/config] - 10https://gerrit.wikimedia.org/r/571256
[09:51:41] <wikibugs>	 (03CR) 10Legoktm: [C: 03+2] jjb: Use the correct script when trying to generate PHP ext coverage [integration/config] - 10https://gerrit.wikimedia.org/r/571256 (owner: 10Legoktm)
[09:52:33] <wikibugs>	 (03Merged) 10jenkins-bot: jjb: Use the correct script when trying to generate PHP ext coverage [integration/config] - 10https://gerrit.wikimedia.org/r/571256 (owner: 10Legoktm)
[09:57:08] <wikibugs>	 (03CR) 10Legoktm: [C: 03+2] Add mahveotm to CI whitelist (longterm contributor) [integration/config] - 10https://gerrit.wikimedia.org/r/491831 (owner: 10Mahveotm)
[09:57:17] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Add mahveotm to CI whitelist (longterm contributor) [integration/config] - 10https://gerrit.wikimedia.org/r/491831 (owner: 10Mahveotm)
[09:57:27] <wikibugs>	 (03CR) 10Legoktm: [C: 04-1] "Needs rebase." [integration/config] - 10https://gerrit.wikimedia.org/r/491831 (owner: 10Mahveotm)
[10:15:38] <wikibugs>	 10Continuous-Integration-Config, 10WMCZ-Tracker: Make a tox+gettext Docker image for Wikimedia Tracker - https://phabricator.wikimedia.org/T241685 (10Urbanecm) Thanks.
[10:39:00] <wikibugs>	 10Phabricator, 10Mail, 10Operations, 10Regression: Weekly phabricator-reports mail cronjob broken since January 2020 - https://phabricator.wikimedia.org/T244677 (10jijiki) p:05Triage→03Medium
[10:39:48] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Operations, 10observability: Beta puppet patch "prometheus: make ferm DNS record type configurable" - https://phabricator.wikimedia.org/T244624 (10jijiki) p:05Triage→03Medium
[10:40:59] <wikibugs>	 10Phabricator, 10Mail, 10Operations, 10Regression: Weekly phabricator-reports mail cronjob broken since January 2020 - https://phabricator.wikimedia.org/T244677 (10Marostegui) Neither monthly one. There's no January stats email. The last one is from Dec.
[10:42:29] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Operations, 10observability: Beta puppet patch "prometheus: make ferm DNS record type configurable" - https://phabricator.wikimedia.org/T244624 (10MoritzMuehlenhoff) ferm has been fixed in stretch-wikimedia and buster-wikimedia to properly resolve AAAA records with a fallback...
[11:14:02] <tarrow>	 o/
[11:14:07] <Amir1>	 o/
[11:14:25] <tarrow>	 what the plan with .18? Is the hope to roll it today?
[11:14:28] <Amir1>	 Adam is on vacation and I'm helping with the train getting unblocked
[11:14:44] <Amir1>	 please ping us when you want to roll out the train
[11:17:36] <hauskatze>	 So are we trying wmf.18 again? Because on Wikitech it's mentioned wmf.19
[11:20:24] <apergos>	 I'm here just following the discussion 
[11:34:38] <Amir1>	 I'm not sure that would be good idea, not my call though. Jumping from 16 to 19 going to cause lots of headaches
[11:38:06] <apergos>	 do we assume this is separate from the wb_terms migration setting, which will be kept as is for now?
[11:39:01] <tarrow>	 apergos: if we want to do .18 then we need to backport a revert to keep it as it is now
[11:39:37] <apergos>	 what about 19? (this is just informational, not a vote)
[11:39:41] <tarrow>	 but the revert is already merged on master so skipping to .19 (from a terms perspective) doesn't need us to take any action
[11:39:47] <apergos>	 ok thanks
[11:42:34] <wikibugs>	 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Patch-For-Review, 10Release, 10Train Deployments: 1.35.0-wmf.18 deployment blockers - https://phabricator.wikimedia.org/T233866 (10Ladsgroup) >>! In T233866#5860166, @Addshore wrote: > If .18 restarts next week then the backport for .18 in T24452...
[11:43:28] <tarrow>	 there is also https://phabricator.wikimedia.org/T244591 which seems to need some cross train version config thought too
[11:44:23] <apergos>	 right
[11:45:34] <apergos>	 please remember that any unscheduled (not in train window, not in swat window) configs should be discussed not only with releng but also with sre, so that someone is available on that side to keep an eye on things (or to say 'not right now, we're just recovering from X or just working on urgent Y')
[12:01:42] <Amir1>	 twentyafterfour: ^ Let us know when you want to roll the train forward 
[12:07:21] <tarrow>	 apergos: aye 👍
[12:07:34] <twentyafterfour>	 tarrow: I think the plan is to go to wmf.18 and then start the train again at wmf.19 on tuesday as usual. So any backporting that needs to be done before that can happen should be a blocker on the train task
[12:07:53] <apergos>	 s/unscheduled configs/unscheduled deploys/  oh well
[12:08:02] <tarrow>	 twentyafterfour: gotcha, it is currently a blocker
[12:09:31] <twentyafterfour>	 ok, I'd like to roll the train forward later today but I wasn't expecting to do it this early... I guess it'll happen once the blockers are resolved and we can get the go-ahead from sre.
[12:09:39] <tarrow>	 the backport is on gerrit and ready to be +2. Didn't want anyone to click the button until we were all on the same page though
[12:09:47] <twentyafterfour>	 Amir1: ^
[12:10:09] <twentyafterfour>	 tarrow: is there harm merging it into an undeployed branch? 
[12:10:15] <tarrow>	 I don't think so
[12:10:21] <twentyafterfour>	 or any risk I should be aware of related to this change in particular? 
[12:10:42] <Amir1>	 twentyafterfour: nothing
[12:10:46] <twentyafterfour>	 configs for this transition have proven quite complicated to get right 
[12:10:47] <tarrow>	 twentyafterfour: nothing in particular. Should be all that needed to keep the status quo
[12:11:09] <Amir1>	 twentyafterfour: I can deploy it as well
[12:11:21] <twentyafterfour>	 ok thanks for the heads-up, everyone
[12:11:22] <tarrow>	 well, it's not deployed anywhere right?
[12:11:31] <twentyafterfour>	 wmf.18 isn't deployed anywhere afaik
[12:11:37] <twentyafterfour>	 unless that changed. I just got here 
[12:11:57] <Amir1>	 twentyafterfour: We didn't touch anything :D
[12:12:18] <Amir1>	 Then I merge and rebase on the deploy node
[12:12:50] <twentyafterfour>	 cool, so I'll make sure we do a full scap before the next version bump 
[12:14:07] <twentyafterfour>	 this late deployment of the train on monday seems to be getting really common, we should just block out a regularly scheduled monday train deployment in acceptance of the facts 
[12:23:03] <apergos>	 you could go after the european mid-day swat I guess, there's a large enough time frame there to have a break, have a window, let it go over if needed, and have a break before the next thing
[12:45:08] <Amir1>	 twentyafterfour: It should be live in wmf.18 now, I can deploy it if you don't want to do full scap
[12:49:21] <twentyafterfour>	 Amir1: go for it, though I should do a full scap either way I think, just to be sure l10n is updated 
[12:49:49] <Amir1>	 okay
[12:59:52] <apergos>	 please announce it in -operations before you do it
[13:00:09] <awight>	 ^ I'd appreciate the full scap, for the sake of a bug I'm watching.
[13:08:07] <twentyafterfour>	 I'm going to give it a bit before I scap. I'll be back in about an hour 
[13:08:42] <apergos>	 I'll check back in a little before then, in that case
[13:08:58] <twentyafterfour>	 thanks apergos
[13:09:15] <apergos>	 you bet
[13:09:38] <apergos>	 oh, lol... I have a meeting in 50 minutes. well that's special
[13:22:54] <wikibugs>	 10Continuous-Integration-Config, 10GapFinder, 10Research: Recommendation-api: tox-docker is failing - https://phabricator.wikimedia.org/T244675 (10bmansurov) My bad. Apparently code runs on Python 3 too. Thanks for the input @Legoktm. I'll look into flake.
[13:29:54] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Operations, 10observability: Beta puppet patch "prometheus: make ferm DNS record type configurable" - https://phabricator.wikimedia.org/T244624 (10Krenair) We still have some Jessie instances which are in need of migration. I think production still has some jessie instances.
[13:34:47] <Amir1>	 twentyafterfour: Ping me when you want to start deploying, I want to keep an eye for explosions and fireworks
[13:41:15] * xover puts on the popcorn…
[13:41:42] <apergos>	 me too but I have a meeting 14:00 - 14:30 utc (so in 20 mins) 
[13:41:45] <hauskatze>	 Amir1: lol looks like we're going to do some carpet bombing
[13:42:19] <Amir1>	 hauskatze: this week will be "fun" 
[13:42:20] <Amir1>	 :P
[13:42:39] <hauskatze>	 hopefully not as fun as the last one :)
[13:43:57] <wikibugs>	 10Continuous-Integration-Config, 10GapFinder, 10Research: Recommendation-api: tox-docker is failing - https://phabricator.wikimedia.org/T244675 (10bmansurov) 05Open→03Resolved a:03bmansurov
[13:44:33] <Amir1>	 Yup, I helped with three outages and I was on vacation
[13:44:40] <Amir1>	 guess what others did
[13:45:17] <apergos>	 you need to take some comp days this week :-/
[13:45:43] <hauskatze>	 or some extra bucks
[13:45:45] <hauskatze>	 or both
[13:46:33] <hauskatze>	 qchris: did I tell you how much I hate to change Diffusion URIs by hand?
[13:47:30] <qchris>	 I feel you hauskatze :-(
[13:48:06] <qchris>	 Oh! I see you're starting on lego's repos. Thanks.
[13:48:22] <hauskatze>	 qchris: I'm sure the gerrit part can be automated but I'm migrating legokt-m's repos from Diffusion to Gerrit as requested and for each migration, I have to switch FOUR URIs each
[13:48:38] <hauskatze>	 qchris: yeah, the repos are all created now
[13:48:48] <qchris>	 I'm still in ill mode and pinged him if any of the repos are urgent. As nothing came back, I guessed they can wait until I recover. Thanks for jumping on them!
[13:49:11] <hauskatze>	 np, happy to help
[13:49:25] <hauskatze>	 hopefully I won't contribute to the explosions and fireworks
[13:49:41] <hauskatze>	 and please do get well soon!
[13:49:51] <qchris>	 No fireworks allowed around here. Waaaay tooo windy :-D
[13:49:55] <qchris>	 Thanks.
[14:10:29] <Daimona>	 Hello there! How am I supposed to log the execution of a maintenance script on the Beta Cluster?
[14:16:52] <awight>	 Daimona: I've done this, https://www.mediawiki.org/wiki/Beta_Cluster#Testing_changes_on_Beta_Cluster
[14:17:22] <awight>	 Hmm, those aren't very clear instructions.
[14:17:43] <Daimona>	 awight: Thanks! So I should send a "!log Running foobar script" on this channel, right?
[14:18:29] <awight>	 I think so, but I'm looking for the configuration now.  I remember doing something more like "!log deployment-prep Running foobar"
[14:18:58] <awight>	 ah, that was just for the #wikimedia-cloud channel.
[14:19:21] <Daimona>	 Ah, perhaps I should also add "on the Beta Cluster"
[14:22:02] <twentyafterfour>	 Amir1: apergos, awight: I'm about ready to scap now. 
[14:23:20] <awight>	 Daimona: I found historical examples, people just "!log" here and it goes to https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[14:23:58] <Daimona>	 Ah, I see. Thank you!
[14:24:16] <awight>	 For comparison, here are the things people log to #wikimedia-cloud : "!log deployment-prep ...", https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL
[14:24:30] <awight>	 twentyafterfour: Sounds good to me, thanks!
[14:26:27] <twentyafterfour>	 apergos: everything look ok from where you are sitting? 
[14:26:40] <apergos>	 meeting still
[14:26:46] <twentyafterfour>	 uh
[14:26:46] <apergos>	 sorry :-(
[14:26:57] <twentyafterfour>	 oh sorry. I just saw alerts in -operations also
[14:33:38] <apergos>	 here
[14:33:45] <apergos>	 meeting over, wha's going on?
[14:34:11] <apergos>	 was there any deploy or... what's up?
[14:35:01] <apergos>	 twentyafterfour: 
[14:35:59] <twentyafterfour>	 apergos: no deploy
[14:36:02] <apergos>	 ok
[14:36:13] <twentyafterfour>	 I was just making sure you were free and trying to get the go-ahead to do it 
[14:36:21] <apergos>	 are you asking about the cpnnn alerts?
[14:36:28] <twentyafterfour>	 yeah 
[14:36:43] <apergos>	 those are known; hosts are being reimaged and for whatever reason sometimes the script isn't downtiming properly
[14:40:44] <wikibugs>	 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Patch-For-Review, 10Release, 10Train Deployments: 1.35.0-wmf.18 deployment blockers - https://phabricator.wikimedia.org/T233866 (10Mholloway)
[14:43:45] <apergos>	 thanks for asking about those btw, everyone involved in a deploy should get into the habit of looking at all that stuff and asking (includes sre side too0
[14:51:10] <apergos>	 slow scaps are slow
[15:40:49] <wikibugs>	 10Phabricator, 10Release-Engineering-Team, 10DBA, 10Operations: Upgrade and restart m3 (phabricator) master (db1128) - https://phabricator.wikimedia.org/T244566 (10Marostegui) For reference, the similar maintenance performed at T244209 resulted in 74 seconds of downtime.
[15:41:49] <apergos>	 group 0 to be rolled to wmf.18 momentarily
[15:43:05] <wikibugs>	 10Release-Engineering-Team (Pipeline), 10Analytics, 10Analytics-Kanban, 10Release Pipeline, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10Ottomata) Bump @akosiaris
[15:50:11] <ottomata>	 hiya, am scheduling some stuff for swat
[15:50:19] <ottomata>	 but i am a bit confused about ordering things
[15:50:33] <ottomata>	 I want to deploy a new extension to beta, and i've got the go ahead
[15:50:34] <ottomata>	 I added
[15:50:38] <ottomata>	 https://wikitech.wikimedia.org/wiki/Deployments#Week_of_February_10
[15:50:43] <ottomata>	 loy EventStreamConfig extension to Beta cluster
[15:50:48] <ottomata>	 Deploy EventStreamConfig extension to Beta cluster
[15:51:00] <ottomata>	 items to today's morning swat.
[15:51:06] <ottomata>	 https://www.mediawiki.org/wiki/Writing_an_extension_for_deployment#Deploy_to_Beta_Cluster
[15:51:07] <ottomata>	 says
[15:51:13] <ottomata>	 'Add your extension to extension-list. See example. This requires that the code be present on every branch running in production'
[15:52:22] <ottomata>	 I'm pretty sure this is true for my extension, as https://github.com/wikimedia/mediawiki-tools-release/commit/708218a14fad8f6a1d84466292ca28ecf31a29ec was merged jan 7.
[15:52:33] <ottomata>	 i hope all my swat items are ok!
[15:53:31] <wikibugs>	 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Analytics, 10Event-Platform, 10Wikimedia-Extension-setup, and 2 others: Deploy EventStreamConfig extension - https://phabricator.wikimedia.org/T242122 (10sbassett)
[15:53:50] <thcipriani>	 as long as eventstreamconfig is being branched as part of train for wmf.16 and wmf.18 -- should be fine
[15:54:33] <Lucas_WMDE>	 it’s present in deploy1001.eqiad.wmnet since wmf.14, it seems
[15:54:41] <Lucas_WMDE>	 so production looks fine
[15:55:19] <Lucas_WMDE>	 and in deployment-prep it’s in /srv/mediawiki-staging/php-master/ too
[15:55:54] <thcipriani>	 ottomata: yep, your extension is good to add (present on branches in prod + beta). too much info: scap rebuilds l10n by gathering messages from every extension listed in extension-list, so if the extension is not in a branch it errors out.
[15:56:30] <ottomata>	 ok cool
[15:56:31] <ottomata>	 great.
[15:56:33] <ottomata>	 thanks yalll
[15:57:24] <shinken-wm>	 PROBLEM - Free space - all mounts on deployment-logstash03 is CRITICAL: CRITICAL: deployment-prep.deployment-logstash03.diskspace.root.byte_percentfree (<100.00%)
[16:01:03] <wikibugs>	 10Release-Engineering-Team, 10Operations, 10Core Platform Team Workboards (Clinic Duty Team), 10Performance Issue, 10Wikimedia-database-error: WikiPage::updateCategoryCounts causing replication lag due to long-running writes on commonswiki - https://phabricator.wikimedia.org/T240405 (10Anomie) >>! In T24...
[16:20:27] <Daimona>	 !log mwscript extensions/AbuseFilter/maintenance/fixOldLogEntries.php --wiki=dewiki | T228655
[16:20:30] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[16:20:30] <stashbot>	 T228655: Dry-run fixOldLogEntries for AbuseFilter - https://phabricator.wikimedia.org/T228655
[16:25:48] <apergos>	 (06:25:21 μμ) apergos: for anyone who has been following along, we're still trying to determine whether or how much to roll forwrd groups 0, 1, 2
[16:25:48] <apergos>	 (06:25:38 μμ) apergos: conversation in wikimedia-sre 
[16:27:14] <wikibugs>	 10Continuous-Integration-Config, 10CPT Initiatives (API Integration Tests), 10Code-Health: API integration tests should skip tests accourding to flags exposed by the SiteInfo API module - https://phabricator.wikimedia.org/T243976 (10WDoranWMF)
[16:29:31] <wikibugs>	 10Release-Engineering-Team, 10MediaWiki-API, 10CPT Initiatives (API Integration Tests), 10Code-Health: Expose flags for controlling API tests from the action API - https://phabricator.wikimedia.org/T243977 (10WDoranWMF)
[16:37:39] <wikibugs>	 (03CR) 10Lars Wirzenius: [C: 03+1] "I don't understand Groovy, so I won't +2 this, but it Lassoes Giant Turtle Mastheads." [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/570944 (https://phabricator.wikimedia.org/T244512) (owner: 10Dduvall)
[16:46:47] <wikibugs>	 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10Scap, 10serviceops: Define a mediawiki "version" - https://phabricator.wikimedia.org/T218412 (10hnowlan)
[17:42:08] <Lucas_WMDE>	 did anything happen to the CodeError extension on Gerrit recently
[17:42:11] <Lucas_WMDE>	 ?
[17:42:17] <Lucas_WMDE>	 had a build fail with fatal: unable to access 'https://gerrit.wikimedia.org/r/mediawiki/extensions/CodeEditor/': The requested URL returned error: 502
[17:42:24] <Lucas_WMDE>	 and the URL still says “not found” when I open it now
[17:42:58] <paladox|UKInEU>	 that's a clone url, so will say not found :)
[17:43:18] <paladox|UKInEU>	 https://gerrit.wikimedia.org/r/#/admin/projects/mediawiki/extensions/CodeEditor
[17:44:35] <Lucas_WMDE>	 ah ok
[17:44:43] <Lucas_WMDE>	 then I guess I’ll recheck and hope it works this time :)
[17:44:46] <Lucas_WMDE>	 thanks
[18:21:24] <wikibugs>	 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Patch-For-Review, 10Release, 10Train Deployments: 1.35.0-wmf.18 deployment blockers - https://phabricator.wikimedia.org/T233866 (10mmodell) 05Stalled→03Open
[18:29:22] <wikibugs>	 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10Scap, 10serviceops: Define a mediawiki "version" - https://phabricator.wikimedia.org/T218412 (10mmodell) it would be nice if the version information could be broken down in some way so that a small change to one file didn'...
[18:49:56] <legoktm>	 qchris: I hope you get better soon! And yeah, no urgency on my part
[18:55:19] <wikibugs>	 10Release-Engineering-Team (Code Health), 10CirrusSearch, 10Discovery-Search, 10Code-Health, 10MW-1.35-notes (1.35.0-wmf.8; 2019-11-26): Migrate CirrusSearch MediaWikiIntegrationTestCase tests to MediaWikiUnitTestCase - https://phabricator.wikimedia.org/T232589 (10Mstyles)
[19:07:07] <shinken-wm>	 RECOVERY - Free space - all mounts on deployment-logstash2 is OK: OK: deployment-prep.deployment-logstash2.diskspace._mnt.byte_percentfree (No valid datapoints found) deployment-prep.deployment-logstash2.diskspace._var_lib_elasticsearch.byte_percentfree (No valid datapoints found) deployment-prep.deployment-logstash2.diskspace.root.byte_percentfree (More than half of the datapoints are undefined) deployment-prep.deployment-logstash
[19:07:07] <shinken-wm>	 v.byte_percentfree (More than half of the datapoints are undefined)
[19:17:19] <wikibugs>	 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Analytics, 10Event-Platform, 10Wikimedia-Extension-setup, and 2 others: Deploy EventStreamConfig extension - https://phabricator.wikimedia.org/T242122 (10Jdforrester-WMF)
[19:20:48] <wikibugs>	 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Patch-For-Review, 10Release, 10Train Deployments: 1.35.0-wmf.18 deployment blockers - https://phabricator.wikimedia.org/T233866 (10Ladsgroup)
[19:24:14] <wikibugs>	 10Phabricator, 10Release-Engineering-Team: Make "Related Gerrit patches" easier to click and/or to visually associate its meta data - https://phabricator.wikimedia.org/T244601 (10Legoktm) Relatedly, it would be nice if the "Related Gerrit patches" header was clickable and led you to the Gerrit search interface...
[19:27:21] <wikibugs>	 (03CR) 10Jforrester: "Very nice." [integration/config] - 10https://gerrit.wikimedia.org/r/542071 (https://phabricator.wikimedia.org/T185583) (owner: 10Awight)
[19:27:53] <wikibugs>	 10Release-Engineering-Team, 10Gerrit-Privilege-Requests, 10Operations, 10SRE-Access-Requests: Request for +2 access to mediawiki-config - https://phabricator.wikimedia.org/T244508 (10Dzahn) @jijiki  Eric is already in the "deployment" shell users group and membership in the relevant Gerrit group normally g...
[19:30:16] <wikibugs>	 10Release-Engineering-Team, 10Gerrit-Privilege-Requests, 10Operations, 10SRE-Access-Requests: Request for +2 access to mediawiki-config - https://phabricator.wikimedia.org/T244508 (10Dzahn) 05Open→03Resolved a:03Dzahn @eevans You should have +2 on the mw-config repo now. Probably after logging out an...
[19:33:25] <wikibugs>	 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10serviceops, 10Test-Coverage: Add pcov PHP extension to wikimedia apt so it can be used in Wikimedia CI - https://phabricator.wikimedia.org/T243847 (10Jdforrester-WMF) >>! In T243847#585...
[19:36:12] <wikibugs>	 (03PS4) 10Jforrester: Add mahveotm to CI whitelist (longterm contributor) [integration/config] - 10https://gerrit.wikimedia.org/r/491831 (owner: 10Mahveotm)
[19:37:30] <wikibugs>	 10Release-Engineering-Team, 10Gerrit-Privilege-Requests, 10Operations, 10SRE-Access-Requests: Request for +2 access to mediawiki-config - https://phabricator.wikimedia.org/T244508 (10Eevans) >>! In T244508#5866291, @Dzahn wrote: > @eevans You should have +2 on the mw-config repo now. Probably after logging...
[19:37:47] <wikibugs>	 (03CR) 10Jforrester: "Ping." [integration/config] - 10https://gerrit.wikimedia.org/r/560807 (https://phabricator.wikimedia.org/T235873) (owner: 10DannyS712)
[19:38:25] <wikibugs>	 (03CR) 10Jforrester: [C: 03+2] Add mahveotm to CI whitelist (longterm contributor) [integration/config] - 10https://gerrit.wikimedia.org/r/491831 (owner: 10Mahveotm)
[19:39:56] <wikibugs>	 (03Merged) 10jenkins-bot: Add mahveotm to CI whitelist (longterm contributor) [integration/config] - 10https://gerrit.wikimedia.org/r/491831 (owner: 10Mahveotm)
[19:43:52] <wikibugs>	 (03PS5) 10Jforrester: layout: [parsoid/deploy] Make PHP tests voting [integration/config] - 10https://gerrit.wikimedia.org/r/564769 (https://phabricator.wikimedia.org/T239642)
[19:46:01] <wikibugs>	 (03CR) 10DannyS712: "> > Patch Set 2:" [integration/config] - 10https://gerrit.wikimedia.org/r/560807 (https://phabricator.wikimedia.org/T235873) (owner: 10DannyS712)
[19:48:27] <wikibugs>	 10Phabricator: Autogeneration of Subtasks - https://phabricator.wikimedia.org/T244782 (10wiki_willy)
[19:48:47] <James_F>	 !log Add mahveotm to CI whitelist
[19:48:48] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[20:03:21] <wikibugs>	 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10Scap, 10serviceops: Define a mediawiki "version" - https://phabricator.wikimedia.org/T218412 (10Dzahn) The problem i see with that is how do you define what a "small" change is?  It feels like when we call things "trivial"...
[20:05:16] <hauskatze>	 twentyafterfour: would it be possible to craft a script to set all Diffusion URIs for a given repo to No I/O?
[20:05:28] <hauskatze>	 I guess we'll need to use Conduit
[20:05:31] <twentyafterfour>	 hauskatze: yes  
[20:05:44] <twentyafterfour>	 I've already had to do something like that before I believe 
[20:06:02] <hauskatze>	 Setting a Diffusion mirror to observe from elsewhere requires me to turn off at least 4 URIs and it's a pain to do by hand
[20:06:16] <hauskatze>	 and I'm creating 15 of such repos today
[20:06:31] <twentyafterfour>	 yeah, totally understood
[20:06:56] <twentyafterfour>	 using the diffusion ui to manage repos isn't fun when you're doing anything beyond one repo
[20:07:13] <twentyafterfour>	 let me see what I can come up with 
[20:07:24] <hauskatze>	 Thank you, really :)
[20:07:44] <hauskatze>	 And I'm sorry to disturb, but I know no one else that understands the inners of Phab so well
[20:13:28] <bd808>	 hauskatze, twentyafterfour: https://gerrit.wikimedia.org/r/plugins/gitiles/labs/striker/+/master/striker/phabricator.py#212 might be close to what you are looking for. Repo management is pretty well covered by the Conduit API, but it takes several calls to do all of the bits.
[20:13:45] * hauskatze looks
[20:14:31] <hauskatze>	 hmm
[20:14:59] <hauskatze>	 well in my case it's just turning the repo uris to no i/o so I can add an 'observe' URI to gerrit-replica
[20:15:40] <hauskatze>	 either upstream makes all URIS to turn read-only or no i/o once an 'observe' uri is added or we craft a script of our own IMHO
[20:20:07] <twentyafterfour>	 hauskatze: I am already working on a script :)
[20:20:27] <hauskatze>	 twentyafterfour: *tears of joy* thanks
[20:20:46] <hauskatze>	 I'm buying you a new car
[20:23:49] <hauskatze>	 (iocandi gratia)
[20:30:33] <twentyafterfour>	 hauskatze: https://www.mazdausa.com/shopping-tools/build-and-price/mx-5-miata-rf#s=5&tr=Manual&d=RWD&f=none&t=19MXRGT%7C19MXRGTA&ex=25D&in=L_NK3&p=1GT&ip=&o=&io=
[20:31:10] <hauskatze>	 ok, let me call my accountant
[20:31:20] <hauskatze>	 :P
[20:32:11] <twentyafterfour>	 My RX-7 is 34 years old. Haven't ever had a new car :P
[20:32:16] <hauskatze>	 I'd buy a Toyota Mirai if there were points to recharge it
[20:38:37] <hauskatze>	 I have one of this in the garage: https://commons.wikimedia.org/wiki/File:1970_Seat_600_E_(3803992282).jpg but I don't use it much
[20:44:18] <shinken-wm>	 PROBLEM - Free space - all mounts on deployment-puppetmaster04 is CRITICAL: CRITICAL: deployment-prep.deployment-puppetmaster04.diskspace.root.byte_percentfree (<100.00%)
[20:46:47] <wikibugs>	 10Project-Admins, 10Office-IT: Scope of #Office-IT project tag in Phabricator? - https://phabricator.wikimedia.org/T242292 (10eliza) @Aklapper  - thanks for your patience, just getting back. This was a tutorial @ggellerman created to show us the phab workflow back in 2016 An OIT tag is not necessary for our wo...
[21:07:40] <hauskatze>	 9 URIS ffs: https://phabricator.wikimedia.org/source/tool-wikitext-deprecation/manage/uris/
[21:09:51] <wikibugs>	 10Release-Engineering-Team (CI & Testing services), 10Performance-Team, 10Upstream, 10phan: Constant inheritance not detected in phan, blocking merge of a patch - https://phabricator.wikimedia.org/T244633 (10Krinkle) a:03Krinkle
[21:31:37] <wikibugs>	 10Release-Engineering-Team (CI & Testing services), 10Performance-Team, 10Upstream, 10phan: Constant inheritance not detected in phan, blocking merge of a patch - https://phabricator.wikimedia.org/T244633 (10Krinkle) a:05Krinkle→03aaron
[21:32:04] <wikibugs>	 10Release-Engineering-Team-TODO, 10Performance-Team, 10Core Platform Team Workboards (Clinic Duty Team), 10PHP 7.2 support: Performance regression from Apcu/ExtensionRegistry::loadFromQueue on PHP7 - https://phabricator.wikimedia.org/T187154 (10Krinkle)
[21:39:09] <wikibugs>	 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Graphite, 10User-greg: Increase retention time of graphite stats for CI - https://phabricator.wikimedia.org/T242826 (10greg) 05Open→03Invalid So yeah, my previous comment is right and I'll j...
[21:53:22] <legoktm>	 James_F, thcipriani: do you know where I configure the ssh-agent-credentials thing in jjb? the context is I want to move https://phabricator.wikimedia.org/T239005 out of toolforge and into CI
[21:53:39] <legoktm>	 I'm looking at copying/modifying the wikidata-query-gui-build job
[22:04:32] <wikibugs>	 (03PS1) 10Volans: Add tox job for operations/homer/mock-private [integration/config] - 10https://gerrit.wikimedia.org/r/571369 (https://phabricator.wikimedia.org/T244690)
[22:09:26] <brennen>	 legoktm: t.hcipriani is off for a good bit of today.  i poked at this for a minute but i'm afraid i don't have a good answer.
[22:11:04] <James_F>	 legoktm: No, no idea.
[22:17:13] <legoktm>	 brennen: ack, thanks though
[22:17:18] <wikibugs>	 (03PS1) 10Jforrester: Modify access rules [homer] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/571370
[22:18:09] <wikibugs>	 10Project-Admins, 10Office-IT: Scope of #Office-IT project tag in Phabricator? - https://phabricator.wikimedia.org/T242292 (10Aklapper) p:05Triage→03Low a:03Aklapper No worries, thanks a lot for the answer! :)  * Disabled the unused workboard and made the project description page the default to be displa...
[22:21:52] <wikibugs>	 (03CR) 10Volans: [V: 03+2 C: 03+2] "Thanks for the fix!" [homer] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/571370 (owner: 10Jforrester)
[22:22:23] <wikibugs>	 (03CR) 10Jforrester: [C: 03+2] Add tox job for operations/homer/mock-private [integration/config] - 10https://gerrit.wikimedia.org/r/571369 (https://phabricator.wikimedia.org/T244690) (owner: 10Volans)
[22:23:11] <wikibugs>	 10Release-Engineering-Team-TODO, 10DiscussionTools, 10Wikimedia-Site-requests, 10Editing-team (Q3 2019-2020 Kanban Board), 10OWC2020 (OWC2020 Replying 1.0): Deploy DiscussionTools to Wikimedia production - https://phabricator.wikimedia.org/T240470 (10JTannerWMF)
[22:23:13] <wikibugs>	 (03Merged) 10jenkins-bot: Add tox job for operations/homer/mock-private [integration/config] - 10https://gerrit.wikimedia.org/r/571369 (https://phabricator.wikimedia.org/T244690) (owner: 10Volans)
[22:23:37] <wikibugs>	 10Release-Engineering-Team-TODO, 10DiscussionTools, 10Wikimedia-Site-requests, 10Editing-team (Q3 2019-2020 Kanban Board), 10OWC2020 (OWC2020 Replying 1.0): Deploy DiscussionTools to Wikimedia production - https://phabricator.wikimedia.org/T240470 (10JTannerWMF) a:03ppelberg
[22:24:36] <James_F>	 !log Zuul: Add tox for operations/homer/mock-private T244690
[22:24:38] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[22:24:38] <stashbot>	 T244690: Homer: setup CI for static data repositories - https://phabricator.wikimedia.org/T244690
[22:27:33] <wikibugs>	 10Release-Engineering-Team-TODO, 10DiscussionTools, 10Wikimedia-Site-requests, 10Editing-team (Q3 2019-2020 Kanban Board), 10OWC2020 (OWC2020 Replying 1.0): Deploy DiscussionTools to Wikimedia production - https://phabricator.wikimedia.org/T240470 (10ppelberg)
[22:37:05] <James_F>	 legoktm: You around? Trying to work out why the new CI for operations/homer/mock-private isn't running. Saw you had fun deploying to operations/homer/public yesterday.
[22:38:43] <legoktm>	 James_F: yes, lemme see
[22:39:01] <James_F>	 I don't see anything obvious in the logs on contint1001.
[22:40:44] <legoktm>	 zuul.rpcclient.RPCFailure: Invalid change: 540622,1
[22:40:53] <legoktm>	 I have never seen that before
[22:41:30] <James_F>	 Oooh. Novel bugs.
[22:41:51] <James_F>	 Is there some magic code that rejects CI on repos with the name 'private' in them or something odd?
[22:42:19] <hauskatze>	 Gerrit allows private changes but iirc we do not allow that in our install?
[22:42:25] <James_F>	 No, we don't.
[22:43:39] <wikibugs>	 10Phabricator, 10Security-Team, 10Security:  Convert #Security to acl*Security - https://phabricator.wikimedia.org/T244165 (10chasemp)
[22:43:52] <legoktm>	 uhh
[22:44:00] <hauskatze>	 fun
[22:44:05] <legoktm>	 ok, even the brand new commit I made is "invalid"
[22:44:09] <James_F>	 Yeah.
[22:45:12] <James_F>	 Maybe volans did something odd in the repo config?
[22:46:06] <paladox|UKInEU>	 hauskatze yup, but that dosen't reject repos with the name private nor does it reject repos that want to be private.
[22:47:20] <legoktm>	 I'm reading the zuul source code now...
[22:47:47] <legoktm>	 it is discarding the entire exception stacktrace
[22:48:44] <James_F>	 Fun.
[22:56:07] <legoktm>	 I think it's the
[22:56:09] <legoktm>	 2020-02-10 22:55:38,372 DEBUG zuul.Scheduler: Project None not found
[22:56:11] <legoktm>	 errors
[22:57:31] <James_F>	 How is the project set for Zuul?
[22:57:51] <James_F>	 Evaluating to None in Python would be null or blank.
[23:02:31] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Operations, 10RESTBase, 10Traffic, 10User-Ryasmeen: Restbase routing down on beta, 2020-02-07 - https://phabricator.wikimedia.org/T244586 (10Jdforrester-WMF) Thank you!
[23:03:02] <wikibugs>	 10Phabricator, 10Security-Team, 10Security, 10security-related: Convert #Security to acl*Security - https://phabricator.wikimedia.org/T244165 (10chasemp)
[23:05:14] <wikibugs>	 10Phabricator, 10Security-Team, 10Security, 10security-related: Convert #Security to acl*Security - https://phabricator.wikimedia.org/T244165 (10chasemp)
[23:06:42] <wikibugs>	 10Phabricator, 10Security-Team, 10Security, 10security-related: Convert #Security to acl*Security - https://phabricator.wikimedia.org/T244165 (10chasemp)
[23:12:16] <wikibugs>	 10Phabricator, 10Security-Team, 10Security, 10security-related: Convert #Security to acl*Security - https://phabricator.wikimedia.org/T244165 (10chasemp) >>! In T244165#5851979, @revi wrote: > Base, HakanIST, Matanya, Wim_b are stew.  thanks!
[23:15:26] <legoktm>	 well
[23:15:37] <legoktm>	 I can't even find the "Project %s not found" error message
[23:15:40] <legoktm>	 wtf
[23:16:09] <James_F>	 Is that from our end?
[23:16:20] <James_F>	 Integration python glue stuff?
[23:16:22] <legoktm>	 it should be coming from zuul
[23:16:27] <legoktm>	 integration/zuul specifically
[23:17:48] <legoktm>	 at this point I think something got cached badly
[23:17:58] <legoktm>	 and we should restart zuul when its quiet
[23:19:42] <James_F>	 Yeah, not whilst wmf gate and submit is running, please. :-)
[23:19:58] <legoktm>	 probably in a few hours after PST finishes working but before Europe wakes up
[23:20:11] <James_F>	 Eh. Let's just do it in 10 minutes' time.
[23:20:20] <hauskatze>	 Europe is watching here
[23:20:46] <James_F>	 There's never a good time that also has people around. And at some point I want to go home. :-)
[23:24:05] <legoktm>	 hauskatze: go to sleep
[23:24:24] <hauskatze>	 legoktm: I can't. I have to finish with your repos.
[23:24:32] * James_F grins.
[23:24:47] <legoktm>	 hauskatze: you don't! they're not that urgent
[23:24:51] <hauskatze>	 Doing things manually tends to take some time
[23:26:34] <James_F>	 legoktm: Now is as good as it'll get for restarting zuul.
[23:26:52] <legoktm>	 do you want to do it? or should I?
[23:27:15] <hauskatze>	 I think I remember a big warning saying 'do not restart zuul, reload instead' ?
[23:27:26] <legoktm>	 hauskatze: hence why we're trying to time it properly.
[23:27:39] <James_F>	 legoktm: You do it.
[23:27:54] <twentyafterfour>	 hauskatze: sorry it took so long: https://phabricator.wikimedia.org/P10370
[23:28:04] <legoktm>	 !log restarting zuul
[23:28:05] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[23:28:49] <legoktm>	 hauskatze: the problem with restarting zuul is that it drops the entire queue, so for routine config changes reload is better
[23:29:47] <legoktm>	 sigh
[23:29:49] <legoktm>	 that didn't work
[23:29:51] <James_F>	 legoktm: It'd be lovely if we could teach zuul to ignore ref-replicated* events rather than complain.
[23:29:55] <James_F>	 Oh. Meh.
[23:30:23] <wikibugs>	 (03PS6) 10Jforrester: layout: [parsoid/deploy] Make PHP tests voting [integration/config] - 10https://gerrit.wikimedia.org/r/564769 (https://phabricator.wikimedia.org/T239642)
[23:30:30] <hauskatze>	 twentyafterfour: looking & I'm still not finished so I may put it to test :D
[23:31:26] <hauskatze>	 twentyafterfour: works with the full repo name or callsign?
[23:31:32] <hauskatze>	 or short name?
[23:31:35] <twentyafterfour>	 the repo "short name"
[23:31:42] <hauskatze>	 and if the repo doesn't have it?
[23:31:51] <twentyafterfour>	 then it won't work I think
[23:31:56] <hauskatze>	 (not this case, they all have)
[23:32:01] <twentyafterfour>	 slight modification could make it use callsign 
[23:32:16] <hauskatze>	 testing!
[23:33:51] <James_F>	 legoktm: Oh yeah, totally off-topic, but is there a way to set some temporary wg* config for parser test runs?
[23:34:16] <hauskatze>	 well maybe I'll test it tomorrow as I have to install arc and jq twentyafterfour 
[23:34:17] <legoktm>	 James_F: https://www.mediawiki.org/wiki/Manual:Hooks/ParserTestGlobals
[23:34:26] <James_F>	 Aha. Thanks.
[23:35:01] <twentyafterfour>	 hauskatze: sorry, I probably should have made it without those dependencies but I was going for the most expedient method. 
[23:35:30] <twentyafterfour>	 turns out jq isn't as easy as I thought for something this complex so I could have done it more quickly in php or js I think 
[23:35:53] <twentyafterfour>	 ...rather I don't know jq well enough to do that complicated of a thing quickly 
[23:40:36] <hauskatze>	 twentyafterfour: does your script work in your machine? can you test on https://phabricator.wikimedia.org/source/tool-apt-browser/ for example?
[23:40:45] <hauskatze>	 it's okay if not
[23:41:34] <wikibugs>	 (03CR) 10Jforrester: [C: 03+2] layout: [parsoid/deploy] Make PHP tests voting [integration/config] - 10https://gerrit.wikimedia.org/r/564769 (https://phabricator.wikimedia.org/T239642) (owner: 10Jforrester)
[23:41:37] <wikibugs>	 10Phabricator, 10Security-Team, 10Security, 10security-related: Convert #Security to acl*Security - https://phabricator.wikimedia.org/T244165 (10DannyS712)
[23:42:21] <wikibugs>	 (03Merged) 10jenkins-bot: layout: [parsoid/deploy] Make PHP tests voting [integration/config] - 10https://gerrit.wikimedia.org/r/564769 (https://phabricator.wikimedia.org/T239642) (owner: 10Jforrester)
[23:42:27] <James_F>	 !log Zuul: [parsoid/deploy] Make PHP tests voting T239642
[23:42:30] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[23:42:30] <stashbot>	 T239642: We need to run tests on the PHP code in the deploy repo - https://phabricator.wikimedia.org/T239642
[23:50:50] <hauskatze>	 it worked twentyafterfour !
[23:55:05] <twentyafterfour>	 hauskatze: cool. I updated the paste with improvements
[23:55:23] <hauskatze>	 awesome, big thanks!
[23:57:19] <wikibugs>	 10Project-Admins, 10Office-IT: Scope of #Office-IT project tag in Phabricator? - https://phabricator.wikimedia.org/T242292 (10Aklapper) Would love to get input from WMF Office IT how to proceed with non-public https://phabricator.wikimedia.org/T171359 and its subtasks. [Please do not discuss the content of tho...