[00:55:24] <wikibugs>	 (03PS1) 10Ahmon Dancy: PipelineRunner.run(): Add removeContainer parameter [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/755830 (https://phabricator.wikimedia.org/T290608)
[00:56:43] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10ci-test-error: CI blocking merges in the Vector skin - https://phabricator.wikimedia.org/T299372 (10Krinkle) For the first one, the build failed due to:  ` sh: 1: tsc: not found Build step 'Execute shell' marked build as failure `  .. whi...
[00:56:46] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10ci-test-error: CI blocking merges in the Vector skin - https://phabricator.wikimedia.org/T299372 (10Krinkle)
[01:28:51] <wikibugs>	 (03PS1) 10BryanDavis: Review access change [labs/tools/cdnjs-index] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/755768
[01:29:56] <wikibugs>	 (03CR) 10BryanDavis: [V: 03+1 C: 03+2] "Needed to allow deleting the stale beta branch that has been merged into master long long ago" [labs/tools/cdnjs-index] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/755768 (owner: 10BryanDavis)
[01:30:03] <wikibugs>	 (03CR) 10BryanDavis: [V: 03+2 C: 03+2] Review access change [labs/tools/cdnjs-index] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/755768 (owner: 10BryanDavis)
[01:31:08] <bd808>	 If a bored gerrit admin is about, I could use a merge on https://gerrit.wikimedia.org/r/c/labs/tools/cdnjs-index/+/755768 (adding delete permission so I can clean up old feature branches)
[02:53:52] <legoktm>	 bd808: I'm not bored, but done :)
[03:46:46] <wikibugs>	 10Release-Engineering-Team (Next), 10Patch-For-Review, 10Release, 10Train Deployments: 1.38.0-wmf.18 deployment blockers - https://phabricator.wikimedia.org/T293959 (10ppelberg)
[04:03:13] <wikibugs>	 (03CR) 10Krinkle: dockerfiles: Add php-excimer to quibble (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/748312 (https://phabricator.wikimedia.org/T225730) (owner: 10Ladsgroup)
[04:04:54] <wikibugs>	 (03CR) 10Krinkle: dockerfiles: Add php-excimer to quibble (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/748312 (https://phabricator.wikimedia.org/T225730) (owner: 10Ladsgroup)
[09:27:08] <wikibugs>	 10Continuous-Integration-Infrastructure, 10castor: npm cache saved by castor get corrupted for unknown reason - https://phabricator.wikimedia.org/T295351 (10hashar)
[09:27:11] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10ci-test-error: CI blocking merges in the Vector skin - https://phabricator.wikimedia.org/T299372 (10hashar)
[09:29:23] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10ci-test-error: CI blocking merges in the Vector skin - https://phabricator.wikimedia.org/T299372 (10hashar) That issue has been hitting us for a bit, it is T295351
[09:34:09] * Reedy waits for jerkins to run some experimental jobs
[09:53:21] <wikibugs>	 10Release-Engineering-Team (Next), 10Release, 10Train Deployments: 1.38.0-wmf.19 deployment blockers - https://phabricator.wikimedia.org/T293960 (10Zabe)
[10:57:16] <wikibugs>	 (03CR) 10Kevin Bazira: [C: 03+1] "LGTM" [integration/config] - 10https://gerrit.wikimedia.org/r/755721 (https://phabricator.wikimedia.org/T298989) (owner: 10Accraze)
[10:57:53] <wikibugs>	 10Continuous-Integration-Config, 10MediaWiki-General, 10MW-1.37-release, 10PHP 8.0 support: Make MW 1.37 tests pass on PHP 8.0 - https://phabricator.wikimedia.org/T292847 (10Reedy) 05Open→03Resolved Progress after some backports.  https://integration.wikimedia.org/ci/job/mediawiki-quibble-composer-mysq...
[10:57:59] <wikibugs>	 10Continuous-Integration-Config, 10MW-1.35-release, 10MW-1.36-release, 10MW-1.37-release, 10PHP 8.0 support: Make PHP 8.0 voting on MW 1.35, 1.36, 1.37 - https://phabricator.wikimedia.org/T274965 (10Reedy)
[10:59:36] <wikibugs>	 10Continuous-Integration-Config, 10MW-1.35-release, 10MW-1.36-release, 10MW-1.37-release, 10PHP 8.0 support: Make PHP 8.0 voting on MW 1.35, 1.36, 1.37 - https://phabricator.wikimedia.org/T274965 (10Reedy)
[11:27:19] <wikibugs>	 10Gerrit: fatal: fetch-pack: invalid index-pack output on git fetch for mediawiki/core - https://phabricator.wikimedia.org/T298967 (10hashar) As far as I can tell the fetch has been done over ssh and I see plenty of them on the server side in `/var/log/gerrit/sshd_log.2022-01-11.gz`. There are errors as well whi...
[11:27:31] <wikibugs>	 10Gerrit: fatal: fetch-pack: invalid index-pack output on git fetch for mediawiki/core - https://phabricator.wikimedia.org/T298967 (10hashar)
[11:27:50] <wikibugs>	 10Gerrit, 10Release-Engineering-Team (Seen): Can't `git pull` mediawiki/core from Gerrit: "fatal: the remote end hung up unexpectedly" SSH_MSG_CHANNEL_WINDOW_ADJUST - https://phabricator.wikimedia.org/T263293 (10hashar)
[12:13:57] <wikibugs>	 10Gerrit, 10Release-Engineering-Team (Seen), 10Patch-For-Review: Can't `git pull` mediawiki/core from Gerrit: "fatal: the remote end hung up unexpectedly" SSH_MSG_CHANNEL_WINDOW_ADJUST - https://phabricator.wikimedia.org/T263293 (10hashar) Lets give `sshd.enableChannelIdTracking=false` a try
[13:49:59] <wikibugs>	 (03CR) 10Hashar: [C: 03+2] "INFO:jenkins_jobs.builder:Creating jenkins job inference-services-pipeline-draftquality-transformer" [integration/config] - 10https://gerrit.wikimedia.org/r/755721 (https://phabricator.wikimedia.org/T298989) (owner: 10Accraze)
[13:51:52] <wikibugs>	 (03Merged) 10jenkins-bot: inference: add draftquality-transformer pipeline [integration/config] - 10https://gerrit.wikimedia.org/r/755721 (https://phabricator.wikimedia.org/T298989) (owner: 10Accraze)
[13:52:39] <wikibugs>	 (03CR) 10Hashar: "I have reloaded CI." [integration/config] - 10https://gerrit.wikimedia.org/r/755721 (https://phabricator.wikimedia.org/T298989) (owner: 10Accraze)
[14:36:16] <wikibugs>	 (03PS4) 10Kosta Harlan: phpbench: Support aggregate reports [integration/quibble] - 10https://gerrit.wikimedia.org/r/741974 (https://phabricator.wikimedia.org/T291549)
[15:50:15] <hashar>	 !log integration-puppetmaster-02: deleted 2021 snapshot tags in puppet repo and ran `git gc --prune=now`
[15:50:20] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[15:56:12] <wikibugs>	 (03CR) 10Hashar: [C: 03+1] "I think that got deployed. I thought about an imaginary problem (scap lock race condition between the two jobs) but Ahmon kindly dismissed" [integration/config] - 10https://gerrit.wikimedia.org/r/755763 (https://phabricator.wikimedia.org/T299163) (owner: 10Ahmon Dancy)
[15:57:13] <wikibugs>	 (03CR) 10Ahmon Dancy: [C: 03+2] beta-code-update-eqiad/beta-mediawiki-config-update-eqiad use scap prep auto [integration/config] - 10https://gerrit.wikimedia.org/r/755763 (https://phabricator.wikimedia.org/T299163) (owner: 10Ahmon Dancy)
[15:59:55] <wikibugs>	 (03Merged) 10jenkins-bot: beta-code-update-eqiad/beta-mediawiki-config-update-eqiad use scap prep auto [integration/config] - 10https://gerrit.wikimedia.org/r/755763 (https://phabricator.wikimedia.org/T299163) (owner: 10Ahmon Dancy)
[16:48:24] <wikibugs>	 10Release-Engineering-Team (Next), 10Release, 10Train Deployments: 1.38.0-wmf.19 deployment blockers - https://phabricator.wikimedia.org/T293960 (10Umherirrender)
[16:48:53] <wikibugs>	 10Release-Engineering-Team (Next), 10Release, 10Train Deployments: 1.38.0-wmf.19 deployment blockers - https://phabricator.wikimedia.org/T293960 (10Umherirrender)
[16:57:49] <wikibugs>	 (03CR) 10Ladsgroup: dockerfiles: Add php-excimer to quibble (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/748312 (https://phabricator.wikimedia.org/T225730) (owner: 10Ladsgroup)
[17:22:10] <wikibugs>	 (03PS1) 10Ahmon Dancy: Add .editorconfig [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/756025
[17:28:59] <wikibugs>	 (03PS1) 10Ahmon Dancy: .editorconfig: Add *.groovy section [integration/config] - 10https://gerrit.wikimedia.org/r/756028
[17:31:11] <wikibugs>	 (03PS2) 10Ahmon Dancy: Add .editorconfig [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/756025
[17:31:13] <wikibugs>	 (03PS2) 10Ahmon Dancy: PipelineRunner.run(): Add removeContainer parameter [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/755830 (https://phabricator.wikimedia.org/T290608)
[17:31:15] <wikibugs>	 (03PS1) 10Ahmon Dancy: Add PipelineRunner.runv2() [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/756029
[17:32:38] <wikibugs>	 (03PS2) 10Ahmon Dancy: .editorconfig: Add *.groovy section [integration/config] - 10https://gerrit.wikimedia.org/r/756028
[17:32:40] <wikibugs>	 (03PS1) 10Ahmon Dancy: jjb/service-pipeline.groovy: Always remove test container [integration/config] - 10https://gerrit.wikimedia.org/r/756030 (https://phabricator.wikimedia.org/T290608)
[17:53:30] <wikibugs>	 (03PS1) 10Ahmon Dancy: scap update-wikiversions: Add --no-check flag [tools/scap] - 10https://gerrit.wikimedia.org/r/756035
[18:12:32] <taavi>	 !log resolved merge conflicts on deployment-puppetmaster04
[18:12:33] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[18:15:51] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Patch-For-Review: Deployment-prep should host its own statsd/graphite server - https://phabricator.wikimedia.org/T241285 (10Majavah) I've been thinking about this for a bit more. I haven't heard anyone complaining about the lack of statsd metrics from deployment-prep since the...
[18:42:29] <wikibugs>	 (03PS1) 10BryanDavis: toolhub: Add commit-message-validator to tests [integration/config] - 10https://gerrit.wikimedia.org/r/756042
[18:43:55] <wikibugs>	 (03PS2) 10BryanDavis: zuul: [wikimedia/toolhub] Add commit-message-validator to tests [integration/config] - 10https://gerrit.wikimedia.org/r/756042
[19:22:43] <wikibugs>	 (03CR) 10Hashar: [C: 03+2] .editorconfig: Add *.groovy section [integration/config] - 10https://gerrit.wikimedia.org/r/756028 (owner: 10Ahmon Dancy)
[19:24:38] <wikibugs>	 (03Merged) 10jenkins-bot: .editorconfig: Add *.groovy section [integration/config] - 10https://gerrit.wikimedia.org/r/756028 (owner: 10Ahmon Dancy)
[19:44:08] <wikibugs>	 (03PS1) 10Hashar: Enforce editorconfig settings [integration/config] - 10https://gerrit.wikimedia.org/r/756047
[19:46:12] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Enforce editorconfig settings [integration/config] - 10https://gerrit.wikimedia.org/r/756047 (owner: 10Hashar)
[19:46:49] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Radar): Deploy new elastic cluster nodes on deployment-prep - https://phabricator.wikimedia.org/T299797 (10bking)
[19:57:24] <mutante>	 hashar: do you care about the instance(s) called doc* in the cloud devtools* project? one was made by you (doc), stretch, and another by me, doc1001 (buster). they are currently a bit in the way of the quota to create other instances for gitlab. was wondering if I delete those and we can recreate them whenever needed
[19:57:41] <mutante>	 also asking for quota increase there though either way
[19:58:31] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Radar): Migrate deployment-prep away from Debian Stretch to Buster/Bullseye - https://phabricator.wikimedia.org/T278641 (10bking)
[19:59:45] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Radar): Deploy new elastic cluster nodes on deployment-prep - https://phabricator.wikimedia.org/T299797 (10Majavah)
[19:59:47] <wikibugs>	 10Beta-Cluster-Infrastructure, 10SRE-swift-storage: Upgrade deployment-prep Swift cluster to Debian Buster or newer - https://phabricator.wikimedia.org/T298253 (10Majavah)
[19:59:50] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Radar): Migrate deployment-prep away from Debian Stretch to Buster/Bullseye - https://phabricator.wikimedia.org/T278641 (10Majavah)
[20:00:30] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Radar): Deploy new elastic cluster nodes on deployment-prep - https://phabricator.wikimedia.org/T299797 (10Majavah)
[20:00:32] <wikibugs>	 10Beta-Cluster-Infrastructure, 10SRE-swift-storage: Upgrade deployment-prep Swift cluster to Debian Buster or newer - https://phabricator.wikimedia.org/T298253 (10Majavah)
[20:00:38] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Discovery-Search, 10Elasticsearch: Upgrade deployment-prep Elastic cluster to Debian Buster or newer - https://phabricator.wikimedia.org/T298252 (10Majavah)
[20:03:22] <hashar>	 mutante: the doc*.devtool instance I think I created it when I wrote code to support moving docs to a standalone partition ( /srv/doc )
[20:04:06] <mutante>	 hashar: ah! ok, so not about the dist upgrade, got it. do you still want to keep that one?
[20:04:21] <hashar>	 no clue probably not. Let me check
[20:04:42] <mutante>	 ok, thanks, no rush. brb
[20:05:31] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Radar), 10Discovery: Deploy new elastic cluster nodes on deployment-prep - https://phabricator.wikimedia.org/T299797 (10bking)
[20:05:42] <hashar>	 bah there is a doc one on stretch and a doc1002 on buster
[20:06:21] <mutante>	 yes, doc1002 was created by me
[20:06:29] <mutante>	 for testing if the role works there
[20:06:48] <mutante>	 doc was created by you for the partioning or so
[20:07:00] <mutante>	 it's still pending to switch to buster in prod
[20:07:14] <mutante>	 but I didnt mean that today, for today I just wanted quota in devtools :)
[20:07:40] <hashar>	 oh and there is the scap testing 
[20:08:07] <mutante>	 also, I merged 2 of your Gerrit changes, the ones for index batch threads
[20:08:16] <mutante>	 but no hard restart so far
[20:08:23] <hashar>	 we can drop them both
[20:08:30] <hashar>	 it should be easy to recreate them using profile::doc
[20:08:31] <mutante>	 both instances?
[20:08:38] <hashar>	 yeah doc and doc1002
[20:08:48] <mutante>	 ok, great. yes, we still want to do that but can recreate anytime. that is what I was hiping
[20:08:51] <mutante>	 hoping
[20:08:52] <hashar>	 I would like to investigate migrating that service to docker/k8s
[20:08:53] <mutante>	 ok, thank you
[20:09:02] <mutante>	 ok
[20:09:11] <hashar>	 gotta ask around where we could store the files when using k8s ;)
[20:09:32] <hashar>	 so it is more or less on hold til I write the problem statement and a proposal for an ideal target
[20:09:41] <mutante>	 ok. you know what is also k8s now, since yesterday?
[20:09:54] <hashar>	 gerrit?
[20:09:55] <mutante>	 https://static-bugzilla.wikimedia.org/ :p 
[20:10:03] <hashar>	 ahah excellent
[20:10:05] <mutante>	 that's my first k8s service
[20:10:16] <mutante>	 going to move more of the small site there eventually
[20:10:23] <mutante>	 the ones on miscweb* now
[20:10:30] <hashar>	 do you plan to migrate the microservices thing as well?
[20:10:47] <hashar>	 err
[20:10:48] <hashar>	 micro sites
[20:10:50] <mutante>	 the sites like annual.wikimedia.org 
[20:10:53] <mutante>	 yes, I do
[20:11:02] <mutante>	 but the ones that have external deployers are more complicated
[20:11:07] <mutante>	 that something that never changes
[20:11:10] <mutante>	 like static bz
[20:11:22] <mutante>	 gotta talk about the deploy process for them
[20:11:43] <mutante>	 they cant just +2 in gerrit and auto-deploy (also your ticket about git::clone => latest is related)
[20:11:43] <hashar>	 we once had some talk about migrating www.wikipedia.org toward k8s
[20:11:47] <hashar>	 iirc it is a purely static site
[20:12:03] <hashar>	 but it is deployed on the mw app servers via a submodule in operations/mediawiki-config
[20:12:07] <mutante>	 yep, that seems possible
[20:12:23] <mutante>	 well, the appservers are also k8s soon
[20:12:46] <hashar>	 I am guessing the mediawiki on kubernetes project is aware of that www.wikipedia.org
[20:12:53] <mutante>	 it's possible that the kubernetes clusters are splitting too
[20:13:03] <mutante>	 between projects and other
[20:13:20] <mutante>	 it should have a copy of the cluster apache config, yea
[20:13:32] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Radar), 10Discovery: Deploy new elastic cluster nodes on deployment-prep - https://phabricator.wikimedia.org/T299797 (10bking) Looking at https://phabricator.wikimedia.org/T278689 as  a reference point for code changes required for new nodes. Will ne...
[20:13:32] <mutante>	 currently apache changes need to happen in 2 places, pre-k8s and k8s, afaik
[20:13:50] <taavi>	 mutante: hashar: btw I still believe we could switchover to the buster doc servers basically at any point, it's been waiting for releng approval on the ticket for a while
[20:14:01] <mutante>	 taavi: same here
[20:14:51] <mutante>	 the VMs are just sitting there
[20:14:59] <hashar>	 yeah so hmm
[20:15:01] <hashar>	 files
[20:15:23] <hashar>	 last time we moved files around we have lost username/group which ended up being more or less random
[20:15:45] <hashar>	 and if we get a new os, that means a new php and I am not quiet sure what will happen to doxygen search.php
[20:15:55] <hashar>	 maybe it will just work
[20:16:00] <mutante>	 that's what that buster VM was for
[20:16:03] <mutante>	 but yea
[20:17:14] <hashar>	             "rsync://doc.discovery.wmnet/doc/${WMF_CI_PUB_DEST}"
[20:17:17] <hashar>	 that is what CI does
[20:17:40] <hashar>	 so I guess if the files are in sync between the hosts
[20:17:47] <hashar>	 change DNS
[20:17:48] <hashar>	 done
[20:17:49] <hashar>	 ?
[20:17:58] <mutante>	 yea, I switched all of that to the discovery record
[20:18:03] <mutante>	 a long time ago
[20:18:36] <mutante>	 it's a "manual" alias for doc1001 though
[20:18:40] <mutante>	 it's not geoDNS
[20:19:04] <mutante>	 so everybody gets response from 1001 I am trying to say
[20:19:04] <hashar>	 mutante: may you propose a time slot sometime next week to do the switch?
[20:19:07] <mutante>	 until we switch it
[20:19:13] <hashar>	 and maybe we can get taavi in if there is an interest
[20:19:37] <mutante>	 you had a reason though you did not want to do it last time
[20:19:40] <mutante>	 i forget what it was
[20:19:56] <hashar>	 since if all the work hsa been completed, you just need to push the green button with me behind signing on it
[20:19:57] <mutante>	 but you had something that made me go "ah, ok, not now then" or so
[20:20:09] <hashar>	 and then I can check doxygen search and the web portal
[20:20:23] <hashar>	 I think the reason might be because of php
[20:20:28] <hashar>	 and how to move files around betweenhost
[20:20:37] <hashar>	 I have the problem for contint* and gerrit* boxes
[20:20:45] <mutante>	 so, do you want to test that somehow in cloud?
[20:20:51] <mutante>	 then we should not delete that buster VM now
[20:20:53] <hashar>	 that?
[20:20:55] <mutante>	 that was made for this
[20:21:03] <mutante>	 the things you are not sure about
[20:21:20] <hashar>	 well like all deployments, there is always a part of unknown
[20:22:06] <hashar>	 if there are files synced on the new prod instance, I guess one can reach it via a ssh tunnel
[20:22:53] <taavi>	 I was just about to suggest that
[20:23:01] <taavi>	 you can use something like `ssh -L 8083:doc1002.eqiad.wmnet:80 deployment.eqiad.wmnet`
[20:23:11] <taavi>	 doxygen search seems to work fine
[20:23:38] <mutante>	 I mean..  I have provided everything, the new VMs, the DNS records, the test VM, i have update the ticket, it's been sitting there for a year. You guys have said you want to test it but lack the bandwidth. 
[20:24:12] <mutante>	 https://phabricator.wikimedia.org/T247653
[20:26:13] <hashar>	 yeah sorry :-\
[20:26:17] <mutante>	 given that I don't really want to also schedule and live test it in prod, Also literally yesterday got new OKRs that fill up my schedule
[20:26:26] <hashar>	 I wanted to pair with Lars to share the doc responsability
[20:26:30] <hashar>	 and events and stuff
[20:26:35] <hashar>	 and I forgot about it once again I guess
[20:27:46] <hashar>	 mutante: just book an hour next week with me and lets do it
[20:27:53] <mutante>	 yea, sorry, I don't have time to schedule this for next week. I need to create gitlab VMs, migrate Phabricator to new hardware, move more sites to miscweb, all in this quarter and I'm off most of March
[20:28:01] <hashar>	 and if something goes wrong I will go "oops"
[20:28:14] <hashar>	 ah
[20:28:25] <mutante>	 am I really needed or just anyone who can make DNS changes?
[20:29:06] <hashar>	 you have much of the context so it is probably helpful to have 
[20:29:19] <mutante>	 what context exactly?
[20:29:20] <hashar>	 then if it is just a dns change and veryfing that is straightforward to do isn't it?
[20:29:46] <mutante>	 sorry, I am really not going to get into the "rsync and UID" and "patch quickadatcopy" thing though. I just have to say no
[20:30:01] <mutante>	 especially not during a "switch it really quick"
[20:30:09] <mutante>	 and it sounds that could be likely
[20:30:29] <hashar>	 so we need a better system than the one based on rsync and giving us uid mismatching
[20:30:52] <hashar>	 which circle back to the same issue I have with contint* and gerrit*
[20:30:54] <mutante>	 I dont know
[20:31:03] <hashar>	 tldr: I need Ceph
[20:31:13] <hashar>	 move those services execution to k8s
[20:31:32] <hashar>	 and serve the file from Ceph (or whatever fs system we have that can span accross dc)
[20:32:36] <mutante>	 that's the kind of thing that we need on the ticket. let's avoid the adhoc part on IRC
[20:33:05] <hashar>	 sure
[20:33:07] <mutante>	 I gotta go and create that gitlab instance. that's what I was here for
[20:33:17] <mutante>	 I deleted the "doc" one, so that should be possible now
[20:33:31] <mutante>	 thanks for confirming that. unblocked me
[20:33:41] <mutante>	 be back later
[20:35:14] <hashar>	 mutante: thank you!
[20:35:33] <hashar>	 taavi: and thank you for the various patches to migrate doc.wikimedia.org 
[20:35:49] <hashar>	 I have added an item to my calendar for monday and revisit that
[21:07:20] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Radar), 10Discovery: Deploy new elastic cluster nodes on deployment-prep - https://phabricator.wikimedia.org/T299797 (10bking) Booted instance ID 48ba77ab-3c6d-46ca-93fd-7a0785d7f45c with hostname 'deployment-elastic00.' I could ping and get an SSH p...
[21:27:16] <wikibugs>	 (03PS1) 10Ahmon Dancy: mods for deploy02 [tools/train-dev] - 10https://gerrit.wikimedia.org/r/756059
[21:42:06] <wikibugs>	 (03PS2) 10Hashar: Enforce editorconfig settings [integration/config] - 10https://gerrit.wikimedia.org/r/756047
[21:42:14] <hashar>	 dancy: congratulations
[21:42:29] <dancy>	 hmmmm?
[21:42:35] <hashar>	 you have managed to trick me into reading gitglossary(7) to figure out magic for `git ls-files` :)
[21:42:47] <dancy>	 haha.. you're welcome
[21:42:51] <hashar>	 on this friday night, I went to add a test for integration/config editorconfig :]]]
[21:43:00] <hashar>	 based on magic tyler once found ages ago
[21:43:10] <hashar>	 and the very nice editorconfig-checker you have introduced to train-dev
[21:43:36] <hashar>	 I should really write a reference page for editorconfigsomehwehre on the wikis
[21:43:48] <dancy>	 I think you added the checker.
[21:44:29] <hashar>	 OH yeah for sure https://gerrit.wikimedia.org/r/c/mediawiki/tools/train-dev/+/736442/2/tox.ini
[21:44:41] <hashar>	 but after you have introduced `shellchecker-py` 
[21:44:55] <hashar>	 so I merely replicated what you did
[21:45:11] <hashar>	 cause shipping binary linters did not have much of a solution
[21:45:14] <hashar>	 speiclaly for shellcheck
[21:45:19] <hashar>	 team work \o/
[21:45:40] <dancy>	 I do notice that the python version of shellcheck reports different things than the binary version..  That's been annoying a time or two.
[21:47:50] <wikibugs>	 (03CR) 10Hashar: "the important bits are in tox.ini and .editorconfig" [integration/config] - 10https://gerrit.wikimedia.org/r/756047 (owner: 10Hashar)
[21:48:06] <hashar>	 possibly because the binary version has a fixed version of the checker that comes from Debian
[21:48:22] <hashar>	 while the py-shellchecker might fetch a different version (maybe it is possible to set the version explicitly)
[21:48:41] <dancy>	 nod
[21:48:49] <hashar>	 or we get the test that uses the binary checker to rely on the one provided by tox
[21:49:41] <hashar>	 yeah
[21:49:47] <hashar>	 utils/shellcheck.sh could use:
[21:50:02] <hashar>	 tox -e lint --notest  # install shellcheck
[21:50:23] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Radar), 10Discovery: Deploy new elastic cluster nodes on deployment-prep - https://phabricator.wikimedia.org/T299797 (10Majavah) >>! In T299797#7641306, @bking wrote: >   - Looking at https://phabricator.wikimedia.org/T278689 as  a reference point fo...
[21:50:36] <hashar>	 shellcheck="$base_dir/.tox/lint/bin/shellcheck"
[21:50:41] <hashar>	 oh screw that irc
[22:09:02] <wikibugs>	 10GitLab, 10GitLab-Test, 10Release-Engineering-Team (Radar), 10serviceops-radar, 10Cloud-VPS (Quota-requests): Request increased quota for devtools Cloud VPS project - https://phabricator.wikimedia.org/T299561 (10Dzahn) I deleted the 2 doc* instances after checking in with hashar. We agreed they can be r...
[22:09:32] <wikibugs>	 10GitLab, 10serviceops: upgrade gitlab-runners to bullseye - https://phabricator.wikimedia.org/T297659 (10Dzahn)
[22:09:36] <wikibugs>	 10GitLab (Infrastructure), 10serviceops, 10Patch-For-Review: Migrate gitlab-test instance to puppet - https://phabricator.wikimedia.org/T297411 (10Dzahn)
[22:09:53] <wikibugs>	 10GitLab, 10GitLab-Test, 10Release-Engineering-Team (Radar), 10serviceops-radar, 10Cloud-VPS (Quota-requests): Request increased quota for devtools Cloud VPS project - https://phabricator.wikimedia.org/T299561 (10Dzahn) 05In progress→03Open a:05Dzahn→03None
[22:10:18] <wikibugs>	 10GitLab, 10GitLab-Test, 10Release-Engineering-Team (Radar), 10serviceops-radar, 10Cloud-VPS (Quota-requests): Request increased quota for devtools Cloud VPS project - https://phabricator.wikimedia.org/T299561 (10Dzahn)
[22:12:49] <wikibugs>	 (03PS1) 10Hashar: utils/shellchecker: install shellcheck from pypi [integration/config] - 10https://gerrit.wikimedia.org/r/756087
[22:12:51] <wikibugs>	 (03PS1) 10Hashar: Run shellcheck against shell files [integration/config] - 10https://gerrit.wikimedia.org/r/756088
[22:16:01] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Run shellcheck against shell files [integration/config] - 10https://gerrit.wikimedia.org/r/756088 (owner: 10Hashar)
[22:17:21] <wikibugs>	 10GitLab, 10serviceops: upgrade gitlab-runners to bullseye - https://phabricator.wikimedia.org/T297659 (10hashar) For the `integration` project, the instances will be migrated to Bullseye using the flavor requested at T299704: `g3.cores8.ram24.disk20.ephemeral60.4xiops`  The important bits being:  -  enough di...
[22:19:09] <wikibugs>	 10GitLab (Infrastructure), 10serviceops, 10Patch-For-Review: Migrate gitlab-test instance to puppet - https://phabricator.wikimedia.org/T297411 (10Dzahn) 05Stalled→03In progress
[22:19:16] <wikibugs>	 10Continuous-Integration-Config, 10MW-1.35-release, 10MW-1.36-release, 10MW-1.37-release, 10PHP 8.0 support: Make PHP 8.0 voting on MW 1.35, 1.36, 1.37 - https://phabricator.wikimedia.org/T274965 (10Reedy)
[22:21:26] <wikibugs>	 10GitLab (Infrastructure), 10serviceops, 10Patch-For-Review: Migrate gitlab-test instance to puppet - https://phabricator.wikimedia.org/T297411 (10Dzahn) a:05Dzahn→03None current status here:  We now have the new instance `gitlab-prod-1001`. It has 2 CPUs and 4GB RAM.  When applying the prod puppet role...
[22:21:43] <wikibugs>	 (03PS2) 10Hashar: Run shellcheck against shell files [integration/config] - 10https://gerrit.wikimedia.org/r/756088
[22:21:54] <hashar>	 ok enough hacking for tonight &
[22:22:09] <wikibugs>	 10GitLab, 10GitLab-Test, 10Release-Engineering-Team (Radar), 10serviceops-radar, 10Cloud-VPS (Quota-requests): Request increased quota for devtools Cloud VPS project - https://phabricator.wikimedia.org/T299561 (10Dzahn) p:05Triage→03Medium
[22:23:07] <wikibugs>	 (03CR) 10Hashar: [C: 04-2] "Plenty of failures that would need to be carefully considered since that means updating Docker images and plenty of jobs :)" [integration/config] - 10https://gerrit.wikimedia.org/r/756088 (owner: 10Hashar)
[22:24:33] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Run shellcheck against shell files [integration/config] - 10https://gerrit.wikimedia.org/r/756088 (owner: 10Hashar)
[23:24:11] <wikibugs>	 10GitLab (Infrastructure), 10serviceops, 10Patch-For-Review: Migrate gitlab-test instance to puppet - https://phabricator.wikimedia.org/T297411 (10Dzahn) btw, you can see here in Phabricator when someone changes roles on cloud VPS instances. example:  https://phabricator.wikimedia.org/rCLIP864817a030ae844bcb...
[23:30:43] <wikibugs>	 (03PS1) 10Ahmon Dancy: train ssh subcommand: Handle 'www' name [tools/train-dev] - 10https://gerrit.wikimedia.org/r/756096
[23:35:20] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Radar), 10Discovery: Deploy new elastic cluster nodes on deployment-prep - https://phabricator.wikimedia.org/T299797 (10bking) Second attempt, created instance ID 48d468a8-7733-47fd-a078-cc4d931d1545 with deployment-elastic00 with hostname 'deploymen...
[23:36:12] <wikibugs>	 (03CR) 10Ahmon Dancy: [C: 03+2] train ssh subcommand: Handle 'www' name [tools/train-dev] - 10https://gerrit.wikimedia.org/r/756096 (owner: 10Ahmon Dancy)
[23:52:00] <wikibugs>	 10Project-Admins: Create project tag for Header Tabs extension - https://phabricator.wikimedia.org/T299619 (10Peachey88) 05Open→03Resolved a:03Peachey88 Requested public project #MediaWiki-extension-Header_Tabs has been created: https://phabricator.wikimedia.org/project/view/5682/  Interested people are we...