[00:00:12] same with dbctl [00:01:02] I think the lookup could reasonably be `https://deployment-etcd05.deployment-prep.eqiad1.wikimedia.cloud:2379/v2/keys/conftool/v1/mediawiki-config/labs/dbconfig`. That returns a 404 with a body of {"errorCode":100,"message":"Key not found","cause":"/conftool","index":4} [00:04:37] Project beta-scap-sync-world build #163741: 04STILL FAILING in 14 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/163741/ [00:06:24] * andrewbogott trying to get dbctl and conftool installed [00:09:18] * bd808 is looking at php code to see if there is a good place to add some logging [00:12:37] Project beta-scap-sync-world build #163742: 04STILL FAILING in 32 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/163742/ [00:12:42] !log disable beta-code-update-eqiad until etcd maintenance concludes [00:12:43] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [00:19:19] Project beta-scap-sync-world build #163743: 04STILL FAILING in 30 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/163743/ [00:23:55] Project beta-scap-sync-world build #163744: 04STILL FAILING in 32 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/163744/ [00:24:59] andrewbogott: I added some logging and found that the lookup is for `https://deployment-etcd05.deployment-prep.eqiad1.wikimedia.cloud:2379/v2/keys/conftool/v1/mediawiki-config/?recursive=true`. Not sure that helps you much. [00:25:22] it does a bit, that's the same config section that I'm trying to create [00:25:41] but right now conftool is looking for the endpoint at _etcd._tcp.conftool.deployment-prep.eqiad.wmflabs.deployment-prep.eqiad1.wikimedia.cloud. [00:25:45] which is clearly not going to work [00:27:41] hmmm... without the svc I guess is the problem? _etcd._tcp.conftool.svc.deployment-prep.eqiad1.wikimedia.cloud. exists [00:30:45] it's doing something weirder than that I think [00:30:46] I have no knowledge of conftool in beta :\ [00:31:01] ERROR:etcd.client:Could not discover the etcd hosts from conftool.deployment-prep.eqiad.wmflabs: None of DNS query names exist: _etcd._tcp.conftool.deployment-prep.eqiad.wmflabs., _etcd._tcp.conftool.deployment-prep.eqiad.wmflabs.deployment-prep.eqiad1.wikimedia.cloud., _etcd._tcp.conftool.deployment-prep.eqiad.wmflabs.deployment-prep.eqiad.wmflabs., _etcd._tcp.conftool.deployment-prep.eqiad.wmflabs.eqiad.wmflabs. [00:31:16] thcipriani: any idea how it got there in the first place? IT seems like it was installed, used to configure etcd, and then removed [00:31:36] dbctl actually (which wraps conftool, which wraps etcd) [00:32:28] hrm...I don't know, but I bet phab must know...let me dig [00:33:51] well https://phabricator.wikimedia.org/T278007 [00:34:29] mercifully none of those boxes are ticked so we won't lose much by starting over [00:38:25] andrewbogott: I'm going to eat dinner. Feel free to yell for more help if you need it. [00:38:36] some good info from the _last time_ etcd was upgraded in beta: https://phabricator.wikimedia.org/T276462 [00:48:30] 10GitLab (Project Migration), 06collaboration-services: Migrate SRE repositories to GitLab - operations/software - https://phabricator.wikimedia.org/T341504#9983777 (10BCornwall) [00:51:11] 10GitLab (Project Migration), 06Traffic, 13Patch-For-Review: Migrate Traffic repositories from Gerrit to Gitlab - https://phabricator.wikimedia.org/T347623#9983778 (10BCornwall) [00:51:39] where I am now is dbctl telling me 'etcd.EtcdKeyNotFound: Key not found : /conftool' and yet... [00:51:55] https://www.irccloud.com/pastebin/ej0jQLmD/ [00:52:31] the further I go down this road the less I know [01:00:03] Project beta-scap-sync-world build #163745: 04STILL FAILING in 33 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/163745/ [01:01:03] hhrm, is it possible that error message is misleading? [01:02:35] i.e., the path it's looking for is somehow different [01:02:59] * thcipriani grasping [01:08:00] hrm, wonder why "dir" is blank/if "dir" should be blank [01:09:38] I'm making small amounts of progress I think [01:09:41] well. ETCDCTL_API=3 etcdctl --endpoints https://deployment-etcd05.deployment-prep.eqiad1.wikimedia.cloud:2379 get /conftool/v1/mediawiki-config is empty [01:10:02] I think the next step is to convert things in https://phabricator.wikimedia.org/T276462#6882968 into json [01:10:16] yeah, it's empty but it exists! That's progress [01:19:14] (03PS1) 10BCornwall: Archive libvmod-querysort [integration/config] - 10https://gerrit.wikimedia.org/r/1054408 (https://phabricator.wikimedia.org/T347623) [01:21:37] 10GitLab (Project Migration), 06Traffic, 13Patch-For-Review: Migrate Traffic repositories from Gerrit to Gitlab - https://phabricator.wikimedia.org/T347623#9983815 (10BCornwall) [01:22:02] Project beta-scap-sync-world build #163746: 04STILL FAILING in 30 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/163746/ [01:22:21] hrm, ok, lemme try something stupid to try to figure out some more info about what this "dir" is [01:25:58] well. I can say it is curling "https://deployment-etcd05.deployment-prep.eqiad1.wikimedia.cloud:2379/v2/keys/conftool/v1/mediawiki-config/?recursive=true" on the deploy server. And that curl does give me a key /conftool/v1/mediawiki-config [01:27:00] let me see if it's a dir... [01:27:18] it isn't, that's probably why it's mad [01:27:38] ah, I could believe that [01:27:52] now it's a dir [01:28:00] full of nonsense, but let's see what happens next :) [01:28:18] Failed to parse value for 'spacefiller' [01:28:19] :) [01:28:38] Project beta-scap-sync-world build #163747: 04STILL FAILING in 31 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/163747/ [01:28:52] lol it doesn't like the nonsense [01:28:57] reasonable [01:30:07] Project beta-scap-sync-world build #163748: 04STILL FAILING in 30 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/163748/ [01:32:04] what if it's just an empty json object? [01:32:53] * andrewbogott tries {} [01:33:18] it may be looking for a `{"config": []}` (but I also could be misreading the code [01:34:20] or possibly something actually in the array, but it is checking `is_array($etcdResponse['config'])` and then caching the output [01:35:00] blah: failed to parse value for 'config' [01:35:15] Project beta-scap-sync-world build #163749: 04STILL FAILING in 31 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/163749/ [01:35:31] ok, that feels like we're getting someplace [01:35:36] So it doesn't like [] [01:36:11] oh, it literally inserted the string "[]" [01:36:12] that's not good [01:36:23] how can I make curl understand emptiness? [01:37:23] Project beta-scap-sync-world build #163750: 04STILL FAILING in 30 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/163750/ [01:37:56] looks like it's value is "{}" not "[]" [01:38:10] first try was [] second try {} [01:38:13] ah [01:38:14] same error message [01:38:45] hrm, I'm guessing the php library is doing some magic here to convert it to a native array [01:42:04] https://github.com/wikimedia/mediawiki/blob/master/includes/config/EtcdConfig.php#L333-L350 [01:43:30] yep [01:43:42] so what would unserialize into a php array? ()? [01:44:26] * andrewbogott takes a tour de bracket [01:44:33] so json_decode("[]", true); returns an empty php array [01:44:43] Project beta-scap-sync-world build #163751: 04STILL FAILING in 32 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/163751/ [01:44:51] (which is what the $this->unserialize function does) [01:45:04] then why didn't [] work? [01:45:27] but! it's looking for is_array and array_key_exists('val') [01:46:33] I must have forgotten what php I used to know [01:46:47] does that just mean ['foo']? [01:47:03] try setting it to: "{'val': 'test'}" [01:47:19] so an 'array' in php is actually a hash/dict/map/etc? [01:47:23] that should make a php array: ["val" => "test"] [01:47:24] yep [01:47:29] * andrewbogott curses [01:47:34] php uses "array" as list or dict [01:48:32] so that should get us past this particular gauntlet and we'll see what else explodes! [01:48:33] Project beta-scap-sync-world build #163752: 04STILL FAILING in 33 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/163752/ [01:49:00] etcd says [01:49:01] {"key":"/conftool/v1/mediawiki-config/config","value":"{'val': 'test'}","modifiedIndex":25,"createdIndex":25}} [01:49:12] but mw still says it can't parse [01:49:27] grr...lemme try some ill-advised debugging [01:49:32] thx [01:51:16] I suppose I should be using conftool, in which case it would be formatting things properly [01:51:21] interesting. $value is null here: https://github.com/wikimedia/mediawiki/blob/master/includes/config/EtcdConfig.php#L342 [01:51:36] But so far I can't get puppet to install conftool [01:51:37] lemme check what $node is [01:52:46] https://phabricator.wikimedia.org/P66571 [01:53:53] that doesn't look like $value is null to me [01:54:13] but what it gets back from json_decode is null [01:54:23] var_dump(json_decode("{'val': 'test'}", true)); => NULL [01:54:34] oh, I see [01:54:37] var_dump(json_decode('{"val": "test"}', true)); => ['val' => 'test'] [01:54:44] needs double quotes I guess [01:54:57] /that/ I know how to do [01:55:21] further adventures pretending I know php [01:56:07] hey, gives us a missing key now [01:56:12] the only options are to know nothing about everything or everything about nothing, we have chosen the former. [01:56:17] Project beta-scap-sync-world build #163753: 04STILL FAILING in 30 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/163753/ [01:56:44] Shit, I was worried that it was going to expect actual content there at some point :( [01:57:22] how do I say 'false' in php? [01:57:30] 'no'? [01:57:32] say it in json and php will parse it [01:57:42] '{"val": {"eqiad/ReadOnly": false}}' [01:58:02] it's idiomatically: false [01:58:50] It's going to want 1000 other settings after this one, right? [01:59:03] Project beta-scap-sync-world build #163754: 04STILL FAILING in 34 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/163754/ [01:59:05] maybe...we could try to curl prod [01:59:23] wait, it didn't even get that one [02:00:54] hrm, yeah, the value of 'config' is an array with 'eqiad/ReadOnly' set to false [02:02:29] oh...I wonder if it cached the response [02:04:15] I'm going to have another go at getting a proper dump of the old etcd node [02:07:25] ah crap [02:08:07] the data from etcd looks like: https://phabricator.wikimedia.org/P66571#266499 [02:08:40] and then it's looking for $thing['config']['eqiad/ReadOnly']; there are one too many 'config's in this array [02:12:47] phab to the rescue: https://phabricator.wikimedia.org/T273089#6782149 [02:14:28] ^ andrewbogott looks like that's what we need to recreate in etcd [02:14:52] (at least for keys/conftol/v1/mediawiki-config ) [02:15:07] I'm having a hard time parsing that into instructions [02:16:56] isn't that ariel querying? [02:17:01] rather htan setting? [02:18:18] alright, so dirs we need under mediawiki-config: codfw, with a key ReadOnly: false; eqiad, with a key RReadOnly '{"val":false}'; common with a key WMFMasterDatacenter '{"val": "eqiad"} [02:19:49] and eqiad needs a key "dbconfig" value '{"val": null}' [02:20:14] and codfw's dir, with key ReadOnly should be '{"val": false}' [02:22:55] is that really all? [02:23:06] I could believe it [02:23:11] * andrewbogott still trying snapshot/restore which sure isn't doing what it should [02:23:22] ok, rewinding... [02:32:03] sorry, I'm lost in snapshot restoration still [02:33:17] no worries :) [02:41:18] wow this works poorly [02:43:24] ok, everything is reset back to 0, now going to add the keys you suggest [02:43:43] but I still don't understand the config/config thing [02:45:09] oh, maybe I do, maybe [02:46:23] yeah, directory named config with key named config [02:49:13] er, no, the php was parsing it into the config key and somehow I misread it as looking for the config key in the directory [02:51:38] ok, is this what you'd expect? [02:51:38] {"action":"get","node":{"key":"/conftool/v1/mediawiki-config","dir":true,"nodes":[{"key":"/conftool/v1/mediawiki-config/codfw","value":"{\"readonly\": {\"val\": false}}","modifiedIndex":6,"createdIndex":6},{"key":"/conftool/v1/mediawiki-config/eqiad","value":"{\"WMFMasterDatacenter\": {\"val\": eqiad}}","modifiedIndex":8,"createdIndex":8}],"modifiedIndex":4,"createdIndex":4}} [02:52:20] something is messed up with eqiad [02:52:42] no `/conftool/v1/mediawiki-config/codfw` should be a dir [02:53:00] rather than a key [02:53:42] oh, ok... [02:53:50] then inside that dir, it should have a key: /conftool/v1/mediawiki-config/codfw/ReadOnly value: '{"val": false}' [02:54:17] likewise with /conftool/v1/mediawiki-config/eqiad, should also be a dir [02:55:34] so... [02:55:35] {"action":"get","node":{"key":"/conftool/v1/mediawiki-config","dir":true,"nodes":[{"key":"/conftool/v1/mediawiki-config/eqiad","dir":true,"modifiedIndex":14,"createdIndex":14},{"key":"/conftool/v1/mediawiki-config/codfw","dir":true,"modifiedIndex":15,"createdIndex":15},{"key":"/conftool/v1/mediawiki-config/common","dir":true,"modifiedIndex":16,"createdIndex":16}],"modifiedIndex":4,"createdIndex":4}} [02:55:49] and {"action":"get","node":{"key":"/conftool/v1/mediawiki-config/eqiad","dir":true,"nodes":[{"key":"/conftool/v1/mediawiki-config/eqiad/readonly","value":"{\"val\": false}","modifiedIndex":14,"createdIndex":14}],"modifiedIndex":14,"createdIndex":14}} [02:55:50] that looks right, but the key looks case sensitive, so "ReadOnly" [02:55:51] etc [02:55:54] dang [02:55:57] :) [02:57:11] one more key in eqiad: /conftool/v1/mediawiki-config/eqiad/dbconfig set to '{"val": null}' [02:57:36] (not sure if that one is going to matter or not) [02:58:00] (it does) [02:58:23] https://www.irccloud.com/pastebin/IEXCffng/ [02:58:33] whoa: mwscript shell.php enwiki worked! [02:58:42] my eyes are just about done working so I can't really proofread myself :( [02:58:53] (that's been my fast debug mechanism). Let's retry the job [02:58:57] ok, I'll poke jenkins... [02:59:50] it's doing things! [03:00:26] made it through l10n cache! [03:00:39] hooray for random unrelated debugging output in phab [03:01:10] yeah! [03:01:40] I started this whole exercise trying to dump the contents into a human-readable format and found a nice doc page that said "there's no text equivalent in etcd v3, you just have to use binary files" [03:01:47] which seems like it can't be true [03:01:52] Yippee, build fixed! [03:01:52] Project beta-scap-sync-world build #163755: 09FIXED in 2 min 44 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/163755/ [03:01:56] yippee [03:01:59] yippee! [03:02:08] Thanks for sorting this out thcipriani [03:02:12] I hope you didn't miss dinner [03:02:16] alright, I'm going to call it an evening. Nice job, andrewbogott one more instance down. [03:02:26] Me too [03:02:31] later! [03:02:32] nobody home but me and the dog (hence the temptation to sit at the computer and eat cold pizza) [03:02:36] toodles [03:03:12] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Buster Deprecation), 13Patch-For-Review: Migrate deployment-prep away from Debian Buster to Bullseye/Bookworm - https://phabricator.wikimedia.org/T327742#9983905 (10Andrew) [03:04:53] !log enable beta-* jobs post beta etcd maintenance [03:04:54] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [03:32:13] Yippee, build fixed! [03:32:13] Project beta-update-databases-eqiad build #77478: 09FIXED in 12 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/77478/ [07:42:57] (03PS1) 10Daniel Kinzler: extension_survey: add mode for colelction service usage [tools/code-utils] - 10https://gerrit.wikimedia.org/r/1054478 [08:04:28] !log integration: reimaging `integration-cumin` from Buster to Bullseye # T360784 [08:04:31] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:04:31] T360784: Rebuild integration-cumin to get rid of Debian Buster - https://phabricator.wikimedia.org/T360784 [08:05:39] Created June 22, 2020, 10:23 a.m. [08:21:41] and the integration-pkgbuilder has Dec. 4, 2019, 11:02 p.m [08:21:51] which sounds like it is from a century ago [08:28:44] stuck in scheduling state for 19 minutes ... [08:31:52] and now DNS has a stuck entry [08:31:53] grr [08:37:53] 10GitLab (Pipeline Services Migration🐀), 06collaboration-services, 06Data-Platform-SRE, 10Wikidata, and 3 others: move commons-query.wikimedia.org and query.wikidata.org to kubernetes - https://phabricator.wikimedia.org/T350793#9984241 (10WMDE-leszek) hello @Jelto, can we go with `repos/wmde/wikidata-query... [08:41:52] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team: Rebuild integration-agent-pkgbuilder-1001 and integration-agent-pkgbuilder-1002 to get rid of Debian Buster - https://phabricator.wikimedia.org/T360786#9984255 (10hashar) I will recreate them using Bullseye which is what is used in production... [08:42:42] (03PS1) 10Arthur taylor: Apply patches in `/cache/patches` during Quibble plan execution [integration/quibble] - 10https://gerrit.wikimedia.org/r/1054492 (https://phabricator.wikimedia.org/T370124) [08:44:17] (03PS2) 10Arthur taylor: Apply patches in `/cache/patches` during Quibble plan execution [integration/quibble] - 10https://gerrit.wikimedia.org/r/1054492 (https://phabricator.wikimedia.org/T370124) [08:46:05] (03CR) 10CI reject: [V:04-1] Apply patches in `/cache/patches` during Quibble plan execution [integration/quibble] - 10https://gerrit.wikimedia.org/r/1054492 (https://phabricator.wikimedia.org/T370124) (owner: 10Arthur taylor) [08:49:06] (03PS3) 10Arthur taylor: Apply patches in `/cache/patches` during Quibble plan execution [integration/quibble] - 10https://gerrit.wikimedia.org/r/1054492 (https://phabricator.wikimedia.org/T370124) [08:51:16] (03CR) 10CI reject: [V:04-1] Apply patches in `/cache/patches` during Quibble plan execution [integration/quibble] - 10https://gerrit.wikimedia.org/r/1054492 (https://phabricator.wikimedia.org/T370124) (owner: 10Arthur taylor) [08:51:20] 06Release-Engineering-Team, 06collaboration-services, 06SRE, 06Traffic, 13Patch-For-Review: implement anti-abuse features for GitLAb (Move GitLab behind the CDN) - https://phabricator.wikimedia.org/T366882#9984285 (10Jelto) [08:53:22] 06Release-Engineering-Team, 06collaboration-services, 06SRE, 06Traffic, 13Patch-For-Review: implement anti-abuse features for GitLAb (Move GitLab behind the CDN) - https://phabricator.wikimedia.org/T366882#9984291 (10Jelto) I migrated the GitLab hosts to nftables which unblocks us using nftables built-in... [08:53:35] 06Release-Engineering-Team, 06collaboration-services, 06SRE, 06Traffic, 13Patch-For-Review: implement anti-abuse features for GitLab (Move GitLab behind the CDN) - https://phabricator.wikimedia.org/T366882#9984292 (10Jelto) [08:54:18] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team: Rebuild integration-agent-pkgbuilder-1001 and integration-agent-pkgbuilder-1002 to get rid of Debian Buster - https://phabricator.wikimedia.org/T360786#9984305 (10hashar) [08:55:55] 06Release-Engineering-Team, 06collaboration-services, 06SRE, 06Traffic, 13Patch-For-Review: implement anti-abuse features for GitLab (Move GitLab behind the CDN) - https://phabricator.wikimedia.org/T366882#9984312 (10Jelto) [08:57:23] (03PS4) 10Arthur taylor: Apply patches in `/cache/patches` during Quibble plan execution [integration/quibble] - 10https://gerrit.wikimedia.org/r/1054492 (https://phabricator.wikimedia.org/T370124) [09:07:25] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team: Rebuild integration-cumin to get rid of Debian Buster - https://phabricator.wikimedia.org/T360784#9984341 (10hashar) I can't rebuild it cause of the Puppet configuration being broken :-/ I will file a task for it. [09:07:56] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for Lakejason0 - https://phabricator.wikimedia.org/T370128 (10Lakejason0) 03NEW [09:09:53] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for Lakejason0 - https://phabricator.wikimedia.org/T370128#9984356 (10Lakejason0) Previously submitted patches to SocialProfile and Comments extensions of MediaWiki on Gerrit [09:17:49] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team: Rebuild integration-agent-pkgbuilder-1001 and integration-agent-pkgbuilder-1002 to get rid of Debian Buster - https://phabricator.wikimedia.org/T360786#9984393 (10hashar) [09:17:50] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team: Rebuild integration-cumin to get rid of Debian Buster - https://phabricator.wikimedia.org/T360784#9984394 (10hashar) [09:24:32] 10GitLab (Pipeline Services Migration🐀), 06collaboration-services, 06Data-Platform-SRE, 10Wikidata, and 3 others: move commons-query.wikimedia.org and query.wikidata.org to kubernetes - https://phabricator.wikimedia.org/T350793#9984396 (10Jelto) Thanks for suggesting a better path, I moved the repository t... [09:24:43] 10GitLab (Pipeline Services Migration🐀), 06collaboration-services, 06Data-Platform-SRE, 10Wikidata, and 3 others: move commons-query.wikimedia.org and query.wikidata.org to kubernetes - https://phabricator.wikimedia.org/T350793#9984397 (10Jelto) [09:38:57] 10GitLab (Pipeline Services Migration🐀), 06collaboration-services, 06Data-Platform-SRE, 10Wikidata, and 3 others: move commons-query.wikimedia.org and query.wikidata.org to kubernetes - https://phabricator.wikimedia.org/T350793#9984441 (10Jelto) [09:39:02] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team: Rebuild integration-cumin to get rid of Debian Buster - https://phabricator.wikimedia.org/T360784#9984444 (10hashar) After fixing the Puppet self setup (T370130) the next breakage is the ssh key pair for cumin: `counterexample Error: /Stage[m... [09:56:49] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for Lakejason0 - https://phabricator.wikimedia.org/T370128#9984503 (10Peachey88) Added to phabricator's #trusted-contributors, Active on mw wiki & skin development. The bot should activate your account in the next hou... [09:56:50] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team: Rebuild integration-cumin to get rid of Debian Buster - https://phabricator.wikimedia.org/T360784#9984504 (10hashar) I think the issue is `profile::openstack::eqiad1::cumin::master` does not have a `secret()` to ship the secrets `files/ssh/cu... [10:30:18] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team: Rebuild integration-cumin to get rid of Debian Buster - https://phabricator.wikimedia.org/T360784#9984638 (10hashar) Filed as T370138 [10:30:24] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team: Rebuild integration-cumin to get rid of Debian Buster - https://phabricator.wikimedia.org/T360784#9984640 (10hashar) [11:29:31] (03PS1) 10Kevin Bazira: inference-services: update outlink_topic_model src path [integration/config] - 10https://gerrit.wikimedia.org/r/1054525 (https://phabricator.wikimedia.org/T369344) [11:32:50] (03PS2) 10Kevin Bazira: inference-services: update outlink_topic_model src path [integration/config] - 10https://gerrit.wikimedia.org/r/1054525 (https://phabricator.wikimedia.org/T369344) [11:53:38] (03CR) 10Ilias Sarantopoulos: [C:03+1] inference-services: update outlink_topic_model src path [integration/config] - 10https://gerrit.wikimedia.org/r/1054525 (https://phabricator.wikimedia.org/T369344) (owner: 10Kevin Bazira) [13:45:47] (03update) 10brennen: merge phorge 2024.19 release into wmf/stable [repos/phabricator/phabricator] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/merge_requests/63 (https://phabricator.wikimedia.org/T368453) [13:46:28] 10Phabricator (phabricator-next), 06Release-Engineering-Team: Deploy Phabricator/Phorge 2024-07-15 - https://phabricator.wikimedia.org/T370109#9985421 (10brennen) 05Openβ†’03In progress p:05Triageβ†’03Medium [13:46:33] (03merge) 10brennen: merge phorge 2024.19 release into wmf/stable [repos/phabricator/phabricator] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/merge_requests/63 (https://phabricator.wikimedia.org/T368453) [13:46:50] 10Beta-Cluster-Infrastructure, 06MediaWiki-Platform-Team, 10MW-1.43-notes (1.43.0-wmf.14; 2024-07-16), 05SUL3: Set up sso.wikimedia.beta.wmflabs.org with config-layer routing to other wikis - https://phabricator.wikimedia.org/T365162#9985443 (10Tgr) Per [[https://gerrit.wikimedia.org/r/c/operations/mediawi... [13:50:16] 10Phabricator (phabricator-next), 06Release-Engineering-Team: Deploy Phabricator/Phorge 2024-07-15 - https://phabricator.wikimedia.org/T370109#9985453 (10brennen) [13:50:21] 10Phabricator, 06Release-Engineering-Team, 13Patch-For-Review: Update to Phorge upstream 2024.19 release - https://phabricator.wikimedia.org/T368453#9985454 (10brennen) [13:51:43] (03open) 10brennen: update submodules for 2024-07-16 release (includes upstream 2024.19) [repos/phabricator/deployment] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/deployment/-/merge_requests/47 (https://phabricator.wikimedia.org/T368453 https://phabricator.wikimedia.org/T370109) [13:55:36] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team: Rebuild integration-cumin to get rid of Debian Buster - https://phabricator.wikimedia.org/T360784#9985487 (10hashar) 05Openβ†’03Resolved I had some trouble with the Puppet self T370130 and to provision Cumin since our Puppet manifest ex... [13:57:03] 10Phabricator, 10Phatality: Phatality submit button gives HTTP 403 error ("Forbidden You don't have permission to access this resource.") - https://phabricator.wikimedia.org/T370160 (10Tgr) 03NEW [13:59:05] 10Phabricator, 10Phatality: Phatality submit button gives HTTP 403 error ("Forbidden You don't have permission to access this resource.") - https://phabricator.wikimedia.org/T370160#9985509 (10Tgr) Specifically, `custom.error.url`. And simpler URL values work, but the one here (`https://tr.wikipedia.org/w/ind... [14:06:10] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10wikimedia.biterg.io: Create account for Levi Ferreira on wikimedia.biterg.io - https://phabricator.wikimedia.org/T370089#9985565 (10Aklapper) 05Openβ†’03Stalled p:05Triageβ†’03Medium a:03Aklapper Requested for user accounts created in Bitergia's non-publ... [14:07:28] 10Phabricator, 10Phatality: Phatality submit button gives HTTP 403 error ("Forbidden You don't have permission to access this resource.") - https://phabricator.wikimedia.org/T370160#9985584 (10Aklapper) [14:08:41] 10Phabricator (phabricator-next), 06Release-Engineering-Team, 13Patch-For-Review: Deploy Phabricator/Phorge 2024-07-16 - https://phabricator.wikimedia.org/T370109#9985591 (10Aklapper) [14:13:46] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Scap: Backport: implement new criteria for relevant dependencies - https://phabricator.wikimedia.org/T365146#9985624 (10jnuche) [14:13:49] 10GitLab (Administration, Settings & Policy), 06Release-Engineering-Team, 06collaboration-services, 06Java-Scala-Standardization, 10Data-Platform-SRE (2024.07.08 - 2024.07.28): Create a Maven package registry in Gitlab - https://phabricator.wikimedia.org/T367322#9985635 (10Gehel) [14:16:56] brennen: question for you ^ [14:17:39] 10GitLab (Administration, Settings & Policy), 06Release-Engineering-Team, 06collaboration-services, 06Java-Scala-Standardization, 10Data-Platform-SRE (2024.07.08 - 2024.07.28): Create a Maven package registry in Gitlab - https://phabricator.wikimedia.org/T367322#9985664 (10Gehel) It seems that the Gitlab... [14:17:40] 10Scap, 13Patch-For-Review: Proposal for refactoring of backport dependency handling - https://phabricator.wikimedia.org/T362987#9985663 (10jnuche) [14:19:42] 10Scap, 13Patch-For-Review: Proposal for refactoring of backport dependency handling - https://phabricator.wikimedia.org/T362987#9985686 (10jnuche) [14:22:35] 10GitLab (Administration, Settings & Policy), 06Release-Engineering-Team, 06collaboration-services, 06Java-Scala-Standardization, 10Data-Platform-SRE (2024.07.08 - 2024.07.28): Create a Maven package registry in Gitlab - https://phabricator.wikimedia.org/T367322#9985707 (10brennen) > does the above sound... [14:34:03] 10Phabricator, 06Release-Engineering-Team, 13Patch-For-Review: Update to Phorge upstream 2024.19 release - https://phabricator.wikimedia.org/T368453#9985896 (10brennen) I've updated https://phabricator.wmcloud.org/ to this release. [14:34:15] 10Phabricator (phabricator-next), 06Release-Engineering-Team, 13Patch-For-Review: Deploy Phabricator/Phorge 2024-07-16 - https://phabricator.wikimedia.org/T370109#9985900 (10brennen) I've updated https://phabricator.wmcloud.org/ to this release. [15:00:22] 10Phabricator: Explore displaying additional info in comment field for open Outreach related tasks - https://phabricator.wikimedia.org/T367500#9986004 (10Aklapper) Uh, very good point, thanks! Could also take age of Phab account into account here - only display if less than two weeks old or such. [15:01:43] 10Phabricator: add to recipients list for quarterly Phabricator metrics - https://phabricator.wikimedia.org/T370167 (10debt) 03NEW [15:02:21] 10Phabricator (phabricator-next), 06Release-Engineering-Team, 13Patch-For-Review: Deploy Phabricator/Phorge 2024-07-16 - https://phabricator.wikimedia.org/T370109#9986036 (10ops-monitoring-bot) Icinga downtime and Alertmanager silence (ID=2b975569-97a1-4cdd-98b8-b56f36d37417) set by jelto@cumin1002 for 0:30:... [15:02:40] (03merge) 10brennen: update submodules for 2024-07-16 release (includes upstream 2024.19) [repos/phabricator/deployment] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/deployment/-/merge_requests/47 (https://phabricator.wikimedia.org/T368453 https://phabricator.wikimedia.org/T370109) [15:02:46] 10Phabricator (phabricator-next), 06Release-Engineering-Team, 13Patch-For-Review: Deploy Phabricator/Phorge 2024-07-16 - https://phabricator.wikimedia.org/T370109#9986037 (10ops-monitoring-bot) Icinga downtime and Alertmanager silence (ID=b992b149-ff4a-434e-8dd6-1052ebe2c70e) set by jelto@cumin1002 for 0:30:... [15:03:18] 10GitLab, 06Release-Engineering-Team, 13Patch-For-Review: Upgrade to buildkit v0.15.0 - https://phabricator.wikimedia.org/T369862#9986010 (10dancy) 05Openβ†’03Resolved p:05Triageβ†’03Medium [15:04:36] 10Phabricator (phabricator-next), 06Release-Engineering-Team, 13Patch-For-Review: Deploy Phabricator/Phorge 2024-07-16 - https://phabricator.wikimedia.org/T370109#9986043 (10ops-monitoring-bot) Icinga downtime and Alertmanager silence (ID=fd09b7fd-9599-4898-ac2b-f9cd87fa3cce) set by jelto@cumin1002 for 0:30:... [15:06:54] (03merge) 10dancy: data-engineering: Allow git-sync image to build on trusted runners [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/91 (https://phabricator.wikimedia.org/T364387 https://phabricator.wikimedia.org/T368033) (owner: 10bking) [15:14:35] 10Phabricator (2024-07-16), 06Release-Engineering-Team: Update to Phorge upstream 2024.19 release - https://phabricator.wikimedia.org/T368453#9986094 (10Aklapper) a:03brennen [15:16:13] 10Phabricator (2024-07-16), 06Release-Engineering-Team, 13Patch-For-Review: Deploy Phabricator/Phorge 2024-07-16 - https://phabricator.wikimedia.org/T370109#9986107 (10Aklapper) a:03brennen [15:19:56] 10Phabricator: Explore displaying additional info in comment field for open Outreach related tasks - https://phabricator.wikimedia.org/T367500#9986136 (10debt) @Aklapper maybe a tag such as "outreachy info" can be used? I'd imagine that tag would only be used for the start of the program cycle (in one or two pha... [15:24:41] 10Phabricator (Upstream), 07Upstream: Disable Audit application in Phabricator - https://phabricator.wikimedia.org/T330794#9986145 (10Aklapper) 05Stalledβ†’03Open This has now become fixable in our instance after today's deployment pulling and deploying the 2024.19 upstream version. [15:24:44] 10Phabricator (Upstream), 07Regression, 07Upstream: PhabricatorDataNotAttachedException when rendering project hovercard with username mentioned in project description - https://phabricator.wikimedia.org/T360530#9986141 (10Aklapper) 05Stalledβ†’03Resolved This should have gotten resolved by today's dep... [15:25:14] 10Phabricator (Upstream), 07Upstream: Allow "lipsum" data generation tool to create projects with empty descriptions - https://phabricator.wikimedia.org/T355966#9986148 (10Aklapper) 05Stalledβ†’03Resolved This should have gotten resolved by today's deployment pulling and deploying the 2024.19 upstream ve... [15:25:53] 10Phabricator (Upstream), 07Upstream: Remove "Action Has No Effect" warning dialog when removing auto assigned user - https://phabricator.wikimedia.org/T337017#9986150 (10Aklapper) 05Stalledβ†’03Resolved This should have gotten resolved by today's deployment pulling and deploying the 2024.19 upstream ver... [15:26:54] 10Phabricator (Upstream), 07Upstream: Exception: Map returned by "newPagingMapFromCursorObject()" in class "ManiphestTaskQuery" omits required key - https://phabricator.wikimedia.org/T344241#9986152 (10Aklapper) 05Stalledβ†’03Resolved This should have gotten resolved by today's deployment pulling and dep... [15:27:05] 10Phabricator (2024-07-16), 06Release-Engineering-Team, 13Patch-For-Review: Deploy Phabricator/Phorge 2024-07-16 - https://phabricator.wikimedia.org/T370109#9986155 (10Aklapper) 05In progressβ†’03Resolved [15:27:07] 10Phabricator (2024-07-16), 06Release-Engineering-Team: Update to Phorge upstream 2024.19 release - https://phabricator.wikimedia.org/T368453#9986156 (10Aklapper) 05Openβ†’03Resolved [15:27:33] (03CR) 10Hashar: "For the simple case of testing a change from Gerrit, one can use `quibble --change`. That can potentially be expanded to support fetching " [integration/quibble] - 10https://gerrit.wikimedia.org/r/1054492 (https://phabricator.wikimedia.org/T370124) (owner: 10Arthur taylor) [15:28:10] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Scap: Backport: implement new criteria for relevant dependencies - https://phabricator.wikimedia.org/T365146#9986170 (10dancy) Regarding: ` # dependencies share the same project project = deps[0].project ` Gerrit doesn't enforce this. The came Change-Id... [15:28:40] 10Phabricator (Upstream), 07Upstream: Address FIXMEs in Phabricator-translations - https://phabricator.wikimedia.org/T365853#9986168 (10Aklapper) 05Openβ†’03Resolved Per last comment, this should have gotten resolved by today's deployment pulling and deploying the 2024.19 upstream version. If not, please... [15:29:03] 10Phabricator (Upstream), 07Upstream: Phabricator-translations should not extract strings from test cases - https://phabricator.wikimedia.org/T363364#9986179 (10Aklapper) For the records, we just pulled and deployed the 2024.19 upstream version in Wikimedia Phabricator. [15:29:13] 10Phabricator (Upstream), 07Upstream: Phabricator-translations should not extract strings from test cases - https://phabricator.wikimedia.org/T363364#9986171 (10Pppery) 05Openβ†’03Resolved Updating the rPHTR repo with the new code will be tracked in T363188 [15:30:03] 10Phabricator, 10Wikimedia-Phabricator-Extensions: Update phabricator-translations for 2024.19 release - https://phabricator.wikimedia.org/T363188#9986189 (10Pppery) 05Stalledβ†’03Open [15:30:14] 10Phabricator (Upstream), 07Upstream: Address FIXMEs in Phabricator-translations - https://phabricator.wikimedia.org/T365853#9986184 (10Pppery) 05Resolvedβ†’03Open This should be left open until someone actually runs the export script again (T363188). I plan to do that later today. [15:30:46] 10Phabricator, 10Wikimedia-Phabricator-Extensions: Update phabricator-translations for 2024.19 release - https://phabricator.wikimedia.org/T363188#9986190 (10Pppery) [15:35:11] πŸ€„οΈŽ πŸ€… πŸ€† [15:35:26] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Scap: Backport: implement new criteria for relevant dependencies - https://phabricator.wikimedia.org/T365146#9986237 (10dancy) [15:35:28] 10Phabricator (Upstream), 07Upstream: Disable Audit application in Phabricator - https://phabricator.wikimedia.org/T330794#9986238 (10Aklapper) [15:35:37] 06Release-Engineering-Team, 10Data Pipelines, 06Data-Engineering, 10Data-Platform-SRE (2024.07.08 - 2024.07.28), 13Patch-For-Review: Upgrade Airflow to 2.9.3 - https://phabricator.wikimedia.org/T365449#9986240 (10BTullis) [15:35:38] ^^ disregard the mahjong tiles (sorry) [15:47:18] (03open) 10aklapper: Uninstall Audit application [repos/phabricator/deployment] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/deployment/-/merge_requests/48 (https://phabricator.wikimedia.org/T330794) [15:48:13] did something just change with fonts on phabricator? [15:49:32] 10Phabricator (Upstream), 13Patch-For-Review, 07Upstream: Disable Audit application in Phabricator - https://phabricator.wikimedia.org/T330794#9986377 (10Aklapper) [15:50:05] cdanis, yes [15:50:49] https://i.imgur.com/aVZwJM8.png [15:52:17] ah, I think the issue is actually with my fontconfig [15:53:28] imgur.com is that website where I have to click too many switches in the "Manage Options" cookie dialog as it offers no "Reject all" button... :-/ [15:53:42] sorry, it's what glowing-bear defaults to for its paste handler [15:53:58] andre: https://phabricator.wikimedia.org/F56463403 [15:54:00] cdanis: that looks like T369615 [15:54:00] hehe [15:54:00] T369615: Order of fonts in fonts-family breaks text on firefox linux (large spaces and emoji numbers) - https://phabricator.wikimedia.org/T369615 [15:54:10] urgh that does look ugly indeed [15:54:25] (I also thought I noticed a slight font change ~30 minutes ago but for me the spaces are still fine, so I guess my fontconfig is different) [15:54:28] that looks like exactly my issue Lucas_WMDE [15:54:43] I can also verify that if I restore `system-ui` to the front of the font family list in browser devtools, it looks like what I'm used to [15:55:33] ('restore' judging from https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/merge_requests/63/diffs#0bf75226fed015804df59fcef2a5e34c0df4b673 ) [15:55:39] Yes, we just pulled recent upstream into Phabricator and they had reverted font changes in upstream - https://we.phorge.it/T15630 [15:56:24] right [16:00:22] 10Phabricator (Upstream), 07Upstream: "Uncaught TypeError: spec is undefined" for hovercards in Aphront notifications - https://phabricator.wikimedia.org/T366118#9986418 (10Aklapper) 05Stalledβ†’03Open Still happens after the 2024.19 deployment. [16:00:38] sigh, I'm *not* doing the same fontconfig thing as the other reporter [16:04:30] 10Phabricator, 13Patch-For-Review: add to recipients list for quarterly Phabricator metrics - https://phabricator.wikimedia.org/T370167#9986458 (10Aklapper) p:05Triageβ†’03Low a:03Aklapper [16:04:34] ah, *this* stanza was my issue: [16:04:35] [16:04:37] Segoe UI Emoji [16:04:39] Noto Color Emoji [16:04:41] emoji [16:04:43] [16:06:34] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Scap: Backport: implement new criteria for relevant dependencies - https://phabricator.wikimedia.org/T365146#9986473 (10hashar) >>! In T365146#9986170, @dancy wrote: > Regarding: > ` > # dependencies share the same project > project = deps[0].project > `... [16:07:12] (03CR) 10Hashar: [C:03+2] Archive libvmod-querysort [integration/config] - 10https://gerrit.wikimedia.org/r/1054408 (https://phabricator.wikimedia.org/T347623) (owner: 10BCornwall) [16:07:48] (03CR) 10Hashar: [C:03+2] inference-services: update outlink_topic_model src path [integration/config] - 10https://gerrit.wikimedia.org/r/1054525 (https://phabricator.wikimedia.org/T369344) (owner: 10Kevin Bazira) [16:08:23] (03Merged) 10jenkins-bot: Archive libvmod-querysort [integration/config] - 10https://gerrit.wikimedia.org/r/1054408 (https://phabricator.wikimedia.org/T347623) (owner: 10BCornwall) [16:09:13] (03Merged) 10jenkins-bot: inference-services: update outlink_topic_model src path [integration/config] - 10https://gerrit.wikimedia.org/r/1054525 (https://phabricator.wikimedia.org/T369344) (owner: 10Kevin Bazira) [16:10:19] (03CR) 10Hashar: [C:03+2] "Deployed!" [integration/config] - 10https://gerrit.wikimedia.org/r/1054525 (https://phabricator.wikimedia.org/T369344) (owner: 10Kevin Bazira) [16:13:49] 10GitLab (Project Migration), 06Traffic, 13Patch-For-Review: Migrate Traffic repositories from Gerrit to Gitlab - https://phabricator.wikimedia.org/T347623#9986510 (10hashar) [16:15:33] 10GitLab (Project Migration), 06Traffic, 13Patch-For-Review: Migrate Traffic repositories from Gerrit to Gitlab - https://phabricator.wikimedia.org/T347623#9986517 (10hashar) I have marked https://gerrit.wikimedia.org/r/admin/repos/operations/software/varnish/libvmod-querysort,general read-only in Gerrit [16:19:42] (03PS6) 10Pppery: Zuul: [mediawiki/extensions/CollaborationKit] Mark as archived [integration/config] - 10https://gerrit.wikimedia.org/r/1053960 (https://phabricator.wikimedia.org/T368092) [16:24:35] 14Phabricator (2024-01-16): Remove unused code in Diffusion to handle closed almanac cluster services - https://phabricator.wikimedia.org/T352530#9986590 (10Aklapper) 05Resolvedβ†’03Declined FYI this was reverted in T355644 [16:42:26] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Scap: Backport: implement new criteria for relevant dependencies - https://phabricator.wikimedia.org/T365146#9986731 (10jeena) ` if dep is not None: vote_on_change(change, dep) if dep.project in config_repos: boun... [16:43:06] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Scap: Backport: implement new criteria for relevant dependencies - https://phabricator.wikimedia.org/T365146#9986738 (10jeena) >>! In T365146#9986170, @dancy wrote: > Regarding: > ` > # dependencies share the same project > project = deps[0].project > ` >... [16:47:01] 10GitLab (Administration, Settings & Policy), 06Release-Engineering-Team, 06collaboration-services, 06Java-Scala-Standardization, 10Data-Platform-SRE (2024.07.08 - 2024.07.28): Create a Maven package registry in Gitlab - https://phabricator.wikimedia.org/T367322#9986755 (10Ottomata) > Things currently in... [16:47:06] 10GitLab (Administration, Settings & Policy), 06Release-Engineering-Team, 06collaboration-services, 06Java-Scala-Standardization, 10Data-Platform-SRE (2024.07.08 - 2024.07.28): Create a Maven package registry in Gitlab - https://phabricator.wikimedia.org/T367322#9986757 (10Ottomata) > * create a specific... [17:01:50] 10Beta-Cluster-Infrastructure, 06MediaWiki-Platform-Team, 10MW-1.43-notes (1.43.0-wmf.14; 2024-07-16), 05SUL3: Set up sso.wikimedia.beta.wmflabs.org with config-layer routing to other wikis - https://phabricator.wikimedia.org/T365162#9986839 (10Tgr) FIXMEs from {925a6ff9b95f98b2a365167244ce4060df08ddeb} th... [17:26:02] 10Phabricator: Update recipients list for quarterly Phabricator metrics - https://phabricator.wikimedia.org/T370167#9986946 (10Aklapper) [17:26:14] 10Phabricator: Update recipients list for quarterly Phabricator metrics - https://phabricator.wikimedia.org/T370167#9986947 (10Aklapper) [17:27:00] 10Phabricator: Update recipients list for quarterly Phabricator metrics - https://phabricator.wikimedia.org/T370167#9986943 (10Aklapper) 05Openβ†’03Resolved This is deployed; on Sep30/Oct01 (depending on timezone) @debt should receive the quarterly summary email and @Maryann-Onyinye should not anymore. [17:42:29] 10GitLab (Project Migration), 10MediaWiki-Codesniffer, 10MinusX, 10phan, and 3 others: Consolidate all Wikimedia CI tools into a single Wikimedia GitLab project group - https://phabricator.wikimedia.org/T334615#9987005 (10Krinkle) [17:43:08] 10GitLab (Project Migration), 10MediaWiki-Codesniffer, 10MinusX, 10phan, and 3 others: Consolidate all Wikimedia CI tools into a single Wikimedia GitLab project group - https://phabricator.wikimedia.org/T334615#9987007 (10Krinkle) [17:43:30] 10GitLab (Project Migration), 10MediaWiki-Codesniffer, 10MinusX, 10phan, and 3 others: Consolidate all Wikimedia CI tools into a single Wikimedia GitLab project group - https://phabricator.wikimedia.org/T334615#9987013 (10Krinkle) Keeping any MediaWiki-adjacent work in our team on Gerrit for now. [17:51:24] (03open) 10dancy: Release 4.92.0-1 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/380 [17:53:11] (03merge) 10dancy: Release 4.92.0-1 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/380 [18:03:02] 10GitLab (Administration, Settings & Policy), 06Release-Engineering-Team, 06collaboration-services, 06Java-Scala-Standardization, 10Data-Platform-SRE (2024.07.08 - 2024.07.28): Create a Maven package registry in Gitlab - https://phabricator.wikimedia.org/T367322#9987048 (10brennen) > +1. Can we consider... [18:21:13] 10Diffusion, 10Phabricator, 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review: Make https://git.wikimedia.org not redirect to Phabricator Diffusion - https://phabricator.wikimedia.org/T323073#9987138 (10Dzahn) Technically this ticket is resolved - though there will be some clean-up... [18:29:29] (03PS3) 10Snwachukwu: Edit Repo Config [node-rdkafka-factory] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1054632 [18:37:55] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 06collaboration-services, 06Java-Scala-Standardization, 10Data-Platform-SRE (2024.07.08 - 2024.07.28): Create a Maven package registry in Gitlab - https://phabricator.wikimedia.org/T367322#9987264 (10brennen) [18:38:26] 10Release-Engineering-Team (Radar), 06collaboration-services, 06SRE, 06Traffic, 13Patch-For-Review: implement anti-abuse features for GitLab (Move GitLab behind the CDN) - https://phabricator.wikimedia.org/T366882#9987283 (10brennen) [18:39:15] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10dev-images, 10MediaWiki-Docker: APT errors when installing custom packages in MediaWiki-Docker - https://phabricator.wikimedia.org/T362702#9987289 (10brennen) [18:42:57] 10Release-Engineering-Team (Yak Shaving πŸƒπŸͺ’), 10Scap: scap: Please provide a subcommand to deploy a new security patch in scap itself - https://phabricator.wikimedia.org/T361709#9987311 (10brennen) This seems like a fine idea, and pretty self-contained. Throwing this on our yak shaving board so maybe we notice... [18:43:53] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Radar), 06collaboration-services: Decommission integration.mediawiki.org - https://phabricator.wikimedia.org/T361250#9987333 (10brennen) [18:52:20] 10MediaWiki-Releasing, 10Release-Engineering-Team (Seen), 10MediaWiki-General: Use semantic(-ish) versioning for MediaWiki by dropping the "1." part of the version number - https://phabricator.wikimedia.org/T336128#9987378 (10brennen) [18:53:16] 10GitLab (Misc), 10Release-Engineering-Team (Radar), 10mwbot-rs: GitLab "An error occurred while merging. Try again." but unable to try again - https://phabricator.wikimedia.org/T332528#9987383 (10brennen) [18:54:15] 10GitLab (Upstream pit of despair πŸ•³οΈ), 10Release-Engineering-Team (Radar), 07Upstream: Gitlab message after push point to a 404 merge request URL when not logged in - https://phabricator.wikimedia.org/T324262#9987385 (10brennen) [18:55:42] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 06collaboration-services: Define GitLab API access for system users - https://phabricator.wikimedia.org/T324008#9987387 (10brennen) [19:01:03] 10Diffusion, 10Phabricator, 10Release-Engineering-Team (Radar), 06collaboration-services, 13Patch-For-Review: Make https://git.wikimedia.org not redirect to Phabricator Diffusion - https://phabricator.wikimedia.org/T323073#9987422 (10brennen) [19:04:15] 10Phabricator (Upstream), 07Upstream: "Uncaught TypeError: spec is undefined" for hovercards in Aphront notifications - https://phabricator.wikimedia.org/T366118#9987448 (10Aklapper) In https://we.phorge.it/source/phorge/browse/master/webroot/rsrc/js/core/behavior-hovercard.js$34 , `var node = e.getNode('hover... [19:04:27] 10Phabricator (Upstream), 07Upstream: "Uncaught TypeError: spec is undefined" for hovercards in Aphront notifications - https://phabricator.wikimedia.org/T366118#9987449 (10Aklapper) p:05Triageβ†’03Low [19:10:57] 10Phabricator (Upstream), 07Upstream: "Uncaught TypeError: spec is undefined" for hovercards in Aphront notifications - https://phabricator.wikimedia.org/T366118#9987482 (10Aklapper) [19:11:09] 10Phabricator (Upstream), 07Upstream: "Uncaught TypeError: spec is undefined" for hovercards in Aphlict notifications - https://phabricator.wikimedia.org/T366118#9987483 (10Aklapper) [20:09:39] (03PS2) 10RhinosF1: layout: add Seawolf35 [integration/config] - 10https://gerrit.wikimedia.org/r/1054657 [20:14:34] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 06serviceops, 06SRE, and 2 others: Spin down api_appserver and appserver clusters - https://phabricator.wikimedia.org/T367949#9987802 (10Scott_French) Current status: * appservers-rw and api-rw are depooled everywhere, and resolve to failoid as of 17:45 UTC *... [20:14:52] 06Project-Admins, 06Data Products, 06GLAM: Create project tag for - https://phabricator.wikimedia.org/T369386#9987817 (10GFontenelle_WMF) 05Resolvedβ†’03Open Hey @Aklapper! I have a problem and I believe you might be the person I need... I'm so sorry for this, but is the... [20:24:55] 06Project-Admins, 06Data Products, 06GLAM: Create project tag for  - https://phabricator.wikimedia.org/T369386#9987836 (10Aklapper) 05Openβ†’03Resolved @GFontenelle_WMF: Hej, no problem, I added you to I added you to #Trusted-Contributors so you should be able to edit... [20:30:02] (03CR) 10Ottomata: [C:03+2] Edit Repo Config [node-rdkafka-factory] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1054632 (owner: 10Snwachukwu) [20:30:04] (03CR) 10Ottomata: [V:03+2 C:03+2] Edit Repo Config [node-rdkafka-factory] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1054632 (owner: 10Snwachukwu) [20:39:36] 06Project-Admins, 06Data Products, 06GLAM: Create project tag for  - https://phabricator.wikimedia.org/T369386#9987939 (10GFontenelle_WMF) This is perfect. I already changed it. Thank you so much, @Aklapper! [20:42:32] 10Release-Engineering-Team (Radar), 06Java-Scala-Standardization, 10Data-Platform-SRE (2024.07.08 - 2024.07.28): Setup a test project to validate upload to the Gitlab package registry - https://phabricator.wikimedia.org/T367391#9987955 (10brennen) [20:43:40] 10Beta-Cluster-Infrastructure, 06MediaWiki-Platform-Team, 10MW-1.43-notes (1.43.0-wmf.14; 2024-07-16), 05SUL3: Set up sso.wikimedia.beta.wmflabs.org with config-layer routing to other wikis - https://phabricator.wikimedia.org/T365162#9987956 (10Tgr) Harmless but weird: API parameter checks run before ApiCh... [20:44:27] 10Beta-Cluster-Infrastructure, 06MediaWiki-Platform-Team, 10MW-1.43-notes (1.43.0-wmf.14; 2024-07-16), 05SUL3: Set up sso.wikimedia.beta.wmflabs.org with config-layer routing to other wikis - https://phabricator.wikimedia.org/T365162#9987957 (10Tgr) [20:48:02] 10GitLab (Project Migration), 06Release-Engineering-Team: Create new GitLab project group: Moderator Tools - https://phabricator.wikimedia.org/T367885#9987994 (10brennen) 05Openβ†’03Resolved a:03brennen Created: https://gitlab.wikimedia.org/repos/modtools Added all users from list as owners. [20:52:53] 10GitLab (Project Migration), 06Release-Engineering-Team: Create new GitLab project group: wikidata-quality-tools - https://phabricator.wikimedia.org/T359170#9988010 (10brennen) 05Openβ†’03Resolved a:03brennen A group exists, but please re-open if you'd prefer a top-level group in `/repos` or elsewhere... [21:10:17] 10Beta-Cluster-Infrastructure, 06MediaWiki-Platform-Team, 10MW-1.43-notes (1.43.0-wmf.14; 2024-07-16), 05SUL3: Set up sso.wikimedia.beta.wmflabs.org with config-layer routing to other wikis - https://phabricator.wikimedia.org/T365162#9988098 (10Tgr) * Logging in works but results in an error page "The prov... [21:17:05] 10Scap: "testwikis wikis" in scap commit message is unclear - https://phabricator.wikimedia.org/T370220 (10Pppery) 03NEW [21:19:41] 10Scap: "testwikis wikis" in train commit message is poorly worded - https://phabricator.wikimedia.org/T370220#9988158 (10Pppery) [21:20:43] 10GitLab (Project Migration), 10MediaWiki-Codesniffer, 10MinusX, 10phan, and 3 others: Consolidate all Wikimedia CI tools into a single Wikimedia GitLab project group - https://phabricator.wikimedia.org/T334615#9988163 (10DannyS712) Can we please also keep codesniffer on gerrit, so that existing contributo... [21:27:12] 10Phabricator (2024-07-16), 07Regression, 07Upstream: PhabricatorDataNotAttachedException in PhabricatorRepositoryCommit (via getRepository()) - https://phabricator.wikimedia.org/T360714#9988168 (10Aklapper) 05Stalledβ†’03Resolved Optimistically resolving after today's deployment - I cannot find any oc... [21:31:34] 10GitLab (Project Migration), 06Release-Engineering-Team, 07Epic: Migrate mediawiki/ namespace from Gerrit to GitLab - https://phabricator.wikimedia.org/T335921#9988173 (10brennen) 05In progressβ†’03Stalled https://www.mediawiki.org/wiki/GitLab/Migration_status > TL;DR On 2024-06-24 a decision to continue... [21:35:07] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for Lakejason0 - https://phabricator.wikimedia.org/T370128#9988189 (10brennen) 05Openβ†’03Resolved [21:35:15] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for Lakejason0 - https://phabricator.wikimedia.org/T370128#9988191 (10brennen) a:03Peachey88 [21:37:46] 10Continuous-Integration-Config, 06Discovery-Portal-Backlog, 10Wikimedia-Portals: Set up proper CI structure on wikimedia/portals - https://phabricator.wikimedia.org/T116450#9988194 (10Pppery) 05Openβ†’03Resolved This appears to be done; https://gerrit.wikimedia.org/r/c/wikimedia/portals shows it has C... [21:39:14] dancy: https://phabricator.wikimedia.org/T370219 might be a blocker (and Nikerabbit is on vacation) [21:42:02] 06Project-Admins: Consider archiving #discovery-portal-backlog, #discovery-portal-sprint - https://phabricator.wikimedia.org/T370222#9988247 (10Pppery) [21:47:09] 06Project-Admins, 06Discovery-Search: Consider archiving #discovery-portal-backlog, #discovery-portal-sprint - https://phabricator.wikimedia.org/T370222#9988269 (10Aklapper) Could also be useful to hear from #discovery-search how much the description on https://phabricator.wikimedia.org/project/manage/1899/ is... [21:54:29] andre: Thanks. Taking a look [21:55:02] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team (Priority Backlog πŸ“₯): Enable parse_ci_job_timestamps in gitlab-settings and document use of FF_TIMESTAMPS in GitLab CI - https://phabricator.wikimedia.org/T367765#9988283 (10brennen) [21:55:27] 10Release-Engineering-Team (Seen), 10Data Pipelines, 06Data-Engineering, 10Data-Platform-SRE (2024.07.08 - 2024.07.28), 13Patch-For-Review: Upgrade Airflow to 2.9.3 - https://phabricator.wikimedia.org/T365449#9988287 (10brennen) [21:55:50] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 05Release, 05Train Deployments: 1.43.0-wmf.14 deployment blockers - https://phabricator.wikimedia.org/T366959#9988288 (10dancy) [22:10:00] andre: I added that task as a blocker and sent out a plea for help. [22:10:39] thanks [22:19:10] (03CR) 10Seawolf35gerrit: "Just to note, I lost access to my previous gerrit account, (Seawolf35), which I had a few easy patches merged on." [integration/config] - 10https://gerrit.wikimedia.org/r/1054657 (owner: 10RhinosF1)