[05:54:24] 10Phabricator: Change my Phabricator username to Evrifaessa - https://phabricator.wikimedia.org/T260510 (10Yagizhan49) [07:35:51] (03PS1) 10Legoktm: make-release: Build tarballs in GNU format [tools/release] - 10https://gerrit.wikimedia.org/r/620647 (https://phabricator.wikimedia.org/T257102) [07:37:51] (03PS2) 10Legoktm: make-release: Build tarballs in GNU format [tools/release] - 10https://gerrit.wikimedia.org/r/620647 (https://phabricator.wikimedia.org/T257102) [07:57:22] s/add/ask/ [08:02:16] Evrifaessa: I wonder if it's better to add you to the whitelist if you're gonna do changes often [08:02:36] allowlist* [08:08:24] uh [08:08:29] should I make changes less often? [08:08:41] I was just trying to resolve tasks in Phabricator [08:08:43] Evrifaessa: no, make them as much as you want! [08:08:52] It'll make it faster for you as well [08:09:31] already made the required changes for 5 tasks, I have 5 deploys scheduled for today in the European mid-day backport window [08:09:40] Nice! [08:10:09] so eh, if you think I qualify for the allowlist, I'd like to get my commits verified automatically by jenkins-bot [08:10:38] I don't see why not. [08:10:57] so how do I apply for that? [08:11:05] You ask in here [08:11:19] okay, could you please add me to the allowlist? [08:11:57] I can do the patch in a few minutes. Someone else will have to merge [08:12:07] alright, thanks :) [08:13:22] * RhinosF1 wonders what legoktm thinks seen as he can merge that [08:14:08] RhinosF1: huh? [08:14:32] legoktm: the zuul auto run list [08:15:05] I mean, what patch? [08:16:08] legoktm: I'm about to do it but I wonder if you thought Evrifaessa would be okay [08:16:23] They seem to be doing fine MediaWiki-config patches [08:16:48] if I don't qualify for it yet, just don't add me. that won't be a matter for me. [08:17:14] * RhinosF1 just wants to double check [08:17:31] Probably, the bar is pretty low [08:18:31] Will write the patch in a bit then [08:28:26] PROBLEM - Host deployment-changeprop is DOWN: CRITICAL - Host Unreachable (172.16.5.21) [08:28:26] PROBLEM - Host deployment-cpjobqueue is DOWN: CRITICAL - Host Unreachable (172.16.4.124) [08:28:26] PROBLEM - Host deployment-chromium02 is DOWN: CRITICAL - Host Unreachable (172.16.4.14) [08:28:32] (03PS1) 10RhinosF1: Add Evrifaessa to jenkins/zuul allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/620666 [08:31:41] (03PS2) 10RhinosF1: Add Evrifaessa to jenkins/zuul allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/620666 [08:32:14] legoktm: ^ [08:32:39] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10Operations, 10Patch-For-Review: The python-build images regenerate wheels even when matching ones are already available - https://phabricator.wikimedia.org/T259611 (10fgiunchedi... [08:34:50] ack, I'll take a look later [11:00:37] PROBLEM - Host deployment-mcs01 is DOWN: CRITICAL - Host Unreachable (172.16.5.64) [11:21:41] (03PS3) 10Hashar: dockerfiles: drop backports, add git proto v2 to ci-stretch [integration/config] - 10https://gerrit.wikimedia.org/r/611181 (https://phabricator.wikimedia.org/T256844) [11:24:24] (03CR) 10Hashar: [C: 03+2] dockerfiles: drop backports, add git proto v2 to ci-stretch (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/611181 (https://phabricator.wikimedia.org/T256844) (owner: 10Hashar) [11:25:20] (03Merged) 10jenkins-bot: dockerfiles: drop backports, add git proto v2 to ci-stretch [integration/config] - 10https://gerrit.wikimedia.org/r/611181 (https://phabricator.wikimedia.org/T256844) (owner: 10Hashar) [11:29:03] hashar: If you're re-building ci-stretch, aren't you going to bump every other image? [11:29:16] hashar: Or are the changes just going to happen as surprises the next time they're re-built? ;-) [11:29:17] sadly yes :( [11:29:41] some child images might depends on stretch-backports though [11:29:45] (This is why I wanted that one image to descend from ci-stretch, not wikimedia-strech, BTW. ;-P) [11:29:49] Yeah, no doubt. [11:33:15] anyway I wanted to close some related task to keep track of the progress [11:33:22] Ack [11:33:24] my sessions are all logged out for some reason [11:33:34] and now I am trying to setup two factor auth again [11:33:36] Phab? Gerrit? Wikis? [11:33:45] cause the tokens are on my old phone and its battery is drained bah [11:33:54] yeah phab/gerrit/wiki pretty much everything [11:33:57] Ah, yeah, that sucks. [11:34:03] which well [11:34:13] kind of force me to finally retrieve those tokens :] [11:34:21] I have changed phone in December.. so that is over due [11:34:27] :-) [11:51:21] 10Phabricator: Phabricator: "500 Internal Server Error" when using VPN (due to specific IP range) - https://phabricator.wikimedia.org/T258059 (10NicoV) 05Open→03Resolved a:03NicoV @Aklapper It seems to work now, thanks ! [11:55:25] 10Phabricator: Change my Phabricator username to Evrifaessa - https://phabricator.wikimedia.org/T260510 (10Aklapper) 05Open→03Resolved a:03Aklapper Sure - done! :) [12:01:25] 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), 10Acme-chief, 10Patch-For-Review: Change CI image for acme-chief from Stretch to Buster - https://phabricator.wikimedia.org/T257456 (10hashar) 05Open→03Resolved a:03hashar That is effe... [12:15:03] (03PS1) 10Hashar: dockerfiles: rebuild all ci-stretch child images [integration/config] - 10https://gerrit.wikimedia.org/r/620696 (https://phabricator.wikimedia.org/T256844) [12:15:08] James_F: eventually ^^^ :] [12:15:17] which would rebuild the fleet [12:17:57] Yea. [12:24:21] (03CR) 10Hashar: [C: 03+2] dockerfiles: rebuild all ci-stretch child images [integration/config] - 10https://gerrit.wikimedia.org/r/620696 (https://phabricator.wikimedia.org/T256844) (owner: 10Hashar) [12:25:30] (03Merged) 10jenkins-bot: dockerfiles: rebuild all ci-stretch child images [integration/config] - 10https://gerrit.wikimedia.org/r/620696 (https://phabricator.wikimedia.org/T256844) (owner: 10Hashar) [12:28:16] that is going to take a while [12:36:32] Indeed. [12:38:09] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), 10Scap, 10MediaWiki Train Development Environment, and 3 others: Try "deploy-promote testwikis" in train-dev, document what seems to be missing - https://phabricator.wikimedia.org/T260376 (10La... [14:42:29] grr [14:42:33] half of them exploded bah [14:43:00] Unexpected error building image docker-registry.discovery.wmnet/releng/typos:0.0.3-s2: [14:43:01] :) [14:54:20] (03PS1) 10Hashar: dockerfiles: fix typos image [integration/config] - 10https://gerrit.wikimedia.org/r/620715 [14:54:46] (03CR) 10Hashar: [C: 03+2] dockerfiles: fix typos image [integration/config] - 10https://gerrit.wikimedia.org/r/620715 (owner: 10Hashar) [14:54:59] bah just one [14:55:46] (03Merged) 10jenkins-bot: dockerfiles: fix typos image [integration/config] - 10https://gerrit.wikimedia.org/r/620715 (owner: 10Hashar) [15:16:55] !log Build new CI images for https://gerrit.wikimedia.org/r/c/integration/config/+/620696 (git v2 T256844 / drop stretch-backports T257327 ) [15:16:58] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:16:58] T256844: Update Stretch CI containers to use a git that supports protocol v2 - https://phabricator.wikimedia.org/T256844 [15:16:59] T257327: Rebuild wikimedia-stretch for repository updates - https://phabricator.wikimedia.org/T257327 [15:17:13] Let's hope that not everything blows up. [15:17:20] !log Rebuild CI image releng/typos due to a build failure in previous change. https://gerrit.wikimedia.org/r/c/integration/config/+/620715 [15:17:21] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:17:23] James_F: ;] [15:17:35] such a pity cause I worked on that early july [15:17:58] the thing is that the newer git might break some stuff here and there [15:18:11] one we found out is that previously git fetch --tags would magically update a local tag [15:18:24] * James_F nods [15:18:26] while the newer git would bails out (that now has to be forced to allow the local update: git fetch --force --tags ) [15:18:33] Right. [15:33:25] (03PS1) 10Hashar: fab: tail docker-pkg-build log [integration/config] - 10https://gerrit.wikimedia.org/r/620721 [15:34:01] (03CR) 10Hashar: [C: 04-1] "Just a proof of concept for now." [integration/config] - 10https://gerrit.wikimedia.org/r/620721 (owner: 10Hashar) [15:36:03] 10Beta-Cluster-Infrastructure, 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban: [beta] EventLogging trying to fetch wrong Schema title - https://phabricator.wikimedia.org/T254058 (10Ottomata) 05Open→03Declined Closing for now, re-open if this is still happening. [15:36:32] I am not sure what is going on [15:36:42] apparently docker-pkg rebuilds everything again :-\ [15:43:10] !log restarting releases-jenkins after plugin update [15:43:18] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:45:34] Just in case anyone here is getting value from shinken alerts: I'm about to delete the shinken project. LMK if you're interested in getting emails from the shinken replacement. [15:50:25] andrewbogott: indeed, I think we would be, particularly for the integration project [15:51:13] 10Scap, 10Operations, 10Wikidata, 10Wikidata-Query-Service, 10Discovery-Search (Current work): Scap configuration for WDQS should get server groups from a known source or truth - https://phabricator.wikimedia.org/T252124 (10Gehel) [15:52:14] kostajh: sounds like it would be nice to have that as a seperate mediawiki maint script :) [15:52:20] but I'll add a hack for now and file a ticket [15:56:48] thcipriani: bd808 is probably the one to talk with about that, although Nicholas might also be interested. Sorry if I killed off prometheus prematurely — it was strictly a source of meaningless noise for our team so I assumed that was true for all subscribers :) [15:56:54] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Analytics, 10Analytics-Kanban, 10Event-Platform: Set up Jenkins maven release job for wikimedia-event-utilities like analytics/refinery/source - https://phabricator.wikimedia.org/T259898 (10Ottomata) a:05Ottomata→03... [15:58:50] (balloons == Nicholas, he's the new manager of WMCS) [15:59:01] * balloons waves! [15:59:52] balloons: welcome :) [16:01:38] shinken definitely got noisy for us and it's not something we're relying on heavily, but there is signal there for the integration project. we were mulling over tuning disk alerts recently, so if there's a replacement we'd probably be interested in setting up alerts for the integration project [16:14:07] So I just made a new tab panel, and accidentally linked a new tab in the panel to itself rather than the query panel of the same name. Phabricator is very amusing: "Exception: You wake in a twisting maze of mirrors, all alike. You are likely to be eaten by a graph cycle. Should you escape alive, you resolve to be more carevul about putting dashboard panels inside themselves." [16:16:51] does phab have a typo ("carevul") or did you make it when manually copying the error? [16:18:59] Majavah: where? :-) [16:19:09] See rob's last line [16:19:34] i manually typed it [16:19:34] hehehe [16:19:41] so typos are on me, not phab [16:19:48] aww [16:19:53] but i was so amused by it [16:19:56] had to share [16:19:57] so we can't make a joke about how you should use srs biznes mode? [16:20:08] nah i wasnt careVul [16:20:13] phab was [16:20:30] or be more cofveve [16:20:52] covfefe* [16:22:43] hello everyone [16:23:19] I tried to make a commit in pywikibot/core to add lldwiki to pywikibot, but it seems like i don't have permissions to push to pywikibot/core [16:23:53] so um, I was told that I need to contact an administrator to fix the permissions [16:23:56] any admins here? [16:24:09] please see https://www.mediawiki.org/wiki/Gerrit/Privilege_policy#Requesting_Gerrit_privileges [16:24:41] Evrifaessa: what command are you using to push your changes to gerrit? [16:24:59] "git push origin master" ? [16:25:14] <_joe_> that's... not how you submit a gerrit change for review [16:25:24] oh wait [16:25:35] git push origin HEAD:refs/for/master [16:25:36] this one [16:25:48] bruh it now works. [16:25:53] how stupid of me -.- [16:26:28] see https://www.mediawiki.org/wiki/Gerrit/Tutorial/tl;dr for the future, you should be using git-review [16:27:09] robh: yep, Phab has some funny error messages; like "return to chartered waters" etc. [16:27:32] Evrifaessa: just creating new commits in master and submitting them in Gerrit might work sometimes but when you're doing anything more complicated it might cause problems [16:27:53] see the link above, in short do your patches in branches and then submit them to gerrit using `git-review` [16:28:02] alright [16:28:03] thanks [16:28:34] so, can someone run the jenkins thingy in this? : https://gerrit.wikimedia.org/r/c/pywikibot/core/+/620735/ [16:28:54] done [16:29:08] also you don't need to add your own CR+1 to your own patches [16:29:20] uh, okay [16:31:36] is merging being automatically done by bots? or should i wait for someone to merge it? [16:31:48] no, you need to get a human to review it [16:32:05] okay. can you review it? [16:32:33] I don't have access to +2 (=merge) pywikibot patches [16:32:43] oh, okay [16:32:47] the pywikibot phabricator board (https://phabricator.wikimedia.org/tag/pywikibot/) has a column "needs review" [16:33:01] you could try moving the phabricator ticket you're working on to that column [16:33:06] i moved it there, thanks [16:33:44] let's hope pywikibot folks monitor that column [16:34:03] if they don't do that in couple of days, ask someone somewhere and we'll figure out a way to contact them [16:34:26] * hauskatze has +2 on pywikibot [16:34:38] but I only do i18n stuff [16:35:06] wow, there are 126 tasks needing review [16:35:14] hauskatze: it's just adding a new language [16:35:19] https://gerrit.wikimedia.org/r/c/pywikibot/core/+/620735/ [16:36:24] Oh, I may be able to take a look [16:36:33] but first thing first [16:36:35] coffee [16:38:51] in principle it looks good [16:39:48] yay [16:40:10] I need to see if the sort order is right [17:05:30] !log docker-pkg still running on contint2001, busy rebuilding ci-stretch based images :-\ [17:05:32] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:34:11] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10Operations, 10Jenkins: Review process to fetch Jenkins Debian package from upstream - https://phabricator.wikimedia.org/T260282 (10greg) [18:36:54] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10Operations, 10Jenkins: Review process to fetch Jenkins Debian package from upstream - https://phabricator.wikimedia.org/T260282 (10Dzahn) > the Alternative upgrade method sectio... [18:40:03] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10Operations, 10Jenkins: Review process to fetch Jenkins Debian package from upstream - https://phabricator.wikimedia.org/T260282 (10Dzahn) >>! In T260282#6380865, @hashar wrote:... [18:45:47] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), 10Scap, 10MediaWiki Train Development Environment, and 3 others: mirror-repos.sh snapshots created at different times will have different train releas... - https://phabricator.wikimedia.org/T260593 [19:07:37] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), 10Scap, 10MediaWiki Train Development Environment, and 3 others: Try "deploy-promote testwikis" in train-dev, document what seems to be missing - https://phabricator.wikimedia.org/T260376 (10da... [19:22:21] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), 10Scap, 10MediaWiki Train Development Environment, and 3 others: Try "deploy-promote testwikis" in train-dev, document what seems to be missing - https://phabricator.wikimedia.org/T260376 (10da... [19:40:14] (03PS1) 10Ahmon Dancy: Clearer error message if mwscript is not in PATH [tools/scap] - 10https://gerrit.wikimedia.org/r/620771 [19:42:39] (03CR) 10jerkins-bot: [V: 04-1] Clearer error message if mwscript is not in PATH [tools/scap] - 10https://gerrit.wikimedia.org/r/620771 (owner: 10Ahmon Dancy) [19:48:56] (03PS2) 10Ahmon Dancy: Clearer error message if mwscript is not in PATH [tools/scap] - 10https://gerrit.wikimedia.org/r/620771 [19:56:19] (03CR) 10Hashar: [C: 03+1] Clearer error message if mwscript is not in PATH [tools/scap] - 10https://gerrit.wikimedia.org/r/620771 (owner: 10Ahmon Dancy) [19:56:58] James_F: somehow docker-pkg is broken :-\ [19:57:04] kept rebuilding images over and over bah [19:58:19] Broken how? Does it say why the builds fail? [19:58:27] I don' tknow really [19:58:31] Or is the publishing bit failing? [19:58:40] Maybe the registry access changed? [19:59:17] giving a try again ;D [19:59:35] or maybe I just largely underestimate how long it takes to rebuild them [20:00:06] anyway, I am letting it run, will check again later when I head to bed ;] [20:02:11] (03CR) 10Hashar: "Went busy with other duties today, but surely that is on my radar and Marcel poked me about it. I guess we can deploy the job, run it and " [integration/config] - 10https://gerrit.wikimedia.org/r/618998 (https://phabricator.wikimedia.org/T251609) (owner: 10Hashar) [20:02:26] we shall see [20:02:35] apparently I had two docker-pkg running in parallel somehow bah [20:03:00] Oh, that wouldn’t work. [20:03:56] ah [20:08:51] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)): releng/bazel CI image fails to build - https://phabricator.wikimedia.org/T260608 (10hashar) [20:09:20] $ gpg --verify bazel/bazel.gpg [20:09:20] gpg: verify signatures failed: Unexpected error [20:09:22] yeah well [20:09:30] that is the only image failling ;] [20:09:41] and it is too late for me to fiddle with gpg [20:09:57] so well hmm good night ;-] [21:38:07] (03PS3) 10Ahmon Dancy: Clearer error message if mwscript is not found [tools/scap] - 10https://gerrit.wikimedia.org/r/620771 [21:40:17] (03CR) 10jerkins-bot: [V: 04-1] Clearer error message if mwscript is not found [tools/scap] - 10https://gerrit.wikimedia.org/r/620771 (owner: 10Ahmon Dancy) [21:43:13] (03PS4) 10Ahmon Dancy: Clearer error message if mwscript is not found [tools/scap] - 10https://gerrit.wikimedia.org/r/620771 [21:55:51] (03PS1) 10Ahmon Dancy: Improve mwscript error handling [tools/scap] - 10https://gerrit.wikimedia.org/r/620791 [21:58:02] (03CR) 10jerkins-bot: [V: 04-1] Improve mwscript error handling [tools/scap] - 10https://gerrit.wikimedia.org/r/620791 (owner: 10Ahmon Dancy) [21:58:51] (03PS2) 10Ahmon Dancy: Improve mwscript error handling [tools/scap] - 10https://gerrit.wikimedia.org/r/620791 [23:50:37] (03PS1) 10Legoktm: Add rust-coverage docker image [integration/config] - 10https://gerrit.wikimedia.org/r/620804 (https://phabricator.wikimedia.org/T256827) [23:56:48] (03CR) 10Legoktm: [C: 03+2] Add rust-coverage docker image [integration/config] - 10https://gerrit.wikimedia.org/r/620804 (https://phabricator.wikimedia.org/T256827) (owner: 10Legoktm) [23:57:57] (03Merged) 10jenkins-bot: Add rust-coverage docker image [integration/config] - 10https://gerrit.wikimedia.org/r/620804 (https://phabricator.wikimedia.org/T256827) (owner: 10Legoktm) [23:58:36] !log building rust-coverage image (https://gerrit.wikimedia.org/r/620804) [23:58:37] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL