[00:02:10] !log Taking deployment-deploy01 offline to fix beta config update deadlock. [00:02:11] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [00:02:58] (03PS2) 10Paladox: Gerrit: remove --incompatible_string_join_requires_strings option [integration/config] - 10https://gerrit.wikimedia.org/r/566895 [00:03:10] thcipriani wondering if you could also do ^ please (sorry) :) [00:03:56] (Done.) [00:05:22] (03CR) 10Thcipriani: [C: 03+2] Gerrit: remove --incompatible_string_join_requires_strings option [integration/config] - 10https://gerrit.wikimedia.org/r/566895 (owner: 10Paladox) [00:05:28] thank you! [00:05:33] * thcipriani doffs cap [00:06:15] (03Merged) 10jenkins-bot: Gerrit: remove --incompatible_string_join_requires_strings option [integration/config] - 10https://gerrit.wikimedia.org/r/566895 (owner: 10Paladox) [00:08:14] !log Updating docker-pkg files on contint1001 for https://gerrit.wikimedia.org/r/566895 [00:08:15] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [00:08:22] (03CR) 10Paladox: "recheck" [software/gerrit] (wmf/stable-2.16) - 10https://gerrit.wikimedia.org/r/562363 (owner: 10Paladox) [00:09:54] paladox: rebuilt, need to update the job with the new image again? [00:10:08] thcipriani i did that in the same change this time :) [00:10:40] ah, but I need to deploy it :P [00:11:08] {{done}} [00:11:27] thanks! [00:11:35] (03CR) 10Paladox: "recheck" [software/gerrit] (wmf/stable-2.16) - 10https://gerrit.wikimedia.org/r/562363 (owner: 10Paladox) [00:11:39] (03CR) 10Paladox: "recheck" [software/gerrit] (wmf/stable-2.16) - 10https://gerrit.wikimedia.org/r/566890 (owner: 10Paladox) [00:12:53] 00:12:28 ERROR: /src/polygerrit-ui/app/BUILD:7:1: no such package '@webcomponentsjs//': no such package '@bower//': failed [None, /src/tools/download_file.py, "-o", /log/external/bower/bower@1.8.8.npm_binary.tgz, "-u", "https://registry.npmjs.org/bower/-/bower-1.8.8.tgz", "-v", "82544be34a33aeae7efb8bdf9905247b2cffa985"]: src/main/tools/process-wrapper-legacy.cc:58: "execvp(None, ...)": No such file or directory [00:12:54] huh [00:13:08] PROBLEM - Free space - all mounts on deployment-snapshot01 is CRITICAL: CRITICAL: deployment-prep.deployment-snapshot01.diskspace._data.byte_percentfree (No valid datapoints found)deployment-prep.deployment-snapshot01.diskspace.root.byte_percentfree (<11.11%) [00:17:05] (03CR) 10Paladox: "recheck" [software/gerrit] (wmf/stable-2.16) - 10https://gerrit.wikimedia.org/r/566890 (owner: 10Paladox) [00:18:54] hrm, trying to execute "None" seems...strange. [00:19:50] None, src/tools/download_file.py, -o, [blah...] -> makes me think that "None" is the python version it found(?). [00:23:07] seems to be using a variable it couldn't initialize [00:23:08] RECOVERY - Free space - all mounts on deployment-snapshot01 is OK: OK: deployment-prep.deployment-snapshot01.diskspace._data.byte_percentfree (No valid datapoints found) [00:23:29] Apparently David P had this before but he said when he re-ran the build it worked again. Though i did another recheck which failed with the sam error [00:23:48] I'm trying to build the image locally [00:23:53] but it seems it cannot find it? [00:24:01] Will build the following images: [00:24:01] == Step 1: building images == [00:24:01] == Step 2: publishing == [00:24:01] NOT publishing images as we have no auth setup [00:24:01] == Build done! == [00:41:35] https://github.com/wikimedia/integration-config/blob/master/dockerfiles/gerrit/run.sh#L11 [00:41:36] hmm [00:47:56] thcipriani i can reproduce it in the container. [00:55:52] ohhh [00:55:55] there's no python [00:56:28] well there's python3 but python does not go to it (returns python -v ; bash: python: command not found) [00:57:21] /usr/bin/python: symbolic link to python2 [00:57:26] /usr/bin/python3: symbolic link to python3.7 [00:57:29] on my system [00:57:55] paladox: do the links exist or is /usr/bin just not in PATH [00:58:16] nobody@685023221baa:/src$ echo $PATH [00:58:19] nobody@685023221baa:/src$ echo $PATH [00:58:20] /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin [00:58:29] ls /usr/bin/python [00:58:29] ls: cannot access '/usr/bin/python': No such file or directory [00:58:37] ls /usr/bin/python3 [00:58:41] ls /usr/bin/python3 [00:58:42] /usr/bin/python3 [00:58:51] paladox: ls /usr/bin/python* [00:59:07] ls /usr/bin/python* [00:59:07] /usr/bin/python3 /usr/bin/python3.5 /usr/bin/python3.5m /usr/bin/python3m [00:59:32] ln -s /usr/bin/python3.5 /usr/bin/python ? [00:59:42] that failed as i'm not root :( [00:59:42] not 3.7? [00:59:57] James_F or thcipriani how do i make my self root? [01:00:10] in a container? [01:00:18] run the container with --user root [01:00:30] ah [01:00:55] ./debug-image gerrit --user root [01:00:55] fails :( [01:01:05] sudo docker run --user root --entrypoint /bin/bash --rm -it [01:01:07] er [01:01:09] not sudo [01:01:13] ohh [01:01:22] i just edited the script to supply --user, thanks! [01:01:25] is what I do to debug [01:05:01] Project beta-update-databases-eqiad build #39661: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/39661/ [01:06:51] root@341916629d0a:/src/gerrit# bazel [01:06:51] FATAL: mkdir('/var/local/bazel'): (error: 13): Permission denied [01:06:53] fun [01:07:38] * paladox crowned the dir as root [01:08:36] heh new error now thcipriani [01:08:44] ERROR: /src/gerrit/polygerrit-ui/app/BUILD:7:1: //polygerrit-ui/app:polygerrit_ui depends on @font-roboto-local//:zipfile in repository @font-roboto-local which failed to fetch. no such package '@font-roboto-local//': failed [/usr/bin/python, /src/gerrit/tools/js/download_bower.py, "-b", "/usr/bin/python /src/gerrit/tools/js/run_npm_binary.py /log/external/bower/bower@1.8.8.npm_binary.tgz", "-n", "font-roboto-local", "-p", [01:08:44] "PolymerElements/font-roboto-local", "-v", "1.1.0", "-s", "de651abf9b1b2d0935f7b264d48131677196412f", "-o", "font-roboto-local__download_bower.zip"]: Traceback (most recent call last): [01:09:57] oh [01:10:13] the tool is not py3 compatible? [01:10:21] "TypeError: write() argument must be str, not bytes" [01:11:51] paladox: it's looking for this font? https://www.npmjs.com/package/@polymer/font-roboto-local [01:12:06] mutante it seems the tool is erroing out due to "TypeError: write() argument must be str, not bytes" [01:12:08] but can't find it? [01:12:17] "no such package '@font-roboto-local//'" [01:12:20] that // at the end ... [01:12:26] is there normally something between the / / [01:12:30] yeh the errors get confusing :( [01:12:40] when it hits an error it says it cannot find the package [01:12:50] yeh [01:13:00] also this is bower, that package is from bower :) [01:13:06] * paladox added that package [01:13:32] how? did you do the npm install --save @polymer/font-roboto-local ? [01:13:33] str not bytes is something you'd expect of a python2-only tool [01:15:19] mutante i added it to bower_archives [01:15:25] and also tested it [01:15:31] ci @ gerrit-review also works [01:15:53] cool [01:17:11] i think i have a fix [01:18:42] https://gerrit-review.googlesource.com/c/gerrit/+/251692 [01:18:43] thcipriani ^ [01:19:44] And that now revealed the real error [01:19:49] you cannot run bazel as root :( [01:28:18] thcipriani ah [01:28:25] we need to install python-minimal and python2 [01:28:51] (03PS1) 10Paladox: Gerrit: Install python-minimal and python2 in docker image [integration/config] - 10https://gerrit.wikimedia.org/r/566910 [01:30:03] (03PS2) 10Paladox: Gerrit: Install python-minimal and python2 in docker image [integration/config] - 10https://gerrit.wikimedia.org/r/566910 [01:30:35] thcipriani could you review ^ please? :) [01:34:48] hrm, do you need to change the invocation anywhere? Or is bazel smart enough to figure this out? [01:35:37] it's smart, i think bazel looks at /usr/bin/python [01:36:03] though we're installing both python2/3 with that change (with it defaulting to 2 for now) [01:36:11] we can install python3-minimal later if we want [01:36:48] what is python3 used for anymore if not bazel? [01:39:50] thcipriani it wouldn't be used i think [01:40:19] k, if you update the patchset to remove it, I'll go ahead and merge and rebuild [01:40:26] ok [01:40:33] (03PS3) 10Paladox: Gerrit: Install python-minimal and python2 in docker image [integration/config] - 10https://gerrit.wikimedia.org/r/566910 [01:40:37] done, also added a todo :) [01:41:43] (03CR) 10Thcipriani: [C: 03+2] Gerrit: Install python-minimal and python2 in docker image [integration/config] - 10https://gerrit.wikimedia.org/r/566910 (owner: 10Paladox) [01:41:49] thank you :) [01:42:35] (03Merged) 10jenkins-bot: Gerrit: Install python-minimal and python2 in docker image [integration/config] - 10https://gerrit.wikimedia.org/r/566910 (owner: 10Paladox) [01:45:17] !log Updating docker-pkg files on contint1001 for https://gerrit.wikimedia.org/r/566910 [01:45:18] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [01:45:57] (03CR) 10Paladox: "recheck" [software/gerrit] (wmf/stable-2.16) - 10https://gerrit.wikimedia.org/r/566890 (owner: 10Paladox) [01:47:14] ugh, what's the package called on stretch? evidently not python2 [01:47:54] just python [01:48:01] oh [01:48:25] (03PS1) 10Paladox: Gerrit: Fix python package [integration/config] - 10https://gerrit.wikimedia.org/r/566911 [01:49:14] (03PS2) 10Paladox: Gerrit: Fix python package [integration/config] - 10https://gerrit.wikimedia.org/r/566911 [01:49:17] thcipriani ^ [01:49:38] thanks [01:49:46] yw :) [01:50:27] (03CR) 10Thcipriani: [C: 03+2] Gerrit: Fix python package [integration/config] - 10https://gerrit.wikimedia.org/r/566911 (owner: 10Paladox) [01:51:18] (03Merged) 10jenkins-bot: Gerrit: Fix python package [integration/config] - 10https://gerrit.wikimedia.org/r/566911 (owner: 10Paladox) [01:52:15] !log Updating docker-pkg files on contint1001 for https://gerrit.wikimedia.org/r/566911 [01:52:16] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [01:54:29] paladox: should be updated [01:54:33] thanks! [01:54:38] * paladox rechecks his gerrit change [01:54:46] (03CR) 10Paladox: "recheck" [software/gerrit] (wmf/stable-2.16) - 10https://gerrit.wikimedia.org/r/566890 (owner: 10Paladox) [01:57:29] thcipriani oh [01:57:47] bazel needs python3 :/ [01:58:11] (03PS1) 10Thcipriani: Fabric: More accurate prompt message [integration/config] - 10https://gerrit.wikimedia.org/r/566913 [01:58:12] (03PS1) 10Paladox: Gerrit: Upgrade to python3 (bazel requires it) [software/gerrit] - 10https://gerrit.wikimedia.org/r/566914 [01:58:23] (03Abandoned) 10Paladox: Gerrit: Upgrade to python3 (bazel requires it) [software/gerrit] - 10https://gerrit.wikimedia.org/r/566914 (owner: 10Paladox) [01:58:37] (03PS1) 10Paladox: Gerrit: Upgrade to python3 (bazel requires it) [integration/config] - 10https://gerrit.wikimedia.org/r/566915 [01:59:27] (03PS2) 10Paladox: Gerrit: Upgrade to python3 (bazel requires it) [integration/config] - 10https://gerrit.wikimedia.org/r/566915 [01:59:43] thcipriani would you be able to review ^ please :) [01:59:50] that should be the last patch hopefully [01:59:53] :) [02:00:09] famous last words [02:00:23] oh [02:00:29] thcipriani hold on [02:00:40] it seems python is not symnlinked in https://packages.debian.org/buster/amd64/python3-minimal/filelist [02:00:47] I thought that you found out it *also* needed python2? [02:00:59] the "str not bytes" thing? [02:01:32] I have to go for the evening, if you ping me on some patchsets I should be able to merge them in the morning. [02:01:54] (03PS3) 10Paladox: Gerrit: Upgrade to python3 (bazel requires it) [integration/config] - 10https://gerrit.wikimedia.org/r/566915 [02:02:39] thcipriani well yeh (if it failed) which i fixed with https://gerrit-review.googlesource.com/c/gerrit/+/251692 [02:02:52] so may as well install python2 and python3 (it needs both apparently) [02:04:01] (03PS4) 10Paladox: Gerrit: Also install python3 (bazel requires it) [integration/config] - 10https://gerrit.wikimedia.org/r/566915 [02:05:00] Project beta-update-databases-eqiad build #39662: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/39662/ [02:12:26] (03CR) 10Paladox: "Based on some quick testing, installing both these packages will work." [integration/config] - 10https://gerrit.wikimedia.org/r/566915 (owner: 10Paladox) [03:05:00] Project beta-update-databases-eqiad build #39663: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/39663/ [09:47:10] hey, I have two questions about our jenkins config [09:47:55] first one - how do I create something like this (I mean the form) https://integration.wikimedia.org/ci/job/analytics-refinery-release/m2release/ ? [09:48:30] and the other question - is there a way to test a change to jenkins configuration before doing a CR? some test instance maybe? [09:48:38] No test instance, no [09:49:12] I would suspect the first is an output of JJB [09:52:13] zpapierski: https://github.com/wikimedia/integration-config/blob/master/jjb/analytics.yaml [09:52:44] I was looking at it - so it generates it? no other configuration is required? [09:53:27] that's quite convenient [09:53:48] https://github.com/wikimedia/integration-config/blob/19a65a5109b9f44ac33038151b5e5a9c9b4af53e/jjb/analytics.yaml#L117-L127 [09:56:02] thx - I'll read up a little bit more on JBB and do a CR [09:57:59] it's a bit of a dark art, but should have at least some documentation [10:48:49] one more question - this build uses maven-release-user. Do I have to request a new user for our job or this one is a correct one? if so, can it do an actual maven release (as in push changes to master, with new versions and a tag)? [10:49:52] I guess it all depends what you're doing [10:50:34] Looking at https://github.com/wikimedia/analytics-refinery/commits/master it seems to push changes [10:50:41] Doesn't seem to push tags [10:51:29] interesting, I was convinced that maven release does that, among other things [10:52:04] but in any case, question stands for our repo (which is wikidata/query/rdf) [10:52:50] I don't necessarily see any reason to use a separate user [10:52:52] will this user be able to push changes there, too or do I need a new technical user for that? [10:53:18] See https://gerrit.wikimedia.org/r/#/admin/projects/analytics/refinery,access and https://gerrit.wikimedia.org/r/#/admin/groups/14,members [10:53:38] I guess we grant JenkinsBots push access to the repo, which includes Maven-release-user [10:53:43] Interestingly though [10:53:49] https://gerrit.wikimedia.org/r/#/admin/projects/analytics/refinery,access says "Create Annotated Tag" [10:53:55] I wonder if we just don't use the feature there (yet?) [10:54:29] but it seems that analytics were prepared for that and they provided correct rights [10:54:40] I assume we just have to do the same [10:55:30] yep, I see we don't have them - who can modify them for us? [10:55:30] it's something we have in use atm, so replicating it to another repo etc shouldn't be an issue [10:55:43] Numerous people can ;) [10:56:22] It might be worth filing a task as an audit/paper trail for requesting the changes though [10:56:53] right, I will do that, I'm not sure who to address it to, though [10:57:02] Depends for which bit [10:57:17] Continuous-Integration-Config for teh jobs... Release Engineering for the lot [10:57:40] Doesn't need to necessarily address anyone [10:57:51] ok [10:58:31] thx for everything, I'm off to request things and break stuff [10:59:46] that's the best way [11:02:23] Hmm Create Annotated Tag [11:03:28] To push tags you only need to grant push to refs/tags (which refs/* should work too) [11:05:27] Actually [11:05:28] https://gerrit-review.googlesource.com/admin/repos/gerrit,access [11:05:29] You need to grant create reference [11:10:18] Reedy: is that what you wanted ^? :) [11:10:34] Personally, I don't really care ;) [11:10:56] It was more asking if they should be creating tags, and they're not in the repo, but some related permissions were seemingly applied [11:12:08] Ohh [11:13:00] I'd have to dig to see if they should be created etc [11:18:53] 10Release-Engineering-Team, 10Wikidata, 10Wikidata-Query-Service: Add rights for JenkinsBot for tagging and push to master on wikidata/query/rdf - https://phabricator.wikimedia.org/T243587 (10Zbyszko) [11:20:04] zpapierski: Does it really need force push? [11:20:19] I just replicated what analytics have [11:20:32] I'm not exactly sure, but I'm guessing they have it for something [11:20:46] No force push on https://gerrit.wikimedia.org/r/#/admin/projects/analytics/refinery,access ? [11:21:07] https://usercontent.irccloud-cdn.com/file/mNWCJ5mK/image.png [11:21:29] oh [11:21:36] missed the check box on mine :) [11:22:11] I probably investigate why is this needed though :) [12:36:42] (03PS1) 10Daimona Eaytoy: Set tabWidth [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/567021 [12:37:37] (03PS2) 10Daimona Eaytoy: Set tabWidth [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/567021 [12:42:11] (03CR) 10jerkins-bot: [V: 04-1] Set tabWidth [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/567021 (owner: 10Daimona Eaytoy) [12:58:41] 10Phabricator, 10Release-Engineering-Team: Clarify purpose of GerritToPhabBot user in Phabricator - https://phabricator.wikimedia.org/T243597 (10Aklapper) p:05Triage→03Lowest [13:02:23] 10MediaWiki-Codesniffer: Set tab-width in the base ruleset file - https://phabricator.wikimedia.org/T243598 (10Daimona) [13:02:41] (03CR) 10Daimona Eaytoy: "See T243598" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/567021 (owner: 10Daimona Eaytoy) [13:03:12] 10MediaWiki-Codesniffer, 10Upstream: PHPCS forbids all attempts to implement interfaces over multiple lines - https://phabricator.wikimedia.org/T243529 (10Daimona) 05Open→03Invalid Working as intended, closing in favour of T243598. [13:06:30] (03Abandoned) 10Gehel: [WIP] build with maven instead of bazel [software/gerrit/plugins/wikimedia] - 10https://gerrit.wikimedia.org/r/500733 (owner: 10Gehel) [13:06:43] (03Abandoned) 10Gehel: Cleanup a few warnings. [software/gerrit/plugins/wikimedia] - 10https://gerrit.wikimedia.org/r/500737 (owner: 10Gehel) [13:39:11] 10Release-Engineering-Team, 10serviceops, 10MW-1.35-notes (1.35.0-wmf.16; 2020-01-21): Opcache hit ratio dropped after 22/1 train on appeservers - https://phabricator.wikimedia.org/T243601 (10jijiki) [14:25:08] PROBLEM - Free space - all mounts on deployment-logstash2 is CRITICAL: CRITICAL: deployment-prep.deployment-logstash2.diskspace._mnt.byte_percentfree (No valid datapoints found) deployment-prep.deployment-logstash2.diskspace._var_lib_elasticsearch.byte_percentfree (No valid datapoints found)deployment-prep.deployment-logstash2.diskspace.root.byte_percentfree (<100.00%) [14:39:08] PROBLEM - Work requests waiting in Zuul Gearman server on contint1001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [150.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [14:58:13] 10Continuous-Integration-Infrastructure: Occasional build failures related to temporary directories / no space left on integration-agent-docker-1008 - https://phabricator.wikimedia.org/T243223 (10Lucas_Werkmeister_WMDE) Now also affecting integration-agent-docker-1002. https://integration.wikimedia.org/ci/job/w... [15:01:58] 10Continuous-Integration-Infrastructure: Occasional Selenium build failures related to temporary directories / no space left - https://phabricator.wikimedia.org/T243223 (10Lucas_Werkmeister_WMDE) [15:04:11] (03PS1) 10ZPapierski: Release plan for WDQS [integration/config] - 10https://gerrit.wikimedia.org/r/567068 [15:29:08] 10Gerrit: Cannot log into Gerrit using Brave Browser - https://phabricator.wikimedia.org/T238569 (10Ottomata) 05Open→03Invalid You are right this is a problem with Brave...although now it is working fine for me. Not sure what changed! [15:32:02] 10MediaWiki-Codesniffer, 10Wikidata, 10Wikidata-Campsite, 10User-Addshore: Release a new version of WikibaseCodeSniffer - https://phabricator.wikimedia.org/T243296 (10Addshore) 05Open→03Resolved a:03Addshore 1.1.0 just released and has: Upgrade PHPUnit from ^4.8.35 to ^8.4 Upgrade MediaWiki Code Sni... [15:32:10] 10MediaWiki-Codesniffer, 10Wikidata, 10User-Addshore, 10Wikidata-Campsite (Wikidata-Campsite-Iteration-∞): Release a new version of WikibaseCodeSniffer - https://phabricator.wikimedia.org/T243296 (10Addshore) [15:32:49] (03CR) 10Jforrester: [C: 03+2] "A grave injustice, indeed." [integration/config] - 10https://gerrit.wikimedia.org/r/566913 (owner: 10Thcipriani) [15:34:07] (03Merged) 10jenkins-bot: Fabric: More accurate prompt message [integration/config] - 10https://gerrit.wikimedia.org/r/566913 (owner: 10Thcipriani) [15:51:57] what does it mean when the Zuul dashboard shows some builds as “skipped”? [15:52:09] did someone take action manually to prevent those builds from running? [15:57:19] Lucas_WMDE: if you point your mouse over the little dark circle at the top right of the change, it hints about the failure [15:57:26] in this case, a merge conflict occured [15:57:47] zuul first attempt to merge the patchset against the tip of the branch (or the tip of the branch + any changes ahead) [15:57:49] and if that fails [15:57:53] it can not run any job [15:58:01] and just flag all those jobs as skipped [15:58:07] the change is still in the queue though [15:58:10] hashar: thanks a lot! [15:58:17] that little circle wasn’t obvious to me ^^ [15:58:22] we’ll rebase, then [15:58:22] because there is a change ahead in the queue: 566527,11 [15:58:25] it still has jobs running [15:58:41] if one of those jobs fail [15:58:53] 566527,11 would get removed from the queue [15:59:10] and the change that has skipped jobs will be moved ahead of the queue, a merge check attempted and job might be triggerd [15:59:18] because the merge conflict might be due to the change ahead [15:59:45] so each change might merge fine with the tip of the branch but conflict with each others [16:00:09] I see [16:00:12] if they conflict with each other [16:00:15] you want to fetch 566527,11 first [16:00:30] then cherry pick 566820,3 and resolve the conflict manually [16:01:02] something like: git-review -d 566527 ; git-review -x 566820 ; ; git-review -R [16:01:42] Lucas_WMDE: it is hopefully a trivial merge conflict ;] [16:01:54] `npm run build && git add dist`, most likely :) [16:02:10] (we’re one of those evil people currently adding build artifacts to git :S) [16:02:35] thanks a lot for the explanation! [16:02:51] eek ;D [16:02:58] to be fair [16:03:12] iirc the mobile team has build artifacts as well, or at least planned to do so [16:03:15] based on webpack [16:05:34] yeah, several groups eagerly awaiting T199004 :) [16:05:35] T199004: RFC: Add a frontend build step to skins/extensions to our deploy process - https://phabricator.wikimedia.org/T199004 [16:07:49] https://www.gerritcodereview.com/2020-01-24-gerrit-news-dec-jan-2020.html#zuul-integration-with-gerrit-is-coming-to-gerrit-ci zuul is replacing the CI upstream over the next few months! [16:07:59] okay, now the skipped builds are gone and Zuul left a comment on the change, mentioning the merge conflict [16:08:09] I guess I just never saw this in progress before, only saw the merge conflicts afterwards [16:08:45] (well, usually the merge conflict was with master, not with an in-flight change, so it wouldn’t have waited in the “skipped” state IIUC) [17:04:32] RECOVERY - Work requests waiting in Zuul Gearman server on contint1001 is OK: OK: Less than 100.00% above the threshold [90.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [17:21:10] 10MediaWiki-Codesniffer, 10Wikidata, 10User-Addshore, 10Wikidata-Campsite (Wikidata-Campsite-Iteration-∞): Release a new version of WikibaseCodeSniffer - https://phabricator.wikimedia.org/T243296 (10Daimona) >>! In T243296#5829712, @Addshore wrote: > I'm going to go around and update this in various places... [17:32:59] Hello! Is there a good way for a host to know when scap it deploying to it? My usecase is that I have an alert that compares versions on mediawiki hosts with the version on deploy servers and I'd like to figure out how to get it to not falsely trigger while a host is being deployed to [17:45:28] 10Phabricator (2020-01-23), 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Security-Team, 10Security: Need to force users to reset their phabricator TOTP auth factor - https://phabricator.wikimedia.org/T243247 (10Tgr) Should the affected ac... [17:49:34] 10Gerrit, 10Release-Engineering-Team, 10Gerrit-Privilege-Requests, 10Wikidata, 10Wikidata-Query-Service: Add rights for JenkinsBot for tagging and push to master on wikidata/query/rdf - https://phabricator.wikimedia.org/T243587 (10MarcoAurelio) [17:51:29] (03PS1) 10MarcoAurelio: Modify project permissions for JenkinsBot [wikidata/query/rdf] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/567107 (https://phabricator.wikimedia.org/T243587) [18:00:56] (03CR) 10ZPapierski: [C: 03+1] Modify project permissions for JenkinsBot [wikidata/query/rdf] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/567107 (https://phabricator.wikimedia.org/T243587) (owner: 10MarcoAurelio) [18:04:46] 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)): Refine Seakeeper proposal for Security/SRE review - https://phabricator.wikimedia.org/T243436 (10dduvall) [18:13:16] 10Release-Engineering-Team, 10Gerrit-Privilege-Requests, 10Wikidata, 10Wikidata-Query-Service: Grant more rights to wikidata/query/rdf for the group wikidata-query (similar to search) - https://phabricator.wikimedia.org/T243431 (10MarcoAurelio) Related: T243587 (same repo) [18:16:38] (03PS1) 10MarcoAurelio: Grant `wikidata-query` people more access in wikidata/query/rdf.git [wikidata/query/rdf] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/567112 (https://phabricator.wikimedia.org/T243431) [20:23:03] (03CR) 10Jforrester: Release plan for WDQS (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/567068 (owner: 10ZPapierski) [21:11:57] (03CR) 10Umherirrender: [C: 03+2] Improve performance of InArrayUsage sniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/566343 (owner: 10Thiemo Kreuz (WMDE)) [21:12:31] (03Merged) 10jenkins-bot: Improve performance of InArrayUsage sniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/566343 (owner: 10Thiemo Kreuz (WMDE)) [22:50:24] so is contint2001 used for something or really just standby [22:50:48] if i reinstall it and then we notice some issue with puppet and then it's a week of allhands.. that would be bad or not matter? [22:51:18] i realize that timing was horrible . 1 minute after hashar left. lol [22:51:26] mutante: I don't know for sure; people are out. [22:51:33] Probably better not to do so. [22:51:35] ack, James. i won't touch it :) [22:51:41] i will ask at allhands [22:51:54] Maybe we load-balance over to it for reads or something odd. [22:51:57] Cool.