[01:38:57] 10Project-Admins: Create component project for GraphQL - https://phabricator.wikimedia.org/T206499 (10dbarratt) [01:39:46] 10Project-Admins: Create component project for GraphQL - https://phabricator.wikimedia.org/T206499 (10dbarratt) This request is to create a project to expand T173214 since the tool (in a basic form) now exists. [02:20:03] Project beta-update-databases-eqiad build #28905: 04FAILURE in 2.4 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/28905/ [03:22:05] Yippee, build fixed! [03:22:05] Project beta-update-databases-eqiad build #28906: 09FIXED in 2 min 4 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/28906/ [06:42:58] 10Project-Admins: Consider archiving #MediaWiki-Documentation in favour of single #Documentation - https://phabricator.wikimedia.org/T142345 (10Wixcloud.net) [06:51:39] 10Project-Admins: Create component project for GraphQL - https://phabricator.wikimedia.org/T206499 (10Legoktm) [07:00:50] RECOVERY - DPKG on contint1001 is OK: All packages OK [07:04:30] RECOVERY - puppet last run on contint1001 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [07:26:07] 10Project-Admins: Create component project for GraphQL - https://phabricator.wikimedia.org/T206499 (10Aklapper) Stupid question: If this is hosted on https://graphql.wmflabs.org/ (not tools.wmflabs.org) then why is the source under "labs/**tools**/graphql"? [07:28:42] 10Project-Admins, 10MediaWiki-Documentation, 10Documentation, 10Proposal: Consider archiving #MediaWiki-Documentation in favour of single #Documentation - https://phabricator.wikimedia.org/T142345 (10Aklapper) [08:03:14] (03PS1) 10Alexandros Kosiaris: Make sure the daemons are restarted [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/465324 [08:04:53] (03CR) 10Alexandros Kosiaris: "Should I be also adding this to other branches ? I did try patch-queue/debian/jessie-wikimedia but gerrit is not allowing me as I hit the " [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/465324 (owner: 10Alexandros Kosiaris) [10:45:22] 10Gerrit, 10Operations, 10Traffic, 10Patch-For-Review: Enable avatars in gerrit - https://phabricator.wikimedia.org/T191183 (10Nikerabbit) >>! In T191183#4098656, @demon wrote: > `avatars-gravatar` I am not installing. I did once, and was very quickly told not remove it. While that Wordpress proxy plugin s... [11:44:11] 10Release-Engineering-Team (Kanban): Request Sauce Labs access for niedzielski - https://phabricator.wikimedia.org/T206358 (10zeljkofilipin) p:05Triage>03Normal a:03zeljkofilipin [11:44:25] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Request Sauce Labs access for niedzielski - https://phabricator.wikimedia.org/T206358 (10zeljkofilipin) [12:03:26] hey paladox what's the desired avatar size for gerrit anyways? is it in fact 100x100? [12:32:37] 10Gerrit: Gerrit CoC and Privacy Policy links showing up in an awkward place when editing a file - https://phabricator.wikimedia.org/T206530 (10Reedy) [13:01:22] apergos: I think any size. Though maybe 100x yeh [13:02:40] well 'can upload any size' and 'will display 100x100 as largest size' means we should only upload 100x100 [13:03:06] Ok [13:03:24] why fill disks with something larger, I mean. [13:04:43] Ah yeh [13:10:22] apergos: I’ve done https://gerrit.wikimedia.org/r/#/c/All-Avatars/+/465417/ [13:11:03] ok (typo: 'match') [13:11:28] note I don't know the largest display size, I was guessing based on other comments in phab/email [13:11:37] it could be 250x250 for all I know or whatever [13:12:00] there avatar -> their avatar (other typo) [13:12:09] apergos: it uses css to size it [13:12:29] do we know the largest that the specific css will permit? [13:12:38] Though it also can use a size parameter if defined (as used at google) but we won’t be using that [13:12:44] I mean if it will use 400x400 then I guess allow it [13:12:45] (03CR) 10MSantos: "> Patch Set 1:" [integration/config] - 10https://gerrit.wikimedia.org/r/464827 (https://phabricator.wikimedia.org/T163274) (owner: 10MSantos) [13:12:57] I suppose there must be some size that's bigger than would get used [13:13:32] also kudos for taking this on [13:13:58] :) [13:30:23] 10Phabricator-Sprint-Extension: Wikimedia Phabricator sprint extension uses removed ManiphestEditStatusCapability - https://phabricator.wikimedia.org/T206538 (10urzds) [13:43:40] 10Gerrit, 10Operations, 10Traffic, 10Patch-For-Review: Enable avatars in gerrit - https://phabricator.wikimedia.org/T191183 (10hashar) >>! In T191183#4651560, @Nikerabbit wrote: >>>! In T191183#4098656, @demon wrote: >> `avatars-gravatar` I am not installing. I did once, and was very quickly told not remov... [14:24:01] Project beta-scap-eqiad build #224357: 04FAILURE in 13 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/224357/ [14:34:47] 10Project-Admins: Create component project for GraphQL - https://phabricator.wikimedia.org/T206499 (10dbarratt) >>! In T206499#4651171, @Aklapper wrote: > Stupid question: If this is hosted on https://graphql.wmflabs.org/ (not tools.wmflabs.org) then why is the source under "labs/**tools**/graphql"? That's a gr... [14:39:07] Yippee, build fixed! [14:39:07] Project beta-scap-eqiad build #224358: 09FIXED in 14 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/224358/ [14:53:43] (03Abandoned) 10Paladox: Allow registered users to merge there own changes [All-Avatars] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/439642 (owner: 10Paladox) [15:07:39] Project beta-scap-eqiad build #224360: 04FAILURE in 12 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/224360/ [15:20:46] Project beta-scap-eqiad build #224361: 04STILL FAILING in 12 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/224361/ [15:30:04] ugh, the scap failures do to sudo issues cause scap failures do to disk-space issues :( [15:32:09] !log deployment-deploy01:sudo rm -rf /tmp/scap_l10n_* [15:32:12] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:33:33] oh is that why it sometimes leaves the /tmp stuff around [15:33:34] ok [15:36:10] Yippee, build fixed! [15:36:11] Project beta-scap-eqiad build #224362: 09FIXED in 14 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/224362/ [15:36:55] yeah, it shouldn't leave the /tmp stuff around (should probably do a try: finally: rm the file) [15:37:05] never been an issue before though [15:41:20] 10Gerrit: Gerrit CoC and Privacy Policy links showing up in an awkward place when editing a file - https://phabricator.wikimedia.org/T206530 (10Paladox) This seems like a bug in GWTUI. I doin't think this will be fixed seeing as GWTUI is now offically deprecated and stated for removal in 3.0. [15:58:19] 10Continuous-Integration-Infrastructure, 10Core Platform Team (PHP7 (TEC4)), 10Core Platform Team Kanban (Current), 10PHP 7.2 support, 10Patch-For-Review: Run MediaWiki tests on PHP 7.2 - https://phabricator.wikimedia.org/T204884 (10Jdforrester-WMF) [16:06:01] 10Release-Engineering-Team (Kanban): Onboarding liw - https://phabricator.wikimedia.org/T206466 (10LarsWirzenius) [16:28:34] 10Release-Engineering-Team (Kanban): Onboarding liw - https://phabricator.wikimedia.org/T206466 (10LarsWirzenius) [16:53:20] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Onboarding liw - https://phabricator.wikimedia.org/T206466 (10zeljkofilipin) [16:53:25] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Onboarding liw - https://phabricator.wikimedia.org/T206466 (10greg) [16:54:11] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Onboarding liw - https://phabricator.wikimedia.org/T206466 (10zeljkofilipin) a:03LarsWirzenius [17:02:32] liw: welcome :-) [17:02:58] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Request Sauce Labs access for niedzielski - https://phabricator.wikimedia.org/T206358 (10zeljkofilipin) For my future reference: - sign as user `wikimedia` at https://saucelabs.com - go to https://saucelabs.com/beta/team-management - click `Add user`... [17:03:16] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Onboarding liw - https://phabricator.wikimedia.org/T206466 (10greg) [17:03:55] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Request Sauce Labs access for niedzielski - https://phabricator.wikimedia.org/T206358 (10zeljkofilipin) 05Open>03Resolved @Niedzielski I've invited you. Please reopen the task if you have any problems creating the account, logging in, using the ser... [17:04:17] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Onboarding liw - https://phabricator.wikimedia.org/T206466 (10greg) [17:08:49] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Onboarding liw - https://phabricator.wikimedia.org/T206466 (10greg) [17:11:46] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Onboarding liw - https://phabricator.wikimedia.org/T206466 (10LarsWirzenius) [17:11:52] 10Continuous-Integration-Infrastructure, 10Core Platform Team (PHP7 (TEC4)), 10Core Platform Team Kanban (Current), 10PHP 7.2 support, 10Patch-For-Review: Run MediaWiki tests on PHP 7.2 - https://phabricator.wikimedia.org/T204884 (10Legoktm) [17:18:52] 10Release-Engineering-Team (Kanban), 10Operations, 10Release Pipeline, 10Epic, 10Services (watching): Migrate production services to kubernetes using the pipeline - https://phabricator.wikimedia.org/T198901 (10thcipriani) [17:44:26] PROBLEM - SSH on integration-slave-docker-1021 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:19:40] !log Messing with scap in beta to test T121597 / D1114 [18:19:44] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:19:46] D1114: Check for fatals in AbstractSync by calling `mwscript eval.php` - https://phabricator.wikimedia.org/D1114 [18:19:48] T121597: Implement MediaWiki pre-promote checks - https://phabricator.wikimedia.org/T121597 [18:22:33] heya thcipriani, i just removed a cherry picked patch on deployment-puppetmaster03 with git rebase -i [18:22:38] got this while rebasing: [18:22:44] error: could not apply 9a0eb955a2... Beta: don't use mediawiki::state function [18:24:02] hrm, that one didn't merge [18:24:04] * thcipriani looks [18:24:49] I see the conflict [18:26:18] * thcipriani fixes [18:29:31] ottomata: rebased [18:30:14] Project beta-scap-eqiad build #224374: 15ABORTED in 7 min 39 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/224374/ [18:30:24] (that's me) [18:30:46] thanks thcipriani ! :) [18:34:00] Hm.. what does this warning mean? [18:34:01] > 18:21:22 Job ['/usr/bin/scap', 'pull', '--no-update-l10n', 'deployment-deploy01.deployment-prep.eqiad.wmflabs', 'deployment-deploy02.deployment-prep.eqiad.wmflabs', 'deployment-deploy01.deployment-prep.eqiad.wmflabs'] called with an empty host list. [18:34:12] Looks like it's in Jenkins builds as well, not just my own invocation [18:34:52] we don't have proxies in beta is basically what that warning is [18:35:37] so no hosts get passed to the command to update proxies. [18:36:19] thcipriani: Hm.. the command seems to list three hostnames, though? [18:36:52] those are the list of deployment masters for the proxies to pull from [18:37:10] thcipriani: Right, so it's warning about something in scap.cnf? [18:37:38] Anyhow, I'll ignore that for now. [18:37:52] it's a warning about it not passing that command with the list of masters to any proxies [18:38:31] ssh [proxy] /usr/bin/scap pull --no-update-l10n deployment-deploy01.deployment-prep.eqiad.wmflabs [etc..] [18:39:42] Ah right. The proxies wouldn't be arguments to scap or locally on the targets on disk, they're passed at run-time to the Job/ssh thing. Makes sense. The server on which to run the pull command first. [18:39:49] I didn't know it used plain scap pull for that. [18:39:55] Neat code re-use :) [18:52:59] 10Continuous-Integration-Infrastructure, 10translatewiki.net: L10n-bot should not force-merge / override Jenkins (breaks the build) - https://phabricator.wikimedia.org/T91707 (10chasemp) 05Open>03Resolved a:03chasemp tentatively resolving this as part of T205563 [19:00:45] 10Scap (Scap3-MediaWiki-MVP), 10scap2, 10Wikimedia-Incident: Implement MediaWiki pre-promote checks - https://phabricator.wikimedia.org/T121597 (10Krinkle) Looks like it might not be working as intended. Here's what I did: * Disabled `beta-scap-eqiad`. * `ssh deployment-deploy01`, `sudo -iu jenkins-deploy`... [19:00:56] !log Re-enable beta-scap-eqiad job [19:00:59] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:13:24] 10Continuous-Integration-Infrastructure, 10translatewiki.net: L10n-bot should not force-merge / override Jenkins (breaks the build) - https://phabricator.wikimedia.org/T91707 (10matmarex) 05Resolved>03Open Surely this is not fixed, because just yesterday, L10n-bot broke the build with https://gerrit.wikime... [19:52:26] 10Continuous-Integration-Infrastructure, 10translatewiki.net: L10n-bot should not force-merge / override Jenkins (breaks the build) - https://phabricator.wikimedia.org/T91707 (10Legoktm) L10n-bot is only triggering the special i18n checker thing right now, we still need to run the full test suite against it. [20:00:24] PROBLEM - SSH on integration-slave-docker-1021 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:16:45] (03PS3) 10Dduvall: Revert "Use a volume under workspace for /tmp in docker containers" [integration/config] - 10https://gerrit.wikimedia.org/r/463852 [20:17:54] (03CR) 10jerkins-bot: [V: 04-1] Revert "Use a volume under workspace for /tmp in docker containers" [integration/config] - 10https://gerrit.wikimedia.org/r/463852 (owner: 10Dduvall) [20:39:48] 10Gerrit, 10Operations, 10Traffic, 10Patch-For-Review: Enable avatars in gerrit - https://phabricator.wikimedia.org/T191183 (10Tgr) >>! In T191183#4651560, @Nikerabbit wrote: > Really? As far as I know all gravatar integrations send hashes of emails. This means they don't know which email it is, unless it... [20:50:16] RECOVERY - SSH on integration-slave-docker-1021 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u7 (protocol 2.0) [21:47:21] what's happening with jenkins on releases? [21:47:25] is somebody working on it? [21:47:45] it switched from 200 to 503 to 403 [22:00:14] mutante: yeah, it's being restricted for use with security patches etc [22:00:38] that broke access for the monitoring check too [22:00:45] which created an alert for jenkins being down [22:00:48] though it wasnt [22:00:55] ah, bummer, sorry about that [22:01:01] cc marxarelli thcipriani ^ [22:01:46] ok, thanks. ACKing it [22:02:16] mutante: sorry! I restricted access to it following a meeting about it on Thursday. It's pretty locked down now. [22:03:29] no problem, i know nothing about that meeting. i just saw Icinga starting to alert ..and it seemed fresh as of today [22:03:41] we can either remove montitoring or open it up for Icinga servers [22:04:13] maybe the later since we do plan on using it [22:04:29] if it can be opened up just for icinga [22:04:30] ^ [22:05:21] it doesn't have to be rushed, it's ACKed for now. but we should add the holes then, yea [22:06:04] I'll make a task to figure out what we can do. I'll try to take a look this week. Thanks for the ping about it! [22:07:31] ok, thanks [22:11:52] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team: Releases Jenkins Icinga check failing after restricting access - https://phabricator.wikimedia.org/T206579 (10thcipriani) [22:12:02] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team: Releases Jenkins Icinga check failing after restricting access - https://phabricator.wikimedia.org/T206579 (10thcipriani) p:05Triage>03Normal [22:28:26] 10Scap (Scap3-MediaWiki-MVP), 10scap2, 10Wikimedia-Incident: Implement MediaWiki pre-promote checks - https://phabricator.wikimedia.org/T121597 (10mmodell) @krinkle: I'm digging into this, trying to figure out what could cause it to miss the error. [22:50:26] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Onboarding liw - https://phabricator.wikimedia.org/T206466 (10greg) [23:02:39] 10Continuous-Integration-Infrastructure, 10Core Platform Team (PHP7 (TEC4)), 10Core Platform Team Kanban (Current), 10PHP 7.2 support, 10Patch-For-Review: Run MediaWiki tests on PHP 7.2 - https://phabricator.wikimedia.org/T204884 (10MaxSem) [23:26:47] legoktm: if I recall correctly, you were working on a newer node/npm for toolforge, right? curious if mabe we can leverage that somehow in CI [23:27:29] 10Continuous-Integration-Infrastructure, 10Wikimedia-production-error (Shared Build Failure): Jenkins jobs for MediaWiki failing with 'npm: shasum check failed' - https://phabricator.wikimedia.org/T203506 (10Krinkle) (Still seen at least a dozen times over the past 2 days, probably the most common kind of fals... [23:34:31] 10Gerrit, 10Operations, 10Traffic, 10Patch-For-Review: Enable avatars in gerrit - https://phabricator.wikimedia.org/T191183 (10thcipriani) >>! In T191183#4649245, @Dereckson wrote: >>>! In T191183#4647075, @Krinkle wrote: >> Gerrit wants 100x100px square thumbnails. > > The 100x100 size isn't what curren...