[00:00:04] 10Deployment-Systems, 06Release-Engineering-Team, 03Scap3, 06Operations: setup automatic deletion of old l10nupdate - https://phabricator.wikimedia.org/T130317#2279070 (10mmodell) As for the blocker, I don't mind if we automate it some other way, I just wanted to note that porting it to scap is on the rada... [00:01:29] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06Operations, 10Ops-Access-Requests: Allow RelEng nova log access - https://phabricator.wikimedia.org/T133992#2279073 (10Dzahn) @thcipriani could you specify who is "CI" and "the releng" team in this context? [00:08:16] RECOVERY - Host integration-dev is UP: PING OK - Packet loss = 0%, RTA = 1.60 ms [00:09:41] PROBLEM - Host integration-dev is DOWN: CRITICAL - Host Unreachable (10.68.17.81) [00:10:59] RECOVERY - Puppet run on integration-slave-trusty-1015 is OK: OK: Less than 1.00% above the threshold [0.0] [00:11:57] RECOVERY - Puppet run on integration-slave-precise-1002 is OK: OK: Less than 1.00% above the threshold [0.0] [00:11:57] PROBLEM - Puppet run on deployment-mediawiki01 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [00:12:19] RECOVERY - Host integration-dev is UP: PING OK - Packet loss = 0%, RTA = 0.89 ms [00:18:15] PROBLEM - Host integration-dev is DOWN: CRITICAL - Host Unreachable (10.68.17.81) [00:28:16] RECOVERY - Host integration-dev is UP: PING OK - Packet loss = 0%, RTA = 1.96 ms [00:30:14] PROBLEM - Host integration-dev is DOWN: CRITICAL - Host Unreachable (10.68.17.81) [00:51:49] RECOVERY - Puppet run on deployment-mediawiki01 is OK: OK: Less than 1.00% above the threshold [0.0] [04:22:51] Project selenium-MultimediaViewer » chrome,beta,OS X 10.9,contintLabsSlave && UbuntuTrusty build #6: 04FAILURE in 26 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,label=contintLabsSlave%20&&%20UbuntuTrusty/6/ [04:22:53] PROBLEM - Puppet run on deployment-mx is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [04:29:02] PROBLEM - Puppet run on deployment-stream is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [04:42:43] RECOVERY - Puppet run on deployment-tmh01 is OK: OK: Less than 1.00% above the threshold [0.0] [05:02:53] RECOVERY - Puppet run on deployment-mx is OK: OK: Less than 1.00% above the threshold [0.0] [05:13:08] RECOVERY - Puppet run on phab-beta is OK: OK: Less than 1.00% above the threshold [0.0] [05:37:10] PROBLEM - Puppet run on integration-slave-trusty-1018 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [06:51:17] PROBLEM - Free space - all mounts on deployment-sentry2 is CRITICAL: CRITICAL: deployment-prep.deployment-sentry2.diskspace._var.byte_percentfree (<11.11%) [07:01:12] PROBLEM - Puppet run on deployment-puppetmaster is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [07:23:57] 06Release-Engineering-Team, 13Patch-For-Review, 05Release: MW-1.27.0-wmf.23 deployment blockers - https://phabricator.wikimedia.org/T131557#2279591 (10Gilles) [07:23:59] 06Release-Engineering-Team, 05MW-1.27-release, 07Performance, 07Regression, 07User-notice: First paint time regression on Wikimedia page views with wmf.23 roll-out - https://phabricator.wikimedia.org/T134553#2279588 (10Gilles) 05Open>03Resolved a:03Gilles The gap on the coal metric that appeared du... [07:24:21] 06Release-Engineering-Team, 13Patch-For-Review, 05Release: MW-1.27.0-wmf.23 deployment blockers - https://phabricator.wikimedia.org/T131557#2170705 (10Gilles) 05Open>03Resolved wmf.23 redeployed yesterday [07:36:16] RECOVERY - Puppet run on deployment-puppetmaster is OK: OK: Less than 1.00% above the threshold [0.0] [07:49:30] 10MediaWiki-Codesniffer: Automatic fix of missing space produces broken code - https://phabricator.wikimedia.org/T134847#2279617 (10Nikerabbit) [07:52:47] 10MediaWiki-Codesniffer: Automatic fix of missing space produces broken code - https://phabricator.wikimedia.org/T134847#2279641 (10Nikerabbit) Version 0.7.1. [07:57:15] 10Continuous-Integration-Config, 06Release-Engineering-Team, 06Operations: Write a test to check for clearly bogus hostnames - https://phabricator.wikimedia.org/T133047#2279644 (10hashar) I have left a note regarding updating /typos on the [[ https://wikitech.wikimedia.org/w/index.php?title=Infrastructure_na... [08:24:45] gilles: thanks to have looked at the firstPaint metric issue yesterday! [08:25:25] the good thing is we have the confirmation ori patch properly fix the metric ! [08:27:53] 06Release-Engineering-Team, 15User-greg: Plan 2016 RelEng team offsite - https://phabricator.wikimedia.org/T134830#2278940 (10hashar) Will follow up on our private list. I am not comfortable in sharing private details publicly :-} [08:39:59] 06Release-Engineering-Team, 15User-greg, 15User-zeljkofilipin: Plan 2016 RelEng team offsite - https://phabricator.wikimedia.org/T134830#2279688 (10zeljkofilipin) Can we make the task private? [09:07:50] !log fixed puppet.conf on deployment-cache-text04 [09:07:55] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [09:09:24] 10Beta-Cluster-Infrastructure, 06Operations, 10Traffic, 13Patch-For-Review, 07WorkType-Maintenance: beta cluster varnish cache can't apt-get upgrade nginx-full: nginx: [emerg] unknown "spdy" variable - https://phabricator.wikimedia.org/T134362#2279766 (10hashar) 05Open>03Resolved That was a transient... [09:30:29] RECOVERY - Puppet run on deployment-ms-fe01 is OK: OK: Less than 1.00% above the threshold [0.0] [09:35:59] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Config, 06Multimedia, 10UploadWizard, 07WorkType-Maintenance: Fix up the UploadWizard-api for beta cluster - https://phabricator.wikimedia.org/T134730#2274628 (10matmarex) Where would I even find the UploadWizard-api smoke test? I was under the impr... [10:02:01] 06Release-Engineering-Team, 10ReleaseTaggerBot: ReleaseTaggerBot broken since last phab upgrade (?) - https://phabricator.wikimedia.org/T134850#2279889 (10Aklapper) p:05Triage>03High [10:09:18] 06Release-Engineering-Team, 10ReleaseTaggerBot: ReleaseTaggerBot broken since last phab upgrade (?) - https://phabricator.wikimedia.org/T134850#2279907 (10valhallasw) No, I am mistaken. The code explicitly notes: ``` 97 except AttributeError: 98 # If slugMap is empty, an empty list rather... [10:12:30] 10MediaWiki-Codesniffer: phpcbf removes array elements - https://phabricator.wikimedia.org/T134857#2279909 (10thiemowmde) [10:12:41] 10MediaWiki-Codesniffer: phpcbf removes array elements - https://phabricator.wikimedia.org/T134857#2279921 (10thiemowmde) p:05Triage>03Unbreak! [10:28:59] 10MediaWiki-Codesniffer: phpcbf: MediaWiki_Sniffs_WhiteSpace_SpaceyParenthesisSniff removes array elements - https://phabricator.wikimedia.org/T134857#2279992 (10thiemowmde) [10:41:33] 10Deployment-Systems, 03Scap3: Rebuild Scap Debian package - https://phabricator.wikimedia.org/T134338#2280008 (10fgiunchedi) 05Open>03Resolved {{done}} and uploaded to trusty-wikimedia and jessie-wikimedia [11:43:31] 10Browser-Tests-Infrastructure, 06Release-Engineering-Team, 07Epic, 13Patch-For-Review, and 2 others: Fix scenarios that fail at en.wikipedia.beta.wmflabs.org or do not run them daily - https://phabricator.wikimedia.org/T94150#2280115 (10zeljkofilipin) [11:46:43] 10Browser-Tests-Infrastructure, 06Release-Engineering-Team, 07Epic, 13Patch-For-Review, and 2 others: Fix scenarios that fail at en.wikipedia.beta.wmflabs.org or do not run them daily - https://phabricator.wikimedia.org/T94150#2280138 (10zeljkofilipin) [11:54:09] 10Continuous-Integration-Config, 10Wikidata, 03Wikidata-Sprint-2016-04-26, 03Wikidata-Sprint-2016-05-10: [Task] Setup a Jenkins job to run Wikidata browsertests on test.wikidata.org - https://phabricator.wikimedia.org/T101499#2280225 (10Tobi_WMDE_SW) [11:54:11] 07Browser-Tests, 10Continuous-Integration-Config, 10Wikidata, 03Wikidata-Sprint-2016-04-26, 03Wikidata-Sprint-2016-05-10: [Task] Move Wikidata browsertests into Wikibase repository - https://phabricator.wikimedia.org/T118727#2280224 (10Tobi_WMDE_SW) [11:54:13] 07Browser-Tests, 10Continuous-Integration-Config, 10Wikidata, 07Story, and 2 others: [Story] Run browsertests regularly on test.wikidata.org via Jenkins - https://phabricator.wikimedia.org/T101497#2280226 (10Tobi_WMDE_SW) [11:58:18] 10MediaWiki-Codesniffer: Automatic fix of missing space produces broken code - https://phabricator.wikimedia.org/T134847#2280253 (10Nikerabbit) [11:58:20] 10MediaWiki-Codesniffer: phpcbf: MediaWiki_Sniffs_WhiteSpace_SpaceyParenthesisSniff removes array elements - https://phabricator.wikimedia.org/T134857#2280255 (10Nikerabbit) [12:00:04] 10MediaWiki-Codesniffer: phpcbf: MediaWiki_Sniffs_WhiteSpace_SpaceyParenthesisSniff removes array elements - https://phabricator.wikimedia.org/T134857#2279909 (10Nikerabbit) This is especially worrisome given that many extensions were just mass-changed by this method. We might need to double check all of those. [12:05:16] (03CR) 10Hashar: "Got deployed already." [integration/config] - 10https://gerrit.wikimedia.org/r/287755 (https://phabricator.wikimedia.org/T133047) (owner: 10Hashar) [12:16:43] (03PS1) 10Hashar: [operations/mediawiki-config] typo job [integration/config] - 10https://gerrit.wikimedia.org/r/287930 (https://phabricator.wikimedia.org/T133047) [12:16:59] (03CR) 10Hashar: [C: 032] typos job now excludes .git directories [integration/config] - 10https://gerrit.wikimedia.org/r/287755 (https://phabricator.wikimedia.org/T133047) (owner: 10Hashar) [12:20:08] (03Merged) 10jenkins-bot: typos job now excludes .git directories [integration/config] - 10https://gerrit.wikimedia.org/r/287755 (https://phabricator.wikimedia.org/T133047) (owner: 10Hashar) [12:20:38] (03CR) 10Hashar: [C: 032] [operations/mediawiki-config] typo job [integration/config] - 10https://gerrit.wikimedia.org/r/287930 (https://phabricator.wikimedia.org/T133047) (owner: 10Hashar) [12:20:49] hashar: https://integration.wikimedia.org/ci/job/cxserver-deploy-npm-node-4.3/43/console can you quick look? I'll fie Task if bug in CI or CXS. [12:22:42] Project selenium-GettingStarted » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #15: 04FAILURE in 41 sec: https://integration.wikimedia.org/ci/job/selenium-GettingStarted/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/15/ [12:22:42] (03Merged) 10jenkins-bot: [operations/mediawiki-config] typo job [integration/config] - 10https://gerrit.wikimedia.org/r/287930 (https://phabricator.wikimedia.org/T133047) (owner: 10Hashar) [12:22:56] kart_: well canot find module 'bluebird' ? [12:23:09] seems that module is not in the deploy repo [12:23:35] and indeed https://gerrit.wikimedia.org/r/#/c/287929/ deletes it ? [12:24:20] kart_: seems the /deploy/ needs the submodule to be bumped to whatever version no more relies on bluebird [12:26:31] hashar: cxserver indeed depnds on bluebird. [12:26:38] so something else is wrong. [12:26:54] kart_: well your change https://gerrit.wikimedia.org/r/#/c/287929/ seems to delete the bluebird module [12:27:02] something screwed up during npm update [12:28:53] hashar: ack. [12:29:00] hashar: sorry for noise. [12:37:45] (03PS1) 10Hashar: Make typos detector to skip binary files [integration/config] - 10https://gerrit.wikimedia.org/r/287934 (https://phabricator.wikimedia.org/T133047) [12:38:15] kart_: you are welcome :} [12:40:11] (03CR) 10Hashar: [C: 032] "Deployed, speed up showing up on https://gerrit.wikimedia.org/r/#/c/287926/" [integration/config] - 10https://gerrit.wikimedia.org/r/287934 (https://phabricator.wikimedia.org/T133047) (owner: 10Hashar) [12:41:00] hashar: forgot to do git add node_modules :D [12:41:09] CI is good now. [12:41:24] (03Merged) 10jenkins-bot: Make typos detector to skip binary files [integration/config] - 10https://gerrit.wikimedia.org/r/287934 (https://phabricator.wikimedia.org/T133047) (owner: 10Hashar) [12:41:32] 10Continuous-Integration-Config, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: Write a test to check for clearly bogus hostnames - https://phabricator.wikimedia.org/T133047#2280412 (10hashar) 05Open>03Resolved a:03hashar I have: * added a `/typos` file to operations/mediawiki-config.... [12:47:23] 06Release-Engineering-Team, 10ReleaseTaggerBot: ReleaseTaggerBot broken since last phab upgrade (?) - https://phabricator.wikimedia.org/T134850#2280443 (10Aklapper) Uhm. So Phab project `mw-1.27-release-notes` has the additional hashtag `mw1.27`. And I did not set the additional hashtag `mw1.28` when I create... [12:47:40] 06Release-Engineering-Team, 10ReleaseTaggerBot: ReleaseTaggerBot broken since branching for 1.28 - https://phabricator.wikimedia.org/T134850#2280444 (10Aklapper) [12:52:04] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Config, 06Multimedia, 10UploadWizard, 07WorkType-Maintenance: Fix up the UploadWizard-api for beta cluster - https://phabricator.wikimedia.org/T134730#2280465 (10hashar) It is not an a browser tests / Selenium based job. The code is some python scr... [12:52:15] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Config, 06Multimedia, 10UploadWizard, 07WorkType-Maintenance: Fix up the UploadWizard-api for beta cluster - https://phabricator.wikimedia.org/T134730#2280466 (10hashar) a:05hashar>03None [12:59:35] !log triggering puppet run on scap targets in beta for https://gerrit.wikimedia.org/r/#/c/287918/ cherry pick [12:59:40] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [13:01:38] good morning [13:06:31] o/ [13:19:59] 06Release-Engineering-Team, 10ReleaseTaggerBot: ReleaseTaggerBot broken since branching for 1.28 - https://phabricator.wikimedia.org/T134850#2280610 (10valhallasw) (1) is somewhat difficult because tags are directly derived from the git branch names. In addition, the primary hashtag name has changed (e.g. #mw1... [13:24:45] Project beta-scap-eqiad build #102026: 04FAILURE in 0.24 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/102026/ [13:29:02] 00:00:00.197 usage: scap [-h] ... [13:29:04] 00:00:00.197 scap: error: argument : invalid choice: 'beta-scap-eqiad (build #102026)' (choose from 'cdb-json-refresh', 'cdb-rebuild', 'deploy', 'deploy-local', 'deploy-log', 'hhvm-graceful', 'hhvm-restart', 'l10n-purge', 'l10n-update', 'pull', 'pull-master', 'say', 'security-check', 'sync', 'sync-dir', 'sync-file', 'sync-l10n', 'sync-wikiversions', 'wikiversions-compile', 'wikiversions-inuse') [13:29:04] thcipriani|afk: ^^:D [13:29:14] invoked as: /srv/deployment/scap/scap/bin/scap 'beta-scap-eqiad (build #102026)' [13:29:30] hashar: yeah. I need to (a) update the job and (b) wait for all these salt runs to finish :( [13:29:37] no worries [13:29:55] thcipriani|afk: are you all set to update jobs via JJB ? [13:30:29] hashar: yep. I've done it a couple of times. [13:30:32] !log Adding integration-slave-jessie-1002 in Jenkins. it is all puppet compliant [13:30:36] sounds good [13:30:37] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [13:30:53] I'll get a patch up here before long. After coffee :) [13:31:15] 🍩 [13:31:15] 🍩 [13:31:16] 🍩 [13:31:36] (03PS3) 10Hashar: Migrate all debian-glue jobs to Jessie slaves [integration/config] - 10https://gerrit.wikimedia.org/r/287649 (https://phabricator.wikimedia.org/T95545) [13:33:26] !log Migrating all debian glue jobs to Jessie permanent slaves T95545 [13:33:26] T95545: Migrate all debian-glue jobs to Jessie slaves - https://phabricator.wikimedia.org/T95545 [13:33:30] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [13:33:46] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Config, 06Multimedia, 10UploadWizard, 07WorkType-Maintenance: Fix up the UploadWizard-api for beta cluster - https://phabricator.wikimedia.org/T134730#2280626 (10matmarex) Oh, I see it now. But please don't restore running it for production. We agre... [13:34:15] RECOVERY - Puppet run on integration-slave-trusty-1018 is OK: OK: Less than 1.00% above the threshold [0.0] [13:35:54] Yippee, build fixed! [13:35:55] Project beta-scap-eqiad build #102027: 09FIXED in 1 min 12 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/102027/ [13:36:18] oh my god [13:37:53] (03CR) 10Hashar: [C: 032] Migrate all debian-glue jobs to Jessie slaves [integration/config] - 10https://gerrit.wikimedia.org/r/287649 (https://phabricator.wikimedia.org/T95545) (owner: 10Hashar) [13:38:00] 10Continuous-Integration-Infrastructure, 13Patch-For-Review: Migrate all debian-glue jobs to Jessie slaves - https://phabricator.wikimedia.org/T95545#2280646 (10hashar) 05Open>03Resolved [13:39:17] (03Merged) 10jenkins-bot: Migrate all debian-glue jobs to Jessie slaves [integration/config] - 10https://gerrit.wikimedia.org/r/287649 (https://phabricator.wikimedia.org/T95545) (owner: 10Hashar) [13:43:07] RECOVERY - Puppet run on integration-slave-jessie-1002 is OK: OK: Less than 1.00% above the threshold [0.0] [13:43:16] (03PS1) 10Thcipriani: Update beta-scap-eqiad job to use subcommands [integration/config] - 10https://gerrit.wikimedia.org/r/287951 [13:44:16] 10Browser-Tests-Infrastructure, 06Release-Engineering-Team, 07Epic, 13Patch-For-Review, and 3 others: Fix scenarios that fail at en.wikipedia.beta.wmflabs.org or do not run them daily - https://phabricator.wikimedia.org/T94150#2280670 (10zeljkofilipin) [13:44:18] 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-MultimediaViewer, 10Reading-Web-Backlog: A JSON text must at least contain two octets! (JSON::ParserError) in MultimediaViewer browser tests - https://phabricator.wikimedia.org/T129483#2280668 (10zeljkofilipin) 05Open>03Resolved a:03zeljkofilipin [13:44:34] 10Continuous-Integration-Infrastructure: Migrate Differential job beta-build-deb to Jessie permanent slaves - https://phabricator.wikimedia.org/T134881#2280672 (10hashar) [13:44:36] 10Browser-Tests-Infrastructure, 06Release-Engineering-Team, 07Epic, 13Patch-For-Review, and 3 others: Fix scenarios that fail at en.wikipedia.beta.wmflabs.org or do not run them daily - https://phabricator.wikimedia.org/T94150#2051193 (10zeljkofilipin) [13:44:38] 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-MultimediaViewer, 10Reading-Web-Backlog: NeedCaptcha (MediawikiApi::CreateAccountError) in MultimediaViewer browser tests - https://phabricator.wikimedia.org/T129472#2280689 (10zeljkofilipin) 05Open>03Resolved a:03zeljkofilipin [13:45:07] 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-MultimediaViewer, 10Reading-Web-Backlog: NeedCaptcha (MediawikiApi::CreateAccountError) in MultimediaViewer browser tests - https://phabricator.wikimedia.org/T129472#2106692 (10zeljkofilipin) Resolved by T128190. [13:45:10] 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-MultimediaViewer, 10Reading-Web-Backlog: A JSON text must at least contain two octets! (JSON::ParserError) in MultimediaViewer browser tests - https://phabricator.wikimedia.org/T129483#2107040 (10zeljkofilipin) Resolved by T128190. [13:45:40] !log Change https://integration.wikimedia.org/ci/job/beta-build-deb/ job to use label selector "DebianGlue && DebianJessie" instead of "BetaDebianRepo" T134881 [13:45:41] T134881: Migrate Differential job beta-build-deb to Jessie permanent slaves - https://phabricator.wikimedia.org/T134881 [13:45:46] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [13:46:00] 10Browser-Tests-Infrastructure, 06Release-Engineering-Team, 07Epic, 13Patch-For-Review, and 3 others: Fix scenarios that fail at en.wikipedia.beta.wmflabs.org or do not run them daily - https://phabricator.wikimedia.org/T94150#2055343 (10zeljkofilipin) [13:46:36] !log Deleting Jenkins slave deployment-puppetmaster T134881 [13:46:37] T134881: Migrate Differential job beta-build-deb to Jessie permanent slaves - https://phabricator.wikimedia.org/T134881 [13:46:41] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [13:48:56] !log deployment-puppetmaster : dropping role::ci::jenkins_access role::ci::slave::labs and role::ci::slave::labs::common T134881 [13:48:57] T134881: Migrate Differential job beta-build-deb to Jessie permanent slaves - https://phabricator.wikimedia.org/T134881 [13:49:01] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [13:51:23] !log restarted apache and zuul-merger on gallium for openssl update [13:51:28] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [13:52:08] !log restarting zuul on gallium for openssl update [13:52:13] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [13:54:24] !log restarted zuul-merger on scandium for openssl update [13:54:29] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [13:55:33] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 15User-zeljkofilipin: Ownership of Selenium tests - https://phabricator.wikimedia.org/T134492#2280720 (10zeljkofilipin) [14:05:42] (03PS1) 10Zfilipin: Do not sent e-mail messages to Jon until jobs are more stable [integration/config] - 10https://gerrit.wikimedia.org/r/287957 (https://phabricator.wikimedia.org/T134492) [14:06:05] (03PS2) 10Zfilipin: Do not sent e-mail messages to Jon until jobs are more stable [integration/config] - 10https://gerrit.wikimedia.org/r/287957 (https://phabricator.wikimedia.org/T134492) [14:06:51] (03CR) 10Zfilipin: [C: 032] "selenium-MobileFrontend and selenium-MultimediaViewer jobs are deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/287957 (https://phabricator.wikimedia.org/T134492) (owner: 10Zfilipin) [14:09:30] (03Merged) 10jenkins-bot: Do not sent e-mail messages to Jon until jobs are more stable [integration/config] - 10https://gerrit.wikimedia.org/r/287957 (https://phabricator.wikimedia.org/T134492) (owner: 10Zfilipin) [14:20:34] !log deployment-puppetmaster mass cleaned packages/service/users etc T134881 [14:20:35] T134881: Migrate Differential job beta-build-deb to Jessie permanent slaves - https://phabricator.wikimedia.org/T134881 [14:20:39] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [14:27:11] 10Continuous-Integration-Infrastructure, 13Patch-For-Review: Migrate all debian-glue jobs to Jessie slaves - https://phabricator.wikimedia.org/T95545#2280866 (10hashar) [14:27:12] 10Continuous-Integration-Infrastructure: Migrate Differential job beta-build-deb to Jessie permanent slaves - https://phabricator.wikimedia.org/T134881#2280864 (10hashar) 05Open>03Resolved Cleaned up. The beta-build-deb now runs on permanent slaves. If we really want packages to be published in some central... [14:27:47] thcipriani|afk: good news, the Jenkins package has been pushed to apt.wm.o :-} [14:30:56] hashar: that's good. so now it's just running/finding someone to run apt-get install --only-upgrade? [14:31:10] and babysitting. [14:34:06] yeah [14:34:19] also on the wikitech page: Jenkins tends to deadlock when shutdowning [14:34:36] so after a minute or the init script returns but the java process is still around [14:34:40] have to manually kill -9 [14:34:43] I then usually run puppet [14:34:47] then start the service [14:38:58] ah, so, as a contint-admin, I *should* have everything I need to run this. [14:46:52] PROBLEM - Puppet run on deployment-mediawiki01 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [14:47:09] ^^^that is probably me [14:47:13] I screwed up the puppetmaster on beta [14:47:35] thcipriani: someone asked who should get more privileges on whatever task (yeah sorry lack of precision) [14:48:04] would need contint-roots I believe [14:52:43] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 07Jenkins, 07WorkType-Maintenance: Upgrade Jenkins from 1.642.3 to 1.651.1 - https://phabricator.wikimedia.org/T133737#2280970 (10hashar) Package is available on apt.wikimedia.org [14:54:03] how I had the nodepool case in mind ... https://phabricator.wikimedia.org/T133992 [15:01:09] zeljkof, hashar: \o [15:01:52] jzerebecki: meeting? [15:01:53] RECOVERY - Puppet run on deployment-mediawiki01 is OK: OK: Less than 1.00% above the threshold [0.0] [15:01:58] I was not sure if it was cancelled [15:02:18] zeljkof: it seems so [15:02:32] that it will happen if you will it [15:02:50] jzerebecki: joining [15:08:02] https://www.mediawiki.org/wiki/Manual:Coding_conventions/Ruby#Base_configuration [15:10:51] and an example gem that pins a rubocop version with sane defaults https://github.com/Nix-wie-weg/rubocop-nww/blob/master/config/default.yml [15:25:09] echo 'require: rubocop-wikimedia' > ~/.rubocop.yml [15:25:13] done essentially :-} [15:25:34] zeljkof: jzerebecki ^^^ we will want a task to create a gem rubocop-wikimedia ;-} [15:27:03] 10Continuous-Integration-Config, 07Ruby: create and use rubocop-wikimedia package - https://phabricator.wikimedia.org/T134895#2281132 (10JanZerebecki) [15:27:13] hashar, zeljkof: https://phabricator.wikimedia.org/T134895 [15:27:16] easy [15:27:45] 10Continuous-Integration-Config, 07Ruby: create and use rubocop-wikimedia package - https://phabricator.wikimedia.org/T134895#2281158 (10JanZerebecki) [15:27:56] 10Continuous-Integration-Config, 07Ruby, 15User-zeljkofilipin: create and use rubocop-wikimedia package - https://phabricator.wikimedia.org/T134895#2281159 (10zeljkofilipin) [15:28:10] 10Continuous-Integration-Config, 07Ruby, 15User-zeljkofilipin: create and use rubocop-wikimedia package - https://phabricator.wikimedia.org/T134895#2281160 (10JanZerebecki) [15:28:24] 10Continuous-Integration-Config, 07Ruby, 15User-zeljkofilipin: create and use rubocop-wikimedia package - https://phabricator.wikimedia.org/T134895#2281161 (10hashar) [15:29:17] 10Continuous-Integration-Config, 07Ruby, 15User-zeljkofilipin: create and use rubocop-wikimedia package - https://phabricator.wikimedia.org/T134895#2281162 (10zeljkofilipin) [15:45:20] 07Browser-Tests, 10Continuous-Integration-Config, 10Wikidata, 15User-zeljkofilipin, 03Wikidata-Sprint-2016-05-10: [Task] Move Wikidata browsertests into Wikibase repository - https://phabricator.wikimedia.org/T118727#2281219 (10zeljkofilipin) [15:53:23] jzerebecki: mw to scap3 is https://phabricator.wikimedia.org/T114313 :-) [16:05:02] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Infrastructure, 07Blocked-on-Operations, 13Patch-For-Review, 07Puppet: Puppet fails on labs instances due to Ganglia (ex: using apache::site puppet class) - https://phabricator.wikimedia.org/T134808#2281327 (10hashar) Summary of patches for puppet.g... [16:11:19] PROBLEM - Keyholder status on mira is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:15:49] RECOVERY - Long lived cherry-picks on puppetmaster on deployment-puppetmaster is OK: OK: Less than 100.00% above the threshold [0.0] [16:16:27] PROBLEM - Free space - all mounts on integration-slave-jessie-1001 is CRITICAL: CRITICAL: integration.integration-slave-jessie-1001.diskspace._mnt.byte_percentfree (<20.00%) [16:17:14] RECOVERY - Puppet run on deployment-pdf02 is OK: OK: Less than 1.00% above the threshold [0.0] [16:21:03] 06Release-Engineering-Team, 10ReleaseTaggerBot: ReleaseTaggerBot broken since branching for 1.28 - https://phabricator.wikimedia.org/T134850#2281420 (10Jdforrester-WMF) 05Open>03Resolved a:03Aklapper Yay. Thank you, both. [16:28:45] 10Beta-Cluster-Infrastructure, 13Patch-For-Review, 15User-bd808: Beta cluster not updating MW code - https://phabricator.wikimedia.org/T109007#2281465 (10Krenair) [16:28:47] 10Beta-Cluster-Infrastructure, 10Monitoring, 13Patch-For-Review, 07Shinken: Monitor keyholder on deployment-prep deployment servers - https://phabricator.wikimedia.org/T111064#2281462 (10Krenair) 05Open>03Resolved This is working, thank you @Joe! [16:29:45] heh seeing the bug "Beta cluster not updating MW code" terrified me for a second :) [16:31:26] 10Beta-Cluster-Infrastructure: deployment-puppetmaster cherrypicked commits not reporting to graphite regularly enough? - https://phabricator.wikimedia.org/T132997#2281481 (10Krenair) 05Open>03Resolved Now there appears to be a different issue, maybe somewhere under check_graphite: ```krenair@shinken-01:~$ /... [16:35:21] !log https://integration.wikimedia.org/ci/job/debian-glue failure on integration-slave-jessie-1001 due to /mnt being 100$ full [16:35:26] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [16:44:10] !log Cleaned up 8.5G of pbuilder tmp output on integration-slave-jessie-1001 with `sudo find /mnt/pbuilder/build -maxdepth 1 -type d -mtime +1 -exec rm -r {} \+` [16:44:14] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [16:51:19] RECOVERY - Free space - all mounts on integration-slave-jessie-1001 is OK: OK: All targets OK [17:00:26] 06Release-Engineering-Team, 05Release: 1.28.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T134249#2281645 (10JanZerebecki) @hashar Would T134857 be blocking todays branching? [17:34:40] !log updated OCG to version b0c57a1c6890e9fa1f2c3743fc14cb6a7f244fc3 [17:34:44] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [17:45:14] cscott: ps... [17:45:43] thedj: ? [17:45:47] "The "download as PDF"/book creator functions are apparently very obsolete/nonfunctional. For example, it appears to completely ignore any content embedded in tables or templates. Should these links simply be removed from the toolbar?" [17:45:51] from VP/T [17:46:05] templates is incorrect [17:46:23] tables has a bug filed (short story, hard to avoid breaking page layout) [17:46:27] what is VP/T? [17:46:34] village pump technical [17:46:59] They get 3 hits/second, so definitely shouldn't be removed. [17:47:32] it's just the featured article crowd that demands perfection.. [17:48:06] cscott: https://en.wikipedia.org/wiki/Wikipedia:Village_pump_%28technical%29#Printable.2Fbook_versions [17:48:49] thanks [17:48:52] i'll respond there [17:49:43] Glad to help [17:50:18] hmm btw, i just notice that it seems the links in pdf are every so slightly colored maroon ? (visited links?) is that intentional ? [17:50:52] yes, i wanted to ensure they'd still print as black on b&w printers, while still indicating that they are clickable if you are reading in a PDF viewer [17:51:11] ah ok. had never noticed it before :_ [17:53:57] cscott: I will note, in OTRS' info-en::tech-issues queues, PDF creator is the one we get the most emails about. [17:54:56] i did fix a few more crashers last week, for what it's worth. and there's a longer-term project to improve the PDF backend (and "printable page" at the same time) which I'm trying to get foundation support for. [17:55:37] i thought we were killing 'printable' ? [17:56:17] the biggest issue is that infoboxes don't show up I think. that ticks people off. [17:56:49] can't we apply the mobile stylesheet for content or something to that ? [17:57:10] * thedj should not think about this kind of stuff, or he'll never finish refactoring timedmediahandler :) [17:58:26] Is ther supposed to be a "Do not use this server" MOTD on mira.deployment-prep.eqiad.wmflabs ? [17:58:31] (There is.) [18:19:11] 05Gitblit-Deprecate, 10Diffusion: Diffusion redirect from name to callsign doesn't always work - https://phabricator.wikimedia.org/T129447#2105968 (10JanZerebecki) See also T128757. [18:33:17] 07Browser-Tests, 10Wikidata, 03Wikidata-Sprint-2016-05-10: Sitelink browser test sometimes fails with firefox because of rate limit? - https://phabricator.wikimedia.org/T126585#2282122 (10JanZerebecki) [18:45:06] 10MediaWiki-Codesniffer: Improving an static analysis tools for MediaWiki - Weekly reports - https://phabricator.wikimedia.org/T134225#2282155 (1001tonythomas) [18:45:18] 10MediaWiki-Codesniffer: Community bonding evaluation for Improving static analysis tools for MediaWiki - https://phabricator.wikimedia.org/T133829#2282160 (1001tonythomas) [19:14:04] (03PS1) 10BryanDavis: labs/toollabs: make tox-jessie voting [integration/config] - 10https://gerrit.wikimedia.org/r/288028 [19:16:29] 06Release-Engineering-Team, 10MediaWiki-extensions-LocalisationUpdate, 10VisualEditor: Visualeditor-mweditmodewt-popup-title not updated in the Hebrew Wikipedia, even though it was translated - https://phabricator.wikimedia.org/T134072#2282352 (10Jdforrester-WMF) https://he.wikipedia.org/wiki/%D7%9E%D7%93%D7... [19:16:54] 06Release-Engineering-Team, 10MediaWiki-extensions-LocalisationUpdate, 10VisualEditor: i18n string not updated in the Hebrew Wikipedia, even though it was translated - https://phabricator.wikimedia.org/T134072#2282354 (10Jdforrester-WMF) p:05Triage>03High [19:17:41] !log beta / CI purging old Linux kernels: salt -v '*' cmd.run 'dpkg -l|grep ^rc|awk "{ print \$2 }"|grep linux-image|xargs dpkg --purge' [19:17:46] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [19:17:51] crazy oneliners [19:18:24] hashar: the zuul diff on this patch looks a bit weird -- https://gerrit.wikimedia.org/r/#/c/288028/ [19:18:52] $ 10 it is due to queue being reschuffled [19:19:09] so yeah [19:19:25] The gate-and-submit is known in Zuul has a dependent pipeline [19:19:41] when two repos share the same job, they are considered to be dependent and thus share the same queue inside gate-and-submit [19:19:49] ah [19:19:59] tox-jessie is already on a lot of repo forming a huge queue [19:20:05] so having php53 ties it to all kinds of stuff [19:20:16] when you add 'tox-jessie' to labs/toollabs , that repo ends up joining the giant mess [19:20:18] yeah [19:20:39] we had it broken ~ a year ago when we started making jobs generic [19:20:47] previously they used a prefixed based on the repo name [19:20:52] eg labs-toollabs-tox-jessie [19:20:59] which would keep each repo in its own queue [19:21:24] Zuul version 3 (a partial rewrite) would make it explicit instead of by convention [19:21:32] the submit on that repo is apparently busted too, but I'm guessing that is unrelated [19:21:51] gate-and-submit runes on +2 but it doens't actually merge [19:22:09] only if the patchset is a fast forward [19:22:16] oh [19:22:23] you mean on labs/toollabs [19:22:28] yes [19:23:24] I bet jenkins doesn't have merge rights in gerrit [19:23:46] ^.*\.(php|php5|phtml|inc)${MatchAny:{MatchAll:{ProjectMatcher:^mediawiki/.*$},{BranchMatcher:(?!REL1_2[3-6]$)}}} [19:23:56] that is the Zuul internal representation of the php53lint job [19:24:07] anddd [19:24:28] it only triggers when a patchset modify a file ending with either .php , .php5 , .phtml or .inc [19:24:29] ie [19:24:40] if you send a patchset that is only changing README , Zuul happily ignore the patch [19:25:08] and on +2 the change might just be stuck idling on the gate-and-submit waiting for jobs to reply but there is none [19:25:11] sorry long story [19:25:18] Zuul is nice and crappy at the same time [19:25:28] tox-jessie is always run, so that would at least solve that part [19:26:07] the labs/toollabs merge mystery is solved. JenkinsBot didn't have submit. I fixed that [19:26:27] (03CR) 10Hashar: "That ties labs/toolsllabs with a few repositories when voting CR+2 which I have explained to Bryan on IRC. It is not ideal but good enoug" [integration/config] - 10https://gerrit.wikimedia.org/r/288028 (owner: 10BryanDavis) [19:26:34] (03CR) 10Hashar: [C: 032] labs/toollabs: make tox-jessie voting [integration/config] - 10https://gerrit.wikimedia.org/r/288028 (owner: 10BryanDavis) [19:26:39] oh [19:26:45] lack of submit ... [19:26:56] it is supposed to have submit right everywhere but on /operations/ hierarchy [19:27:24] https://gerrit.wikimedia.org/r/#/admin/projects/labs/toollabs,access [19:27:29] (03Merged) 10jenkins-bot: labs/toollabs: make tox-jessie voting [integration/config] - 10https://gerrit.wikimedia.org/r/288028 (owner: 10BryanDavis) [19:27:40] I just added the direct Submit grant [19:28:16] bd808: deployed [19:28:22] neat. thanks [19:49:01] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Infrastructure, 07Blocked-on-Operations, 13Patch-For-Review, 07Puppet: Puppet fails on labs instances due to Ganglia (ex: using apache::site puppet class) - https://phabricator.wikimedia.org/T134808#2282461 (10Dzahn) @Hashar all 3 merged (after chec... [19:49:40] RECOVERY - Host integration-dev is UP: PING OK - Packet loss = 0%, RTA = 348.55 ms [19:50:19] 10Beta-Cluster-Infrastructure, 07Puppet, 07Tracking: Deployment-prep hosts with puppet errors (tracking) - https://phabricator.wikimedia.org/T132259#2282465 (10hashar) [19:50:23] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Infrastructure, 07Blocked-on-Operations, 13Patch-For-Review, 07Puppet: Puppet fails on labs instances due to Ganglia (ex: using apache::site puppet class) - https://phabricator.wikimedia.org/T134808#2282463 (10hashar) 05Open>03Resolved puppet co... [19:57:38] (03PS1) 10PleaseStand: SpaceyParenthesisSniff: Don't remove last argument or array element [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/288043 (https://phabricator.wikimedia.org/T134857) [20:02:59] (03CR) 10PleaseStand: "This caused T134857. Fix: https://gerrit.wikimedia.org/r/#/c/288043/" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/275796 (owner: 10Lethexie) [20:04:05] 06Release-Engineering-Team, 10MediaWiki-extensions-General-or-Unknown, 05Release: Notice: Unable to unserialize: [-1]. Expected ':' but got '1'. in /srv/mediawiki/php-1.28.0-wmf.1/includes/objectcache/RedisBagOStuff.php on line 313 - https://phabricator.wikimedia.org/T134923#2282493 (10hashar) [20:04:39] PROBLEM - Host integration-dev is DOWN: CRITICAL - Host Unreachable (10.68.17.81) [20:04:43] 06Release-Engineering-Team, 10MediaWiki-extensions-General-or-Unknown, 05Release: Notice: Unable to unserialize: [-1]. Expected ':' but got '1'. in /srv/mediawiki/php-1.28.0-wmf.1/includes/objectcache/RedisBagOStuff.php on line 313 - https://phabricator.wikimedia.org/T134923#2282493 (10hashar) No trace thoug... [20:15:21] (03CR) 10Jforrester: [C: 031] "Failing test would be good." [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/288043 (https://phabricator.wikimedia.org/T134857) (owner: 10PleaseStand) [20:16:28] 06Release-Engineering-Team, 10ReleaseTaggerBot: ReleaseTaggerBot broken since branching for 1.28 - https://phabricator.wikimedia.org/T134850#2279690 (10hashar) /me gives some tokens of some sort Thank you for the bot maintenance! [20:18:58] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06Operations, 10Ops-Access-Requests: Allow RelEng nova log access - https://phabricator.wikimedia.org/T133992#2282604 (10thcipriani) >>! In T133992#2279073, @Dzahn wrote: > @thcipriani could you specify who is "CI" and "the releng" team i... [20:19:38] RECOVERY - Host integration-dev is UP: PING OK - Packet loss = 0%, RTA = 0.79 ms [20:22:33] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06Operations, 10Ops-Access-Requests: Allow RelEng nova log access - https://phabricator.wikimedia.org/T133992#2282615 (10Krenair) what would be the rationale for only providing a subset of contint-admins access, and why specifically that... [20:30:37] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06Operations, 10Ops-Access-Requests: Allow RelEng nova log access - https://phabricator.wikimedia.org/T133992#2282661 (10hashar) We can revisit the list of contint-admins. I am not sure whether bd808, cscott, reedy or marktraceur still n... [20:47:11] PROBLEM - Host integration-dev is DOWN: CRITICAL - Host Unreachable (10.68.17.81) [20:54:46] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06Operations, 10Ops-Access-Requests: Allow RelEng nova log access - https://phabricator.wikimedia.org/T133992#2251644 (10bd808) I'd be glad to give up contint-admins membership. I haven't been active in supporting CI for quite a while. [21:05:29] noooo! :) bd808 ^ [21:06:01] greg-g: I'm not a hat collector ;) [21:06:35] also hello! [21:07:08] not collecting hats is not very Wikipedian :} [21:08:40] MaxSem: well I'm making up for it in Labs and Tool Labs I think [21:08:43] bd808: hello! [21:09:00] I hope you've been enjoying my kid-related photos/videos on twitter :) [21:09:09] Thank god I don't have to maintain contint anymore [21:09:14] It was really starting to wear me out. [21:10:11] greg-g: I've seen them fly by in the feed. :) [21:10:38] MarkTraceur: we're hear to make your life better [21:10:58] * bd808 makes MarkTraceur a shirt os people will know to give him food [21:11:05] greg-g: I can't believe how big Rowan is. [21:11:12] bd808: People give me food so often as it is [21:11:30] (03CR) 10Addshore: [C: 031] "I agree, a test for this would be great!" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/288043 (https://phabricator.wikimedia.org/T134857) (owner: 10PleaseStand) [21:14:50] RECOVERY - Host integration-dev is UP: PING OK - Packet loss = 0%, RTA = 1.23 ms [21:15:21] (03CR) 10Addshore: "Ahh wait, this is a fix, and so far I havn't figured out a way to test the fixiness..." [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/288043 (https://phabricator.wikimedia.org/T134857) (owner: 10PleaseStand) [21:19:05] MarkTraceur: he learned to pedal bike last night! in like 5 seconds! (after a year? on a balance bike) [21:19:22] no training wheels :) [21:19:29] * greg-g is a proud dad [21:23:12] PROBLEM - Host integration-dev is DOWN: CRITICAL - Host Unreachable (10.68.17.81) [21:31:55] greg-g: So great. [21:32:17] greg-g: I'm going to be that weird family friend who shows up once every five years and is like "I remember you when you were this big" [21:32:58] thcipriani, ori, twentyafterfour: so there seems to be an issue arming keyholder on mira.deployment-prep.eqiad.wmflabs [21:33:17] every time you run `sudo keyholder arm` you get "Enter passphrase for /etc/keyholder.d/phabricator: " [21:33:41] * thcipriani looks [21:33:50] if you give it the contents of deployment-puppetmaster:/var/lib/git/labs/private/modules/secret/secrets/keyholder/keyholder.pw, it says "Identity added: /etc/keyholder.d/phabricator (/etc/keyholder.d/phabricator)" [21:34:26] but it still prompts you again [21:34:59] that key seems to be listed in the agent output. [21:35:18] I have noticed that ssh-agent isn't very smart about what keys are already in the agent. [21:35:42] sudo /usr/lib/nagios/plugins/check_keyholder always fails on that instance [21:37:42] I actually think that's because there are more keys in the keyholder agent than there are on disk [21:37:56] lemme try something [21:40:29] krenair@mira:~$ sudo /usr/bin/ssh-add -l [21:40:30] Could not open a connection to your authentication agent. [21:40:41] (that's part of what check_keyholder tries to do) [21:41:18] check_keyholder seems happy now [21:41:48] I deleted all keys from the ssh-agent, then re-ran sudo keyholder arm [21:42:03] seems like the agent had some keys that were removed from disk. [21:42:18] krenair@mira:~$ sudo keyholder arm [21:42:18] /etc/keyholder.d/phabricator is not an acceptable key. Does it have a passphrase? [21:42:18] Identity added: /etc/keyholder.d/eventlogging (/etc/keyholder.d/eventlogging) [21:42:18] Identity added: /etc/keyholder.d/mwdeploy (/etc/keyholder.d/mwdeploy) [21:42:19] Enter passphrase for /etc/keyholder.d/phabricator: [21:43:09] yeah, I think you'll be prompted for the password everytime regardless. That's an ssh-agent thing I've noticed recently. [21:43:27] there's probably a simple workaround we could add to the keyholder script for that. [21:43:52] but: SSH_AUTH_SOCK=/run/keyholder/proxy.sock ssh-add -l shows all the keys in /etc/keyholder.d/ [21:54:41] RECOVERY - Host integration-dev is UP: PING OK - Packet loss = 0%, RTA = 1.17 ms [22:03:14] PROBLEM - Host integration-dev is DOWN: CRITICAL - Host Unreachable (10.68.17.81) [22:04:25] Krenair: thcipriani: I'll fix keyholder [22:04:43] so that it doesn't prompt for a password at all [22:26:22] what does "natural order" really mean on a Phab workboard? I'm thinking about changing the default to "priority order", but I want to make sure I understand the ominous warning [22:26:44] (default for #ArchCom-RFC, not default for everything) [22:28:36] robla: "Natural order" means cars stay where they are dragged to but don't change state. "Priority order" means dragging cards in the columns also changes their priority (and reflects that in their position). [22:32:19] * robla contemplates the implications of that [22:37:19] changed - https://phabricator.wikimedia.org/project/board/52/ . thanks James_F! [22:37:37] Always. [22:54:20] 10Continuous-Integration-Config, 10OOjs-UI: Move OOUI out of the MediaWiki gate-and-submit queue - https://phabricator.wikimedia.org/T134946#2283244 (10Jdforrester-WMF) [22:54:51] 10Continuous-Integration-Config, 10OOjs-UI: Move OOUI out of the MediaWiki gate-and-submit queue - https://phabricator.wikimedia.org/T134946#2283268 (10Jdforrester-WMF) @Paladox, do you know how to do this for us? [22:56:03] 10Continuous-Integration-Config, 10OOjs-UI: Move OOUI out of the MediaWiki gate-and-submit queue - https://phabricator.wikimedia.org/T134946#2283270 (10Paladox) @Jdforrester-WMF I kind of do, do you want all the tests done or just a certain one. [22:56:54] 10Continuous-Integration-Config, 10OOjs-UI: Move OOUI out of the MediaWiki gate-and-submit queue - https://phabricator.wikimedia.org/T134946#2283271 (10Jdforrester-WMF) >>! In T134946#2283270, @Paladox wrote: > @Jdforrester-WMF I kind of do, do you want all the tests done or just a certain one. All is fine (a... [23:00:11] James_F you would also like jsonlint and jshint out of it too. [23:00:31] I don't understand your question. [23:02:07] James_F: Would you like me to also move jsonlint and jshint to, meaning take them out of mw gate and submit. [23:02:21] I would need to renamed the test's so they have prefixed. [23:02:36] It would go a little like https://phabricator.wikimedia.org/rCICFd8e482348713bb09282c8c8a83bb30a7cc854c3b [23:03:17] Oh, you can't move them out of the queue without renaming the jobs? [23:03:19] RECOVERY - Host integration-dev is UP: PING OK - Packet loss = 0%, RTA = 0.68 ms [23:04:47] James_F: Nope [23:05:45] :-( [23:09:00] paladox: Maybe leave it for hashar to come up with a neat solution for now, then? [23:09:46] James_F: I doint think there is a neat solution currently, since all the tests are bound to mw gate and submit [23:09:52] * James_F nods. [23:14:14] PROBLEM - Host integration-dev is DOWN: CRITICAL - Host Unreachable (10.68.17.81) [23:21:35] (03PS1) 10Paladox: Allow decoupling of npm* and rake-jessie and jshint and jsonlint tests [integration/config] - 10https://gerrit.wikimedia.org/r/288128 (https://phabricator.wikimedia.org/T134946) [23:21:41] James_F ^^ [23:23:36] The only thing im not sure about is the composer test. But ive moved most tests to uncouple them. But i also managed to reduce some duplicate code too into similer code :) [23:24:19] (03CR) 10Paladox: "@Hashar the only thing I'm not sure about is the composer test." [integration/config] - 10https://gerrit.wikimedia.org/r/288128 (https://phabricator.wikimedia.org/T134946) (owner: 10Paladox) [23:32:13] RECOVERY - Host integration-dev is UP: PING OK - Packet loss = 0%, RTA = 0.81 ms [23:36:43] 10Continuous-Integration-Config, 10OOjs-UI, 13Patch-For-Review: Move OOUI out of the MediaWiki gate-and-submit queue - https://phabricator.wikimedia.org/T134946#2283467 (10Paladox) @Jdforrester-WMF I think I fixed this in the above patch, only thing which I left a comment there is about compser since I'm no... [23:48:16] PROBLEM - Host integration-dev is DOWN: CRITICAL - Host Unreachable (10.68.17.81)