[00:59:20] <shinken-wm>	 PROBLEM - Puppet run on integration-slave-trusty-1006 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0]
[01:13:06] <shinken-wm>	 PROBLEM - Puppet run on integration-slave-trusty-1003 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0]
[01:16:43] <shinken-wm>	 PROBLEM - Puppet run on integration-slave-precise-1011 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0]
[01:25:25] <wikibugs>	 10MediaWiki-Codesniffer: Undefined index: scope_opener in MediaWiki/Sniffs/Usage/ExtendClassUsageSniff.php - https://phabricator.wikimedia.org/T154731#2922176 (10Samwilson)
[01:30:58] <wikibugs>	 (03PS1) 10Samwilson: Prevent abstract functions being marked eligable [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/330834 (https://phabricator.wikimedia.org/T154731)
[01:34:44] <wikibugs>	 10MediaWiki-Codesniffer: Release v0.8.0 - https://phabricator.wikimedia.org/T154715#2922243 (10Samwilson)
[01:34:46] <wikibugs>	 10MediaWiki-Codesniffer, 13Patch-For-Review: Undefined index: scope_opener in MediaWiki/Sniffs/Usage/ExtendClassUsageSniff.php - https://phabricator.wikimedia.org/T154731#2922242 (10Samwilson)
[01:39:21] <shinken-wm>	 RECOVERY - Puppet run on integration-slave-trusty-1006 is OK: OK: Less than 1.00% above the threshold [0.0]
[01:40:10] <wikibugs>	 10Gerrit, 06Release-Engineering-Team, 07Upstream: Gerrit java.lang.ArrayIndexOutOfBoundsException when querying changes - https://phabricator.wikimedia.org/T153642#2922247 (10Paladox) @hashar hi, could you try again as the update to gerrit that was deployed today should fix it please?
[01:42:35] <wikibugs>	 10MediaWiki-Codesniffer: Release v0.8.0 - https://phabricator.wikimedia.org/T154715#2921575 (10Samwilson) Not that it's related, but in testing the upgrade to 2.7.1 I came across T154731, which should probably be merged before a new release (if it's valid).
[01:45:29] <wikibugs>	 (03CR) 10Legoktm: [C: 032] Prevent abstract functions being marked eligable [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/330834 (https://phabricator.wikimedia.org/T154731) (owner: 10Samwilson)
[01:45:49] <wikibugs>	 10MediaWiki-Codesniffer: Release v0.8.0 - https://phabricator.wikimedia.org/T154715#2922254 (10Paladox) yes, thanks, we should merge your change + the phpcs upgrade at the same time. Thanks for testing it.
[01:46:07] <wikibugs>	 (03PS2) 10Legoktm: Prevent abstract functions being marked eligible [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/330834 (https://phabricator.wikimedia.org/T154731) (owner: 10Samwilson)
[01:46:14] <wikibugs>	 (03CR) 10Legoktm: [C: 032] Prevent abstract functions being marked eligible [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/330834 (https://phabricator.wikimedia.org/T154731) (owner: 10Samwilson)
[01:48:39] <wikibugs>	 (03Merged) 10jenkins-bot: Prevent abstract functions being marked eligible [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/330834 (https://phabricator.wikimedia.org/T154731) (owner: 10Samwilson)
[01:49:58] <shinken-wm>	 RECOVERY - Puppet run on integration-slave-precise-1012 is OK: OK: Less than 1.00% above the threshold [0.0]
[01:51:42] <shinken-wm>	 RECOVERY - Puppet run on integration-slave-precise-1011 is OK: OK: Less than 1.00% above the threshold [0.0]
[01:53:04] <shinken-wm>	 RECOVERY - Puppet run on integration-slave-trusty-1003 is OK: OK: Less than 1.00% above the threshold [0.0]
[01:54:05] <shinken-wm>	 RECOVERY - Puppet run on integration-slave-precise-1002 is OK: OK: Less than 1.00% above the threshold [0.0]
[01:54:51] <shinken-wm>	 RECOVERY - Puppet run on integration-slave-jessie-1001 is OK: OK: Less than 1.00% above the threshold [0.0]
[02:02:09] <wikibugs>	 10MediaWiki-Codesniffer, 13Patch-For-Review: Undefined index: scope_opener in MediaWiki/Sniffs/Usage/ExtendClassUsageSniff.php - https://phabricator.wikimedia.org/T154731#2922281 (10Samwilson) I've found some other errors of a similar type. Will send new patch.
[02:02:19] <wikibugs>	 10MediaWiki-Codesniffer, 13Patch-For-Review: Undefined index: scope_opener in MediaWiki/Sniffs/Usage/ExtendClassUsageSniff.php - https://phabricator.wikimedia.org/T154731#2922282 (10Samwilson) p:05Triage>03Normal
[02:03:04] <wikibugs>	 06Release-Engineering-Team, 10Wikimedia-Developer-Summit, 06Developer-Relations (Oct-Dec-2016), 07Documentation: Developer Summit 2017: Work with TPG and RelEng on solution to event documenting - https://phabricator.wikimedia.org/T132400#2922284 (10srishakatux) Related and recently updated documents are be...
[02:14:03] <shinken-wm>	 PROBLEM - Puppet run on integration-slave-trusty-1003 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0]
[02:17:29] <shinken-wm>	 PROBLEM - Puppet run on deployment-urldownloader is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0]
[02:21:09] <wikibugs>	 10Deployment-Systems, 10Wikimedia-Logstash, 13Patch-For-Review, 07Wikimedia-Incident: Check same set of errors/warnings/fatals in scap logstash_checker.py as there is in `fatalmonitor` on fluorine - https://phabricator.wikimedia.org/T142784#2922325 (10Krinkle)
[02:23:01] <wikibugs>	 10Deployment-Systems, 10Wikimedia-Logstash, 13Patch-For-Review, 07Wikimedia-Incident: Check same set of errors/warnings/fatals in scap logstash_checker.py as there is in `fatalmonitor` on fluorine - https://phabricator.wikimedia.org/T142784#2546271 (10Krinkle) What about [20170104-MonologSpi](https://wikit...
[02:23:06] <Krinkle>	 greg-g: ^
[02:23:58] <Krinkle>	 (also, fixed incident report days-ago on https://wikitech.wikimedia.org/wiki/Incident_documentation )
[02:24:03] <Krinkle>	 Was caused by one of the incident reports not following the proper title convention, so the Lua module exploded a bit
[02:33:08] <bd808>	 I l<3 that bit of crazy lua you wrote Krinkle 
[02:34:31] <Krinkle>	 bd808: hehe, thanks :)
[02:34:31] <Krinkle>	 bd808: I'm mostly glad I could get rid of this hack - https://wikitech.wikimedia.org/w/index.php?title=Module:Days_since_incidents/since&diff=next&oldid=326643
[02:35:36] <Krinkle>	 I think this was my first Lua module btw. Still not sure how it reads to somehow who knows the language better.
[02:35:37] <Krinkle>	 someone*
[02:49:04] <shinken-wm>	 RECOVERY - Puppet run on integration-slave-trusty-1003 is OK: OK: Less than 1.00% above the threshold [0.0]
[02:57:30] <shinken-wm>	 RECOVERY - Puppet run on deployment-urldownloader is OK: OK: Less than 1.00% above the threshold [0.0]
[04:09:37] <wmf-insecte>	 Project selenium-MultimediaViewer » safari,beta,OS X 10.9,contintLabsSlave && UbuntuTrusty build #257: 04FAILURE in 12 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,label=contintLabsSlave%20&&%20UbuntuTrusty/257/
[04:12:44] <wikibugs>	 10Gerrit, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review, 07Upstream: Gerrit: Restarting gerrit could lead to data loss + maybe accounts - https://phabricator.wikimedia.org/T154205#2922451 (10demon) 05Open>03Resolved a:03demon This rolled out today
[04:13:01] <wikibugs>	 10Gerrit, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review, 07Upstream: Gerrit: Restarting gerrit could lead to data loss + maybe accounts - https://phabricator.wikimedia.org/T154205#2922457 (10demon)
[04:14:29] <wikibugs>	 10Gerrit: Rename mediawiki/extensions/normal repository to mediawiki/php/normal - https://phabricator.wikimedia.org/T86033#2922458 (10demon) 05stalled>03declined We don't rename repositories.
[04:14:55] <wikibugs>	 10Gerrit, 06Repository-Admins, 13Patch-For-Review: Rename the Semantic Forms extension to "Page Forms" - https://phabricator.wikimedia.org/T147582#2922461 (10demon) 05Open>03declined We don't rename repositories, plus this already happened as a second repo entirely.
[04:15:12] <wikibugs>	 10Gerrit, 10SyntaxHighlight: Rename git repo to "SyntaxHighlight" - https://phabricator.wikimedia.org/T103614#2922464 (10demon) 05Open>03declined We don't rename repositories, plus this already happened as a second repo entirely.
[04:17:23] <wikibugs>	 10Gerrit, 10Math, 07Documentation: Productivity: Best practices for rebasing changes - https://phabricator.wikimedia.org/T120182#2922468 (10demon) 05Open>03Invalid There's not really much to be done here on the gerrit side -- rebasing can be done on the web (via the rebase button) where you can define th...
[04:20:38] <wmf-insecte>	 Project selenium-MultimediaViewer » chrome,beta,OS X 10.9,contintLabsSlave && UbuntuTrusty build #257: 04FAILURE in 23 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,label=contintLabsSlave%20&&%20UbuntuTrusty/257/
[04:22:38] <wikibugs>	 10Continuous-Integration-Config, 13Patch-For-Review: Convert operations/mediawiki-config to use composer for phpunit and php linting - https://phabricator.wikimedia.org/T85947#2922475 (10Krinkle) I'll take this on further and try use the composer-fetch-dev script. That way we will still be testing with the com...
[04:22:47] <wikibugs>	 10Continuous-Integration-Config, 13Patch-For-Review: Convert operations/mediawiki-config to use composer for phpunit and php linting - https://phabricator.wikimedia.org/T85947#2922476 (10Krinkle) a:05Legoktm>03Krinkle
[04:24:06] <wikibugs>	 10Gerrit: In Gerrit, clear watchlist of several accounts that are no more used (to avoid mail server errors) - https://phabricator.wikimedia.org/T113926#2922478 (10demon) 05Open>03Resolved a:03demon How did I miss this task for so long? Resolved.
[04:28:33] <wikibugs>	 10Gerrit, 06Repository-Admins, 10Wikidata: Deactivate/archive WikibaseQueryEngine - https://phabricator.wikimedia.org/T141858#2922482 (10demon)
[04:29:00] <wikibugs>	 10Gerrit, 06Repository-Admins, 10Wikidata: Deactivate/archive WikibaseQueryEngine - https://phabricator.wikimedia.org/T141858#2514694 (10demon) What's left to do here? I see no such repo on Gerrit or Wikimedia's github. Just the top 2 bullet points?
[04:29:39] <wikibugs>	 10Gerrit, 06Repository-Admins, 10Wikidata: Deactivate/archive WikibaseDatabase - https://phabricator.wikimedia.org/T141865#2514917 (10demon) I see no such repo in Gerrit or Github, we must've already handled it. What's left to do here?
[04:34:45] <wikibugs>	 10Gerrit, 10GitHub-Mirrors, 10Librarization: Move wikimedia/assert to gerrit or wikimedia's github account - https://phabricator.wikimedia.org/T114330#1691742 (10demon) This lives at [[https://gerrit.wikimedia.org/r/#/admin/projects/mediawiki/libs/Assert | mediawiki/libs/Assert ]] -- anything left to do?
[04:36:13] <wikibugs>	 10Gerrit: Creating a patch on the inline editor has some problems in gerrit 2.13 - https://phabricator.wikimedia.org/T152931#2922491 (10demon) Is this related to T154205?
[04:37:41] <wikibugs>	 10Continuous-Integration-Infrastructure: Support installing composer require-dev packages together with mediawiki/vendor - https://phabricator.wikimedia.org/T112895#2922495 (10Krinkle)
[04:37:43] <wikibugs>	 10Continuous-Integration-Infrastructure, 07Composer: Come up with non sucky solution for running "composer test" on repos that have vendor/ checked in - https://phabricator.wikimedia.org/T92605#2922494 (10Krinkle)
[04:38:04] <wikibugs>	 10Gerrit, 06Labs: Strange errors when cloning operations/mediawiki-config from gerrit to labs NFS - https://phabricator.wikimedia.org/T142787#2922497 (10demon)
[04:38:09] <wikibugs>	 10Gerrit, 06Labs, 10Pywikibot-core, 10Tool-Labs: Fresh clone of pywikibot from gerrit fails with error: RPC failed; result=56, HTTP code = 200 on Toollabs - https://phabricator.wikimedia.org/T151351#2922500 (10demon)
[04:38:17] <wikibugs>	 10Gerrit, 06Labs: Strange errors when cloning operations/mediawiki-config from gerrit to labs NFS - https://phabricator.wikimedia.org/T142787#2546348 (10demon) (Yes, this is the older task but that one has more comments/details)
[04:38:29] <wikibugs>	 10Gerrit, 06Labs, 10Pywikibot-core, 10Tool-Labs: Fresh clone of pywikibot from gerrit fails with error: RPC failed; result=56, HTTP code = 200 on Toollabs (NFS) - https://phabricator.wikimedia.org/T151351#2814978 (10demon)
[04:40:00] <wikibugs>	 10Gerrit: Extensions lagging in mediawiki/extensions meta repo - https://phabricator.wikimedia.org/T119333#2922505 (10demon) 05Open>03Resolved a:03demon Shouldn't be anymore
[04:41:27] <wikibugs>	 (03PS1) 10Krinkle: Add fetch-composer-dev.sh script (derived from mw-fetch-composer-dev.sh) [integration/jenkins] - 10https://gerrit.wikimedia.org/r/330842 (https://phabricator.wikimedia.org/T92605)
[04:42:10] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Add fetch-composer-dev.sh script (derived from mw-fetch-composer-dev.sh) [integration/jenkins] - 10https://gerrit.wikimedia.org/r/330842 (https://phabricator.wikimedia.org/T92605) (owner: 10Krinkle)
[04:43:59] <wikibugs>	 10Gerrit: Code merged for core without verified score shown - https://phabricator.wikimedia.org/T45485#2922514 (10demon) 05Open>03Resolved a:03demon Tentatively resolving.
[04:45:36] <wikibugs>	 (03PS1) 10Krinkle: Add operations-mw-config-composer-jessie job [integration/config] - 10https://gerrit.wikimedia.org/r/330843 (https://phabricator.wikimedia.org/T92605)
[04:47:30] <wikibugs>	 (03PS2) 10Krinkle: Add fetch-composer-dev.sh script (derived from mw-fetch-composer-dev.sh) [integration/jenkins] - 10https://gerrit.wikimedia.org/r/330842 (https://phabricator.wikimedia.org/T92605)
[04:48:05] <ostriches>	 Ok I'm done with my gerrit bugspam
[04:48:12] <wikibugs>	 10Continuous-Integration-Infrastructure, 07Composer, 13Patch-For-Review: Come up with non sucky solution for running "composer test" on repos that have vendor/ checked in - https://phabricator.wikimedia.org/T92605#2922521 (10Krinkle) a:03Krinkle
[04:48:20] <wikibugs>	 (03CR) 10Krinkle: [C: 032] Add fetch-composer-dev.sh script (derived from mw-fetch-composer-dev.sh) [integration/jenkins] - 10https://gerrit.wikimedia.org/r/330842 (https://phabricator.wikimedia.org/T92605) (owner: 10Krinkle)
[04:49:15] <wikibugs>	 (03Merged) 10jenkins-bot: Add fetch-composer-dev.sh script (derived from mw-fetch-composer-dev.sh) [integration/jenkins] - 10https://gerrit.wikimedia.org/r/330842 (https://phabricator.wikimedia.org/T92605) (owner: 10Krinkle)
[04:50:05] <wikibugs>	 (03CR) 10Krinkle: [C: 032] "Added as experimental job. Pushed to Jenkins." [integration/config] - 10https://gerrit.wikimedia.org/r/330843 (https://phabricator.wikimedia.org/T92605) (owner: 10Krinkle)
[04:51:25] <wikibugs>	 (03Merged) 10jenkins-bot: Add operations-mw-config-composer-jessie job [integration/config] - 10https://gerrit.wikimedia.org/r/330843 (https://phabricator.wikimedia.org/T92605) (owner: 10Krinkle)
[04:56:16] <Krinkle>	 !log Reloading Zuul to deploy  https://gerrit.wikimedia.org/r/330843
[04:56:52] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[05:23:52] <wikibugs>	 (03PS1) 10Krinkle: Fixup operations-mw-config-composer-jessie job [integration/config] - 10https://gerrit.wikimedia.org/r/330845
[05:42:19] <TimStarling>	 I'm adding RemexHtml to packagist
[05:54:49] <wikibugs>	 (03CR) 10Samwilson: [C: 031] Update PHP_CodeSniffer to 2.7.1 [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/330785 (owner: 10Paladox)
[05:57:18] <wikibugs>	 10MediaWiki-Codesniffer, 13Patch-For-Review: Undefined index: scope_opener in MediaWiki/Sniffs/Usage/ExtendClassUsageSniff.php - https://phabricator.wikimedia.org/T154731#2922689 (10Samwilson) I'm getting different results for the same file when running it as part of a whole set of directories vs running it ju...
[06:35:07] <wmf-insecte>	 Project selenium-Wikibase » chrome,test,Linux,contintLabsSlave && UbuntuTrusty build #230: 04FAILURE in 1 hr 54 min: https://integration.wikimedia.org/ci/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=test,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/230/
[06:47:30] <wikibugs>	 (03PS1) 10Samwilson: Explicitely check for method structure before using [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/330846 (https://phabricator.wikimedia.org/T154731)
[06:55:34] <wikibugs>	 10MediaWiki-Codesniffer, 13Patch-For-Review: Undefined index: scope_opener in MediaWiki/Sniffs/Usage/ExtendClassUsageSniff.php - https://phabricator.wikimedia.org/T154731#2922731 (10Samwilson) Sad to say I've not figured it out, but I've uploaded a patch that does fix it. (The worst sort of patch, I know.)  Se...
[08:13:00] <wikibugs>	 10Gerrit: Creating a patch on the inline editor has some problems in gerrit 2.13 - https://phabricator.wikimedia.org/T152931#2922851 (10Paladox) Nope as it happends on upstream too. Plus can still reproduce. I noticed it doing this when you add reviewers to the patch.
[09:08:39] <wikibugs>	 10Gerrit, 06Release-Engineering-Team, 07Upstream: Gerrit java.lang.ArrayIndexOutOfBoundsException when querying changes - https://phabricator.wikimedia.org/T153642#2922876 (10hashar) 05Open>03Resolved a:03hashar Yup apparently that specific error is gone now :]
[09:18:54] <hashar>	 ahhh
[09:19:18] <hashar>	 an upstream tagging releases \O/ https://github.com/watir/watir/issues/519#issuecomment-270844467  
[09:45:47] <wikibugs>	 (03PS2) 10Hashar: Fix javadoc generation for search projects [integration/config] - 10https://gerrit.wikimedia.org/r/330683 (owner: 10DCausse)
[09:47:14] <dcausse>	 wow nice ^
[09:48:13] <wikibugs>	 (03CR) 10DCausse: [C: 031] Fix javadoc generation for search projects [integration/config] - 10https://gerrit.wikimedia.org/r/330683 (owner: 10DCausse)
[09:48:52] <wikibugs>	 (03CR) 10Hashar: "I have tweaked the change so the javadoc jobs get their list of goals from a JJB variable "javadocgoals"." [integration/config] - 10https://gerrit.wikimedia.org/r/330683 (owner: 10DCausse)
[09:49:08] <hashar>	 dcausse: I spent like 40 minutes yesterday trying to find a solution
[09:49:21] <hashar>	 eventually went to my local hacker group meeting, had a bunch of beer and suddenly this morning
[09:49:23] <hashar>	 Eureka!
[09:49:28] <dcausse>	 :)
[09:49:45] <wikibugs>	 (03PS3) 10Hashar: Fix javadoc generation for search projects [integration/config] - 10https://gerrit.wikimedia.org/r/330683 (owner: 10DCausse)
[09:49:50] <dcausse>	 beer is always THE solution :)
[09:56:16] <wikibugs>	 10Gerrit: 404 downloading any changes with https remote url: "The requested URL /changes/ was not found" - https://phabricator.wikimedia.org/T154760#2922987 (10Aklapper)
[09:57:22] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Gerrit, 07Zuul: "Depends on" tests both change cherry-picked from and cherry-pick patch itself; should only test cherry-pick patch itself - https://phabricator.wikimedia.org/T154359#2923010 (10Aklapper)
[10:00:30] <hashar>	 dcausse: and of course on my Debian "clean package javadoc:aggregate -Dmaven.test.skip=true"  fails :D
[10:00:42] <dcausse>	 hu?
[10:00:54] <hashar>	 on search/highlighter
[10:01:37] <dcausse>	 hashar: you've tested with https://gerrit.wikimedia.org/r/#/c/330679/ ?
[10:02:08] <hashar>	 I am just hitting hard on my keyboard
[10:04:44] <hashar>	 dcausse: yeah that one pass :]
[10:05:00] <dcausse>	 nice :)
[10:05:28] <wikibugs>	 (03CR) 10Hashar: [C: 032] "Pass with https://gerrit.wikimedia.org/r/#/c/330679/ :)" [integration/config] - 10https://gerrit.wikimedia.org/r/330683 (owner: 10DCausse)
[10:05:56] <dcausse>	 hashar: thanks!
[10:06:24] <wikibugs>	 (03Merged) 10jenkins-bot: Fix javadoc generation for search projects [integration/config] - 10https://gerrit.wikimedia.org/r/330683 (owner: 10DCausse)
[10:06:44] <hashar>	 and the jjb config has less duplicated code as a result Oo
[10:09:26] <dcausse>	 indeed :)
[10:51:18] <wikibugs>	 10Gerrit: 404 downloading any changes with https remote url: "The requested URL /changes/ was not found" - https://phabricator.wikimedia.org/T154760#2922987 (10Paladox) This is a known problem, I think there's a task around here but I carnt find it todo with this.  Try using ssh as the workaround.  Or look in .g...
[10:51:19] <wikibugs>	 (03PS1) 10Hashar: test: invoke rspec directly [selenium] - 10https://gerrit.wikimedia.org/r/330856
[10:51:29] <hashar>	 aoraoezia
[10:51:32] <hashar>	 phantomjs ... :(
[10:56:20] <wikibugs>	 10Gerrit: 404 downloading any changes with https remote url: "The requested URL /changes/ was not found" - https://phabricator.wikimedia.org/T154760#2923149 (10Paladox) We could do a redirect rule to redirect changes to /r/changes/
[11:16:29] <wikibugs>	 (03PS2) 10Hashar: test: invoke rspec directly [selenium] - 10https://gerrit.wikimedia.org/r/330856 (https://phabricator.wikimedia.org/T137112)
[11:23:10] <wikibugs>	 (03CR) 10Hashar: "That caused issue on the Jessie instances which I reproduce on my local Jessie machine :]" [selenium] - 10https://gerrit.wikimedia.org/r/330856 (https://phabricator.wikimedia.org/T137112) (owner: 10Hashar)
[11:58:01] <wikibugs>	 (03PS1) 10Hashar: (WIP) have cucumber to auto install phantomjs (WIP) [selenium] - 10https://gerrit.wikimedia.org/r/330864
[12:45:17] <wikibugs>	 10Beta-Cluster-Infrastructure, 13Patch-For-Review, 15User-Ladsgroup, 03Wikidata-Sprint-2016-11-15: Make beta German Wiktionary - https://phabricator.wikimedia.org/T150764#2923255 (10Micru)
[12:46:56] <wikibugs>	 (03CR) 10Hashar: "The aim is to move the mediawiki-selenium-integration job to Nodepool which does not have PhantomJS.   It is not available on Debian Jessi" (034 comments) [selenium] - 10https://gerrit.wikimedia.org/r/330864 (owner: 10Hashar)
[12:47:46] <wikibugs>	 10Browser-Tests-Infrastructure, 05Continuous-Integration-Scaling, 13Patch-For-Review, 15User-zeljkofilipin: migrate mwext-mw-selenium to Nodepool instances - https://phabricator.wikimedia.org/T137112#2923257 (10hashar) The Nodepool version of mediawiki-selenium-integration pass with the two above patches :]
[13:07:34] <wikibugs>	 10Gerrit, 13Patch-For-Review: 404 downloading any changes with https remote url: "The requested URL /changes/ was not found" - https://phabricator.wikimedia.org/T154760#2923283 (10hashar) >>! In T100987#1497954, @hashar wrote: > The root cause is git-review looks at the remote URL then does: > ``` >>>> import...
[13:07:46] <wikibugs>	 10Gerrit, 13Patch-For-Review: 404 downloading any changes with https remote url: "The requested URL /changes/ was not found" - https://phabricator.wikimedia.org/T154760#2923291 (10hashar)
[13:07:48] <wikibugs>	 10Gerrit, 07Upstream: "git review -d XXX" doesn't work for http gerrit - https://phabricator.wikimedia.org/T100987#1325879 (10hashar)
[13:08:10] <wikibugs>	 10Gerrit, 07Upstream: "git review -d XXX" doesn't work for http gerrit - https://phabricator.wikimedia.org/T100987#1325879 (10hashar)
[13:08:12] <wikibugs>	 10Gerrit: Cannot download changes from gerrit: "The requested URL /changes/ was not found on this server." - https://phabricator.wikimedia.org/T147044#2923296 (10hashar)
[13:23:11] <wikibugs>	 (03CR) 10Hashar: "We did but the mediawiki/selenium integration tests (cucumber) still relies on PhantomJS.  Did a patch to automagically install it https:/" [integration/config] - 10https://gerrit.wikimedia.org/r/330675 (https://phabricator.wikimedia.org/T137112) (owner: 10Hashar)
[13:47:47] <wmf-insecte>	 Yippee, build fixed!
[13:47:47] <wmf-insecte>	 Project selenium-VisualEditor » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #266: 09FIXED in 2 min 46 sec: https://integration.wikimedia.org/ci/job/selenium-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/266/
[15:10:12] <wikibugs>	 10Gerrit, 07Upstream: "git review -d XXX" doesn't work for http gerrit - https://phabricator.wikimedia.org/T100987#2923505 (10Paladox) Found it  https://github.com/openstack-infra/git-review/blob/67dbbc2e59b0b104c9de0a8ab1d39ca54e9845ca/git_review/cmd.py#L571  Probably want to add either /r/ on the end of the...
[15:39:49] <shinken-wm>	 PROBLEM - Puppet run on deployment-phab02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[15:53:40] <wikibugs>	 (03PS1) 10Hashar: [labs/tools/crosswatch] make tox voting [integration/config] - 10https://gerrit.wikimedia.org/r/330921
[15:54:26] <wikibugs>	 (03CR) 10Hashar: [C: 032] [labs/tools/crosswatch] make tox voting [integration/config] - 10https://gerrit.wikimedia.org/r/330921 (owner: 10Hashar)
[15:55:10] <wikibugs>	 (03Merged) 10jenkins-bot: [labs/tools/crosswatch] make tox voting [integration/config] - 10https://gerrit.wikimedia.org/r/330921 (owner: 10Hashar)
[16:04:59] <wmf-insecte>	 Project beta-code-update-eqiad build #137664: 15ABORTED in 1 min 0 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/137664/
[16:06:59] <shinken-wm>	 PROBLEM - Puppet run on deployment-eventlogging04 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0]
[16:11:48] <shinken-wm>	 PROBLEM - Puppet run on deployment-restbase01 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0]
[16:14:53] <shinken-wm>	 PROBLEM - Puppet run on deployment-mathoid is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0]
[16:18:34] <shinken-wm>	 PROBLEM - Puppet run on deployment-parsoid09 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0]
[16:23:31] <wikibugs>	 (03PS9) 10Hashar: (WIP) test Zuul gate configuration (WIP) [integration/config] - 10https://gerrit.wikimedia.org/r/173831
[16:24:00] <hashar>	 !log Nodepool Image ci-trusty-wikimedia-1483719370 in wmflabs-eqiad is ready
[16:24:04] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[16:25:15] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] (WIP) test Zuul gate configuration (WIP) [integration/config] - 10https://gerrit.wikimedia.org/r/173831 (owner: 10Hashar)
[16:27:12] <wikibugs>	 (03Abandoned) 10Hashar: [wikidata/query/gui-deploy] make npm test voting [integration/config] - 10https://gerrit.wikimedia.org/r/291736 (owner: 10Paladox)
[16:30:50] <wikibugs>	 (03Abandoned) 10Hashar: Update test-requirements.txt to use jessie and not precise [integration/config] - 10https://gerrit.wikimedia.org/r/322500 (owner: 10Paladox)
[16:31:24] <hashar>	 !log Nodepool Image ci-jessie-wikimedia-1483719758 in wmflabs-eqiad is ready
[16:31:29] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[16:33:41] <wikibugs>	 (03Abandoned) 10Hashar: [ZoomableImages] add endpoint [integration/config] - 10https://gerrit.wikimedia.org/r/323438 (owner: 10Gergő Tisza)
[16:39:17] <wikibugs>	 (03PS1) 10Hashar: [ZoomableImages] add composer-test [integration/config] - 10https://gerrit.wikimedia.org/r/330932
[16:39:31] <wikibugs>	 (03CR) 10Hashar: [C: 032] [ZoomableImages] add composer-test [integration/config] - 10https://gerrit.wikimedia.org/r/330932 (owner: 10Hashar)
[16:40:35] <wikibugs>	 (03Merged) 10jenkins-bot: [ZoomableImages] add composer-test [integration/config] - 10https://gerrit.wikimedia.org/r/330932 (owner: 10Hashar)
[16:42:01] <shinken-wm>	 RECOVERY - Puppet run on deployment-eventlogging04 is OK: OK: Less than 1.00% above the threshold [0.0]
[16:42:30] <wikibugs>	 10Gerrit, 06Release-Engineering-Team, 06Operations: setup/install gerrit2001/WMF6408 - https://phabricator.wikimedia.org/T152525#2923650 (10Papaul)
[16:51:48] <shinken-wm>	 RECOVERY - Puppet run on deployment-restbase01 is OK: OK: Less than 1.00% above the threshold [0.0]
[16:53:35] <shinken-wm>	 RECOVERY - Puppet run on deployment-parsoid09 is OK: OK: Less than 1.00% above the threshold [0.0]
[16:54:50] <shinken-wm>	 RECOVERY - Puppet run on deployment-mathoid is OK: OK: Less than 1.00% above the threshold [0.0]
[17:08:34] <wikibugs>	 (03PS4) 10Hashar: Whitelist user SamanthaNguyen [integration/config] - 10https://gerrit.wikimedia.org/r/329362 (owner: 10Paladox)
[17:08:41] <wikibugs>	 (03CR) 10Hashar: [C: 032] Whitelist user SamanthaNguyen [integration/config] - 10https://gerrit.wikimedia.org/r/329362 (owner: 10Paladox)
[17:09:31] <wikibugs>	 (03Merged) 10jenkins-bot: Whitelist user SamanthaNguyen [integration/config] - 10https://gerrit.wikimedia.org/r/329362 (owner: 10Paladox)
[17:11:04] <wikibugs>	 (03Abandoned) 10Hashar: Add a puppet compiler pipeline [integration/config] - 10https://gerrit.wikimedia.org/r/325109 (owner: 10Paladox)
[17:24:54] <wikibugs>	 (03CR) 10Paladox: "> Abandoned" [integration/config] - 10https://gerrit.wikimedia.org/r/325109 (owner: 10Paladox)
[17:39:55] <wikibugs>	 10MediaWiki-Codesniffer: Closure formatting is ugly - https://phabricator.wikimedia.org/T154789#2923866 (10Aleksey_WMDE)
[17:44:28] <wikibugs>	 10MediaWiki-Codesniffer: Closure formatting is ugly - https://phabricator.wikimedia.org/T154789#2923886 (10Aleksey_WMDE) It is of course up to discussion, but I would suggest to allow one line closures, because some times there is a need to pass empty closure as an argument and then you always have to chop down...
[18:58:39] <wikibugs>	 06Release-Engineering-Team, 10Wikimedia-Developer-Summit, 06Developer-Relations (Oct-Dec-2016), 07Documentation: Developer Summit 2017: Work with TPG and RelEng on solution to event documenting - https://phabricator.wikimedia.org/T132400#2924089 (10ksmith) @srishakatux : I don't have rights to view that go...
[19:03:26] <wikibugs>	 10Gerrit, 13Patch-For-Review: Gerrit bug search not (naively) working with Phabricator tasks - https://phabricator.wikimedia.org/T85002#2924101 (10Paladox) 05Open>03Resolved a:03Paladox This now works.  See https://gerrit.wikimedia.org/r/#/q/bug:T1  All new changes will be able to do search doing that....
[19:22:47] <icinga-wm>	 PROBLEM - puppet last run on contint2001 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[lswh]
[19:23:11] <paladox>	 ^^ known error, it was a typo
[19:23:19] <shinken-wm>	 PROBLEM - Puppet run on deployment-eventlogging03 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0]
[19:23:47] <shinken-wm>	 PROBLEM - Puppet run on deployment-mx is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0]
[19:24:05] <shinken-wm>	 PROBLEM - Puppet run on deployment-aqs01 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0]
[19:24:19] <shinken-wm>	 PROBLEM - Puppet run on deployment-trending01 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0]
[19:25:21] <shinken-wm>	 PROBLEM - Puppet run on integration-slave-jessie-android is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0]
[19:26:04] <shinken-wm>	 PROBLEM - Puppet run on deployment-kafka05 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0]
[19:26:06] <shinken-wm>	 PROBLEM - Puppet run on deployment-ores-redis is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0]
[19:26:15] <shinken-wm>	 PROBLEM - Puppet run on deployment-mediawiki04 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0]
[19:27:19] <shinken-wm>	 PROBLEM - Puppet run on deployment-sca01 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0]
[19:27:27] <shinken-wm>	 PROBLEM - Puppet run on deployment-puppetmaster02 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0]
[19:27:32] <shinken-wm>	 PROBLEM - Puppet run on deployment-stream is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0]
[19:27:37] <mutante>	 blame me
[19:27:43] <mutante>	 it's not critical and will be fixed soon
[19:27:43] <wikibugs>	 10Gerrit, 13Patch-For-Review: Gerrit bug search not (naively) working with Phabricator tasks - https://phabricator.wikimedia.org/T85002#2924183 (10Paladox) @demon has initiated the online reindex and some existing changes have started to work. Will take a while before all existing changes can do this. But it w...
[19:27:52] <mutante>	 typo in the name of a package
[19:28:01] <mutante>	 that it's trying to install.. doesnt break anything though
[19:28:26] <shinken-wm>	 PROBLEM - Puppet run on integration-slave-trusty-1004 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0]
[19:28:26] <shinken-wm>	 PROBLEM - Puppet run on integration-slave-docker-1000 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0]
[19:28:36] <shinken-wm>	 PROBLEM - Puppet run on deployment-pdf01 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0]
[19:28:41] <wikibugs>	 10Gerrit: Gerrit bug search not (naively) working with Phabricator tasks - https://phabricator.wikimedia.org/T85002#2924188 (10Paladox)
[19:29:08] <shinken-wm>	 PROBLEM - Puppet run on integration-publisher is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0]
[19:30:06] <shinken-wm>	 PROBLEM - Puppet run on deployment-ms-be01 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0]
[19:30:20] <shinken-wm>	 PROBLEM - Puppet run on integration-slave-trusty-1006 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0]
[19:30:28] <shinken-wm>	 PROBLEM - Puppet run on deployment-tin is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0]
[19:30:31] <shinken-wm>	 PROBLEM - Puppet run on deployment-sca02 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0]
[19:31:17] <shinken-wm>	 PROBLEM - Puppet run on deployment-sentry01 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0]
[19:32:05] <shinken-wm>	 PROBLEM - Puppet run on deployment-kafka01 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0]
[19:32:11] <shinken-wm>	 PROBLEM - Puppet run on deployment-restbase02 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0]
[19:32:31] <shinken-wm>	 PROBLEM - Puppet run on deployment-poolcounter04 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0]
[19:33:13] <shinken-wm>	 PROBLEM - Puppet run on deployment-kafka03 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0]
[19:33:20] <shinken-wm>	 PROBLEM - Puppet run on deployment-tmh01 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0]
[19:33:50] <mutante>	 ^ next puppet run will do it
[19:34:08] <shinken-wm>	 PROBLEM - Puppet run on deployment-ircd is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0]
[19:34:24] <shinken-wm>	 PROBLEM - Puppet run on deployment-secureredirexperiment is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0]
[19:34:36] <shinken-wm>	 PROBLEM - Puppet run on deployment-db03 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0]
[19:35:12] <shinken-wm>	 PROBLEM - Puppet run on deployment-memc04 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0]
[19:57:25] <hashar>	 mutante: thanks :)
[19:58:04] <mutante>	 there's the bot again, it's over:)
[20:01:03] <shinken-wm>	 RECOVERY - Puppet run on deployment-kafka05 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:01:05] <shinken-wm>	 RECOVERY - Puppet run on deployment-ores-redis is OK: OK: Less than 1.00% above the threshold [0.0]
[20:01:13] <shinken-wm>	 RECOVERY - Puppet run on deployment-mediawiki04 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:02:26] <shinken-wm>	 RECOVERY - Puppet run on deployment-puppetmaster02 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:02:32] <shinken-wm>	 RECOVERY - Puppet run on deployment-stream is OK: OK: Less than 1.00% above the threshold [0.0]
[20:03:18] <shinken-wm>	 RECOVERY - Puppet run on deployment-eventlogging03 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:03:26] <shinken-wm>	 RECOVERY - Puppet run on integration-slave-docker-1000 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:03:26] <shinken-wm>	 RECOVERY - Puppet run on integration-slave-trusty-1004 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:03:46] <shinken-wm>	 RECOVERY - Puppet run on deployment-mx is OK: OK: Less than 1.00% above the threshold [0.0]
[20:04:07] <shinken-wm>	 RECOVERY - Puppet run on deployment-aqs01 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:04:21] <shinken-wm>	 RECOVERY - Puppet run on deployment-trending01 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:04:41] <mutante>	 sorry for spam, done now
[20:05:24] <shinken-wm>	 RECOVERY - Puppet run on integration-slave-jessie-android is OK: OK: Less than 1.00% above the threshold [0.0]
[20:05:30] <shinken-wm>	 RECOVERY - Puppet run on deployment-tin is OK: OK: Less than 1.00% above the threshold [0.0]
[20:05:31] <shinken-wm>	 RECOVERY - Puppet run on deployment-sca02 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:06:16] <shinken-wm>	 RECOVERY - Puppet run on deployment-sentry01 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:07:09] <shinken-wm>	 RECOVERY - Puppet run on deployment-restbase02 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:07:16] <shinken-wm>	 RECOVERY - Puppet run on deployment-sca01 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:07:32] <shinken-wm>	 RECOVERY - Puppet run on deployment-poolcounter04 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:08:14] <shinken-wm>	 RECOVERY - Puppet run on deployment-kafka03 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:09:09] <shinken-wm>	 RECOVERY - Puppet run on integration-publisher is OK: OK: Less than 1.00% above the threshold [0.0]
[20:09:24] <shinken-wm>	 RECOVERY - Puppet run on deployment-secureredirexperiment is OK: OK: Less than 1.00% above the threshold [0.0]
[20:09:33] <shinken-wm>	 PROBLEM - Puppet run on deployment-pdfrender02 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0]
[20:09:47] <shinken-wm>	 PROBLEM - Puppet run on deployment-cache-text04 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0]
[20:09:49] <shinken-wm>	 PROBLEM - Puppet run on deployment-mx is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0]
[20:09:57] <shinken-wm>	 PROBLEM - Puppet run on deployment-prometheus01 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0]
[20:10:13] <shinken-wm>	 RECOVERY - Puppet run on deployment-memc04 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:10:15] <shinken-wm>	 PROBLEM - Puppet run on deployment-elastic07 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0]
[20:10:18] <shinken-wm>	 PROBLEM - Puppet run on deployment-db04 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0]
[20:10:20] <shinken-wm>	 RECOVERY - Puppet run on integration-slave-trusty-1006 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:10:20] <shinken-wm>	 PROBLEM - Puppet run on deployment-elastic05 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0]
[20:10:52] <shinken-wm>	 PROBLEM - Puppet run on deployment-fluorine02 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0]
[20:11:04] <shinken-wm>	 PROBLEM - Puppet run on deployment-ms-fe01 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0]
[20:11:11] <shinken-wm>	 PROBLEM - Puppet run on deployment-imagescaler01 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0]
[20:11:30] <shinken-wm>	 PROBLEM - Puppet run on deployment-sca02 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0]
[20:12:04] <shinken-wm>	 RECOVERY - Puppet run on deployment-kafka01 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:12:06] <shinken-wm>	 PROBLEM - Puppet run on deployment-ores-redis is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0]
[20:12:12] <shinken-wm>	 PROBLEM - Puppet run on deployment-salt02 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0]
[20:12:16] <shinken-wm>	 PROBLEM - Puppet run on deployment-sentry01 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0]
[20:12:29] <shinken-wm>	 PROBLEM - Puppet run on deployment-mediawiki05 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0]
[20:12:29] <shinken-wm>	 PROBLEM - Puppet run on deployment-redis01 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0]
[20:12:47] <shinken-wm>	 PROBLEM - Puppet run on deployment-restbase01 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0]
[20:13:01] <shinken-wm>	 PROBLEM - Puppet run on deployment-eventlogging04 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0]
[20:13:03] <shinken-wm>	 PROBLEM - Puppet run on deployment-apertium02 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0]
[20:13:09] <shinken-wm>	 PROBLEM - Puppet run on deployment-restbase02 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0]
[20:13:29] <shinken-wm>	 PROBLEM - Puppet run on deployment-conf03 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0]
[20:13:31] <shinken-wm>	 PROBLEM - Puppet run on deployment-poolcounter04 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0]
[20:13:35] <shinken-wm>	 PROBLEM - Puppet run on deployment-elastic06 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0]
[20:13:41] <shinken-wm>	 PROBLEM - Puppet run on deployment-memc05 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0]
[20:13:51] <wikibugs>	 10Deployment-Systems, 03Scap3, 13Patch-For-Review, 07Wikimedia-Incident: Include fatal log rate check in scap canary test - https://phabricator.wikimedia.org/T154646#2924324 (10thcipriani) So this is the query I came up with:  `((type:mediawiki AND channel:exception) OR type:hhvm)`  Filtered with: ``` {...
[20:14:13] <shinken-wm>	 PROBLEM - Puppet run on deployment-kafka03 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0]
[20:14:23] <shinken-wm>	 PROBLEM - Puppet run on deployment-mediawiki06 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0]
[20:14:28] <hashar>	 Failed to determined $::labsproject at /etc/puppet/manifests/realm.pp:53 
[20:14:56] <shinken-wm>	 PROBLEM - Puppet run on repository is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0]
[20:15:04] <shinken-wm>	 PROBLEM - Puppet run on integration-slave-precise-1002 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0]
[20:15:04] <shinken-wm>	 PROBLEM - Puppet run on integration-slave-trusty-1003 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0]
[20:15:58] <shinken-wm>	 PROBLEM - Puppet run on integration-slave-precise-1012 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0]
[20:16:02] <wikibugs>	 (03PS1) 10Umherirrender: Add npm jobs [integration/config] - 10https://gerrit.wikimedia.org/r/330997
[20:17:20] <wikibugs>	 (03CR) 10Umherirrender: "I hope one patch set for some repos is okay. Give me a hint, if I should create one patch set per repo in the future when adding banana" [integration/config] - 10https://gerrit.wikimedia.org/r/330997 (owner: 10Umherirrender)
[20:21:50] <wikibugs>	 (03CR) 10Hashar: [C: 032] "A patch for multiple repos is the easiest I guess. Specially with the change id being referenced, one can then:" [integration/config] - 10https://gerrit.wikimedia.org/r/330997 (owner: 10Umherirrender)
[20:24:00] <wikibugs>	 (03Merged) 10jenkins-bot: Add npm jobs [integration/config] - 10https://gerrit.wikimedia.org/r/330997 (owner: 10Umherirrender)
[20:24:47] <shinken-wm>	 RECOVERY - Puppet run on deployment-cache-text04 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:25:51] <shinken-wm>	 RECOVERY - Puppet run on deployment-fluorine02 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:27:09] <shinken-wm>	 RECOVERY - Puppet run on deployment-salt02 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:27:29] <shinken-wm>	 RECOVERY - Puppet run on deployment-mediawiki05 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:28:01] <shinken-wm>	 RECOVERY - Puppet run on deployment-apertium02 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:28:34] <shinken-wm>	 RECOVERY - Puppet run on deployment-elastic06 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:29:30] <shinken-wm>	 RECOVERY - Puppet run on deployment-pdfrender02 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:29:58] <shinken-wm>	 RECOVERY - Puppet run on deployment-prometheus01 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:30:13] <wikibugs>	 (03CR) 10Umherirrender: "Thanks. Just more than 200 to do ..." [integration/config] - 10https://gerrit.wikimedia.org/r/330997 (owner: 10Umherirrender)
[20:31:10] <shinken-wm>	 RECOVERY - Puppet run on deployment-imagescaler01 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:32:04] <shinken-wm>	 RECOVERY - Puppet run on deployment-ores-redis is OK: OK: Less than 1.00% above the threshold [0.0]
[20:32:16] <shinken-wm>	 RECOVERY - Puppet run on deployment-sentry01 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:32:30] <shinken-wm>	 RECOVERY - Puppet run on deployment-redis01 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:32:46] <shinken-wm>	 RECOVERY - Puppet run on deployment-restbase01 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:33:00] <shinken-wm>	 RECOVERY - Puppet run on deployment-eventlogging04 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:33:08] <shinken-wm>	 RECOVERY - Puppet run on deployment-restbase02 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:33:30] <shinken-wm>	 RECOVERY - Puppet run on deployment-poolcounter04 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:34:09] <shinken-wm>	 RECOVERY - Puppet run on deployment-ircd is OK: OK: Less than 1.00% above the threshold [0.0]
[20:34:15] <shinken-wm>	 RECOVERY - Puppet run on deployment-kafka03 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:34:25] <shinken-wm>	 RECOVERY - Puppet run on deployment-mediawiki06 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:34:35] <shinken-wm>	 RECOVERY - Puppet run on deployment-db03 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:34:47] <shinken-wm>	 RECOVERY - Puppet run on deployment-mx is OK: OK: Less than 1.00% above the threshold [0.0]
[20:35:05] <shinken-wm>	 RECOVERY - Puppet run on deployment-ms-be01 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:35:16] <shinken-wm>	 RECOVERY - Puppet run on deployment-elastic07 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:35:16] <shinken-wm>	 RECOVERY - Puppet run on deployment-db04 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:35:22] <shinken-wm>	 RECOVERY - Puppet run on deployment-elastic05 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:36:04] <shinken-wm>	 RECOVERY - Puppet run on deployment-ms-fe01 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:36:13] <wikibugs>	 (03CR) 10Hashar: "Yup that is a bit crazy. I am pretty sure one can come up with a script to mass add banana everywhere." [integration/config] - 10https://gerrit.wikimedia.org/r/330997 (owner: 10Umherirrender)
[20:36:30] <shinken-wm>	 RECOVERY - Puppet run on deployment-sca02 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:38:19] <shinken-wm>	 RECOVERY - Puppet run on deployment-tmh01 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:38:39] <shinken-wm>	 RECOVERY - Puppet run on deployment-pdf01 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:38:41] <shinken-wm>	 RECOVERY - Puppet run on deployment-memc05 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:41:59] <hashar>	 mutante: all puppet runs are happy now :]
[20:42:40] <wikibugs>	 (03CR) 10Umherirrender: "I have build some template files to just copy over in the repo, but it needs some individual work to finish and commit and to throttle a b" [integration/config] - 10https://gerrit.wikimedia.org/r/330997 (owner: 10Umherirrender)
[20:43:48] <wikibugs>	 10Deployment-Systems, 03Scap3, 13Patch-For-Review, 07Wikimedia-Incident: Include fatal log rate check in scap canary test - https://phabricator.wikimedia.org/T154646#2924372 (10aaron)
[20:43:53] <wmf-insecte>	 Project selenium-Echo » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #264: 04FAILURE in 1 min 54 sec: https://integration.wikimedia.org/ci/job/selenium-Echo/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/264/
[20:43:55] <wmf-insecte>	 Project selenium-Echo » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #264: 04FAILURE in 1 min 56 sec: https://integration.wikimedia.org/ci/job/selenium-Echo/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/264/
[20:49:56] <shinken-wm>	 RECOVERY - Puppet run on repository is OK: OK: Less than 1.00% above the threshold [0.0]
[20:50:04] <shinken-wm>	 RECOVERY - Puppet run on integration-slave-trusty-1003 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:50:04] <shinken-wm>	 RECOVERY - Puppet run on integration-slave-precise-1002 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:50:59] <shinken-wm>	 RECOVERY - Puppet run on integration-slave-precise-1012 is OK: OK: Less than 1.00% above the threshold [0.0]
[20:53:27] <shinken-wm>	 RECOVERY - Puppet run on deployment-conf03 is OK: OK: Less than 1.00% above the threshold [0.0]
[21:08:34] <wikibugs>	 (03PS1) 10Hashar: [QuizGame] add npm [integration/config] - 10https://gerrit.wikimedia.org/r/331004
[21:36:15] <wikibugs>	 10Continuous-Integration-Config, 10MediaWiki-Unit-tests, 10Refreshed: Skin Refreshed sub repo does not handled in test config - https://phabricator.wikimedia.org/T154806#2924515 (10Umherirrender)
[21:47:14] <wikibugs>	 10Continuous-Integration-Config, 10MediaWiki-Unit-tests, 10Refreshed: Skin Refreshed sub repo does not handled in test config - https://phabricator.wikimedia.org/T154806#2924515 (10SamanthaNguyen) I wasn't aware that it's somehow possible to be able to include it via test configuration, which resulted in a p...
[21:49:08] <wikibugs>	 (03CR) 10Gergő Tisza: "Thanks Hashar!" [integration/config] - 10https://gerrit.wikimedia.org/r/323438 (owner: 10Gergő Tisza)
[21:51:09] <wikibugs>	 10Continuous-Integration-Config, 10MediaWiki-Unit-tests, 10Refreshed: Skin Refreshed sub repo does not handled in test config - https://phabricator.wikimedia.org/T154806#2924554 (10Umherirrender) The normal way to define dependencies is composer.json or something in the zuul config files. I did not know if p...
[21:53:43] <wikibugs>	 10Continuous-Integration-Config, 10MediaWiki-Unit-tests, 10Refreshed: Skin Refreshed sub repo does not handled in test config - https://phabricator.wikimedia.org/T154806#2924569 (10hashar) Subscribed a few people which I believe interacted with mediawiki/skins/Refreshed at some point.  That is rather annoyin...
[21:55:56] <wikibugs>	 10Continuous-Integration-Config, 10MediaWiki-Unit-tests, 10Refreshed: Skin Refreshed sub repo does not handled in test config - https://phabricator.wikimedia.org/T154806#2924573 (10hashar) A note: mediawiki/extensions/VisualEditor has a similar issue so it would benefit from having submodules to be processed...
[21:56:26] <wikibugs>	 10Deployment-Systems, 03Scap3, 13Patch-For-Review, 07Wikimedia-Incident: Include fatal log rate check in scap canary test - https://phabricator.wikimedia.org/T154646#2924576 (10Krinkle) >>! In T154646#2919756, @thcipriani wrote:  > I took a crack at a patch to incorporate fatalmonitor into the logstash_che...
[21:57:43] <wikibugs>	 10Continuous-Integration-Config, 10MediaWiki-Unit-tests, 10Refreshed: Skin Refreshed sub repo does not handled in test config - https://phabricator.wikimedia.org/T154806#2924578 (10SamanthaNguyen) I don't know that much about either Composer or Zuul (only a little about the former), so I'll have to do more r...
[22:04:31] <wikibugs>	 10Continuous-Integration-Config, 10MediaWiki-Unit-tests, 10Refreshed: Skin Refreshed sub repo does not handled in test config - https://phabricator.wikimedia.org/T154806#2924591 (10SamanthaNguyen)
[22:10:03] <wikibugs>	 03Scap3 (Scap3-MediaWiki-MVP), 10scap, 07Wikimedia-Incident: Implement MediaWiki pre-promote checks - https://phabricator.wikimedia.org/T121597#2924615 (10Krinkle)
[22:10:17] <wikibugs>	 10Continuous-Integration-Config, 10MediaWiki-Unit-tests, 10Refreshed: Skin Refreshed sub repo does not handled in test config - https://phabricator.wikimedia.org/T154806#2924619 (10hashar) Composer is a package manager for PHP. Lets one easily define a list of dependencies (in a file `composer.json`) that ar...
[22:11:20] <wikibugs>	 06Release-Engineering-Team, 10Wikimedia-Developer-Summit, 06Developer-Relations (Oct-Dec-2016), 07Documentation: Developer Summit 2017: Work with TPG and RelEng on solution to event documenting - https://phabricator.wikimedia.org/T132400#2924620 (10Rfarrand) 05Open>03Resolved @ksmith Thank you so much...
[22:12:08] <wikibugs>	 10Continuous-Integration-Config, 10MediaWiki-Unit-tests, 10Refreshed: Skin Refreshed sub repo does not handled in test config - https://phabricator.wikimedia.org/T154806#2924515 (10hashar) From the other task: >>! In T134683#2612647, @Volker_E wrote: > I'm not quite sure if that's needed, I'd probably just i...
[22:12:42] <wikibugs>	 (03PS1) 10Umherirrender: [QuizGame] Depends on SocialProfile [integration/config] - 10https://gerrit.wikimedia.org/r/331061
[22:19:37] <wikibugs>	 10Continuous-Integration-Config, 10MediaWiki-Unit-tests, 10Refreshed: Skin Refreshed sub repo does not handled in test config - https://phabricator.wikimedia.org/T154806#2924714 (10SamanthaNguyen) >>! In T154806#2924619, @hashar wrote: > Composer is a package manager for PHP. Lets one easily define a list of...
[22:20:31] <wikibugs>	 (03CR) 10Umherirrender: [C: 031] [QuizGame] add npm (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/331004 (owner: 10Hashar)
[22:23:45] <wikibugs>	 (03CR) 10Hashar: [C: 032] "Magic!" [integration/config] - 10https://gerrit.wikimedia.org/r/331061 (owner: 10Umherirrender)
[22:24:30] <wikibugs>	 (03Merged) 10jenkins-bot: [QuizGame] Depends on SocialProfile [integration/config] - 10https://gerrit.wikimedia.org/r/331061 (owner: 10Umherirrender)
[22:28:14] <wikibugs>	 10Deployment-Systems, 03Scap3, 13Patch-For-Review, 07Wikimedia-Incident: Include fatal log rate check in scap canary test - https://phabricator.wikimedia.org/T154646#2924728 (10thcipriani) >>! In T154646#2924576, @Krinkle wrote: > Presumably the reason this isn't an issue is because the checker doesn't jus...
[22:46:07] <wikibugs>	 10Gerrit, 10DBA, 06Operations, 13Patch-For-Review, 07Upstream: Gerrit shows HTTP 500 error when pasting extended unicode characters - https://phabricator.wikimedia.org/T145885#2924787 (10Paladox) @jcrespo or @Marostegui Hi, i have tested this https://gerrit.wikimedia.org/r/#/c/330455/ locally. Could you...
[22:52:59] <wikibugs>	 10Continuous-Integration-Config, 06Brickimedia, 10MediaWiki-Unit-tests, 10Refreshed: Skin Refreshed sub repo does not handled in test config - https://phabricator.wikimedia.org/T154806#2924813 (10SamanthaNguyen)
[22:53:04] <wikibugs>	 (03PS2) 10Krinkle: Fixup operations-mw-config-composer-jessie job [integration/config] - 10https://gerrit.wikimedia.org/r/330845
[22:56:35] <wikibugs>	 (03PS3) 10Krinkle: Fix experimental operations-mw-config-composer-jessie job [integration/config] - 10https://gerrit.wikimedia.org/r/330845
[23:00:15] <wikibugs>	 (03CR) 10Krinkle: [C: 032] Fix experimental operations-mw-config-composer-jessie job [integration/config] - 10https://gerrit.wikimedia.org/r/330845 (owner: 10Krinkle)
[23:00:44] <wikibugs>	 (03CR) 10Hashar: "finally deployed. Had connectivity issues." [integration/config] - 10https://gerrit.wikimedia.org/r/331061 (owner: 10Umherirrender)
[23:02:26] <shinken-wm>	 PROBLEM - Long lived cherry-picks on puppetmaster on deployment-puppetmaster02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[23:02:32] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 10Wikimedia-Logstash, 07Jenkins: Send Jenkins daemon logs to logstash - https://phabricator.wikimedia.org/T143733#2924836 (10Paladox)
[23:11:49] <wikibugs>	 (03PS1) 10Hashar: [QuizGame] make tests voting [integration/config] - 10https://gerrit.wikimedia.org/r/331090
[23:13:01] <wikibugs>	 (03CR) 10Hashar: [QuizGame] add npm (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/331004 (owner: 10Hashar)
[23:13:16] <wikibugs>	 (03CR) 10Hashar: [C: 032] [QuizGame] make tests voting [integration/config] - 10https://gerrit.wikimedia.org/r/331090 (owner: 10Hashar)
[23:14:02] <wikibugs>	 (03Merged) 10jenkins-bot: [QuizGame] make tests voting [integration/config] - 10https://gerrit.wikimedia.org/r/331090 (owner: 10Hashar)
[23:26:22] <wikibugs>	 10Deployment-Systems, 03Scap3, 13Patch-For-Review, 07Wikimedia-Incident: Include fatal log rate check in scap canary test - https://phabricator.wikimedia.org/T154646#2918734 (10mmodell) One heuristic I find to be useful when watching a deployment is to look over the error messages right before deploying, t...
[23:27:11] <wikibugs>	 (03PS4) 10Krinkle: Fix experimental operations-mw-config-composer-jessie job [integration/config] - 10https://gerrit.wikimedia.org/r/330845
[23:27:39] <wikibugs>	 (03CR) 10Krinkle: Fix experimental operations-mw-config-composer-jessie job [integration/config] - 10https://gerrit.wikimedia.org/r/330845 (owner: 10Krinkle)
[23:27:43] <wikibugs>	 (03CR) 10Krinkle: [C: 032] Fix experimental operations-mw-config-composer-jessie job [integration/config] - 10https://gerrit.wikimedia.org/r/330845 (owner: 10Krinkle)
[23:29:25] <wikibugs>	 (03Merged) 10jenkins-bot: Fix experimental operations-mw-config-composer-jessie job [integration/config] - 10https://gerrit.wikimedia.org/r/330845 (owner: 10Krinkle)
[23:35:42] <hashar>	 that is all folks  *wave*
[23:40:37] <wikibugs>	 10Continuous-Integration-Config, 06Brickimedia, 10MediaWiki-Unit-tests, 10Refreshed: Skin Refreshed sub repo does not handled in test config - https://phabricator.wikimedia.org/T154806#2925034 (10ashley) I have no strong feelings either way, but probably bundling WikiFont is the easiest option (not (just)...