[00:49:52] <wikibugs>	 10Gerrit: Gerrit needs a very wide screen or has big horizontal scroll - https://phabricator.wikimedia.org/T38471#2960062 (10demon) Yes. Upstream is redoing their UI which mostly solves this. I also think it's outside the scope of something we could accomplish in the wishlist survey.
[01:15:04] <wikibugs>	 06Release-Engineering-Team, 10MediaWiki-Vagrant, 06Operations, 07Epic: [EPIC] Migrate base image to Debian Jessie - https://phabricator.wikimedia.org/T136429#2960088 (10Reedy)
[03:13:04] <wikibugs>	 06Release-Engineering-Team, 10MediaWiki-Vagrant, 06Operations, 07Epic: [EPIC] Migrate base image to Debian Jessie - https://phabricator.wikimedia.org/T136429#2960258 (10bd808)
[04:19:14] <wmf-insecte>	 Project selenium-MultimediaViewer » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #274: 04FAILURE in 22 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/274/
[04:38:03] <wikibugs>	 06Release-Engineering-Team, 10MediaWiki-Vagrant, 06Operations, 07Epic: [EPIC] Migrate base image to Debian Jessie - https://phabricator.wikimedia.org/T136429#2960364 (10bd808)
[04:38:32] <wikibugs>	 06Release-Engineering-Team, 10MediaWiki-Vagrant, 06Operations, 07Epic: [EPIC] Migrate base image to Debian Jessie - https://phabricator.wikimedia.org/T136429#2334744 (10bd808)
[04:39:24] <wikibugs>	 06Release-Engineering-Team, 10MediaWiki-Vagrant, 06Operations, 07Epic: [EPIC] Migrate base image to Debian Jessie - https://phabricator.wikimedia.org/T136429#2334744 (10bd808)
[08:38:16] <wikibugs>	 (03CR) 10Hashar: [C: 032] [ImageTweaks] Make unit test voting [integration/config] - 10https://gerrit.wikimedia.org/r/333366 (owner: 10Umherirrender)
[08:39:05] <wikibugs>	 (03Merged) 10jenkins-bot: [ImageTweaks] Make unit test voting [integration/config] - 10https://gerrit.wikimedia.org/r/333366 (owner: 10Umherirrender)
[09:02:17] <hashar>	 !log Archiving Gerrit project wikidata/gremlin marking it read-only T155829
[09:02:21] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[09:02:22] <stashbot>	 T155829: Archive wikidata/gremlin.git - https://phabricator.wikimedia.org/T155829
[09:03:02] <wikibugs>	 (03PS1) 10Hashar: Unconfigure wikidata/gremlin [integration/config] - 10https://gerrit.wikimedia.org/r/333577 (https://phabricator.wikimedia.org/T155829)
[09:05:12] <wikibugs>	 (03CR) 10Hashar: [C: 032] Unconfigure wikidata/gremlin [integration/config] - 10https://gerrit.wikimedia.org/r/333577 (https://phabricator.wikimedia.org/T155829) (owner: 10Hashar)
[09:06:05] <wikibugs>	 (03Merged) 10jenkins-bot: Unconfigure wikidata/gremlin [integration/config] - 10https://gerrit.wikimedia.org/r/333577 (https://phabricator.wikimedia.org/T155829) (owner: 10Hashar)
[09:07:05] <wikibugs>	 (03PS1) 10Hashar: Whitelist JuniorSys [integration/config] - 10https://gerrit.wikimedia.org/r/333578
[09:07:36] <wikibugs>	 10Continuous-Integration-Config, 10Gerrit, 06Discovery, 10Wikidata, and 2 others: Archive wikidata/gremlin.git - https://phabricator.wikimedia.org/T155829#2960581 (10hashar) 05Open>03Resolved a:03hashar Thank you Stas for the quick confirmation!
[09:07:49] <wikibugs>	 (03CR) 10Hashar: [C: 032] Whitelist JuniorSys [integration/config] - 10https://gerrit.wikimedia.org/r/333578 (owner: 10Hashar)
[09:08:33] <wikibugs>	 (03Merged) 10jenkins-bot: Whitelist JuniorSys [integration/config] - 10https://gerrit.wikimedia.org/r/333578 (owner: 10Hashar)
[10:42:56] <shinken-wm>	 PROBLEM - Puppet run on repository is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0]
[10:45:22] <wikibugs>	 06Release-Engineering-Team, 10MediaWiki-Vagrant, 06Operations, 07Epic: [EPIC] Migrate base image to Debian Jessie - https://phabricator.wikimedia.org/T136429#2960848 (10Mvolz)
[11:22:55] <shinken-wm>	 RECOVERY - Puppet run on repository is OK: OK: Less than 1.00% above the threshold [0.0]
[12:08:26] <wikibugs>	 (03Abandoned) 10Hashar: [examples] Update jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/244747 (owner: 10Paladox)
[12:09:28] <wikibugs>	 (03Abandoned) 10Hashar: Add new template composer-{phpflavour}-non-voting [integration/config] - 10https://gerrit.wikimedia.org/r/278405 (https://phabricator.wikimedia.org/T124342) (owner: 10Paladox)
[12:10:24] <wikibugs>	 (03Abandoned) 10Hashar: [SemanticExpressiveness] Add npm test and composer-test [integration/config] - 10https://gerrit.wikimedia.org/r/281417 (owner: 10Paladox)
[12:10:57] <wikibugs>	 (03Abandoned) 10Hashar: Validate integration/composer with the shipped version [integration/config] - 10https://gerrit.wikimedia.org/r/259243 (owner: 10Hashar)
[12:12:08] <wikibugs>	 (03Restored) 10Hashar: Validate integration/composer with the shipped version [integration/config] - 10https://gerrit.wikimedia.org/r/259243 (owner: 10Hashar)
[12:14:16] <wikibugs>	 (03CR) 10Addshore: [C: 031] Do not require specific versions of PHPCS [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/333123 (owner: 10Jeroen De Dauw)
[12:14:45] <wikibugs>	 (03Abandoned) 10Hashar: [JsonData] Add composer-test [integration/config] - 10https://gerrit.wikimedia.org/r/280772 (owner: 10Paladox)
[12:26:14] <wikibugs>	 10Continuous-Integration-Infrastructure, 13Patch-For-Review: castor rsyncd spam logs with forward name lookup for ci-trusty-wikimedia-95202.contintcloud.eqiad.wmflabs failed: Name or service not known - https://phabricator.wikimedia.org/T136276#2961049 (10hashar) I have rebased the patches and proposed them fo...
[12:28:28] <wikibugs>	 (03PS2) 10Hashar: dib: do not start varnish service on boot [integration/config] - 10https://gerrit.wikimedia.org/r/325052 (https://phabricator.wikimedia.org/T113342)
[12:28:34] <wikibugs>	 (03CR) 10Hashar: [C: 032] dib: do not start varnish service on boot [integration/config] - 10https://gerrit.wikimedia.org/r/325052 (https://phabricator.wikimedia.org/T113342) (owner: 10Hashar)
[12:29:21] <wikibugs>	 (03Merged) 10jenkins-bot: dib: do not start varnish service on boot [integration/config] - 10https://gerrit.wikimedia.org/r/325052 (https://phabricator.wikimedia.org/T113342) (owner: 10Hashar)
[12:45:49] <hashar>	 !log Image ci-jessie-wikimedia-1485174573 in wmflabs-eqiad is ready  | should no more spawn varnish on boot
[12:45:52] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[12:51:14] <wikibugs>	 10Continuous-Integration-Config, 10BlueSpice, 13Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#2961053 (10Paladox) @osnard and @mglaser hi, it seems the tests are failing on a new error  11:11:23 [5e31535beec38d67ece94ef5] [no req]   BsException from line...
[13:09:08] <wikibugs>	 (03CR) 10Hashar: [C: 031] Do not require specific versions of PHPCS [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/333123 (owner: 10Jeroen De Dauw)
[13:11:27] <wikibugs>	 (03CR) 10Hashar: "verified and it works just fine" [integration/config] - 10https://gerrit.wikimedia.org/r/325052 (https://phabricator.wikimedia.org/T113342) (owner: 10Hashar)
[13:21:58] <wikibugs>	 10Continuous-Integration-Infrastructure, 05Continuous-Integration-Scaling: Speed up the time to get a Nodepool instances to achieve READY state - https://phabricator.wikimedia.org/T113342#2961095 (10hashar)
[13:32:06] <wikibugs>	 10Continuous-Integration-Infrastructure, 05Continuous-Integration-Scaling: Speed up the time to get a Nodepool instances to achieve READY state - https://phabricator.wikimedia.org/T113342#2961104 (10hashar) After bunch of optimizations:  Trusty images boot in 16 seconds. Jessie ones boot in ~ 10 seconds.  It s...
[13:44:52] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 07Jenkins: Install the blue ocean plugin alongside jenkins 2.x upgrade - https://phabricator.wikimedia.org/T155840#2961133 (10hashar) 05Open>03stalled
[13:53:03] <wikibugs>	 10Continuous-Integration-Infrastructure: Review CI tutorials on mediawiki.org - https://phabricator.wikimedia.org/T96024#2961159 (10hashar) 05Open>03Resolved a:03hashar
[13:54:13] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: civicrm-buildkit doesn't composer update our wikimedia projects correctly - https://phabricator.wikimedia.org/T104031#2961164 (10hashar) p:05Triage>03High
[13:54:19] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: civicrm-buildkit doesn't composer update our wikimedia projects correctly - https://phabricator.wikimedia.org/T104031#1406224 (10hashar) p:05Triage>03High
[13:57:02] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Labs, 10Labs-Infrastructure, 13Patch-For-Review: Puppet fails on integration instances: nfs_mount[home-on-labstoresvc]: umount: /home: not mounted - https://phabricator.wikimedia.org/T155820#2955587 (10hashar) p:05Triage>03High
[13:58:08] <wikibugs>	 10Browser-Tests-Infrastructure, 10Continuous-Integration-Infrastructure, 10Packaging, 13Patch-For-Review: Create a Debian package for https://github.com/mozilla/geckodriver for at least Debian Jessie - https://phabricator.wikimedia.org/T137797#2961178 (10hashar) p:05Normal>03Low
[14:01:19] <wikibugs>	 10Continuous-Integration-Config, 13Patch-For-Review: Phase out jobs "pplint-HEAD" and "erblint-HEAD" - https://phabricator.wikimedia.org/T154894#2961183 (10hashar) p:05Triage>03Normal
[14:02:41] <wikibugs>	 10Continuous-Integration-Config, 10FR-Smashpig, 10fundraising-tech-ops: Switch wikimedia/fundraising/SmashPig to use tox as an entry point - https://phabricator.wikimedia.org/T114361#2961184 (10hashar) 05Open>03declined
[14:03:48] <wikibugs>	 10Continuous-Integration-Config, 10MediaWiki-General-or-Unknown, 10MediaWiki-Unit-tests, 07Tracking: Let ApiDocumentationTest structure test pass on all repos - https://phabricator.wikimedia.org/T154838#2961186 (10hashar) p:05Triage>03Normal
[14:05:29] <wikibugs>	 10Continuous-Integration-Config, 06Operations, 06Operations-Software-Development, 13Patch-For-Review: E901 SyntaxError: invalid syntax is wrongly raised on using python's abc by jenkins python CI linter - https://phabricator.wikimedia.org/T152950#2864426 (10hashar) 05Open>03stalled
[14:06:13] <wikibugs>	 10Continuous-Integration-Config, 06Release-Engineering-Team, 10MediaWiki-Unit-tests, 13Patch-For-Review, 07Technical-Debt: Clone mediawiki into mediawiki-config when running test's via jenkins - https://phabricator.wikimedia.org/T115713#1730888 (10hashar) p:05Triage>03Normal
[14:41:51] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 03releng-201617-q3, 10Release Pipeline: Gather requirements for new CI system - https://phabricator.wikimedia.org/T153270#2961268 (10thcipriani)
[14:42:32] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 10Release Pipeline: Spike: Evaluate containerized CI builds using Kubernetes - https://phabricator.wikimedia.org/T153363#2961270 (10thcipriani)
[14:50:58] <wikibugs>	 10Deployment-Systems, 06Release-Engineering-Team, 06Operations, 05Mediawiki SWAT Deployments, 07Puppet: mwdebug1002 should have PHP extensions - https://phabricator.wikimedia.org/T153316#2961290 (10MoritzMuehlenhoff) p:05Triage>03Normal >>! In T153316#2881845, @greg wrote: > Let's do that. It makes s...
[14:53:34] <wikibugs>	 (03Abandoned) 10Hashar: (wip) php extensions compilation (wip) [integration/config] - 10https://gerrit.wikimedia.org/r/290925 (owner: 10Hashar)
[15:13:48] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team: Move from diskimage-builder to python-bootstrap-vz - https://phabricator.wikimedia.org/T156003#2961381 (10hashar)
[15:45:48] <wmf-insecte>	 Yippee, build fixed!
[15:45:49] <wmf-insecte>	 Project selenium-MobileFrontend » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #300: 09FIXED in 22 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/300/
[15:48:17] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Infrastructure, 10DBA, 10MediaWiki-Database, and 2 others: Enable MariaDB/MySQL's Strict Mode - https://phabricator.wikimedia.org/T108255#2961580 (10Marostegui)
[15:54:34] <wmf-insecte>	 Yippee, build fixed!
[15:54:35] <wmf-insecte>	 Project selenium-MobileFrontend » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #300: 09FIXED in 31 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/300/
[16:12:04] <shinken-wm>	 PROBLEM - Puppet run on integration-slave-trusty-1003 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0]
[16:12:57] <wikibugs>	 10Gerrit, 10MediaWiki-Vagrant, 13Patch-For-Review: "index-pack failed" when installing new MediaWiki-Vagrant box - https://phabricator.wikimedia.org/T152801#2860585 (10Niharika) I encountered this today while trying to clone a repo.  ``` vagrant@mediawiki-vagrant:/vagrant/mediawiki/extensions$ git clone http...
[16:21:52] <wikibugs>	 10Gerrit, 10MediaWiki-Vagrant, 13Patch-For-Review: "index-pack failed" when installing new MediaWiki-Vagrant box - https://phabricator.wikimedia.org/T152801#2860585 (10Paladox) Apparently this could be a firewall issue, see https://confluence.atlassian.com/stashkb/git-clone-fails-error-rpc-failed-result-56-h...
[16:23:35] <wikibugs>	 10Gerrit, 10MediaWiki-Vagrant, 13Patch-For-Review: "index-pack failed" when installing new MediaWiki-Vagrant box - https://phabricator.wikimedia.org/T152801#2961767 (10Paladox) A temp solution is try to use ssh to clone, i am wondering weather the git:// protocol is an open ssh protocol, if so i wonder how d...
[16:38:45] <wikibugs>	 10Gerrit, 10MediaWiki-Vagrant, 13Patch-For-Review: "index-pack failed" when installing new MediaWiki-Vagrant box - https://phabricator.wikimedia.org/T152801#2961784 (10Paladox) Also apparently https git clone is no supported in ubuntu / debian, it's a bug, see http://stackoverflow.com/questions/25442734/git-...
[16:40:13] <wikibugs>	 10Gerrit, 10MediaWiki-Vagrant, 13Patch-For-Review: "index-pack failed" when installing new MediaWiki-Vagrant box - https://phabricator.wikimedia.org/T152801#2961804 (10Paladox) What version of git are you running in ubuntu 14.04?  we should add  apt-get update \ && apt-get install -y build-essential libcurl4...
[16:41:20] <wikibugs>	 10Gerrit, 10MediaWiki-Vagrant, 13Patch-For-Review: "index-pack failed" when installing new MediaWiki-Vagrant box - https://phabricator.wikimedia.org/T152801#2961805 (10Paladox) >>! In T152801#2908307, @Tgr wrote: > I also get the `TLS packet with unexpected length` error when doing a new checkout (MW master,...
[16:48:11] <wikibugs>	 10Gerrit, 10MediaWiki-Vagrant, 13Patch-For-Review: "index-pack failed" when installing new MediaWiki-Vagrant box - https://phabricator.wikimedia.org/T152801#2961827 (10Paladox) You can workaround it by doing for example  mkdir mediawiki-config cd mediawiki-config git init git remote add -f origin https://ger...
[16:52:03] <shinken-wm>	 RECOVERY - Puppet run on integration-slave-trusty-1003 is OK: OK: Less than 1.00% above the threshold [0.0]
[16:54:55] <wikibugs>	 10Gerrit, 06Release-Engineering-Team: Convert its-phabricator upstream repo which wmf maintains to bazel - https://phabricator.wikimedia.org/T156024#2961872 (10Paladox)
[16:55:19] <wikibugs>	 10Gerrit, 06Release-Engineering-Team: Convert its-phabricator upstream repo which wmf maintains to bazel - https://phabricator.wikimedia.org/T156024#2961886 (10Paladox) p:05Triage>03High
[16:55:48] <wikibugs>	 10Gerrit, 06Release-Engineering-Team: Convert its-phabricator upstream repo which wmf maintains to bazel - https://phabricator.wikimedia.org/T156024#2961872 (10Paladox) Setting to high as this is a blocker for any future upgrades we do.
[16:56:09] <wikibugs>	 10Gerrit, 06Release-Engineering-Team, 07Upstream: Convert its-phabricator upstream repo which wmf maintains to bazel - https://phabricator.wikimedia.org/T156024#2961896 (10Paladox)
[17:26:16] <wikibugs>	 06Release-Engineering-Team, 10Phabricator, 10Wikimedia-Blog: Write a blog post on the up coming phabricator update on wmf - https://phabricator.wikimedia.org/T155896#2958113 (10EdErhart-WMF) Hey @Paladox, can you send me an email? Happy to send you a Google Doc with all of the instructions needed for a blog...
[17:31:28] <wikibugs>	 06Release-Engineering-Team, 10Phabricator, 10Wikimedia-Blog: Write a blog post on the up coming phabricator update on wmf - https://phabricator.wikimedia.org/T155896#2962110 (10EdErhart-WMF) No worries! When someone decides to write it, please contact me and I'll send them the doc. :-)
[17:36:54] <wikibugs>	 (03Draft2) 10WMDE-leszek: prepare-mediawiki-zuul-project-no-sql: Use composer to install deps [integration/config] - 10https://gerrit.wikimedia.org/r/333686
[18:11:02] <wikibugs>	 06Release-Engineering-Team, 06Operations, 10Phabricator: reinstall iridium (phabricator) as phab1001 with jessie - https://phabricator.wikimedia.org/T152129#2962309 (10Dzahn) I think this could be done anytime. We'll just need an agreement with releng, decision which way to go and a larger maintenance window.
[18:11:18] <wikibugs>	 06Release-Engineering-Team, 06Operations, 10Phabricator: reinstall iridium (phabricator) as phab1001 with jessie - https://phabricator.wikimedia.org/T152129#2962310 (10Paladox) I Spoke with @dzahn who said we can do this any time but is now blocked on @mmodell scheduling the maint window for this.
[18:15:11] <wikibugs>	 06Release-Engineering-Team, 06Operations, 10Phabricator: reinstall iridium (phabricator) as phab1001 with jessie - https://phabricator.wikimedia.org/T152129#2962332 (10Paladox) We can migrate to phab2001 first then upgrade iridium to debian and rename it to phab1001. Reason we should do it like this is if we...
[18:20:47] <JustBerry>	 MaxSem, connection problems? ;o
[18:50:41] <wikibugs>	 06Release-Engineering-Team, 10Phabricator, 10Wikimedia-Blog: Write a blog post on the up coming phabricator update on wmf - https://phabricator.wikimedia.org/T155896#2962463 (10Paladox) Ok, thanks.
[19:25:43] <wikibugs>	 06Release-Engineering-Team, 06Operations, 10Phabricator: reinstall iridium (phabricator) as phab1001 with jessie - https://phabricator.wikimedia.org/T152129#2839436 (10Dzahn)
[19:28:05] <Reedy>	 reedy@deployment-tin:/srv/mediawiki-staging$ scap sync-file wmf-config/CommonSettings.php Consistency
[19:28:12] <Reedy>	 TypeError: not all arguments converted during string formatting
[19:28:15] <Reedy>	 waaa?
[19:34:20] <ostriches>	 Hmm?
[19:34:22] <ostriches>	 More context?
[19:35:02] <Reedy>	 trying to sync a file on deployment-tin
[19:35:26] <Reedy>	 https://phabricator.wikimedia.org/P4780
[19:36:45] <ostriches>	 Oh yeah
[19:36:47] <ostriches>	 I saw that
[19:37:03] <ostriches>	 twentyafterfour: I think something's up with logging ^
[19:39:32] <ostriches>	 Reedy: beta runs scap's master branch fwiw :)
[19:46:56] <wikibugs>	 06Release-Engineering-Team, 10Phabricator, 10Wikimedia-Blog: Write a blog post on the up coming phabricator update on wmf - https://phabricator.wikimedia.org/T155896#2958113 (10Dzahn) How about putting the Google doc content on wiki? That would eliminate the need for email and extra work outside the ticket s...
[20:10:39] <thcipriani>	 hrm, so whatever is happening with scap in beta is something something lockfile handling. Well, logging fail, but the root issue is lockfile handling.
[20:12:30] <ostriches>	 It's legal to not pass any formatting arguments, like you did with "%s.sql", but it's not legal to pass arguments but not the right amount ("w" % (today) passes one, but there's no string formatting in "w", so you get an error that not all of the arguments were used)
[20:12:41] <ostriches>	 fields['message'] = fields['msg'] % fields['args']
[20:12:54] <ostriches>	 So basically, 'msg' has too few %s's for 'args'
[20:13:07] <ostriches>	 I wonder if switching to .format() would make it fail nicer
[20:13:42] <thcipriani>	 possibly. I've definitely seen that problem before related to other issues.
[20:24:04] <wikibugs>	 (03PS4) 10Hashar: (WIP) mediawiki-releases job [integration/config] - 10https://gerrit.wikimedia.org/r/333280
[20:29:19] <wikibugs>	 (03CR) 10Legoktm: [C: 04-2] "We discussed this previously and T133011 was the proposed solution." [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/333123 (owner: 10Jeroen De Dauw)
[20:41:40] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Labs, 10Labs-Infrastructure: Migrate integration-publisher service to use a Jessie instance - https://phabricator.wikimedia.org/T156064#2962943 (10hashar)
[20:42:38] <thcipriani>	 ostriches: I think this does it: https://github.com/wikimedia/scap/blob/master/scap/cli.py#L176-L178
[20:43:08] <thcipriani>	 once it hits the logger.error underneath there it's like: logger.error('message with no placeholders', 'thing', 'thing', 'thing')
[20:44:36] <ostriches>	 Looking
[20:49:43] <thcipriani>	 played with the python interactive debugger pdb and pdb.set_trace() with it a bit, could recreate. Here I set a breakpoint right before the logger.error call: https://phabricator.wikimedia.org/P4781
[20:50:32] <thcipriani>	 final line I changed message to be '%s %s %s'
[21:05:05] <hashar>	 !log Created integration-publishing Jessie instance 10.68.23.254 with puppet class role::ci::publisher::labs .  Meant to replace Precise instance integration-publisher T156064
[21:05:10] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[21:05:10] <stashbot>	 T156064: Migrate integration-publisher service to use a Jessie instance - https://phabricator.wikimedia.org/T156064
[21:12:20] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Labs, 10Labs-Infrastructure, 07Beta-Cluster-reproducible, 07Puppet: New instance have broken puppet configuration when using puppetmaster standalone - https://phabricator.wikimedia.org/T148929#2963092 (10hashar)
[21:12:24] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Labs, 10Labs-Infrastructure: Migrate integration-publisher service to use a Jessie instance - https://phabricator.wikimedia.org/T156064#2963091 (10hashar)
[21:12:44] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Labs, 10Labs-Infrastructure: Migrate integration-publisher service to use a Jessie instance - https://phabricator.wikimedia.org/T156064#2962943 (10hashar) Puppet doesn't pass on the new instance due to Puppet SSL certificates T148929
[21:16:49] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Labs, 10Labs-Infrastructure: Migrate integration-publisher service to use a Jessie instance - https://phabricator.wikimedia.org/T156064#2963109 (10hashar)
[21:16:52] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Labs, 10Labs-Infrastructure, 07Beta-Cluster-reproducible, 07Puppet: New instance have broken puppet configuration when using puppetmaster standalone - https://phabricator.wikimedia.org/T148929#2736876 (10hashar)
[21:17:58] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Labs, 10Labs-Infrastructure: Migrate integration-publisher service to use a Jessie instance - https://phabricator.wikimedia.org/T156064#2962943 (10hashar) Eventually I manually fixed Puppet and applied `role::ci::publisher::labs` in Horizon.  Just have to update the...
[21:19:33] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Labs, 10Labs-Infrastructure, 07Beta-Cluster-reproducible, 07Puppet: New instance have broken puppet configuration when using puppetmaster standalone - https://phabricator.wikimedia.org/T148929#2963120 (10hashar)
[21:37:27] <wikibugs>	 10Beta-Cluster-Infrastructure, 10MediaWiki-extensions-InterwikiSorting, 06Operations, 10Wikidata, and 3 others: Deploy InterwikiSorting extension to beta - https://phabricator.wikimedia.org/T155995#2963153 (10greg)
[21:40:31] <wikibugs>	 10Browser-Tests-Infrastructure, 15User-zeljkofilipin: Browser test Jenkins videos do not always play in-browser - https://phabricator.wikimedia.org/T155794#2963162 (10greg)
[22:54:52] <bearND>	  Hi, I'd like to deploy to beta cluster for the first time. I can't seem to be able to connect to deployment-prep. I'm getting 'channel 0: open failed: administratively prohibited: open failed'
[22:55:07] <bearND>	 I'm using 'ProxyCommand ssh -a -W %h:%p -A bsitzmann@primary.bastion.wmflabs.org' in my ssh config
[22:58:03] <mobrovac>	 bearND: try with just bastion.wmflabs.org
[23:00:24] <bearND>	 mobrovac: hmm, same response
[23:02:21] <mobrovac>	 bearND: https://phabricator.wikimedia.org/P4782 is my ssh config for labs
[23:02:39] <mobrovac>	 with that, i just do ssh deployment-tin.deployment-prep.eqiad.wmnet
[23:02:46] <mobrovac>	 ups i meant .wmflabs
[23:05:41] <bearND>	 mobrovac: ah, ok. I was going by https://wikitech.wikimedia.org/wiki/Help:Access#Accessing_instances_with_ProxyCommand_ssh_option_.28recommended.29. Will try yours soon. 
[23:06:17] <thcipriani>	 fwiw I use primary.bastion.wmflabs.org
[23:10:27] <bearND>	 mobrovac: oh, you use a different hostname when connecting: deployment-tin.deployment-prep vs deployment-prep
[23:12:51] <mutante>	 bearND: deployment-prep is the name of the project in labs
[23:13:33] <mutante>	 deployment-tin is a host within the project. and the schema is   host.project.datacenter.wmflabs
[23:13:55] <mutante>	 datacenter is always eqiad  currently
[23:14:16] <bearND>	 mutante: ok, that confused me a bit since in prod 'deployment' is an alias for tin, so i thought 'deployment-prep' was an alias for whatever the beta cluster equivalent machine is for tin
[23:14:42] <mutante>	 oh, yea, that is confusing
[23:15:03] <mutante>	 in prod there is no "project" level
[23:15:28] <mutante>	 it's just   tin.eqiad.wmnet    or mira.codfw.wmnet  
[23:15:46] <mutante>	 they are the deployment servers and "tin" is the active on in eqiad
[23:16:07] <bearND>	 anyways. Thanks for y'all's help. It works now. I can also use primary.bastion, too
[23:16:13] <mutante>	 nice :)
[23:21:32] <wikibugs>	 10Continuous-Integration-Config, 05Goal, 07I18n, 13Patch-For-Review: Configure banana checker for i18n files to run on all MediaWiki extensions and skins - https://phabricator.wikimedia.org/T94547#2946853 (10Psychoslave) On a side note, what is the origin of the banana reference?
[23:25:18] <bearND>	 thcipriani: Just did my first beta cluster deploy. Should I provide a scap deploy justification parameter for beta cluster, too? I wasn't sure so I left if off. Then it said "(no justification provided)".
[23:25:33] <thcipriani>	 :)
[23:25:49] <thcipriani>	 it doesn't actually log in this channel like it does for production
[23:25:59] <thcipriani>	 so it's less important for beta
[23:26:27] <thcipriani>	 the "(no justification provided)" message is an update to the "(no message)" message you get in production
[23:26:45] <thcipriani>	 beta runs scap's master branch, so you'll see that message go out with the new version of scap
[23:27:26] <thcipriani>	 tl;dr: it's up to you :)
[23:27:32] <bearND>	 Yeah, I thought the output was a bit different here than prod.
[23:28:30] <bearND>	 Isn't the "Server admin log" section in https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep for beta cluster?
[23:28:30] <thcipriani>	 yup, it'll be different from time-to-time, but deployment should work *roughly* the same. Shouldn't see breakage.
[23:29:08] <thcipriani>	 yeah, we do have a SAL for beta: https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[23:29:50] <bearND>	 ah, cool. Next time I'll add the message. Then it should show up there, right?
[23:29:54] <thcipriani>	 which is fed from this channel with !log messages, same as prod. Just scap doesn't !log in this channel like it does prod.
[23:30:27] <thcipriani>	 nah, you'd have to !log manually in this channel for it to show up in that log
[23:30:53] <bearND>	 thcipriani: ah, I see. Thanks
[23:32:00] <bearND>	 thcipriani: would be nice if it did this automatically, like in prod
[23:33:55] <thcipriani>	 bearND: yeah, that would be a nice-to-have thing for services. It might add a bit of noise here for mediawiki deploys (it's auto-deployed every 10 minutes :)). I'll file a task for it to put it in the queue.
[23:34:43] <greg-g>	 thcipriani: there's a --quiet option, right?
[23:34:49] <greg-g>	 or whatever, to not log
[23:35:00] <greg-g>	 $DONOLOGMSG or somesuch
[23:35:08] <thcipriani>	 yeah, there's something you can do for that we'd have to add to the jenkins job
[23:35:55] <bearND>	 ah, didn't know about the auto deploy every 10 minutes. Yeah, that would be noisy
[23:36:42] <thcipriani>	 heh, yeah, that shouldn't be too hard to work around though :)
[23:38:46] <greg-g>	 Then I'll need a "exclude mw deploy msgs" view in the SAL ;)
[23:39:19] <wikibugs>	 03Scap3: autolog scap3 deployments in beta - https://phabricator.wikimedia.org/T156079#2963519 (10thcipriani)
[23:39:57] <thcipriani>	 ^ bearND
[23:41:16] <bearND>	 thcipriani: thanks
[23:41:43] <bearND>	 !log Update mobileapps to 66ef3c2
[23:41:47] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[23:57:51] <wikibugs>	 10Deployment-Systems, 06Release-Engineering-Team, 06Operations, 05Mediawiki SWAT Deployments, 07Puppet: mwdebug1002 should have PHP extensions - https://phabricator.wikimedia.org/T153316#2963564 (10greg) >>! In T153316#2961290, @MoritzMuehlenhoff wrote: >>>! In T153316#2881845, @greg wrote: >> Let's do t...