[00:04:51] Project mwext-phpunit-coverage-publish build #3970: 04FAILURE in 3.4 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/3970/ [00:04:53] Project mwext-phpunit-coverage-publish build #3971: 04STILL FAILING in 2.1 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/3971/ [00:04:56] Project mwext-phpunit-coverage-publish build #3972: 04STILL FAILING in 2.2 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/3972/ [00:07:26] Yippee, build fixed! [00:07:26] Project mwext-phpunit-coverage-publish build #3973: 09FIXED in 2 min 26 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/3973/ [00:22:25] 10Phabricator, 10Discourse, 10Developer-Relations (Apr-Jun-2018): Enable Wikimedia Phabricator login in discourse-mediawiki.wmflabs.org - https://phabricator.wikimedia.org/T184987#4170048 (10Samwilson) Doesn't work for me :( I just get this ever time: > Sorry, there was an error authorizing your account. Pe... [00:31:05] 10Phabricator, 10Discourse, 10Developer-Relations (Apr-Jun-2018): Enable Wikimedia Phabricator login in discourse-mediawiki.wmflabs.org - https://phabricator.wikimedia.org/T184987#4170055 (10mmodell) @samwilson: I works for me even though I also have a blank 'scope' field. Odd. [00:35:40] 10Release-Engineering-Team, 10Patch-For-Review, 10Scoring-platform-team (Current): ORES deployment submodules should point to phabricator HTTPS repos. - https://phabricator.wikimedia.org/T179009#4170079 (10mmodell) @demon: At least for now, since the swift backend I've been working on for phabricator's git-l... [00:41:27] 10Phabricator, 10Discourse, 10Developer-Relations (Apr-Jun-2018): Enable Wikimedia Phabricator login in discourse-mediawiki.wmflabs.org - https://phabricator.wikimedia.org/T184987#4170120 (10Samwilson) Do you have two-factor authentication enabled on Phabricator? [01:15:03] Hi [01:15:13] Refresh beta-mediawiki-config-update-eqiad job [02:46:01] 10Release-Engineering-Team (Kanban), 10MediaWiki-SWAT-deployments, 10User-greg, 10User-zeljkofilipin: Proposal: Effective immediately, disallow multi-sync patch deployment - https://phabricator.wikimedia.org/T187761#4170271 (10Krinkle) @MarcoAurelio Okay. Here is a simpler version of "what" and "how", with... [02:59:09] 10Deployments, 10MediaWiki-Debug-Logger, 10Patch-For-Review, 10User-Tgr: Capture PHP warnings with stacktraces in MediaWiki and save to logstash - https://phabricator.wikimedia.org/T45086#4170278 (10Krinkle) >>! In T45086#4166452, @Tgr wrote: > Seems like some PHP errors are only logged in the HHVM channel... [03:42:42] (03PS9) 10Zoranzoki21: Whitelist user Gopavasanth [integration/config] - 10https://gerrit.wikimedia.org/r/428068 [03:45:01] (03CR) 10Jayprakash12345: [C: 031] Whitelist user Gopavasanth [integration/config] - 10https://gerrit.wikimedia.org/r/428068 (owner: 10Zoranzoki21) [07:00:53] (03PS1) 10Hashar: Migrate mediawiki/extensions/C* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430033 (https://phabricator.wikimedia.org/T183512) [07:02:24] (03CR) 10jerkins-bot: [V: 04-1] Migrate mediawiki/extensions/C* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430033 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [07:04:13] (03PS2) 10Hashar: Migrate mediawiki/extensions/C* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430033 (https://phabricator.wikimedia.org/T183512) [07:07:27] (03PS1) 10Hashar: Migrate mediawiki/extensions/D* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430034 (https://phabricator.wikimedia.org/T183512) [07:12:53] (03PS1) 10Legoktm: [WIP] Support postgres backend [integration/quibble] - 10https://gerrit.wikimedia.org/r/430035 [07:13:19] (03CR) 10jerkins-bot: [V: 04-1] [WIP] Support postgres backend [integration/quibble] - 10https://gerrit.wikimedia.org/r/430035 (owner: 10Legoktm) [07:15:53] (03PS1) 10Hashar: Migrate mediawiki/extensions/E* & F* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430036 (https://phabricator.wikimedia.org/T183512) [07:16:10] (03CR) 10Legoktm: "Requiring pg_virtualenv to start quibble doesn't seem ideal. Probably we need some way for quibble to call `pg_virtualenv`, get the releva" [integration/quibble] - 10https://gerrit.wikimedia.org/r/430035 (owner: 10Legoktm) [07:16:32] (03CR) 10Hashar: [C: 032] Migrate mediawiki/extensions/C* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430033 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [07:16:35] (03CR) 10Hashar: [C: 032] Migrate mediawiki/extensions/D* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430034 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [07:16:42] (03CR) 10Hashar: [C: 032] Migrate mediawiki/extensions/E* & F* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430036 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [07:17:53] (03Merged) 10jenkins-bot: Migrate mediawiki/extensions/C* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430033 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [07:18:33] (03Merged) 10jenkins-bot: Migrate mediawiki/extensions/D* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430034 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [07:18:35] (03Merged) 10jenkins-bot: Migrate mediawiki/extensions/E* & F* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430036 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [07:18:57] https://youtu.be/lxuLNn2UH1U?t=11s [07:19:11] the quibble revolution has begun! [07:20:02] (03PS1) 10Legoktm: [WIP] Add postgresql dependencies to quibble-stretch [integration/config] - 10https://gerrit.wikimedia.org/r/430037 [07:36:12] (03PS1) 10Hashar: Migrate mediawiki/extensions G* H* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430040 (https://phabricator.wikimedia.org/T183512) [07:36:13] (03PS1) 10Hashar: Migrate mediawiki/extensions/I* J* L* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430041 (https://phabricator.wikimedia.org/T183512) [07:37:02] legoktm: yeah more or less. I am only migrating extensions known to pass on "master" branch :D [07:37:39] 350 more extensions to migrate + all the ones that are failling for random reasons [07:37:39] (03CR) 10jerkins-bot: [V: 04-1] Migrate mediawiki/extensions G* H* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430040 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [07:37:41] (03CR) 10jerkins-bot: [V: 04-1] Migrate mediawiki/extensions/I* J* L* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430041 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [07:38:57] (03PS2) 10Hashar: Migrate mediawiki/extensions G* H* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430040 (https://phabricator.wikimedia.org/T183512) [07:39:25] (03CR) 10Hashar: [C: 032] Migrate mediawiki/extensions G* H* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430040 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [07:39:55] (03PS2) 10Hashar: Migrate mediawiki/extensions/I* J* L* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430041 (https://phabricator.wikimedia.org/T183512) [07:40:14] (03CR) 10Hashar: [C: 032] Migrate mediawiki/extensions/I* J* L* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430041 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [07:41:11] (03Merged) 10jenkins-bot: Migrate mediawiki/extensions G* H* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430040 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [07:41:47] (03Merged) 10jenkins-bot: Migrate mediawiki/extensions/I* J* L* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430041 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [07:42:07] anyway I am not working today. :] [07:51:38] hasharAway: me too ;) [08:16:07] 10Gerrit, 10Documentation: Gititles does not display 
 blocks in repository descriptions - https://phabricator.wikimedia.org/T193468#4170493 (10Tgr)
[08:40:53] 	 (03PS1) 10Hashar: Migrate mediawiki/extensions/M* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430043 (https://phabricator.wikimedia.org/T183512)
[08:51:02] 	 (03PS1) 10Hashar: Migrate mediawiki/extensions/N* O* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430044 (https://phabricator.wikimedia.org/T183512)
[08:52:28] 	 10Phabricator, 10Discourse, 10Developer-Relations (Apr-Jun-2018): Enable Wikimedia Phabricator login in discourse-mediawiki.wmflabs.org - https://phabricator.wikimedia.org/T184987#4170521 (10Tgr) I have 2FA and it seems to work. Couldn't fully test as I use a different email address in Phabricator but Discou...
[08:56:37] 	 10Deployments, 10MediaWiki-Debug-Logger, 10Patch-For-Review, 10User-Tgr: Capture PHP warnings with stacktraces in MediaWiki and save to logstash - https://phabricator.wikimedia.org/T45086#4170524 (10Tgr) Hm, not sure why I didn't find it. Thanks Krinkle.  What would be the next step here? Get a full list o...
[09:53:11] 	 10Deployments, 10MediaWiki-Debug-Logger, 10Patch-For-Review, 10User-Tgr: Capture PHP warnings with stacktraces in MediaWiki and save to logstash - https://phabricator.wikimedia.org/T45086#4170614 (10Tgr)
[09:58:11] 	 10Continuous-Integration-Config, 10MediaWiki-Debug-Logger, 10Patch-For-Review: Log suppressed errors with level=DEBUG - https://phabricator.wikimedia.org/T193472#4170617 (10Tgr) The patch breaks CI which checks that nothing gets logged on the error channel (https://integration.wikimedia.org/ci/job/mediawiki-...
[10:00:05] 	 10Release-Engineering-Team (Kanban), 10MediaWiki-SWAT-deployments, 10User-greg, 10User-zeljkofilipin: Proposal: Effective immediately, disallow multi-sync patch deployment - https://phabricator.wikimedia.org/T187761#4170622 (10MarcoAurelio) Okay. Thanks for explaining @Krinkle  Does that mean that I have t...
[10:04:22] 	 (03PS1) 10Hashar: Migrate mediawiki/extensions/P* Q* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430051 (https://phabricator.wikimedia.org/T183512)
[10:05:03] 	 (03CR) 10Hashar: [C: 032] Migrate mediawiki/extensions/M* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430043 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar)
[10:05:06] 	 (03CR) 10Hashar: [C: 032] Migrate mediawiki/extensions/N* O* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430044 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar)
[10:05:11] 	 (03CR) 10Hashar: [C: 032] Migrate mediawiki/extensions/P* Q* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430051 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar)
[10:06:20] 	 (03Merged) 10jenkins-bot: Migrate mediawiki/extensions/M* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430043 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar)
[10:06:31] 	 (03Merged) 10jenkins-bot: Migrate mediawiki/extensions/N* O* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430044 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar)
[10:06:33] 	 (03Merged) 10jenkins-bot: Migrate mediawiki/extensions/P* Q* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430051 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar)
[11:45:44] 	 (03PS1) 10Hashar: Migrate mediawiki/extensions/R* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430055 (https://phabricator.wikimedia.org/T183512)
[11:48:05] 	 (03PS1) 10MarcoAurelio: Cleanup redundant rules [extensions/WantedPagesFromNS] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/430056
[12:12:40] 	 (03PS1) 10Hashar: Migrate mediawiki/extensions/S* T* U* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430059 (https://phabricator.wikimedia.org/T183512)
[12:13:00] 	 (03CR) 10Hashar: [C: 032] Migrate mediawiki/extensions/R* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430055 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar)
[12:13:04] 	 (03CR) 10Hashar: [C: 032] Migrate mediawiki/extensions/S* T* U* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430059 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar)
[12:14:07] 	 (03CR) 10jerkins-bot: [V: 04-1] Migrate mediawiki/extensions/S* T* U* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430059 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar)
[12:14:36] 	 (03Merged) 10jenkins-bot: Migrate mediawiki/extensions/R* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430055 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar)
[12:14:38] 	 (03CR) 10jerkins-bot: [V: 04-1] Migrate mediawiki/extensions/S* T* U* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430059 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar)
[12:15:55] 	 (03PS2) 10Hashar: Migrate mediawiki/extensions/S* T* U* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430059 (https://phabricator.wikimedia.org/T183512)
[12:16:26] 	 (03CR) 10Hashar: [C: 032] Migrate mediawiki/extensions/S* T* U* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430059 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar)
[12:18:17] 	 (03Merged) 10jenkins-bot: Migrate mediawiki/extensions/S* T* U* to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430059 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar)
[12:23:13] 	 10Project-Admins: Create phabricator project for the Wiki Loves Love contest - https://phabricator.wikimedia.org/T193377#4170898 (10Wikilover90) Interested people please add your name in the team:  https://commons.wikimedia.org/wiki/Commons:Wiki_Loves_Love_2018  Since it is an international level contest, we nee...
[12:24:22] 	 (03PS1) 10Hashar: Migrate rest of passing extensions to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430061 (https://phabricator.wikimedia.org/T183512)
[12:24:45] 	 10Project-Admins, 10User-MarcoAurelio: Create phabricator project for the Wiki Loves Love contest - https://phabricator.wikimedia.org/T193377#4170900 (10MarcoAurelio) a:03MarcoAurelio I'll take care of this one.
[12:25:38] 	 (03CR) 10Hashar: [C: 032] Migrate rest of passing extensions to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430061 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar)
[12:27:08] 	 (03Merged) 10jenkins-bot: Migrate rest of passing extensions to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430061 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar)
[14:09:20] 	 10Release-Engineering-Team, 10MediaWiki-Parser, 10MediaWiki-Platform-Team, 10Parsing-Team, 10Tidy: Different versions of Tidy installed on different production servers? - https://phabricator.wikimedia.org/T193414#4171035 (10ssastry) The original problem in the description persists. For example, mw1250, m...
[14:09:44] 	 10Release-Engineering-Team, 10MediaWiki-Parser, 10MediaWiki-Platform-Team, 10Parsing-Team, 10Tidy: Different versions of Tidy installed on different production servers? - https://phabricator.wikimedia.org/T193414#4171038 (10ssastry) p:05Triage>03High
[14:12:45] 	 10Release-Engineering-Team, 10MediaWiki-Parser, 10MediaWiki-Platform-Team, 10Parsing-Team, 10Tidy: Different versions of Tidy installed on different production servers? - https://phabricator.wikimedia.org/T193414#4171048 (10ssastry) Not sure who can look into this ..  Release Engineering or MediaWiki Pla...
[14:16:31] 	 10Release-Engineering-Team, 10MediaWiki-Parser, 10MediaWiki-Platform-Team, 10Parsing-Team, 10Tidy: Different production servers tidy output differently - https://phabricator.wikimedia.org/T193414#4171052 (10ssastry)
[14:23:01] 	 10Release-Engineering-Team, 10MediaWiki-Parser, 10MediaWiki-Platform-Team, 10Parsing-Team, 10Tidy: Different production servers tidy output differently - https://phabricator.wikimedia.org/T193414#4171056 (10ssastry) ``` ssastry@mw1269:~$ tidy -v HTML Tidy for Linux version 5.2.0 ... ... ssastry@mw1330:~$...
[14:29:53] 	 10Release-Engineering-Team, 10MediaWiki-Parser, 10MediaWiki-Platform-Team, 10Parsing-Team, 10Tidy: Different production servers tidy output differently - https://phabricator.wikimedia.org/T193414#4168635 (10Anomie) >>! In T193414#4171035, @ssastry wrote: > The original problem in the description persists...
[14:53:00] 	 10Release-Engineering-Team, 10MediaWiki-Parser, 10MediaWiki-Platform-Team, 10Parsing-Team, 10Tidy: Different production servers tidy output differently - https://phabricator.wikimedia.org/T193414#4171117 (10ssastry) >>! In T193414#4171065, @Anomie wrote: >>>! In T193414#4171035, @ssastry wrote: >> The or...
[14:59:08] 	 (03CR) 10Jforrester: "Wow, might we be able to actually test PG before merge rather than find out two days later from Travis? That'd be brilliant." [integration/config] - 10https://gerrit.wikimedia.org/r/430037 (owner: 10Legoktm)
[14:59:28] 	 10Release-Engineering-Team, 10MediaWiki-Parser, 10MediaWiki-Platform-Team, 10Parsing-Team, 10Tidy: Different production servers tidy output differently - https://phabricator.wikimedia.org/T193414#4171156 (10Anomie) >>! In T193414#4171117, @ssastry wrote: > When I looked at view source and looked at the s...
[15:17:14] 	 10Release-Engineering-Team, 10MediaWiki-Parser, 10MediaWiki-Platform-Team, 10Parsing-Team, 10Tidy: Different production servers tidy output differently - https://phabricator.wikimedia.org/T193414#4171220 (10Jdforrester-WMF) Yes, we had a task a couple of weeks ago from @hashar about this – MediaWiki does...
[15:18:39] 	 Bah, no hashar, presumably because of it being 1 May.
[15:21:36] 	 10Release-Engineering-Team, 10MediaWiki-Parser, 10MediaWiki-Platform-Team, 10Parsing-Team, 10Tidy: Different production servers tidy output differently - https://phabricator.wikimedia.org/T193414#4171242 (10Jdforrester-WMF) Found it: {T191771}
[15:22:42] 	 10Release-Engineering-Team, 10MediaWiki-Parser, 10MediaWiki-Platform-Team, 10Operations, and 2 others: Different production servers have different versions of tidy installed, resulting in varying output - https://phabricator.wikimedia.org/T193414#4171244 (10Jdforrester-WMF)
[16:01:00] 	 10Release-Engineering-Team, 10MediaWiki-Parser, 10MediaWiki-Platform-Team, 10Operations, and 2 others: Different production servers have different versions of tidy installed, resulting in varying output - https://phabricator.wikimedia.org/T193414#4171313 (10ssastry) >>! In T193414#4171156, @Anomie wrote: >...
[16:02:06] 	 10Release-Engineering-Team, 10MediaWiki-Parser, 10MediaWiki-Platform-Team, 10Operations, and 2 others: Different production servers have different versions of tidy installed, resulting in varying output - https://phabricator.wikimedia.org/T193414#4171319 (10ssastry) >>! In T193414#4171220, @Jdforrester-WMF...
[16:12:32] 	 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10Services, 10MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), and 2 others: deployment-prep has jobqueue issues - https://phabricator.wikimedia.org/T192473#4140086 (10Pchelolo) It seems this task got derailed completely from the origi...
[16:29:02] 	 10Release-Engineering-Team (Kanban), 10User-greg: Write JD for DevProd position - https://phabricator.wikimedia.org/T193502#4171388 (10greg) p:05Triage>03Normal
[16:34:24] 	 10Gerrit, 10Documentation: Gitiles does not display 
 blocks in repository descriptions - https://phabricator.wikimedia.org/T193468#4171414 (10Quiddity)
[16:34:38] 	 thcipriani: we got a ping on T193202 in #wikimedia-cloud
[16:34:38] 	 T193202: Request access for deployment-prep - https://phabricator.wikimedia.org/T193202
[16:35:39] 	 bd808: thanks for the ping, hadn't noticed this one :( I'll take a look.
[16:38:11] 	 I would have just added her, but I bet there will be some need for a tour of the universe too
[16:38:38] 	 her irc nick is nataliaharateh
[16:39:04] 	 thanks!
[16:46:11] 	 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10Services, 10MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), and 2 others: deployment-prep has jobqueue issues - https://phabricator.wikimedia.org/T192473#4171459 (10EddieGP) >>! In T192473#4171334, @Pchelolo wrote: > The Kafka queue...
[16:46:19] 	 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10Services, 10MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), and 2 others: deployment-prep has jobqueue issues - https://phabricator.wikimedia.org/T192473#4171461 (10EddieGP) 05Open>03Resolved a:03EddieGP
[16:46:44] 	 I'm so far behind in my phab bugmail I think I'm going to declare bankruptcy
[16:47:50] 	 wanna lawyer to file the papers in the court greg-g - I can do you a nice discount :-P
[16:48:09] 	 Hauskatze: :)
[16:49:11] * Hauskatze tests apparent jobqueue resolution on beta
[16:50:11] 	 10Release-Engineering-Team (Kanban): Request access for deployment-prep - https://phabricator.wikimedia.org/T193202#4171477 (10thcipriani) 05Open>03Resolved Added Nharateh to the deployment-prep project. Closing this task, if you need additional access of have problems feel free to reopen.
[16:50:20] 	 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10Wikimedia-Logstash: logstash-beta not recording since April, 20th 2018 - https://phabricator.wikimedia.org/T193133#4171480 (10EddieGP) 05Open>03Invalid What's the correct closed status for "Whoever fixed this did so inadvertently or did not kno...
[16:51:06] 	 !log maurelio@deployment-tin:~$ mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=deploymentwiki --logwiki=deploymentwiki 'Spambot~BobFeliciano' 'BobFeliciano'
[16:51:08] 	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[16:58:30] 	 10Beta-Cluster-Infrastructure, 10Patch-For-Review: Ensure replica DB in labs is read-only - https://phabricator.wikimedia.org/T183245#4171514 (10EddieGP)
[16:58:33] 	 10Beta-Cluster-Infrastructure, 10DBA, 10Operations: Possible to run writes (e.g. UPDATE) on Beta Cluster replica - https://phabricator.wikimedia.org/T110115#4171517 (10EddieGP)
[17:05:23] 	 (03PS1) 10Hashar: Move OAuthAuthentication and WebChat to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430086 (https://phabricator.wikimedia.org/T183512)
[17:05:40] 	 (03CR) 10Hashar: [C: 032] Move OAuthAuthentication and WebChat to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430086 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar)
[17:07:05] 	 (03Merged) 10jenkins-bot: Move OAuthAuthentication and WebChat to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/430086 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar)
[17:29:41] 	 (03CR) 10MarcoAurelio: [V: 032] Cleanup redundant rules [extensions/WantedPagesFromNS] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/430056 (owner: 10MarcoAurelio)
[17:47:51] 	 10Continuous-Integration-Config: Publish Doxygen output for RunningStat to doc.wikimedia.org - https://phabricator.wikimedia.org/T193508#4171652 (10Krinkle)
[17:48:09] 	 10Continuous-Integration-Config, 10Librarization: Publish Doxygen output for RunningStat to doc.wikimedia.org - https://phabricator.wikimedia.org/T193508#4171663 (10Krinkle)
[17:48:34] 	 10Continuous-Integration-Config, 10Librarization: Publish Doxygen output for RunningStat to doc.wikimedia.org - https://phabricator.wikimedia.org/T193508#4171652 (10Krinkle)
[17:48:43] 	 10Continuous-Integration-Config, 10Librarization: Publish Doxygen for RunningStat library - https://phabricator.wikimedia.org/T185724#3923868 (10Krinkle)
[17:49:12] 	 10Continuous-Integration-Config, 10Librarization: Publish Doxygen for RunningStat library - https://phabricator.wikimedia.org/T185724#3923868 (10Krinkle)
[17:49:15] 	 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10Wikimedia-Logstash: logstash-beta not recording since April, 20th 2018 - https://phabricator.wikimedia.org/T193133#4171672 (10MarcoAurelio) I'd say resolved because this was not a lie :-) But whatever, if this is resolved now that's what matters.
[17:52:37] 	 10Project-Admins, 10User-MarcoAurelio: Create phabricator project for the Wiki Loves Love contest - https://phabricator.wikimedia.org/T193377#4171703 (10MarcoAurelio) I've created #wiki-loves-love and added @Psychoslave as initial member. You can edit the description at https://phabricator.wikimedia.org/projec...
[17:54:05] 	 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Kanban): Request access for deployment-prep - https://phabricator.wikimedia.org/T193202#4171722 (10MarcoAurelio)
[17:54:36] 	 10Beta-Cluster-Infrastructure, 10JobRunner-Service, 10User-MarcoAurelio: GlobalRename refuses to work on Beta Cluster - https://phabricator.wikimedia.org/T192604#4171723 (10MarcoAurelio) 05Open>03Resolved a:03MarcoAurelio This is now fixed by someone at some moment somewhere.
[17:55:53] 	 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10Services, 10MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), and 2 others: deployment-prep has jobqueue issues - https://phabricator.wikimedia.org/T192473#4171740 (10MarcoAurelio) > This link shows that the rename process was correct...
[19:01:16] 	 10Release-Engineering-Team (Kanban), 10Quibble: Error: 1071 Specified key was too long; max key length is 767 bytes - https://phabricator.wikimedia.org/T193222#4172053 (10hashar) a:05hashar>03None
[19:11:42] 	 10Release-Engineering-Team (Kanban), 10Quibble: [BetaFeatures] sql/create_counts.sql : Error: 1071 Specified key was too long; max key length is 767 bytes - https://phabricator.wikimedia.org/T193533#4172148 (10hashar)
[19:17:22] 	 10Release-Engineering-Team (Kanban), 10Quibble: [CodeReview] codereview.sql : Error: 1071 Specified key was too long; max key length is 767 bytes - https://phabricator.wikimedia.org/T193538#4172220 (10hashar)
[19:19:42] 	 10Release-Engineering-Team (Kanban), 10Quibble: [Comments] sql/comments.sql : Error: 1071 Specified key was too long; max key length is 767 bytes - https://phabricator.wikimedia.org/T193539#4172239 (10hashar)
[19:27:16] 	 10Release-Engineering-Team (Kanban), 10Quibble: Error: 1071 Specified key was too long; max key length is 767 bytes - https://phabricator.wikimedia.org/T193222#4163311 (10Bawolff) Note, that the installer will normally set either `$wgDBTableOptions = 'ENGINE=InnoDB,DEFAULT CHARSET=binary';` or `$wgDBTableOptio...
[19:28:41] 	 (03CR) 10Legoktm: [C: 04-1] "I have an idea." [integration/quibble] - 10https://gerrit.wikimedia.org/r/430035 (owner: 10Legoktm)
[19:54:17] 	 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4172587 (10hashar)
[20:48:17] 	 @awight: could the problem with `git-lfs pull` be simply that we haven't ran `git lfs install` on the targets?
[20:58:15] 	 10Release-Engineering-Team (Kanban), 10Scap, 10Scoring-platform-team, 10Patch-For-Review: Support git-lfs - https://phabricator.wikimedia.org/T180627#4172761 (10mmodell) @awight: I think the latest problem is that we don't run `git lfs install` automatically on targets.  I've ran the command manually on or...
[21:02:40] 	 10Gerrit, 10ORES, 10Operations, 10Patch-For-Review, 10Scoring-platform-team (Current): Plan migration of ORES repos to git-lfs - https://phabricator.wikimedia.org/T181678#4172772 (10mmodell) @awight: `git lfs install` needs to be executed on each target and that isn't happening, currently. I can add a ho...
[21:20:46] 	 Project mwext-phpunit-coverage-publish build #4008: 04FAILURE in 4 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/4008/
[21:21:44] 	 twentyafterfour: oho!  nice find, lemme try another canary deployment...
[21:24:24] 	 Yippee, build fixed!
[21:24:24] 	 Project mwext-phpunit-coverage-publish build #4009: 09FIXED in 1 min 21 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/4009/
[21:26:00] 	 10Release-Engineering-Team (Kanban), 10User-greg: Create q3 quarterly check in slides - https://phabricator.wikimedia.org/T192935#4172836 (10greg) TP6 done.
[21:31:25] 	 Project mwext-phpunit-coverage-publish build #4012: 04FAILURE in 3.3 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/4012/
[21:32:24] 	 Yippee, build fixed!
[21:32:24] 	 Project mwext-phpunit-coverage-publish build #4013: 09FIXED in 47 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/4013/
[21:35:28] 	 10Gerrit, 10ORES, 10Operations, 10Patch-For-Review, 10Scoring-platform-team (Current): Plan migration of ORES repos to git-lfs - https://phabricator.wikimedia.org/T181678#4172851 (10awight) @mmodell I'm reading some strange stuff here, https://github.com/git-lfs/git-lfs/wiki/Installation Apparently, `git...
[21:49:24] 	 (03CR) 10Chad: [C: 032] Rewrite testReleaseTarball.php as test_tarball.py [tools/release] - 10https://gerrit.wikimedia.org/r/429578 (owner: 10Chad)
[21:50:03] 	 (03Merged) 10jenkins-bot: Rewrite testReleaseTarball.php as test_tarball.py [tools/release] - 10https://gerrit.wikimedia.org/r/429578 (owner: 10Chad)
[21:50:11] 	 twentyafterfour: FYI, scap deploy -f isn't removing a stale checkout of this same revision... strange.
[21:50:21] 	 I'll bump with a dummy commit
[21:52:02] 	 (03CR) 10Chad: [C: 032] makerelease: Compute skins/extensions list on the fly [tools/release] - 10https://gerrit.wikimedia.org/r/428675 (owner: 10Chad)
[21:52:04] 	 (03PS4) 10Chad: makerelease: Compute skins/extensions list on the fly [tools/release] - 10https://gerrit.wikimedia.org/r/428675
[21:52:39] 	 awight: odd.
[21:52:42] 	 10Gerrit, 10ORES, 10Operations, 10Patch-For-Review, 10Scoring-platform-team (Current): Plan migration of ORES repos to git-lfs - https://phabricator.wikimedia.org/T181678#4172903 (10mmodell) @awight: I don't think `git lfs install --local` will take care of the submodules. I suppose I could do `git submo...
[21:53:07] 	 awight: oh maybe because I had a shell with cwd set to /srv/deployment/ores/deploy-cache/revs/4601497c4f4363fcea639dc3e13d4f178c421a1b/submodules/assets/word2vec  ?
[21:53:20] 	 logged out now
[21:53:44] 	 twentyafterfour: AWESOME.  -rw-r--r-- 1 deploy-service deploy-service 1647046227 May  1 21:52 submodules/assets/word2vec/GoogleNews-vectors-negative300.bin.gz
[21:54:05] 	 Should I leave any of these tasks open for cleanup work?
[21:55:30] 	 awight: yeah we still need to decide what to do about git-lfs-install at least
[21:56:05] 	 if `git submodule foreach 'git lfs install --local'` does the trick I guess that would resolve it
[21:56:19] 	 ah that sounds fine to me
[21:56:44] 	 Just to get this straight, we're talking about another scap deployment, right?
[22:02:19] 	 10Release-Engineering-Team (Kanban), 10Scap, 10Scoring-platform-team, 10Patch-For-Review: Support git-lfs - https://phabricator.wikimedia.org/T180627#4172945 (10awight) Good news!  We've done an initial LFS deployment of the 1.6GB word2vec binary and it landed successfully on ores1001!  There's one last de...
[22:02:34] 	 10Continuous-Integration-Config, 10Operations, 10puppet-compiler, 10Puppet: Figure out a way to enable volunteers to use the puppet compiler - https://phabricator.wikimedia.org/T192532#4172946 (10RobH) This maybe something for @joe to review (since he is quite familiar with the compiler)?
[22:03:13] 	 Project mwext-phpunit-coverage-publish build #4015: 04FAILURE in 3.5 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/4015/
[22:05:15] 	 10Gerrit, 10ORES, 10Operations, 10Patch-For-Review, 10Scoring-platform-team (Current): Plan migration of ORES repos to git-lfs - https://phabricator.wikimedia.org/T181678#4172949 (10awight) I'm happy with either solution, either a redundant `git lfs install` or the submodule foreach.  It would be very su...
[22:13:01] 	 Yippee, build fixed!
[22:13:02] 	 Project mwext-phpunit-coverage-publish build #4016: 09FIXED in 9 min 24 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/4016/
[22:18:16] 	 Project mwext-phpunit-coverage-publish build #4017: 04FAILURE in 3.5 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/4017/
[22:22:22] 	 Yippee, build fixed!
[22:22:23] 	 Project mwext-phpunit-coverage-publish build #4018: 09FIXED in 1 min 21 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/4018/
[23:14:57] 	 jenkins is making me :'(
[23:15:24] 	 My phan patch passes tests locally. It fails on jenkins
[23:15:50] 	 add a debugging statement that does nothing but essentially var_dump() some stuff so i can see what's going on in jenkins, suddenly it passes
[23:16:20] 	 This is for https://gerrit.wikimedia.org/r/#/c/429581/ . I'm just soo confused
[23:17:01] * bawolff just needed to rant here. I'm not expecting any help since i doubt its actually a jenkins issue as its the tests i wrote myself
[23:26:52] 	 10Gerrit, 10ORES, 10Operations, 10Patch-For-Review, 10Scoring-platform-team (Current): Plan migration of ORES repos to git-lfs - https://phabricator.wikimedia.org/T181678#4173222 (10mmodell) {D1039}
[23:27:19] 	 10Release-Engineering-Team (Kanban), 10Scap, 10Scoring-platform-team, 10Patch-For-Review: Support git-lfs - https://phabricator.wikimedia.org/T180627#4173223 (10mmodell)
[23:27:21] 	 10Release-Engineering-Team (Kanban), 10Quibble: Error: 1071 Specified key was too long; max key length is 767 bytes - https://phabricator.wikimedia.org/T193222#4173224 (10jcrespo) I am not sure if creating so many tasks is the right way- in some cases the fields are overprovisioned, but in others, like video,...
[23:30:31] 	 10Release-Engineering-Team (Kanban), 10Quibble: Error: 1071 Specified key was too long; max key length is 767 bytes - https://phabricator.wikimedia.org/T193222#4173232 (10Bawolff) Personally, I think we should just make everything varbinary(), or be more explicit about what fields are charset configurable.  Ha...
[23:34:45] 	 (03PS1) 10Jforrester: [Vector] Add Phan [integration/config] - 10https://gerrit.wikimedia.org/r/430272
[23:35:39] 	 10Release-Engineering-Team (Kanban), 10Quibble: Error: 1071 Specified key was too long; max key length is 767 bytes - https://phabricator.wikimedia.org/T193222#4173240 (10jcrespo) Can we close or stall the subtasks?- not necessarily as a final decision, but to not do and later undo work, as clearly this needs...
[23:35:41] 	 (03CR) 10Jforrester: "Config patch is I587285fb368." [integration/config] - 10https://gerrit.wikimedia.org/r/430272 (owner: 10Jforrester)
[23:36:53] 	 (03CR) 10Jforrester: "Oops, dupe of Iced3b9f7d10." [integration/config] - 10https://gerrit.wikimedia.org/r/430272 (owner: 10Jforrester)
[23:36:57] 	 (03Abandoned) 10Jforrester: [Vector] Add Phan [integration/config] - 10https://gerrit.wikimedia.org/r/430272 (owner: 10Jforrester)
[23:37:42] 	 (03PS2) 10Jforrester: [Vector] Run phan [integration/config] - 10https://gerrit.wikimedia.org/r/400157 (https://phabricator.wikimedia.org/T179554) (owner: 10Phantom42)
[23:38:57] 	 (03CR) 10Jforrester: "Config patch for the repo is I587285fb368." [integration/config] - 10https://gerrit.wikimedia.org/r/400157 (https://phabricator.wikimedia.org/T179554) (owner: 10Phantom42)
[23:39:22] 	 10Release-Engineering-Team (Kanban), 10Quibble: Error: 1071 Specified key was too long; max key length is 767 bytes - https://phabricator.wikimedia.org/T193222#4173242 (10jcrespo) > I think we should just make everything varbinary()  I don't agree or disagree, we use binary for almost everything at WMF product...