[00:07:47] <wikibugs>	 6Labs, 7Database: High replag at labs db - https://phabricator.wikimedia.org/T119315#1823353 (10Luke081515) 3NEW
[00:45:22] <Merlissimo>	 lag
[01:05:14] <Betacommand>	 Merlissimo: yep http://tools.wmflabs.org/betacommand-dev/cgi-bin/replag
[01:07:32] <Luke081515>	 since about 17:15 UTC, it seems like there is no replication (dewiki and commons and a few others)
[01:36:47] <wikibugs>	 6Labs, 5Patch-For-Review, 7Tracking: Make OpenStack Horizon useful for production labs - https://phabricator.wikimedia.org/T87279#1823416 (10Negative24) @Addshore, You can reopen T104910 if we have people that will triage the bug reports. I'm not as familiar with the OpenStack projects in Labs.
[01:57:02] <Luke081515>	 !log rcm deleted rcm-5 (specific tests done)
[01:57:07] <labs-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Rcm/SAL, Master
[08:38:52] <wllm>	 Howdy, all.
[08:44:25] <wllm>	 Now, I hope y’all don’t just ban or kick problems away.
[08:44:40] <wllm>	 Barras2 has a pretty bad habit of that.
[08:45:10] <wllm>	 Moreover, I hope y’all don’t see me as a problem.
[08:45:18] <wllm>	 Cause I’m here to stay.
[08:46:07] <wllm>	 After all, the only way to keep someone out of a public IRC channel is to make it private.
[09:09:14] <wllm>	 Katie: You’re in here, too?
[09:09:30] <wllm>	 Wow. What a small world.
[09:29:52] <wllm>	 Kicked from another channel. . .
[09:29:57] <wllm>	 This is a serious problem. . .
[09:30:59] <wllm>	 It seems that no one has the courage to hold to the values of Wikipedia and the WMF on these channels.
[09:31:22] <wllm>	 YuviPanda: Gonna kick me here, too?
[09:31:39] <wllm>	 Have you figured out who I am yet?
[09:32:18] <wllm>	 Hint: I’m a guy that some people think is worth listening to.
[09:42:17] <wllm>	 YuviPanda: Figured out who I am yet?
[09:42:31] <wllm>	 Gonna ban me again?
[09:43:03] <wllm>	 Do you have the “courage”?
[09:44:47] <wllm>	 Yeah. . . I didn’t think so.
[09:47:15] <YuviPanda>	 @kick wllm
[12:51:53] <Luke081515>	 19:36:24 replag at dewiki, and commonswiki
[12:52:02] <Luke081515>	 can someone help to solve this issue?
[13:09:57] <addshore>	 *faceplam* I made an xlarge instance but by default it doesnt actually mount / use all of the diskspace for that size of an instance?
[13:09:59] <addshore>	 bah!
[13:12:26] <Reedy>	 addshore: Isn't there an extra puppet think you need to check?
[13:12:41] <addshore>	 bah, whut, why >.>
[13:13:03] <addshore>	 labsdrives ?
[13:13:09] <Reedy>	 I seem to remember something like that when creating a mysql instance for beta
[13:14:08] <addshore>	 can I just go and resize2fs it or am I going to break shit?
[13:14:32] <Reedy>	 https://doc.wikimedia.org/puppet/classes/__site__/role/labs/lvm/srv.html
[13:14:33] <Reedy>	 gj
[13:14:46] <addshore>	 I just looked at this thing and 47% of my disk has gone and its been running for 2.5 out of like 90 hours :P
[13:14:55] <Reedy>	 That labsdrive looks it might be right
[13:15:53] <Reedy>	 modules/role/manifests/labs/lvm/srv.pp:class role::labs::lvm::srv {
[13:15:57] <addshore>	 Allocate all of the instance‘s extra space as /srv
[13:16:14] <Reedy>	 # Allocate all of the instance's extra space as /srv
[13:16:15] <Reedy>	 Yup
[13:16:19] <Reedy>	 DAT ONE
[13:16:42] <addshore>	 ffs
[13:17:24] <addshore>	 *goes to the office*
[13:18:10] <wikibugs>	 6Labs: doc.wikimedia.org puppet documentation for labs/lvm/srv.html gives a 404 - https://phabricator.wikimedia.org/T119329#1823602 (10Reedy) 3NEW
[13:18:23] <wikibugs>	 6Labs, 7Documentation: doc.wikimedia.org puppet documentation for labs/lvm/srv.html gives a 404 - https://phabricator.wikimedia.org/T119329#1823609 (10Reedy)
[13:19:02] <wikibugs>	 6Labs, 7Documentation, 7Puppet: doc.wikimedia.org puppet documentation for labs/lvm/srv.html gives a 404 - https://phabricator.wikimedia.org/T119329#1823612 (10Reedy)
[13:19:16] <wikibugs>	 6Labs, 7Documentation, 7Puppet: doc.wikimedia.org puppet documentation for labs/lvm/srv.html gives a 404 - https://phabricator.wikimedia.org/T119329#1823613 (10Addshore) I guess this should instead be linked to https://doc.wikimedia.org/puppet/classes/role/labs/lvm/srv.html from wikitech
[13:22:12] <wikibugs>	 6Labs, 10MediaWiki-extensions-OpenStackManager, 7Documentation, 7Puppet: doc.wikimedia.org puppet documentation for labs/lvm/srv.html gives a 404 - https://phabricator.wikimedia.org/T119329#1823624 (10Reedy)
[13:25:33] <addshore>	 need to go and get some food, and now its snowing :D
[13:27:02] <Reedy>	 In Berlin?
[13:27:08] <addshore>	 yup
[13:49:13] <addshore>	 right, all running again! :) ty for the poke in the right direction Reedy! just another 90 ish hours to wait now!
[13:49:22] <Reedy>	 90 hours for what?
[13:49:59] <addshore>	 tearing bits of stuff out of a wikibase json dump and shoving them in mysql tables
[13:50:15] <addshore>	 github.com/JeroenDeDauw/QueryrAPI github.com/JeroenDeDauw/Replicator
[14:26:25] <wm-bot>	 Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Shoichi was created, changed by Shoichi link https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Shoichi edit summary: Created page with "{{Tools Access Request |Justification=For solving  CJK(Chinese Japanese Korean) Kanji lacking characters problem on Wikisource,Wikipedia ,  I want to test the  IDS(Unicode IDS..."
[14:27:43] <Reedy>	 ^ I think he's a bit misguided
[14:27:52] <Reedy>	 "Then I will apply my extension https://github.com/MGdesigner/Mediawiki-IDSextension on Chinese Wikisource,Wikipedia. Then we can use <ids>ids string</ids> tag to render mass Kanji lacking characters."
[14:49:39] <Zhaofeng_Li>	 Reedy: Sorry if the question seems stupid, but what does it even mean?
[14:50:10] <Zhaofeng_Li>	 What's that "CJK Kanji lacking character problem" he's talking about?
[14:52:04] <Reedy>	 I honestly couldn't say
[14:52:11] <Reedy>	 But he's not going to just get an extension installed like that :)
[15:02:20] <Zhaofeng_Li>	 Looks like the extension can use a third-party server to render some obscure characters, but requires the characters be represented as Unicode IDs in the wikitext, which may be inconvenient to editors.
[15:55:40] <Reedy>	 And using a random third party server is a no no
[18:48:51] <tseppelt>	 Hi everybody, I set up an OAuth application on tool labs and am now waiting for the approval of my consumer. I pinged two oauth-administrators on meta, but I guess this is not the best way to do it. Where should I apply? How is it working? I can't find suitable information anywhere. Thank you!
[19:45:16] <wikibugs>	 6Labs, 7Database: High replag at labs db - https://phabricator.wikimedia.org/T119315#1823817 (10hoo) labsdb1001 is ok, labsdb1002 is not. I didn't check any others.
[19:52:07] <tseppelt>	 My problem is solved. Thanks.
[19:55:32] <multichill>	 tseppelt: Doesn't seem to be very well documented
[19:55:52] <Reedy>	 multichill: you just need to ask the right people ;)
[19:56:23] <Reedy>	 But yeah, someone should be reviewing the queue...
[19:56:29] <multichill>	 https://meta.wikimedia.org/wiki/Meta:OAuth_administrators is outdated
[19:56:42] <multichill>	 Help the man out Reedy ;-)
[19:56:43] <Reedy>	 We probably need a state of something like "release wanted"
[19:57:13] <Reedy>	 As a proposed consumer on the list doesn't mean it wants to be released for everyone; might still be in development
[19:57:45] <Reedy>	 multichill: https://meta.wikimedia.org/w/index.php?title=Special%3AListUsers&username=&group=oauthadmin&limit=50
[19:57:46] <Reedy>	 yw
[19:57:47] <Reedy>	 :D
[19:58:26] <multichill>	 I know, I noticed you in that list Sam
[19:58:39] <Reedy>	 This page provides information on the "OAuth adminstrators" group on MediaWikiWiki.
[19:58:44] <Reedy>	 That's wrong, it was moved to meta
[20:04:19] <multichill>	 Reedy: https://meta.wikimedia.org/w/index.php?title=Special:ListUsers&group=oauthadmin <- I looked here
[20:04:26] <multichill>	 Looks like you moved there too!
[20:04:53] <Reedy>	 I think it was all migrated
[20:06:39] <multichill>	 chippy: The warper box seemed a bit unstable this afternoon. Unable to sign in and 502's at some point. Any idea why?
[20:14:40] <tseppelt>	 Another question: I try to write data to a database on tools-db using JDBC with the standard MariaDB driver. I get this error: java.sql.SQLNonTransientConnectionException: Could not read resultset: unexpected end of stream, read 0bytes from 4 Is this problem known?
[20:35:40] <wikibugs>	 6Labs, 7Database: High replag at labs db - https://phabricator.wikimedia.org/T119315#1823887 (10hoo)
[20:43:12] <wm-bot>	 Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Shoichi was modified, changed by Tim Landscheidt link https://wikitech.wikimedia.org/w/index.php?diff=207372 edit summary: 
[20:49:16] <seth__>	 hi!
[20:49:55] <seth__>	 the databases at labs seem unsynchronized. I guess that https://phabricator.wikimedia.org/T119315 is the corresponding issue.
[20:50:12] <seth__>	 Does anybody know, when this will work again?
[20:52:42] <Reedy>	 I would suspect it should get resolved tomorrow when Ops are working and the DBA is available
[20:53:54] <gifti>	 seth__: have you tried s1?
[20:55:02] <seth__>	 how do I try s1?
[20:56:42] <gifti>	 mysql --defaults-file="${HOME}"/replica.my.cnf -h s1.labsdb
[20:56:51] <gifti>	 seems to work
[20:57:16] <gifti>	 [dewiki_p]> select max(rev_timestamp) from revision; 20151122205612
[20:58:34] <seth__>	 hmm: SELECT command denied to user '...' for table 'revision'
[20:59:02] <seth__>	 oops, no, sorry, works
[20:59:05] <seth__>	 :-)
[21:00:16] <tseppelt>	 is this connected to this error I get for tools-db java.sql.SQLNonTransientConnectionException: Could not read resultset: unexpected end of stream, read 0bytes from 4 ?
[21:01:05] <wikibugs>	 6Labs, 7Database: High replag at labs db - https://phabricator.wikimedia.org/T119315#1823929 (10Superyetkin) **s3** is also experiencing serious issues.
[21:01:39] <seth__>	 great! may I use s1 constantly?
[21:01:44] <gifti>	 s1, s2, s3 and tools-db should be independent
[21:01:50] <gifti>	 you may ;)
[21:02:27] <gifti>	 but it's generally better to use the server the system gives to you (better load distribution)
[21:03:17] <seth__>	 ok, thanks a lot! cu
[21:04:52] <tseppelt>	 Hm. And tools-db is behaving regularly? I am tired of looking for the problem behind it.
[21:07:52] <gifti>	 afaik it's ok
[21:10:54] <IVeertje>	 hi
[21:11:45] <tseppelt>	 Okay, thanks..
[21:14:57] <IVeertje>	 might it be a good idea to mirror http://reftag.appspot.com/
[21:15:04] <IVeertje>	 It has a GPL license
[21:15:23] <IVeertje>	 source is up on GitHub
[21:17:10] <chippy>	 multichill, hmm, it seems okay now? load seems okay. maybe a bit slow in general... in next week or so im deploying a newer version which should run quicker - with better caching etc
[21:17:31] <chippy>	 ive restarted apache
[21:17:49] <multichill>	 Think so. You might want to throw a proxy in front of the tiles? That makes it easier later to scale up
[21:18:49] <chippy>	 yeah, proxy is in the works
[21:19:50] <chippy>	 the thing is decaching (of course!) as each change means the tiles need decaching.
[21:32:19] <multichill>	 chippy: Eventual consistency is the bomb
[21:32:46] <multichill>	 YuviPanda: Can you ore someone else take a look at https://phabricator.wikimedia.org/T119315 ?
[21:33:07] <wikibugs>	 6Labs, 10Tool-Labs, 6operations, 7Database: Replication broken om labsdb1002. - https://phabricator.wikimedia.org/T119315#1823353 (10Multichill)
[21:37:32] <wikibugs>	 6Labs, 10Tool-Labs, 6operations, 7Database: Replication broken on labsdb1002. - https://phabricator.wikimedia.org/T119315#1823944 (10Giftpflanze)
[21:44:38] <multichill>	 chippy: How is the grant thing going?
[21:45:05] <chippy>	 multichill, I believe we hear after this weekend, so cross fingers.
[21:46:19] <multichill>	 How hard would it be to do i18n chippy?
[21:47:01] <multichill>	 Does the framework offer some sort of standard way of doing that?
[21:47:07] <chippy>	 multichill, well it's Rails, and has all the locale stuff in the framework yes
[21:47:21] <chippy>	 there's just the time to get the strings and translate them
[21:47:29] <multichill>	 That would be a big plus
[21:47:50] <multichill>	 If you can just store the actual translations in json we can easily add it to Translatewiki
[21:47:57] <chippy>	 right, yes!
[21:49:55] <multichill>	 chippy: https://github.com/wikimaps-dev/mapwarper <- what license is this?
[21:50:42] <chippy>	 multichill, well previously its been under MIT
[21:51:27] <chippy>	 so I think it will probably be the same, however we may or may not change it for wikimaps
[21:51:52] <chippy>	 either more or less depending on what folks feel happier with
[21:53:25] <multichill>	 So just put MIT on it, at least for now
[21:53:37] <chippy>	 right
[21:55:35] <multichill>	 nn