[00:33:28] <wikibugs>	 6Labs: Create new labs project for ifttt - https://phabricator.wikimedia.org/T122378#1902833 (10yuvipanda) 5Open>3Resolved
[00:33:29] <wikibugs>	 6Labs, 7Tracking: New Labs project requests (tracking) - https://phabricator.wikimedia.org/T76375#1902834 (10yuvipanda)
[01:06:17] <wikibugs>	 6Labs, 10Continuous-Integration-Infrastructure, 6operations, 7Puppet: compiler02.puppet3-diffs.eqiad.wmflabs out of disk space - https://phabricator.wikimedia.org/T122346#1902907 (10scfc) >>! In T122346#1902019, @Dzahn wrote: > I checked /mnt/jenkins-workspace/puppet-compiler/output# for especially large o...
[01:27:46] <wikibugs>	 6Labs, 5Continuous-Integration-Scaling: Nodepool can't SSH to spawn instances due to wmflabs provided instances due ssh algorithms - https://phabricator.wikimedia.org/T102459#1902962 (10Krenair) A labs instance with a name pointing to this ticket keeps going up and down :/
[01:50:04] <shinken-wm>	 RECOVERY - Puppet failure on tools-worker-1001 is OK: OK: Less than 1.00% above the threshold [0.0]
[01:56:01] <shinken-wm>	 PROBLEM - Puppet failure on tools-worker-1001 is CRITICAL: CRITICAL: 11.11% of data above the critical threshold [0.0]
[02:13:00] <shinken-wm>	 PROBLEM - Puppet failure on tools-worker-1005 is CRITICAL: CRITICAL: 57.14% of data above the critical threshold [0.0]
[02:21:18] <shinken-wm>	 RECOVERY - Puppet failure on tools-worker-1002 is OK: OK: Less than 1.00% above the threshold [0.0]
[04:24:36] <shinken-wm>	 PROBLEM - Puppet failure on tools-docker-builder-01 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0]
[04:32:03] <shinken-wm>	 PROBLEM - Puppet failure on tools-worker-1004 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0]
[04:32:11] <YuviPanda>	 storm coming up I suppose
[04:41:31] <shinken-wm>	 PROBLEM - Puppet failure on tools-mail-01 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0]
[04:41:58] <Matthew_>	 YuviPanda: Around?
[04:42:26] <YuviPanda>	 yes but fixing some puppet/apt labs-wide issues.
[04:42:40] <Matthew_>	 Okay, I”ll wait.  Good luck!
[04:43:14] <YuviPanda>	 thanks
[04:43:21] <YuviPanda>	 Matthew_: filing a bug would probably be better mostly :)
[04:43:49] <Matthew_>	 Heh, my question was whether I should file a bug, actually.  I will :)
[04:47:45] <wikibugs>	 6Labs: Create project for OTRS one-click spam disposal - https://phabricator.wikimedia.org/T122391#1903071 (10Matthewrbowker) 3NEW
[04:47:58] <Matthew_>	 YuviPanda: ^
[04:48:48] <YuviPanda>	 ok :)
[04:48:51] <YuviPanda>	 I'll take a look afte
[04:52:58] <Matthew_>	 Good luck! My thing is low priorty, JSUK.
[05:07:03] <shinken-wm>	 RECOVERY - Puppet failure on tools-worker-1004 is OK: OK: Less than 1.00% above the threshold [0.0]
[05:21:30] <shinken-wm>	 RECOVERY - Puppet failure on tools-mail-01 is OK: OK: Less than 1.00% above the threshold [0.0]
[06:39:09] <wikibugs>	 6Labs: Create project for OTRS one-click spam disposal - https://phabricator.wikimedia.org/T122391#1903109 (10yuvipanda) There's already an OTRS project, with @Krenair, @bd808 and @jgreen as project admins. Perhaps one of them can add you to it and use an instance there for testing?
[06:41:32] <wikibugs>	 6Labs: Create project for OTRS one-click spam disposal - https://phabricator.wikimedia.org/T122391#1903112 (10Matthewrbowker) @yuvipanda Fair, I will wait for a response there.
[06:41:51] <Matthew_>	 Sorry, like you need more pings :/
[06:43:53] <YuviPanda>	 :D
[06:43:55] <YuviPanda>	 np, Matthew_
[06:44:04] <Matthew_>	 :)
[11:05:50] <addshore>	 *bumps https://phabricator.wikimedia.org/T121095 again* ;)
[11:11:39] <wikibugs>	 6Labs, 10Attribution-Generator, 6TCB-Team, 6WMF-Legal, 5Attribution-Generator-Release-2.0: [AG] [Task] Assign 1 IP address to lizenzhinweisgenerator labs project - https://phabricator.wikimedia.org/T121095#1903201 (10yuvipanda) 5Open>3Resolved Done. Remember to keep whois updated and be good citizens...
[11:11:47] <YuviPanda>	 addshore: bump succesful
[11:11:53] <addshore>	 :D
[11:12:02] <addshore>	 also, WHY are you still awake you silly panda! :P
[11:12:25] <YuviPanda>	 inorite
[11:13:42] <addshore>	 3am :/
[11:14:00] <addshore>	 happy hollidays! :D and see you in a week and a half?
[11:14:43] <YuviPanda>	 addshore: \o/
[11:14:47] <YuviPanda>	 addshore: also what does lizenzhinweisgenerator mean?
[11:15:02] <addshore>	 basically attributation generator
[11:15:08] <YuviPanda>	 ah :)
[11:15:10] <YuviPanda>	 ok
[11:15:12] <addshore>	 :D
[11:15:20] <YuviPanda>	 addshore: why is it its own domain rather than .wmflabs.org?
[11:15:43] <addshore>	 because :P (I dont know) ;D
[11:16:09] <addshore>	 I just help make people's wishes come true! I'm basically a fairy..? O_o
[11:16:19] <YuviPanda>	 hehe
[11:16:25] * YuviPanda grants addshore's wishes and goes to sleep
[11:16:37] <addshore>	 :D sleep well!
[13:14:34] <grrrit-wm>	 (03PS25) 10Ricordisamoa: Initial commit [labs/tools/wikidata-slicer] - 10https://gerrit.wikimedia.org/r/241296 
[13:16:06] <grrrit-wm>	 (03CR) 10Ricordisamoa: "PS25 simplifies API requests" [labs/tools/wikidata-slicer] - 10https://gerrit.wikimedia.org/r/241296 (owner: 10Ricordisamoa)
[13:18:29] <wikibugs>	 6Labs, 7Tracking: New Labs project requests (tracking) - https://phabricator.wikimedia.org/T76375#1903304 (10Krenair)
[13:18:30] <wikibugs>	 6Labs: Create project for OTRS one-click spam disposal - https://phabricator.wikimedia.org/T122391#1903301 (10Krenair) 5Open>3Invalid a:3Krenair Added you to that instead. Marking this as invalid.
[14:19:44] <wikibugs>	 6Labs, 10Tool-Labs, 10DBA: Rename user database - https://phabricator.wikimedia.org/T122338#1903379 (10jcrespo) a:3jcrespo
[14:20:00] <wikibugs>	 6Labs, 10Tool-Labs, 10DBA: Rename user database - https://phabricator.wikimedia.org/T122338#1901847 (10jcrespo) p:5Triage>3Normal
[14:35:26] <wikibugs>	 6Labs, 10Tool-Labs, 10DBA: Rename user database - https://phabricator.wikimedia.org/T122338#1903389 (10jcrespo) 5Open>3Resolved Thank you for creating the ticket. This way I was able to confirm that your account matched the mysql account, plus it helps not forgetting the task by reminding me by email.  D...
[14:42:30] <wikibugs>	 6Labs, 10Tool-Labs: tool labs: provide custom domain proxy? - https://phabricator.wikimedia.org/T122403#1903414 (10valhallasw) 3NEW
[15:03:36] <wikibugs>	 6Labs, 10netops, 6operations: Consider renumbering Labs to separate address spaces - https://phabricator.wikimedia.org/T122406#1903452 (10faidon) 3NEW
[17:49:31] <wikibugs>	 6Labs, 10Tool-Labs, 10DBA, 6Stewards-and-global-tools: Throttling linkwatcher tool user as it is consuming 100% CPU - https://phabricator.wikimedia.org/T121094#1903553 (10jcrespo) There are still problems with thousands of queries executing:  ``` SELECT COUNT(*) as total_record FROM linkwatcher_linklog WHE...
[18:00:01] <wikibugs>	 6Labs, 10Tool-Labs, 10DBA, 6Stewards-and-global-tools: Throttling linkwatcher tool user as it is consuming 100% CPU - https://phabricator.wikimedia.org/T121094#1903562 (10Beetstra) Is that since this morning (UTC+3)?  I will return on Sunday 27.  > >
[18:19:28] <wikibugs>	 6Labs, 10Tool-Labs, 10DBA, 6Stewards-and-global-tools: Throttling linkwatcher tool user as it is consuming 100% CPU - https://phabricator.wikimedia.org/T121094#1903578 (10jcrespo) The load is mostly constant, but the peak was between 13-20h (UTC) on 2015-12-23. I count >50 000 of those in the last 128 hour...
[22:40:45] <wikibugs>	 6Labs, 10Tool-Labs: tool labs: provide custom domain proxy? - https://phabricator.wikimedia.org/T122403#1903785 (10valhallasw) * Certificate management. How do we make sure both proxies have access to the certificates? Do we need to (maybe we can run letsencrypt on both hosts)?  According to my reading of [[ht...
[23:42:19] <wikibugs>	 6Labs, 10Tool-Labs: tool labs: provide custom domain proxy? - https://phabricator.wikimedia.org/T122403#1903833 (10scfc) In general, I'd prefer if we discourage using such custom domains – IMHO they open a can of worms (trademarks, DNS management, certificate mangement, TOS, etc.) that is not worth … well, wha...