[00:28:22] <doctaxon>	 Hi! I have a problem running a job on tools.taxonbot   
[00:28:56] <doctaxon>	 I don't get output running the job in the grid, but I get output running it on bastion
[00:29:26] <doctaxon>	 I don't know why
[00:31:36] <doctaxon>	 Yuvipanda, are you there?
[00:34:31] <doctaxon>	 andrewbogott: anybody here?
[02:31:48] <wikibugs>	 06Labs, 10wikitech.wikimedia.org, 07Wikimedia-log-errors: PHP array to string conversion on wikitech in SMW 1.8.x - https://phabricator.wikimedia.org/T124235#2510861 (10Dereckson) According @mwjames, fix could be 60002797.
[02:36:33] <OH->	 YuviPanda, one of your gists got onto reddit?
[02:55:52] <Krenair>	 found it: https://www.reddit.com/r/programming/comments/4v99gk/a_highly_efficient_sorting_algorithm_that/
[05:10:48] <wm-bot>	 Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Freddy2001 was modified, changed by Tim Landscheidt link https://wikitech.wikimedia.org/w/index.php?diff=809937 edit summary: 
[05:21:05] <shinken-wm>	 PROBLEM - Puppet staleness on tools-worker-1008 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0]
[05:27:01] <shinken-wm>	 PROBLEM - Puppet staleness on tools-worker-1010 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0]
[05:29:33] <shinken-wm>	 PROBLEM - Puppet staleness on tools-worker-1005 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0]
[05:30:25] <shinken-wm>	 PROBLEM - Puppet staleness on tools-worker-1019 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0]
[05:30:57] <shinken-wm>	 PROBLEM - Puppet staleness on tools-worker-1004 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0]
[05:31:05] <shinken-wm>	 PROBLEM - Puppet staleness on tools-worker-1015 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0]
[05:31:36] <shinken-wm>	 PROBLEM - Puppet staleness on tools-worker-1014 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0]
[05:37:40] <shinken-wm>	 PROBLEM - Puppet staleness on tools-worker-1007 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0]
[05:40:28] <shinken-wm>	 PROBLEM - Puppet staleness on tools-worker-1013 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0]
[05:43:03] <shinken-wm>	 PROBLEM - Puppet staleness on tools-worker-1002 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0]
[05:44:33] <shinken-wm>	 PROBLEM - Puppet staleness on tools-worker-1017 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0]
[05:45:35] <shinken-wm>	 PROBLEM - Puppet staleness on tools-worker-1016 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0]
[05:45:47] <shinken-wm>	 PROBLEM - Puppet staleness on tools-worker-1011 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0]
[05:45:51] <shinken-wm>	 PROBLEM - Puppet staleness on tools-worker-1018 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0]
[05:47:03] <shinken-wm>	 PROBLEM - Puppet staleness on tools-worker-1012 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0]
[05:47:51] <shinken-wm>	 PROBLEM - Puppet staleness on tools-worker-1009 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0]
[05:51:12] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:25] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:26] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:28] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:29] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:30] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:31] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:32] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:33] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:34] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:35] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:37] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:38] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:39] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:40] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:41] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:42] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:44] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:45] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:46] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:47] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:48] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:49] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:50] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:51] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:53] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:54] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:55] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:56] <shinken-wm>	 PROBLEM - Puppet staleness on tools-docker-builder-01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0]
[05:51:56] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:58] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:51:59] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:00] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:01] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:02] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:03] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:05] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:06] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:07] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:08] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:09] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:10] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:13] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:14] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:15] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:18] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:19] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:20] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:21] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:22] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:24] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:25] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:26] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:27] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:28] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:30] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:31] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:52:32] <LALELILOLU122>	 MIERDA.. FUCK IT IS WIKIPEDIA.. PUDRANSE TODOS LOS DE #WIKIPEDIA-ES HIJOS DE PERRA
[05:57:52] <Earwig>	 can someone with ops here please +t the topic because this keeps happening
[06:03:03] <shinken-wm>	 PROBLEM - SSH on tools-merlbot-proxy is CRITICAL: Server answer
[06:54:32] <comets>	 yikes
[06:54:49] <comets>	 i blame CIA 
[07:19:16] <AlexZ>	 Earwig: done
[07:19:23] <Earwig>	 ta
[07:48:01] <shinken-wm>	 RECOVERY - SSH on tools-merlbot-proxy is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u3 (protocol 2.0)
[07:53:01] <Lokal_Profil>	 !log tools.heritage Deployed latest from Git, 5fe42fe (5fe42fe), 1ec3530, 9a630b5 (T139258)
[07:53:02] <stashbot>	 T139258: Figure out improved matching of monuments for Iran - https://phabricator.wikimedia.org/T139258
[07:53:05] <labs-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.heritage/SAL, Master
[07:54:01] <shinken-wm>	 PROBLEM - SSH on tools-merlbot-proxy is CRITICAL: Server answer
[07:54:26] <Lokal_Profil>	 !log tools.heritage (correction to last line) Deployed latest from Git, 5fe42fe (T111618), 1ec3530, 9a630b5 (T139258)
[07:54:28] <stashbot>	 T139258: Figure out improved matching of monuments for Iran - https://phabricator.wikimedia.org/T139258
[07:54:28] <stashbot>	 T111618: Make use of the project field in categorisation jobs - https://phabricator.wikimedia.org/T111618
[07:54:29] <labs-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.heritage/SAL, Master
[08:22:29] <grrrit-wm>	 (03PS1) 10Lokal Profil: Alow username to be set on deploy [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/302221 
[08:42:45] <grrrit-wm>	 (03CR) 10Jean-Frédéric: [C: 031] "Not sure why this is needed, but sure thing :)" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/302221 (owner: 10Lokal Profil)
[10:09:04] <shinken-wm>	 RECOVERY - SSH on tools-merlbot-proxy is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u3 (protocol 2.0)
[10:12:52] <shinken-wm>	 PROBLEM - Puppet run on tools-services-01 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0]
[10:15:02] <shinken-wm>	 PROBLEM - SSH on tools-merlbot-proxy is CRITICAL: Server answer
[10:31:55] <grrrit-wm>	 (03PS1) 10Lokal Profil: Ensure that field destinations have ascii names in monuments_config [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/302233 (https://phabricator.wikimedia.org/T141757) 
[10:36:15] <grrrit-wm>	 (03CR) 10Lokal Profil: "My system isn't set up so that it defaults to the right username (hence the need for username@)." [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/302221 (owner: 10Lokal Profil)
[10:36:25] <grrrit-wm>	 (03PS2) 10Lokal Profil: Alow username to be set on deploy [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/302221 
[10:38:02] <grrrit-wm>	 (03CR) 10Lokal Profil: "Good catch on the executability" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/302221 (owner: 10Lokal Profil)
[10:39:16] <tom29739>	 @kick TheBlahOfBlah 
[10:41:19] <wm-bot>	 Operator tools are now not in permanent mode on this channel
[10:41:19] <tom29739>	 @optools-permanent-off
[10:41:41] <tom29739>	 @kick TheBlahOfBlah 
[10:42:00] <tom29739>	 ^ TheBlahOfBlah is me
[10:43:59] <wm-bot>	 Permission denied
[10:43:59] <paladox>	 @add #wikimedia-offtopic
[10:44:06] <wm-bot>	 Permission denied
[10:44:06] <paladox>	 @add #wikimedia-operations
[10:52:54] <shinken-wm>	 RECOVERY - Puppet run on tools-services-01 is OK: OK: Less than 1.00% above the threshold [0.0]
[10:52:57] <grrrit-wm>	 (03CR) 10Jean-Frédéric: [C: 032] Alow username to be set on deploy [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/302221 (owner: 10Lokal Profil)
[10:54:12] <grrrit-wm>	 (03CR) 10Jean-Frédéric: [C: 032] Ensure that field destinations have ascii names in monuments_config [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/302233 (https://phabricator.wikimedia.org/T141757) (owner: 10Lokal Profil)
[10:54:39] <grrrit-wm>	 (03Merged) 10jenkins-bot: Alow username to be set on deploy [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/302221 (owner: 10Lokal Profil)
[10:55:52] <grrrit-wm>	 (03Merged) 10jenkins-bot: Ensure that field destinations have ascii names in monuments_config [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/302233 (https://phabricator.wikimedia.org/T141757) (owner: 10Lokal Profil)
[10:56:42] <JeanFred>	 !log tools.heritage Deployed latest from Git: 6763dbb and dadf805 (T141757)
[10:56:44] <stashbot>	 T141757: Onknown field column for fr_(fr) - https://phabricator.wikimedia.org/T141757
[10:56:46] <labs-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.heritage/SAL, Master
[13:44:06] <wikibugs>	 06Labs, 07Tracking: New Labs project requests (tracking) - https://phabricator.wikimedia.org/T76375#2511525 (10chasemp)
[14:15:07] <wm-bot>	 Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Jarallah II was modified, changed by Jarallah II link https://wikitech.wikimedia.org/w/index.php?diff=811354 edit summary: renew Request
[14:19:56] <wikibugs>	 06Labs, 10Labs-Infrastructure, 10DBA: Users can't run EXPLAIN queries to check the theoretical efficiency of their SQL - https://phabricator.wikimedia.org/T141095#2511565 (10chasemp) The idea w/ associating with T140788 is we want to approach this issue as part of the rearchitecting.  Removing this as a subt...
[14:20:00] <Guest74150>	 hi
[14:20:06] <Guest74150>	 how can i fix this problem, i can't login my account
[14:20:15] <Guest74150>	 Using keyboard-interactive authentication
[14:20:25] <wikibugs>	 06Labs, 10Labs-Infrastructure, 10DBA, 07Epic, 07Tracking: Labs databases rearchitecture (tracking) - https://phabricator.wikimedia.org/T140788#2475959 (10chasemp)
[14:20:28] <wikibugs>	 06Labs, 10Labs-Infrastructure, 10DBA: Users can't run EXPLAIN queries to check the theoretical efficiency of their SQL - https://phabricator.wikimedia.org/T141095#2511578 (10chasemp)
[14:21:38] <wikibugs>	 06Labs, 10Labs-Infrastructure, 10DBA, 07Epic, 07Tracking: Labs databases rearchitecture (tracking) - https://phabricator.wikimedia.org/T140788#2475959 (10chasemp)
[14:21:41] <wikibugs>	 06Labs, 10Labs-Infrastructure, 10DBA: Users can't run EXPLAIN queries to check the theoretical efficiency of their SQL - https://phabricator.wikimedia.org/T141095#2486960 (10chasemp) 05duplicate>03Open
[14:27:08] <wikibugs>	 06Labs, 10Labs-Infrastructure, 10DBA: Explore 'Analyze' statement as substitute for Explain - https://phabricator.wikimedia.org/T141095#2511585 (10chasemp)
[14:28:25] <wm-bot>	 Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Jarallah II was modified, changed by Jarallah II link https://wikitech.wikimedia.org/w/index.php?diff=811395 edit summary: 
[14:55:41] <valhallasw`vecto>	 Guest74150: that typically means that either your private key is not loaded correctly, or the username is incorrect
[14:55:53] <valhallasw`vecto>	 the username is case-sensitive
[15:26:41] <wikibugs>	 06Labs: Interactive consoles? - https://phabricator.wikimedia.org/T130806#2511774 (10Andrew) Proposed:  add a root password (managed like a prod password) but also modify policy files so that the Console tab is only visible for people with the admin keystone right.
[15:55:38] <Luke081515>	 o.O
[16:29:05] <Guest72753>	 !ping
[16:29:05] <wm-bot>	 !pong
[16:29:05] <Guest72753>	 !ping
[16:29:05] <wm-bot>	 !pong
[16:34:52] <Luke081515>	 yuvipanda: what happend at 15:55 (UTC)?
[16:42:40] <valhallasw`cloud>	 Luke081515: I assume matrix.org was accidentally k-lined
[16:43:30] <wikibugs>	 06Labs: Request creation of readmore labs project - https://phabricator.wikimedia.org/T139863#2512111 (10chasemp) 05Open>03declined We talked about this in our weekly and AFAIU this is resolved via running in Tools on k8s.  We will have to sort out the quota and resource allocations per tool issues this prom...
[16:43:41] <Luke081515>	 hm
[17:03:27] <wm-bot>	 Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Jarallah II was modified, changed by Tim Landscheidt link https://wikitech.wikimedia.org/w/index.php?diff=811832 edit summary: 
[17:14:02] <doctaxon>	 andrewbogott: will the labs upgrade window tomorrow affect running scripts in the grid by tools.taxonbot ?
[17:14:25] <andrewbogott>	 doctaxon: there will be short network interruptions but I don't think tools will much notice
[17:14:29] <andrewbogott>	 unless they are /very/ touchy
[17:15:45] <doctaxon>	 andrewbogott: what means "/very/ touchy" 
[17:16:10] <andrewbogott>	 doctaxon: like if they have short network timeouts and crash if the network timeout is reached
[17:16:25] <doctaxon>	 ah okay
[17:42:38] <wikibugs>	 06Labs, 06Operations: labnet100[12].eqiad.wmnet need to be reimaged with RAID - https://phabricator.wikimedia.org/T136718#2512444 (10chasemp) we said next week post-Liberty upgrade we will schedule a time for failover and reimage of labnet1002.
[17:56:57] <wikibugs>	 06Labs, 10Phlogiston: Phlogiston-1 server is unstable and no longer able to run Phlogiston reports - https://phabricator.wikimedia.org/T141796#2512472 (10JAufrecht)
[18:52:01] <wikibugs>	 06Labs, 10Labs-Infrastructure, 10Continuous-Integration-Infrastructure: Nodepool has trouble taking snapshots on OpenStack labs - https://phabricator.wikimedia.org/T138106#2512795 (10hashar) Le 27/07/2016 à 17:25, Andrew a écrit : > Andrew added a comment. >  >  > Is this still failing, or are things resolve...
[18:53:12] <wikibugs>	 06Labs, 10Labs-Infrastructure, 10Continuous-Integration-Infrastructure: Nodepool has trouble taking snapshots on OpenStack labs - https://phabricator.wikimedia.org/T138106#2512797 (10hashar) 05Open>03Resolved
[19:18:08] <wikibugs>	 06Labs, 07Tracking: New Labs project requests (tracking) - https://phabricator.wikimedia.org/T76375#2512851 (10tom29739)
[19:54:43] <GitHub195>	 [13flask-mwoauth] 15valhallasw pushed 1 new commit to 06master: 02https://git.io/v6fdz
[19:54:43] <GitHub195>	 13flask-mwoauth/06master 1475aa936 15Merlijn van Deen: #15: Use POST form data instead of GET parameters
[19:57:56] <Matthew_>	 !log tools.xtools Restarted webservices for xtools, xtools-ec, xtools-articleinfo due to 502 and 503 errors
[19:57:59] <labs-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.xtools/SAL, Master
[19:58:54] <GitHub116>	 [13flask-mwoauth] 15valhallasw pushed 1 new commit to 06master: 02https://git.io/v6fFY
[19:58:54] <GitHub116>	 13flask-mwoauth/06master 14136e714 15Merlijn van Deen: Bump version to 0.2.51
[20:23:30] <GitHub147>	 [13flask-mwoauth] 15valhallasw pushed 1 new commit to 06master: 02https://git.io/v6fAS
[20:23:31] <GitHub147>	 13flask-mwoauth/06master 147db829d 15Merlijn van Deen: #10: Add projects as examples...
[20:24:52] <GitHub91>	 [13flask-mwoauth] 15valhallasw pushed 1 new commit to 06master: 02https://git.io/v6fAA
[20:24:52] <GitHub91>	 13flask-mwoauth/06master 148159f94 15Merlijn van Deen: Reformat README.md
[20:26:49] <bd808>	 valhallasw`cloud: can you config the github irc hook to use a consistent nick? "github" is a nice one to pick
[20:26:59] <valhallasw`cloud>	 I'm not sure...
[20:27:48] <Luke081515>	 bd808: github is registered and protected
[20:27:55] <Luke081515>	 so you can use it, but only for 30 seconds
[20:28:15] <bd808>	 Luke081515: which is all the join, post, part thing needs
[20:28:26] <github>	 [13flask-mwoauth] 15valhallasw pushed 1 new commit to 06master: 02https://git.io/v6fAA
[20:28:26] <github>	 13flask-mwoauth/06master 148159f94 15Merlijn van Deen: Reformat README.md
[20:28:27] <bd808>	 I have several repos setup to use that nick
[20:28:33] <valhallasw`cloud>	 seems to work
[20:28:38] <bd808>	 :) thanks
[20:28:45] <valhallasw`cloud>	 not sure why it doesn't just do that by default
[20:29:57] <bd808>	 I have an ulterior motive. My irc client is setup to render that nick in muted colors :)
[20:31:03] <valhallasw`cloud>	 a filter on 'github*' instead of on 'github' would probably help on that side
[20:31:28] <bd808>	 yeah. I need to update my scripts to do that sort of matching
[20:32:28] * bd808 adds that to things to do someday list
[20:58:18] <Krenair>	 !log deployment-prep deleted 2014/2015 files from deployment-stream:/var/log/diamond to get space on /var and stop it warning
[20:58:18] <stashbot>	 Please !log in #wikimedia-releng for beta cluster SAL
[20:58:22] <labs-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL, Master
[21:00:43] <paladox>	 Krenair ^^
[21:01:16] <Krenair>	 hi paladox 
[21:01:23] <paladox>	 Hi
[21:21:32] <grrrit-wm>	 (03PS1) 10Merlijn van Deen: Testing. [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/302348 
[21:25:41] <madhuvishy>	 !logs testlabs Added Madhuvishy as project member and admin
[21:25:42] <wm-bot>	 raw text: http://bots.wmflabs.org/~wm-bot/logs/%23wikimedia-labs/ cute html: http://tools.wmflabs.org/wm-bot/logs/index.php?display=%23wikimedia-labs
[21:48:23] <yuvipanda>	 madhuvishy !log not !logs
[21:48:38] <madhuvishy>	 I swear i typed log :/
[21:48:57] <madhuvishy>	 !log testlabs Added Madhuvishy as project member and admin
[21:49:00] <labs-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Testlabs/SAL, Master
[22:36:02] <paladox>	 qchris_ Hi could you quickly review https://gerrit.wikimedia.org/r/#/c/299164/ please
[22:36:06] <paladox>	 ?
[22:37:39] <qchris_>	 paladox: It's hard to "quickly review" debs :-)
[22:37:56] <qchris_>	 ost-riches asked me about the mysql-connector remove.
[22:38:08] <qchris_>	 I have not tried that, but it's worth trying.
[22:38:17] <paladox>	 Oh
[22:38:20] <qchris_>	 IIRC, he said hel'll try.
[22:38:23] <paladox>	 Ok
[22:48:13] <yuvipanda>	 madhuvishy https://phabricator.wikimedia.org/T141126
[22:48:34] <madhuvishy>	 !log tools Depooling tools-worker-1009 to prepare for T141126
[22:48:35] <stashbot>	 T141126: Investigate moving docker to use direct-lvm devicemapper storage driver - https://phabricator.wikimedia.org/T141126
[22:48:40] <labs-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL, Master
[22:53:11] <shinken-wm>	 PROBLEM - Host tools-worker-1009 is DOWN: CRITICAL - Host Unreachable (10.68.22.79)
[23:04:57] <shinken-wm>	 RECOVERY - Host tools-worker-1009 is UP: PING OK - Packet loss = 0%, RTA = 1.02 ms
[23:06:00] <madhuvishy>	 !log Repooled tools-worker-1009 (T114126)
[23:06:00] <stashbot>	 T114126: CX tool congratulates multiple times on the first translation - https://phabricator.wikimedia.org/T114126
[23:06:00] <labs-morebots>	 Repooled is not a valid project.
[23:06:21] <madhuvishy>	 !log Added tools-worker-1022 as new k8s worker node
[23:06:21] <labs-morebots>	 Added is not a valid project.
[23:06:30] <madhuvishy>	 !log tools Repooled tools-worker-1009 (T114126)
[23:06:31] <stashbot>	 T114126: CX tool congratulates multiple times on the first translation - https://phabricator.wikimedia.org/T114126
[23:06:34] <labs-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL, Master
[23:06:36] <madhuvishy>	 !log tools Added tools-worker-1022 as new k8s worker node
[23:06:37] <shinken-wm>	 PROBLEM - Puppet run on tools-worker-1009 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0]
[23:06:39] <labs-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL, Master
[23:07:51] <shinken-wm>	 RECOVERY - Puppet staleness on tools-worker-1009 is OK: OK: Less than 1.00% above the threshold [3600.0]
[23:16:36] <shinken-wm>	 RECOVERY - Puppet run on tools-worker-1009 is OK: OK: Less than 1.00% above the threshold [0.0]
[23:17:47] <madhuvishy>	 !log tools Yuvi depooled tools-worker-1019 for T114126
[23:17:48] <stashbot>	 T114126: CX tool congratulates multiple times on the first translation - https://phabricator.wikimedia.org/T114126
[23:17:52] <labs-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL, Master
[23:19:13] <madhuvishy>	 !log tools Depooling tools-worker 1010 and 1011 for T114126
[23:19:14] <stashbot>	 T114126: CX tool congratulates multiple times on the first translation - https://phabricator.wikimedia.org/T114126
[23:19:17] <labs-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL, Master
[23:20:00] <shinken-wm>	 PROBLEM - Host tools-worker-1019 is DOWN: CRITICAL - Host Unreachable (10.68.16.51)
[23:20:24] <shinken-wm>	 PROBLEM - Host tools-worker-1010 is DOWN: CRITICAL - Host Unreachable (10.68.19.138)
[23:20:54] <shinken-wm>	 PROBLEM - Host tools-worker-1011 is DOWN: CRITICAL - Host Unreachable (10.68.18.116)
[23:21:42] <madhuvishy>	 !log tools Yuvi is depooling tools-worker-1018 for T114126
[23:21:43] <stashbot>	 T114126: CX tool congratulates multiple times on the first translation - https://phabricator.wikimedia.org/T114126
[23:21:46] <labs-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL, Master
[23:24:00] <shinken-wm>	 PROBLEM - Host tools-worker-1018 is DOWN: CRITICAL - Host Unreachable (10.68.23.8)
[23:35:03] <shinken-wm>	 RECOVERY - Host tools-worker-1019 is UP: PING OK - Packet loss = 0%, RTA = 0.99 ms
[23:35:15] <shinken-wm>	 RECOVERY - Host tools-worker-1010 is UP: PING OK - Packet loss = 0%, RTA = 0.84 ms
[23:38:11] <shinken-wm>	 PROBLEM - SSH on tools-docker-builder-03 is CRITICAL: Server answer
[23:40:25] <shinken-wm>	 RECOVERY - Puppet staleness on tools-worker-1019 is OK: OK: Less than 1.00% above the threshold [3600.0]
[23:41:34] <madhuvishy>	 !log tools Repooled tools-worker-1010 and tools-worker-1019 (Yuvi) for T114126
[23:41:35] <stashbot>	 T114126: CX tool congratulates multiple times on the first translation - https://phabricator.wikimedia.org/T114126
[23:41:38] <labs-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL, Master
[23:42:00] <shinken-wm>	 RECOVERY - Puppet staleness on tools-worker-1010 is OK: OK: Less than 1.00% above the threshold [3600.0]
[23:48:45] <madhuvishy>	 !log tools Repooled tools-worker-1011 and tools-worker-1018 (Yuvi) for T114126
[23:48:46] <stashbot>	 T114126: CX tool congratulates multiple times on the first translation - https://phabricator.wikimedia.org/T114126
[23:48:49] <labs-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL, Master
[23:51:02] <legoktm>	 madhuvishy: wrong bug?
[23:52:54] <madhuvishy>	 legoktm: gah I didn't notice :/ it is 1126 not 126
[23:54:01] <madhuvishy>	 I logged it right once fwiw