[04:37:42] 3Tool-Labs: add basic expectations management to docs - https://phabricator.wikimedia.org/T56701#952224 (10Aklapper) p:5Triage>3Volunteer? [05:53:51] PROBLEM - Puppet failure on tools-exec-15 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [06:23:52] RECOVERY - Puppet failure on tools-exec-15 is OK: OK: Less than 1.00% above the threshold [0.0] [06:39:57] PROBLEM - Puppet failure on tools-shadow is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [06:42:40] PROBLEM - Puppet failure on tools-submit is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [07:01:33] PROBLEM - Puppet failure on tools-exec-02 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [07:09:56] RECOVERY - Puppet failure on tools-shadow is OK: OK: Less than 1.00% above the threshold [0.0] [07:12:40] RECOVERY - Puppet failure on tools-submit is OK: OK: Less than 1.00% above the threshold [0.0] [07:26:34] RECOVERY - Puppet failure on tools-exec-02 is OK: OK: Less than 1.00% above the threshold [0.0] [09:00:17] PROBLEM - Free space - all mounts on tools-webproxy is CRITICAL: CRITICAL: tools.tools-webproxy.diskspace._var.byte_percentfree.value (<11.11%) [09:55:17] RECOVERY - Free space - all mounts on tools-webproxy is OK: OK: All targets OK [10:00:37] RECOVERY - Free space - all mounts on tools-webproxy is OK: OK: All targets OK [10:01:17] PROBLEM - Free space - all mounts on tools-webproxy is CRITICAL: CRITICAL: tools.tools-webproxy.diskspace._var.byte_percentfree.value (<55.56%) [10:17:29] 3Wikimedia-Labs-Infrastructure: Internal DNS look-ups fail every once in a while - https://phabricator.wikimedia.org/T72076#952348 (10fgiunchedi) [10:26:17] RECOVERY - Free space - all mounts on tools-webproxy is OK: OK: All targets OK [10:47:19] PROBLEM - Free space - all mounts on tools-webproxy is CRITICAL: CRITICAL: tools.tools-webproxy.diskspace._var.byte_percentfree.value (<11.11%) [11:41:31] 3Tool-Labs-tools-Quentinv57's-tools: Global Sysop Statistics are not working - https://phabricator.wikimedia.org/T72185#952390 (10abian) Today there is no error message, but only the following code between tags. ```

Global Sysop Stat... [11:58:17] quentinv57: https://phabricator.wikimedia.org/T72185#952390 - Tool-Labs-tools-Quentinv57's-tools: Global Sysop Statistics are not working [11:59:57] abian, hey [12:00:04] I cannot maintain these tools anymore [12:00:20] I'm waiting to find somebody to do it after me [12:00:32] unfortunately I didn't find it yet :/ [12:00:35] Hi, happy 2015 :) [12:01:00] Ok, I'll try to find someone [12:01:25] Thanks [12:48:10] quentinv57: I've found someone who maybe could maintain that tool... :) [12:48:59] However, I've read that there are more maintainers currently active, right? [12:49:29] abian: which tool? [12:50:00] Global Sysop Statistics at least [12:50:24] The Quentinv57's Tools in general [12:50:35] Is there a problem with it? [12:51:14] Yes, it doesn't work, directly [12:52:02] And quentinv57 said to me that he could no longer maintain those tools [12:52:33] https://phabricator.wikimedia.org/T72185#952390 [12:54:00] * jem is the "someone" [12:54:18] Indeed :) [12:54:45] quentinv57, are you back? [12:55:49] abian, yes I am here [12:55:55] who are you talking about ? [12:56:15] Cyberpower678 might be interested, but still asleep, unless the monsters from under the bed got him. [12:56:27] :) [12:56:43] ok for me [12:56:56] quentinv57: It's me :) [12:57:08] hi jem [12:57:12] Hi [12:57:31] jem could maintain the Global Sysop Stats, I think [12:57:53] I could try to help as long as there is no strong compromise of time in a long term [12:57:58] anyway I've given the user rights on Labs to stewards and the tools now belong to the group [12:58:18] but of course, if jem wants to maintain, it's ok for me [12:59:35] Good [12:59:52] At least I think I can try to help with major problems like this one [13:00:04] And keep an eye on Phabricator [13:01:07] Anyway, quentinv57, I don't know if Cyberpower678 is also working or thinking in working in this [13:12:47] what does the Global Sysops stats tool do? [13:12:49] * YuviPanda is just curious [13:19:08] YuviPanda: I guess it gives statistics for sysops in a global scope :) [13:20:00] What kinds of statistics? [13:20:29] Number of sysop-reserved actions done by project and user [13:25:52] Hi, Cyberpower678 [13:25:52] Good morning Cyberpower678 [13:26:24] I was talking with quentinv57 about helping him with his tools until he got disconnected [13:26:37] But I see you're also a maintainer [13:27:24] Does anyone know if there is a labs replacement of Dispenser's useractivity.py for maintaining WikiProject mailing lists? [13:49:27] Wow. I'm popular. :p [13:49:38] Good morning to you too. :-) [13:49:42] :) [13:51:25] It's not my decision. You'll have to talk to Quentinv57 [13:53:08] Ok [13:53:36] I'm not one to decide for him. I only maintain my tools. [13:53:39] his [13:54:03] I'm mainly worried about globalsysopstats not working at all [13:54:14] As I think there is no similar tool [13:55:50] He was saying "13:58:18< quentinv57> but of course, if jem wants to maintain, it's ok for me [13:55:57] and then ping timeout [13:57:53] jem, which channel? [13:58:23] Here [13:58:36] !botlogs [13:58:41] !logs [13:58:41] raw text: http://bots.wmflabs.org/~wm-bot/logs/%23wikimedia-labs/ cute html: http://tools.wmflabs.org/wm-bot/logs/index.php?display=%23wikimedia-labs [13:59:17] It all came from abian question, then he contacted me [14:00:59] I just reviewed the logs. I'll have you added in a second. [14:02:56] jem, what's your username? [14:03:18] jem :) [14:03:21] And thanks [14:03:34] (jem in Labs, -jem- in WMF) [14:03:41] You have no access to toollabs apparently. [14:03:49] Ehm? [14:03:56] You're not listed. [14:04:28] Well, I'm connected in this moment, I have a tool and access to three other tools, so... [14:04:37] T13|needsCoffee, speaking of needing new maintainers, how do you feel about become an xtools members? [14:05:01] found you [14:05:53] jem, You're in. [14:06:15] SSH out and back in to access quentinv57-tools [14:07:59] Sure Cyberpower678 [14:08:26] Done and working [14:08:31] Thanks again [14:09:14] T13|needsCoffee, I chose you to be a maintainer because you are a skilled PHP developer, respect consensus regarding optin, and will not override any decisions in place without discussion first. [14:09:53] All true. [14:11:02] What's your wikitech username?> [14:11:40] T13|needsCoffee, ^ [14:11:46] idr If it is technical13 or technical-13 [14:12:02] Both don't show up. [14:12:29] Do you have access to toollabs. [14:12:51] Yes, I'm a wm-bot maintainer last I knew. [14:13:53] We can figure it out tonight if need be. I'm on a daddy/daughter day date all day. :D [14:14:13] Cyberpower678 will figure it out. [14:15:12] T13|playingDad, unless your user name Petrb I can't find you in a list of maintainers there. [14:18:13] T13|mobile, get back to me with your username. You're not present in the list of maintainers of for wm-bot [14:37:46] Cyberpower678: https://wikitech.wikimedia.org/wiki/User:Technical_13 [14:39:10] T13|mobile, you do not have access to tool labs then. [14:39:24] Your name does not come up. [15:16:05] wm-bot is on bots, not on tools. [15:18:19] Cyberpower678: you get my link to https://wikitech.wikimedia.org/wiki/User:Technical_13 - my connection was sketchy in store. [15:24:47] Yes. You're not listed on tools, nor do you have access to wm-bot [15:39:07] PROBLEM - Puppet failure on tools-dev is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [16:01:19] 3Tool-Labs: qsub failed from jlocal crontab entry - https://phabricator.wikimedia.org/T73517#952607 (10Anomie) >>! In T73517#951873, @scfc wrote: > but if it has not reoccurred since October, I would consider it a one-time fluke. Err, I just said it recurred a few days ago. The cron job in question only runs on... [16:04:07] RECOVERY - Puppet failure on tools-dev is OK: OK: Less than 1.00% above the threshold [0.0] [16:30:54] PROBLEM - Puppet failure on tools-exec-11 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [17:00:55] RECOVERY - Puppet failure on tools-exec-11 is OK: OK: Less than 1.00% above the threshold [0.0] [17:11:54] 3Tool-Labs: qsub failed from jlocal crontab entry - https://phabricator.wikimedia.org/T73517#952674 (10scfc) You said that "can't resolve host name" happened a few days ago; I was referring to the "access denied" occurence. [17:27:58] Cyberpower678: you get my link to https://wikitech.wikimedia.org/wiki/User:Technical_13 - my connection was sketchy in store. [17:30:16] T13|mobile, yes I did. You don't have access to toollabs. [17:30:35] Coren: ^ [18:23:02] Hi folks, when using jsub/qstat I've gotten a lot of "unable to send message to qmaster using port 6444 on host "tools-master.eqiad.wmflabs": can't resolve host name" errors today. Is this a common issue? [18:24:03] Coren: ^ [18:24:15] bjelleklang: seems to be for the last few days. [18:24:25] oh, ok [18:24:40] I’m not too fond of just restarting the DNS servers myself, because I think you’ve to do something slightly more complicated to bring them back up... [18:24:47] Coren: ^ do you remember how to restart DNS? [21:38:14] PROBLEM - Puppet failure on tools-login is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [21:42:21] PROBLEM - Puppet failure on tools-webgrid-03 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [21:43:36] PROBLEM - Puppet failure on tools-exec-02 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [22:03:18] RECOVERY - Puppet failure on tools-login is OK: OK: Less than 1.00% above the threshold [0.0] [22:07:21] RECOVERY - Puppet failure on tools-webgrid-03 is OK: OK: Less than 1.00% above the threshold [0.0] [22:08:34] RECOVERY - Puppet failure on tools-exec-02 is OK: OK: Less than 1.00% above the threshold [0.0]