[01:27:48] (03CR) 10Legoktm: "recheck" [labs/tools/extdist] - 10https://gerrit.wikimedia.org/r/168819 (owner: 10Legoktm) [02:30:08] 3Tool Labs tools / 3[other]: grrrit-wm: runs into infinite loop if unable to join channels - 10https://bugzilla.wikimedia.org/72523#c4 (10MZMcBride) Thanks, Merlijn! [03:48:49] (03PS1) 10Legoktm: Bug 72523: Remove #wikimedia-growth [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/168927 [03:49:21] (03CR) 10Legoktm: [C: 032] Bug 72523: Remove #wikimedia-growth [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/168927 (owner: 10Legoktm) [03:49:24] (03Merged) 10jenkins-bot: Bug 72523: Remove #wikimedia-growth [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/168927 (owner: 10Legoktm) [03:49:49] sigh. [03:54:51] ? [03:55:36] !log tools.lolrrit-wm restarting grrrit-wm for https://gerrit.wikimedia.org/r/168927 [03:55:38] Logged the message, Master [03:56:10] ehhh, crap. [03:56:16] I forgot we still can't kill the thing. [04:09:09] 3Tool Labs tools / 3[other]: grrrit-wm: runs into infinite loop if unable to join channels - 10https://bugzilla.wikimedia.org/72523#c7 (10Kunal Mehta (Legoktm)) 5PATC>3NEW Leaving this open as the actual bot still needs fixing... [08:49:45] Hello all! [08:52:33] I need an admin to help me a little. [08:53:51] I made a mistake last night I was tired... [08:55:30] In my project folder, /data/project/ato I have done a command "chmod -R -g+rw ./scripts" instead of "chmod -R g+rw ./scripts" [08:56:20] It would be great to get back a write access... [09:05:11] . [09:28:49] http://tools.wmflabs.org/ times out [09:40:40] 3Tool Labs tools / 3[other]: tool labs home page times out - 10https://bugzilla.wikimedia.org/72551 (10matanya) 3NEW p:3Unprio s:3normal a:3None go visit https://tools.wmflabs.org :) [11:29:29] xtools failing for anyone else? [11:34:38] 3Tool Labs tools / 3[other]: Map Warper - No space left on device - 10https://bugzilla.wikimedia.org/71604 (10Andre Klapper) [11:35:09] 3Wikimedia Labs / 3tools: tool labs home page times out - 10https://bugzilla.wikimedia.org/72551 (10Andre Klapper) a:3Marc A. Pelletier [11:37:07] 3Tool Labs tools / 3[other]: Map Warper - No space left on device - 10https://bugzilla.wikimedia.org/71604#c7 (10Tim Waters) it's due to the size of the /tmp partition, not the whole instance. The whole instance has enough disk space, it's where /tmp resides which is filling up, but _temporarily_ _tempora... [12:45:52] YuviPanda: Something going wrong with redis it looks like; it looks like there's a key for admin that refuses to be overwritten. [12:46:03] (the admin webservice) [13:01:22] YuviPanda: We have redundant data (thankfully) to that within redis (/data/project/.system/dynamic). What would you say to a tool that resyncs redis with that data? [13:06:08] YuviPanda: Also, we probably want to have some sort of alert if proxylistener stops listening; though it's not immediately clear to me how to distinguish "no longer adds new keys" from "nobody's asking it to" [13:20:37] 3Wikimedia Labs / 3tools: Dumps not updating again. - 10https://bugzilla.wikimedia.org/72154#c1 (10Andre Klapper) Coren: Is this being tackled? (Was also wondering whether this should be under the "Datasets" product instead but I guess it's unrelated to dumps.wm.org?) [15:08:48] is there a known thing w/ instance creation going on or a weirdness for me only? [15:10:18] chasemp: what are you seeing? [15:11:04] #chasetest -> medium instance -> submit -> Failed to create instance. [15:12:12] you're over quota. You can see your quotas via a link on the 'manage projects' page [15:12:34] which, damn, over quota with three instances? they must be big! [15:13:03] the phabricator previews [15:13:09] it's all official like [15:13:45] there is one I can nuke so I'll do that [15:14:30] ok -- I can raise your quota if need be, but labs is getting pretty full at the moment :( [15:14:45] I'll try to shuffle around now that I know [15:15:08] I wonder if that could say "over quota" instead of opaque fail [15:15:17] then I wouldn't have bugged you :) [17:58:37] chasemp: I'm not even sure that information is even exposed to the extension at all. [18:28:55] andrewbogott: ping? [18:29:12] YuviPanda: I'm here but in a meeting [18:29:33] andrewbogott: ah, yeah, ok. just a fyi - that OSM patch got merged, and is live on wikitech-test too [18:29:56] YuviPanda: I saw… the yaml page doesn't actually do anything yet though, right? [18:30:24] andrewbogott: nope, that's https://gerrit.wikimedia.org/r/#/c/168984/ and being worked on [18:30:41] andrewbogott: I guess we can get it SWATted tomorrow? [18:31:14] sure [18:31:25] want to put it on the schedule? [18:32:09] andrewbogott: yeah, doing now... [18:32:33] andrewbogott: hmm, actually, I'm technically off for rest of the week. I'll probably still be working a bit, but not so much... [18:32:49] andrewbogott: do you think you can shpherd that patch through swat? [18:33:07] YuviPanda: your choice -- you can volunteer me to shepherd or you can just postpone until you're back working [18:33:23] * YuviPanda volunteers andrewbogott to shepherd [18:33:37] of course I'm ill-qualified to judge if it works or not :) [18:34:41] andrewbogott: heh :) well, if you can't edit or create Hiera: for a project for which you aren't projectadmin, then it works [20:02:25] 3Wikimedia Labs / 3tools: Tool Labs: jsub should prevent starting duplicate jobs for -once tasks - 10https://bugzilla.wikimedia.org/60862#c7 (10Krinkle) Still happening. ecmabot-wm had two instances running on IRC (and while only 2 were visible on Freenode IRC, it turns out many more were running on the serv... [20:05:55] 3Wikimedia Labs / 3tools: Tool Labs: jsub should prevent starting duplicate jobs for -once tasks - 10https://bugzilla.wikimedia.org/60862#c8 (10Krinkle) (In reply to Tim Landscheidt from comment #6) > (In reply to Krinkle from comment #5) > > [...] > > > Is there some change we're expected to make in how we... [20:23:08] !log deployment-prep updated OCG to version 60b15d9985f881aadaa5fdf7c945298c3d7ebeac [20:23:12] Logged the message, Master [21:43:53] 3Wikimedia Labs / 3tools: tool labs home page times out - 10https://bugzilla.wikimedia.org/72551#c1 (10matanya) 5NEW>3RESO/FIX seems fixed now [23:33:23] 3Wikimedia Labs / 3tools: wikidata-todo webservice not working - 10https://bugzilla.wikimedia.org/72532#c3 (10Magnus Manske) s:5blocke>3normal Update 2: magnus-toolserver now works again, after many webservice restarts. I'll reduce priority, but I'd still like to know what this was. Black hole server gra...