[00:27:49] gwi [02:36:27] @seen Cyberpower678 [02:36:27] T13|mobile: Last time I saw Cyberpower678 they were quitting the network with reason: Ping timeout: 246 seconds N/A at 2/20/2015 10:27:57 PM (4h8m30s ago) [02:36:53] !ping [02:36:53] !pong [02:37:23] Hello? Is it me or is bot not responding? [03:52:48] 10Tool-Labs: Provide source/repository link on https://tools.wmflabs.org - https://phabricator.wikimedia.org/T86431#1056158 (10scfc) p:5Triage>3Volunteer? It's in the [[http://git.wikimedia.org/tree/labs%2Ftoollabs.git/master/www|www]] directory of the labs/toollabs repository. [04:18:46] MusikAnimal: hey, get my email? [04:19:40] I did! sorry to hear about all the other trouble you're going through [04:20:33] I meant the one about xtools with the screenshot [04:20:52] oh [04:21:32] XTools has been restarting itself a lot, but -ec and -articleinfo weren't. [04:21:32] oh I see [04:21:48] just now seeing that [04:21:54] Look at those mem= values... [04:22:07] 24000GBs... [04:22:20] well, that's quite a bit [04:22:30] looks like you isolated the memory leak [04:22:41] that seems insane [04:22:53] Not good. Risker came to my talk page asking for a restart.. [04:23:24] I'm not sure how that's possible... it must be getting locked up into some recursion or something [04:24:18] Hopefully I can get a little time to look at it this weekend. Wish Cyberpower678 was around. Not sure what he's been doing with moving to our new instance. [04:24:19] I don't think that's representative of RAM usage [04:24:38] And his recent oauth stuff [04:24:45] how only earth is there 24 terabytes of RAM on that machine [04:25:07] Virtual ram? [04:25:30] maybe... that's still way way way too much, like beyond realistic [04:25:31] YuviPanda: what exactly does mem= in qstat represent? [04:25:46] I don't think there's that much disk space on there either [04:26:13] No idea exactly what we have or it represents. [04:26:20] there's another figure for virtual RAM, says it was at 2 GB [04:26:53] We start writing our first .sh script in unix class next week. [04:27:00] Been going a little slow [04:27:29] well you should be able copy over that webwatcher, maybe a few changes, I shall try now [04:31:56] yeah, whatever instance the articleinfo is on there's 4 GB of RAM [04:32:22] (Sorry, still on vacation) [04:36:22] 10Wikibugs: Wikibugs should not say ", and 0 others" - https://phabricator.wikimedia.org/T90324#1056181 (10Krinkle) 3NEW [04:44:55] T13{droid}: well I don't know what's going on, the articleinfo just isn't working. Just hangs and eventually gets a 502 [04:45:01] Cyberpower678: you around? [04:45:49] I added the webwatcher, but as it stands now it's just going to keep restarting it every 15 minutes, which apparently doesn't solve anything [04:49:38] I don't know. webwatcher is running but I turned off the emails so we don't get spammed [04:53:09] -articleinfo isn't communicating with db it seems [04:53:41] Interface is loading for me, but isn't pulling page info. [04:56:47] Cyberpower678, very sleepy. [04:56:56] Err MusikAnimal ^ [04:57:09] Hi Cyberpower678 [04:57:20] That email was me goof. [04:57:23] Hi Cyberpower678 [04:57:31] Err T13{droid} [04:57:31] 24787GBs... [04:57:47] * Cyberpower678 can't think straight. [04:58:03] * T13{droid} knows Cyberpower678 is sleepy, he said hi to hisself... [04:58:29] T13{droid}, can you make me some shoes? :p [04:58:47] ... [04:59:03] No! [05:00:02] that figure is not correct [05:00:07] there's only 4 GB of RAM on there [05:00:17] What's the status with migration to our own instance Cyberpower678 [05:00:33] And.. login oauth [05:00:33] ShoeMaker, ask Coren [05:00:41] Wait. I meant MusikAnimal [05:00:53] .. [05:00:55] yeah sorry I haven't gotten back around to working on it [05:01:10] ShoeMaker, Coren wouldn't know anything about that. :p [05:01:41] He might know exactly what mem= represents in qstat though [05:02:13] yep [05:02:27] Since it's midnigh [05:02:30] ... [05:03:26] A shoe can sleep? [05:07:30] 10Tool-Labs: Error mails from SGE are encoded as application/octet-stream - https://phabricator.wikimedia.org/T63160#1056197 (10scfc) p:5Triage>3Low [05:12:37] 10Tool-Labs: Make SGE be more informative about OOM kills - https://phabricator.wikimedia.org/T88824#1056204 (10scfc) SGE indeed does offer something like that, and I proposed enabling it in T52053 (you could even accomplish continuous jobs without wrapper scripts by using epilog scripts that return an special... [05:55:19] 10Wikimedia-Labs-Infrastructure: Change labs shell name. - https://phabricator.wikimedia.org/T66192#1056228 (10scfc) 5Open>3Invalid [05:56:44] 10Wikimedia-Labs-Infrastructure: Change labs shell name. - https://phabricator.wikimedia.org/T66192#708360 (10scfc) According to [[https://wikitech.wikimedia.org/w/?diff=145061|this]], shell names cannot be renamed. [06:15:27] 10Tool-Labs: Puppetize /usr/local/bin/jobkill - https://phabricator.wikimedia.org/T90331#1056282 (10scfc) 3NEW a:3scfc [09:33:31] (03PS1) 10Merlijn van Deen: Fix incorrect 'and N others' message. [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/192069 (https://phabricator.wikimedia.org/T90324) [09:37:52] 10Wikibugs, 5Patch-For-Review: wikibugs test bug - https://phabricator.wikimedia.org/T1152#1056365 (10valhallasw) [09:39:28] 10Wikibugs, 4OOjs-UI-0.7.0: wikibugs test bug - https://phabricator.wikimedia.org/T1152#20004 (10valhallasw) [09:45:30] 10Wikibugs: wikibugs test bug - https://phabricator.wikimedia.org/T1152#1056370 (10valhallasw) [09:53:27] 10Wikibugs, 5Patch-For-Review: Problems with the new color scheme - https://phabricator.wikimedia.org/T89632#1056371 (10valhallasw) 5Resolved>3Open @Krinkle @ https://gerrit.wikimedia.org/r/#/c/190858/: > Can we not add underlines please? > > Also from UX I'd strongly recommend not to use red under any c... [09:54:52] also, Krinkle|detached, it's pretty dangerous to comment on merged patches ;-) The testing-and-merging mails make me archive the thread without reading after merging, and this is often not immediately but a day later [09:54:58] anyway, thanks for your feedback. [10:45:57] Hi, any admin around? [10:54:45] Kelson: coren is probably still asleep, and it's weekend as well. [10:54:53] Kelson: maybe it's something non-admins can also help with? [10:55:15] valhallasw: setting public IP, opening ports? [10:55:32] probably not, no :-) [10:55:51] valhallasw: then I will wait :) thx for your feedback. [10:56:08] Kelson: alternatively, open a bug in the labs project. [10:56:45] valhallasw: I will wait, I find it a little bit overkill to open service request tickets for this kind of simple service requests. [10:58:22] ok! don't be afraid to open a ticket though; it's also a tool to facilitate cross-timezone communication [11:49:37] PROBLEM - Free space - all mounts on tools-webproxy is CRITICAL: CRITICAL: tools.tools-webproxy.diskspace._var.byte_percentfree.value (<66.67%) [12:18:32] 10Wikibugs: use case-insensitive sort - https://phabricator.wikimedia.org/T90339#1056456 (10valhallasw) 3NEW [16:09:41] RECOVERY - Free space - all mounts on tools-webproxy is OK: OK: All targets OK [17:37:16] 10Tool-Labs: Puppetize /usr/local/bin/jobkill - https://phabricator.wikimedia.org/T90331#1056678 (10scfc) It's also currently not installed on: ``` tools-uwsgi-01: cp: cannot stat ‘/usr/local/bin/jobkill’: No such file or directory pdsh@passepartout: tools-uwsgi-01: ssh exited with exit code 1 tools-webgrid-05... [18:25:37] PROBLEM - Free space - all mounts on tools-webproxy is CRITICAL: CRITICAL: tools.tools-webproxy.diskspace._var.byte_percentfree.value (<12.50%) [18:40:06] again problems ? [18:40:27] I am so getting fed up [18:40:35] https://tools.wmflabs.org/toolscript/index.html?pastebin=x9TXBfZi [18:41:59] hmmm [18:42:09] it is firefox that is breaking up [18:50:38] RECOVERY - Free space - all mounts on tools-webproxy is OK: OK: All targets OK [18:52:36] right now the problem is with Chrome as well [20:06:35] PROBLEM - Free space - all mounts on tools-webproxy is CRITICAL: CRITICAL: tools.tools-webproxy.diskspace._var.byte_percentfree.value (<12.50%) [20:16:35] RECOVERY - Free space - all mounts on tools-webproxy is OK: OK: All targets OK [20:27:44] Web services seem to be rather unstable. Anyone able to open http://tools.wmflabs.org/catscan2/catscan2.php ? [20:29:10] multichill: I can at least open the page (so without a search). [20:29:25] Hmm, yeah, now it opens again. [20:29:29] It was stuck for a while [20:29:44] Maybe related to the webproxy alerts.... [20:49:12] things are really bad [20:49:16] ,,, :( [20:49:28] https://tools.wmflabs.org/toolscript/index.html?pastebin=x9TXBfZi is just one [20:49:41] https://tools.wmflabs.org/reasonator/?&q=7118905 another [20:56:24] (03PS1) 10Ricordisamoa: Initial commit [labs/tools/faces] - 10https://gerrit.wikimedia.org/r/192096 [20:58:17] (03CR) 10Ricordisamoa: [C: 04-2] "Does not work with OAuth; needs more work." [labs/tools/faces] - 10https://gerrit.wikimedia.org/r/192096 (owner: 10Ricordisamoa) [21:04:55] GerardM-: That bin appears to be empty [21:05:16] ? [21:05:33] https://tools.wmflabs.org/toolscript/index.html?pastebin=x9TXBfZi seems to be empty [21:06:12] https://tools.wmflabs.org/reasonator/?q=Q5248433 geeft ook alleen de HTTP [21:06:21] heeft niks met de bin te maken [21:07:39] I get normal output on reasonator, but there seem to be intermittent problems [21:08:25] GerardM-: Took several tries with my bot before it could grab the data for https://nl.wikipedia.org/wiki/Gebruiker:Multichill/Adel_zonder_familie [21:47:38] PROBLEM - Free space - all mounts on tools-webproxy is CRITICAL: CRITICAL: tools.tools-webproxy.diskspace._var.byte_percentfree.value (<55.56%) [21:58:46] Hi! Can someone tell me in which table and which column is stored wikipedia page text (wikitext). I downloaded and installed mediawiki on localhost and i noticed that text is stored in TEXT.old_text. But on labs this table is missing/has other name/is hidden / or is unreachable? [22:09:31] GerardM-: dat is allemaal magnustools die offline is [22:09:49] Dan_1591: it's not on labs [22:10:00] Dan_1591: you can use the api to retrieve text, or the database dumps [22:11:43] so, nor on quarry isn't a way to access this table? [22:12:23] No. I don't know the exact method of storage, but it's differently stored in the WMF cluster than on normal wikis [22:12:39] what do you need it for? [22:17:01] @valhallasw`cloud: i want to search in wikitext pages which contain or does not contain various texts: expressions, elements of wiki language, templates, urls, html comments and their content and varia [22:17:22] Dan_1591: you wouldn't be able to do that in the database anyway. It's not suitable for that kind of queries. [22:17:32] Dan_1591: the full text dumps are much better for that [22:17:58] dumps are enormous :( [22:18:23] You can run the analysis on labs? [22:18:30] the dumps are mostly there already [22:20:05] is there a documentation how i can do this? [22:21:19] Not very extensively, but https://wikitech.wikimedia.org/wiki/Help:Tool_Labs#Dumps documents where to get them [22:22:01] as for how to use them, https://meta.wikimedia.org/wiki/Data_dumps and https://meta.wikimedia.org/wiki/Data_dumps/Other_tools might be helpful [22:23:21] ok, i'll see if this can help me. Thank you. [23:07:42] RECOVERY - Free space - all mounts on tools-webproxy is OK: OK: All targets OK