[00:00:38] use the page_links table [00:07:55] legoktm, I tried the templatelinks, and it is taking forever. [00:07:56] select page_namespace, page_title [00:07:56] from templatelinks [00:07:56] left join page on tl_from = page_id [00:07:56] where tl_title ="Cc-by-sa" [00:09:14] Magog_the_Ogre: probably because there's going to be a *lot* of results [00:09:21] not really [00:09:23] 13000 [00:09:36] how long is forever? [00:09:47] I am 3 minutes in [00:10:00] and yet the tool can do it in like 1 second: https://tools.wmflabs.org/templatecount/?lang=commons&name=Cc-by-sa&namespace=10#bottom [00:10:31] Magog_the_Ogre: you should also specify tl_namespace, I think. otherwise it probably won't use its index. [00:10:49] That + a LIMIT should get you to much quicker [00:11:19] my limit is exactly the number of results. [00:11:23] I want all 13000 [00:12:17] Magog_the_Ogre: you'll probably get it to be faster with a smaller limit, and I'm now reasonably sure you aren't hitting an index without the tl_namespace in your 'where' [00:12:39] oh yes [00:12:45] ok let me see [00:13:19] select page_namespace, page_title [00:13:22] from templatelinks [00:13:27] where tl_title ="Cc-by-sa" [00:13:34] shoot [00:13:36] try again [00:13:55] select page_namespace, page_title [00:13:55] from templatelinks [00:13:55] left join page on tl_from = page_id [00:13:55] where tl_title ="Cc-by-sa" [00:13:55] and tl_namespace = 6 [00:13:57] there [00:14:03] I'm getting 0 results though [00:14:10] Magog_the_Ogre: template is 10, not 6 [00:14:32] but I want to get the links for this template on file pages (6) [00:15:00] Magog_the_Ogre: tl_namespace is for the namespace of the page being used as a template, not the page it is being used in [00:15:06] www.mediawiki.org/wiki/Manual:Database_layout [00:15:11] is what I usually use as reference [00:15:33] you overestimate my ability to read database layouts [00:15:36] Magog_the_Ogre: you can add a page_namespace = 6 in the WHERE for that [00:15:54] it is in the where? [00:16:10] oh I see. page_namespace must equal 6 [00:16:11] Magog_the_Ogre: you have 'tl_namespace = 6' [00:16:23] Magog_the_Ogre: yeah, so you want to have 'tl_namespace = 10' and 'page_namespace = 6' [00:17:39] well darn, it worked [00:17:44] thanks YuviPanda, legoktm [00:18:27] Magog_the_Ogre: :D much faster? :) [00:18:46] yes [00:20:23] Magog_the_Ogre: I use http://quarry.wmflabs.org/query/242 to test it out [00:20:41] Magog_the_Ogre: I added a LIMIT mostly so the resultset won't crash my browser :) [00:21:40] oh that is a mightily dangerous link [00:21:43] I will pretend I didn't see that. [00:22:16] (although I may use it) >:-D [00:22:22] Magog_the_Ogre: :D why dangerous? [00:23:05] If you must ask that, then please go look up WP:BEANS [00:23:41] I don't think it's dangerous [00:23:57] Magog_the_Ogre: it's hardened enough for the WMF DBA :) [00:24:35] Magog_the_Ogre: see, for example, http://quarry.wmflabs.org/query/243 :) [00:24:58] probably because he could ban my - ERR I MEAN - someone ELSE's IP if they try to bombard the page. [00:25:30] Magog_the_Ogre: hard to do that as well :) [00:26:32] Magog_the_Ogre: I also don't see or store your IP [00:26:46] Magog_the_Ogre: quarry requires OAuth login [00:28:22] >create an OAuth account [00:28:30] heh [00:28:41] if you have a wikipedia account, you already have an OAuth account! :D [00:28:47] >issue like 700 computer-generated very heavy requests [00:28:53] >use an open proxy for everything [00:28:58] >post requests via bot [00:29:01] >??? [00:29:02] >profit [00:29:38] in all seriousness, I gtg [00:29:40] ttfn [00:29:53] Magog_the_Ogre: one user can't run more than a number of queries in parallel, and all queries get killed after 10m [00:30:56] like I said, WP:BEANS :) [00:32:34] tch tch :P this one is the case where the mom genetically engineers the kid to have a plastic shield over the nose [02:03:33] !log quarry increased mysql connection limit manually to 1024, re-running all old query-runs to produce output in new sqlite format [02:03:37] Logged the message, Master [05:45:28] Hi! Is here an admin online? [05:46:49] I cannot get access to my tools project "taxonbot" any more. [05:46:59] By Putty and any else [13:34:08] Am I understanding it correctly that gadget-related data is not (yet) available on Tool labs databases? [13:34:33] I would like to do something like this: http://quarry.wmflabs.org/query/248 [13:36:45] Ideally I would like to keep track of it over time. [13:41:41] whym: heya! [13:41:47] whym: no, gadget related data isn't available [13:42:28] whym: btw, http://quarry.wmflabs.org/query/129 does work now - but quarry is having some unicode issues I'm in the process of fixing [13:43:04] whym: see https://bugzilla.wikimedia.org/show_bug.cgi?id=19288 [13:48:14] YuviPanda: thanks for the info, and for working on the unicode issue. [13:49:04] whym: :) glad you find quarry useful [13:49:20] whym: any other feature requests? [13:49:23] (for quarry, that is) [13:53:05] YuviPanda: assuming we have lots of queries published, tagging of queries might be nice, for example I would like to say, this query is about "jawiki" "new editors", that query is about "jawiki" and "new articles" etc. [13:53:24] I mean assuming we are going to have [13:53:30] I hope we do :) [13:53:39] whym: yeah, that's a requested feature. should be on the pipeline some time. [13:54:37] YuviPanda: and i18n of the interface, lower priority probably, though. [13:55:10] whym: yeah, true. this is a python app, and I don't know if our infrastructure has had localized python apps before [13:56:15] YuviPanda: pywikibot has a nice i18n framework in it, you might be able to borrow something from them. [13:56:18] whym: http://quarry.wmflabs.org/Whym exists now as well :) [13:56:33] whym: yeah, will take a look! problem here would be that I'd need messages in both python and JS, while pywikibot doesn't [14:11:12] 3Wikimedia Labs / 3tools: Tool Labs: Provide anonymized view of the user_properties table - 10https://bugzilla.wikimedia.org/58196 (10Yusuke Matsubara) [15:46:11] Hi, there. I'm new to the labs, and met a problem. I created a instance, i-0000052c.eqiad.wmflabs, with inside ip 10.68.17.232. I have logged in to bastion1, but got 'Could not resolve hostname' error when trying ssh to the instance. And also cannot ping the ip. Is there anyone can help? Thanks very much! [15:57:51] jw if labs is ever planning on upgrading to a new version of PHP [15:58:22] it's not a big deal by any means, but occasionally I'll have my code running clean as a whistle at home under 5.5, only for it to fail under 5.3 on Labs. [15:59:41] Magog_the_Ogre: should come when we upgracde to trusty [16:00:02] hey aaron_xiao! I don't know if I can help right now :( have you read https://wikitech.wikimedia.org/wiki/Help:Access [16:00:45] Magog_the_Ogre: no timeline yet, but I suspect 'sometime this year' [16:01:13] OK thanks YuviPanda [16:07:31] hmm. Your account is not in the project tools. [16:07:43] can someone please add me to the project [16:09:48] Mardetanha: heya! what's your username? [16:09:59] same Mardetanha :) [16:10:02] bah, I don't have my phone, can't log in :| [16:10:30] Mardetanha: if you request one at https://wikitech.wikimedia.org/wiki/Special:FormEdit/Tools_Access_Request I'll add you in 30m or so [16:11:28] YuviPanda: sure [16:11:56] Mardetanha: thanks! sorry about htat [16:12:08] I have two factor auth on, and my phone is currently dead + with someone else [16:13:17] damn, it happend to me before, you have to regain your phone [16:13:34] I shall, once my friend comes back home [16:21:59] YuviPanda: done [16:28:30] whym_away: temp unicode fix for your query at http://quarry.wmflabs.org/query/129 [16:32:37] whym_away: you should comment that query and use multiple lines so it's more understandable, though :) [17:44:44] 3Wikimedia Labs / 3tools: 'become' doesn't load ~/.bashrc - 10https://bugzilla.wikimedia.org/50249 (10Dispenser) [17:44:47] 3Tool Labs tools / 3[other]: Migrate http://toolserver.org/~dispenser/* to Tool Labs - 10https://bugzilla.wikimedia.org/66868 (10Dispenser) [17:44:47] 3Wikimedia Labs / 3tools: Provide replication lag as a database function - 10https://bugzilla.wikimedia.org/48628 (10Dispenser) [17:44:47] 3Wikimedia Labs / 3tools: screen doesn't work from within 'become' - 10https://bugzilla.wikimedia.org/50248 (10Dispenser) [18:45:03] I just ran into bug https://bugzilla.wikimedia.org/show_bug.cgi?id=54330 when doing some analysis (some databases missing). [18:45:28] For example, shiladsen@tools-login:~$ sql dewiki_p ERROR 1045 (28000): Access denied for user 'u10339'@'127.0.0.1' (using password: YES) [18:46:02] I count 26 languages that don't exist [18:47:42] 3Wikimedia Labs / 3Infrastructure: Some databases missing - 10https://bugzilla.wikimedia.org/54330#c1 (10Shilad Sen) I just encountered this bug. The full list of missing databases for me appears below: connection to de failed connection to nl failed connection to it failed connection to pl failed connecti... [18:47:59] Any known workarounds? [18:49:02] shilad: are you connecting to dewiki_p instead of de? [18:49:56] I'm running "sql dewiki_p" [18:50:10] Is that correct? [18:50:17] (It works for most languages) [18:57:14] shilad: YuviPanda: something seems to wrecked on tools-login, works for me from tools-dev & exec-nodes [18:59:19] Hmmm... I have the same problem for de on tools-dev: [18:59:36] hiladsen@tools-dev:~$ sql dewiki_p ERROR 1045 (28000): Access denied for user 'u10339'@'127.0.0.1' (using password: YES) [18:59:58] shilad: as of writing this, it was ok, now broken even on tools-dev [19:00:18] Glad to know it's not just me :) [19:00:23] seems someone is fiddling with sql script atm :/ [19:00:58] Okay. I'll hang tight and try again later today. [19:01:25] Thanks. [19:03:35] shilad: aha, now working on tools-dev again, still broken on tools-login. HURRY up ;-) [19:03:38] lol [19:08:57] huskyr: ping. working on some ehancements to directory atm. [19:16:20] shilad: On which host can you not connect to which database? [19:25:05] scfc_de: @tools-login:~$ sql dewiki -> fail [19:25:59] scfc_de: @tools-dev:~$ sql dewiki -> {{ok}} [19:27:45] hedonil: @tools-login, "/usr/bin/sql dewiki_p" WFM. [19:29:13] scfc_de: doesn't work for me [19:29:15] $ /usr/bin/sql dewiki_p [19:29:22] Access denied for user 's52281'@'127.0.0.1' (using password: YES) [19:32:32] scfc_de: aha! s52281 is a new user, on -dev I used an "old" user [19:33:06] scfc_de: works even on -login, with an "old" user! [19:36:04] scfc_de: and the new user also works on -login for enwiki, seems just to be a problem with s2/4/5 + new accounts [19:48:19] hedonil: "New accounts" = since ...? [19:50:56] scfc_de: hmm s52281 has been created 20140817144614Z [19:55:14] scfc_de: and shilad 's tool afterwards 20140817180959Z [22:42:53] betalabs is badly broken :( [22:43:15] http://zero.wikimedia.beta.wmflabs.org/wiki/Main_Page?debug=true -- tries to load http://bits.beta.wmflabs.org/zero.wikimedia.beta.wmflabs.org/load.php?debug=true&lang=en&modules=ext.uls.nojs&only=styles&skin=vector&* [22:49:02] or is bits down? [22:51:30] yurikR1: It looks like the beta bit server is dead to me. I'll see if I can figure out what's up. [22:53:14] thx bd808 ! [22:54:04] we have a new magic fairy, fixing all the problems in the wikiland ) [22:56:40] !log deployment-prep deployment-cache-bits01.eqiad.wmflabs not allowing ssh access and wikitech console full of OOM killer messages [22:56:43] Logged the message, Master [22:58:31] death to bits! reboot :) [22:58:57] !log deployment-prep Attempting to reboot deployment-cache-bits01.eqiad.wmflabs via wikitech [22:58:59] Logged the message, Master [23:00:28] yurikR1: We may need to find a root to kill it with fire [23:00:52] i think i have root [23:01:09] I have project root, but this would need a labs root I think [23:01:28] you think the box needs to be booted? [23:01:51] It may be restarting.... [23:03:34] yurikR1: I think it is better now [23:04:26] bd808|AWAY, thx, works :) [23:04:54] bd808|AWAY, btw, while you were gone - http://graphtest.wmflabs.org/wiki/Main_Page [23:05:01] might like 'em