[14:28:40] o/ [16:22:59] \o_ [19:29:32] heyo. 2 Qs. 1) for future reference, What's the best location for initial lazy-web "quarry query assistance" requests? Either: This channel, a specific talkpage somewhere, a phab task, or other? [19:29:36] 2) I'd like help writing a Quarry query, that will find all instances of a [[Mediawiki:Foo]] page that have been customized - i.e. where they have been created locally, versus just using the default strings. [19:29:37] E.g. https://en.wikipedia.org/wiki/MediaWiki:Talk has been customized on Enwiki, but how many other wikis have overridden the default? [20:32:02] o/ quiddity [20:32:05] did you get query help? [20:32:14] not yet :) [20:32:24] How hard-coded is the title "Talk" [20:32:34] e.g. Is it localized within the wikis? [20:34:10] At enwiki, https://en.wikipedia.org/wiki/MediaWiki:Talk exists as a local page. (I.e. it has edit history). Whereas at Frwiki, the local override was deleted in 2007, and now they just use the default - https://fr.wikipedia.org/wiki/MediaWiki:Talk [20:35:09] OK. If we can assume that "Talk" is what it will be called on all wikis, I think we can do this pretty easily. [20:35:15] However, it's going to be a bit of a pain. [20:35:32] Since we'll need to explicitly connect to each wiki's database independently to check. [20:35:57] There's no nice way to run queries against all databases. [20:35:57] Not in quarry. [20:36:03] But we can do it on the command-line pretty easily. [20:36:18] mhm, I wasn't sure if multiwiki was possible via quarry. The only examples I could find in the list of examples, mentions a bash script https://wikitech.wikimedia.org/wiki/Help:MySQL_queries#List_of_external_links_from_all_wikis [20:37:38] halfak, that particular example is not the one I want. It's just a simple example. This is more of a generalized search that I often want to do [20:37:45] Yeah. If I were going to do it, I'd use my utility. https://github.com/halfak/multiquery [20:38:08] quiddity, gotcha. maybe we can ask yuvipanda what it would take to make this kind of query easier in quarry. [20:38:21] Might be easy. might not be so easy. [20:38:59] nod. The specific example I hit yesterday, was wondering how many of these pages had been created/customized at each wiki. https://en.wikipedia.org/wiki/MediaWiki:Pageinfo-footer [20:39:10] I'll write up a thing. [20:39:11] ty! [20:40:59] quiddity, :) horray for writeups [20:42:04] Now that I think of it, PAWS might be a good way to do this. It would be great if we had a simple example. [20:49:14] quiddity: multiwiki is possible [20:49:18] 'use wikiname;' [21:01:08] You say that as if I understand any of the rest of the sqlmoonlanguage! ;) [21:03:19] lol @ sqlmoonlanguage [21:03:37] yuvipanda, not gonna work if you need to run a query against 800 DBs [21:09:01] No collab review today? [21:15:38] halfak: quiddity there's a patch from Krenair to allow multi-db work in Quarry [21:15:42] I need to merge it :| [21:15:51] Ooooooohhhhhh :DDDD [21:15:59] halfak: quiddity but we'll still limit it to 30mins across all [21:16:07] Make sense. [21:16:25] Many of the queries that I'd like to do cross-wiki will totally finish in 30 mins. [21:16:33] (for all the wikis) [21:18:58] halfak: quiddity https://gerrit.wikimedia.org/r/#/q/project:analytics/quarry/web,n,z [21:19:01] ba [21:19:05] https://gerrit.wikimedia.org/r/#/c/266925/ I mean [21:24:12] https://www.youtube.com/embed/VMZxm-EisrQ?rel=0&start=489&end=520&autoplay=1&modestbranding=1&loop=0&autohide=2 [21:24:24] halfak, ^ moonlanguage. (30 second clip from The Tick) [21:25:37] Awesome! [21:25:44] Thats a nice clip :) [21:26:25] I have it bound to /moonlanguage >.> [21:28:21] quiddity: halfak I don't feel too comfortable merging it today and then going on vacation :| [21:28:32] ohgodno! [21:28:33] Go have good vacations [21:28:43] i filed my request, and marked it low urgency [21:29:07] quiddity: link to said request? [21:29:13] https://phabricator.wikimedia.org/T129698 and it really is low urgency. Just a frequent curiosity that I have, which /might/ be useful. [21:30:50] ah [21:30:57] quiddity: fwiw, this might be much easier with PAWS [21:31:04] which is getting generally usable db access like... today [21:31:47] nod. no rush at all at all. :) I hesitated to even mention, given your impending vacation, and not wishing to distract whilst you tie up things. [21:32:20] :D [21:36:28] yuvipanda, if PAWS gets db access, I'm happy to work on an example. [21:36:44] halfak: it should in like ~30ish minutes [21:36:50] no magic yet [21:36:53] but that's ok [21:36:56] Yup [21:37:05] halfak: btw, the cscw trick for db access still works :) [21:37:13] it will stop working at some point soon tho [21:37:25] OK. I'll try *not* to use that :) [21:37:30] halfak: yeah :) [21:37:42] halfak: I'm going to impose a limit ont hese as well. 30mins until we get the new hardware [21:37:55] Makes sense. [21:38:07] https://gerrit.wikimedia.org/r/#/c/276310/ [21:38:14] (advertising...) [21:39:09] halfak: I also have personal paging setup for paws now [21:42:22] yuvipanda, great. The increased uptime will help me plan to get work done there. [21:44:11] * yuvipanda nods [21:44:29] halfak: the important update happened a few weeks ago, which allowed me to restart the hub without having to kill all users [21:45:10] * halfak likes being alive [21:45:20] halfak: now, if I take down the hub, I still make it inaccessible though. with https://phabricator.wikimedia.org/T129208, that will no longer be the case (so I can take down hub, and it will only affect new user logins) [21:45:29] so possibly taking down the hub now! wheee :D [21:45:33] * yuvipanda pushes button [21:45:38] I also need a test staging setup soon [21:46:12] yuvipanda, is that going to be a big pile of boiler plate or is this mostly handled now? [21:46:30] halfak: staging setup? [21:46:33] halfak: yeah, mostly handled now [21:46:45] I'll have to do some 's/paws/paws-testing' in a bunch of place [21:46:47] *places [21:46:55] and s/paws-public/paws-public-testing [21:47:25] halfak: not sure if I told you, I get to officially spend 50% of time on this now [21:47:39] You did. Also woot. :) [21:47:56] The other 50% is labs infra/weening us off your support for ORES? [21:49:02] halfak: ORES is still not part of the 100% in my head I think [21:49:17] halfak: most of other 50% is underlying kubernetes infra that tools is moving to (and paws is already on) [21:50:17] yuvipanda, nice. So even the other 50% is, in part, in support of PAWS [21:50:41] yeah [21:50:54] well our quarterly goal is to start moving tools webservices to kubernetes [21:51:08] so a good chunk of it is underlying kubernetes work [21:51:11] Helpful if we start talking about moving wikilabels soon? [21:51:30] not yet [21:51:34] * halfak would love to have some batteries included. [21:51:35] OK [22:01:25] halfak: success! [22:01:53] halfak: you can connect to a database using the host os.environ['MYSQL_HOST'], the username os.environ['MYSQL_USERNAME'] and the password os.environ['MYSQL_PASSWORD'] [22:02:42] Great! Thanks Yuvi! [22:02:53] I'm off for the evening. Ya'll have a good weekend [22:02:53] o/ [22:03:38] halAFK: you too! [22:07:43] bye halfak!