[00:04:30] legoktm: Yeah, something seems broken. [00:04:34] orientdb> select expand( both('Friend').out('Eat') ) from Person where name = 'Luca' [00:04:39] love it, so simple :) [00:04:49] legoktm: I filed https://phabricator.wikimedia.org/T75812 [00:05:47] AaronSchulz: puppet time? [00:06:03] 3MediaWiki-Core-Team: Investigate OrientDB for WDQ - https://phabricator.wikimedia.org/T75813 (10aaron) 3NEW p:3Normal a:3aaron [00:06:26] sec [00:11:47] ori: where are you? [00:15:52] heheh [00:15:55] AaronS: I haven't left R37 yet [00:15:57] on my way [00:16:06] my god [00:49:43] AaronS, ori: can I get a +1 from somebody on this additional beta logging config change? -- https://gerrit.wikimedia.org/r/#/c/175619/ [00:49:51] legoktm: ^ [01:52:16] bd808: sorry, missed your ping [01:52:32] ori: finding a task that I'm halfway through and then doing the second half of it is fine if it is an emergency, and it's fine if I've specifically delegated that subtask to you [01:52:57] otherwise don't do it [01:53:41] ori: no worries. I self-merged like a champ [01:56:54] TimStarling: I'll reply in PM [03:50:46] legoktm: It's not clear why that banner showed to logged-in users. [04:49:02] 3MediaWiki-Core-Team: SHA-1 file name support - https://phabricator.wikimedia.org/T1210#783413 (10Revi) [05:38:57] 3MediaWiki-API, MediaWiki-Core-Team: API: adrprefix gives invalid title error for valid titles - https://phabricator.wikimedia.org/T75711#783440 (10Mattflaschen) [06:51:05] Warning: Compilation failed: this version of PCRE is compiled without UTF support at offset 0 in /home/tstarling/src/mediawiki/core/includes/MagicWord.php on line 550 [06:51:21] on osmium [06:53:12] _joe_: know anything about that? [06:53:45] <_joe_> TimStarling: nope [06:54:06] <_joe_> that seems quite worrysome btw [06:54:12] <_joe_> let me take a look [06:59:23] it's reproducible with /usr/local/bin/hhvm [06:59:48] <_joe_> TimStarling: yeah I was more worried we had the same problem with production [07:00:15] <_joe_> php -r "var_dump(preg_match('/ai/ui', 'cagliaI'));" works on HHVM appservers in general, not on osmium [07:01:12] <_joe_> so, someone did something there? taking a deeper look [07:02:05] <_joe_> the libpcre binaries on osmium are different than the ones on the other appservers [07:02:24] funny [07:02:29] <_joe_> while the package is supposedly the same [07:02:52] you want to reinstall? [07:03:26] <_joe_> mh no actually [07:03:40] <_joe_> md5sum /lib/x86_64-linux-gnu/libpcre.so.3 is the _same_ [07:06:15] hhvm on mw1189 doesn't use the system lib [07:06:25] <_joe_> how can you tell [07:06:31] oh, never mind, yes it does, sorry [07:06:31] <_joe_> it uses it on mw1117 [07:06:40] <_joe_> oh ok [07:06:49] ok, that's one jump to conclusions each [07:06:53] <_joe_> it's osmium that's strange [07:06:57] * TimStarling 1, _joe_ 1 [07:06:59] <_joe_> eheh [07:07:27] <_joe_> now what really bugs me is, both /usr/local/bin/hhvm and /usr/bin/hhvm show the same behaviour on osmium [07:07:38] <_joe_> so I'd tend to think it's a problem with the library [07:07:51] <_joe_> but ldd tells us the library is the same as on other servers [07:07:53] <_joe_> so... [07:19:04] <_joe_> TimStarling: I am looking at the strace of the test repro I showed you, and apart from seeing the ton of weird things HHVM does on startup (like reading /proc/meminfo) [07:19:13] <_joe_> I don't see a smoking gun for this [07:20:26] very mysterious [07:20:36] <_joe_> it is [07:22:14] <_joe_> mmmh [07:23:02] <_joe_> I see libpcreposix.a and libpcre.a in /usr/local/lib/ [07:23:14] <_joe_> but they don't seem to be loaded by hhvm [07:23:47] <_joe_> I'll get back to this later, now I have more urgent matters [07:23:53] ok [07:24:02] I have to go for dinner soon anyway [07:24:17] <_joe_> :) ok I'll let you know if I solve this puzzle [07:24:24] <_joe_> good evening [09:29:05] _joe_: I had a thought during dinner [09:29:20] Breakpoint 1, 0x0000000001790210 in pcre_compile2 () [09:29:20] (gdb) print $rip [09:29:20] $1 = (void (*)()) 0x1790210 [09:29:24] <_joe_> TimStarling: about the pcre thing? [09:29:27] (gdb) info symbol 0x0000000001790210 [09:29:28] pcre_compile2 in section .text of /usr/bin/hhvm [09:29:37] that's on osmium [09:29:56] on mw1189: [09:29:59] (gdb) print $rip [09:30:00] $2 = (void (*)()) 0x7ffff5e463c0 [09:30:07] (gdb) info symbol 0x7ffff5e463c0 [09:30:07] pcre_compile in section .text of /lib/x86_64-linux-gnu/libpcre.so.3 [09:30:11] <_joe_> ohhh so although it's linked to pcre, it's not using it [09:30:13] <_joe_> UGH [09:30:35] yeah, on osmium, it is using the bundled one, which is broken [09:30:43] on mw1189 it is using the system one, which is not broken [09:31:11] <_joe_> ok the important thing was "prod not broken" [09:31:18] <_joe_> but well, good catch [11:03:37] 3Release-Engineering, MediaWiki-Core-Team: Make sure scap rsync proxies aren't in jobrunner pool - https://phabricator.wikimedia.org/T1342#783927 (10Reedy) It's something that @bd808 has mentioned a few times, based on the logs, stuff using the job runners take longer IIRC. This can be then exacerbated by many... [12:31:07] 3Release-Engineering, MediaWiki-Core-Team: Make sure scap rsync proxies aren't in jobrunner pool - https://phabricator.wikimedia.org/T1342#784056 (10Reedy) [12:35:51] 3Release-Engineering, MediaWiki-Core-Team: Make sure scap rsync proxies aren't in jobrunner pool - https://phabricator.wikimedia.org/T1342#784074 (10Joe) I have a patch that will make this easier to do: https://gerrit.wikimedia.org/r/#/c/174664/ Working on it today. [13:18:15] 3MediaWiki-extensions-WikidataClient, MediaWiki-Core-Team, Scrum-of-Scrums, Wikidata: Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached - https://phabricator.wikimedia.org/T58602#784131 (10hoo) 5Open>3Resolved a:3hoo [14:39:47] 3MediaWiki-Core-Team: Track down and resolve cause for high system CPU% on HHVM API servers - https://phabricator.wikimedia.org/T75706#784416 (10hashar) [14:39:53] 3MediaWiki-Core-Team: Track down and resolve cause for high system CPU% on HHVM API servers - https://phabricator.wikimedia.org/T75706#776953 (10hashar) [14:48:33] 3MediaWiki-Core-Team: HHVM gets stuck in what seems a deadlock in pcre cache code - https://phabricator.wikimedia.org/T1194#784453 (10hashar) [14:49:04] 3MediaWiki-Core-Team: Fix HHVM PCRE cache - https://phabricator.wikimedia.org/T757#784458 (10hashar) [15:04:02] 3MediaWiki-extensions-WikidataClient, MediaWiki-Core-Team, Scrum-of-Scrums, Wikidata: Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached - https://phabricator.wikimedia.org/T58602#784502 (10aude) [15:32:05] <^d> Why do we check in .idea/* directory to vagrant? [15:33:42] ^d: For fun? And probably because somebody wanted a "common" setup for new team members. [15:34:07] * bd808 uses vim and really doens't care [15:34:11] <^d> Long as I can check in $myFavoriteEditorsDotFiles too :) [15:47:15] evening [15:47:38] <^d> hi Nikerabbit :) [15:48:39] ^d: did we talk about setting ttm queries to some specific "group"? I don't remember us doing so, so I'm wondering whether I'm just imagining [15:49:06] <^d> stats grouping? [15:49:23] yeah stats or monitoring something like that [15:49:43] <^d> Ah yeah Nik probably had mentioned that before. [15:49:48] <^d> Speak of the devil :) [15:50:17] haha sorry [16:06:53] 3Release-Engineering, MediaWiki-Core-Team: Make sure scap rsync proxies aren't in jobrunner pool - https://phabricator.wikimedia.org/T1342#784643 (10bd808) [16:25:11] We're on the road to dropping 5.3 :D [16:27:54] gj us. Dropping support for an unsupported PHP version within a year of it losing upstream patches. :) [16:28:00] 3Release-Engineering, MediaWiki-Core-Team, Deployment-Systems: Make sure scap rsync proxies aren't in jobrunner pool - https://phabricator.wikimedia.org/T1342#784782 (10greg) [16:28:45] <^d> new versions are overrated. [16:29:59] 3Release-Engineering, MediaWiki-Core-Team, Deployment-Systems: Update servers in scap rsync proxy pool - https://phabricator.wikimedia.org/T1342#784784 (10Reedy) [16:41:56] 3MediaWiki-General-or-Unknown, MediaWiki-Core-Team: Drop PHP 5.3 support - https://phabricator.wikimedia.org/T75901 (10Reedy) 3NEW p:3Triage [16:50:31] omg. My stupid logging config patch is still not right. I'm a moron. [16:53:14] bd808: is `sql` broken again on beta for you? [16:53:54] legoktm: wfm from deployment-bastion [16:54:22] uh wtf, it didn't work and now it does [16:54:32] thanks >.> [16:54:51] I had a bad crash in the logging config for a bit that may have messed it up [16:55:01] now I only have a soft crash :/ [17:14:08] bd808: The plan of "don't mark a task as done until after the weekly meeting" doesn't seem to work out that well a task is in multiple groups. For example, I left https://phabricator.wikimedia.org/T75711 open but then someone else closed it. [17:14:44] Yeah. :( If we want to track "sprint progress" we will probably need to have sprint boards I guess [17:15:11] Then we could show closed tasks and see something besides noise [17:15:17] Or the hidden "archived" column that everything in "done" gets moved to after the meeting [17:15:34] true that would be fairly easy to do [17:15:47] Would sprint boards mean even more projects to add and drag-and-dropping to have to mess around with? [17:15:57] anomie: yup [17:16:04] * anomie -1s that idea [17:16:08] so maybe your plan would be nicer [17:17:04] My beta logging config still isn't working but at least it's not spewing errors into the hhvm log now. :/ [17:17:22] * bd808 guesses there are firewall or other acl problems now [17:19:28] 3MediaWiki-Core-Team, Librarization: Test monolog logging provider in beta - https://phabricator.wikimedia.org/T845#784869 (10bd808) Config is live in beta and seems to not be throwing PHP errors to the HHVM log now, but the redis transport seems to still not be working. Next step will be to verify that connecti... [17:20:49] 3MediaWiki-Core-Team, Librarization: Test monolog logging provider in beta - https://phabricator.wikimedia.org/T845#784870 (10bd808) [17:39:32] Reedy, csteipp: so in https://noc.wikimedia.org/conf/highlight.php?file=CommonSettings.php's CentralAuthWikiList hook, why do we remove closed wikis? [17:43:23] legoktm: The code was roughly there in Roans initial commit [17:43:24] https://github.com/wikimedia/operations-mediawiki-config/commit/015f5b7131eea4309864691dbc1f4266ac57ad18 [17:43:24] legoktm: git blame and find out who did the change... but I'd guess because we don't usually want sul users logging in there, or have those wikis merged, etc. [17:44:21] I can still login at https://aa.wikipedia.org/wiki/Main_Page [17:44:44] https://noc.wikimedia.org/conf/highlight.php?file=closed.dblist [17:44:48] aawiki is on the top [17:48:34] swtaarrs: HHVM serving 1/3rd of Wiki[pm]edia traffic [17:49:16] 3MediaWiki-extensions-WikidataClient, MediaWiki-Core-Team, Scrum-of-Scrums, Wikidata: Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached - https://phabricator.wikimedia.org/T58602#784922 (10bd808) [17:49:19] 3Scrum-of-Scrums, Wikidata, MediaWiki-Core-Team: Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached - https://phabricator.wikimedia.org/T1339#784923 (10bd808) [17:57:01] <_joe_> swtaarrs: http://ganglia.wikimedia.org/latest/?r=hour&cs=&ce=&c=Application+servers+eqiad&h=&tab=m&vn=&hide-hf=false&m=cpu_report&sh=1&z=small&hc=4&host_regex=&max_graphs=0&s=by+name you can play "spot HHVM" on this graph [17:57:12] <_joe_> it's pretty easy too [17:57:36] * legoktm has hacked around it for now [18:07:30] <^d> I'm lurking in #phpfig now. Let's see what comes of it :) [18:08:14] 3MediaWiki-API, MediaWiki-Core-Team: add an index field to show original order of queried titles - https://phabricator.wikimedia.org/T16859#784990 (10Anomie) [18:08:36] 3MediaWiki-API, MediaWiki-Core-Team: add an index field to show original order of queried titles - https://phabricator.wikimedia.org/T16859#185744 (10Anomie) [18:08:51] Oh, it's still Bug:, just with T prefix [18:09:38] 3MediaWiki-Core-Team: Deprecated API usage report on WMF wikis - https://phabricator.wikimedia.org/T1272#784995 (10Anomie) [18:09:41] 3MediaWiki-Core-Team: Deprecated API usage report on WMF wikis - https://phabricator.wikimedia.org/T1272#22032 (10Anomie) [18:15:47] <^d> bd808: <^d> I'm lurking in #phpfig now. Let's see what comes of it :) [18:16:25] ^d: sweet. I was just looking at the digest email from yesterday. The cache psr is a mess. [18:16:32] <^d> yeah [18:25:46] 3MediaWiki-Core-Team: [Bug 72576] When translations are changed on control wiki the change should be updated on jump wikis - https://phabricator.wikimedia.org/T1270#785023 (10Anomie) [18:26:07] 3MediaWiki-extensions-SecurePoll, MediaWiki-Core-Team: When translations are changed on control wiki the change should be updated on jump wikis - https://phabricator.wikimedia.org/T74576#765242 (10Anomie) [18:26:32] 3MediaWiki-extensions-SecurePoll, MediaWiki-Core-Team: When translations are changed on control wiki the change should be updated on jump wikis - https://phabricator.wikimedia.org/T74576#765242 (10Anomie) [18:28:10] ^d: Ummm... today id TACO TUESDAY! [18:28:13] *is [18:28:20] 3MediaWiki-extensions-SecurePoll, MediaWiki-Core-Team: When translations are changed on control wiki the change should be updated on jump wikis - https://phabricator.wikimedia.org/T74576#785040 (10Anomie) a:3Anomie [18:28:21] 3Release-Engineering, MediaWiki-Core-Team, Deployment-Systems: Update servers in scap rsync proxy pool - https://phabricator.wikimedia.org/T1342#785043 (10greg) p:5Triage>3Normal [18:32:03] https://www.google.com/recaptcha/intro/comingsoon/index.html Coming soon, the "No-CAPTCHA" reCAPTCHA [18:39:23] ori: nice [18:39:37] ori: I assume it's the smaller CPU graphs :) [18:39:38] "intro/comingsoon/index.html" [18:42:29] 3Editing, Wikidata, Mobile-Web, Zero, Parsoid-Team, Scrum-of-Scrums, Services, Phabricator, Release-Engineering, Research-and-Data, MediaWiki-Core-Team, Engineering-Community, Language-Engineering, WMF-Design, Multimedia, Core-Features, Mobile-Apps: Create team projects for all teams participating in scrum of scru... [18:53:08] ori: any issues you need help with? I'm doing a phone screen right now but hope to be able to finish up tim's pcre diff after [18:53:38] swtaarrs: yeah, that's be best [19:26:14] anomie: I think we should merge the OpenSearchXML stuff after tomorrows branch cut [19:26:36] legoktm: Sounds good to me [19:50:57] 3MediaWiki-General-or-Unknown, MediaWiki-Core-Team: $wgProfileToDatabase still used - https://phabricator.wikimedia.org/T75917 (10Chad) 3NEW p:3Triage [19:51:07] AaronSchulz: Heh ^ [20:28:14] tacotuesday: https://gerrit.wikimedia.org/r/#/c/175769/ [20:40:34] 3MediaWiki-Core-Team, Librarization: Give CDB library a nice README - https://phabricator.wikimedia.org/T1313#22980 (10bd808) [20:40:58] 3MediaWiki-Core-Team, Librarization: Give CDB library a nice README - https://phabricator.wikimedia.org/T1313#22980 (10bd808) [20:41:50] 3Scrum-of-Scrums, Wikidata, MediaWiki-Core-Team: Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached - https://phabricator.wikimedia.org/T1339#785805 (10bd808) [20:41:52] 3MediaWiki-Core-Team, Librarization: Transfer wikimedia/simplei18n to WMF - https://phabricator.wikimedia.org/T1347#785806 (10bd808) [20:41:55] 3MediaWiki-Core-Team: CirrusSearch enwiki rollout - https://phabricator.wikimedia.org/T997#785808 (10bd808) [20:41:56] 3MediaWiki-Core-Team: ProfilerOutput refactoring - https://phabricator.wikimedia.org/T1311#785809 (10bd808) [20:41:59] 3MediaWiki-Vendor, MediaWiki-Core-Team, Librarization: Bring in elastica library through composer - https://phabricator.wikimedia.org/T1281#785810 (10bd808) [20:42:00] 3MediaWiki-API, MediaWiki-Core-Team: API: adrprefix gives invalid title error for valid titles - https://phabricator.wikimedia.org/T75711#785811 (10bd808) [20:42:03] 3Scrum-of-Scrums, MediaWiki-Core-Team: disks for logstash - https://phabricator.wikimedia.org/T1328#785812 (10bd808) [20:42:04] 3Release-Engineering, Scrum-of-Scrums, MediaWiki-Core-Team: disks for logstash - https://phabricator.wikimedia.org/T1225#785813 (10bd808) [20:42:08] 3Editing, Wikidata, Mobile-Web, Zero, Parsoid-Team, Scrum-of-Scrums, Services, Phabricator, Release-Engineering, Research-and-Data, MediaWiki-Core-Team, Engineering-Community, Language-Engineering, WMF-Design, Multimedia, Core-Features, Mobile-Apps: Create team projects for all teams participating in scrum of scru... [20:42:30] hey legoktm: column change notification is lame ^^^ [20:42:41] 3Zero, MediaWiki-Core-Team: CirrusSearch for rebooted apps - https://phabricator.wikimedia.org/T1230#785816 (10bd808) [20:42:44] 3Logstash, MediaWiki-Core-Team: doc_values setting in mapping causes fields >32K to reject indexing document - https://phabricator.wikimedia.org/T1269#785817 (10bd808) [20:42:46] 3MediaWiki-Core-Team: HHVM forks (with 4 gb of copied memory!) stuck in a futex - https://phabricator.wikimedia.org/T1195#785818 (10bd808) [20:43:45] 3MediaWiki-Core-Team: Security review for WikiGrok extension [Bug 72567] - https://phabricator.wikimedia.org/T948#785819 (10bd808) [20:43:47] 3MediaWiki-Core-Team: Fix OAuth bug 72634 - https://phabricator.wikimedia.org/T950#785820 (10bd808) [20:43:49] 3MediaWiki-Core-Team: Isolate and fix memory leaks in HHVM - https://phabricator.wikimedia.org/T820#785821 (10bd808) [20:48:55] 3Scrum-of-Scrums, MediaWiki-Core-Team, Core-Features: Enable $wgContentHandlerUseDB everywhere (bug 49193) - https://phabricator.wikimedia.org/T1217#785838 (10Mattflaschen) [20:50:04] bd808: yeah, there's a bug open for that [20:50:35] legoktm: Oh I know. I just want to keep poking out about it :P [20:50:49] s/out/you/ [21:01:54] 3Wikimedia-General-or-Unknown, Scrum-of-Scrums, Core-Features, MediaWiki-Core-Team: Add ContentHandler columns to Wikimedia wikis, and set $wgContentHandlerUseDB = true - https://phabricator.wikimedia.org/T51193#785903 (10Mattflaschen) [21:02:38] 3MediaWiki-Core-Team: [Bug 71323] CentralAuthUser::matchHash should only match the hash, not also update the password - https://phabricator.wikimedia.org/T745#785908 (10bd808) [21:02:41] 3MediaWiki-Core-Team: [bug 72359] feedrecentchanges returns zero bytes on 1.25wmf4 - https://phabricator.wikimedia.org/T804#785909 (10bd808) [21:02:43] 3MediaWiki-Core-Team: [Bug 67774] UserMerge support for OAuth - https://phabricator.wikimedia.org/T721#785910 (10bd808) [21:09:22] 3MediaWiki-Core-Team: [Bug 67766] Add UserMerge support to Echo - https://phabricator.wikimedia.org/T731#785951 (10bd808) [21:09:25] 3MediaWiki-Core-Team: [Bug 39470] Fix merging blocked users - https://phabricator.wikimedia.org/T730#785952 (10bd808) [21:09:27] 3MediaWiki-Core-Team: [Bug 72204] Add UserMerge support to AntiSpoof - https://phabricator.wikimedia.org/T714#785953 (10bd808) [21:10:28] 3MediaWiki-extensions-WikidataClient, MediaWiki-Core-Team, Scrum-of-Scrums, Wikidata: Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached - https://phabricator.wikimedia.org/T58602#785966 (10JanZerebecki) [21:11:58] 3MediaWiki-Core-Team: Finish getting es-tool reviewed - https://phabricator.wikimedia.org/T712#785968 (10bd808) [21:12:00] 3MediaWiki-Core-Team: Fix CentralAuthAntiSpoof to be called in all necessary code paths - https://phabricator.wikimedia.org/T724#785969 (10bd808) [21:12:03] 3MediaWiki-Core-Team: [CirrusSearch] Support specifying replica count per index type - https://phabricator.wikimedia.org/T998#785970 (10bd808) [21:16:47] 3MediaWiki-Core-Team: Restart Elasticsearch to pick up regex fixes + sandboxing config for Translate - https://phabricator.wikimedia.org/T1241#786013 (10bd808) [21:16:49] 3MediaWiki-Core-Team: GlobalUserPage security review - https://phabricator.wikimedia.org/T1285#786014 (10bd808) [21:16:51] 3MediaWiki-Core-Team: Deploy Elasticsearch plugin updates for regex fixes - https://phabricator.wikimedia.org/T1040#786015 (10bd808) [21:27:26] 3MediaWiki-Core-Team, Librarization: Clean up @ profile entry handling in xhprof - https://phabricator.wikimedia.org/T1274#786046 (10bd808) [21:33:21] 3MediaWiki-Core-Team, Librarization: Template profiling rewrite - https://phabricator.wikimedia.org/T1258#786058 (10bd808) [21:33:24] 3MediaWiki-Core-Team, Librarization: Create PHP class to make working with XHProf easier - https://phabricator.wikimedia.org/T937#786059 (10bd808) [21:33:27] 3MediaWiki-Core-Team: Fix slow simplify call on some regexes - https://phabricator.wikimedia.org/T1082#786060 (10bd808) [21:35:54] 3MediaWiki-Core-Team, Librarization: Test monolog logging provider in beta - https://phabricator.wikimedia.org/T845#786064 (10bd808) >>! In T845#784869, @bd808 wrote: > Config is live in beta and seems to not be throwing PHP errors to the HHVM log now, but the redis transport seems to still not be working. Next... [21:41:31] AaronSchulz: you should claim your aschulz4587 email in phab :) [21:41:38] AaronSchulz: There is a trivial fix needed in your scopedProfileIn/Out patch. Should I just fix it and then merge? [21:41:40] eg: https://phabricator.wikimedia.org/T65681#710847 [21:44:39] bd808: amended [21:44:41] anybody knows a good way to find out how many entities is in wikibase? [21:45:16] SMalyshev: Database query? Ask in #wikidata ? [21:45:56] Purge hte main page? [21:45:57] "the free knowledge base with 12,873,909 data items that anyone can edit" [21:46:22] Reedy: this is page count, is it the same as entity count? [21:46:36] what exactly do you mean by entity? [21:47:50] Reedy: something like https://www.wikidata.org/wiki/Q42 [21:48:15] legoktm: +2d. [21:48:28] or https://www.wikidata.org/wiki/Special:EntityData/Q42.json [21:48:30] thanks [21:48:57] SMalyshev: so do you mean items? [21:49:05] entities in wikibase terminology also includes properties [21:49:18] legoktm: well, I'd actually like both counts :) [21:49:47] bd808: +1 to "archive" column. [21:49:59] tacotuesday: bueno! [21:50:08] SMalyshev: 16657706 items (select count(*) from page where page_namespace=0;( [21:50:21] legoktm: aha, thanks [21:50:31] SMalyshev: and 1318 properties (page_namespace=120) [21:50:53] thanks, that helps [21:51:23] SMalyshev: do you have access to tool labs? there are database replicas that you can query without needing access to prod [21:52:09] legoktm: nope. That'd help too, in case I need more queries [21:52:10] they have private info redacted though [21:52:19] or maybe I do, but don't know about it :) [21:52:39] http://tools.wmflabs.org/? I have access to it I think [21:52:58] find out, ssh tools-login.wmflabs.org :P [21:57:39] AaronSchulz: Dueling rebases! +2 just waiting on Jenkins. Sorry that took so long. [21:58:43] legoktm: nope, verboten [21:59:26] SMalyshev: ok so fill out https://wikitech.wikimedia.org/wiki/Special:FormEdit/Tools_Access_Request saying "I want to do database queries" and then add your ssh key to https://wikitech.wikimedia.org/wiki/Special:Preferences#mw-prefsection-openstack [21:59:36] once you've filled out the form request, I'll poke someone to approve you [22:00:08] 3MediaWiki-Core-Team, MediaWiki-JobRunner, Beta-Cluster: beta cluster job runner keep running some periodic tasks - https://phabricator.wikimedia.org/T65681#786131 (10hashar) [22:00:56] legoktm: done [22:01:02] legoktm: I have cloudadmin but I don't really know how to use it :/ [22:01:06] 3MediaWiki-Core-Team, MediaWiki-JobRunner, Beta-Cluster: beta cluster job runner keep running some periodic tasks - https://phabricator.wikimedia.org/T65681#786133 (10hashar) [22:02:50] 3SUL-Finalization, MediaWiki-Core-Team: [Bug 72927] Write a maint. script to queue failed page moves due to LocalPageMoveJob breakage - https://phabricator.wikimedia.org/T1055#786135 (10bd808) [22:02:53] 3Release-Engineering, Scrum-of-Scrums, MediaWiki-Core-Team: Performance review BounceHandler extension for Deployment - https://phabricator.wikimedia.org/T1227#786136 (10bd808) [22:02:54] 3MediaWiki-Core-Team: [Bug 62322] Namespaces with diacritics are ignored on search suggestions - https://phabricator.wikimedia.org/T720#786137 (10bd808) [22:03:04] bd808: visit https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Smalyshev and use the "Manage tools users" link? [22:03:18] oh, beaten by andrew [22:03:27] SMalyshev: ok, try ssh'ing in again? [22:03:38] you can also use mosh for tools [22:03:47] yay! now it does it [22:04:42] so for simple CLI access to the db, you just do $ sql wikidatawiki_p [22:04:57] wikidatawiki is the name of the database, and the _p is for the replica [22:05:01] https://wikitech.wikimedia.org/wiki/Help:Tool_Labs/Database has the full docs [22:06:10] weirdest part will probably be the naming scheme, it's typically languagecodeprojectname, except wikipedas are abbreviated to "wiki" (en.wikipedia.org --> enwiki, en.wiktionary.org --> enwiktionary), except for "special" wikis, meta, commons, wikidata, which all have "wiki" as their suffix [22:06:47] legoktm: thanks! [22:06:55] so, internally, all special wikis are wikipedias [22:07:32] Didn't Yuvi make a web interface for running queries too? [22:08:05] http://quarry.wmflabs.org/ [22:08:14] yeah that [22:08:15] still, <3 command line:P [22:09:01] 502 failure on oauth login :( [22:09:30] worked the second time [22:09:56] 3MediaWiki-Core-Team: Teach Cirrus how to interpret error message from too complex regexes and create documentation on simplifying regexes - https://phabricator.wikimedia.org/T1109#786176 (10bd808) [22:09:59] 3MediaWiki-Core-Team: CirrusSearch frwiki rollout - https://phabricator.wikimedia.org/T994#786177 (10bd808) [22:11:28] it had a time limit I think [22:11:31] has* [22:12:56] 3MediaWiki-Core-Team: Search on Commons times out, keyword incategory does not work - https://phabricator.wikimedia.org/T927#786188 (10bd808) [22:12:59] 3Phabricator, MediaWiki-Core-Team, Librarization: Create Librarization project - https://phabricator.wikimedia.org/T754#786189 (10bd808) [22:13:01] 3MediaWiki-Core-Team: FileRepo temp zone cleanup - https://phabricator.wikimedia.org/T769#786190 (10bd808) [22:14:41] I get 502 Bad Gateway when I try to use quarry [22:15:26] Yeah I did too. The next time I tired it let me in. [22:15:36] I wonder if the ssl proxy is sick? [22:15:48] yeah looks like it checks if I really mean it or just kidding around [22:17:27] * bd808 poked Yuiv about it in #-labs [22:17:35] *Yuvi [22:18:48] morning [22:18:49] 3MediaWiki-Core-Team: CirrusSearch zhwiki rollout - https://phabricator.wikimedia.org/T995#786203 (10bd808) [22:18:51] 3MediaWiki-Core-Team: [Bug 72568] Delete option button goes off to infinity - https://phabricator.wikimedia.org/T930#786204 (10bd808) [22:18:54] 3MediaWiki-Core-Team: Deploy statsd plugin for beta elasticsearch. - https://phabricator.wikimedia.org/T711#786205 (10bd808) [22:19:31] 3MediaWiki-Core-Team: [Bug 72576] When translations are changed on control wiki the change should be updated on jump wikis - https://phabricator.wikimedia.org/T1270#786207 (10bd808) [22:19:39] 3MediaWiki-Core-Team: Write a maint. script to rename all users during the SUL finalization - https://phabricator.wikimedia.org/T728#786208 (10bd808) [22:19:41] 3MediaWiki-Core-Team: [Bug 72123] Add a maintenance script to send mass messages - https://phabricator.wikimedia.org/T732#786209 (10bd808) [22:20:46] Hey TimStarling. I haven't heard any screaming today so I think dissolving the hhvm app server pool has gone well so far. [22:21:00] * bd808 knocks on his wooden head [22:21:22] good [22:21:33] it makes me a bit nervous when we don't really have any way to roll back [22:21:56] *nod* [22:22:03] reimage I guess [22:22:08] but that's not fast [22:23:20] 3MediaWiki-Core-Team: Run maintenance script to clean up duplicate rows in iptables - https://phabricator.wikimedia.org/T931#786219 (10bd808) [22:23:22] 3MediaWiki-Core-Team: [Bug 67521] Suggest results which differ in diacritics (missing ascii normalized lookup) - https://phabricator.wikimedia.org/T722#786220 (10bd808) [22:23:25] 3MediaWiki-Core-Team: Backport regex fix to wikimedia-extra Elasticsearch plugin - https://phabricator.wikimedia.org/T1038#786221 (10bd808) [22:23:41] only 29 more tasks to move and make notification spam :/ [22:26:33] 3MediaWiki-Core-Team, MediaWiki-JobRunner, Beta-Cluster: beta cluster job runner keep running some periodic tasks - https://phabricator.wikimedia.org/T65681#786226 (10hashar) [22:34:01] 3MediaWiki-Core-Team: [Bug 73464] PHP notice in hhvm.log from API - https://phabricator.wikimedia.org/T1297#786261 (10bd808) [22:34:04] 3MediaWiki-Core-Team: Upstream limit memory usage of Lucene's Automata during determinization - https://phabricator.wikimedia.org/T1037#786262 (10bd808) [22:34:05] 3SUL-Finalization, MediaWiki-Core-Team: Refactor page move logic so it doesn't interfere with global rename - https://phabricator.wikimedia.org/T727#786263 (10bd808) [22:34:30] bd808: we could have just quieted the bot... [22:34:50] there's still time! [22:35:18] tacotuesday is +f [22:35:35] no Thehelpfulone :( [22:35:57] tacotuesday: can you tell wikibugs to stfu for a bit while I finish moving things? [22:38:57] 3MediaWiki-Core-Team: [Bug 72574] Allow jump-text to be set at poll creation - https://phabricator.wikimedia.org/T1104#786272 (10bd808) [22:39:00] 3MediaWiki-Core-Team: [Bug 72575] Carry over election Title msg to jump wikis - https://phabricator.wikimedia.org/T1105#786273 (10bd808) [22:39:03] 3MediaWiki-Core-Team: Backport regex fix to experimental-highlighter Elasticsearch plugin - https://phabricator.wikimedia.org/T1039#786274 (10bd808) [22:46:01] _joe_ / ori: anyone working on the PCRE issue on osmium? I'm about to fix it [22:50:33] 3MediaWiki-Core-Team: Review subcategory query proposals - https://phabricator.wikimedia.org/T748#786311 (10bd808) [22:50:36] 3MediaWiki-Core-Team: Review Wikidata query service doc (WikiGrok) - https://phabricator.wikimedia.org/T812#786312 (10bd808) [22:50:37] 3MediaWiki-Core-Team: Prevent nasty regexes from crushing Elasticsearch - https://phabricator.wikimedia.org/T1013#786313 (10bd808) [22:57:02] 3MediaWiki-Core-Team: CirrusSearch dewiki rollout - https://phabricator.wikimedia.org/T996#786359 (10bd808) [22:57:06] 3MediaWiki-Core-Team: Fix list=deletedrevs - https://phabricator.wikimedia.org/T852#786360 (10bd808) [22:57:09] 3MediaWiki-Core-Team: [CirrusSearch] Finish deploying accelerated regexes - https://phabricator.wikimedia.org/T735#786363 (10bd808) [23:03:29] 3MediaWiki-Core-Team: Re-run setZoneAccess and possibly prune temp dir - https://phabricator.wikimedia.org/T811#786389 (10bd808) [23:03:31] 3MediaWiki-Core-Team, Librarization: Refactor database profiling - https://phabricator.wikimedia.org/T1117#786390 (10bd808) [23:03:34] 3SUL-Finalization, MediaWiki-Core-Team: [Bug 70850] Not possible to filter Special:Log/gblrename by old CentralAuth account name - https://phabricator.wikimedia.org/T733#786391 (10bd808) [23:06:49] 3MediaWiki-Core-Team: GlobalUserPage perf review - https://phabricator.wikimedia.org/T936#786419 (10bd808) [23:06:51] 3MediaWiki-Core-Team: Cut new Cirrus release against 1.23 and 1.24 - https://phabricator.wikimedia.org/T964#786420 (10bd808) [23:06:54] 3MediaWiki-Core-Team: Perf review of BounceHandler - https://phabricator.wikimedia.org/T726#786421 (10bd808) [23:13:26] 3MediaWiki-Core-Team: Re-juggle shard and replica counts in Elasticsearch - https://phabricator.wikimedia.org/T999#786431 (10bd808) [23:13:28] 3MediaWiki-Core-Team: Use BloomFilter for more LogPage queries - https://phabricator.wikimedia.org/T985#786432 (10bd808) [23:13:31] 3SUL-Finalization, MediaWiki-Core-Team: [Bug 70380] GlobalRename: check with global AntiSpoof and warn about possible collisions - https://phabricator.wikimedia.org/T734#786433 (10bd808) [23:24:44] 3MediaWiki-Core-Team: [Bug 73219] wl_notificationtimestamp field is not copied on page moves - https://phabricator.wikimedia.org/T1202#786507 (10bd808) [23:24:47] 3MediaWiki-Core-Team: [Bug 65724] Chunked upload of SVGs triggers INVALIDXML exception, but file is valid - https://phabricator.wikimedia.org/T1106#786508 (10bd808) [23:24:57] legoktm: ^ ack [23:25:19] bd808: probably https://phabricator.wikimedia.org/T1204#20856 [23:25:26] er wait [23:25:26] https://phabricator.wikimedia.org/T75710 [23:25:28] that one [23:26:03] waiting on a patch to phab to be deployed [23:26:18] hrm. ok [23:26:41] only 6 left. ima gonna go for it [23:26:49] 3Librarization, MediaWiki-Core-Team: Document project plan for Librarization Q2 project - https://phabricator.wikimedia.org/T713#786515 (10bd808) [23:26:53] 3MediaWiki-Core-Team: Split hitcounters patch - https://phabricator.wikimedia.org/T723#786518 (10bd808) [23:26:54] 3MediaWiki-Core-Team: [Bug 71597] Review and deploy IEG grant review application - https://phabricator.wikimedia.org/T718#786519 (10bd808) [23:26:56] 3MediaWiki-Core-Team: Finish moving beta elastic nodes to trusty - https://phabricator.wikimedia.org/T708#786520 (10bd808) [23:26:58] 3Phabricator, MediaWiki-Core-Team: Create core-team project for MW Core Team - https://phabricator.wikimedia.org/T649#786521 (10bd808) [23:27:37] 3MediaWiki-extensions-WikidataClient, Wikidata, Scrum-of-Scrums, MediaWiki-Core-Team: Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached - https://phabricator.wikimedia.org/T58602#786525 (10bd808) [23:31:35] manybubbles: where is that gremlin import xml you had? [23:32:24] 3Librarization, MediaWiki-Core-Team: Give CDB library a nice README - https://phabricator.wikimedia.org/T1313#786542 (10bd808) 5Open>3Resolved a:3bd808 The readme looks pretty good to me now. More improvements are of course welcome. [23:35:11] ah, https://github.com/nik9000/wikidata-gremlin/blob/master/pom.xml [23:51:35] legoktm: Huh +f? [23:51:43] here! [23:51:49] you're the founder! [23:51:50] * tacotuesday is irc noob [23:52:21] well, I fixed the bot [23:54:06] I just spent the last 45 minutes in a line buying a ham. [23:55:20] :< [23:55:31] lines that long? [23:56:04] Don't you SF folks have an app that buys ham for you and has drone drop it off in your fridge? [23:56:23] If not, I smell a market opprotunity [23:57:27] I'm sure lines are shorter at safeway. [23:57:35] But I wanted a honey baked ham :) [23:58:59] OMG EMO [23:59:08] good ham is worth a wait [23:59:31] AaronSchulz: pom just tells mvn how to build the groovy files into a jar so it can be embedded in a gremlin compatible server. but, yeah, that is the gremlin stuff I was working on. Its pretty hacky.