[00:46:02] legoktm: where does @default for seccomp come from? [00:46:12] I get a warning about it not being recognized [00:55:14] the manpage suggests using the defaults is just --seccomp and --seccomp=foo,bar automatically adds the defaults [01:09:10] tgr: https://firejail.wordpress.com/features-3/man-firejail/ lists @default, what firejail version are you using? [01:09:15] (it works for me) [01:09:30] 0.9.44.6 [01:09:44] the one apt installs on vagrant [01:10:03] I'm on 0.9.52 [01:11:44] https://github.com/netblue30/firejail/commit/34ee8e03f58c4c51c3aa29f553e06570d0654db2 I think [01:12:20] so 0.9.50 [01:12:33] stretch-backports has that, but are you still on jessie? [01:12:41] you could also build it yourself, it has no dependencies [01:14:38] hmm but we're using --seccomp=@default in production, and that has 0.9.44 [01:15:05] I don't think it breaks anything, it just gets ignored [01:15:26] that's not really great either... [01:15:54] I'll ask moritz to backport 0.9.50+ [01:16:02] the manpage suggests the defaults always get applied on .44 anyway, unless you use seccomp.keep or something like that [01:16:23] I'm trying to find an easy way to test seccomp, but not much luck so far [01:16:57] lilypond uses the execve syscall, I tested with that [01:17:15] yeah, execve is easy to test [01:21:18] I gotta go afk now, I'll make sure to follow up on the @default usage [01:21:38] thanks for taking a look at the patches [01:29:12] (I'm using vagrant, which is on jessie, yes. Not for long though.) [02:20:29] tgr: thanks :) [12:32:36] DanielK_WMDE_: addshore: Yay re MCR patch being merged. I reviewed part of it yesterday but didn't get around to submitting my comments. I just submitted them and they're mostly about incorrect doc comments [12:32:49] RoanKattouw: awesome! [12:33:00] I can file some followups today [12:33:07] I think Daniel is mostly off not until the new year [12:33:23] OK cool [12:33:37] Also did you want to do some lag experiments in beta? [12:34:12] so I dont think it is really needed, the 250 -> 500ms lag there always is between the master and slave seem enough to reproduce things needed [12:34:21] I also setup a master and replica on my local setup now :) [12:35:12] there were a couple of issues with the patch I fixed last night after testing on beta, the one remaining issue is fixed with https://gerrit.wikimedia.org/r/#/c/399795/ and https://gerrit.wikimedia.org/r/#/c/399764 [12:36:15] OK cool [12:38:06] Once that lands on beta I'll do a bunch more testing on all the sites [12:39:20] I just +2ed both [12:51:30] whee [12:51:59] and scap has just finished running! :D [12:52:07] *goes to test it again* [12:54:52] Yup, that issue is resolved, woo! [12:54:57] this patch might stick this time :D [13:00:42] meh, found another bug! [13:01:22] very similar [13:04:59] https://phabricator.wikimedia.org/T183548 [14:28:46] RoanKattouw: https://gerrit.wikimedia.org/r/#/c/399812/ is similar to the other one you just merged [15:34:31] o/ DanielK_WMDE_ [15:34:39] Could I ask a quick Q about multi-content revisions? [15:35:07] I'm thinking about creating a page that has an arbitrary number of "contents" with their own independent histories. [15:35:28] Does that fit? Or is there a fixed number of "contents" per page? [15:50:21] halfak: I think DanielK_WMDE_ might be off for the holidays already but addshore might still be around [15:50:42] Thanks RoanKattouw :) [15:51:14] RoanKattouw, some time after the holidays, I'd really love to have you walk me through flow's 0.5 implementation of suppression. [15:51:22] I want to learn from your experience. :D [15:52:26] It's a 0.5 implementation of versioning in general and it's a can of worms that's not great to open [15:52:35] And yeah I'd be happy to talk to you about it some time [15:53:19] Good (short) reading in the meantime if you haven't already seen it: https://www.mediawiki.org/wiki/Everything_is_a_wiki_page [15:53:24] great! Yeah, I just want to examine the can. We can leave it closed :D [16:19:59] halfak: that doesnt sound like it fiyts [16:20:01] *fits [16:20:35] For MCR there will be a single history / collection of revisions for ALL slots of a page [16:20:47] but each revision has multiple slots [16:20:59] Sure. Each slot has it's own history though, right? [16:21:14] also arbitrary number of "contents" also doesn't rally sound like it fits well [16:21:58] Sounds like "slots" is the right term [16:22:12] halfak: I mean, yes, kind of, but when your looking through mediawiki, you have the page history, and in there each slot of a revision can remain the same between different page revisions [16:22:15] Arbitrary as in, some pages will have 5. Others will have 2. [16:22:29] halfak: so the slots of designed to have names [16:22:40] Yeah. they [16:22:42] 'd be named [16:23:32] E.g. revision/1234 would have slots "article quality", "draft quality", or "topic" [16:23:36] I mean, anything is possible right ;) [16:23:47] addshore, just trying to figure out the data model of MCR [16:23:58] halfak: yes, that seems possible, and probably in the list of use cases it's designed for [16:24:01] I've get to see a diagram of the shape. [16:24:04] *yet [16:24:12] addshore, interesting :) [16:24:14] *goes to search for a diagram* [16:24:18] Thanks :) [16:25:04] mhhm, cant find a diagram right now! [16:26:16] Ok no worries. I can dig later. Let me not totally side-track you :) [16:26:20] Thanks for your help :D [16:31:39] relevant to what I'm thinking: https://www.mediawiki.org/wiki/JADE/MCR_example/Revision/1234 [16:32:00] I've used sub-page transclusions to mimic multi-content revisions. [16:32:28] halfak: The high-level idea of MCR is that things you would now have separate pages for won't have to have separate titles in MCR. And the same for stuff that's weirdly embedded in wikitext to avoid having a separate page. For example, a template and its /doc subpage and its TemplateData, or an article and its metadata like which categories it's in. [16:33:18] anomie, in my case, there would be no main page that has peripheral content. Does that make sense in MCR? [16:33:49] halfak: But it probably doesn't make a whole lot of sense to separate one small structured data Content blob across several slots, particularly when the set of slots isn't well-defined. [16:34:39] anomie, slots isn't well-defined? [16:34:55] By "isn't well defined", you have wp10 and draft_quality on there now, but I've seen you add and remove similar things from ORES as needs change. [16:35:05] anomie, never removed [16:35:17] Added as needs arise. Then they continue forever [16:35:33] Ok, s/remove/stop using/ [16:35:41] never stop using [16:35:47] :/ [16:35:52] Not sure what you've been seeing [16:36:38] Maybe I'm mistaken then. But you could, if you decide one of your topics isn't useful anymore. [16:36:54] (I'm sure "topics" is the wrong word) [16:37:09] So the different sub-pages in this case implement different schemas. they're JSON. So I'd want to validate them with different JSON schemas [16:37:46] Each "namespace" (in this case "Revision") would have a set of slots coupled with JSON schemas. [16:38:16] In your example they're both just trivial strings. [16:38:55] anomie, they aren't just trivial strings. The third is an array of strings. They will be based on a limited set of potential values. [16:39:09] anomie: do you want to meet today? [16:39:09] Also, i'm not sure why that is relevant. [16:39:33] FWIW, the JSON schemas *will* be relatively simple. [16:39:39] In most cases. [16:41:01] bd808: Ugh, my reminder didn't go off. If it's ok with you, let's skip it this week. [16:41:18] anomie: okey doke. Have a good break! [16:45:23] Another example: https://www.mediawiki.org/wiki/JADE/MCR_example/Edit/1234 [16:46:10] RoanKattouw: Another one https://gerrit.wikimedia.org/r/399838 [17:47:34] addshore: Ahm... another one? https://en.wikipedia.beta.wmflabs.org/wiki/Sandbox [17:47:43] [Wj1FJApEE4AAAEx7hZEAAAAF] /wiki/Sandbox Wikibase\DataModel\Services\Lookup\EntityLookupException from line 44 of /srv/mediawiki/php-master/extensions/Wikibase/lib/includes/Store/RevisionBasedEntityLookup.php: Failed to unserialize the content object. [17:47:53] interesting, I havn't seen that one before [17:48:06] at a guess, because it is the sandbox, it has some very old revisions in [17:50:09] hmm, wait, that has Wikibase in the stacktrace [17:50:23] Yes, also the exception is a Wikibase exception [17:53:03] RoanKattouw: shall I file a task or do you want to? :) [17:54:25] RoanKattouw: right now I think the best course of action is leave it in master and revert the changes in the branch before the train at the start of jan [17:54:27] no_justification: ^^ [17:54:45] Agreed [17:54:48] IMO having this time on beta is very valuable [17:55:16] It would be nice to be able to wrap it all in a switch, but due to how tangled it all is that s a bit tricky. [17:55:50] I'm around all over the christmas period and am going to keep jabbing violently at beta, and will be around to do the revert for the first train too [18:03:56] I'll keep a list of patches to revert (currently standing at 8) and applying cleanly [18:06:42] Infact, I'll keep that @ https://wikitech.wikimedia.org/wiki/User:Addshore/MCR_Revert :) [18:23:42] > mw.config.get( 'wgContentLanguage' ) [18:23:44] 'deployment' [18:23:49] Dear beta labs, WTF [18:23:53] Sincerely, Roan [18:24:27] addshore: You file the task, I'm in a task-filing stack three levels deep in VisualEditor right now [18:27:06] RoanKattouw: what is "beta labs"? ;) [18:27:23] betatoolclusterforgelabs [18:27:48] RoanKattouw, s/labs/cluster/ [18:27:55] oh, you mean the deployment-prep Cloud VPS project :) [18:28:27] * bd808 is snarky today [18:28:44] * subbu maybe shouldn't have made the drive by comment after just paging into the channel .. but was trying to be helpful :) [18:28:46] RoanKattouw: will do [18:40:09] addshore: is feature flag not an option? [18:40:49] legoktm: I mean, in theory yes, it could be rather messy and tangle [18:40:51] *tangled [18:41:28] If its temporary I think its okay... can't be messier than $wgDisableAuthManager [18:41:45] could load alternate Revision classes based on the flag, and then wrap all the other logic changes in the flag [18:41:52] I'm happy to try and write up a patch for it :) [18:42:08] Just fixing up https://gerrit.wikimedia.org/r/#/c/399856/ now [18:44:12] subbu: While you're here [18:44:17] I found a fun bug [18:44:25] $ echo '

' | bin/parse.js --html2wt --prefix mediawikiwiki [18:44:26] {{Echo|}} [18:44:34] Note the missing |1= [18:44:51] addshore: are you planning to be working next week? [18:44:56] yup [18:45:24] If you remove the , the 1= comes back [18:48:12] RoanKattouw: finally filed it as https://phabricator.wikimedia.org/T183583 [18:48:50] right, feature flag time :D [18:48:57] DanielK_WMDE_: ^^ FYI [18:49:17] subbu: (Filed as T183584) [18:49:18] T183584: Parsoid incorrectly serializes (html2wt) templates with named parameters containing equals signs (=) and angle brackets (<>) - https://phabricator.wikimedia.org/T183584 [18:49:50] RoanKattouw, thanks for the bug report .. we'll take a look. [18:51:16] Thanks. It probably doesn't happen very often. [18:51:20] The bug, I mean [18:52:27] legoktm: default with MCR off i guess? worth removing the REL notes or leave them there for now? [18:52:46] Default with on [18:55:47] RoanKattouw, right, if it had, we would have heard about it by now :) we have code to detect the presence of '=' in tpl args and use the N=arg format .. but i think that code probably over-optimistically assumes that html-tags will be parsed atomically in transclusions (although that is probably a reasonable / better way to parse transclusions) [18:56:02] We've replaced "labs labs labs" with "ha ha you forgot the new name" :/ [18:56:34] legoktm: okay! :) [18:57:56] addshore: So, change of plan, you're not going to prepare a series of reverts for wmf.15 but instead you're introducing a feature flag? [18:58:05] Do I understand that correctly? [18:58:43] well, i have the reverts, but I'm going to see if I can do the feature flag this evening [18:59:15] If I can and it isn't horrible, then we can run with that :) [19:01:27] I just emailed wikitech-L with an update [19:01:32] now going to have pudding [19:02:44] addshore: FYI, you broke a bunch of tests when $wgCommentTableSchemaMigrationStage is not MIGRATION_OLD again. You can probably look for where I had to add that in https://gerrit.wikimedia.org/r/#/c/380669/. [19:03:20] anomie: can we have jenkins run the tests with all three migration modes? [19:03:42] legoktm: that would be something similar to what we now have for the contentmodel switch [19:04:12] legoktm: Four: MIGRATION_OLD, MIGRATION_WRITE_BOTH, MIGRATION_WRITE_NEW, and MIGRATION_NEW. I don't know how we'd go about that, but I'm sure it's theoretically possible. [19:04:22] anomie: it should just be a case of forcing the tests to run with a specific global using setMwGlobals [19:05:17] legoktm: anomie for contentmodel in revision we made https://github.com/wikimedia/mediawiki/blob/master/tests/phpunit/includes/RevisionDbTestBase.php and https://github.com/wikimedia/mediawiki/blob/master/tests/phpunit/includes/RevisionNoContentHandlerDbTest.php for example [19:05:25] Let me clarify: "I don't know how we'd go about that without a bunch of crazy hacks in MW's unit testing" [19:05:38] we can do what we do in PreprocessorTest, let me find it [19:06:53] anomie: https://phabricator.wikimedia.org/source/mediawiki/browse/master/tests/phpunit/includes/parser/PreprocessorTest.php;63c30080f550da8ddaad1b9522560f5279e2dda4$44 and instead of the class name, it would be the different global setting, and each test case would do $this->setMwGlobals [19:07:21] addshore: I don't think we'd want to do that for the tests of everything that touches the comment table, though. And soon the actor table too. [19:08:06] anomie: well, in theroy we only need to update the tests when we update DefaultSettings.php to change the value [19:08:34] If users change config settings to break tests there isn't really anything we can do [19:09:46] addshore: We can write the tests to use setMwGlobals to set the needed values, or make what the tests check adapt, or avoid checking the things that vary if they're not part of what's actually being tested. [19:10:13] legoktm: Same response: I don't think we'd want to do that for the tests of everything that touches the comment table, though. And soon the actor table too. [19:13:25] hm right [19:36:31] Krinkle: ideally I'd like to get the @covers validator patch merged, then when I run libraryupgrader against everything for the MediaWiki-CodeSniffer upgrade, we'll spot any other failing extensions [21:40:46] DanielK_WMDE: Regarding mwjames's comments on https://gerrit.wikimedia.org/r/#/c/399445/, I wouldn't put it past SemanticMediaWiki to be doing "CREATE TEMPORARY TABLE" calls on a DB_REPLICA handle... [21:41:02] lol [22:05:14] hehe. well. *that* would break. [22:05:27] but not for the reason he quoted [22:06:15] anomie: I have been wondering whether we should make the wrapping optional, and only enabled it in unit tests per default. [22:07:04] it's a breaking change, in that it merans getConnection doesn't return a Database instance in all cases. I fixed a few extensions, but I suspect there may be more that type-hint against Database (or DatabaseBase) instead of IDatabase. [22:07:04] DanielK_WMDE: Considering the Beta Cluster bug, I'd say keep the default the same everywhere. [22:07:16] hmhm... [22:07:53] well, the wrap logic is irrelevant to beta, since it uses real replicas. the wrapper is only for when you get a master connection when asking for a replica [22:43:02] somebody should tell mwjames that temp tables created on mariadb/mysql hosts under replication mess everything up [22:43:55] per jaime in https://phabricator.wikimedia.org/T179628#3788031