[00:01:41] K4-713: anyway, so for helping other orgs, that's a Z+M thing? (now just M?) [00:02:00] Actually, now it's L+M. [00:02:09] who dat? [00:02:13] But, probably mostly M. [00:02:19] L = Lisa Gruwell. [00:02:23] aha [00:02:59] i think this is an appropriately off-season time to work on it :) [00:03:10] Ha. We don't have off-seasons anymore. [00:03:33] oh, because of the spring/summer testing for non-US? [00:03:51] Yeah... "testing" is sort of a misnomer. Sort of. [00:04:00] well and the "shortening" [00:04:09] "test" is sort of a synonym for "campaign" for us. [00:04:56] well i guess the difference is sometimes you could be doing something you already know is going to do well [00:05:04] and sometimes you're doing it as a real test [00:05:17] and sometimes you're doing a small sample and sometimes a larger sample [00:06:10] Yeah... we don't really make the distinction these days. [00:06:40] Usually, what it looks like is: We start out with things that re-test assumptions of goodness, against both old and new ideas. [00:07:05] And then, the best performers experience a bunch of tuning phases... [00:07:20] ...which are then tested against our old ideas to make sure they're actually better... [00:07:27] ...and repeat until the campaign is done. [00:07:48] So, I guess a campaign is probably more like a series of tests. [00:09:13] I think part of the reason there hasn't been a publication of a rigid process, is that it's pretty... what's the word? [00:09:27] "Organic", maybe. [00:14:02] hmmmmmmmmmmm [01:03:36] jeremyb: I'm afraid that at any given time your only option to understand what's going on is V [01:03:39] * https://meta.wikimedia.org/wiki/Special:CentralNotice [21:46:10] Nemo_bis: FR people have written some analysis of various a/b tests. i think. i was hoping some were already on wiki. even better would be if there were all linked from some central place [21:46:15] * jeremyb just found https://meta.wikimedia.org/wiki/Fundraising/Wild_Ideas#Why_Do_Green_Backgrounds_Work.3F_.28untested_theories.29 [22:14:12] jeremyb: isn't that quite old [22:14:27] so?