[08:38:22] 10Quarry: Do the big Quarry migration - https://phabricator.wikimedia.org/T202588 (10zhuyifei1999) > Backup sql db and resultset folder of legacy live main instance I'm pretty sure the results live on NFS, so there isn't really a need to back this up. [08:49:23] halfak: have fun at opensym! [08:49:44] Lucie just sent me a picture of your hillarious slide about the addbot :p [09:28:05] addshore, :D [09:28:09] The Darkest Day in Wikipedia's robot history! [09:28:14] The keynote was well received. [09:28:24] I'll upload a video ASAP. [09:35:21] :) [18:56:07] bmansurov_: are you around? [18:56:13] leila: o/ [18:56:48] bmansurov_: hi. sooo, I'm going to finalize the survey questions for eliciting new editor interests. Do you have some time for that today, to start sending out a subset of emails? [18:56:59] leila: sure [18:57:36] bmansurov_: the first thing you can do is to check the zip file to make sure you know from which file you should pull out the matchings (there are three files in there;) [18:58:14] leila: ok, i'll take a look [18:58:31] bmansurov_: please confirm but I read that user_to_matches_k.json is the main file you should use. [18:58:53] ok [19:41:07] bmansurov_: can you review https://meta.wikimedia.org/wiki/Research:Voice_and_exit_in_a_voluntary_work_environment/Elicit_new_editor_interests#The_matching_email and let me know if it needs more clarity in steps? [19:49:52] leila: all clear [19:56:50] bmansurov_: let me know if you need anything from me then. [19:57:28] leila: I'll send out test emails later today and would like to see if you got them [19:57:42] leila: if all is good, then I'll send the first 10% [19:57:52] I'll ping you here once I send those emails [19:58:17] bmansurov_: sure. thanks. [22:07:45] leila: I've just sent out test emails. Did you receive yours? [22:08:25] bmansurov_: checking [22:09:24] bmansurov_: I have the email,but there is a problem with the link for contacting the users. we have to provide the Email this user link [22:09:30] * leila updates the page on meta [22:09:38] ok [22:11:58] bmansurov_: I fixed that on meta. let me read the rest of the email as well. ;) [22:12:11] ok [22:15:12] bmansurov_: I fixed an error on the meta page (typo). the rest looks good to me (and all links work. :D) [22:15:35] ok, I'll send the updated version as a test. [22:15:47] yup [22:18:00] leila: sent [22:19:19] * leila checks [22:20:00] bmansurov_: all good. [22:20:21] leila: ok sending this out to 38 users [22:20:33] bmansurov_: yup. thanks. [22:20:39] ;) [22:20:57] :D [22:26:44] leila: found out that some users entered their non-wiki name [22:27:04] leila: which means we cannot locate them from the send email page [22:27:04] bmansurov_: where? [22:27:16] leila: in the list of users we got from Ramtin [22:27:36] ow man! [22:27:36] :D [22:27:51] bmansurov_: what percentage? [22:28:04] leila: can't tell, just checked someone randomly [22:28:18] did you send any of the real emails out? [22:28:23] leila: not yet [22:28:55] bmansurov_: good. ;) let's see. Can you cross check the usernames they have provided with the list of possible usernames to get a sense of percentage? [22:29:05] leila: sure [22:29:18] thanks. (a gigantic mess avoided.;) [22:34:47] bmansurov_: independent of the percentage and unless we get really lucky, we have to ask Ramtin to re-run the matching. :/ [22:35:12] leila: k [22:35:33] bmansurov_: but of course, let's see the numbers. anyway you should tell him which usernames need to be excluded. [22:39:57] leila: 46% missing [22:40:05] bmansurov_: ohoh! [22:40:17] are you doing case-sensitive regex? [22:40:48] leila: just comparing string equality [22:41:36] leila: let me lowercase everything and then compare [22:41:44] bmansurov_: right. just to be sure, if you, for example, convert all strings from both sets to lower case and compare, it's fine. I want to make sure we don't do case-sensitive checks [22:41:46] yeah [22:42:36] bmansurov_: retrospect: we should have asked for their emails, too, just in case. [22:42:42] :D [22:42:50] yeah [22:43:35] leila: lowercasing everything I get 19% missing [22:44:06] bmansurov_: phew [22:44:06] :d [22:44:20] can you pass that 19% to me over email? [22:44:28] leila: ok [22:44:53] bmansurov_: I can do an eyeballing and see if there are some obvious ones we can catch. because of the nature of consent, I doubt we can save much of them. I can't read that much into similarities. [22:46:22] leila: yeah there are some obvious ones such as email addresses and ~~~~ [22:46:26] leila: just emailed you the list [22:46:50] * leila checks [22:50:27] leila: i'll be back later [22:50:35] in about 45mins [22:51:08] bmansurov_: actually, I was about to email. I don't think we can do much at the moment. I'll contact Legal to ask how we can handle this, and I'll also check with Ramtin. [22:51:20] leila: ok [22:51:26] bmansurov_: we should pick this up tomorrow again as those conversations need time to converge. Thanks for pushing it this far today. [22:51:46] leila: sounds good [22:51:51] have a good one [22:55:26] bmansurov_: thanks. you, too.