[00:00:15] well, back to the forensics lab... [00:00:27] indeed! [00:00:43] (the queries courtesy of Ellery via e-mail) [00:09:03] ejegg: awight: cwd: XenoRyet: atgo: new code is live! [00:09:18] Good times [00:09:27] * cwd logs out of WP [00:09:55] I guess we need to hack a waitcookie in waitdate state [00:16:05] ejegg: awight|cave: cwd: no issues so far it seems? [00:16:23] nope, been messing with the cookie and it seems to do as expected for each case [00:16:34] AndyRussG: nothing forward facing i can see [00:16:57] AndyRussG: also, I ran another query on mobile pv vs impressions, but grouping by browser family [00:17:18] ejegg: ah! and....? [00:17:40] mobile safari and chrome have beacon requests at 76-77% [00:17:59] 'android' old browser 52% [00:18:18] IE zero (vs 64795 pv) [00:18:29] firefox 1% [00:18:34] opera mini 2% [00:18:58] 'other' .08% [00:19:01] ejegg: there's a thing to concatenate browser family and major version number, and group on that [00:19:05] does that FF # seem weird? [00:19:09] 65 vs 76,207 [00:19:22] ejegg: can u post ur data? [00:19:40] yah, remind me where the etherpad is? [00:19:44] (careful about private info tho) [00:20:23] Yeah, this is just counts, and I'll cut it off at <5000 pv in that hr [00:20:23] ejegg: https://etherpad.wikimedia.org/p/FR_unsolved_mysteries [00:20:25] not updated [00:20:27] thanks! [00:21:22] ejegg: so grouping by browser family + major version number, I didn't look for the possibility of somehow "sometimes" not sending the beacon [00:21:24] AndyRussG: also, is there any sense in looking at LoadBanner page views? [00:21:57] I just compared ones that were sending no beacon, assuming that a browser (family + major version) sends a beacon, it always does [00:22:01] That assumption may be off [00:22:08] ejegg: re: LoadBanner pageviews, yes fer sure! [00:25:39] oh hey, of course IE and BB have zero beacons - that query's only using device (ipad, iphone, android) [00:25:44] i'm gonna take off for awhile, but i'll be back later to beat my head against the civi install some more [00:25:48] congrats on the deploy! [00:26:10] cwd|afk: thx! cya!! :) [00:27:22] Checked on mobile, all seems good [00:49:05] hey AndyRussG! how's the impressions thang? [00:50:31] atgomez1: patch seems to be working as intended! [00:50:50] atgomez1: yeah all deployed, all good so far :) [00:51:01] awesome! any news on the mobile front? [00:51:15] Expect finally that people who got stuck in waitdate will now start getting banners again [00:51:21] I'm looking at data, just now wondering if filters for pageviews and impressions are getting way different counts for mobile [00:51:22] awesome, that's great [00:51:33] ejegg: ? [00:52:06] AndyRussG: impressions is filtered on ... 'QUERY', 'device') in ('iphone', 'ipad', 'android') [00:52:24] and pv is filtered on access_method = 'mobile web' [00:52:56] I'm trying a query now with both filtered on user_agent_map('os_family') in('Android','iOS') [00:53:39] atgomez1: exec summary: there is also a discrepancy between pageviews and calls to /beacon/impression (formerly Special:RecordImpression) on the desktop, but it's apparently less. Forensics lab is open. New ideas on possible causes of the discrepancy: bots that are not correctly detected as such by analytics code, and maybe something odd about the pageview definition [00:53:55] ejegg: so banners don't run on the "unknown" device [00:54:44] Hmmm it's true, desktop browsers browsing the mobile site don't get banners [00:55:41] Though from the beakdown of devices just not getting banners, since that seemed to add up only to 4% of total pageviews, it seemed like "completely unbannered" devices can't account for too much of the discrepancy [00:55:57] atgomez1: so in sum, the jury is still out, but we're learning a lot :) [00:56:10] atgomez1: I was gonna send an e-mail about the deploy [00:56:59] ah, hmm, so how do we filter out 'unknown' device from pageviews? [00:57:35] Well, my computer and phone are both about to die, and folks are telling me to quit staring at screens... [00:57:52] might play with data more over the wkend [00:58:08] but for now, this is see ya later! [00:58:23] ciao ejegg [00:58:34] so.. it sounds like we still basically don't know what's going on with mobile? [00:58:51] but we *thinik* maybe we're not under-serving [01:00:53] ejegg|away: thx cya!!!! :) [01:01:13] atgomez1: correct. Or at least, not under-serving tooo much. [01:01:22] There are still quite a lot of things we can try [01:01:37] ok. [01:01:51] atgomez1: the check-in with Ellery was cool. He continued to fiddle w/ more stuff after the call and check in via e-mail BTW [01:01:56] awesome, great [01:02:00] Fundraising Sprint Zapp, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Unplanned-Sprint-Work: Need to see UTM Source/UTM Campaign in Civi - https://phabricator.wikimedia.org/T121284#1874825 (CaitVirtue) @atgo All I understand in Adam's comments is "a backfill script would be easy to write."... [01:04:42] AndyRussG: thanks in advance for the update to the team. If you could please also include clarity around the decision to leave the mobile campaign up, that would be great :) [01:05:58] atgomez1: ah K sure... were there lots of doubts about that? [01:07:07] Fundraising Sprint Zapp, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Unplanned-Sprint-Work: Need to see UTM Source/UTM Campaign in Civi - https://phabricator.wikimedia.org/T121284#1874831 (atgo) @caitvirtue - the donations are being tagged with the Campaign, just not in a way that we're ab... [01:07:54] AndyRussG: it's just always good to address potential concerns head on :) [01:08:32] i think megan is worried that we're possibly hurting our potential by leaving things up now while we debug, but if we're confident that's not the case i just think we should be proactive [01:10:36] atgomez1: K [09:07:44] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Decompose the Silverpop export into general bookkeeping jobs - https://phabricator.wikimedia.org/T121304#1875109 (awight) NEW [09:34:06] (CR) Awight: "abandoned?" [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/195200 (https://phabricator.wikimedia.org/T91763) (owner: AndyRussG) [18:48:44] Fundraising-Backlog: Other amount in WMF donation form: error message unclear - https://phabricator.wikimedia.org/T118741#1875653 (MBeat33) Resolved>Open Three major donors who've received the recent enMG15 bulk email have reported this problem occurring; the donor in the screenshot said it occurred on... [19:14:11] (PS1) Ejegg: Fix generated SQL [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/258690 [19:22:40] Fundraising-Backlog: Other amount in WMF donation form: error message unclear - https://phabricator.wikimedia.org/T118741#1875663 (Pcoombe) Okay, think I fixed what might have caused this (silly javascript error on my part). Have tested on crossbrowsertesting and it worked, but they don't have iOS 9. Will tr... [19:50:03] (PS2) Ejegg: Update test data [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/258423 [20:08:25] (CR) Cdentinger: [C: 2] "Fixes the drush import" [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/258423 (owner: Ejegg) [20:08:50] (CR) Cdentinger: [C: 2] "Fixes the install script" [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/258690 (owner: Ejegg) [20:11:55] (PS2) Cdentinger: Add year selector to Big English [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/257677 (https://phabricator.wikimedia.org/T94110) (owner: Ejegg) [20:31:29] (CR) Cdentinger: [C: 2] "Works!" [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/257677 (https://phabricator.wikimedia.org/T94110) (owner: Ejegg) [20:35:56] (CR) Cdentinger: [C: 2] "Charts become a little unreadable with excessively many overlay values, just the nature of bar charts. Maybe a pie chart some day!" [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/257078 (https://phabricator.wikimedia.org/T86094) (owner: Ejegg) [20:36:17] (PS2) Cdentinger: Fix text filters [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/258419 (owner: Ejegg) [20:36:35] (CR) Cdentinger: [C: 2] Fix text filters [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/258419 (owner: Ejegg) [20:37:36] (CR) Cdentinger: [V: 2] Fix text filters [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/258419 (owner: Ejegg) [20:40:14] (PS2) Cdentinger: Fix filter summary for non-dropdowns [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/257202 (owner: Ejegg) [20:40:23] (PS5) Cdentinger: Add numeric filters [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/257203 (https://phabricator.wikimedia.org/T120678) (owner: Ejegg) [20:42:05] (CR) Cdentinger: [V: 2] Add numeric filters [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/257203 (https://phabricator.wikimedia.org/T120678) (owner: Ejegg) [20:42:33] (PS3) Cdentinger: Tighten up whitespace in X-by-Y settings [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/256748 (owner: Ejegg) [20:44:22] (CR) Cdentinger: [C: 2 V: 2] "Easier to read" [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/256748 (owner: Ejegg) [20:51:23] (CR) Cdentinger: [C: 2] "Great feature!" [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/257079 (https://phabricator.wikimedia.org/T120673) (owner: Ejegg) [20:51:42] (PS5) Cdentinger: Hide filters not intended for user selection [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/257204 (owner: Ejegg) [20:52:01] (CR) Cdentinger: [V: 2] Hide filters not intended for user selection [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/257204 (owner: Ejegg) [20:54:31] (PS3) Cdentinger: Fix filter summary for non-dropdowns [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/257202 (owner: Ejegg) [20:54:41] (CR) Cdentinger: [C: 2] Fix filter summary for non-dropdowns [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/257202 (owner: Ejegg) [20:58:02] (PS4) Cdentinger: Use common operators in text filter [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/257205 (owner: Ejegg) [21:01:51] (CR) Cdentinger: [C: 2] Use common operators in text filter [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/257205 (owner: Ejegg) [21:02:40] (PS6) Cdentinger: Add numeric filters [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/257203 (https://phabricator.wikimedia.org/T120678) (owner: Ejegg) [21:03:44] thanks for the flood of CR, cwd! I'll push that stuff out once it's all merged [21:03:47] (PS6) Cdentinger: Hide filters not intended for user selection [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/257204 (owner: Ejegg) [21:04:11] ejegg|away: you bet! sorry for the noise, got a little out of sync with the dep chain [21:04:19] but just 2 more to go [21:05:14] (CR) Cdentinger: [V: 2] Add numeric filters [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/257203 (https://phabricator.wikimedia.org/T120678) (owner: Ejegg) [21:05:42] (CR) Cdentinger: [V: 2] Hide filters not intended for user selection [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/257204 (owner: Ejegg) [21:06:19] ejegg|away: ok, i think that's everything! [21:06:31] great new features btw [21:08:18] rockin! thanks again [21:11:26] np! i'm gonna go play in the snow now [22:03:04] (PS1) Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/dash] (deployment) - https://gerrit.wikimedia.org/r/258712 [22:04:23] (PS2) Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/dash] (deployment) - https://gerrit.wikimedia.org/r/258712 [22:04:50] (CR) Ejegg: [C: 2 V: 2] Merge branch 'master' into deployment [wikimedia/fundraising/dash] (deployment) - https://gerrit.wikimedia.org/r/258712 (owner: Ejegg) [22:06:33] !log updated fundraising dashboard from 34dee88d137aa1d0c4487a3a94b87e7ed2f8d0c4 to 961a24c9cf76966aaa7ba8c60e13b6d1d37fa859 [22:06:38] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [22:15:57] (PS1) Ejegg: Fix minification for deploy [wikimedia/fundraising/dash] (deployment) - https://gerrit.wikimedia.org/r/258715 [22:16:12] (CR) Ejegg: [C: 2 V: 2] Fix minification for deploy [wikimedia/fundraising/dash] (deployment) - https://gerrit.wikimedia.org/r/258715 (owner: Ejegg) [22:17:12] !log updated fundraising dashboard from 961a24c9cf76966aaa7ba8c60e13b6d1d37fa859 to 59e51c4ff74c3c584daf6c5de3bb66daa764cd28 [22:17:17] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [22:22:49] ooh shiny new dash stuff! thanks ejegg! [22:23:16] my pleasure! just testing the new stuff, will send an email in a bit. [22:23:27] Please let me know if anything looks wonky [22:34:50] (PS1) Ejegg: Update gulpfile, hush up jslint [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/258717 [22:45:54] (PS1) Ejegg: Fix filter summary for text functions [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/258718 [23:08:38] (Abandoned) Ejegg: DIAGNOSTIC: segfault-handler [wikimedia/fundraising/dash/node_modules] - https://gerrit.wikimedia.org/r/257816 (owner: Ejegg) [23:08:51] (Abandoned) Ejegg: DIAGNOSTIC: try using segfault-handler [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/257813 (owner: Ejegg) [23:35:57] Fundraising-Backlog: Other amount in WMF donation form: error message unclear - https://phabricator.wikimedia.org/T118741#1875935 (Pcoombe) Open>Resolved This seems to be working again now.