[00:09:06] (PS1) Ejegg: Another SmashPig initialization fix [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/339329 [00:22:51] (PS1) Ejegg: Use HashBag instead of EmptyBag [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/339330 [00:30:28] (PS1) Ejegg: Throw SmashPig exception on Ingenico API errors [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/339331 [01:57:07] (PS1) Eileen: Major gifts requests, Do not send thank you for Benevity import, Set Restrictions, Gift Source. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/339341 (https://phabricator.wikimedia.org/T115044) [02:18:06] Fundraising Sprint Autotune Earphones, Fundraising Sprint Baudelaire Bowdlerizer, Fundraising Sprint Costlier Alternative, Fundraising Sprint Deferential Equations, and 4 others: Create an import method for matching gifts and payroll deductions - https://phabricator.wikimedia.org/T115044#3048734 (... [07:33:03] fundraising-tech-ops, DBA: fundraising database tuning - https://phabricator.wikimedia.org/T158446#3048928 (Marostegui) @Jgreen one last thing, if you are planning to migrate to 10.0.29 you might want to take a look at: ``` innodb_buffer_pool_load_at_startup innodb_buffer_pool_dump_at_shutdown ``` Those... [08:09:52] fundraising-tech-ops, DBA: fundraising database tuning - https://phabricator.wikimedia.org/T158446#3048985 (jcrespo) > Obviously, it would increase the shutdown time a bit though as you need to dump It takes 3 additional seconds to shutdown a 512GB server, as it only dumps the LRU, which only contains p... [08:37:38] fundraising-tech-ops, DBA: fundraising database tuning - https://phabricator.wikimedia.org/T158446#3049010 (jcrespo) > The main problem we see at present is contention around long-running queries. I do not know much about your architecture, but consider, instead of buying only large servers, buying als... [08:43:03] fundraising-tech-ops, DBA: fundraising database tuning - https://phabricator.wikimedia.org/T158446#3049017 (jcrespo) You seem to have high Aria activity, research that. However, you send me the session status, not the global status. Invest memory on performance_schema, you will get free usage metrics wh... [12:38:30] Fundraising-Backlog, MediaWiki-extensions-CentralNotice, MediaWiki-extensions-Translate, Wikimedia-CentralNotice-Administration, Wikimedia-log-errors: "Internal error" on testwiki's Special:LanguageStats due to non-existing CentralNotice banner - https://phabricator.wikimedia.org/T157997#3049328... [12:43:53] Fundraising-Backlog, MediaWiki-extensions-CentralNotice, MediaWiki-extensions-Translate, Wikimedia-CentralNotice-Administration, Wikimedia-log-errors: "Internal error" on testwiki's Special:LanguageStats due to non-existing CentralNotice banner - https://phabricator.wikimedia.org/T157997#3049345... [13:27:38] fundraising-tech-ops, DBA: fundraising database tuning - https://phabricator.wikimedia.org/T158446#3049507 (Jgreen) >>! In T158446#3049017, @jcrespo wrote: > You seem to have high Aria activity, research that. However, you send me the session status, not the global status. Whoops. Here's global status:... [13:48:12] fundraising-tech-ops, DBA: fundraising database tuning - https://phabricator.wikimedia.org/T158446#3049550 (Jgreen) >>! In T158446#3049017, @jcrespo wrote: > You seem to have high Aria activity, research that. However, you send me the session status, not the global status. Could this all be due to temp... [13:55:56] fundraising-tech-ops, DBA: fundraising database tuning - https://phabricator.wikimedia.org/T158446#3049559 (jcrespo) > Could this all be due to temp table activity? Not from the session stats, probably, but yes, indeed. ON 5.5/10 we didn't have the feature of innodb temp tables. Again, on those versions... [14:12:36] fundraising-tech-ops, DBA: fundraising database tuning - https://phabricator.wikimedia.org/T158446#3049593 (Jgreen) >>! In T158446#3049559, @jcrespo wrote: >> Could this all be due to temp table activity? > > Not from the session stats, probably, but yes, indeed. ON 5.5/10 we didn't have the feature of... [14:18:57] Fundraising Sprint Deferential Equations, Fundraising-Backlog, MediaWiki-extensions-CentralNotice: Central Notice banners slow to save - https://phabricator.wikimedia.org/T158084#3049600 (Pcoombe) I noticed that the actual edit to the banner shows up in "my contributions" almost immediately, although... [14:33:39] fundraising-tech-ops, DBA: fundraising database tuning - https://phabricator.wikimedia.org/T158446#3049646 (jcrespo) > a back of envelope calculation suggests we might recover 20-30GB total. I do not think that is accurate (eg. doesn't have into account ibdata1 overhead), to make sure: run on your produ... [14:40:37] fundraising-tech-ops, DBA: fundraising database tuning - https://phabricator.wikimedia.org/T158446#3049670 (jcrespo) I forgot- the other thing that you should deploy is GTIDs, the extra functionality is not that great, but it makes the slaves more reliable due to transactional replication control. [14:42:42] fundraising-tech-ops, DBA: fundraising database tuning - https://phabricator.wikimedia.org/T158446#3049688 (Marostegui) >>! In T158446#3049670, @jcrespo wrote: > I forgot- the other thing that you should deploy is GTIDs, the extra functionality is not that great, but it makes the slaves more reliable due... [14:44:54] fundraising-tech-ops, DBA: fundraising database tuning - https://phabricator.wikimedia.org/T158446#3049690 (Jgreen) >>! In T158446#3049646, @jcrespo wrote: > I do not think that is accurate (eg. doesn't have into account ibdata1 overhead), to make sure: run on your production: Here's what we got: Datab... [14:47:21] fundraising-tech-ops, DBA: fundraising database tuning - https://phabricator.wikimedia.org/T158446#3049693 (jcrespo) >>! In T158446#3049690, @Jgreen wrote: >>>! In T158446#3049646, @jcrespo wrote: >> I do not think that is accurate (eg. doesn't have into account ibdata1 overhead), to make sure: run on yo... [15:51:43] https://security.googleblog.com/2017/02/announcing-first-sha1-collision.html [16:17:38] Wikimedia-Fundraising: Sidebar appears over fundraising "nag" banner on German Wikipedia - https://phabricator.wikimedia.org/T158865#3049968 (Pcoombe) [16:17:49] Wikimedia-Fundraising: Sidebar appears over fundraising "nag" banner on German Wikipedia - https://phabricator.wikimedia.org/T158865#3049981 (Pcoombe) p:Triage>Normal [17:37:02] Wikimedia-Fundraising-Campaigns (FY Q3 Jan-Mar 2017), Wikimedia-CentralNotice-Administration (Q1-2017): WMF Fundraising - 16/17 - Sweden (7 Feb - 7 Apr) - https://phabricator.wikimedia.org/T156815#3050343 (Jseddon) [17:37:09] Wikimedia-Fundraising-Campaigns (FY Q3 Jan-Mar 2017), Wikimedia-CentralNotice-Administration (Q1-2017): WMF Fundraising - 16/17 - Sweden (7 Feb - 7 Apr) - https://phabricator.wikimedia.org/T156815#2986766 (Jseddon) [17:43:07] Wikimedia-Fundraising-Campaigns (FY Q3 Jan-Mar 2017), Wikimedia-CentralNotice-Administration (Q1-2017): WMF Fundraising - 16/17 - Sweden (7 Feb - 7 Apr) - https://phabricator.wikimedia.org/T156815#2986766 (Jseddon) [17:43:09] Wikimedia-Fundraising-Campaigns (FY Q3 Jan-Mar 2017), Wikimedia-CentralNotice-Administration (Q1-2017): WMF Fundraising - 16/17 - Sweden (7 Feb - 7 Apr) - https://phabricator.wikimedia.org/T156815#3050363 (Jseddon) [17:43:11] Wikimedia-Fundraising-Campaigns (FY Q3 Jan-Mar 2017): Update FR Ideas page with swedish banners - https://phabricator.wikimedia.org/T156823#3050362 (Jseddon) Open>declined [17:43:13] Wikimedia-Fundraising-Campaigns (FY Q3 Jan-Mar 2017), Wikimedia-CentralNotice-Administration (Q1-2017): WMF Fundraising - 16/17 - Sweden (7 Feb - 7 Apr) - https://phabricator.wikimedia.org/T156815#2986766 (Jseddon) [17:43:15] Wikimedia-Fundraising-Campaigns (FY Q3 Jan-Mar 2017): Update FR Ideas page with swedish banners - https://phabricator.wikimedia.org/T156823#2986906 (Jseddon) Open>declined [17:43:17] Wikimedia-Fundraising-Campaigns (FY Q3 Jan-Mar 2017): Update FR Ideas page with swedish banners - https://phabricator.wikimedia.org/T156823#2986906 (Jseddon) Open>declined [18:00:21] fr-tech: The following quote is from page 4-27 of the MSCP Basic Disk Functions [18:00:21] Manual which is part of the UDA50 Programmers Doc Kit manuals: [18:00:21] As stated above, the host area of a disk is structured as a vector of [18:00:21] logical blocks. From a performance viewpoint, however, it is more [18:00:21] appropriate to view the host area as a four dimensional hyper-cube, the [18:00:22] four dimensions being cylinder, group, track, and sector. [18:00:22] . . . [18:00:23] Referring to our hyper-cube analogy, the set of potentially accessible [18:00:23] blocks form a line parallel to the track axis. This line moves [18:00:24] parallel to the sector axis, wrapping around when it reaches the edge [18:00:24] of the hyper-cube. [18:00:25] -- discuss. [18:04:02] Heh nice one, slander [18:05:14] fr-tech: sorry gotta miss -talk today, busy morning [18:22:03] dang, hangouts app uses like 3x as much data as tethered hangouts on desktop [18:55:37] hello again all! [19:21:39] (PS2) Ejegg: Ingenico API decodes JSON, throws exception on errors [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/339331 (https://phabricator.wikimedia.org/T128692) [19:22:08] fr-tech if anyone's up for a tetch more review, ^^^ adds some basic error handling around the Ingenico API [19:25:11] I'll take a look after metrics. [19:28:38] Fundraising Sprint Baudelaire Bowdlerizer, Fundraising Sprint Costlier Alternative, Fundraising Sprint Deferential Equations, Fundraising Sprint Dirt Farming, and 6 others: Store and update list of currenly working iDEAL banks - https://phabricator.wikimedia.org/T128692#3050874 (Ejegg) Code is ab... [19:40:59] quick question, can I get taken off the reviewers list for SmashPig changes? not sure how I ended up there [19:41:25] couldn't find a way to do it myself [19:41:40] the-wub: oops, I added you to the fr-tech group at some point. Fixing that now. [19:42:00] cool, thanks awight! [19:42:19] the-wub: done [19:42:21] FYI: https://gerrit.wikimedia.org/r/#/admin/groups/784 [19:43:10] * awight is overjoyed that my user ID is 143. [19:47:32] ejegg: yeah isn't phone hangouts infuriating? no way to throttle, uses max data possible [19:47:43] see also: bluejeans [19:47:57] cwd phone bluejeans app at least lets you do audio only [19:48:24] I'd be happy to do more meetings via riot app [19:48:47] i had such a bad time setting up my own matrix server [19:50:55] i still get sporadic emails when someone talks in the wikimedia-matrix channel [19:51:05] even though i deleted every semblance of that account [19:55:16] oh man [19:58:16] Wikimedia-Fundraising-Campaigns (FY Q3 Jan-Mar 2017), Wikimedia-CentralNotice-Administration (Q2-2017): WMF Fundraising - 2016-17 - Austria (Mar 7 - Apr 4) - https://phabricator.wikimedia.org/T157119#3051079 (Pcoombe) [19:58:18] (PS1) Ejegg: Set SmashPig logging prefix [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/339484 [19:58:20] Wikimedia-Fundraising: Sidebar appears over fundraising "nag" banner on German Wikipedia - https://phabricator.wikimedia.org/T158865#3051080 (Pcoombe) [19:58:29] http://openmeetings.apache.org/ [19:58:29] hmmmmmmm [19:58:35] looks like this got picked back up [19:58:46] o? [19:59:33] new release this month [19:59:49] "Recorded sessions can be downloaded as AVI/FLV files" [19:59:52] FLV??? [20:00:03] ah, this month's release switches to HTML5 [20:00:22] ...partially [20:01:08] https://demo-openmeetings.apache.org/openmeetings [20:01:11] sigh [20:02:10] Wikimedia-Fundraising: Seed task for fundraising - https://phabricator.wikimedia.org/T118862#3051091 (Pcoombe) Open>Resolved a:Pcoombe [20:03:25] big old java catastrophe [20:04:13] apparently this problem space is pretty thorny [20:04:16] i don't really get why [20:04:44] Seems like the browser spec should have made it a damn sight easier [20:05:34] Fundraising Tech Backlog, Fundraising-Backlog, FR-Smashpig: Scrap custom fundraising logging, integrate with PSR-3 core stuff - https://phabricator.wikimedia.org/T87065#3051111 (Ejegg) [20:05:49] tbh the best meeting experience i've had was when i was dialing in to all the meetings [20:06:00] telephone infrastructure is optimized for real-time communication [20:06:02] internet is not [20:06:53] when i'm in blue jeans and i see crisp 1080p video and mangled audio [20:06:54] get real [20:09:06] I bet dialing in over google voice would be less data for me. I wonder if the googfrastructure is smart enough not to decode and re-encode [20:12:43] Fundraising Sprint Deferential Equations, Fundraising-Backlog, MediaWiki-extensions-CentralNotice: Central Notice banners slow to save - https://phabricator.wikimedia.org/T158084#3051141 (AndyRussG) >>! In T158084#3049600, @Pcoombe wrote: > I noticed that the actual edit to the banner shows up in "my... [20:13:14] ejegg: google voice uses data? [20:13:16] googfrastructure? [20:13:48] goobfrastructure? [20:13:50] cwd in Colombia it does [20:13:52] gooeystructure? [20:14:15] they don't have a call-forwarding endpoint in +57 [20:15:15] gooberstructure [20:18:45] What is the structure of goober? [20:20:56] Deep under the sea, ooze the viscous high-latency goo bits of the goober backbone? [20:24:04] Fundraising Sprint Deferential Equations, Fundraising-Backlog, MediaWiki-extensions-CentralNotice: Central Notice banners slow to save - https://phabricator.wikimedia.org/T158084#3051154 (AndyRussG) Hmm, this makes it pretty clear: - Edit a banner as wiki page. - It's very slow to save, just like in... [20:34:15] Fundraising Sprint Deferential Equations, Fundraising-Backlog, MediaWiki-extensions-CentralNotice: Central Notice banners slow to save - https://phabricator.wikimedia.org/T158084#3051161 (AndyRussG) This seems to affect editing of other pages in the Mediawiki: namespace, too. Same thing happened when... [20:34:37] (CR) XenoRyet: [C: 2] Ingenico API decodes JSON, throws exception on errors [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/339331 (https://phabricator.wikimedia.org/T128692) (owner: Ejegg) [20:34:56] Wikimedia-Fundraising-Campaigns (FY Q3 Jan-Mar 2017), Wikimedia-CentralNotice-Administration (Q1-2017): WMF Fundraising - 2016-17 - Austria (Mar 7 - Apr 4) - https://phabricator.wikimedia.org/T157119#3051162 (Pcoombe) [20:36:00] (Merged) jenkins-bot: Ingenico API decodes JSON, throws exception on errors [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/339331 (https://phabricator.wikimedia.org/T128692) (owner: Ejegg) [20:36:02] thanks XenoRyet ! [20:36:10] No worries. Looks good. [20:36:23] Wikimedia-Fundraising: Sidebar appears over fundraising "nag" banner on German Wikipedia - https://phabricator.wikimedia.org/T158865#3049968 (spatton) @Pcoombe happened to notice this task in irc and poked around, looks like there's a z-index property for .mw-body that could be causing this? .mw-body {... [20:37:26] Wikimedia-Fundraising-Campaigns (FY Q3 Jan-Mar 2017), Wikimedia-CentralNotice-Administration (Q1-2017): WMF Fundraising - 2016-17 - Netherlands (Mar 21 - Apr 18) - https://phabricator.wikimedia.org/T158905#3051189 (Pcoombe) [20:39:18] Fundraising Sprint Baudelaire Bowdlerizer, Fundraising Sprint Costlier Alternative, Fundraising Sprint Deferential Equations, Fundraising Sprint Dirt Farming, and 6 others: Store and update list of currenly working iDEAL banks - https://phabricator.wikimedia.org/T128692#3051204 (Pcoombe) [20:39:22] Wikimedia-Fundraising-Campaigns (FY Q3 Jan-Mar 2017), Wikimedia-CentralNotice-Administration (Q1-2017): WMF Fundraising - 2016-17 - Netherlands (Mar 21 - Apr 18) - https://phabricator.wikimedia.org/T158905#3051203 (Pcoombe) [20:42:24] XenoRyet: if you're still in SmashPig headspace, this other tiny fix would be nice to have: https://gerrit.wikimedia.org/r/339273 [20:42:41] Sure, haven't really context shifted away yet. I'll take a look. [20:43:02] Fundraising Sprint Deferential Equations, Fundraising-Backlog, MediaWiki-Cache, MediaWiki-extensions-CentralNotice: Mediawiki namespace pages, including CentralNotice banners, are slow to save - https://phabricator.wikimedia.org/T158084#3051217 (AndyRussG) [20:44:54] Fundraising Sprint Deferential Equations, Fundraising-Backlog, MediaWiki-Cache, MediaWiki-extensions-CentralNotice: Mediawiki namespace pages, including CentralNotice banners, are slow to save - https://phabricator.wikimedia.org/T158084#3026116 (AndyRussG) I also tried editing a [[ https://meta.w... [20:45:54] (CR) XenoRyet: [C: 2] Throw a descendent of SmashPig exception on cURL fail [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/339273 (owner: Ejegg) [20:48:07] (Merged) jenkins-bot: Throw a descendent of SmashPig exception on cURL fail [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/339273 (owner: Ejegg) [21:00:26] fundraising-tech-ops, Operations, Traffic, HTTPS: update SSL certificate for benefactorevents.wikimedia.org by 2017-03-02 - https://phabricator.wikimedia.org/T158684#3051267 (RobH) I've emailed the new public cert and private key file (the key being pgp encrypted) over to @EWilfong_WMF. [21:05:48] (PS1) Ejegg: Update SmashPig library [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/339489 [21:05:55] (CR) Ejegg: [C: 2] Update SmashPig library [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/339489 (owner: Ejegg) [21:06:42] (PS2) Ejegg: Use HashBag instead of EmptyBag [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/339330 [21:07:01] (PS2) Ejegg: Another SmashPig initialization fix [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/339329 [21:07:03] (PS2) Ejegg: Set SmashPig logging prefix [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/339484 [21:07:32] fr-tech a few other tiny patches for iDEAL lookup seeking reviewers ^^^ [21:07:47] k, getting my bus ticket. back soon! [21:08:11] (CR) jerkins-bot: [V: -1] Update SmashPig library [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/339489 (owner: Ejegg) [21:08:25] ack, why'd that happen? [21:09:02] (CR) jerkins-bot: [V: -1] Update SmashPig library [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/339489 (owner: Ejegg) [21:09:10] d'oh [21:10:49] (CR) jerkins-bot: [V: -1] Another SmashPig initialization fix [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/339329 (owner: Ejegg) [21:11:16] (CR) jerkins-bot: [V: -1] Use HashBag instead of EmptyBag [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/339330 (owner: Ejegg) [21:11:30] (CR) jerkins-bot: [V: -1] Set SmashPig logging prefix [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/339484 (owner: Ejegg) [21:37:01] (PS4) Cdentinger: process payment before popping out of iframe [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/338410 (https://phabricator.wikimedia.org/T153972) [21:56:27] ejegg: this actually seems to work https://gerrit.wikimedia.org/r/#/c/338410/4 [21:56:36] the inheritance structure there is confusing [21:56:38] cwd w00t! [21:59:00] will look in a sec, just sorting out all those test failures above. Think I just need to tell the mock not to call the normal constructor [22:03:44] fundraising-tech-ops, DBA: fundraising database tuning - https://phabricator.wikimedia.org/T158446#3051390 (Jgreen) >>! In T158446#3048928, @Marostegui wrote: > @Jgreen one last thing, if you are planning to migrate to 10.0.29 you might want to take a look at: > innodb_buffer_pool_load_at_startup > innod... [22:04:26] (PS2) Ejegg: Update SmashPig library [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/339489 (https://phabricator.wikimedia.org/T128692) [22:06:28] fundraising-tech-ops, Operations, Traffic, HTTPS: update SSL certificate for benefactorevents.wikimedia.org by 2017-03-02 - https://phabricator.wikimedia.org/T158684#3051412 (EWilfong_WMF) Thanks, @RobH, the new cert is in place on benefactorevents.wikimedia.org. [22:06:59] fundraising-tech-ops, Operations, Traffic, HTTPS: update SSL certificate for benefactorevents.wikimedia.org by 2017-03-02 - https://phabricator.wikimedia.org/T158684#3051417 (RobH) Open>Resolved [22:12:58] well dang, this VPN connection worked yesterday [22:19:47] huh [22:20:00] getting an error? [22:20:10] just no DNS [22:20:28] restarting all the networking bits, let's see if it works now [22:21:44] hmph, still no [22:22:39] 8.8.8.8? [22:23:21] if the DNS is on your local network, i imagine the full tunnel would wall it off [22:28:35] thanks cwd, adding the goog ns did the trick! [22:28:58] \o/ [22:39:58] (PS3) Ejegg: Another SmashPig initialization fix [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/339329 [22:40:19] (PS3) Ejegg: Set SmashPig logging prefix [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/339484 [22:43:38] (CR) Ejegg: [C: -1] "Looking pretty good, at least for GC. Found one undefined variable. Needs smoke testing with the other gateways, at least Adyen and PayPal" (1 comment) [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/338410 (https://phabricator.wikimedia.org/T153972) (owner: Cdentinger) [22:46:07] (PS3) Ejegg: Use HashBag instead of EmptyBag [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/339330 [22:54:50] (PS4) Ejegg: Use HashBag instead of EmptyBag [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/339330 (https://phabricator.wikimedia.org/T128692) [22:55:02] back later! [22:55:16] ok fr-tech, got my test failures sorted. If anyone has time for some mostly-trivial CR, I think those 3 are all we need to actually deploy the iDEAL lookup ^^^ [22:55:21] err, 4 [22:55:58] relocating for a glimpse of epic sunset [23:07:35] XenoRyet: i have decent bandwidth atm. realtime collaboration? [23:09:50] Ah, I'm kind of in my own zone right now. Think I want to be a loner for a bit longer. [23:10:46] k [23:11:46] AndyRussG|sortof: you're just waiting on ops/perf for confirmation about purging 800 things at once? [23:12:48] Fundraising Sprint Deferential Equations, Fundraising-Backlog: Update fr-tech job roles on wiki - https://phabricator.wikimedia.org/T158710#3051635 (ggellerman) Updated https://www.mediawiki.org/wiki/Fundraising_tech/Roles_and_Responsibilities with roles described in https://docs.google.com/document/d/1g... [23:28:26] (CR) Ejegg: [C: 1] "Looks really good! Optional suggestion inline." (1 comment) [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/339341 (https://phabricator.wikimedia.org/T115044) (owner: Eileen) [23:31:49] (CR) Ejegg: "Change looks good, just curious about why the deleted code is no longer needed." (1 comment) [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/338834 (https://phabricator.wikimedia.org/T153917) (owner: Eileen) [23:33:37] * ejegg searches gerrit in vain for things to distract from policy review task [23:34:04] i've been dragging my feet on that for too darn long, and it's a cross-team dependency :S [23:39:54] feels like dinner time...