[00:00:55] I found Widgiemooltha on google https://www.google.co.nz/maps/place/Widgiemooltha+WA+6443,+Australia/@-32.6387784,123.9804325,6.4z/data=!4m13!1m7!3m6!1s0x2a5222737cbb077d:0x400f6382479d7f0!2sWidgiemooltha+WA+6443,+Australia!3b1!8m2!3d-31.4932004!4d121.5747949!3m4!1s0x2a5222737cbb077d:0x400f6382479d7f0!8m2!3d-31.4932004!4d121.5747949 “Widgiemooltha is an abandoned town in Western Australia “ - that’s the carpark I slept in [01:00:12] (Abandoned) Eileen: Lybunt Clarify Row count reporting on calculated rows [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/473654 (https://phabricator.wikimedia.org/T208900) (owner: Eileen) [01:11:08] (PS1) Eileen: Add CiviTutorial [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/474829 [02:19:53] Fundraising Sprint Window dressing is mostly olive oil, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: See if we can exclude our top matching gifts donor from 'last_donation_date' & last_donation_currency calcs - https://phabricator.wikimedia.org/T208816 (Eileenmcnaughton)... [02:34:01] Fundraising Sprint Window dressing is mostly olive oil, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: slow loading of contribution tab when many contributions for a contact - https://phabricator.wikimedia.org/T209415 (Eileenmcnaughton) The short answer is that it's using an index_merge or index... [14:13:14] PROBLEM - check_ipsec on civi1001 is CRITICAL: Strongswan CRITICAL - ok: 0 not-conn: americium_v4 [14:13:24] PROBLEM - check_ipsec on americium is CRITICAL: Strongswan CRITICAL - ok: 0 not-conn: civi1001_v4 [14:18:10] RECOVERY - check_ipsec on civi1001 is OK: Strongswan OK - 1 ESP OK [14:18:32] RECOVERY - check_ipsec on americium is OK: Strongswan OK - 1 ESP OK [15:28:26] (PS1) Ejegg: More oauth logging [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/474927 [15:28:38] (CR) Ejegg: [C: 2] More oauth logging [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/474927 (owner: Ejegg) [15:31:18] (PS1) Ejegg: More oauth logging [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/474928 [15:31:21] (CR) Ejegg: [C: 2] More oauth logging [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/474928 (owner: Ejegg) [15:33:22] (Merged) jenkins-bot: More oauth logging [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/474927 (owner: Ejegg) [15:33:24] (Merged) jenkins-bot: More oauth logging [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/474928 (owner: Ejegg) [15:36:08] !log updated fundraising CiviCRM from e648be0d9e to a31dbefc61 [15:36:09] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [15:38:17] Jeff_Green: hi! I'm getting closer to figuring out the oauth failure [15:38:39] The Civi server doesn't seem to think it's getting the request over https [15:39:07] so it's checking the signature on a url that starts with http:// and says that's wrong [15:39:13] huh interesting [15:39:24] I see the nginx config is supposedly passing an 'https' variable [15:39:32] that sounds like it would be a new security feature in civi right? [15:39:41] and the X-Forwarded-Protocol [15:39:45] right [15:39:49] Jeff_Green: new security feature? [15:40:18] as in maybe it worked before because drupal didn't use to require https [15:40:28] Ah, no, this is the same old oauth module [15:40:40] so, the dash code needs to sign the request [15:40:42] huh [15:40:47] and part of what's signed is the full URL [15:41:05] so when the provider code is the trying to check the signature [15:41:12] and dash checks "https*" vs drupal checks "http*" [15:41:16] it has to decide what its own url is [15:41:18] yep yep [15:41:37] makes sense, I wonder what changed to make this break then [15:41:48] the oauth code is doing that by checking the PHP superglobal $_SERVER['HTTPS'] [15:41:57] which seems not to be set these days [15:42:12] (or set to 'off') [15:43:14] Hmm, I guess we could just force it to 'on' in the drupal settings file [15:44:39] the nginx config dates back to 3/2017 [15:44:56] huh. apache config? [15:45:00] well the vhost file does, looking at the main nginx conf now [15:45:47] oh right, the main conf changed recently to send error_log to syslog, but that shouldn't have any bearing on this [15:45:50] looking at apache [15:46:32] we tweaked the civicrm apache vhost config in 7/2017 [15:46:49] weird, ok [15:47:11] I can't see any changes in the civi or drupal settings files this year that would have any bearing on https either [15:47:28] and this module isn't even touching anything in Civi, just drupal [15:47:43] could be a bugfix in any of the components involved [15:48:45] ejegg: one thing I was wondering, what URL is dash using? [15:49:01] b/c we must be overriding DNS for civicrm.wikimedia.org somehow [15:49:04] ahh, there was an update to oauth in march, maybe that was it! [15:49:54] yep yep, look at that! [15:50:12] nice [15:50:12] they got rid of handling for HTTP_X_FORWARDED_PROTO [15:50:20] now why would they have done that??? [15:51:02] oh.... because I had added it back in 2014 [15:51:05] d'oh [15:51:08] ha [15:51:21] that'll teach me not to upstream! [15:51:58] oh jeez, there are patches adding all the same logging lines I added back yesterday :P [15:52:06] hahahaha [15:52:26] it's been a LONG 4 years! [15:52:32] it definitely has [15:52:44] lolol [15:53:01] ok, I'll restore that patch from the git history and see what their process is for upstreaming [15:53:11] i wonder if it would make sense to add a README that explains the things we had to do at every part of the pipeline [15:53:34] yeah, I'm thinking to add this to the dash readme [15:53:39] since that's where the failure shows up [15:54:05] apropos: https://phabricator.wikimedia.org/T209872 [15:54:15] hehe [15:54:18] as long as you're in there with logging, would it be easy to have this thing clearly log successful/failed login attempts to syslog? [15:55:03] Jeff_Green: you mean just for oauth, or for all logins? [15:55:11] actually for all would be awesome [15:55:29] hmm, I'm sure that'd be possible. Would have to dig a little bit [15:55:34] I'm working on schemes to audit stuff like this [15:55:36] ooh, post em in privchan? [15:56:06] ok, if it's more than trivial let's task it and do it next year [15:56:10] Jeff_Green: want to throw a ticket in phab for that? [15:56:16] sure [15:56:33] we might consider having a botchan in addition to privchan [15:56:49] even now deploys turn it to glass [15:57:23] maybe a web-based systems dash [15:57:43] yeah [15:57:46] it's on the horizon [15:57:52] just send it all to slack X] [15:58:02] a youtube channel! [15:58:20] shortwave! [15:59:31] APRS [15:59:40] over amateur rdio [15:59:59] i like it [16:00:20] (PS1) Ejegg: Undo watchdog logging and failed fix for oauth [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/474934 [16:00:28] (CR) Ejegg: [C: 2] Undo watchdog logging and failed fix for oauth [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/474934 (owner: Ejegg) [16:01:23] tyler showed me a program where he put his ham radio next to the computer and played a noise channel from the ISS which the computer listened to and reconstructed into pictures [16:01:58] oh wow, i would be interested in that [16:02:33] Jeff_Green: https://baofengtech.com/ [16:02:44] cwd wait, were those transmitted as pictures? [16:02:52] I just ordered a survivalist-type shortwave radio for emergency use, after realizing that we don't even own a battery powered AM/FM radio of any kind [16:02:56] getting a 404 at that page [16:03:09] oh, busted nojs redirect [16:04:54] (PS1) Ejegg: Tweak OAuth lib to respect x-forwarded-proto [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/474936 (https://phabricator.wikimedia.org/T207209) [16:05:00] (CR) Ejegg: [C: 2] Tweak OAuth lib to respect x-forwarded-proto [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/474936 (https://phabricator.wikimedia.org/T207209) (owner: Ejegg) [16:05:07] (Merged) jenkins-bot: Undo watchdog logging and failed fix for oauth [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/474934 (owner: Ejegg) [16:07:44] jgleeson: hi! I'm about to deploy a couple CRM patches and I see your audit parser is in the list [16:07:58] lmk if you want to take the deploy, or just test it later today [16:08:27] hey ejegg [16:08:44] how's the compy today? [16:08:58] if it's easier I can deploy that now to save you having to mess around with it? [16:09:06] ah much better :) [16:09:36] (Merged) jenkins-bot: Tweak OAuth lib to respect x-forwarded-proto [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/474936 (https://phabricator.wikimedia.org/T207209) (owner: Ejegg) [16:10:44] woohoo [16:11:11] jgleeson: if you're not busy with other stuff [16:14:02] sure thing. I'll just pull down the latest changes to see whats what on master [16:15:25] ejegg: https://photos.google.com/share/AF1QipNrRjWFki1lP_CErSxLpnU4XqtuV-eEgjo_AjLqryX66MbD-IU9im-qQ1D83WQ7Jw?key=UnRobS1qRGVaVzdJMHRKQl9yY1J5cWtKLXA3eXl3 [16:23:29] cwd cool! in color even [16:23:59] jgleeson there are a bunch of junky looking logging patches that I was cherry-picking and have just reverted [16:25:38] cool. lastpass isn't logging me in for some reason via browser extension so gonna login via the website [16:34:25] ok lastpass is completely not working for me... so I will carry on without collab docs :) [16:36:10] pass(1) ftw [16:37:07] https://lastpass.com/status.php [16:37:13] An error occurred while processing your request. [16:37:20] :| [16:37:24] hahaha [16:37:56] jgleeson: https://www.passwordstore.org/ [16:38:08] I'm pretty I have offline mode enabled also which is worrying since it's still being blocked by outbound calls [16:39:28] pass just uses your gpg key and some text files [16:40:46] yeah reading now, looks pretty cool [16:44:50] oh great https://twitter.com/LastPassStatus/status/1064904151166083082 [16:45:13] cwd, I'll pull it down tonight and have a plan [16:45:30] jgleeson: it should be in your package manager [16:45:37] have a play* [16:45:38] apt-get install pass [16:45:49] hmm I'd rather pull down the src [16:45:52] and build/inspect [16:45:59] there's not much to it [16:46:03] just scripts some gpg commands [16:46:08] do you have a key you use? [16:46:37] yeah I have one somewhere [16:47:00] I guess I could setup a new one for work [16:47:16] maybe we can do another key signing party at all-hands [16:47:28] ha! [16:47:31] http://keys.gnupg.net/pks/lookup?op=vindex&fingerprint=on&search=0xA3BDE689F2667CAB [16:50:32] looks like that redirects to an analytics site for an investment firm possibly related to gentoo linux [16:51:08] jgleeson: oh? [16:51:22] yeah I get taken here : https://analytics.sumptuouscapital.com/pks/lookup?op=vindex&fingerprint=on&search=0xA3BDE689F2667CAB [16:51:38] https://sumptuouscapital.com/ [16:51:49] https://blog.sumptuouscapital.com/2018/02/gentoo-at-fosdem-2018/ [16:52:19] weeeeird [16:52:29] too bad the MIT keyserver is a shitshow [16:52:37] someone should really fix that up [16:52:59] it seems to be working better today https://pgp.mit.edu/pks/lookup?op=vindex&search=0xA3BDE689F2667CAB [17:00:52] hey ejegg, just merging latest master into develop on crm and his a conflict in oauth.php [17:00:59] hit [17:01:18] am I ok to take masters? [17:02:13] looks like master has some extra checks [17:03:40] (PS1) Jgleeson: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/474951 [17:04:02] (CR) jerkins-bot: [V: -1] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/474951 (owner: Jgleeson) [17:05:30] oooooooooh [17:05:45] looks like I did that the wrong way around [17:06:07] we update vendor directly and then update the submodule [17:06:18] whereas I've just updated the composer version [17:06:20] Fundraising-Backlog, fundraising-tech-ops: ccogdill has new computer, needs ssh set up again... - https://phabricator.wikimedia.org/T209715 (CCogdill_WMF) Hey! Anything else I can do here? I'm behind on doing some big updates to the team without access to server data. [17:06:33] little bit of release rust setting in I think [17:12:21] jgleeson: ah, sorry about that conflict [17:12:29] it's because I had cherry-picked things [17:17:37] so the composer version patch is the right thing to do for master [17:17:46] since vendor only exists on the deployment branch [17:23:26] but I'm confused why my local vendor submodule on deployment is showing no changs [17:23:30] changes to be commited [17:23:34] trying to work out why [17:23:50] I expect that submodule to need updating on deployment, and then the parent pull that in [17:24:41] local vendor module that is [17:38:08] jgleeson: hmm, it needed smash-pig updated for me [17:38:18] I generally do this [17:38:21] rm -rf vendor [17:38:26] git submodule update --init [17:38:38] to get a fresh of vendor [17:38:47] since I've got all the dev deps installed while I'm on master [17:39:05] then I do a composer install --no-dev to get the libraries updated [17:39:11] and cd vendor [17:39:13] git add . [17:39:22] git commit -m 'Updated foolib' [17:39:33] git-review it, and C+2 [17:40:05] Fundraising-Backlog, fundraising-tech-ops: ccogdill has new computer, needs ssh set up again... - https://phabricator.wikimedia.org/T209715 (cwdent) @CCogdill_WMF try now, new key is in place [17:40:42] yeah that sounds like a good plan pulling down a fresh copy. for some reason my vendor submodule isnt seeing changes [17:41:06] jgleeson: even after you do the composer install ? [17:41:10] I think the submodule itself might not be setup for some reason which is a surprise because I'm sure I've done this before [17:41:30] just to double check [17:41:34] path: /org.wikimedia.civicrm/vendor [17:41:47] origin ssh://jgleeson@gerrit.wikimedia.org:29418/wikimedia/fundraising/crm (fetch) [17:41:52] git remote -v output ^ [17:42:00] I'm expecting a '/vendor/' on the end [17:42:17] this is on deployment too [17:42:18] are you on the deployment branch? [17:42:21] oh weird [17:43:08] yeah, try deleting the dir and doing git submodule update --init [17:43:54] https://pasteboard.co/HO4wcmH.png [17:44:15] that's what i get, which suggests the submodule isnt setup right [17:44:43] did you do the submodule update --init ? [17:45:38] I did before but I'm gonna delete it now as that feels like it will work [17:45:58] sorry, was looking for a good open source image sharing tool, the ads are so distracting [17:46:46] does wmf have any engineer tools like pastbins or image sharing stuff? [17:47:07] (out of general interest) [17:47:12] good question! There's phab, but it's not as simple as it could be [17:47:20] https://tools.wmflabs.org/paste/ [17:47:22] https://phabricator.wikimedia.org/file/upload/ [17:47:23] yes it does! [17:47:33] Fundraising-Backlog, fundraising-tech-ops: ccogdill has new computer, needs ssh set up again... - https://phabricator.wikimedia.org/T209715 (CCogdill_WMF) Open>Resolved a:CCogdill_WMF Wonderful, I'm in! Thank you very much, Casey! [17:50:39] argh time caught up with me. just gonna grab some food before tech-talk [18:01:17] fr-tech any requests for -talk? [18:01:42] ejegg: hmmm nothing comes to mind especially... I'll be there in about 5 min btw! :) [18:01:47] k [18:02:01] Not sure. I was half wondering if I should lurk that fundraising feedback meeting though. [18:02:16] yeah i was wondering about that [18:02:20] ah, might be interesting [18:02:29] i was juts going to ask what the plan was [18:02:36] I think I'll do that, just to see what comes up. [18:02:38] cool, I'll pop into that feedback meeting for a few min [18:03:31] ah, that's why no one is here [18:03:37] god bluejeans is horrible at network usage [18:03:54] HD video, unusable audio [18:03:59] no controls [18:04:26] hi everyone! if you're on here during the Fundraising Brainstorm call and have any questions, go ahead and ask here and I'll relay to the team :) the meeting has now started on Bluejeans - check out the staff calendar for details. [18:04:49] thanks mnoor [18:06:18] ah ok I'll go there, too, then [18:06:58] cwd the phone client has a few more options [18:07:17] ejegg: do i have to install an app? [18:07:22] yah [18:07:28] grumble [18:07:35] damn it [18:07:36] sorry grumble [18:07:42] hehe [18:18:19] Seddon: https://phabricator.wikimedia.org/T203669#4763197 [18:18:30] cwd: I've done Bluejeans many times without an app [18:18:44] It normally shows an option when you join [18:19:38] Wikimedia-Fundraising, Android-app-feature-Feeds, Mobile-Content-Service, Wikipedia-Android-App-Backlog, and 5 others: 2018 English campaign fundraising on apps - https://phabricator.wikimedia.org/T204821 (bearND) [18:20:18] Wikimedia-Fundraising, Android-app-feature-Feeds, Mobile-Content-Service, Wikipedia-Android-App-Backlog, and 4 others: 2018 English campaign fundraising on apps - https://phabricator.wikimedia.org/T204821 (bearND) [18:20:45] cwd: ejegg: On FF 63, when you go to the meeting, there's a link at the bottom that says "Join with the browser" [18:20:59] works fine [18:21:01] AndyRussG: oh yeah i don't use the app [18:21:10] yeah me either [18:21:11] i just wish there was bandwidth controls w/o [18:21:13] AndyRussG: yep yep, it just doesn't have much of a low bandwidth option [18:21:19] ahhh right [18:21:30] bluejeans trashes my network harder than anything [18:22:24] cwd: There's a control to say "scale video to fit view", then you can make the browser window tiny [18:22:38] oh nice [18:22:40] Dunno if that actually helps bandwidth, but that's what I've done when tethering form my phone [18:22:53] this is how i used to play wolfenstein on my LCII [18:22:59] (lmk if it helps, actually) [18:23:21] heheh [18:24:54] Wikimedia-Fundraising, Android-app-feature-Feeds, Mobile-Content-Service, Wikipedia-Android-App-Backlog, and 4 others: 2018 English campaign fundraising on apps - https://phabricator.wikimedia.org/T204821 (Mholloway) It's live on https://en.wikipedia.org/api/rest_v1/feed/announcements. [18:28:32] Wikimedia-Fundraising-Banners, Browser-Support-Internet-Explorer: IE11: Problem with card logo spacing on mobile large - https://phabricator.wikimedia.org/T209996 (Pcoombe) [18:53:38] (PS1) Jgleeson: Updated SmashPig [wikimedia/fundraising/crm/vendor] - https://gerrit.wikimedia.org/r/474964 [18:59:37] (CR) Jgleeson: [V: 2 C: 2] Updated SmashPig [wikimedia/fundraising/crm/vendor] - https://gerrit.wikimedia.org/r/474964 (owner: Jgleeson) [19:00:05] we're wrapping up the fundraising call, but if you have any additional questions, feel free to email us at fr-creative@wikimedia.org or contact one of us directly :) [19:01:47] (PS2) Jgleeson: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/474951 [19:02:21] (CR) jerkins-bot: [V: -1] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/474951 (owner: Jgleeson) [19:03:10] great presentation mnoor ccogdill spatton :) [19:03:25] thanks jgleeson! [19:05:03] (Merged) jenkins-bot: Updated SmashPig [wikimedia/fundraising/crm/vendor] - https://gerrit.wikimedia.org/r/474964 (owner: Jgleeson) [19:05:51] thank you jgleeson :) and thanks for coming! [19:13:21] (Abandoned) Ejegg: Update Smash-Pig library [wikimedia/fundraising/crm/vendor] - https://gerrit.wikimedia.org/r/474804 (owner: Ejegg) [19:14:45] (CR) Jgleeson: "recheck" [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/474951 (owner: Jgleeson) [19:19:06] ejegg, looks like everything is in order [19:19:15] great! [19:19:27] although I merged the submodule update with the merge from master to deployment, that feels like it might be wrong [19:19:35] should I break it up for separation ? [19:25:09] jgleeson: no, that's how I usually do it [19:28:21] (CR) AndyRussG: [V: 2] Sanitize translatable banner messages on output [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/474322 (https://phabricator.wikimedia.org/T208069) (owner: AndyRussG) [19:30:36] Fundraising Sprint USB stands for underhanded socket bureaucracy, Fundraising Sprint Vestigial tails shoot from the hip, Fundraising Sprint Window dressing is mostly olive oil, Fundraising-Backlog, Patch-For-Review: dash oauth stopped working - https://phabricator.wikimedia.org/T207209 (Ejegg... [19:34:55] (CR) AndyRussG: [V: 2 C: 2] Sanitize translatable banner messages on output [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/474322 (https://phabricator.wikimedia.org/T208069) (owner: AndyRussG) [19:44:01] (Merged) jenkins-bot: Sanitize translatable banner messages on output [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/474322 (https://phabricator.wikimedia.org/T208069) (owner: AndyRussG) [19:44:03] (CR) jerkins-bot: [V: -1] Include translatable messages from any banner [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/474323 (https://phabricator.wikimedia.org/T208069) (owner: AndyRussG) [19:49:34] (CR) jenkins-bot: Sanitize translatable banner messages on output [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/474322 (https://phabricator.wikimedia.org/T208069) (owner: AndyRussG) [20:01:31] hey ejegg, there's a bunch of eileens patches in the latest updates on CRM master not yet deployed. I might hang on until standup to ask if she's ok with me releasing them on her behalf (in case there are cross-dependencies elsewhere) unless you think we're ok? [20:01:56] ok, no hurry [20:02:12] cool [20:13:21] (CR) AndyRussG: [V: 2 C: 2] Include translatable messages from any banner [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/474323 (https://phabricator.wikimedia.org/T208069) (owner: AndyRussG) [20:16:46] (PS3) Ejegg: Use index hint to speed up trigger query on donors with many donations [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/474806 (https://phabricator.wikimedia.org/T208816) (owner: Eileen) [20:16:55] (CR) Ejegg: [C: 2] Use index hint to speed up trigger query on donors with many donations [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/474806 (https://phabricator.wikimedia.org/T208816) (owner: Eileen) [20:20:38] (PS2) Ejegg: Add extension to add a permission to suppress the link to export data. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/470958 (https://phabricator.wikimedia.org/T208270) (owner: Eileen) [20:22:12] (Merged) jenkins-bot: Include translatable messages from any banner [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/474323 (https://phabricator.wikimedia.org/T208069) (owner: AndyRussG) [20:24:12] (Merged) jenkins-bot: Use index hint to speed up trigger query on donors with many donations [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/474806 (https://phabricator.wikimedia.org/T208816) (owner: Eileen) [20:25:03] (PS3) Ejegg: Add extension to add a permission to suppress the link to export data. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/470958 (https://phabricator.wikimedia.org/T208270) (owner: Eileen) [20:25:10] (CR) Ejegg: [C: 2] Add extension to add a permission to suppress the link to export data. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/470958 (https://phabricator.wikimedia.org/T208270) (owner: Eileen) [20:28:24] (CR) jenkins-bot: Include translatable messages from any banner [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/474323 (https://phabricator.wikimedia.org/T208069) (owner: AndyRussG) [20:30:25] (Merged) jenkins-bot: Add extension to add a permission to suppress the link to export data. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/470958 (https://phabricator.wikimedia.org/T208270) (owner: Eileen) [20:30:54] (Restored) AndyRussG: Make CentralNotice admin group configurable [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/471099 (https://phabricator.wikimedia.org/T208112) (owner: Ejegg) [20:31:20] (PS2) AndyRussG: Make CentralNotice admin group configurable [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/471099 (https://phabricator.wikimedia.org/T208112) (owner: Ejegg) [20:32:05] argh what is with my connection [20:32:37] (CR) AndyRussG: [C: 2] Make CentralNotice admin group configurable [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/471099 (https://phabricator.wikimedia.org/T208112) (owner: Ejegg) [20:34:58] (Abandoned) Eileen: Exclude proliferous donors from main wmf_donor calc [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/473660 (https://phabricator.wikimedia.org/T208816) (owner: Eileen) [20:36:43] (CR) jerkins-bot: [V: -1] Make CentralNotice admin group configurable [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/471099 (https://phabricator.wikimedia.org/T208112) (owner: Ejegg) [20:37:15] (CR) AndyRussG: [V: 2 C: 2] Make CentralNotice admin group configurable [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/471099 (https://phabricator.wikimedia.org/T208112) (owner: Ejegg) [20:44:51] (CR) jenkins-bot: Make CentralNotice admin group configurable [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/471099 (https://phabricator.wikimedia.org/T208112) (owner: Ejegg) [20:59:03] Fundraising-Backlog, Wikimedia-Fundraising, fundraising-tech-ops, Operations: Frdev1001 server and mysql access - https://phabricator.wikimedia.org/T206478 (cwdent) Open>Resolved @jkim_wikimedia cleaning house, please re-open if you need help. [21:01:27] ejegg: so should we deploy this ? https://gerrit.wikimedia.org/r/#/c/wikimedia/fundraising/crm/+/474951/-1..2 [21:02:05] yep, that looks good [21:02:46] jgleeson: sorry, are you still around for deploying that? [21:03:07] ejegg, yep just issue the f_c_u call [21:03:21] ok, looks like the merge still needs a +2? [21:03:29] ooooooooohhhh [21:03:34] that will explain why nothing changed [21:04:02] (CR) Jgleeson: [C: 2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/474951 (owner: Jgleeson) [21:05:22] (Merged) jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/474951 (owner: Jgleeson) [21:05:41] ok lets try that again [21:07:41] (PS1) Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/474991 [21:07:52] (CR) Eileen: [C: 2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/474991 (owner: Eileen) [21:07:55] deployed ejegg & eileen [21:08:01] thanks jgleeson [21:08:09] want to !log it? [21:08:10] cool [21:08:29] (Merged) jenkins-bot: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/474991 (owner: Eileen) [21:08:46] !log civicrm changed from a31dbefc61 to f4127d5316 [21:08:47] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [21:08:56] and dash login is working again! [21:09:11] charts still taking a hefty amt of time to load [21:09:17] nice! [21:09:23] I should see if some index hints help... [21:09:23] ejegg: I’m seeing a merge conflict I think [21:09:38] maybe not [21:09:58] eileen: after what jgleeson just deployed should just be your latest two patches [21:10:11] ejegg: ok they are merging now [21:12:37] !log civicrm revision changed from f4127d5316 to 013807a7b9, config revision is 684ec9b7c0 [21:12:38] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [21:13:39] ejegg: I’m a bit annoyed with the drupal navigation - I think we should add admin_menu module [21:14:16] eileen: oh? what's the upshot with that one? [21:14:35] I can put it on staging if you want to see it [21:14:51] it adds a top menu in drupal that makes it easy to get around drupal [21:15:13] sure, i'd love to see it on staging [21:22:37] (PS1) Eileen: Add admin menu extenstion [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/474995 [21:26:14] ejegg: try on a drupal page on staging now - top bar [21:28:12] eileen: oh cool, it doesn't take up space on civi pages then? [21:28:21] ejegg: nope [21:28:28] that'd be my only objection [21:30:49] already found a win with index hints for the fraud % query [21:31:52] ejegg: that is a separate query? [21:32:27] so the issue happens when you have one index that is really good for a query - ie. contact_id is a really good index [21:32:33] it's one of the widgets on the dash [21:32:37] & then you have one that doesn’t add much [21:32:44] like contribution_status_id [21:32:54] & it’s best to just use contact_id [21:33:12] rather than a convoluted attempt to build a combined index [21:33:18] yep, this query should have just used date, but it was also using the contribution_tracking_id [21:33:47] (PS1) Ejegg: Index hint for fraud % query [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/474998 [21:43:26] hmm, what's freezing up jobs on civi now? [21:43:33] just looking [21:43:46] I was just trying to enable an extension but that shouldn’t kill it [21:44:25] it’s super unresponsive [21:44:34] just trying to load mysql & slooooowww [21:45:06] it’s lke when the disk check was running [21:45:59] top not showing something consistently at the top [21:46:55] hmm, cwd any ideas? [21:47:11] looks like there IS an md3_raid1 process happening [21:47:27] hmmm [21:47:30] i'll look [21:47:47] which is the comand that shows that? I know it was in an email [21:48:25] shall I email MG, DS & let them know we are aware of a prob & digging in? [21:48:43] eileen: I just saw it in the 'top' output [21:48:48] ah ok [21:49:11] apache and php are often taking a lot tho [21:49:48] it’s responsive again now [21:51:12] Fundraising Sprint Vestigial tails shoot from the hip, Fundraising Sprint Window dressing is mostly olive oil, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: acl for easy export of civi data - https://phabricator.wikimedia.org/T208270 (Eileenmcnaughton) @MBeat33 @Leanne... [21:54:01] oh nice, 'c' key when running top toggles display of full command lines [21:54:52] cwd - we have a trigger update to run - it improves some performance [21:55:57] ok [21:56:08] looks like php doing the thrashing to me [21:56:22] i would think the md* procs are probably normal for software raid [21:57:13] hmm, batch merge is often a big cpu user [21:58:04] guessing a lot of that is just waiting for queries to come back tho [21:59:08] well, we can at least tell the running_job_list not to email when it gets hung up for a minute [21:59:21] that's not exactly mission-critical stuff [21:59:36] though I guess it's got value as a canary [22:00:01] (PS2) Eileen: Add admin menu extenstion [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/474995 [22:01:15] (PS1) AndyRussG: $wgNoticeProtectGroup -> $wgCentralNoticeMessageProtectRight [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/475001 (https://phabricator.wikimedia.org/T208109) [22:01:17] (PS1) AndyRussG: Protect banner components in MW NS [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/475002 (https://phabricator.wikimedia.org/T208110) [22:01:56] (CR) AndyRussG: [C: 2] $wgNoticeProtectGroup -> $wgCentralNoticeMessageProtectRight [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/475001 (https://phabricator.wikimedia.org/T208109) (owner: AndyRussG) [22:08:18] cwd updated triggers are in my home dir triggers21nov.mysql [22:11:29] eileen: could you enter a task for that? no time right this second plus i'm on kind of unreliable internet rn [22:11:38] would hate to fry the db and disappear [22:11:41] cwd sure [22:11:54] i can do it this evening when i get home [22:12:36] ejegg: do you think we should push out after thanksgiving to respect code chill? [22:13:30] eileen: hmm, I'd be happier to get it out this evening if possible [22:13:39] I'll be around all tomorrow to notice any weirdness [22:13:42] ok - cool - then cwd that would be great [22:14:16] cwd the fix improves query indexing on query that happens all the time - but only really matters much for contacts with many contributions [22:14:54] eileen: cool. will you be around in a few hours? [22:15:09] Wikimedia-Fundraising-CiviCRM, fundraising-tech-ops: Reload triggers to pick up index improvement - https://phabricator.wikimedia.org/T210016 (Eileenmcnaughton) [22:15:11] cwd yep! [22:15:16] https://phabricator.wikimedia.org/T210016 [22:15:19] great [22:15:21] just in case [22:15:23] thanks! [22:16:59] Jeff_Green: the PCI rule for inactive accounts is 90 days right? [22:17:25] yes, I think so [22:29:04] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, fundraising-tech-ops: New Engage Civi user - Mark S. - https://phabricator.wikimedia.org/T209316 (cwdent) Open>Resolved a:cwdent @LeanneS thanks! Closing, but re-open if there are problems. [22:31:31] (CR) jerkins-bot: [V: -1] $wgNoticeProtectGroup -> $wgCentralNoticeMessageProtectRight [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/475001 (https://phabricator.wikimedia.org/T208109) (owner: AndyRussG) [22:44:42] Fundraising-Backlog: renew civicrm certificate - https://phabricator.wikimedia.org/T210017 (MNoorWMF) [22:49:33] Fundraising-Backlog: renew civicrm certificate - https://phabricator.wikimedia.org/T210017 (cwdent) @MNoorWMF I sent you a new cert on 11/13, can you check your mail from then? Are you stateside at the moment? If so I can SMS the password. [22:51:03] Fundraising-Backlog: Need updated CiviCRM cert for new computer - https://phabricator.wikimedia.org/T210021 (CCogdill_WMF) [22:52:28] Fundraising-Backlog, fundraising-tech-ops: renew civicrm certificate - https://phabricator.wikimedia.org/T210017 (cwdent) [22:53:06] Fundraising Tech Backlog, Wikimedia-Fundraising-CiviCRM: we need a failsafe deployment process for civicrm triggers/procedures - https://phabricator.wikimedia.org/T210023 (Jgreen) [22:53:40] Fundraising-Backlog, fundraising-tech-ops, Epic: Clarify fundraising cluster account guidelines - https://phabricator.wikimedia.org/T210024 (cwdent) [23:08:01] (CR) AndyRussG: [V: 2 C: 2] $wgNoticeProtectGroup -> $wgCentralNoticeMessageProtectRight [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/475001 (https://phabricator.wikimedia.org/T208109) (owner: AndyRussG) [23:13:05] (Merged) jenkins-bot: $wgNoticeProtectGroup -> $wgCentralNoticeMessageProtectRight [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/475001 (https://phabricator.wikimedia.org/T208109) (owner: AndyRussG) [23:20:42] (CR) jenkins-bot: $wgNoticeProtectGroup -> $wgCentralNoticeMessageProtectRight [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/475001 (https://phabricator.wikimedia.org/T208109) (owner: AndyRussG) [23:21:18] (CR) AndyRussG: [C: 2] Protect banner components in MW NS [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/475002 (https://phabricator.wikimedia.org/T208110) (owner: AndyRussG) [23:26:53] (PS1) Ejegg: Add config for 2018 campaign [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/475014 [23:31:20] Fundraising-Backlog: SSL cert - https://phabricator.wikimedia.org/T210032 (TSkaff) [23:34:10] Fundraising Sprint Window dressing is mostly olive oil, Fundraising-Backlog, FR-PayPal-ExpressCheckout: PayPal recurring audit 10/21/2018 duplicate - https://phabricator.wikimedia.org/T209294 (XenoRyet) I believe this has to do with the paypal recurring issues we've been dealing with previously. I n... [23:42:41] (CR) Eileen: [C: 2] "Makes sense" [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/475014 (owner: Ejegg) [23:44:12] (Merged) jenkins-bot: Add config for 2018 campaign [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/475014 (owner: Ejegg) [23:49:18] Fundraising Sprint Window dressing is mostly olive oil, Fundraising-Backlog, FR-PayPal-ExpressCheckout: PayPal recurring audit 10/21/2018 duplicate - https://phabricator.wikimedia.org/T209294 (Ejegg) @XenoRyet I see 105 rows from this query: ` lang=sql select count(*) from wmf_contribution_extra wca1... [23:54:36] (CR) jerkins-bot: [V: -1] Protect banner components in MW NS [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/475002 (https://phabricator.wikimedia.org/T208110) (owner: AndyRussG) [23:58:39] Fundraising Sprint Window dressing is mostly olive oil, Fundraising-Backlog, FR-PayPal-ExpressCheckout: PayPal recurring audit 10/21/2018 duplicate - https://phabricator.wikimedia.org/T209294 (Ejegg) Shoot, there's at least 1 from last Wednesday, and we haven't deployed any additional fixes since the...