[08:44:05] (CR) Thiemo Mättig (WMDE): [C: 2] Use https for link to meta.wikimedia.org [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/361288 (owner: Umherirrender) [08:47:08] (Merged) jenkins-bot: Use https for link to meta.wikimedia.org [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/361288 (owner: Umherirrender) [14:27:00] Fundraising Sprint Freshmaking, Fundraising-Backlog, MediaWiki-extensions-CentralNotice, Patch-For-Review, Unplanned-Sprint-Work: Summary of campaign settings changes is not logged in CentralNotice logs when modified using Special:CentralNotice ... - https://phabricator.wikimedia.org/T110315#3379068 [14:33:43] Fundraising-Backlog, MediaWiki-extensions-CentralNotice: All CentralNotice log pages should have filters - https://phabricator.wikimedia.org/T168870#3379075 (Pcoombe) [15:33:06] cwd did vagrant install correctly for you on the first go or did you have to do anything? I ask because there have been a bunch of assumptions i've had to handle (like the directory being in /vagrant) and now it's failing because it tries to enable drupal modules outside the drupal directory [15:35:01] mepps: yeah there will be much fiddling required :) [15:35:33] you are running the civi install scripts? [15:36:51] currently just ran vagrant up under the fundraising role [15:39:24] cwd how do i run the civi install scripts? [15:39:54] do you mean going into the installer once drupal is set up? currently vagrant up fails [15:40:36] aah gotcha [15:42:17] mepps: i guess i would qualify, i've never had it work without mucho hackery [15:42:31] cwd ahh [15:42:39] the fundraising role is complicated [15:43:40] mepps: https://phabricator.wikimedia.org/T130243 [15:44:07] that is probably enough to send you running away [15:46:31] haha yeah i was doing this because i thought it'd be simpler than debugging my local setup... [16:19:29] mepps: i think, in time, it is simpler [16:19:47] plus you don't have to ruin your laptop when you hose your dev env [16:27:57] Fundraising-Backlog, MediaWiki-extensions-CentralNotice: CentralNotice: Add controls to purge banner content in Varnish for a specific language - https://phabricator.wikimedia.org/T168673#3379621 (DStrine) [16:29:06] Fundraising-Backlog, MediaWiki-extensions-CentralNotice, Easy: Clone button for CN campaigns - https://phabricator.wikimedia.org/T91078#3379624 (DStrine) [17:00:32] fr-tech: CONSULTANT: [17:00:32] Someone who'd rather climb a tree and tell a [17:00:32] lie than stand on the ground and tell the truth. [17:00:32] -- discuss. [17:47:48] fundraising-tech-ops, Operations, Patch-For-Review: Revisit paging strategy for frack servers - https://phabricator.wikimedia.org/T163368#3379980 (Jgreen) Open>Resolved a:Jgreen I think we resolved the core issues of this task, thus closing it. [17:50:19] Fundraising-Backlog, fundraising-tech-ops: Version control Jenkins config - https://phabricator.wikimedia.org/T154208#3380006 (Jgreen) Open>Invalid Jenkins is dead. Long live Jenkins. [17:53:46] Fundraising-Backlog, fundraising-tech-ops, Performance: Serve cache control headers for static resources on paymentswiki - https://phabricator.wikimedia.org/T114404#3380013 (Jgreen) [17:53:48] Fundraising-Backlog, fundraising-tech-ops, MediaWiki-extensions-DonationInterface, Epic, Performance: [Epic] Payments performance tuning - https://phabricator.wikimedia.org/T140311#3380012 (Jgreen) [17:54:12] Fundraising-Backlog, fundraising-tech-ops, Performance: Paymentswiki load.php should be cached - https://phabricator.wikimedia.org/T110394#3380015 (Jgreen) [17:54:14] Fundraising-Backlog, fundraising-tech-ops, MediaWiki-extensions-DonationInterface, Epic, Performance: [Epic] Payments performance tuning - https://phabricator.wikimedia.org/T140311#2459918 (Jgreen) [17:58:28] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, fundraising-tech-ops: Remove Engage Civi users and revoke SSL keys - https://phabricator.wikimedia.org/T114797#3380037 (Jgreen) @DStrine do you know whatever happened re. awight's comment re. imports? Do Engage users still need civi access? [18:03:17] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, fundraising-tech-ops: Remove Engage Civi users and revoke SSL keys - https://phabricator.wikimedia.org/T114797#3380062 (DStrine) We are not going to change this process. [18:03:32] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, fundraising-tech-ops: Remove Engage Civi users and revoke SSL keys - https://phabricator.wikimedia.org/T114797#3380063 (DStrine) Open>declined [18:46:54] mepps: katie brought to my attention how short staffed tech is this week, just want to reach out and say please don't hesitate to poke me with questions or whatever [18:47:09] thank you cwd! [18:47:15] "vagrant up" is the start of a great adventure [18:47:39] haha yeah still working on that--drush enable modules still isn't working but it seems to be a db error [18:47:50] yeah [18:48:23] it's a great way to learn the stack because you will have to unbreak basically everything [18:52:28] also occurs to me that awight was largely responsible for the fundraising role [18:52:40] * cwd is passed torch, hurls into grassy field [18:54:14] Now a little fire in a wild field were like an old lecher’s heart—a small spark, all the rest on ’s body cold. Look, here comes a walking fire. [18:54:31] * awight has been replaced by fortune -o bot [18:54:53] :) [18:56:15] lol the problem statement though--I think you're right that our vagrant role sometimes serves as the exact opposite of what it's intended to be. [18:56:27] s/reference implementation/rubik's cube/ [18:58:08] Fundraising Tech Backlog, Fundraising-Backlog, Epic: Write puppet (for vagrant) modules to provision all fundraising components - https://phabricator.wikimedia.org/T88658#3380140 (Jgreen) [18:59:19] multiversion is a scary funhouse [19:12:35] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Restore live civicrm database to staging to get time to run 4.7.21 upgrade - https://phabricator.wikimedia.org/T168574#3380189 (Jgreen) [19:16:16] cwd this might be a dumb question but in reading through the puppet manifests for the crm module--does vagrant read through those procedurally or are the various commands referenced elsewhere? i think the error i'm encountering lies in the drupal one because it wants to enable the modules before civicrm is set up [19:17:18] mepps: That's a pain point with puppet, it's mostly declarative so you have to explicitly create dependencies between resources. [19:17:30] https://docs.puppet.com/puppet/4.10/lang_relationships.html [19:18:09] Can you paste the error? [19:19:58] mepps: not a dumb question! puppet is arcane [19:21:12] i would be surprised if there was a remaining race condition in there but it's certainly possible [19:22:25] so this appears to be the initial error: ==> default: Notice: /Stage[main]/Crm::Drupal/Exec[enable_drupal_modules]/returns: Fatal error: Uncaught exception 'Exception' with message 'Port is not numeric' in /vagrant/srv/org.wikimedia.civicrm/civicrm/packages/DB/mysqli.php:330 [19:23:28] in looking at the log it's clear the drupal db is all set up but the civicrm db gets declared in it's own manifest so i'm wondering if this drupal setup is running before that happens causing this error [19:24:32] cwd: oh hey, here's one for the back pocket: https://docs.puppet.com/puppet/4.10/configuration.html#ordering [19:24:41] I've been using "random" for personal projects, it helps a lot. [19:24:48] "this appears to be the initial error" <- you really summed up debugging puppet [19:25:48] awight: nice [19:25:54] like a tiny chaos monkey [19:26:44] mepps: That doesn't actually look like an ordering issue [19:26:51] weeeird. [19:27:00] yeah that is freaky [19:27:06] almost sounds like a platform difference [19:27:13] I would take a look at the settings.php or settings_local.php [19:27:28] see what surprises lurk within $DATABASES [19:36:03] Fundraising Tech Backlog, Fundraising-Backlog, Tracking: Fundraising Tech Staging (tracking) - https://phabricator.wikimedia.org/T88657#3380292 (Jgreen) [19:36:05] Fundraising Tech Backlog, Fundraising-Backlog, fundraising-tech-ops: overhaul payments-wiki deployment process - https://phabricator.wikimedia.org/T136963#3380290 (Jgreen) Open>Invalid This is a vague/existential task, although nice to have it's not clear enough what we're trying to achieve t... [19:48:21] AndyRussG: meeting? [19:49:02] cwd: and Jeff_Green do you have anything to share with frtech tday? [19:49:09] *today [19:49:32] dstrine: good question [19:49:54] dstrine: nothing in particular but i am available if you got something [19:50:11] i guess we could chat about the results of the security audit, but feels a little premature b/c they're supposed to send us a revised report, and I haven't got input yet from our security folks [19:50:36] yeah, basically all of fr tech is out this week too [19:50:59] ok, then let's put that on the agenda for next time [19:51:13] sounds good [19:53:06] ok so nothing for today? [19:53:11] right [19:55:38] Fundraising Sprint Loose Lego Carpeting, Fundraising-Backlog, MediaWiki-extensions-CentralNotice: CentralNotice: Add controls to purge banner content in Varnish for a specific language - https://phabricator.wikimedia.org/T168673#3380348 (DStrine) [19:59:25] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, fundraising-tech-ops: Ensure that CiviCRM triggers are always the same on staging as on production - https://phabricator.wikimedia.org/T159507#3069824 (Jgreen) Aren't there times when production and staging are intentionaly not in sync, i.e. when we... [20:00:19] Fundraising-Backlog, MediaWiki-extensions-CentralNotice: CentralNotice device selector checkboxes look all weird - https://phabricator.wikimedia.org/T168910#3380354 (Pcoombe) [20:01:33] Fundraising-Backlog, fundraising-tech-ops: Try fail2ban on payments - https://phabricator.wikimedia.org/T136110#3380372 (Jgreen) [20:01:36] Fundraising-Backlog: Produce failure signals from the application which indicate bad behavior - https://phabricator.wikimedia.org/T137239#3380370 (Jgreen) Open>Invalid [20:01:37] Fundraising-Backlog, fundraising-tech-ops: Allow fr-tech to block IPs - https://phabricator.wikimedia.org/T136111#3380371 (Jgreen) [20:03:49] Fundraising-Backlog, fundraising-tech-ops: Try fail2ban on payments - https://phabricator.wikimedia.org/T136110#3380374 (Jgreen) [20:05:02] Fundraising-Backlog, fundraising-tech-ops: Try fail2ban on payments - https://phabricator.wikimedia.org/T136110#2323572 (Jgreen) a:Jgreen>None [20:08:26] fundraising-tech-ops: fix freeradius vs libpam-yubico too many open files bug - https://phabricator.wikimedia.org/T148863#3380384 (Jgreen) p:Normal>Low [20:09:34] Fundraising-Backlog, Documentation: Document paymentswiki config VCS on collabwiki - https://phabricator.wikimedia.org/T134221#3380385 (Jgreen) [20:10:36] Fundraising-Backlog, monitoring, Epic: [EPIC] Improve Fundraising monitoring, alert, and high-level error handling - https://phabricator.wikimedia.org/T136169#3380390 (Jgreen) [20:12:14] Fundraising-Backlog: Revoke AWight's donatewiki account - https://phabricator.wikimedia.org/T168430#3380392 (Jgreen) [20:12:46] Fundraising-Backlog: Revoke AWight's donatewiki account - https://phabricator.wikimedia.org/T168430#3364301 (Jgreen) retagging Fundraising-Backlog because fr-tech-ops does not administer donatewiki [20:13:16] Fundraising-Backlog, Epic: [Epic] Revoke AWight fundraising privileges - https://phabricator.wikimedia.org/T168421#3380398 (Jgreen) [20:13:18] Fundraising-Backlog: Revoke AWight's CiviCRM account and SSL cert - https://phabricator.wikimedia.org/T168423#3380395 (Jgreen) Open>Resolved a:Jgreen civicrm account is closed too [20:16:01] Fundraising-Backlog, Epic: [Epic] Revoke AWight fundraising privileges - https://phabricator.wikimedia.org/T168421#3380401 (Jgreen) [20:16:03] fundraising-tech-ops: Unsubscribe AWight from fr-tech internal lists - https://phabricator.wikimedia.org/T168431#3380399 (Jgreen) Open>Invalid I put in an equivalent request to OIT... [20:54:39] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, fundraising-tech-ops: Slow login on CiviCRM - https://phabricator.wikimedia.org/T130784#3380452 (Jgreen) Open>Invalid closing for staleness and lack of information [20:56:03] Fundraising-Backlog, fundraising-tech-ops: adjust fr-log-announcer to use IRC more securely - https://phabricator.wikimedia.org/T122104#3380455 (Jgreen) [20:59:21] Fundraising-Backlog, fundraising-tech-ops: adjust fr-log-announcer to use IRC more securely - https://phabricator.wikimedia.org/T122104#3380459 (Jgreen) [21:01:15] Fundraising-Backlog, fundraising-tech-ops: Don't send us all the cron spam - https://phabricator.wikimedia.org/T119452#3380460 (Jgreen) Open>declined task died on the vine... [21:05:52] Fundraising-Backlog, fundraising-tech-ops: Figure out why we can't get information about the causes of deadlocks - https://phabricator.wikimedia.org/T149275#3380474 (Jgreen) Open>Resolved Closing because I think we've fixed this as best we can at this point. [21:20:52] Fundraising Tech Backlog, Fundraising-Backlog, fundraising-tech-ops: overhaul payments-wiki deployment process - https://phabricator.wikimedia.org/T136963#3380512 (Jgreen) [21:20:54] Fundraising Tech Backlog, Fundraising-Backlog, MediaWiki-extensions-DonationInterface: Adjustable load balancer to direct small samples of donors to staging payments - https://phabricator.wikimedia.org/T97745#3380513 (Jgreen) [21:20:56] Fundraising-Backlog, fundraising-tech-ops, Spike: Spike: How to configure a staging server for payments? - https://phabricator.wikimedia.org/T112857#3380509 (Jgreen) stalled>Resolved a:Jgreen Closing task for lack of action, we already have a task about restoring payments1004 as a staging... [21:22:35] Fundraising-Backlog, Operations, Technical-Debt: Determine if benefactorevents.wikimedia.org should be hosted on the production cluster or still on Microsoft Azure - https://phabricator.wikimedia.org/T166240#3380515 (Jgreen) [21:23:10] Fundraising-Backlog, FR-ActiveMQ, Documentation: Documentation: Update mw:Fundraising_tech/Message_queues to reflect new landscape - https://phabricator.wikimedia.org/T147583#3380516 (Jgreen) [21:24:08] Fundraising-Backlog, MediaWiki-extensions-DonationInterface: Provision PSP maintenance scripts to the CRM box - https://phabricator.wikimedia.org/T142659#3380519 (Jgreen) Removing fr-tech-ops until there's something we can deploy. [21:25:02] Fundraising Sprint Vengaboys, Fundraising Sprint William Shatner, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Script to compile civicrm into deployment form - https://phabricator.wikimedia.org/T115925#3380521 (Jgreen) [21:26:29] Fundraising-Backlog, Epic: [epic] PCI gap analysis and Improvements - https://phabricator.wikimedia.org/T77912#3380528 (Jgreen) [21:27:31] Fundraising-Backlog, Release-Engineering-Team (Watching / External), Spike: Spike: decide how payments-wiki deployment process should relate to the core MW deployment process - https://phabricator.wikimedia.org/T130658#3380531 (Jgreen) [21:28:56] Fundraising Sprint Baudelaire Bowdlerizer, Fundraising Sprint Pretending This Isn't Happening, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, and 4 others: Migrate pending consumers to new queue and finish cleanup - https://phabricator.wikimedia.org/T131274#3380532 (Jgreen) [21:38:31] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Changing contact records from individual records to organization records - https://phabricator.wikimedia.org/T156193#3380556 (DStrine) [21:56:11] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Epic: [EPIC] Engage exclusively uses spreadsheet imports - https://phabricator.wikimedia.org/T114683#3380619 (DStrine)