[00:10:12] !log update civicrm from 187238fccb2b59378dececac7055a5320ce0269b to b6f7dc3e3cb8d016c4bd42a449400616ed254ae1 [00:10:25] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [02:08:40] Fundraising Sprint RadioActivewear, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, FR-Email, Patch-For-Review: Omnimail recipient load (silently) broken - https://phabricator.wikimedia.org/T175394#3616768 (Eileenmcnaughton) This is a bit more serious than I realised. The issue is that I... [02:16:10] (PS1) Eileen: Fix date miscalculation on retrieving mailings. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/378830 (https://phabricator.wikimedia.org/T175394) [08:02:23] (PS1) Eileen: CRM-21011 Sort out tag descriptions when displaying better [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/378846 [12:57:40] fundraising-tech-ops, Operations, netops, ops-codfw: connect second ethernet interface for fundraising codfw hosts - https://phabricator.wikimedia.org/T176175#3617370 (Jgreen) >>! In T176175#3616476, @faidon wrote: > Ah! active/backup is safer indeed, but in my experience, I've seen many more iss... [13:06:12] Fundraising-Backlog, fundraising-tech-ops, Operations: Port fundraising stats off Ganglia - https://phabricator.wikimedia.org/T152562#3617381 (Jgreen) >>! In T152562#3616435, @Ejegg wrote: > For CiviCRM code: > > PHP client library: https://github.com/Jimdo/prometheus_client_php > Metric types: http... [13:30:50] fundraising-tech-ops, Operations, netops, ops-codfw: connect second ethernet interface for fundraising codfw hosts - https://phabricator.wikimedia.org/T176175#3617443 (Jgreen) a:Jgreen>Papaul [13:34:32] (CR) Mepps: [C: 2] Add CVV map variable for Ingenico [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/378813 (owner: Ejegg) [13:40:28] (Merged) jenkins-bot: Add CVV map variable for Ingenico [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/378813 (owner: Ejegg) [13:50:12] (PS6) Mepps: Adding getStatus tests [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/378257 [13:53:01] (CR) jerkins-bot: [V: -1] Adding getStatus tests [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/378257 (owner: Mepps) [14:07:53] (CR) Mepps: "Is this upstreamed or will it be?" [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/378846 (owner: Eileen) [14:21:10] (CR) Mepps: [C: 1] Optionally send more Minfraud parameters (1 comment) [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/275043 (https://phabricator.wikimedia.org/T128902) (owner: Ejegg) [15:09:18] hi mepps! [15:09:27] I'm about to do a DonationInterface deploy [15:09:55] it'll have all those library updates and the style fixes, along with the case change on those front-end module [15:09:58] s [15:10:09] Hi ejegg! Cool [15:22:26] Fundraising Sprint RadioActivewear, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, FR-Email, Patch-For-Review: Omnimail recipient load (silently) broken - https://phabricator.wikimedia.org/T175394#3617797 (CCogdill_WMF) Ah, bummer! I would vote to please re-import the data. This is going... [15:26:59] fundraising-tech-ops, Operations, netops, ops-codfw: connect second ethernet interface for fundraising codfw hosts - https://phabricator.wikimedia.org/T176175#3617810 (Papaul) a:Papaul>Jgreen @Jgreen Complete [15:40:51] (PS10) Ejegg: Optionally send more Minfraud parameters [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/275043 (https://phabricator.wikimedia.org/T128902) [15:55:00] (PS1) Ejegg: Update libraries, swap in new minFraud [extensions/DonationInterface/vendor] - https://gerrit.wikimedia.org/r/378939 [15:55:03] (CR) Ejegg: [C: 2] Update libraries, swap in new minFraud [extensions/DonationInterface/vendor] - https://gerrit.wikimedia.org/r/378939 (owner: Ejegg) [15:57:03] (PS1) Ejegg: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/378940 [15:57:37] (CR) Ejegg: [V: 2 C: 2] Update libraries, swap in new minFraud [extensions/DonationInterface/vendor] - https://gerrit.wikimedia.org/r/378939 (owner: Ejegg) [16:02:41] (CR) Ejegg: [C: 2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/378940 (owner: Ejegg) [16:03:26] (PS1) Ejegg: Update DonationInterface submodule [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/378943 [16:03:41] (CR) Ejegg: [C: 2] Rename 'variants' to 'form_variants' [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/378761 (owner: Ejegg) [16:03:50] (CR) Ejegg: [C: 2] Update DonationInterface submodule [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/378943 (owner: Ejegg) [16:12:06] (Merged) jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/378940 (owner: Ejegg) [16:16:26] Fundraising-Backlog, FR-PayPal-ExpressCheckout: Handle additional reason codes for Paypay-EC refunds - https://phabricator.wikimedia.org/T176225#3617986 (XenoRyet) [16:19:39] ejegg did you see my comment on the minfraud patch? [16:20:06] also that one test is still failing on getStatus whenever you can take a look [16:20:34] (Merged) jenkins-bot: Rename 'variants' to 'form_variants' [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/378761 (owner: Ejegg) [16:20:35] yeah, I'll split that snippet into its own file [16:20:39] (Merged) jenkins-bot: Update DonationInterface submodule [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/378943 (owner: Ejegg) [16:20:56] thanks for the CR! [16:22:02] XenoRyet: do you have an estimate for this: https://phabricator.wikimedia.org/T161121 [16:22:24] Yea, I'll put some points on there. [16:22:29] thanks! [16:23:04] That was the last old task from my little accounting project [16:24:15] Fundraising Sprint Far Beer, Fundraising Sprint Gondwanaland Reunification Engine, Fundraising Sprint Homebrew Hadron Collider, Fundraising-Backlog, and 3 others: Need to distinguish between paypal and paypal_ec for refund IPN messages - https://phabricator.wikimedia.org/T161121#3618025 (XenoRyet) [16:24:27] Nice [16:30:04] mepps / XenoRyet I'm about to give Robin an orientation on DonationInterface forms [16:30:16] in case either of you have advice for him [16:39:10] fundraising-tech-ops, MediaWiki-extensions-ContributionTracking: DB errors from missing ContributionTracking table - https://phabricator.wikimedia.org/T176229#3618108 (Bawolff) [17:27:11] ejegg should i work on tests for: https://gerrit.wikimedia.org/r/#/c/370656/ [17:27:41] mepps yeah, that would be great! [17:28:09] cool, i still can't get that one last test to pass on getStatus [17:51:50] mepps yeah, it was stumping me last night too. [17:52:02] I'll debug through it again after I get some lunch in me [18:08:19] Fundraising-Backlog: Get Kaitlin Thaney access to CiviCRM - https://phabricator.wikimedia.org/T176177#3616165 (CaitVirtue) No, she doesn't have access yet. [18:08:55] Fundraising-Backlog: Get Kaitlin Thaney access to CiviCRM - https://phabricator.wikimedia.org/T176177#3618546 (CaitVirtue) @LeanneS for visibility [18:24:05] Fundraising-Backlog, fundraising-tech-ops: Get Kaitlin Thaney access to CiviCRM - https://phabricator.wikimedia.org/T176177#3618602 (DStrine) [18:24:21] Fundraising-Backlog, fundraising-tech-ops: Get Kaitlin Thaney access to CiviCRM - https://phabricator.wikimedia.org/T176177#3616165 (DStrine) a:cwdent [18:24:54] Fundraising-Backlog, fundraising-tech-ops: Get Kaitlin Thaney access to CiviCRM - https://phabricator.wikimedia.org/T176177#3616165 (DStrine) @cwdent or @Jgreen can you help out? [18:29:39] Fundraising-Backlog, fundraising-tech-ops: Get Kaitlin Thaney access to CiviCRM - https://phabricator.wikimedia.org/T176177#3618697 (cwdent) Yes this is on my to-do list but as it has been less than 24 hours it has not reached the top yet. [19:17:51] !log updated payments-wiki from 26b16eadc119e3edddec83ac0e680ac60c43ecaf to 896f16ac380aaa6022749b395f9187ecf4bc802b [19:18:04] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [19:20:22] woohoo, new minFraud library is working! [19:20:34] giving us warnings about sending postal code "0" though [19:20:57] I guess we shouldn't send postal in those cases [19:24:33] Fundraising Sprint Quill Pencil, Fundraising Sprint RadioActivewear, Fundraising-Backlog, MediaWiki-extensions-CentralNotice, and 2 others: CN Campaign Suppression prior to scheduled start time - https://phabricator.wikimedia.org/T175358#3619008 (AndyRussG) Hi! I've successfully reproduced this t... [19:33:09] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Add placeholding & limit to omnimail recipients, like groupmember - https://phabricator.wikimedia.org/T176255#3619036 (Eileenmcnaughton) [19:42:25] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: UI batch merge dropping limit at the end - https://phabricator.wikimedia.org/T176256#3619077 (Eileenmcnaughton) [19:47:25] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Manage groups page seems to be refreshing groups when it shouldn't - https://phabricator.wikimedia.org/T176258#3619122 (Eileenmcnaughton) [19:49:23] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, FR-WMF-Audit: WX audit parser: support alternate directory for log files - https://phabricator.wikimedia.org/T176259#3619141 (Ejegg) [19:50:17] PROBLEM - check_mysql on frdb2001 is CRITICAL: Slave IO: Preparing Slave SQL: Yes Seconds Behind Master: (null) [19:50:51] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Manage groups page seems to be refreshing groups when it shouldn't - https://phabricator.wikimedia.org/T176258#3619157 (DStrine) a:Eil>Eileenmcnaughton [19:51:24] Fundraising Sprint RadioActivewear, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Manage groups page seems to be refreshing groups when it shouldn't - https://phabricator.wikimedia.org/T176258#3619122 (DStrine) [19:51:59] Fundraising Sprint Quill Pencil, Fundraising Sprint RadioActivewear, Fundraising-Backlog, FR-Ingenico, and 3 others: spike: investigate creating an ingenico form with no city and state - https://phabricator.wikimedia.org/T151769#2827507 (Ejegg) This works! https://payments.wikimedia.org/index.p... [19:52:29] Fundraising Sprint RadioActivewear, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Add placeholding & limit to omnimail recipients, like groupmember - https://phabricator.wikimedia.org/T176255#3619167 (DStrine) [19:55:17] PROBLEM - check_mysql on frdb2001 is CRITICAL: Slave IO: Preparing Slave SQL: Yes Seconds Behind Master: (null) [19:57:48] Fundraising-Backlog, fundraising-tech-ops: Get Kaitlin Thaney access to CiviCRM - https://phabricator.wikimedia.org/T176177#3619183 (Eileenmcnaughton) I've added a CiviCRM account for her - she should have an email about that now [19:58:37] Fundraising Sprint RadioActivewear, Fundraising-Backlog: Persistent colors for labels in Grafana - https://phabricator.wikimedia.org/T176173#3619184 (DStrine) [20:02:36] (CR) Ejegg: [C: 2] CRM-21011 Sort out tag descriptions when displaying better [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/378846 (owner: Eileen) [20:05:17] RECOVERY - check_mysql on frdb2001 is OK: Uptime: 517463 Threads: 2 Questions: 16732079 Slow queries: 34335 Opens: 508 Flush tables: 1 Open tables: 607 Queries per second avg: 32.334 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 [20:06:04] (Merged) jenkins-bot: CRM-21011 Sort out tag descriptions when displaying better [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/378846 (owner: Eileen) [20:09:03] (CR) Ejegg: [C: 2] Fix date miscalculation on retrieving mailings. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/378830 (https://phabricator.wikimedia.org/T175394) (owner: Eileen) [20:15:05] (Merged) jenkins-bot: Fix date miscalculation on retrieving mailings. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/378830 (https://phabricator.wikimedia.org/T175394) (owner: Eileen) [20:22:50] Fundraising-Backlog, fundraising-tech-ops, Operations: Port fundraising stats off Ganglia - https://phabricator.wikimedia.org/T152562#3619242 (cwdent) [20:22:52] fundraising-tech-ops: refactor collect_frqueue_redis_via_gmetric to prometheus - https://phabricator.wikimedia.org/T175044#3619241 (cwdent) Open>Resolved [20:24:09] (PS1) Eileen: CiviCRM submodule update [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/379001 [20:36:42] brb, relocating to nearby cafe [20:49:27] (CR) Eileen: [C: 2] CiviCRM submodule update [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/379001 (owner: Eileen) [20:52:56] (Merged) jenkins-bot: CiviCRM submodule update [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/379001 (owner: Eileen) [20:54:55] ejegg: I wanted to deploy a composer update but should I commit & push up everythng - seems to include minfraud & you said there was an issue [20:55:31] eileen: ooh, good call [20:55:52] the postal code thing is ok for now, but I should update the donationinterface-under-crm settings [20:56:04] (PS1) Eileen: Vendor updates, Omnimail, SmashPig, Donation interface, minfraud [wikimedia/fundraising/crm/vendor] - https://gerrit.wikimedia.org/r/379042 [20:56:05] doing so now [20:56:31] ejegg: https://gerrit.wikimedia.org/r/#/c/379042/ is what it looks like [20:56:40] ug - that's without php 54 removed [20:56:51] cool, let me check which rev of DonationInterface made it in [20:56:54] also: aargh [20:56:59] what a pain [20:57:58] ok, the revision looks good. updating those settings [21:01:59] (CR) jerkins-bot: [V: -1] Vendor updates, Omnimail, SmashPig, Donation interface, minfraud [wikimedia/fundraising/crm/vendor] - https://gerrit.wikimedia.org/r/379042 (owner: Eileen) [21:03:34] ok eileen, got the new settings pushed to the settings repo - they should come along with the funcraising_code_update [21:03:55] funkraising. obviously. [21:04:46] Fundraising-Backlog, fundraising-tech-ops: Network errors and replication recovery - https://phabricator.wikimedia.org/T176266#3619388 (cwdent) [21:07:45] cwd - was there a file we could add in vendor to stop linting specific php 5.4 files? [21:08:29] i...think so? [21:08:33] i'll ask [21:09:51] (PS1) Ejegg: Record the form variant in contribution tracking [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/379079 (https://phabricator.wikimedia.org/T173869) [21:09:55] thanks [21:10:29] eileen ooh [21:10:41] think it's this: jakub-onderka/php-parallel-lint [21:11:02] then in the test script: parallel-lint . --exclude [21:11:04] (PS2) Eileen: Vendor updates, Omnimail, SmashPig, Donation interface, minfraud [wikimedia/fundraising/crm/vendor] - https://gerrit.wikimedia.org/r/379042 [21:11:06] oh derp [21:11:17] sorry, that's not going to work for the vendor submodule [21:11:29] dang I know we got it to work somehwere [21:12:10] Fundraising-Backlog, fundraising-tech-ops: Network errors and MySQL replication recovery - https://phabricator.wikimedia.org/T176266#3619430 (cwdent) [21:13:48] Fundraising Sprint Quill Pencil, Fundraising Sprint RadioActivewear, Fundraising-Backlog, FR-Ingenico, and 3 others: spike: investigate creating an ingenico form with no city and state - https://phabricator.wikimedia.org/T151769#3619434 (Ejegg) One last bit to review, so we record the variant: h... [21:13:58] eileen: https://github.com/wikimedia/integration-config/blob/master/jjb/macro.yaml#L481-L488 [21:14:09] based on that... looks unlikely that there is a way to override yet [21:14:32] :-( [21:14:59] phooey [21:15:33] shall we ask releng if they have any time for a fix? [21:17:20] (CR) jerkins-bot: [V: -1] Vendor updates, Omnimail, SmashPig, Donation interface, minfraud [wikimedia/fundraising/crm/vendor] - https://gerrit.wikimedia.org/r/379042 (owner: Eileen) [21:17:43] (PS2) Ejegg: Retry deadlocked inserts, take two [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/377903 (https://phabricator.wikimedia.org/T118487) [21:17:59] it would be nice - this does hurt us ongoingly [21:18:44] what is the file that doesn't pass lint? [21:18:47] (CR) Ejegg: "Yes, the grepping is horrible, but the problem is that PEAR's db package doesn't even pass the db error codes up nicely." [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/377903 (https://phabricator.wikimedia.org/T118487) (owner: Ejegg) [21:18:58] cwd it's a php5.4 shim [21:19:07] actually at the moment I don't know if an ignore at lint level would do it https://integration.wikimedia.org/ci/job/php56lint/105/consoleFull [21:19:18] aah [21:19:21] that lint screams is redeclaring built-in stuff [21:19:58] https://github.com/wikimedia/integration-jenkins/blob/master/bin/git-changed-in-head#L73-L74 [21:20:08] i guess this would be the place to override [21:20:14] but it doesn't look fun [21:20:52] (PS3) Eileen: Vendor updates, Omnimail, SmashPig, Donation interface, minfraud [wikimedia/fundraising/crm/vendor] - https://gerrit.wikimedia.org/r/379042 [21:21:24] cwd oh man, that's really silly to be excluding lint-specific stuff in that script [21:21:35] it should just take an exclude prefix argument [21:22:08] yeah [21:22:37] you can pass exclude to lint [21:23:06] but doesn't one of the other repos use this [21:23:07] -c, --configuration=CONFIGURATION Read configuration from config file (default: ./.phplint.yml). [21:23:20] ie can we add a .phplint.yml file? [21:23:27] Fundraising-Backlog, fundraising-tech-ops: Network errors and MySQL replication recovery - https://phabricator.wikimedia.org/T176266#3619488 (ayounsi) The BGP session over IPsec between the two sites has been regularly flapping, and thus briefly breaking the TCP session. Unless urgent, I'd recommend wait... [21:23:41] eileen: other repos user that php-parallel-lint package, but it's a composer package itself [21:24:03] so we'd have to do something funky to get it to run on our vendor repo, I think [21:24:08] ah [21:24:17] (CR) jerkins-bot: [V: -1] Vendor updates, Omnimail, SmashPig, Donation interface, minfraud [wikimedia/fundraising/crm/vendor] - https://gerrit.wikimedia.org/r/379042 (owner: Eileen) [21:24:33] that last comment on replag is a bit head-hurty - ie. there might be a network level issue? [21:26:55] oh jeez [21:27:24] well, that would be easier than fixing deep Civi stuff, I hope [21:28:29] yeah deep civi stuff doesn't seem changed enough [21:29:40] eileen, ejegg - bgp problems are a real possiblity for what has been going on with 2001 [21:29:52] (PS4) Eileen: Vendor updates, Omnimail, SmashPig, Donation interface, minfraud [wikimedia/fundraising/crm/vendor] - https://gerrit.wikimedia.org/r/379042 [21:29:58] whether that has any correlation with the other dbs lagging i have no idea [21:31:24] yeah… [21:32:16] (PS11) Ejegg: Optionally send more Minfraud parameters [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/275043 (https://phabricator.wikimedia.org/T128902) [21:33:46] (PS12) Ejegg: Optionally send more Minfraud parameters [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/275043 (https://phabricator.wikimedia.org/T128902) [21:34:50] ejegg: finally verified https://gerrit.wikimedia.org/r/#/c/379042/ [21:34:59] phew [21:35:02] do you want to run your eye over changes [21:35:07] only one is mine [21:35:11] heh, I'll take a look [21:35:22] pretty huge with all the phpcs fixes [21:36:11] but it does look like the right set of packages added/removed/changed [21:37:37] a few stray php54 polyfill bits crept into the composer/autoload* files is all [21:38:06] only one that concerns me is the SessionHandlerInterface in autoload_static [21:41:04] Fundraising-Backlog, fundraising-tech-ops: Network errors and MySQL replication recovery - https://phabricator.wikimedia.org/T176266#3619535 (cwdent) @ayounsi thank you for the info! Agreed that digging in right before the firewall switch is not a good use of time. In the mean time I will look into the... [21:42:07] (PS1) Ejegg: Don't send empty or '0' address fields to minFraud [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/379120 [21:44:02] (PS2) Ejegg: Don't send empty or '0' address fields to minFraud [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/379120 [21:49:20] (PS1) Ejegg: Remove old test harness [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/379123 [21:52:05] ejegg: are you doing that deploy? [21:52:20] eileen: the crm deploy? [21:52:24] I can if you'd like [21:52:34] either /or - I just wasn't clear who [21:52:42] Lemme just snip those last couple php54 polyfill bits out of autoload [21:53:42] ok [21:56:20] (PS5) Ejegg: Vendor updates, Omnimail, SmashPig, Donation interface, minfraud [wikimedia/fundraising/crm/vendor] - https://gerrit.wikimedia.org/r/379042 (owner: Eileen) [21:56:27] (PS1) Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/379124 [21:56:46] (CR) Ejegg: [C: 2] Vendor updates, Omnimail, SmashPig, Donation interface, minfraud [wikimedia/fundraising/crm/vendor] - https://gerrit.wikimedia.org/r/379042 (owner: Eileen) [21:57:57] (Abandoned) Eileen: Vendor updates, Omnimail, SmashPig, Donation interface, minfraud [wikimedia/fundraising/crm/vendor] - https://gerrit.wikimedia.org/r/379042 (owner: Eileen) [21:58:05] ejegg: arg - this was against master https://gerrit.wikimedia.org/r/#/c/379042/ [21:58:11] needed to be deploy didn't it [21:58:25] (Restored) Eileen: Vendor updates, Omnimail, SmashPig, Donation interface, minfraud [wikimedia/fundraising/crm/vendor] - https://gerrit.wikimedia.org/r/379042 (owner: Eileen) [21:58:26] fundraising-tech-ops, Operations, netops, Patch-For-Review: Move codfw frack to new infra - https://phabricator.wikimedia.org/T171970#3619622 (ayounsi) Open>Resolved > The fix has been committed on version 15.1X49-D110 which currently is expected to be released on 13th of Sept 2017. Firew... [21:58:27] eileen: the vendor submodule only has 'master' [21:58:34] yeah just realised [21:58:51] i freaked too soon [21:58:56] :) [21:59:46] (CR) Eileen: [C: 2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/379124 (owner: Eileen) [22:02:41] (Merged) jenkins-bot: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/379124 (owner: Eileen) [22:03:19] (CR) Eileen: "recheck" [wikimedia/fundraising/crm/vendor] - https://gerrit.wikimedia.org/r/379042 (owner: Eileen) [22:06:26] ejegg: can I get away with v+2 on this since the only reason it isn't is my abandon+ restore https://gerrit.wikimedia.org/r/#/c/379042/ [22:07:46] ah done [22:07:47] eileen: I just submitted it [22:08:36] (PS1) Eileen: Vendor submodule update [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/379127 [22:08:54] (CR) Eileen: [C: 2] Vendor submodule update [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/379127 (owner: Eileen) [22:09:10] cool - now got the submodule update trying [22:10:00] (Merged) jenkins-bot: Vendor submodule update [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/379127 (owner: Eileen) [22:10:37] ok ejegg all merged! [22:10:53] I can deploy [22:12:05] cool! [22:12:19] I'm messing around with some DonationInterface stuff, so that would be great [22:12:54] (PS1) Eileen: Fix last vendor commit [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/379128 [22:13:03] (CR) Eileen: [C: 2] Fix last vendor commit [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/379128 (owner: Eileen) [22:14:47] (CR) Ejegg: [C: -1] "post_process function still needs a rename, some test data doesn't match the GlobalCollect test cases. Also, maybe store the response arra" (5 comments) [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/378257 (owner: Mepps) [22:15:17] (Merged) jenkins-bot: Fix last vendor commit [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/379128 (owner: Eileen) [22:16:33] ejegg "vendor/addshore is not in git!" message - seems odd [22:16:42] wha? [22:17:01] lessee [22:17:05] What? [22:17:09] D [22:17:12] :D [22:17:18] lol [22:17:40] hehe, your cache wrapper has disappeared [22:17:41] What's occuring? :) [22:17:46] or appeared mysteriously [22:17:58] just one of our deploy tools getting confused [22:18:20] about the folder with your BagOStuffPsrCacheWrapper [22:18:26] if I point out vendor/amzn is not in git will amzn pop up on irc? [22:18:33] Aaaaah, that thing :) [22:18:42] haha, I wish I could get them to respond on GitHub [22:18:48] I'll go back to pretend bed then! [22:18:54] gnight! [22:19:07] Night! [22:19:40] ejegg: so I did a wrong vendor submodule commit (mine) & fixed to yours - is that causing the confusion ? [22:20:02] ah shoot, yep [22:20:08] I got in that same spot earlier [22:20:24] just say 'y' to each top-level dir [22:20:29] ok thanks [22:20:33] it'll delete em and then check out the new stuff [22:20:54] it's very scary! [22:21:25] yah [22:21:48] !log update civicrm from 9677cf7eac969d0f98492c1c91adfa8d33fefa63 to 0fb46767f0c86b3fc85c44e228fd7c1a7ae75e46 [22:22:01] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [22:22:33] rysync blaster changes looked sane [22:23:38] fundraising-tech-ops: fundraising_code_update could handle bad submodule shas better - https://phabricator.wikimedia.org/T176283#3619802 (Ejegg) [22:27:33] Fundraising Sprint RadioActivewear, Fundraising-Backlog, MediaWiki-extensions-DonationInterface: Message with blank payment_method and amount = 0 sent to payments-init - https://phabricator.wikimedia.org/T173347#3619835 (Ejegg) a:Ejegg [22:28:40] Fundraising-Backlog, MediaWiki-extensions-DonationInterface: Don't send malformed payment_init messages on muddled ResultSwitcher hits - https://phabricator.wikimedia.org/T176285#3619856 (Ejegg) [22:31:00] Fundraising Sprint Navel Warfare, Fundraising Sprint Outie Inverter, Fundraising Sprint Prank Seatbelt, Fundraising-Backlog, and 2 others: CentralNotice: JS selection widgets no longer work in interface to add a campaign - https://phabricator.wikimedia.org/T172023#3483202 (Ejegg) @AndyRussG this... [22:32:33] Fundraising Sprint RadioActivewear, Fundraising-Backlog, Patch-For-Review: process-control should make slow-starting jobs easier - https://phabricator.wikimedia.org/T171873#3478936 (Ejegg) a:Ejegg [22:41:37] (PS1) Ejegg: Fix empty( $thing->doStuff() ) use [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/379138 [22:45:33] XenoRyet: need help with anything? [22:45:50] I'm trying to resist the urge to pull more stuff into sprint [22:46:37] Heh, that struggle is real. [22:47:07] But no, nothing I particularly need right now. [22:47:50] there's a fair amount of stuff in review in case you get bored [22:48:17] Yea, I'll probably head there in a little bit. [22:48:29] be harsh, so I have stuff to fix! [22:48:40] Heh, I'll do my best! [22:48:50] (CR) Eileen: [C: 2] "Can't see any way this could cause a problem" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/359174 (owner: Ejegg) [22:52:39] (Merged) jenkins-bot: Define a constant to allow switching dbs for phpunit [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/359174 (owner: Ejegg) [22:58:31] !log manually running Omnirecipient.load from 2017-09-18 with accidentally low throttle setting [22:58:46] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [23:01:37] Fundraising-Backlog, FR-Ingenico: Determine if we need to change anything with Ingenico authorizations - https://phabricator.wikimedia.org/T170475#3619955 (Ejegg) Open>Resolved a:Ejegg I think we concluded that the answer is 'no' [23:15:18] PROBLEM - check_mysql on frdev1001 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1258 [23:15:18] PROBLEM - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1258 [23:20:18] PROBLEM - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1500 [23:20:18] PROBLEM - check_mysql on frdev1001 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1501 [23:25:08] PROBLEM - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1738 [23:25:18] PROBLEM - check_mysql on frdev1001 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1740 [23:30:08] PROBLEM - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1973 [23:30:18] PROBLEM - check_mysql on frdev1001 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1981 [23:35:08] PROBLEM - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2198 [23:35:18] PROBLEM - check_mysql on frdev1001 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2217 [23:35:18] PROBLEM - check_mysql on frdb2001 is CRITICAL: Cant connect to local MySQL server through socket /var/run/mysqld/mysqld.sock (2) [23:40:18] PROBLEM - check_mysql on frdev1001 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2452 [23:40:18] PROBLEM - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2421 [23:45:08] PROBLEM - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2650 [23:45:18] PROBLEM - check_mysql on frdev1001 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2688 [23:50:18] PROBLEM - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2626 [23:50:18] PROBLEM - check_mysql on frdev1001 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2923 [23:50:19] RECOVERY - check_mysql on frdb2001 is OK: Uptime: 880 Threads: 1 Questions: 700519 Slow queries: 58 Opens: 206 Flush tables: 1 Open tables: 220 Queries per second avg: 796.044 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1 [23:52:09] wat [23:53:30] unless they all catch up now [23:53:34] i will retract my wat [23:55:08] PROBLEM - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2516 [23:55:18] PROBLEM - check_mysql on frdev1001 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2760