[00:16:59] (PS1) Ejegg: Add fancy version of Thank You page for opt-in [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/508477 (https://phabricator.wikimedia.org/T218240) [00:17:16] cstone: OK, ^^^ should do it [00:17:34] I ended up making the shared bits into the child templates (top & bottom) [00:18:17] just so we didn't have to feed a custom parameter into the render call [00:25:33] Hi Jeff_Green! Shall I go ahead & take down campaigns? [00:25:43] hi tskaff, yes please! [00:27:38] Alrighty [00:28:46] They've been taken down. About how long so I can keep an eye out? [00:29:57] (PS1) Ejegg: Update triggers for new fields [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/508478 [00:30:09] ok eileen, ^^^ looks pretty good to me [00:32:06] !log disabled fundraising scheduled jobs for CiviCRM maintenance [00:32:09] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [00:34:50] tskaff: scheduled an hour, hopefully less [00:35:01] nothing on the front end should be broken though, just civi processing [00:38:25] (CR) Eileen: [C: +2] Update triggers for new fields [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/508478 (owner: Ejegg) [00:38:54] Thanks cwd! [00:39:19] ejegg: looks good - I think the DE Greenparty guy Patrick Figel submitted that fix that removes tracking 'modified_date' changes - which is good [00:40:32] ah, right, that makes sense. Though if there's no other field changing, I guess maybe modified_date shouldn't be updated in the first place? [00:43:57] (Merged) jenkins-bot: Update triggers for new fields [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/508478 (owner: Ejegg) [00:57:55] fr-tech any quick review love for https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/CentralNotice/+/508089, to get it on tomorrow's train? [00:57:58] thx in advance!!!! [00:58:29] AndyRussG: looks merged to me [00:59:15] ejegg: d'oh! thanks!!!!!!!!!!! [00:59:50] someone should review my review-requesting IRC pings [01:00:13] PROBLEM - check_mysql on frdev1001 is CRITICAL: Cant connect to local MySQL server through socket /var/run/mysqld/mysqld.sock (2 No such file or directory) [01:00:15] PROBLEM - check_puppetrun on frdev1001 is CRITICAL: CRITICAL: Puppet has 64 failures. Last run 3 minutes ago with 64 failures. Failed resources (up to 3 shown): Package[rssh],Package[aide-common],Package[libapache2-mod-php],Package[auditd] [01:06:17] PROBLEM - check_ipsec on americium is CRITICAL: Strongswan CRITICAL - ok: 0 not-conn: civi1001_v4 [01:06:53] i just did downtime for these [01:10:13] RECOVERY - check_mysql on frdev1001 is OK: Uptime: 113 Threads: 1 Questions: 1946 Slow queries: 27 Opens: 1416 Flush tables: 1 Open tables: 200 Queries per second avg: 17.221 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 [01:10:15] RECOVERY - check_puppetrun on frdev1001 is OK: OK: Puppet is currently enabled, last run 44 seconds ago with 0 failures [01:11:17] RECOVERY - check_ipsec on americium is OK: Strongswan OK - 1 ESP OK [01:17:13] Fundraising-Backlog, Analytics, Analytics-EventLogging, Analytics-Kanban, and 3 others: Fix EventLogging schemas that use array for items type - https://phabricator.wikimedia.org/T218617 (Samwilson) I've made [[https://meta.wikimedia.org/w/index.php?title=Schema%3ATemplateWizard&type=revision&dif... [01:55:01] Ok putting campaigns back up cwd and Jeff_Green [01:55:08] great [01:55:17] ty! [05:14:19] (PS1) AndyRussG: Merge branch 'master' into wmf_deploy [extensions/CentralNotice] (wmf_deploy) - https://gerrit.wikimedia.org/r/508491 [05:25:33] (CR) AndyRussG: [C: +2] Merge branch 'master' into wmf_deploy [extensions/CentralNotice] (wmf_deploy) - https://gerrit.wikimedia.org/r/508491 (owner: AndyRussG) [05:40:48] (Merged) jenkins-bot: Merge branch 'master' into wmf_deploy [extensions/CentralNotice] (wmf_deploy) - https://gerrit.wikimedia.org/r/508491 (owner: AndyRussG) [05:45:56] (CR) jenkins-bot: Merge branch 'master' into wmf_deploy [extensions/CentralNotice] (wmf_deploy) - https://gerrit.wikimedia.org/r/508491 (owner: AndyRussG) [09:42:14] PROBLEM - check_redis on frqueue1001 is CRITICAL: CRITICAL: payments-antifraud is 1275 1000, payments-init is 1363 1000, pending is 2035 2000 - REDIS 2.8.17 on 127.0.0.1:6379 has 1 databases (db0) with 11 keys, up 313 days 15 hours - memory use is 7.78M (peak 32.82M, 0.13% of max, fragmentation 1.37%), connected_slaves is 2, donations is 1131, jobs is 0, jobs-adyen is 162, jobs-paypal is 461, recurring is 0, refund is 0, unsubsc [09:47:14] PROBLEM - check_redis on frqueue1001 is CRITICAL: CRITICAL: payments-antifraud is 1290 1000, payments-init is 1380 1000, pending is 2069 2000 - REDIS 2.8.17 on 127.0.0.1:6379 has 1 databases (db0) with 11 keys, up 313 days 16 hours - memory use is 7.86M (peak 32.82M, 0.13% of max, fragmentation 1.36%), connected_slaves is 2, donations is 1144, jobs is 0, jobs-adyen is 165, jobs-paypal is 466, recurring is 0, refund is 0, unsubsc [09:52:14] PROBLEM - check_redis on frqueue1001 is CRITICAL: CRITICAL: payments-antifraud is 1311 1000, payments-init is 1404 1000, pending is 2102 2000 - REDIS 2.8.17 on 127.0.0.1:6379 has 1 databases (db0) with 11 keys, up 313 days 16 hours - memory use is 7.97M (peak 32.82M, 0.13% of max, fragmentation 1.36%), connected_slaves is 2, donations is 1161, jobs is 0, jobs-adyen is 168, jobs-paypal is 476, recurring is 0, refund is 0, unsubsc [09:57:14] PROBLEM - check_redis on frqueue1001 is CRITICAL: CRITICAL: payments-antifraud is 1335 1000, payments-init is 1427 1000, pending is 2138 2000 - REDIS 2.8.17 on 127.0.0.1:6379 has 1 databases (db0) with 11 keys, up 313 days 16 hours - memory use is 8.07M (peak 32.82M, 0.13% of max, fragmentation 1.35%), connected_slaves is 2, donations is 1178, jobs is 0, jobs-adyen is 171, jobs-paypal is 484, recurring is 0, refund is 0, unsubsc [10:02:10] PROBLEM - check_redis on frqueue1001 is CRITICAL: CRITICAL: payments-antifraud is 1359 1000, payments-init is 1457 1000, pending is 2183 2000 - REDIS 2.8.17 on 127.0.0.1:6379 has 1 databases (db0) with 11 keys, up 313 days 16 hours - memory use is 8.23M (peak 32.82M, 0.14% of max, fragmentation 1.35%), connected_slaves is 2, donations is 1197, jobs is 0, jobs-adyen is 175, jobs-paypal is 515, recurring is 0, refund is 0, unsubsc [10:07:16] PROBLEM - check_redis on frqueue1001 is CRITICAL: CRITICAL: payments-antifraud is 1380 1000, payments-init is 1481 1000, pending is 2215 2000 - REDIS 2.8.17 on 127.0.0.1:6379 has 1 databases (db0) with 11 keys, up 313 days 16 hours - memory use is 8.47M (peak 32.82M, 0.14% of max, fragmentation 1.34%), connected_slaves is 2, donations is 1216, jobs is 0, jobs-adyen is 176, jobs-paypal is 609, recurring is 0, refund is 0, unsubsc [10:12:16] PROBLEM - check_redis on frqueue1001 is CRITICAL: CRITICAL: payments-antifraud is 1409 1000, payments-init is 1512 1000, pending is 2269 2000 - REDIS 2.8.17 on 127.0.0.1:6379 has 1 databases (db0) with 11 keys, up 313 days 16 hours - memory use is 8.75M (peak 32.82M, 0.14% of max, fragmentation 1.32%), connected_slaves is 2, donations is 1237, jobs is 0, jobs-adyen is 180, jobs-paypal is 710, recurring is 0, refund is 0, unsubsc [10:17:10] ACKNOWLEDGEMENT - check_redis on frqueue1001 is CRITICAL: CRITICAL: payments-antifraud is 1409 1000, payments-init is 1512 1000, pending is 2269 2000 - REDIS 2.8.17 on 127.0.0.1:6379 has 1 databases (db0) with 11 keys, up 313 days 16 hours - memory use is 8.75M (peak 32.82M, 0.14% of max, fragmentation 1.32%), connected_slaves is 2, donations is 1237, jobs is 0, jobs-adyen is 180, jobs-paypal is 710, recurring is 0, refund is 0, [10:17:10] Jeff_Green yup [10:56:07] Fundraising-Backlog, fundraising-tech-ops: Banner impression data not updating on frdev1001 - https://phabricator.wikimedia.org/T222706 (Pcoombe) [10:58:14] Fundraising-Backlog, MediaWiki-extensions-CentralNotice, Spike: Spike: Create an alert for suspicious dips in banner impressions - https://phabricator.wikimedia.org/T116047 (Pcoombe) >>! In T116047#2479526, @Pcoombe wrote: > I now have a cron job which emails me if there were no entries in pgehres.ba... [13:13:13] Fundraising-Backlog, Analytics, Analytics-EventLogging, Analytics-Kanban, and 3 others: Fix EventLogging schemas that use array for items type - https://phabricator.wikimedia.org/T218617 (Ottomata) Thank you! [13:13:50] Fundraising-Backlog, Analytics, Analytics-EventLogging, Analytics-Kanban, and 3 others: Fix EventLogging schemas that use array for items type - https://phabricator.wikimedia.org/T218617 (Ottomata) [14:33:33] fundraising-tech-ops: upgrade frdev1001 to Debian Buster - https://phabricator.wikimedia.org/T220452 (Pcoombe) [14:33:35] Fundraising-Backlog, fundraising-tech-ops: Update SciPy on frdev1001 - https://phabricator.wikimedia.org/T213948 (Pcoombe) Open→Resolved a:Pcoombe Looks like the version is 0.18.1 now which is fine. Thanks! [15:24:26] Fundraising-Backlog: Create checklist for civi upgrades - https://phabricator.wikimedia.org/T222733 (mepps) [15:25:33] Fundraising-Backlog: Create checklist for mediawiki upgrades - https://phabricator.wikimedia.org/T222734 (mepps) [15:42:13] RECOVERY - check_redis on frqueue1001 is OK: OK: REDIS 2.8.17 on 127.0.0.1:6379 has 1 databases (db0) with 8 keys, up 313 days 21 hours - memory use is 2.42M (peak 32.82M, 0.09% of max, fragmentation 2.89%), connected_slaves is 2, donations is 15, jobs is 0, jobs-adyen is 0, jobs-paypal is 0, payments-antifraud is 74, payments-init is 78, pending is 0, recurring is 637, refund is 0, unsubscribe is 26 [17:13:54] (PS3) XenoRyet: Opt-in Consumer handles contact ID and Hash [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/508401 (https://phabricator.wikimedia.org/T217710) [17:16:26] (CR) jerkins-bot: [V: -1] Opt-in Consumer handles contact ID and Hash [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/508401 (https://phabricator.wikimedia.org/T217710) (owner: XenoRyet) [17:20:15] PROBLEM - check_gcsip on payments2001 is CRITICAL: CRITICAL - Socket timeout after 121 seconds [17:20:16] PROBLEM - check_gcsip on payments2003 is CRITICAL: CRITICAL - Socket timeout after 121 seconds [17:20:16] (PS4) XenoRyet: Opt-in Consumer handles contact ID and Hash [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/508401 (https://phabricator.wikimedia.org/T217710) [17:23:05] (CR) jerkins-bot: [V: -1] Opt-in Consumer handles contact ID and Hash [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/508401 (https://phabricator.wikimedia.org/T217710) (owner: XenoRyet) [17:23:15] RECOVERY - check_gcsip on payments2003 is OK: HTTP OK: HTTP/1.1 200 OK - 343 bytes in 0.241 second response time [17:23:15] RECOVERY - check_gcsip on payments2001 is OK: HTTP OK: HTTP/1.1 200 OK - 343 bytes in 1.741 second response time [17:45:47] (PS5) XenoRyet: Opt-in Consumer handles contact ID and Hash [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/508401 (https://phabricator.wikimedia.org/T217710) [17:48:22] (CR) jerkins-bot: [V: -1] Opt-in Consumer handles contact ID and Hash [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/508401 (https://phabricator.wikimedia.org/T217710) (owner: XenoRyet) [17:50:42] (PS6) XenoRyet: Opt-in Consumer handles contact ID and Hash [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/508401 (https://phabricator.wikimedia.org/T217710) [17:51:11] Perhaps next time I'll try actually reading what the error says before trying to fix it... [17:56:08] Fundraising Sprint A series of unfortunate event handlers, Fundraising Sprint Bert and Ernie's Excellent Adventure, Fundraising Sprint Casino Royale With Cheese, Fundraising Sprint Da Vinci Coder, and 9 others: Reduce recurring TY emails - https://phabricator.wikimedia.org/T213209 (TSkaff) Hi Eje... [20:03:54] (PS3) XenoRyet: Attempt at handling existing email, fix to opt-in new contacts Create contact and opt-in from just email address. Log if we get an already existing email that is not tied to any contacts, but take no other action. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/506837 (https://phabricator.wikimedia.org/T217710) (owner: Mepps) [20:05:51] (CR) Cstone: [C: +2] Add fancy version of Thank You page for opt-in [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/508477 (https://phabricator.wikimedia.org/T218240) (owner: Ejegg) [20:06:13] cstone: There's the changes we discussed. ^ [20:06:34] ok cool [20:06:46] (Merged) jenkins-bot: Add fancy version of Thank You page for opt-in [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/508477 (https://phabricator.wikimedia.org/T218240) (owner: Ejegg) [20:13:23] Anyway, I'm gonna grab some food. Back in a bit. [20:16:24] Fundraising-Backlog, Analytics, Analytics-Kanban: CentralNoticeImpression refined impressionEventSampleRate is int instead of double - https://phabricator.wikimedia.org/T217109 (Milimetric) for the record, we made a teeny mistake the first time we did this and the useragent field had a bad schema. S... [20:24:36] Fundraising-Backlog, fundraising-tech-ops: Update civi1001 django_settings.py, backfill banner impressions - https://phabricator.wikimedia.org/T222761 (Ejegg) [20:24:53] Fundraising-Backlog, fundraising-tech-ops: Update civi1001 django_settings.py, backfill banner impressions - https://phabricator.wikimedia.org/T222761 (Ejegg) a:cwdent [20:26:14] (PS1) Ejegg: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/508705 [20:26:23] (CR) Ejegg: [C: +2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/508705 (owner: Ejegg) [20:27:16] (Merged) jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/508705 (owner: Ejegg) [20:31:28] (PS1) Ejegg: Update DonationInterface submodule [core] (fundraising/REL1_31) - https://gerrit.wikimedia.org/r/508707 [20:31:44] (CR) Ejegg: [C: +2] Update DonationInterface submodule [core] (fundraising/REL1_31) - https://gerrit.wikimedia.org/r/508707 (owner: Ejegg) [20:31:55] cstone: is it just me or was this to the 16th before https://civicrm.org/civicrm/event/info?reset=1&id=1371 [20:35:58] (Merged) jenkins-bot: Update DonationInterface submodule [core] (fundraising/REL1_31) - https://gerrit.wikimedia.org/r/508707 (owner: Ejegg) [20:38:25] !log updated payments-wiki from 558427f731 to 6e0172bac3 [20:38:27] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [20:43:08] relocating... [20:44:42] (CR) jenkins-bot: Update DonationInterface submodule [core] (fundraising/REL1_31) - https://gerrit.wikimedia.org/r/508707 (owner: Ejegg) [21:19:14] (PS1) Vedmaka Wakalaka: WIP in page preview draft [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/508720 [21:19:25] (CR) jerkins-bot: [V: -1] WIP in page preview draft [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/508720 (owner: Vedmaka Wakalaka) [21:32:58] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi SSL Certificate expired - https://phabricator.wikimedia.org/T222764 (RLewis) [21:42:02] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, fundraising-tech-ops: Civi SSL Certificate expired - https://phabricator.wikimedia.org/T222764 (DStrine) [21:56:39] (CR) Ejegg: "The two new functions are almost identical - maybe better to have one function with a matchEmail parameter? Also, I'd like to see tests us" (3 comments) [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/508401 (https://phabricator.wikimedia.org/T217710) (owner: XenoRyet) [21:57:40] XenoRyet: and cstone: do you want to squash the two commits together about handling existing email? [21:57:54] https://gerrit.wikimedia.org/r/506837 and https://gerrit.wikimedia.org/r/505686 ? [21:58:10] I suppose that would make sense. [21:59:07] and can anyone give a review to this? [21:59:10] https://gerrit.wikimedia.org/r/504213 [21:59:29] Yea, I was just in the middle of looking at that one. [21:59:39] Looks fine, was just going to push a message through to prove it out. [22:00:03] cstone: If you want to do the squashing, I'll finish that review. [22:06:30] (CR) XenoRyet: [C: +2] "Looks fine, does the job." [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/504213 (https://phabricator.wikimedia.org/T218240) (owner: Ejegg) [22:06:58] (PS2) Vedmaka Wakalaka: WIP in page preview draft [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/508720 [22:07:09] (CR) jerkins-bot: [V: -1] WIP in page preview draft [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/508720 (owner: Vedmaka Wakalaka) [22:09:48] (PS2) Ejegg: Opting in reverses opt-out fields [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/504213 (https://phabricator.wikimedia.org/T218240) [22:11:05] That need the +2 reapplied? ^ [22:13:54] the +2 is still there, let's see what happens [22:17:40] just used the 'submit' button to merge it [22:18:45] huh, cool [22:35:45] (PS15) Vedmaka Wakalaka: Banner live preview [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/497611 (https://phabricator.wikimedia.org/T208125) [22:36:48] (PS3) Vedmaka Wakalaka: WIP in page preview draft [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/508720 [22:40:00] (CR) jerkins-bot: [V: -1] Banner live preview [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/497611 (https://phabricator.wikimedia.org/T208125) (owner: Vedmaka Wakalaka) [22:41:50] (CR) jerkins-bot: [V: -1] WIP in page preview draft [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/508720 (owner: Vedmaka Wakalaka) [22:43:08] (PS16) Vedmaka Wakalaka: Banner live preview [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/497611 (https://phabricator.wikimedia.org/T208125) [22:53:16] Fundraising Sprint Fistful of $variables, Fundraising Sprint Greps of Wrath, Fundraising Sprint Hansel and grep -l, Fundraising Sprint It Came From Out of Scope, and 2 others: Create variants for fancy new opt in pages on payments wiki - https://phabricator.wikimedia.org/T218240 (XenoRyet) @CCogd... [22:58:55] (PS17) Vedmaka Wakalaka: Banner live preview [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/497611 (https://phabricator.wikimedia.org/T208125) [22:58:57] (PS4) Vedmaka Wakalaka: WIP in page preview draft [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/508720 [23:02:58] (CR) jerkins-bot: [V: -1] WIP in page preview draft [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/508720 (owner: Vedmaka Wakalaka) [23:03:59] (CR) jerkins-bot: [V: -1] Banner live preview [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/497611 (https://phabricator.wikimedia.org/T208125) (owner: Vedmaka Wakalaka) [23:04:52] (PS18) Vedmaka Wakalaka: Banner live preview [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/497611 (https://phabricator.wikimedia.org/T208125) [23:08:17] Fundraising Sprint Hansel and grep -l, Fundraising Sprint It Came From Out of Scope, Fundraising-Backlog, Patch-For-Review: 1-month update for privacy policy - https://phabricator.wikimedia.org/T220428 (Ejegg) OK, this new text is up, and I see the volunteer translators have already given us cove... [23:27:35] Fundraising-Backlog: Create checklist for civi upgrades - https://phabricator.wikimedia.org/T222733 (Eileenmcnaughton) We actually have this https://collab.wikimedia.org/wiki/Checklists_for_maintenance_%26_Recovery I think last night was an fr-ops update & we snuck in a trigger reload & I didn't check wha... [23:28:13] Fundraising-Backlog, fundraising-tech-ops: Outage to reload triggers - https://phabricator.wikimedia.org/T222001 (Eileenmcnaughton) Open→Resolved a:Eileenmcnaughton All done [23:29:32] Fundraising Sprint It Came From Out of Scope, Fundraising-Backlog: New Custom Fields for Target Smart Import - https://phabricator.wikimedia.org/T222559 (Eileenmcnaughton) @NNichols So for some reason when you created those fields the db field is_locked was set to true - I've changed that & you can proce... [23:33:22] Fundraising Sprint It Came From Out of Scope, Fundraising-Backlog: New Custom Fields for Target Smart Import - https://phabricator.wikimedia.org/T222559 (Eileenmcnaughton) OK - I see why - for some reason our schema is missing a change ALTER TABLE civicrm_option_group MODIFY COLUMN is_locked TINYINT(4)...