[01:07:20] PROBLEM - check_gcsip on payments1004 is CRITICAL: CRITICAL - Socket timeout after 121 seconds [01:07:22] PROBLEM - check_gcsip on payments1002 is CRITICAL: CRITICAL - Socket timeout after 121 seconds [01:10:10] RECOVERY - check_gcsip on payments1004 is OK: HTTP OK: HTTP/1.1 200 OK - 343 bytes in 0.150 second response time [01:10:12] RECOVERY - check_gcsip on payments1002 is OK: HTTP OK: HTTP/1.1 200 OK - 343 bytes in 0.149 second response time [13:35:39] (PS1) Mepps: Delete extension, update currency symbols via install script Bug: T151957 [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/353877 (https://phabricator.wikimedia.org/T151957) [13:36:25] (PS2) Mepps: Delete extension, update currency symbols via install script Bug: T151957 [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/353877 (https://phabricator.wikimedia.org/T151957) [13:46:28] (CR) jerkins-bot: [V: -1] Delete extension, update currency symbols via install script Bug: T151957 [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/353877 (https://phabricator.wikimedia.org/T151957) (owner: Mepps) [13:52:01] (PS3) Mepps: Delete extension, update currency symbols via install script Bug: T151957 [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/353877 (https://phabricator.wikimedia.org/T151957) [14:00:54] Fundraising-Backlog, Analytics-Kanban, Patch-For-Review: Productionize banner impressions druid/pivot dataset - https://phabricator.wikimedia.org/T155141#3263119 (AndyRussG) Merci!! :) [14:08:01] Fundraising Sprint Judgement Suspenders, Fundraising-Backlog, MediaWiki-extensions-CentralNotice: Spike: Investigate cause of large banner impression surge in NL and ES fr campaigns - https://phabricator.wikimedia.org/T164996#3253691 (AndyRussG) Hi! I activated a test campaign (since the original on... [15:05:58] Fundraising-Backlog, MediaWiki-extensions-CentralNotice: Spike: CentralNotice: Investigate proliferation of StaleCampaignException errors - https://phabricator.wikimedia.org/T165335#3263408 (AndyRussG) [15:08:15] Fundraising Sprint Deferential Equations, Fundraising Sprint English Cuisine, Fundraising Sprint Far Beer, Fundraising Sprint Gondwanaland Reunification Engine, and 9 others: Mediawiki namespace pages, including CentralNotice banners, are slow to sa... - https://phabricator.wikimedia.org/T158084#3263452 [15:34:38] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi unresponsive for Engage in evenings - https://phabricator.wikimedia.org/T152786#3263691 (Jgreen) Just checking back on this since there hasn't been an update, is it still a problem? [15:56:32] Wikimedia-Fundraising-Campaigns (FY Q4 Apr-Jun 2017), Wikimedia-CentralNotice-Administration (Q2-2017): WMF Fundraising - 2016-17 - Poland/Romania/Slovakia (May 16 - Jun 13) - https://phabricator.wikimedia.org/T164268#3263754 (Pcoombe) [15:56:34] Wikimedia-Fundraising: Update Polish language thank you page - https://phabricator.wikimedia.org/T164508#3263753 (Pcoombe) Open>Resolved [16:06:08] Fundraising Sprint Judgement Suspenders, Fundraising-Backlog, MediaWiki-extensions-CentralNotice: Spike: Investigate cause of large banner impression surge in NL and ES fr campaigns - https://phabricator.wikimedia.org/T164996#3263780 (AndyRussG) Just checked the [[ https://logstash.wikimedia.org | lo... [16:22:28] Fundraising-Backlog, MediaWiki-extensions-DonationInterface: Are we inserting extra contribution tracking rows - https://phabricator.wikimedia.org/T163615#3263828 (Ejegg) Another symptom of this will be to exaggerate the dropoff between people hitting payments and people opening iframes onto payment proc... [16:55:16] Fundraising-Backlog, Wikimedia-Fundraising-Banners, MediaWiki-extensions-CentralNotice, Spike: Spike: investigate negative scroll offset for cancelling "banner bump" - https://phabricator.wikimedia.org/T107967#3264018 (Pcoombe) [17:00:19] fr-tech: Q: What's yellow, and equivalent to the Axiom of Choice? [17:00:20] A: Zorn's Lemon. [17:00:20] -- discuss. [17:00:34] (PS3) Ejegg: Run stylelint also for less files [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/352610 (owner: Umherirrender) [17:01:05] (CR) Ejegg: [C: 2] Run stylelint also for less files [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/352610 (owner: Umherirrender) [17:04:47] (Merged) jenkins-bot: Run stylelint also for less files [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/352610 (owner: Umherirrender) [17:13:50] hi fr-tech! [17:21:35] howdy [17:25:34] i'm guessing i shouldn't expect K4 for 1on1 today? [17:26:10] cwd: nope [17:45:34] Fundraising Sprint Judgement Suspenders, Fundraising-Backlog, Wikimedia-Fundraising: Missing Polish translation of Thank You email - https://phabricator.wikimedia.org/T164510#3264199 (jrobell) HI all, The Polish thank you email is updated on Meta and published https://meta.wikimedia.org/w/index.ph... [17:46:41] hey pcoombe and dstrine [17:47:05] Just a heads up that I published the Polish thank you email on Meta [17:47:09] Phab task : https://phabricator.wikimedia.org/T164510 [17:47:50] Is there a possibility this could be deployed today you think? [17:48:27] jessicarobell: sure, it's pretty quick to snag from the wiki [17:48:41] Wonderful! Thanks much ejegg [17:49:13] mepps: want to learn about this arcane process? [17:50:25] jessicarobell: thanks! [17:51:35] ejegg yes! In about half an hour? [17:51:46] sure mepps [17:52:02] also XenoRyet are you familiar with drush make-thank-you? [17:52:40] Na, I don't think I've used that before either. I could tag along as well. [17:53:04] k, let's meet in the -talk spot in 30 min [17:53:11] I'll be there. [18:00:58] Fundraising Sprint Deferential Equations, Fundraising Sprint English Cuisine, Fundraising Sprint Far Beer, Fundraising Sprint Gondwanaland Reunification Engine, and 9 others: Mediawiki namespace pages, including CentralNotice banners, are slow to sa... - https://phabricator.wikimedia.org/T158084#3264313 [18:17:41] (PS1) Ejegg: Log session IDs when adding info & failing to find it [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/353904 [18:17:49] XenoRyet: think that will help? ^^^ [18:18:11] Looking [18:20:51] well, that's a mysterious failmail [18:21:00] oh huh, DB error [18:22:40] (CR) XenoRyet: [C: 2] Log session IDs when adding info & failing to find it [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/353904 (owner: Ejegg) [18:22:49] Yea, that looks like it should get us some useful info. [18:23:17] err, is civi down, or is that just the normal blocked-version-check-login-delay? [18:23:54] guess it's just the login delay [18:24:08] Yea, looks up to me. [18:24:24] (Merged) jenkins-bot: Log session IDs when adding info & failing to find it [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/353904 (owner: Ejegg) [18:44:43] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi unresponsive for Engage in evenings - https://phabricator.wikimedia.org/T152786#3264591 (LeanneS) @jgreen Thanks for checking. I haven't heard of any issues recently. [18:54:34] Fundraising-Backlog, MediaWiki-extensions-CentralNotice: Spike: CentralNotice: General investigation on how we might use service workers with CentralNotice - https://phabricator.wikimedia.org/T165383#3264654 (AndyRussG) [18:55:50] Fundraising-Backlog, MediaWiki-extensions-CentralNotice: Spike: CentralNotice: General investigation on how we might use service workers with CentralNotice - https://phabricator.wikimedia.org/T165383#3264678 (AndyRussG) [18:57:00] Wikimedia-Fundraising, MediaWiki-ResourceLoader, MediaWiki-extensions-CentralNotice, Operations, and 2 others: Provide location, logged-in status and device information in ResourceLoaderContext - https://phabricator.wikimedia.org/T103695#1396785 (AndyRussG) @Krinkle Thanks so much for the explana... [18:58:51] Fundraising-Backlog, MediaWiki-extensions-CentralNotice: Spike: CentralNotice: General investigation on how we might use service workers with CentralNotice - https://phabricator.wikimedia.org/T165383#3264703 (AndyRussG) [18:59:32] (PS1) Ejegg: Don't combine page and oldid parameters [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/353907 [19:07:54] Fundraising Sprint Judgement Suspenders, Fundraising-Backlog, Wikimedia-Fundraising: Missing Polish translation of Thank You email - https://phabricator.wikimedia.org/T164510#3264733 (Ejegg) Hi @jrobell, there was one little broken bit in the footer, where it's supposed to link to the matching gift p... [19:08:44] mepps / XenoRyet here's the api params fix: https://gerrit.wikimedia.org/r/353907 [19:11:58] You want to do the honors on that one mepps? [19:12:37] (PS1) Ejegg: Error handling fix, FIXME [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/353910 [19:22:06] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi unresponsive for Engage in evenings - https://phabricator.wikimedia.org/T152786#3264849 (Jgreen) Open>Resolved a:Jgreen >>! In T152786#3264591, @LeanneS wrote: > @jgreen Thanks for checking. I haven't heard of any issues recently. Ok,... [19:23:55] fundraising-tech-ops: reimage tellurium to jessie - https://phabricator.wikimedia.org/T165391#3264871 (Jgreen) [19:24:31] fundraising-tech-ops: reimage bismuth to Jessie - https://phabricator.wikimedia.org/T165392#3264884 (Jgreen) [19:25:04] fundraising-tech-ops: reimage americium with Jessie - https://phabricator.wikimedia.org/T165393#3264897 (Jgreen) [19:25:15] xenoryet, ejegg: yeah! [19:25:39] (CR) Mepps: [C: 2] Don't combine page and oldid parameters [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/353907 (owner: Ejegg) [19:25:44] fundraising-tech-ops: reimage heka with Jessie - https://phabricator.wikimedia.org/T165394#3264915 (Jgreen) [19:26:19] fundraising-tech-ops: reimage bellatrix with Jessie - https://phabricator.wikimedia.org/T165395#3264928 (Jgreen) [19:27:26] (PS2) Ejegg: Delete KeyedOpaque* and correlation-id [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/353757 [19:29:49] (Merged) jenkins-bot: Don't combine page and oldid parameters [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/353907 (owner: Ejegg) [19:30:45] ejegg with this pr: https://gerrit.wikimedia.org/r/#/c/353910/1/sites/all/modules/thank_you/generators/RenderTranslatedPage.php what is the reason for removing language from the error message? might we need it if we're requesting multiple languages? [19:30:49] fundraising-tech-ops: upgrade all frack servers to debian/jessie - https://phabricator.wikimedia.org/T146479#3264967 (Jgreen) p:High>Normal no longer urgent now that all important boxes are Jessie, and otherwise Trusty [19:31:38] fundraising-tech-ops: recycle db1008 for frack virtual test cluster protoyping - https://phabricator.wikimedia.org/T140953#3264969 (Jgreen) Open>Resolved we're currently using it to prototype ossim/alienvault [19:33:11] fundraising-tech-ops, Monitoring: overhaul fundraising cluster monitoring - https://phabricator.wikimedia.org/T91508#3264974 (Jgreen) [19:33:49] mepps: the api query is actually made without the language on there! [19:34:06] it gets all of the review actions for all languages [19:34:15] ejegg got it! :) [19:34:51] (CR) Mepps: [C: 2] Error handling fix, FIXME [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/353910 (owner: Ejegg) [19:39:13] (Merged) jenkins-bot: Error handling fix, FIXME [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/353910 (owner: Ejegg) [19:41:18] Fundraising-Backlog, FR-Smashpig: Add SmashPig config to settings repo - https://phabricator.wikimedia.org/T129706#3264978 (Jgreen) stalled>declined Once we solve T147503 the puppet-deployed config is easily templated from private variables. [19:58:39] (PS1) Ejegg: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/353913 [19:59:41] (CR) jerkins-bot: [V: -1] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/353913 (owner: Ejegg) [20:03:18] (PS2) Ejegg: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/353913 [20:09:40] fundraising-tech-ops: reimage alnitak with Jessie - https://phabricator.wikimedia.org/T165396#3265012 (Framawiki) [20:23:45] Fundraising Sprint Judgement Suspenders, Fundraising-Backlog, Wikimedia-Fundraising: Missing Polish translation of Thank You email - https://phabricator.wikimedia.org/T164510#3265134 (Pcoombe) @Ejegg Thanks, should be published now [21:10:55] (PS1) Ejegg: Add PL translation of thank you letter [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/353916 (https://phabricator.wikimedia.org/T164510) [21:18:38] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Thank you mail send should have a time limit - https://phabricator.wikimedia.org/T163412#3196461 (mepps) @ejegg what should happen if execution takes too long--log an error message? [21:42:07] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Thank you mail send should have a time limit - https://phabricator.wikimedia.org/T163412#3265312 (Ejegg) @mepps just have it quietly stop when it reaches the time limit. All of the queue consumers do that - timer is just checked before getting each new... [21:48:02] Hey ejegg, which were those cleanup patches you needed reviewed? [21:48:50] well, there's one big one, getting rid of the correlation-id and KeyedOpaqueStorable.... [21:49:04] https://gerrit.wikimedia.org/r/353757 [21:50:50] Cool, I'll start there. [21:57:47] Fundraising Sprint Ivory Tower Defense Games, Fundraising Sprint Judgement Suspenders, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, and 2 others: Thank you letter from civi mangles non-$ currencies - https://phabricator.wikimedia.org/T151957#3265368 (Eileenmcnaughton) @mepps - so the probl... [22:04:41] Fundraising-Backlog: donate.wikimedia.org access for a new user - https://phabricator.wikimedia.org/T165412#3265490 (DStrine) [22:08:39] (PS4) Mepps: Delete extension, update currency symbols via install script Bug: T151957 [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/353877 (https://phabricator.wikimedia.org/T151957) [22:09:29] Fundraising Sprint Ivory Tower Defense Games, Fundraising Sprint Judgement Suspenders, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, and 2 others: Thank you letter from civi mangles non-$ currencies - https://phabricator.wikimedia.org/T151957#3265559 (mepps) @Eileenmcnaughton yes, exactly.... [22:21:38] Fundraising Sprint Ivory Tower Defense Games, Fundraising Sprint Judgement Suspenders, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, and 2 others: Thank you letter from civi mangles non-$ currencies - https://phabricator.wikimedia.org/T151957#3265814 (Eileenmcnaughton) Wow - I looked into t... [22:34:57] (PS2) Ejegg: Add PL translation of thank you letter [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/353916 (https://phabricator.wikimedia.org/T164510) [22:35:50] (CR) jerkins-bot: [V: -1] Add PL translation of thank you letter [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/353916 (https://phabricator.wikimedia.org/T164510) (owner: Ejegg) [22:50:27] (CR) Ejegg: "recheck" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/353916 (https://phabricator.wikimedia.org/T164510) (owner: Ejegg) [22:56:43] OK, I think that PL thankyou letter is ready for review ^^^ [22:57:21] (PS1) Ejegg: More horrifying regexps for ty letter template generation [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/353927 [22:57:36] and those tweaks to the replacements ^^^^ [23:03:05] anyone got a chance to review? [23:03:16] jessicarobell was pretty eager to see it on production [23:03:37] Fundraising-Backlog, fundraising-tech-ops: donate.wikimedia.org access for a new user - https://phabricator.wikimedia.org/T165412#3265971 (DStrine) [23:16:53] (CR) Ejegg: "i THINK it's safe, but the deletion and inserts into auto-increment give me the willies." [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/353877 (https://phabricator.wikimedia.org/T151957) (owner: Mepps) [23:17:23] XenoRyet: I'm going to deploy that stuff to paymentswiki, including the error refactoring [23:17:32] Good times [23:17:34] Want to watch? [23:17:43] Sure [23:18:45] I do have a hard out at 5:00 as per usual, but I can watch stuff until then. [23:20:06] (CR) Ejegg: [C: 2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/353913 (owner: Ejegg) [23:21:35] (Merged) jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/353913 (owner: Ejegg) [23:23:29] (PS1) Ejegg: Update DonationInterface submodule [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/353929 [23:23:32] (CR) Ejegg: [C: 2] Update DonationInterface submodule [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/353929 (owner: Ejegg) [23:25:33] (CR) jerkins-bot: [V: -1] Update DonationInterface submodule [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/353929 (owner: Ejegg) [23:25:52] hrm? [23:27:10] ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error? [23:27:23] that... fails the build in CI? [23:28:47] wait, what? [23:29:48] (CR) Ejegg: [C: 2] "recheck" [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/353929 (owner: Ejegg) [23:30:03] I dunno.. I'm asking over in -releng [23:30:47] (CR) jerkins-bot: [V: -1] Update DonationInterface submodule [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/353929 (owner: Ejegg) [23:31:38] (CR) jerkins-bot: [V: -1] Update DonationInterface submodule [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/353929 (owner: Ejegg) [23:40:34] (CR) Ejegg: [C: 2] "recheck" [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/353929 (owner: Ejegg) [23:42:20] (CR) jerkins-bot: [V: -1] Update DonationInterface submodule [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/353929 (owner: Ejegg) [23:42:57] k, not a fluke :( [23:43:26] :-/ [23:43:27] XenoRyet: mind reviewing that PL thankyou letter? I think we can at least get that out today. [23:43:36] https://gerrit.wikimedia.org/r/353916 [23:43:43] Sure, let me take a look. [23:46:43] (CR) XenoRyet: [C: 2] Add PL translation of thank you letter [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/353916 (https://phabricator.wikimedia.org/T164510) (owner: Ejegg) [23:46:47] (CR) jerkins-bot: [V: -1] Update DonationInterface submodule [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/353929 (owner: Ejegg) [23:51:06] (Merged) jenkins-bot: Add PL translation of thank you letter [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/353916 (https://phabricator.wikimedia.org/T164510) (owner: Ejegg) [23:58:35] (CR) Ejegg: [V: 2 C: 2] Update DonationInterface submodule [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/353929 (owner: Ejegg) [23:59:22] Alright, headed out to pick up that kid. Catch ya'll later.