[00:03:21] i have a nice update to all the grant scripts that's only about 1300 lines long. [00:05:54] yep - that worked! [00:06:35] cool. [00:11:20] interesting - it;s basically 500MB for an index on one of the big tables + data (ie, the tables have some indexed fields that we don't use & they have a consistent size) [00:13:40] Fundraising-Backlog, Analytics, Analytics-Kanban, MediaWiki-extensions-CentralNotice: Refining is failing to refine centranoticeimpression events - https://phabricator.wikimedia.org/T244771 (Nuria) Closing as all data is re-refined and accessible. [00:13:50] Fundraising-Backlog, Analytics, Analytics-Kanban, MediaWiki-extensions-CentralNotice: Refining is failing to refine centranoticeimpression events - https://phabricator.wikimedia.org/T244771 (Nuria) Open→Resolved [00:16:33] Fundraising-Backlog, Analytics, WMDE-Analytics-Engineering, WMDE-FUN-Team, WMDE-Fundraising-Tech: Find a better way for WMDE to get impression counts for their banners - https://phabricator.wikimedia.org/T243092 (Nuria) ping @kai.nissen that data is accessible in event table in hive, to query... [00:24:35] gotta dad taxi. see you all later. [02:19:26] fundraising-tech-ops, Operations, ops-codfw: (Need by: TBD) codfw:fundraising single-cpu misc servers frpig2001,civi2001.pay-lvs200[1-2] - https://phabricator.wikimedia.org/T244950 (Papaul) [02:29:25] Fundraising Sprint Byzantine Empire Strikes Back, Fundraising Sprint CAPS LOCK CULTS, Fundraising Sprint Dampness, Fundraising-Backlog, FR-Ingenico: January spike in duplicate donations? - https://phabricator.wikimedia.org/T243873 (Ejegg) At this point I only see 7 duplicate PayPal donations... [02:48:14] Fundraising Sprint Byzantine Empire Strikes Back, Fundraising Sprint CAPS LOCK CULTS, Fundraising Sprint Dampness, Fundraising-Backlog, FR-Ingenico: January spike in duplicate donations? - https://phabricator.wikimedia.org/T243873 (Ejegg) I can't seem to refund them. @MBeat33 is it too late,... [02:58:07] Fundraising Sprint Byzantine Empire Strikes Back, Fundraising Sprint CAPS LOCK CULTS, Fundraising Sprint Dampness, Fundraising-Backlog, FR-Ingenico: January spike in duplicate donations? - https://phabricator.wikimedia.org/T243873 (MBeat33) It looks like I'm able to refund them, @Ejegg I'll t... [04:05:55] (PS1) DannyS712: Remove last use of global $wgUser [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/575121 (https://phabricator.wikimedia.org/T241615) [04:07:17] (PS2) DannyS712: Remove last use of global $wgUser [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/575121 (https://phabricator.wikimedia.org/T241615) [04:08:24] (CR) DannyS712: Remove last use of global $wgUser (2 comments) [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/575121 (https://phabricator.wikimedia.org/T241615) (owner: DannyS712) [04:11:02] (CR) Ppchelko: [C: +1] "LGTM, if there would be no objections I'll +2 in a day or so" [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/575121 (https://phabricator.wikimedia.org/T241615) (owner: DannyS712) [12:23:59] Fundraising-Backlog: Oanda moving to cloudflare - IP whitelisting changes. - https://phabricator.wikimedia.org/T246336 (jgleeson) [12:41:21] (PS22) Jgleeson: Break up Adyen into separate PaymentProvider and Api classes. [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/567141 (https://phabricator.wikimedia.org/T244536) [12:47:08] (CR) Jgleeson: Break up Adyen into separate PaymentProvider and Api classes. (2 comments) [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/567141 (https://phabricator.wikimedia.org/T244536) (owner: Jgleeson) [12:50:24] (CR) Jgleeson: "actually that wouldn't solve the visibility issue as we'd have to pass in the mock with expects() during instantiation which couldn't happ" [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/567141 (https://phabricator.wikimedia.org/T244536) (owner: Jgleeson) [14:09:07] just heading to the library back online later [14:19:41] Wikimedia-Fundraising-Banners: Desktop large opt-in is broken for RTL languages - https://phabricator.wikimedia.org/T246344 (Pcoombe) [14:19:42] Wikimedia-Fundraising-Banners: Desktop large opt-in is broken for RTL languages - https://phabricator.wikimedia.org/T246344 (Pcoombe) p:Triage→Medium [14:35:49] Fundraising-Backlog: Review Banner Templating - https://phabricator.wikimedia.org/T246347 (mepps) [14:50:24] fr-tech I just added "allow_overtime: true" to the config file for the delete_deleted_contacts job [14:50:39] that should stop it emailing us every time the script takes more than 3 min to run. [14:50:46] nice ejegg! [14:50:50] less email is so important... [14:51:24] oh hmm, the unsubscribe queue consumer failed overnight too [14:51:27] let's see what that was [14:52:22] ah no, not the queue consumer, it's the one that processes unsubscribe events from silverpop [14:52:46] i'm pretty sure that one recovers just fine without losing anything [14:56:38] Fundraising-Backlog: Oanda moving to cloudflare - IP whitelisting changes. - https://phabricator.wikimedia.org/T246336 (Ejegg) [14:57:40] Fundraising-Backlog, fundraising-tech-ops: Oanda moving to cloudflare - IP whitelisting changes. - https://phabricator.wikimedia.org/T246336 (Ejegg) [15:07:01] Thanks for making that OANDA IP phab task, jgleeson|baksoon! [15:20:50] (CR) Ejegg: [C: +2] "Looks good!" [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/567141 (https://phabricator.wikimedia.org/T244536) (owner: Jgleeson) [15:21:13] (Merged) jenkins-bot: Break up Adyen into separate PaymentProvider and Api classes. [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/567141 (https://phabricator.wikimedia.org/T244536) (owner: Jgleeson) [15:21:34] jgleeson did you have plans for error code normalization or can I take a stab at that while you adapt the Ingenico PaymentProvider? [15:22:49] ah sorry, you're still |baksoon [15:24:57] anyway, we have a DonationInterface class ResponseCodes that is intended for the purpose [15:27:41] back! [15:30:01] mm ejegg with adyen specifically they included the error codes in the refusal reason. I did add some heuristic mapping to pickup the first part of the refusal reason if it was digits but that's probably not ideal [15:30:46] jgleeson: yah, we need to map processor-specific error codes to a set of local constants that are shared between processors [15:30:56] That's basically what ResponseCodes tries to do [15:31:07] anyway, I'm looking for where in SmashPig to put it [15:31:18] I guess it's Core based on us moving FinalStatus there [15:31:33] but that's starting to feel crowded [15:31:40] maybe in PaymentData? [15:32:22] Would that sound right for FinalStatus, ResponseCodes, and ValidationAction? [15:32:39] fr-tech anyone want to weigh in on a namespace choice? ^^^ [15:33:40] we have nothing in the base PaymentData directory, but that feels like a decent designator for these payment-related enums [15:34:07] it's got a subdirectory ReferenceData with rough currency rates and national currency lists [15:35:16] ejegg: that feels ok to me [15:36:41] hmmm [15:40:16] OK, I'll do a patch to move FinalStatus and ValidationAction, then one to add ResponseCodes [15:40:58] yeah I was just looking over the code base and I don't another namespace stands out [15:46:27] (PS1) Ejegg: Move FinalStatus and ValidationAction to PaymentData [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/575267 [15:47:05] ejegg: did you see my feedback on the test mocks [15:47:21] I tinkered round a little before leaving but didn't come up with a solution [15:47:29] did anything obvious stand out to you? [15:59:00] jgleeson: my thought was that we could somehow create the mock in setup, assign it to a test class member variable and also inject it into the config, then in the test method call expects() on it [15:59:10] I'll peek at that later though [15:59:37] For now let's just get AndyRussG what he needs to adapt the Civi extension [16:00:56] (PS1) Ejegg: Add ResponseCode enum to normalize processor errors [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/575272 (https://phabricator.wikimedia.org/T243340) [16:04:12] Wikimedia-Fundraising-Banners: PTF Checkbox does not align right to left on Desktop Small Banner - https://phabricator.wikimedia.org/T242389 (Pcoombe) Sorry about that @jbolorinos-ctr. Desktop Small should be fixed now, and I also made some small fixes to button positioning on RTL: https://he.wikipedia.org/w... [16:08:21] Fundraising-Backlog, fundraising-tech-ops: Oanda moving to cloudflare - IP whitelisting changes. - https://phabricator.wikimedia.org/T246336 (Jgreen) p:Triage→Medium [16:09:06] 10 4 ejegg ! [16:09:50] I'm looking at that now actually trying to workout why we added error messags to the top level response [16:10:06] oh no, the e key on my keyboard is failing [16:10:27] Wikimedia-Fundraising-Banners: Misplaced Currency Symbol on Desktop Large - Nag banner in Hebrew - https://phabricator.wikimedia.org/T242395 (Pcoombe) I think this is actually correct now that we have Hebrew text there: https://he.wikipedia.org/w/index.php?title=%D7%A0%D7%90%D7%A1%22%D7%90&banner=B1920_0301_... [16:10:29] which is really inconvenient for obvious reasons jgg! [16:10:31] :) [16:11:55] jgleeson: oh, for Ingenico? [16:12:06] oh false alarm it just had food behind it [16:12:21] We did that because their API responses can have error messages at a bunch of different levels of the nested array [16:12:41] so we just didn't want to have to check in all of them after each of the API calls [16:12:59] so I guess a primitive first bit of response normalization [16:13:38] woah failmail wave hit fr-tehc [16:13:41] fr-tech [16:14:16] dwisehaupt ^^ [16:14:42] it looks like a possible service outage? or an endpoint test failure [16:15:27] paymetns is still up and running i just confirmed at least--havne't test donated but i can load the form [16:16:24] Wikimedia-Fundraising-Banners: Mobile small: amount button layout broken on RTL - https://phabricator.wikimedia.org/T246355 (Pcoombe) p:Triage→Medium [16:19:07] hmm, all nagios alerts [16:19:14] no actual failing processes [16:26:04] Wikimedia-Fundraising-Banners: Misplaced Currency Symbol on Desktop Large - Nag banner in Hebrew - https://phabricator.wikimedia.org/T242395 (TSkaff) Responding to the above question ... Hebrew text are in Meta Translate (although not yet reviewed) ... so at least there is something to work with! [16:31:04] Jeff_Green, dwisehaupt: any clue what's up with nagios? [16:31:08] looks like false alarms [16:32:03] ejegg: we're not sure yet, from our side it looks like our reporters are running and sending normally, which suggests a server-side explosion [16:32:10] SRE is investigating [16:33:29] always a good thing to open up your computer to. :) [16:33:36] keeps us on our toes. [16:33:41] ha [16:33:49] Wikimedia-Fundraising-Banners: "Cannot accept donations greater than 12,000" error message has a rounding error in Malaysia - https://phabricator.wikimedia.org/T246262 (Pcoombe) a:Pcoombe Ah, good old floating-point arithmetic. Fixed with [this change in CoreJS](https://meta.wikimedia.org/w/index.php?tit... [16:34:18] I figure it's just a matter of time before gmail starts routing them all to the spam folder :-( [16:36:59] mepps I'm trying to run the mw upgrade script on the staging server (to add the region column) and it's telling me /usr/bin/php doesn't exist! [16:37:36] which is really really weird because ps -ef shows www-data running some things with /usr/bin/php [16:38:40] wat, apt list --installed shows neither php nor apache [16:39:11] wait, is there some inner box running those things? [16:39:37] "sever-side explosion" ಠ_ಠ [16:40:12] Fundraising-Backlog, fundraising-tech-ops: Oanda moving to cloudflare - IP whitelisting changes. - https://phabricator.wikimedia.org/T246336 (Jgreen) Open→Resolved a:Jgreen Deployed commit 89b862098 Author: Jeff Green Date: Thu Feb 27 16:36:48 2020 +0000 add clo... [16:40:24] nice turnaround! [16:40:52] or am I sshed into some sort of chroot jail? [16:41:42] ahh, ok, so there IS an inner vagrant box [16:41:44] huh [16:41:50] huh? [16:41:57] an INNER vagrant box [16:41:59] inside what.. [16:42:10] inception-style vagranting? [16:42:19] inside the cloud VPS instance for CN staging [16:42:39] the vagrant is collapsing!!!! [16:43:02] I thought maybe since it was a virtual server the puppet roles from vagrant would be applied to the virtual server itself [16:43:32] but no, the virtual server runs a vagrant box and just passes requests and responses in and out [16:44:29] sounds complicated [16:45:33] weird, I can't log in to the wiki now [16:45:48] Wikimedia-Fundraising-Banners: Euro symbol appears on new line for PTF when decimal is present - https://phabricator.wikimedia.org/T246361 (jbolorinos-ctr) [16:46:31] Wikimedia-Fundraising-Banners: Euro symbol appears on new line for PTF when decimal is present - https://phabricator.wikimedia.org/T246361 (jbolorinos-ctr) p:Triage→Medium This bug is currently only affecting countries that use the Euro currency, so setting priority to medium. [16:46:37] mepps can you still log in at http://cn-stage-2.wmflabs.org/w/index.php?title=Special:UserLogin ? [16:47:05] Wikimedia-Fundraising-Banners: Euro symbol appears on new line for PTF when decimal is present - https://phabricator.wikimedia.org/T246361 (jbolorinos-ctr) [16:47:08] I get no errors when I put my credentials it, but I keep seeing 'Not logged in' at the top of the page [16:56:49] (PS10) Mepps: Make subscription id optional in paypal refund script [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/574864 [17:00:17] fr-tech is there actually a way to check if a path in a multidimensional php array exists all the way down without individually isset & !empty'ing at each element along the way? [17:02:00] jgleeson maybe in 7.4? [17:02:47] :) [17:04:55] Note: [17:04:57] array_key_exists() will search for the keys in the first dimension only. Nested keys in multidimensional arrays will not be found. [17:05:01] WHY ?!?!?1 [17:05:22] who thought that was a good idea [17:06:22] oh hey, isset($arr[0][1][2]) doesn't throw an error [17:06:30] I think you can just use isset! [17:06:40] I think it returns true for an empty string [17:06:48] although that might not be a real issue? [17:07:16] ok, empty works as well if you want to only look for non-falsy values [17:07:26] oh rly [17:07:42] so if links in the chain don't exist it doesn't give a warning? [17:08:00] I coulda sworn it didn't like it [17:08:21] * jgleeson thinks I shoulda tried it before ranting out loud [17:28:47] (PS1) Jgleeson: WIP: map Ingenico createPayment response to Response object [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/575306 (https://phabricator.wikimedia.org/T244536) [17:29:00] Wikimedia-Fundraising-Banners: Euro symbol appears on new line for PTF when decimal is present - https://phabricator.wikimedia.org/T246361 (Pcoombe) a:Pcoombe Nice catch. Fixed by adding white-space: nowrap; to the fee element, I'm not sure why we hadn't done this already. Changes: - [desktop large](htt... [17:29:05] (CR) jerkins-bot: [V: -1] WIP: map Ingenico createPayment response to Response object [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/575306 (https://phabricator.wikimedia.org/T244536) (owner: Jgleeson) [17:36:16] ejegg sorry to be late but yes i was able to log in to cn staging [17:37:11] fundraising-tech-ops, Operations, ops-codfw: (Need by: TBD) codfw: rack/setup/install 3 new payments server for frack - https://phabricator.wikimedia.org/T244169 (Papaul) a:Papaul→Jgreen @Jgreen All yours. [17:38:40] Wikimedia-Fundraising-Banners: Entering too many numbers in the Other donation amount field pushes form out of view - https://phabricator.wikimedia.org/T246367 (jbolorinos-ctr) [17:40:56] Wikimedia-Fundraising-Banners: Entering too many numbers in the Other donation amount field pushes form out of view - https://phabricator.wikimedia.org/T246367 (jbolorinos-ctr) p:Triage→Lowest Since this is an extreme edge case scenario, priority is being set to Lowest [17:44:34] (PS1) Cstone: WIP: Ignore authorization IPN messages from recurring Adyen donations. [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/575313 (https://phabricator.wikimedia.org/T243334) [17:44:59] (CR) jerkins-bot: [V: -1] WIP: Ignore authorization IPN messages from recurring Adyen donations. [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/575313 (https://phabricator.wikimedia.org/T243334) (owner: Cstone) [17:48:57] (PS2) Cstone: WIP: Ignore authorization IPN messages from recurring Adyen donations. [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/575313 (https://phabricator.wikimedia.org/T243334) [17:49:26] (CR) jerkins-bot: [V: -1] WIP: Ignore authorization IPN messages from recurring Adyen donations. [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/575313 (https://phabricator.wikimedia.org/T243334) (owner: Cstone) [17:50:29] (PS3) Cstone: WIP: Ignore authorization IPN messages from recurring Adyen donations. [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/575313 (https://phabricator.wikimedia.org/T243334) [17:56:30] Fundraising-Backlog, Analytics, WMDE-Analytics-Engineering, WMDE-FUN-Team, WMDE-Fundraising-Tech: Find a better way for WMDE to get impression counts for their banners - https://phabricator.wikimedia.org/T243092 (kai.nissen) @Nuria, @AndyRussG I compared the numbers we received from `pgehres.... [18:02:58] ejegg meeting? [18:10:07] Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint CAPS LOCK CULTS, Fundraising Sprint Dampness, Fundraising Sprint Visual Basic Instinct, and 6 others: Collapse countries and regions into one column in the campaign list - https://phabricator.wikimedia.org/T243011 (DStrine) [19:05:50] Fundraising-Backlog, Analytics, WMDE-Analytics-Engineering, WMDE-FUN-Team, WMDE-Fundraising-Tech: Find a better way for WMDE to get impression counts for their banners - https://phabricator.wikimedia.org/T243092 (Nuria) I do not think those two datasets have the same sample size sample sizes,... [19:15:21] Fundraising-Backlog, Analytics, Analytics-Kanban: Turnilo no longer showing sample-rate adjusted data for banner activity - https://phabricator.wikimedia.org/T241162 (Nuria) mmm... i do not see it on turnilo: https://turnilo.wikimedia.org/#banner_activity_minutely/ cc @Milimetric [19:21:02] Fundraising-Backlog, Analytics, Analytics-Kanban: Turnilo no longer showing sample-rate adjusted data for banner activity - https://phabricator.wikimedia.org/T241162 (Nuria) Open→Resolved [19:22:30] Fundraising-Backlog, Analytics, Analytics-Kanban: Whitelist CentralNotice banner history events for sanitization and long-term storage - https://phabricator.wikimedia.org/T245285 (Nuria) Open→Resolved [19:27:57] Fundraising-Backlog, fundraising-tech-ops: fundraising access request for Rosie Lewis - https://phabricator.wikimedia.org/T232632 (mepps) @MBeat33 @RLewis is this still needed? [19:39:14] Wikimedia-Fundraising-Banners: Euro symbol appears on new line for PTF when decimal is present - https://phabricator.wikimedia.org/T246361 (jbolorinos-ctr) Open→Resolved Thanks for the extremely quick fix Peter!!! Fix verified {F31647334} Closing this task now as Resolved. [19:54:26] Wikimedia-Fundraising-Banners: Misplaced Currency Symbol on Desktop Large - Nag banner in Hebrew - https://phabricator.wikimedia.org/T242395 (jbolorinos-ctr) I'm just going to keep this bug open for now until all of the translated text has been input. [20:02:09] AndyRussG: do you know anything about querying inside JSON blobs in Hive? [20:04:48] ejegg: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF#LanguageManualUDF-get_json_object and also https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF#LanguageManualUDF-json_tuple [20:14:16] ottomata: thanks! [20:14:23] jkumalah: ^ more specific links here [20:35:00] thank! [20:35:03] *thanks! [20:38:13] PROBLEM - check_mysql on payments2003 is CRITICAL: Access denied for user nagios@localhost [20:47:12] Fundraising-Backlog, fundraising-tech-ops: fundraising access request for Rosie Lewis - https://phabricator.wikimedia.org/T232632 (RLewis) Hi I feel like I never set this up, so sorry. I've recently received a new laptop with a new yubikey. Let me check in with Caitin Virtue to see if I should still get... [21:03:47] (PS4) Cstone: Ignore authorization IPN messages from recurring Adyen donations. [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/575313 (https://phabricator.wikimedia.org/T243334) [21:08:23] Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint CAPS LOCK CULTS, Fundraising Sprint Dampness, Fundraising Sprint Visual Basic Instinct, and 6 others: Collapse countries and regions into one column in the campaign list - https://phabricator.wikimedia.org/T243011 (mepps) a:mepps→... [21:09:48] Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Dampness, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint X-rays, and 4 others: Show selected countries and regions under tree selector - https://phabricator.wikimedia.org/T243012 (mepps) [21:12:42] Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Dampness, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint X-rays, and 4 others: Show selected countries and regions under tree selector - https://phabricator.wikimedia.org/T243012 (mepps) Current thoughts: - If we're going... [21:25:04] Wikimedia-Fundraising-Banners: "Cannot accept donations greater than 12,000" error message has a rounding error in Malaysia - https://phabricator.wikimedia.org/T246262 (jbolorinos-ctr) Open→Resolved Hey Peter, Thanks so much again for the quick fix. {F31647483} Verified and closing this now as Res... [21:26:44] Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Dampness, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint X-rays, and 4 others: Show selected countries and regions under tree selector - https://phabricator.wikimedia.org/T243012 (mepps) Actually since writing that I'm mu... [21:28:16] Wikimedia-Fundraising-Banners: PTF Checkbox does not align right to left on Desktop Small Banner - https://phabricator.wikimedia.org/T242389 (jbolorinos-ctr) No problem Peter! This is why it's good practice to verify these fixes! :) {F31647490} I've now verified this fix on Desktop Small, so closing this a... [21:42:20] Wikimedia-Fundraising-Banners: Mobile small: amount button layout broken on RTL - https://phabricator.wikimedia.org/T246355 (Pcoombe) Fixed in [this change](https://meta.wikimedia.org/w/index.php?title=MediaWiki:Centralnotice-template-B1920_0301_mlWW_m_p2_sm_cnt&diff=prev&oldid=19849648). @jbolorinos-ctr can... [21:51:03] Fundraising-Backlog, fundraising-tech-ops: Yubikey setup for CDenes - https://phabricator.wikimedia.org/T246390 (spatton) [22:16:11] PROBLEM - check_mysql on payments2002 is CRITICAL: Access denied for user nagios@localhost (using password: YES) [22:17:03] Wikimedia-Fundraising-Banners: Mobile small: amount button layout broken on RTL - https://phabricator.wikimedia.org/T246355 (jbolorinos-ctr) Open→Resolved a:jbolorinos-ctr I've verified this fix on Safari (iOS) and Firefox (Android) {F31647564} {F31647565} Closing this now as resolved. [22:26:10] PROBLEM - check_mysql on payments2002 is CRITICAL: Access denied for user nagios@localhost (using password: YES) [22:31:10] PROBLEM - check_mysql on payments2002 is CRITICAL: Access denied for user nagios@localhost (using password: YES) [22:33:00] ACKNOWLEDGEMENT - check_mysql on payments2002 is CRITICAL: Access denied for user nagios@localhost (using password: YES) Dwisehaupt Newly built hosts, verifying mysql installs still. [22:33:00] ACKNOWLEDGEMENT - check_mysql on payments2003 is CRITICAL: Access denied for user nagios@localhost (using password: YES) Dwisehaupt Newly built hosts, verifying mysql installs still. [22:51:10] RECOVERY - check_mysql on payments2002 is OK: Uptime: 1800 Threads: 10 Questions: 173 Slow queries: 0 Opens: 36 Flush tables: 1 Open tables: 30 Queries per second avg: 0.096 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 [22:55:07] (CR) Ejegg: [C: -1] "For the countries with regions, instead of building the string as you go along, how about this?" (5 comments) [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/571768 (https://phabricator.wikimedia.org/T243011) (owner: Mepps) [22:58:00] (PS2) Ejegg: Add ErrorCode enum to normalize processor errors [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/575272 (https://phabricator.wikimedia.org/T243340)