[00:00:17] i'm just looking at a bit of those 'extended report updates' - pretty chunky. any suggestions for review or local testing? [00:00:40] Looks like this is the stuff that lets you add an extended report as a contact summary tab? [00:02:42] fundraising-tech-ops, Operations, ops-codfw, Patch-For-Review: move/setup/install frauth2001.codfw.wmnet - https://phabricator.wikimedia.org/T204079 (Dzahn) Yep, with a /29 netmask and 10.195.0.72 as the network address, .79 is the broadcast address. It looks like .73 is not used though and we c... [00:09:01] fundraising-tech-ops, Operations, ops-codfw, Patch-For-Review: move/setup/install frauth2001.codfw.wmnet - https://phabricator.wikimedia.org/T204079 (Dzahn) And as Arzhel points out .73 is already the router IP, so afraid this network is already full now and the host can't be added. And changing... [00:10:03] ejegg: yeah there is a bunch of stuff in there - we don’t use extended reports that heavily so it’s OK to only lightly review IMHO [00:10:17] the fraud report uses it [00:10:26] trying to think what else we use it for [00:10:45] From a MG POV it will add ‘join filters' [00:10:59] ok, cool. my IDE is pointing out a call to a private function in a parent class, but that seems to be pre-existing.. [00:11:18] ie. ability to LEFT JOIN with a where on the join [00:11:30] ah, that's nice to have in the UI! [00:11:37] specifically so they can show ‘websites but only of type ‘Benefactor’ [00:11:45] it also adds some sorting [00:12:02] but I also got really fed up of cruft & did quite a big overhaul - [00:12:27] historically I tried to extend the parent report class & deal with some of it’s weirdneses [00:12:49] but I decided I’m actually going to work towards not having any dependency on the parent [00:13:17] which will make it a bit unstable in the short term but better in the longer term [00:13:17] wow, that won't mean reinventing a ton? [00:13:45] well I don’t know if I will 100% cut the apron strings (copy the functions across & remove the extends clause) [00:14:05] but there are just some bad bad decisions in the parent about how it handles metadata [00:15:03] I go back & forth a bit TBH on trying to port improvements into the parent & giving up on the parent & I’m in the latter camp at the moment [00:15:34] ahh, parent class is just too entangled with other legacy stuff? [00:16:09] yeah well also all those functions like getSelectedFields & getSelectedFilters don’t exist [00:16:20] so it just endlessly iterates $this->_columns [00:16:35] blech [00:16:49] which might be OK-ish except in core the spec for a table is [‘fields’ => [], ‘fitlers’ => []…] [00:17:09] & there is no ‘metadata’ so when a filter is defined but the field isn’t exposed it gets messy real quick [00:17:54] I’ve started to port the ‘metadata’ declarations into core - but it’s hard because there are a bunch of weird & wonderful reports in there [00:20:44] fundraising-tech-ops, Operations, ops-codfw, Patch-For-Review: move/setup/install frauth2001.codfw.wmnet - https://phabricator.wikimedia.org/T204079 (ayounsi) 10.195.0.73 is the router IP, it's missing from DNS, I'll add it (and the other ones). And indeed, it can't be extended to a /28. Short t... [00:53:57] fundraising-tech-ops, Operations, ops-codfw, Patch-For-Review: move/setup/install frauth2001.frack.codfw.wmnet - https://phabricator.wikimedia.org/T204079 (Dzahn) [00:54:02] fundraising-tech-ops, Operations, ops-codfw, Patch-For-Review: move/setup/install frauth2001.frack.codfw.wmnet - https://phabricator.wikimedia.org/T204079 (Jgreen) >>! In T204079#4579043, @ayounsi wrote: > Short time solution, if this host replaces an existing host in the same subnet, is to re-al... [00:56:05] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: RichText fields munged - https://phabricator.wikimedia.org/T204179 (Eileenmcnaughton) [00:56:15] (PS2) Ejegg: Extended reports updates [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/459642 (owner: Eileen) [00:56:31] (CR) Ejegg: [C: 2] "Looks good at a glance!" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/459642 (owner: Eileen) [00:56:38] :-) [00:56:44] well, an /extended/ glance [00:56:52] a short gaze? [00:57:20] so that's the last of the things to deploy today, yeah? [00:57:56] The opt-in qc merged earlier, and that's tied to the unsub qc so it'll start automatically [00:58:20] Jeff_Green deployed the necessary config for it this morning, though, so it should be fine [01:04:06] (Merged) jenkins-bot: Extended reports updates [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/459642 (owner: Eileen) [01:09:01] ejegg: yeah I think so [01:12:17] ok, cool [01:13:15] looks like the queues are pretty quiet [01:13:28] till the next hourly recurring charge jon [01:13:31] *job [01:14:25] (PS1) Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/460182 [01:17:13] (CR) Ejegg: [C: 2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/460182 (owner: Ejegg) [01:18:32] (Merged) jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/460182 (owner: Ejegg) [01:20:40] just going to eat something then will push that out [01:20:55] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Profile won't save if contact_id is in it - https://phabricator.wikimedia.org/T204181 (Eileenmcnaughton) [01:24:19] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Figure out best way to make current employer ' a movable feast' - https://phabricator.wikimedia.org/T204182 (Eileenmcnaughton) [01:28:51] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Figure out best way to make current employer ' a movable feast' - https://phabricator.wikimedia.org/T204182 (Eileenmcnaughton) @NNichols so thinking about this - it seems like we ideally want the... [01:43:43] cwd: are you around to help with a trigger update? [01:45:57] !log disabled fundraising CiviCRM jobs [01:46:03] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [01:48:14] !log updated CiviCRM from 2a3583cca1 to b0d7df4e60 [01:48:19] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [02:20:22] ejegg: I can check in that filter script via gerrit - cwd can do it at a time that suits him [02:21:34] ok, thanks eileen [02:21:51] remind me the drush command again? [02:21:59] sql-dump-triggers or the like? [02:22:12] so basically I turn logging off & on & then fish the files out of ConfigAndLog [02:22:25] (then I scp them to my local & do a commit from there) [02:22:32] ah, that works [02:23:16] ok, I just did one run of the donations qc, and the last few imported look good as far as the wmf_contribution_extra table is concerned [02:23:24] and the unsub qc doesn't blow up [02:23:25] cool [02:23:29] I'm going to restart the jobs [02:23:32] great [02:24:45] !log restarted fundraising CiviCRM jobs [02:24:50] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [02:32:18] PROBLEM - check_mysql on frdev1001 is CRITICAL: Slave IO: Yes Slave SQL: No Seconds Behind Master: (null) [02:33:02] (PS1) Eileen: Updated triggers. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/460187 (https://phabricator.wikimedia.org/T199753) [02:34:19] hey [02:34:21] hmmm [02:36:01] cwd ouch [02:36:14] what does that mean? [02:36:23] this looks like a problem: Error 'Unknown column 'log_id' in 'log_civicrm_contact_layout' [02:36:32] ah hmm [02:36:54] it looks like it's stopping replication [02:37:17] cwd new table created by updating logging [02:37:18] PROBLEM - check_mysql on frdev1001 is CRITICAL: Slave IO: Yes Slave SQL: No Seconds Behind Master: (null) [02:37:25] & the field you guys added didn’t get added [02:37:33] ie. you added to the others [02:37:41] so if you just add that field we should be OK for now [02:37:53] & then we should log a phab to be more robust in future [02:38:45] ok, it was jeff's doing so let me try and find what he did [02:39:13] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: New logging tables don't pick up our new primary key - https://phabricator.wikimedia.org/T204187 (Eileenmcnaughton) [02:39:21] cwd - it’s a bit vague https://phabricator.wikimedia.org/T204187 [02:40:45] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: New logging tables don't pick up our new primary key - https://phabricator.wikimedia.org/T204187 (Eileenmcnaughton) [02:42:18] PROBLEM - check_mysql on frdev1001 is CRITICAL: Slave IO: Yes Slave SQL: No Seconds Behind Master: (null) [02:42:44] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Figure out best way to make current employer ' a movable feast' - https://phabricator.wikimedia.org/T204182 (Eileenmcnaughton) https://github.com/civicrm/org.civicrm.contactlayout/issues/22 [02:47:18] PROBLEM - check_mysql on frdev1001 is CRITICAL: Slave IO: Yes Slave SQL: No Seconds Behind Master: (null) [02:47:45] eileen: can you think of any reason the column would exist on the master but not the slave? [02:48:19] cwd not really - I turned logging off & on which might have created that table [02:48:33] but I would have thought it would create without the column on both [02:48:48] cwd you can drop the table in the interim [02:49:02] & punt resolving it until a better time [02:50:04] (check first but I’m pretty sure there are no triggers inputting into it yet - based on them only just showing up in the trigger script - https://gerrit.wikimedia.org/r/#/c/wikimedia/fundraising/crm/+/460187/1/sites/all/modules/wmf_civicrm/scripts/4.7.trigger.drop.mysql ) [02:51:57] i can't imagine why it would exist one place and not the other [02:52:18] PROBLEM - check_mysql on frdev1001 is CRITICAL: Slave IO: Yes Slave SQL: No Seconds Behind Master: (null) [02:55:48] argh [02:56:10] it's on the other servers but not frdev [02:56:41] i am afraid of rattling anything and screwing up replication [02:57:18] PROBLEM - check_mysql on frdev1001 is CRITICAL: Slave IO: Yes Slave SQL: No Seconds Behind Master: (null) [02:58:31] cwd Oh right it’s only frdev! [02:59:04] eileen: how come? [03:01:43] cwd I mean - the problem is only affecting frdev [03:02:18] PROBLEM - check_mysql on frdev1001 is CRITICAL: Slave IO: Yes Slave SQL: No Seconds Behind Master: (null) [03:02:25] eileen: yeah, that's where the column is missing [03:02:40] do you know why? i am at a loss [03:02:44] no idea! [03:03:15] in terms of getting you back offline - is it ok to leave a replication problem overnight if only frdev is affected? [03:03:16] i have been strongly advised against any write queries on the slaves [03:04:17] probably better to just ack the alert for tonight but i don't love it [03:07:18] PROBLEM - check_mysql on frdev1001 is CRITICAL: Slave IO: Yes Slave SQL: No Seconds Behind Master: (null) [03:08:06] cwd yeah not great but prob OK [03:08:28] we should maybe let ccogdill know as it might affect silverpop export (to be a day old) [03:12:18] PROBLEM - check_mysql on frdev1001 is CRITICAL: Slave IO: Yes Slave SQL: No Seconds Behind Master: (null) [03:12:30] ACKNOWLEDGEMENT - check_mysql on frdev1001 is CRITICAL: Slave IO: Yes Slave SQL: No Seconds Behind Master: (null) Casey Dentinger Replication problem, does not compute, need to look it over in the morning. We have two other replicas so it should not be a risk. [03:13:35] eileen: i'll file a task unless you already did? [03:14:12] cwd https://phabricator.wikimedia.org/T204187 [03:14:20] I thought it was just gonna be for next time [03:14:28] but looks like more diagnositcs on this time required [03:15:09] eileen: thanks! i'll make a subtask of that for the specific mysql problem [03:15:36] it seems like a bug to me, i can't imagine any reason it would replicate elsewhere but not on frdev [03:16:50] eileen: the new log table was added from php? [03:16:58] was the new table it is based on too? [03:16:58] cwd yep [03:17:10] yep - but earlier [03:17:20] cool [03:31:29] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: MySQL replication broken on frdev1001 - https://phabricator.wikimedia.org/T204188 (cwdent) [03:31:50] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: MySQL replication broken on frdev1001 - https://phabricator.wikimedia.org/T204188 (cwdent) p:Triage>High [03:52:57] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi: did script delete a contact's email address? - https://phabricator.wikimedia.org/T203198 (Eileenmcnaughton) @MBeat33 that contact has since been merged but that log_conn_id relates to this u... [04:47:32] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi: did script delete a contact's email address? - https://phabricator.wikimedia.org/T203198 (Eileenmcnaughton) [04:50:31] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: wmf_contribution_extra table is inserted twice for a single contribution insert - https://phabricator.wikimedia.org/T203537 (Eileenmcnaughton) Open>Resolved I don't t... [04:59:45] (PS1) Brian Wolff: Make phan-taint-check pass on this extension [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/460195 (https://phabricator.wikimedia.org/T202372) [05:00:42] (CR) Brian Wolff: "check experimental" [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/460195 (https://phabricator.wikimedia.org/T202372) (owner: Brian Wolff) [05:00:59] (CR) jerkins-bot: [V: -1] Make phan-taint-check pass on this extension [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/460195 (https://phabricator.wikimedia.org/T202372) (owner: Brian Wolff) [05:01:02] (CR) jerkins-bot: [V: -1] Make phan-taint-check pass on this extension [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/460195 (https://phabricator.wikimedia.org/T202372) (owner: Brian Wolff) [05:02:11] (CR) jerkins-bot: [V: -1] Make phan-taint-check pass on this extension [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/460195 (https://phabricator.wikimedia.org/T202372) (owner: Brian Wolff) [07:30:28] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: MySQL replication broken on frdev1001 - https://phabricator.wikimedia.org/T204188 (jcrespo) `mysqlbinlog: unknown variable 'default-character-set=binary'` is a [[ https://jira.mariadb.org/browse/MDEV-15835 | known bug ]] of mariadb. Run instead: ``` s... [07:32:17] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: MySQL replication broken on frdev1001 - https://phabricator.wikimedia.org/T204188 (jcrespo) > I considered adding the column on frdev1001 but writing only to the replica seems like a good way to make a mess With care, but that would be the recommended... [07:32:26] (PS2) Brian Wolff: Build: Make phan-taint-check 1.5.0 pass on this extension [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/460195 (https://phabricator.wikimedia.org/T202372) [07:33:59] (CR) jerkins-bot: [V: -1] Build: Make phan-taint-check 1.5.0 pass on this extension [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/460195 (https://phabricator.wikimedia.org/T202372) (owner: Brian Wolff) [07:36:57] (CR) jerkins-bot: [V: -1] Build: Make phan-taint-check 1.5.0 pass on this extension [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/460195 (https://phabricator.wikimedia.org/T202372) (owner: Brian Wolff) [07:37:37] (PS3) Brian Wolff: Build: Make phan-taint-check 1.5.0 pass on this extension [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/460195 (https://phabricator.wikimedia.org/T202372) [07:45:39] (CR) Brian Wolff: "check experimental" [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/460195 (https://phabricator.wikimedia.org/T202372) (owner: Brian Wolff) [07:54:36] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: MySQL replication broken on frdev1001 - https://phabricator.wikimedia.org/T204188 (Eileenmcnaughton) Note that it's fine to lose the contents of that table - if any - so no backfill required [09:22:29] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: MySQL replication broken on frdev1001 - https://phabricator.wikimedia.org/T204188 (Pcoombe) What are the chances of replication being fixed by 15 UTC today? Or should we plan to delay our English test? [12:53:25] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi: did script delete a contact's email address? - https://phabricator.wikimedia.org/T203198 (MBeat33) Thank you, @Eileenmcnaughton I will remember/document that just being in a recipient group... [13:32:10] RECOVERY - check_mysql on frdev1001 is OK: Uptime: 2628977 Threads: 3 Questions: 90314298 Slow queries: 578586 Opens: 12080 Flush tables: 1 Open tables: 1135 Queries per second avg: 34.353 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 [13:39:35] yey [13:42:41] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: MySQL replication broken on frdev1001 - https://phabricator.wikimedia.org/T204188 (cwdent) @jcrespo thank you for the info! I added the column to frdev1001, and then the error fell to another: log_civicrm_value_partner_19 I found the command to add th... [14:53:42] Wikimedia-Fundraising, MediaWiki-extensions-NavigationTiming, Performance-Team: Track when a CentralNotice banner was displayed to the user in NavTiming - https://phabricator.wikimedia.org/T195840 (AndyRussG) @Gilles Apologies for the delay... Is it ok with you if this goes on next week's deployment... [15:10:19] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi: restore quick Unsubscribe Email list to Navigation menu - https://phabricator.wikimedia.org/T204249 (MBeat33) [15:27:26] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi: restore quick Unsubscribe Email list to Navigation menu - https://phabricator.wikimedia.org/T204249 (MBeat33) Open>Resolved a:MBeat33 Hah, looks like this option just migrated to the opposite corner, please ignore! [16:20:55] fr-tech as of yesterday, we have CentralNotice browser tests failing on OSX, on both Chrome and Firefox [16:20:57] https://integration.wikimedia.org/ci/job/selenium-CentralNotice/ [16:21:06] yikes! [16:21:18] AndyRussG do we know what changed? [16:21:24] no, I just saw it [16:21:37] Looks like a red flag, since normally when somehting's wrong with the browser tests, they all fail [16:23:32] a red flag? [16:30:04] mepps: as in, why would it fail only on that platform? I've never seen that before [16:30:22] the browser tests are fragile and I've seen them fail all together for different reasons [16:30:36] so it could be some change that is causing problems just on that platform [16:30:46] it's a change that's only for sure on the beta cluster [16:30:55] 'cause that's what we test agains [16:30:57] t [16:32:23] Wikimedia-Fundraising, MediaWiki-extensions-NavigationTiming, Performance-Team: Track when a CentralNotice banner was displayed to the user in NavTiming - https://phabricator.wikimedia.org/T195840 (Gilles) Yes, next train is totally fine, thanks! [16:55:49] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, FR-Amazon, FR-Smashpig, Unplanned-Sprint-Work: Support Amazon payments initiated off paymentswiki - https://phabricator.wikimedia.org/T194317 (DStrine) [17:24:23] fr-tech mepps the failing browser tests on OS-X are a browser test configuration problem [17:24:24] https://integration.wikimedia.org/ci/job/selenium-CentralNotice/lastBuild/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,label=BrowserTests/console [17:24:46] So not so urgent [17:25:15] I'll just make a task for the fixing the config [17:25:57] fr-tech dstrine any of you on OS-X if you want to just check that you see a banner here, just to be sure: https://en.wikipedia.beta.wmflabs.org/wiki/Main_Page [17:26:00] thx!!!! [17:26:51] AndyRussG: this is what I see in chrome: https://www.screencast.com/t/lltITNY1 [17:27:13] I see the same thing in firefox [17:27:43] same in safari [17:27:44] dstrine: yep all good! [17:27:47] thx much! [17:27:50] np [17:28:08] There was some task for upgrading our browser tests in general, or some ask about that from releng [17:28:16] I'll try to link that in or something [17:35:08] fundraising-tech-ops, Operations, ops-codfw, Patch-For-Review: move/setup/install frauth2001.frack.codfw.wmnet - https://phabricator.wikimedia.org/T204079 (Papaul) I talked with @Jgreen on IRC, he said to use the IP address of frmon2001 for frauth2001 for now since frmon2001 is not installed yet. [17:54:36] fundraising-tech-ops, Operations, ops-codfw, Patch-For-Review: rack/setup/install Prometeuse/Grafana host frmon2001 for fr-tech - https://phabricator.wikimedia.org/T196476 (Papaul) [18:27:16] fundraising-tech-ops, Operations, netops: Grow frack-administration-codfw to /28 - https://phabricator.wikimedia.org/T204271 (ayounsi) p:Triage>Normal [18:40:53] Fundraising-Backlog, fundraising-tech-ops: Renew ccogdill's civicrm SSL cert - https://phabricator.wikimedia.org/T203495 (cwdent) @CCogdill_WMF you have a current cert good until 2019-04-02, the files (ccogdill.pw and ccogdill.p12) are in your home dir on frdev1001. Feel free to reach out on IRC if you'... [20:16:11] (PS4) Mepps: Move from clearCache which deletes everything under the key 'translate-groups' to recache, which just restores the definitions [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/459834 (https://phabricator.wikimedia.org/T203925) [20:16:13] (PS2) Mepps: Insert a job into the queue because in this case it is not fast enough to wait for run Would love testing on this patch [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/459843 [20:31:38] Fundraising Sprint Karma chameleons hide amongst us, Fundraising Sprint Lactose is unusually tolerant, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Naming Sprints Is Not Important, and 10 others: Create Ingenico orphan rectifier ... - https://phabricator.wikimedia.org/T163949 [20:32:37] Fundraising Sprint Karma chameleons hide amongst us, Fundraising Sprint Lactose is unusually tolerant, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Naming Sprints Is Not Important, and 6 others: New scripts to ingress data from K... - https://phabricator.wikimedia.org/T195594 [20:33:30] Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Owls, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Queue is pronounced GJif, and 3 others: Investigate why Ingenico donation did not recur on 6/14 - https://phabricator.wikimedia.org/T199331 (mepps) @Ejegg ca... [20:41:46] fundraising-tech-ops, Operations, ops-codfw, Patch-For-Review: move/setup/install frauth2001.frack.codfw.wmnet - https://phabricator.wikimedia.org/T204079 (Papaul) [22:17:12] ejegg: just looking at the queue like I’m seeing a distinct improvment - but also that there are enough data points that don’t fit any pattern I’m trying to describe that it’s hard to make a strong declaration [22:18:12] but we have mostly sustained > 6 per second [22:19:09] & last week we didn’t really cross 5 per second - https://grafana.wikimedia.org/dashboard/db/fundraising-overview?orgId=1&from=now-1w%2Fw&to=now-1w%2Fw&refresh=1m [22:23:26] eileen_: yeah, definitely better today! [22:24:58] the average queue delay was around a minute for the whole test [22:25:20] I'd say we're in pretty good shape [22:47:18] is the test finished? [22:49:46] eileen_: yeah, about 6 hrs ago [22:49:54] ok cool [23:04:43] ejegg: should we push out the civi update today? [23:05:07] sure, let me at least pull it down locally to click around [23:05:42] (CR) Ejegg: [C: 2] Updated triggers. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/460187 (https://phabricator.wikimedia.org/T199753) (owner: Eileen) [23:06:23] ejegg: I actully haven’t tested if the api switch is an issue yet [23:06:32] but if you pull that should do it [23:06:39] ie. the core tarball now ships with api v4 [23:07:05] ah, so we'll want to remove the extension version at some point [23:07:16] so as not to have possibly conflicting versions of things? [23:09:51] ejegg: yep [23:11:38] eileen_: I keep fogetting, what's the fix for the upgrade re-creating the geocoder zip dataset log tables? [23:11:39] (Merged) jenkins-bot: Updated triggers. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/460187 (https://phabricator.wikimedia.org/T199753) (owner: Eileen) [23:11:57] ejegg: turn logging off before the upgrade & on after [23:12:09] d'oh, that's right [23:13:16] ooh, fun: Civi\API\Exception\NotImplementedException: "API (Contact, get) does not exist (join the API team and implement it!)" [23:13:23] on trying to view a contact page [23:13:31] hmm, lemme just drush cc all [23:14:10] so yeah, maybe we need to turn off the extension version? [23:15:10] oh weird, that was transient [23:23:01] eileen_: so after that one hiccup at the start, it's looking good [23:23:11] ejegg: cool [23:56:31] (CR) Ejegg: [C: 2] Stock CiviCRM 5.6 as at commit b875df23ab [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/459860 (owner: Eileen) [23:56:46] (CR) Ejegg: [C: 2] Apply our patches to 5.6 rc [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/457783 (owner: Eileen) [23:56:53] (CR) Ejegg: [C: 2] Port caching patches [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/459861 (owner: Eileen)