[01:03:10] <grrrit-wm>	 (PS1) Adamw: Prototype of Adyen client-side credit card encryption [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/97658
[01:42:59] <grrrit-wm>	 (PS1) Adamw: (FR #1228) Stupid typo was killing recurring queue consume [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/97662
[01:43:15] <awight>	 mwalker: ^^
[01:43:37] <grrrit-wm>	 (CR) Mwalker: [C: 2] (FR #1228) Stupid typo was killing recurring queue consume [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/97662 (owner: Adamw)
[01:49:52] <grrrit-wm>	 (CR) Mwalker: [C: 2] API for peeking at head messages in a queue [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/96820 (owner: Adamw)
[01:49:54] <grrrit-wm>	 (CR) jenkins-bot: [V: -1] API for peeking at head messages in a queue [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/96820 (owner: Adamw)
[01:50:29] <grrrit-wm>	 (CR) Mwalker: [C: 2] Stomp readTimeout actually does anything [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/96818 (owner: Adamw)
[01:51:31] <grrrit-wm>	 (PS2) Mwalker: API for peeking at head messages in a queue [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/96820 (owner: Adamw)
[01:51:38] <grrrit-wm>	 (CR) Mwalker: [C: 2] API for peeking at head messages in a queue [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/96820 (owner: Adamw)
[01:51:43] <grrrit-wm>	 (PS3) Mwalker: (FR #1144) Damaged queue navigator [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/96685 (owner: Adamw)
[01:51:47] <grrrit-wm>	 (CR) Mwalker: [C: 2] (FR #1144) Damaged queue navigator [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/96685 (owner: Adamw)
[01:53:16] <grrrit-wm>	 (CR) Adamw: [C: 2 V: 2] FR #988 - Allow ThankYou generator to know about all translations [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/93990 (owner: Mwalker)
[01:57:08] <grrrit-wm>	 (PS1) Mwalker: Updated ThankYou templates [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/97666
[01:58:10] <awight>	 !log updated crm from 9979fe9a0f456499ff5be261aa41ca601a88dc13 to 3e7f0d57023e98e6be0e1d7539b2abd04b72ad99
[01:58:22] <morebots>	 Logged the message, Master
[01:59:50] <awight>	 !log rollback crm from 3e7f0d57023e98e6be0e1d7539b2abd04b72ad99 to 9979fe9a0f456499ff5be261aa41ca601a88dc13
[02:00:06] <morebots>	 Logged the message, Master
[02:03:53] <awight>	 !log updated crm from 9979fe9a0f456499ff5be261aa41ca601a88dc13 to 82af6188f5e019ab23636e78719e17c4cb838859
[02:04:10] <morebots>	 Logged the message, Master
[02:04:42] <grrrit-wm>	 (Abandoned) Mwalker: Updated ThankYou templates [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/97666 (owner: Mwalker)
[09:08:24] <grrrit-wm>	 (CR) Nikerabbit: FR #988 - Allow ThankYou generator to know about all translations (4 comments) [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/93990 (owner: Mwalker)
[17:58:58] <mwalker>	 me
[17:59:28] <mwalker>	 ... that was a mistake, but there's no solution but to follow that up with... you
[19:25:50] <K4-713>	 mwalker: Are you talking to yourself? Or was there some kind of hour-plus pause?
[19:26:50] <K4-713>	 I don't want to have to fundraise while we're worried about temporal anomalies.
[19:26:59] <awight_>	 whaa that was amazing backscroll
[19:27:33] <K4-713>	 awight_: Do you have more than I do? ;)
[19:27:52] <awight_>	 nope.  No explanation outside of pure humor
[19:28:34] <K4-713>	 If I'm right, we'll get the first part later.
[19:28:49] <K4-713>	 And then all our notification messages will come in way our of order.
[19:29:01] <K4-713>	 :p
[19:30:05] <awight_>	 crap.  man the spacetime shields
[20:02:48] <awight_>	 K4-713: so, I have the answer: the queue traffic started *before* the test went up... traveling backwards in time, however.  That is what we must correct
[20:15:14] <K4-713>	 AHA
[20:15:16] <K4-713>	 Of course.
[20:15:22] <K4-713>	 I've been so blind.
[20:50:58] <awight_>	 K4|away: Jeff_Green: I'm gonna make the call that today is a nolo contendere for the schema upgrade.  There's a pediatrician thing...  but I reserve the right to pull the string Wednesday morning, if Jgreen is looking sedentary.
[20:51:31] <Jeff_Green>	 awight_: ok. i should have the drush mess sorted out shortly
[20:51:40] <Jeff_Green>	 you're free to abuse lutetium for testing as you have time
[20:56:53] <awight_>	 will do
[20:58:00] <Jeff_Green>	 ok it's installed on lutetium, pls test
[21:02:04] <awight_>	 Jeff_Green:
[21:02:05] <awight_>	 awight@lutetium:/srv/org.wikimedia.civicrm/drupal$ drush sql-cli
[21:02:05] <awight_>	 [sudo] password for awight:
[21:02:11] <awight_>	 rehashing cmdline...
[21:02:22] <awight_>	 logging out...
[21:02:28] <Jeff_Green>	 sec. i bet it's the sudoers file
[21:02:36] <awight_>	 argh same
[21:02:36] <Jeff_Green>	 the drush path changed
[21:04:14] <awight_>	 mwalker brought up a pretty crucial improvement to drush logging, btw: timestamps.
[21:04:17] <awight_>	 wtf
[21:04:18] <awight_>	 omgbbq
[21:04:40] <awight_>	 I wish jenkins were pulling from syslog as well as cheesy stdout
[21:05:05] <Jeff_Green>	 wait whut?
[21:05:18] <Jeff_Green>	 i wish jenkins were dead and we just used cron :-)
[21:05:33] <awight_>	 yes!  I was heaping an oyster shell on the mound
[21:05:38] <Jeff_Green>	 pls try drush again
[21:05:44] <awight_>	 lashing the camel with a straw...
[21:05:45] <awight_>	 k
[21:06:14] <awight_>	 failfail
[21:06:34] <awight_>	 you are welcome to sudo my likeness...
[21:06:46] <Jeff_Green>	 blargharghababhahhbhabhhab
[21:06:47] <Jeff_Green>	 stab.
[21:07:20] * awight_  shields the boxen with a voodoo deflector puppet

[21:07:55] <Jeff_Green>	 we need a samsonite gorilla
[21:08:04] <Jeff_Green>	 ok NOW try
[21:08:06] <Jeff_Green>	 for reals
[21:09:53] <awight_>	 Jeff_Green: can we get one?
[21:09:54] <awight_>	 https://wiki.jenkins-ci.org/display/JENKINS/Timestamper
[21:10:19] <Jeff_Green>	 sigh
[21:10:26] <awight_>	 awight@lutetium:~$ !cd
[21:10:26] <awight_>	 cd /srv/org.wikimedia.civicrm/drupal/
[21:10:26] <awight_>	 awight@lutetium:/srv/org.wikimedia.civicrm/drupal$ !dr
[21:10:26] <awight_>	 drush sql-cli
[21:10:26] <awight_>	 [sudo] password for awight:
[21:10:28] <Jeff_Green>	 maybe someday
[21:11:05] <awight_>	 ooh, your processes are invisible!
[21:11:08] <awight_>	 howtha
[21:11:23] <Jeff_Green>	 why, just why.
[21:15:03] <awight_>	 Jeff_Green: u mind if I install Timestamper?
[21:15:03] <awight_>	 http://localhost:8001/pluginManager/available
[21:15:11] <awight_>	 err that is Jenkins
[21:15:28] <Jeff_Green>	 imo we should do that another time
[21:15:47] <awight_>	 sure
[21:16:13] <awight_>	 lutetium hell is already set aside, so don't lose hairs over it
[21:16:49] <awight_>	 There is, however... a very disturbing trend in our queue consumer builds.
[21:17:12] <awight_>	 They have been randomly taking 12x longer, and I'd like to determine why.
[21:21:38] * Jeff_Green  falls over dead

[21:21:40] <Jeff_Green>	 ok fixed.
[21:21:53] <Jeff_Green>	 basically I am a steady stream of typos at this point
[21:22:02] * awight_  sheepiwshly reaches for the electrical outlet

[21:22:26] <awight_>	 whoohoo!
[21:22:32] <awight_>	 Jeff_Green: verifiable
[21:22:49] <awight_>	 or ahh err, certifiable
[21:23:01] <awight_>	 The night of the fight, you may feel a slight sting. That's pride fucking with you.
[21:23:48] <Jeff_Green>	 ha
[21:24:23] * awight_  shifts his very medium weight back to Timestamp

[21:24:42] <awight_>	 okok, you are worried we'll blow the whole place up, just in time for christmas?
[21:24:55] <Jeff_Green>	 nope
[21:25:16] <Jeff_Green>	 but maybe it would be wise to triple check the config on that box to make sure we can't write to the real master?
[21:25:28] <awight_>	 ah I am speaking of production
[21:25:53] <Jeff_Green>	 i am the confuse
[21:26:23] <awight_>	 the queue draining thing was pretty well disproven in the other channel...  IMO
[21:26:33] <Jeff_Green>	 oh that's good!
[21:26:35] <awight_>	 But now I'm investigating the 12x slowdown