[07:20:48] (CR) Nikerabbit: [C: 2] Fill empty apihelp messages [extensions/ContributionTracking] - https://gerrit.wikimedia.org/r/370086 (owner: Umherirrender) [07:22:25] (Merged) jenkins-bot: Fill empty apihelp messages [extensions/ContributionTracking] - https://gerrit.wikimedia.org/r/370086 (owner: Umherirrender) [14:31:08] (CR) Mepps: [C: 2] Set source fields correctly [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/370289 (https://phabricator.wikimedia.org/T95647) (owner: Ejegg) [14:32:08] (PS2) Mepps: Fix 'Only variables should be passed by reference' [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/369803 (https://phabricator.wikimedia.org/T171560) (owner: Ejegg) [14:32:12] (CR) Mepps: [C: 2] Fix 'Only variables should be passed by reference' [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/369803 (https://phabricator.wikimedia.org/T171560) (owner: Ejegg) [14:33:24] (Merged) jenkins-bot: Fix 'Only variables should be passed by reference' [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/369803 (https://phabricator.wikimedia.org/T171560) (owner: Ejegg) [14:38:06] (Merged) jenkins-bot: Set source fields correctly [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/370289 (https://phabricator.wikimedia.org/T95647) (owner: Ejegg) [15:38:16] fundraising-tech-ops, Patch-For-Review: Unsubscribe AWight from icinga alerts - https://phabricator.wikimedia.org/T170437#3431249 (Jgreen) This is done. Sorry it took so long! [15:38:23] Fundraising-Backlog, Epic: [Epic] Revoke AWight fundraising privileges - https://phabricator.wikimedia.org/T168421#3506319 (Jgreen) [15:38:27] fundraising-tech-ops, Patch-For-Review: Unsubscribe AWight from icinga alerts - https://phabricator.wikimedia.org/T170437#3506317 (Jgreen) Open>Resolved a:Jgreen [15:48:37] Fundraising Sprint Kickstopper, Wikimedia-Fundraising-CiviCRM, FR-Paypal, FR-WMF-Audit: Follow up with Paypal on audit regeneration, enable parser - https://phabricator.wikimedia.org/T167828#3506356 (Aklapper) > @Ejegg triaged this task as Unbreak Now! priority. @Ejegg: This task has been open fo... [17:44:54] Fundraising Sprint Kickstopper, Wikimedia-Fundraising-CiviCRM, FR-Paypal, FR-WMF-Audit: Follow up with Paypal on audit regeneration, enable parser - https://phabricator.wikimedia.org/T167828#3506882 (Ejegg) It's still unbreak now. It's preventing us from properly closing out the last fiscal year... [17:56:02] PayPal says they've regenerated some of the old files. Forcing a re-download. [17:57:16] hey ejegg! [17:58:13] hi mepps! [17:58:24] how goes it? [17:58:56] oh, just following up on a bunch of audit files things, both payPal and Ingenico [17:59:02] how's things with you? [18:00:32] not too bad, i spent a hitting my head against a wall wondering why my drush command wasn't working only to realize i was just testing it the wrong way (wanting drush to list it instead of just trying to run it) [18:00:47] and have wifi connectivity issues because i'm in rural ny [18:01:04] and my friends' wifi apparently stopped working last night :/ [18:01:30] oh jeez, the wifi gods are not being kind to you lately [18:01:31] but it's been an interesting opportunity to explore [18:01:55] nope, it's made me have not much a taste for travel/working going forward [18:02:37] this is even worse than WV though, because we don't even have cell reception at their house and our mobile hotspot gets no signal! [18:02:55] oof. Just gotta travel in cities, I guess! [18:04:07] or stay home where I have childcare, wifi and coffee :) [18:04:27] heh, also an option [18:04:32] but the fact that the wifi died the evening we arrived does make me wonder if i should do a wifi dance or something [18:04:37] ok, going to re-run the paypal audit parser. [18:04:42] good luck! [18:04:44] prepare for failmail! [18:04:53] i'm braced! [18:05:55] oy... killed the parser 'cause I saw a ton of those rows go by [18:06:05] failmail is on its way [18:24:28] well, there were a bunch of fixed transactions in each file, so I just re-ran it to pick those up [18:24:44] updated the tech support ticket with the new damaged row counts [18:25:44] so it was able to work for part of the audit file ejegg? [18:26:09] yeah [18:26:18] (PS4) Mepps: WIP Orphan Slayer Module [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/370225 [18:27:08] I dunno if they're manually fixing db rows or what, but it looks like they're still losing data [18:28:33] heh, the phab ticket for this issue is in the first page of google results for 'paypal audit files' [18:29:29] haha [18:30:16] PROBLEM - check_redis on frqueue1001 is CRITICAL: CRITICAL: recurring is 11299 2000 - REDIS 2.8.17 on 127.0.0.1:6379 has 1 databases (db0) with 7 keys, up 32 days 19 hours - memory use is 11.89M (peak 14.74M, 0.19% of max, fragmentation 1.31%), connected_slaves is 2, donations is 0, jobs is 0, jobs-adyen is 3, jobs-paypal is 1, payments-antifraud is 3, payments-init is 2, pending is 0, refund is 7, unsubscribe is 0 [18:31:02] cwd / Jeff_Green sorry, acking that [18:31:12] ok [18:31:12] does that mean the audit file was good? [18:32:15] ACKNOWLEDGEMENT - check_redis on frqueue1001 is CRITICAL: CRITICAL: recurring is 11299 2000 - REDIS 2.8.17 on 127.0.0.1:6379 has 1 databases (db0) with 7 keys, up 32 days 19 hours - memory use is 11.89M (peak 14.74M, 0.19% of max, fragmentation 1.31%), connected_slaves is 2, donations is 0, jobs is 0, jobs-adyen is 3, jobs-paypal is 1, payments-antifraud is 3, payments-init is 2, pending is 0, refund is 7, unsubscribe is 0 Ell [18:32:15] nning audit files, expected queue flood [18:33:01] cwd I was expecting <2000 new ones [18:33:16] but lemme look at that audit parser code [18:33:27] could be it's re-sending all the recurring ones it finds [18:33:38] and relying on the queue consumer to drop duplicates [18:34:41] yeah, most of the recurring queue seems to be duplicates [18:39:33] aah gotcha [18:40:17] RECOVERY - check_redis on frqueue1001 is OK: OK: REDIS 2.8.17 on 127.0.0.1:6379 has 1 databases (db0) with 6 keys, up 32 days 19 hours - memory use is 1.84M (peak 14.74M, 0.07% of max, fragmentation 2.91%), connected_slaves is 2, donations is 0, jobs is 0, jobs-adyen is 5, jobs-paypal is 1, payments-antifraud is 13, payments-init is 7, pending is 0, recurring is 0, refund is 7, unsubscribe is 0 [19:01:52] (PS2) Mepps: Update config documentation in README [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/369406 (owner: Ejegg) [19:01:56] (CR) Mepps: [C: 2] Update config documentation in README [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/369406 (owner: Ejegg) [19:02:51] (Merged) jenkins-bot: Update config documentation in README [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/369406 (owner: Ejegg) [19:05:44] Fundraising-Backlog, FR-Paypal: PayPal audit parser shouldn't send duplicate recurring donations - https://phabricator.wikimedia.org/T172723#3507468 (Ejegg) [19:17:27] (PS1) Ejegg: PayPal audit: check for existing recurring donations [wikimedia/fundraising/tools] - https://gerrit.wikimedia.org/r/370520 (https://phabricator.wikimedia.org/T172723) [19:17:54] (CR) jerkins-bot: [V: -1] PayPal audit: check for existing recurring donations [wikimedia/fundraising/tools] - https://gerrit.wikimedia.org/r/370520 (https://phabricator.wikimedia.org/T172723) (owner: Ejegg) [19:18:11] Fundraising Sprint Outie Inverter, Fundraising-Backlog, FR-Paypal, Patch-For-Review: PayPal audit parser shouldn't send duplicate recurring donations - https://phabricator.wikimedia.org/T172723#3507574 (Ejegg) p:Triage>Low a:Ejegg [19:19:33] (PS1) Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/370521 [19:35:42] (CR) Ejegg: [C: 2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/370521 (owner: Ejegg) [19:36:29] (Merged) jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/370521 (owner: Ejegg) [19:48:25] (PS5) Mepps: WIP Orphan Slayer Module [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/370225 [19:51:51] !log updated CiviCRM from f24ba787f711ed38029594f3f3049bd79221ddd7 to 200abc23209d608ec54955d40e0845dd975c7a29 [19:52:02] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [20:09:12] fr-tech: sup, any topics for ops chat? [20:09:49] not that I can think of. Jeff_Green - anything to discuss? [20:10:00] nope [20:10:50] the only thing i would bring up is a lot of paypal failmail, but it looks like you are working on that [20:11:45] i don't want to filter failmail if i can help it [20:12:10] (Abandoned) Mepps: WIP Started CCPayment [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/365044 (owner: Mepps) [20:12:35] (Abandoned) Mepps: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/362296 (owner: Mepps) [20:12:57] ejegg/XenoRyet don't forget this patch: https://gerrit.wikimedia.org/r/#/c/366565/ [20:13:24] cwd agreed [20:13:52] i am not using a threaded mail client so a few hundred messages is very loud :) [20:15:28] cwd oof, sorry! [20:15:41] can at least select by pattern, I hope? [20:15:44] heh, luckily i can glob delete [20:15:45] yeah [20:16:15] but if we aren't having any luck getting them to fix it maybe we can at least make it not mail, or only send one mail? [20:16:37] yeah, one mail with a list of txn IDs and the file name would be best, I think [20:17:27] mepps right on, looking! [20:17:48] only thing I can see to fix so far is that there are still a lot of mixed spaces and tabs [20:21:44] ejegg okay, ahh i've actually been using vim more today because it's easier to see the difference (phpstorm doesn't show me which it's using but now that i type that i should see if it can) [20:22:47] (PS5) Mepps: Approve and Cancel payment [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/366565 (https://phabricator.wikimedia.org/T163952) [20:23:29] mepps yeah, it can show whitespace but that gets a bit cluttered. should be able to set the space style per project, though [20:24:08] I think you can put settings for specific directories in your .vimrc too [20:36:17] autocmd BufNewFile,BufRead /path/to/files/* set nowrap tabstop=4 shiftwidth=4 expandtab etc [20:49:01] (PS6) Mepps: Approve and Cancel payment [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/366565 (https://phabricator.wikimedia.org/T163952) [20:49:56] ejegg white space fixed in that patch and i removed the changes to idealstatusprovider, not sure why those were there but seems like creep for them to be in this patch [20:57:13] (PS2) Mepps: Remove obsolete selenium tests and WP responses. [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/368474 (owner: Ejegg) [20:57:53] (CR) Mepps: [C: 2] "ejegg this looks good but should we consider updating selenium tests?" [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/368474 (owner: Ejegg) [20:59:48] (Merged) jenkins-bot: Remove obsolete selenium tests and WP responses. [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/368474 (owner: Ejegg) [21:03:43] ejegg what's the status of this patch: https://gerrit.wikimedia.org/r/#/c/366167/ [21:04:14] mepps looks like it needs a rebase, at least [21:04:43] then I think there are a few things we still need to abstract in the confirm_creditcard transaction [21:05:00] which are looking for XML-API-specific names [21:05:06] like CVVRESULT [21:05:32] are you traveling tomorrow? [21:06:21] i can take a look tomorrow as i think the orphan rectifier stuff is moving along, though need to get tests working [21:06:31] (CR) Ejegg: "Definitely would be good to have some integration tests running. Looks like the new way to run these is via cucumber: https://www.mediawik" [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/368474 (owner: Ejegg) [21:15:46] OMG I JUST GOT MY TINY MONITOR WORKING. [21:15:54] ejegg|afk: ^^ important [21:16:07] Is it as cool as you hoped? [21:16:36] I now have six displays on my desk. [21:16:42] ...I may have a problem. [21:18:08] XenoRyet: It's pretty freaking cool. The ubuntu drivers for it aren't the best... there seems to be something wrong with the colors, such that smooth gradients come out a bit chunky. But all I wanted it for was a special place for chat messages to show up all the time. [21:18:43] Also, I had to do some alligator-wrestling to get it to work at all in Ununtu. [21:18:58] Can confirm, though, that with Windows 10 it's plug and play, and the colors are fine. [21:19:44] Yea, I had some of the same kinds of trouble with my bigger USB monitor and Ubuntu. [21:19:59] DisplayLink drivers? [21:20:02] Most annoying bit being that there's no way to rotate the screen, so I can't use it in a vertical configuration. [21:20:25] oho, I should be able to sideways this thing pretty handily. Let me try it... [21:21:23] Aw. No dice. [21:21:38] The option doesn't exist. My other monitor does it, though. [21:22:11] xrandr? [21:22:40] i have a bunch of stupid scripts to make monitors work right [21:23:09] haha... sounds about right. [21:23:35] if you just type xrandr you should see information about the screens [21:24:28] DVI-I-1-1 connected 1024x600+1600+1280 153mm x 90mm [21:25:29] xrandr --output DVI-I-1-1 --rotate left [21:25:37] might work [21:26:15] cwd: Is "left" clockwise, or counter-clockwise? Left over the top or under the bottom? [21:26:45] heh, no idea [21:26:58] i just thrash till it works [21:27:01] I love ambiguous options. [21:27:24] work, monitor, or I'll thrash some more! [21:28:23] "output DVI-I-1-1 cannot use rotation "left" reflection "none"" [21:28:25] d'oh [21:28:35] weird [21:29:05] ubuntu might also have their own thing going on [21:29:08] I suspect the driver is just not very good. [21:29:17] very possible [21:29:32] soon wayland will come along and shove everything i know out to sea anyway [21:30:06] ha, if you guys want to get these, I'd suggest *not* getting the touch screen if you're going Ubuntu. [21:30:12] It's poking things on a different display. [21:30:33] ha ha [21:31:34] Six monitors, though. I could drive the whole world from this desk. [21:51:08] K4-713: woo! [21:51:40] ordering... [21:53:07] Hmm I wonder how it'd do with Debian unstable [21:57:15] K4-713: are they all attached to the same computer? [21:58:43] cwd: No, there are three on my ubuntu laptop and three on my windows machine. [21:59:04] nice [21:59:39] KM shared between the two with a USB switch [21:59:51] The tiny monitor would bring me to six as well. There'd be seven if I could figure a way to use the VR headset for work. [22:06:15] (CR) Ejegg: "Weird, did something change with DB access in CI?" [wikimedia/fundraising/tools] - https://gerrit.wikimedia.org/r/370520 (https://phabricator.wikimedia.org/T172723) (owner: Ejegg) [22:14:39] Would you really like to navigate mustache templates in 3d VR? [22:14:57] Good point... [22:18:44] fundraising-tech-ops, Patch-For-Review: Unsubscribe AWight from icinga alerts - https://phabricator.wikimedia.org/T170437#3508296 (awight) o/ Looking more stable than ever these days, though! Thanks for all the Fundraising help, and I look forward to chatting about other things <3 [22:20:10] Fundraising-Backlog, Epic: [Epic] Revoke AWight fundraising privileges - https://phabricator.wikimedia.org/T168421#3508298 (awight) [22:20:12] Fundraising-Backlog: Transfer centralnotice-admin mailing list ownership from awight to Jseddon - https://phabricator.wikimedia.org/T168429#3508297 (awight) Open>Resolved [22:20:53] Fundraising-Backlog: Revoke AWight's donatewiki account - https://phabricator.wikimedia.org/T168430#3508300 (awight) p:Triage>Normal [22:22:48] Fundraising-Backlog: Revoke centralnotice-admin for AWight (WMF) - https://phabricator.wikimedia.org/T168428#3508301 (awight) p:Triage>Normal [22:35:33] (PS3) Ejegg: WIP getHostedCheckoutStatus [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/366167 (https://phabricator.wikimedia.org/T163948) [22:43:51] AndyRussG: hey, the firefox 3d-view web debugger has actually come in really handy for me a few times! [23:29:40] Fundraising Sprint Gondwanaland Reunification Engine, Fundraising Sprint Homebrew Hadron Collider, Fundraising Sprint Ivory Tower Defense Games, Fundraising Sprint Judgement Suspenders, and 8 others: retrieve the text/ html and statistics data for m... - https://phabricator.wikimedia.org/T161758#3508451 [23:29:43] Fundraising Sprint Gondwanaland Reunification Engine, Fundraising Sprint Homebrew Hadron Collider, Fundraising Sprint Ivory Tower Defense Games, Fundraising Sprint Judgement Suspenders, and 9 others: Drush not handling spaces in quotes / schedule Si... - https://phabricator.wikimedia.org/T171435#3508449 [23:52:41] Fr-tech and of course the wifi started working after the work day was over [23:54:15] wildcat strike [23:54:16] ?