[00:03:06] (CR) Ejegg: [C: 2] "recheck" [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/469802 (owner: Ejegg) [00:03:29] (CR) jerkins-bot: [V: -1] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/469802 (owner: Ejegg) [00:03:31] (CR) jerkins-bot: [V: -1] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/469802 (owner: Ejegg) [00:08:38] (CR) Ejegg: [V: 2 C: 2] Update Amazon SDK and SmashPig [extensions/DonationInterface/vendor] - https://gerrit.wikimedia.org/r/469803 (owner: Ejegg) [00:09:02] (CR) Ejegg: [C: 2] "recheck" [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/469802 (owner: Ejegg) [00:10:04] (Merged) jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/469802 (owner: Ejegg) [00:20:52] (PS1) Ejegg: Update DonationInterface [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/469806 [00:21:03] (CR) Ejegg: [C: 2] Update DonationInterface [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/469806 (owner: Ejegg) [00:24:58] (Merged) jenkins-bot: Update DonationInterface [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/469806 (owner: Ejegg) [00:32:24] !log updated payments-wiki from f5999d963d to 57e8438e9c [00:32:26] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [00:33:45] weird, it didn't look like the vendor update got synced [00:39:44] (PS1) Ejegg: Update DonationInterface submodule [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/469810 [00:39:56] oh, did I somehow update to an OLDER donationinterface commit? [00:39:57] weird [00:40:08] (CR) Ejegg: [C: 2] Update DonationInterface submodule [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/469810 (owner: Ejegg) [00:43:38] (Merged) jenkins-bot: Update DonationInterface submodule [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/469810 (owner: Ejegg) [00:46:27] Fundraising-Backlog, MediaWiki-extensions-DonationInterface: DonationInterface forms should filter card types by currency - https://phabricator.wikimedia.org/T208011 (Ejegg) [00:59:59] cwd I'm having trouble getting the latest payments-wiki up on frpm [01:00:20] let's see, I think the vendor submodule is OK [01:00:34] but... let me see [01:01:28] yeah, https://phabricator.wikimedia.org/rEDIV56ac709d5632594213e986a01c00d980ffdf5122 [01:01:35] it's definitely there [01:01:56] but for some reason fr_code_update keeps telling me this: [01:02:00] fatal: unable to read db7b22410b1596c94e9545779a7693172d80bc49 [01:02:05] any ideas? [01:02:29] a bit earlier I got this: [01:02:31] error: insufficient permission for adding an object to repository database /srv/www/org/wikimedia/payments/extensions/DonationInterface/.git/modules/vendor/objects [01:02:38] but it seemed to be transient [01:28:44] ejegg: hmm not sure right off, ddg suggests corruption: https://duckduckgo.com/?q=git+%22unable+to+read%22&t=ffab&ia=qa [01:30:57] cwd can we clear out the dir and re-clone it? [01:38:00] ejegg: sure but not just now, making dinner [01:38:12] ok to wait for the morning? [01:40:55] cwd ah, sure [02:10:23] PROBLEM - check_puppetrun on frdb1002 is CRITICAL: CRITICAL: Puppet last ran 8 hours ago [02:15:23] RECOVERY - check_puppetrun on frdb1002 is OK: OK: Puppet is currently enabled, last run 7 seconds ago with 0 failures [08:08:56] fundraising-tech-ops, Icinga, Operations, monitoring: Why doesn't icinga notify the team-fr-tech contact for services in WARNING state? - https://phabricator.wikimedia.org/T207966 (jijiki) p:Triage>Normal [12:45:35] fundraising-tech-ops, Icinga, Operations, monitoring: Why doesn't icinga notify the team-fr-tech-ops contact for services in WARNING state? - https://phabricator.wikimedia.org/T207966 (Jgreen) [14:32:36] (PS24) Jgleeson: WIP: Backend Stats Comparison Script [wikimedia/fundraising/FRUEC] - https://gerrit.wikimedia.org/r/456016 (https://phabricator.wikimedia.org/T198752) [14:32:43] morning Jeff_Green [14:33:01] would you mind clearing out the q [14:33:06] derp [14:33:24] *clearing out the directory for payments-wiki on frpm? [14:33:33] I think git's a little scrambled there [14:33:40] ejegg: let's see if we can figure out the problem [14:33:43] lemme try again [14:34:03] hi cwd! [14:34:15] yoyo [14:34:59] cwd ok, still getting fatal: unable to read db7b22410b1596c94e9545779a7693172d80bc49 [14:35:24] oh huh, that's actually a different commit ID [14:35:30] than I was seeing earlier [14:35:58] that's right after it says it's trying to update the vendor submodule [14:36:08] * submodule extensions/DonationInterface/vendor (2bef6e0f31 --> 56ac709d56) [14:37:35] ok, so locally, I can't see that db7b commit ID anywhere [14:38:49] ejegg: searching for keys, but sounds like maybe the commit has not made it up? [14:40:54] cwd the mediawiki fundraising/REL1_27 pointer to extensions/DonationInterface is at e75873f2417932860a7cc8fb9ad763c624828910 [14:41:37] https://github.com/wikimedia/mediawiki-extensions-DonationInterface/commit/e75873f2417932860a7cc8fb9ad763c624828910 [14:42:08] and that commit's submodule pointer to DonationInterface/vendor is 56ac709d5632594213e986a01c00d980ffdf5122 [14:42:30] https://github.com/wikimedia/mediawiki-extensions-DonationInterface-vendor/commit/56ac709d5632594213e986a01c00d980ffdf5122 [14:42:37] All merged and visible [14:43:27] Fundraising Sprint They Live, Fundraising Sprint USB stands for underhanded socket bureaucracy, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Extend deletion to multiple silverpop databases - https://phabricator.wikimedia.org/T205332 (CCogdill_WMF) Hey Eileen, I will l... [14:45:28] cwd I just cloned fundraising/REL1_27 branch of mw to my homedir on frdev and successfully did a git submodule update --init --recursive [14:45:41] populated the DonationInterface/vendor submodule without any problems [14:46:07] ok, looking [14:46:11] there's something specific to the clone on frpm that's scrambled [14:53:05] I'm gonna deploy a partially-new config for rsyslog in a sec, using new-fangled syntax. If all goes well the only visible change should be that it adds a message when the service decides it's having trouble delivering a particular queue. [15:09:24] (PS2) Umherirrender: Start showing warning for deprecated PHP entry point [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/468408 [15:09:31] (CR) Umherirrender: [C: 2] "Resubmit" [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/468408 (owner: Umherirrender) [15:33:39] any luck with that repo cwd? [15:34:33] not really [15:34:37] git fsck says: [15:34:40] dangling commit 56ac709d5632594213e986a01c00d980ffdf5122 [15:35:15] in donationinterface/vendor [15:36:55] is there a good way to clean that up? Would we lose anything by just re-initializing that dir? [15:39:03] we lose the opportunity to figure out what happened and avoid it [15:39:10] but i think this is the point of diminishing returns [15:41:09] well i recloned vendor and the same thing happens [15:42:25] weird [15:42:51] cwd a lot of submodule data is stored in the parent repo's .git dir though, right? [15:44:12] just pointers to commits afaik [15:47:45] i don't see reference to this db7 commit anywhere [15:48:22] cloning the vendor dir to my computer does not present the problem [15:48:57] ejegg: the problem command is: git diff --numstat -z 2bef6e0f31 56ac709d56 [15:56:23] hmm, that's supposed to generate the pretty output, huh [16:00:50] ejegg: look now? i think it is updated [16:01:21] i dunno wtf happened, i blew everything away and then there were bad perms in .git [16:07:48] thanks, cwd, I'll give it a shot! [16:10:43] !log updated payments-wiki to 34506ce636 [16:10:45] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [16:10:55] cwd yep, looks good now [16:17:33] cool [16:23:11] (CR) jerkins-bot: [V: -1] Start showing warning for deprecated PHP entry point [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/468408 (owner: Umherirrender) [16:30:00] Fundraising Sprint USB stands for underhanded socket bureaucracy, Fundraising-Backlog, MW-1.33-notes (1.33.0-wmf.1; 2018-10-23), Patch-For-Review: Bahrain & Oman donation forms - minimum amount error - https://phabricator.wikimedia.org/T178402 (Ejegg) @MBeat33 and @Pcoombe , this should be workin... [17:12:14] (CR) Umherirrender: [C: 2] Start showing warning for deprecated PHP entry point [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/468408 (owner: Umherirrender) [17:21:37] (CR) jerkins-bot: [V: -1] Start showing warning for deprecated PHP entry point [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/468408 (owner: Umherirrender) [17:23:14] (CR) Umherirrender: "It seems ext.centralNotice.kvStore is a flaky test" [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/468408 (owner: Umherirrender) [17:24:03] (CR) AndyRussG: "> It seems ext.centralNotice.kvStore is a flaky test" [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/468408 (owner: Umherirrender) [17:24:11] (CR) AndyRussG: "recheck" [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/468408 (owner: Umherirrender) [17:30:18] Fundraising Sprint USB stands for underhanded socket bureaucracy, Fundraising-Backlog, MW-1.33-notes (1.33.0-wmf.1; 2018-10-23), Patch-For-Review: Bahrain & Oman donation forms - minimum amount error - https://phabricator.wikimedia.org/T178402 (MBeat33) Great, thank you @Ejegg [17:32:37] (CR) jerkins-bot: [V: -1] Start showing warning for deprecated PHP entry point [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/468408 (owner: Umherirrender) [18:25:04] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi: contribs search timed out - https://phabricator.wikimedia.org/T208078 (MBeat33) [18:34:47] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi: contribs search timed out - https://phabricator.wikimedia.org/T208078 (MBeat33) Turning off the VPN, the search worked in about 3 minutes. [18:49:08] (PS1) C. Scott Ananian: Replace deprecated OutputPage::parse() [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/469973 (https://phabricator.wikimedia.org/T198214) [18:50:04] (PS1) Umherirrender: Start showing warning for deprecated PHP entry point [extensions/LandingCheck] - https://gerrit.wikimedia.org/r/469976 [18:54:43] (CR) jerkins-bot: [V: -1] Replace deprecated OutputPage::parse() [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/469973 (https://phabricator.wikimedia.org/T198214) (owner: C. Scott Ananian) [19:13:34] (PS2) C. Scott Ananian: Replace deprecated OutputPage::parse() [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/469973 (https://phabricator.wikimedia.org/T198214) [20:11:03] (PS1) Ejegg: One more opt_in fix, this time for folks with NULL [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/470033 (https://phabricator.wikimedia.org/T204769) [20:33:15] (CR) XenoRyet: [C: 2] One more opt_in fix, this time for folks with NULL [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/470033 (https://phabricator.wikimedia.org/T204769) (owner: Ejegg) [20:38:04] (Merged) jenkins-bot: One more opt_in fix, this time for folks with NULL [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/470033 (https://phabricator.wikimedia.org/T204769) (owner: Ejegg) [21:34:29] (PS1) Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/470079 [21:34:41] (CR) Ejegg: [C: 2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/470079 (owner: Ejegg) [21:35:41] (Merged) jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/470079 (owner: Ejegg) [21:36:57] !log updated fundraising CiviCRM from 97506677e8 to 65130ef3dd [21:40:41] ejegg: Failed to log message to wiki. Somebody should check the error logs. [21:40:52] thanks stashbot [22:18:50] (CR) Ejegg: [C: 2] "Thanks for the backwards compatibility! I'm afraid it'll be a while before payments-wiki is on 1.33+" [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/469973 (https://phabricator.wikimedia.org/T198214) (owner: C. Scott Ananian) [22:21:36] (Merged) jenkins-bot: Replace deprecated OutputPage::parse() [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/469973 (https://phabricator.wikimedia.org/T198214) (owner: C. Scott Ananian) [22:22:33] Fundraising Sprint USB stands for underhanded socket bureaucracy, Fundraising-Backlog: dash oauth stopped working - https://phabricator.wikimedia.org/T207209 (Ejegg) p:Triage>Normal a:Ejegg