[00:00:17] 10Phabricator, 10Mail, 10Operations: Phabricator email comments not posted - https://phabricator.wikimedia.org/T224752 (10mmodell) I'm not sure if the above problem is the entire issue? It seems like it should be working. [00:03:31] Oh, hah, thanks paladox. [00:03:40] your welcome :) [00:27:54] 10Phabricator, 10Mail, 10Operations: Phabricator email comments not posted - https://phabricator.wikimedia.org/T224752 (10mmodell) Test [00:38:06] 10Phabricator, 10Mail, 10Operations: Phabricator email comments not posted - https://phabricator.wikimedia.org/T224752 (10mmodell) As far as I can tell everything seems to be configured correctly but the messages just disappear. I suspect that something changed with the exim version on stretch? [00:48:52] 10Phabricator: phab irc lang parser doesn't work if times are shown - https://phabricator.wikimedia.org/T180307 (10Peachey88) 05Open→03Resolved a:03Peachey88 Appears to be working now, example: T224738 [00:53:57] 10Continuous-Integration-Config, 10Wikibase-Containers, 10Wikidata, 10Maps (Kartographer), 10Wikimedia-production-error (Shared Build Failure): CachingKartographerEmbeddingHandlerTest phpunit test from Wikibase is failing - https://phabricator.wikimedia.org/T224785 (10Jdforrester-WMF) p:05Unbreak!→03H... [00:55:55] 10Phabricator, 10Mail, 10Operations: Phabricator email comments not posted - https://phabricator.wikimedia.org/T224752 (10mmodell) Note that I've gone through all the upstream troubleshooting steps, however, we have a custom exim setup which is not at all supported by upstream and I wasn't involved in settin... [00:58:19] 10Phabricator, 10Mail, 10Operations: Phabricator email comments not posted - https://phabricator.wikimedia.org/T224752 (10mmodell) adding @chasemp as he was the one who set up phab_epipe.py as far as I remember. [01:08:00] 10Phabricator, 10Mail, 10Operations: Phabricator email comments not posted - https://phabricator.wikimedia.org/T224752 (10Paladox) @mmodell could it be because we don't have php-mailparse installed when on stretch? We installed php-mailparse when using php5 though. [01:17:55] 10Phabricator, 10Mail, 10Operations, 10Patch-For-Review: Phabricator email comments not posted - https://phabricator.wikimedia.org/T224752 (10mmodell) hmm `php-mailparse is already the newest version (3.0.2+2.1.6-12-gae1ef14-3+0~20180910132529.4+stretch~1.gbpcad4a8+wmf1)` [01:20:06] 10Phabricator, 10Mail, 10Operations, 10Patch-For-Review: Phabricator email comments not posted - https://phabricator.wikimedia.org/T224752 (10Paladox) @mmodell Yup, it may be installed but the php class manages the mods (removes ones that are not maintained by the class). [01:21:55] 10Phabricator, 10Mail, 10Operations, 10Patch-For-Review: Phabricator email comments not posted - https://phabricator.wikimedia.org/T224752 (10Paladox) For example if we removed: ` 'mysqlnd': package_name => 'php7.2-mysqlnd', sapis => ['cli', 'fpm'], ` p... [02:18:26] 10Phabricator, 10Mail, 10Operations, 10Patch-For-Review: Phabricator email comments not posted - https://phabricator.wikimedia.org/T224752 (10mmodell) test test [02:26:53] 10Phabricator, 10Mail, 10Operations, 10Patch-For-Review: Phabricator email comments not posted - https://phabricator.wikimedia.org/T224752 (10mmodell) test again! [02:34:02] 10Phabricator, 10Mail, 10Operations, 10Patch-For-Review: Phabricator email comments not posted - https://phabricator.wikimedia.org/T224752 (10mmodell) one more time [02:37:10] 10Phabricator, 10Mail, 10Operations, 10Patch-For-Review: Phabricator email comments not posted - https://phabricator.wikimedia.org/T224752 (10mmodell) ok it looks like it works.. https://gerrit.wikimedia.org/r/513713 should be the fix (Applied manually on phab1003) [02:39:08] 10Phabricator, 10Mail, 10Operations, 10Patch-For-Review: Phabricator email comments not posted - https://phabricator.wikimedia.org/T224752 (10mmodell) @paladox: nice catch noticing that the mailparse module wasn't enabled on fpm in stretch! [06:20:56] 10Continuous-Integration-Config, 10Wikibase-Containers, 10Wikidata, 10Maps (Kartographer), 10Wikimedia-production-error (Shared Build Failure): CachingKartographerEmbeddingHandlerTest phpunit test from Wikibase is failing - https://phabricator.wikimedia.org/T224785 (10Umherirrender) The test contains `... [06:33:52] 10Phabricator, 10Release-Engineering-Team (Kanban), 10Mail, 10Operations, 10Patch-For-Review: Phabricator email comments not posted - https://phabricator.wikimedia.org/T224752 (10greg) p:05Unbreak!→03High Hotfix in place, resetting to High. [09:46:08] (03PS1) 10MarcoAurelio: Edit Project Config [extensions/SpamBlacklist] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/513722 [09:46:47] (03PS2) 10MarcoAurelio: Clean empty project.config sections [extensions/SpamBlacklist] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/513722 [09:46:58] (03CR) 10MarcoAurelio: [V: 03+2 C: 03+2] Clean empty project.config sections [extensions/SpamBlacklist] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/513722 (owner: 10MarcoAurelio) [10:07:50] 10Release-Engineering-Team, 10Operations, 10Release Pipeline, 10serviceops, and 5 others: Introduce kask session storage service to kubernetes - https://phabricator.wikimedia.org/T220401 (10akosiaris) >>! In T220401#5226623, @Eevans wrote: >>>! In T220401#5226531, @akosiaris wrote: >> One minor question. G... [13:14:28] 10Beta-Cluster-Infrastructure, 10Discovery-Search, 10MediaWiki-Search, 10Services (next): Beta Cluster search box displays unexisting pages as results - https://phabricator.wikimedia.org/T186993 (10Krenair) 05Open→03Resolved It looks like this got resolved by Joe in the child ticket [13:18:30] PROBLEM - Long lived cherry-picks on puppetmaster on deployment-puppetmaster03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [13:40:59] PROBLEM - Free space - all mounts on deployment-mwmaint01 is CRITICAL: CRITICAL: deployment-prep.deployment-mwmaint01.diskspace.root.byte_percentfree (<10.00%) [13:51:00] RECOVERY - Free space - all mounts on deployment-mwmaint01 is OK: OK: All targets OK [14:55:24] 10Phabricator: Phabricator May's stats missing - https://phabricator.wikimedia.org/T224804 (10Marostegui) [14:56:42] 10Phabricator: Phabricator May's stats missing - https://phabricator.wikimedia.org/T224804 (10mmodell) Most likely a cron job that was manually created? I don't think I have access to phab1001 anymore but I'll see if I can find the script. [14:59:19] 10Diffusion, 10Phabricator: Set new Diffusion repos URIs to No I/O by default - https://phabricator.wikimedia.org/T224753 (10mmodell) p:05Triage→03Normal [15:01:14] 10Phabricator: move_project script does not check if task is in both future parent and future subproject and does not remove future parent project - https://phabricator.wikimedia.org/T224421 (10mmodell) This is unfortunately sort of expected due to the nature of moving projects around. How would you propose to r... [15:01:35] 10Phabricator: Phabricator May's stats missing - https://phabricator.wikimedia.org/T224804 (10Marostegui) This is 1003: ` root@phab1003:/var/spool# egrep -iR "stats|metr" * cron/crontabs/root:# Puppet Name: phabstatscron_communitymetrics cron/crontabs/root:0 0 1 * * /usr/local/bin/community_metrics.sh ` Looks... [16:12:30] 10Phabricator, 10Mail, 10Regression: Phabricator May's stats missing - https://phabricator.wikimedia.org/T224804 (10Aklapper) [17:29:37] 10Beta-Cluster-Infrastructure, 10User-DannyS712: Enwiki beta cluster: IAdmin rights request - https://phabricator.wikimedia.org/T224809 (10DannyS712) [20:22:38] (03PS1) 10Urbanecm: Whitelist DannyS712 [integration/config] - 10https://gerrit.wikimedia.org/r/513739 [20:51:28] 10Phabricator, 10Mail, 10Regression: "Phabricator monthly statistics" email on wikitech-l@ missing for May 2019 - https://phabricator.wikimedia.org/T224804 (10Aklapper) [20:55:13] 10Project-Admins: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706 (10Aklapper) @WDoranWMF: Added you. The usual disclaimer to [please set good project descriptions](https://www.mediawiki.org/wiki/Phabricator/Creating_and_renaming_projects#Good_practic... [21:10:44] (03CR) 10Jforrester: [C: 03+2] Whitelist DannyS712 [integration/config] - 10https://gerrit.wikimedia.org/r/513739 (owner: 10Urbanecm) [21:11:09] (03CR) 10Jforrester: [C: 03+2] [CentralNotice] Add phan [integration/config] - 10https://gerrit.wikimedia.org/r/513657 (owner: 10Umherirrender) [21:12:15] (03Merged) 10jenkins-bot: Whitelist DannyS712 [integration/config] - 10https://gerrit.wikimedia.org/r/513739 (owner: 10Urbanecm) [21:12:39] (03Merged) 10jenkins-bot: [CentralNotice] Add phan [integration/config] - 10https://gerrit.wikimedia.org/r/513657 (owner: 10Umherirrender) [21:14:08] (03CR) 10DannyS712: "Thanks, but what does this mean?" [integration/config] - 10https://gerrit.wikimedia.org/r/513739 (owner: 10Urbanecm) [21:14:37] !log Reloading Zuul to add phan for CentralNotice and add DannyS712 to whitelist [21:14:39] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [21:25:26] 10Phabricator, 10Release-Engineering-Team (Kanban), 10Mail, 10Operations, and 2 others: Phabricator email comments not posted - https://phabricator.wikimedia.org/T224752 (10Aklapper) [22:30:21] (03PS1) 10Jforrester: Re-apply: [JsonConfig] Add dependency [integration/config] - 10https://gerrit.wikimedia.org/r/513744 [22:51:27] (03CR) 10Jforrester: [C: 03+2] "Let's try this again." [integration/config] - 10https://gerrit.wikimedia.org/r/513744 (owner: 10Jforrester) [22:53:04] (03Merged) 10jenkins-bot: Re-apply: [JsonConfig] Add dependency [integration/config] - 10https://gerrit.wikimedia.org/r/513744 (owner: 10Jforrester) [22:54:38] !log Reloading Zuul to re-add Kartographer dependency for JsonConfig T224785 [22:54:41] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:54:41] T224785: CachingKartographerEmbeddingHandlerTest phpunit test from Wikibase is failing - https://phabricator.wikimedia.org/T224785 [22:56:39] Krinkle: I imagine https://gerrit.wikimedia.org/r/c/mediawiki/core/+/513106 will be of significant interest to you, BTW. :-) [23:00:05] James_F: Yeah, Kosta was/is working on something similar [23:00:50] I think they worked together at the hackathon. [23:00:58] (With A.mir1)