[03:36:42] mutante: it might be due to 20e998d [04:59:33] 10Wikimedia-Apache-configuration, 10Operations, 10Patch-For-Review, 10User-revi: Change kr.wikimedia.org redirection destination - https://phabricator.wikimedia.org/T222033 (10revi) p:05Normal→03Triage Can I get an attention from Ops? Seems like this is not eligible for Puppet swat as an apache config... [05:38:59] just in case anyone's in here still: seeing some cronspam from cp500* with errors like [05:39:03] Cron /usr/local/sbin/smart-data-dump --syslog --outfile /var/lib/prometheus/node.d/device_smart.prom [05:39:13] 2019-04-30 23:34:03.166493 WARN  puppetlabs.facter - Could not process routing table entry: Expected a destination followed by key/value pairs, got '10.64.0.131 via 10.132.0.1 dev enp5s0f0  mtu lock 1450' [05:39:55] (bunch of those whines) and then 2019-04-30 23:34:03.168420 WARN  puppetlabs.facter - Could not process routing table entry: Expected a destination followed by key/value pairs, got '2620:0:860:101:10:192:0:123 via fe80::66c3:d602:8bc:c7f1 dev enp5s0f0 metric 1024  mtu lock 1450 pref medium' [05:40:00] (bunch of those whines too) [05:40:30] looks like it's once an hour for each box [10:56:59] 10Traffic, 10Operations, 10Performance-Team, 10Thumbor, 10Patch-For-Review: SwiftMedia URL rewrite returns some 404s with wrong Content-Length - https://phabricator.wikimedia.org/T222071 (10Gilles) Probably [17:33:27] 10Traffic, 10DNS, 10Mail, 10Operations, 10Patch-For-Review: wiki-mail DKIM failing - https://phabricator.wikimedia.org/T221290 (10herron) Looking better after merging the above. From a password reminder mail: ` Date: Wed, 01 May 2019 17:29:44 +0000 dkim=pass (1024-bit rsa key sha256) header.d=wikim... [19:41:26] re: cron spam from cp* hosts: TLDR: bug in facter, suppressing warnigns https://gerrit.wikimedia.org/r/c/operations/puppet/+/507634 [19:58:24] but.. that caused even more cron spam from "everything EXCEPT cp" or so.. because they use different facter versions and 2.x does not have a -l option :( [22:27:50] 10Traffic, 10DNS, 10Mail, 10Operations, 10Patch-For-Review: wiki-mail DKIM failing - https://phabricator.wikimedia.org/T221290 (10Krenair) Looks better to me too.