[01:20:31] 10Analytics, 10WMDE-Analytics-Engineering, 10User-GoranSMilovanovic: Public Data for the WMDE Banner Campaigns Dashboard - https://phabricator.wikimedia.org/T210463 (10GoranSMilovanovic) 05Open>03Invalid - I will close this as invalid: a different schema is being applied and no user Id fields, hashed or... [08:31:22] mmmm that refine error for Upload is really weird [08:31:39] I don't see any varnishkafka issue for the timeframe [08:39:50] no changes that I can see in traffic [08:57:25] tried to see if this was again another weird recurrence of dt:'-' but I didn't find anything really clear from the raw logs [09:01:35] unrelated but while debugging I found this: [09:01:35] Nov 30 17:11:53 cp3034 varnishkafka[24713]: KAFKADR: Kafka message delivery error: Local: Required feature not supported by broker [09:08:48] 10Analytics: Varnishkafka error to investigate: - https://phabricator.wikimedia.org/T210939 (10elukey) [09:08:59] 10Analytics: Varnishkafka error to investigate: Required feature not supported by broker - https://phabricator.wikimedia.org/T210939 (10elukey) [09:09:14] 10Analytics, 10User-Elukey: Varnishkafka error to investigate: Required feature not supported by broker - https://phabricator.wikimedia.org/T210939 (10elukey) [09:22:31] all right probably better to start working on it tomorrow [09:23:18] I have an idea that needs Joseph and the Traffic team probably, it doesn't seem too heavy to ping people on Sunday :) [09:23:38] (03CR) 10Framawiki: [C: 032] app.py: Handle meta endpoints when the specified id doesn't exist [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/474530 (https://phabricator.wikimedia.org/T209783) (owner: 10Rafidaslam) [09:24:13] (03Merged) 10jenkins-bot: app.py: Handle meta endpoints when the specified id doesn't exist [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/474530 (https://phabricator.wikimedia.org/T209783) (owner: 10Rafidaslam) [09:26:52] 10Quarry, 10Patch-For-Review: Handle meta endpoints when the specified id doesn't exist - https://phabricator.wikimedia.org/T209783 (10Framawiki) 05Open>03Resolved [09:29:02] (03PS6) 10Framawiki: health.py: initializes health endpoint [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/474532 (https://phabricator.wikimedia.org/T205151) (owner: 10Rafidaslam) [09:30:29] (03CR) 10Framawiki: [C: 032] health.py: initializes health endpoint [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/474532 (https://phabricator.wikimedia.org/T205151) (owner: 10Rafidaslam) [09:31:21] (03Merged) 10jenkins-bot: health.py: initializes health endpoint [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/474532 (https://phabricator.wikimedia.org/T205151) (owner: 10Rafidaslam) [10:02:19] PROBLEM - Check the last execution of check_webrequest_partitions on an-coord1001 is CRITICAL: CRITICAL: Status of the systemd unit check_webrequest_partitions [10:32:55] yeah we know... --^ [13:51:57] 10Analytics: librdkafka 1.0.0 deprecates functions used by varnishkafka - https://phabricator.wikimedia.org/T210944 (10elukey) [13:52:09] 10Analytics, 10User-Elukey: librdkafka 1.0.0 deprecates functions used by varnishkafka - https://phabricator.wikimedia.org/T210944 (10elukey) [19:25:43] (03CR) 10Zhuyifei1999: "@Framawiki: Mind if I merge? I can't think of something that would break," [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/472377 (owner: 10Zhuyifei1999) [20:00:25] (03CR) 10Framawiki: "> Patch Set 1:" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/472377 (owner: 10Zhuyifei1999) [21:26:50] (03CR) 10Zhuyifei1999: [C: 032] Make surrogateescape the global default error handler for Unicode issues [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/472377 (owner: 10Zhuyifei1999) [21:26:56] (03CR) 10jerkins-bot: [V: 04-1] Make surrogateescape the global default error handler for Unicode issues [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/472377 (owner: 10Zhuyifei1999) [21:33:54] (03PS2) 10Zhuyifei1999: Make surrogateescape the global default error handler for Unicode issues [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/472377 [21:34:10] (03CR) 10Zhuyifei1999: [C: 032] Make surrogateescape the global default error handler for Unicode issues [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/472377 (owner: 10Zhuyifei1999) [21:34:40] (03Merged) 10jenkins-bot: Make surrogateescape the global default error handler for Unicode issues [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/472377 (owner: 10Zhuyifei1999) [21:40:37] 10Quarry, 10I18n: Quarry cannot save queries with emojies - https://phabricator.wikimedia.org/T196153 (10Framawiki) Now (since [[ https://gerrit.wikimedia.org/r/c/analytics/quarry/web/+/472377 | Make surrogateescape the global default error handler for Unicode issues ]] deployment?) `🇫🇷` appears as `????????`.