[05:01:58] Analytics-EventLogging, ArchCom-RfC, Discovery, Graphs, and 9 others: RFC: Use YAML instead of JSON for structured on-wiki content - https://phabricator.wikimedia.org/T147158#2683091 (Florian) I also think we shouldn't move to JSON with this Little Benefiz. E.g. JSON already Supports comments, No... [07:10:59] !log rebooting eventlog1001 for kernel upgrades (EventLogging stopped) [07:16:18] all good, all processes up and running [07:27:50] PROBLEM - Kafka MirrorMaker main-eqiad_to_analytics on kafka1012 is CRITICAL: PROCS CRITICAL: 0 processes with command name java, regex args kafka.tools.MirrorMaker.+/etc/kafka/mirror/main-eqiad_to_analytics/producer\.properties [07:28:02] I restarted the process but the logs were a bit weird [07:31:40] PROBLEM - Difference between raw and validated EventLogging overall message rates on graphite1001 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [30.0] [07:36:41] RECOVERY - Difference between raw and validated EventLogging overall message rates on graphite1001 is OK: OK: Less than 20.00% above the threshold [20.0] [08:14:15] this one was of course me :) [09:35:01] Analytics, Commons, Lexicographical data, Multimedia, and 4 others: Allow structured datasets on a central repository (CSV, TSV, JSON, GeoJSON, XML, ...) - https://phabricator.wikimedia.org/T120452#2687657 (Aklapper) [09:41:23] Analytics-Tech-community-metrics, Developer-Relations: Measuring Time To First Code Change (TTFCC) - https://phabricator.wikimedia.org/T137201#2687674 (Peter) yes I can do that. - Core and extensions - Gadgets - Bots - Tools - Templates / Lua modules - Mobile apps Thinking something like: m... [09:44:19] Analytics, Commons, Multimedia, Tabular-Data, and 3 others: Allow structured datasets on a central repository (CSV, TSV, JSON, GeoJSON, XML, ...) - https://phabricator.wikimedia.org/T120452#2687677 (Lydia_Pintscher) [10:11:58] Analytics, Community-Liaisons, User-Johan: Collect information about how we collect user statistics in one place - https://phabricator.wikimedia.org/T132405#2687817 (Qgil) [12:20:22] PROBLEM - Difference between raw and validated EventLogging overall message rates on graphite1001 is CRITICAL: CRITICAL: 26.67% of data above the critical threshold [30.0] [12:28:12] RECOVERY - Difference between raw and validated EventLogging overall message rates on graphite1001 is OK: OK: Less than 20.00% above the threshold [20.0] [13:05:11] Analytics-Cluster, Operations, Traffic: Respect X-Forwarded-For only from trustworthy sources - https://phabricator.wikimedia.org/T56783#2688311 (BBlack) So I've linked above that we have a separate task already about moving Zero's trusted proxy lists to metawiki, for more-transparent / community man... [13:15:52] Analytics-Tech-community-metrics, Differential, Developer-Relations (Oct-Dec-2016): Make MetricsGrimoire/korma support gathering Code Review statistics from Phabricator's Differential - https://phabricator.wikimedia.org/T118753#2688370 (Qgil) Just checking: is this task committed to #devrel-oct-dec-16 ? [13:30:48] Analytics-Tech-community-metrics, Differential, Developer-Relations (Jan-Mar-2017): Make MetricsGrimoire/korma support gathering Code Review statistics from Phabricator's Differential - https://phabricator.wikimedia.org/T118753#2688465 (Aklapper) Thanks for the ping! Very unlikely, hence punting. It'... [14:04:51] Analytics-Cluster, Operations, hardware-requests: Decommission analytics1026 and analytics1015 - https://phabricator.wikimedia.org/T147313#2688601 (elukey) [14:06:49] !log applied role::spare to analytics1026 opened a task to decom it together with 1015 [14:07:08] that is https://phabricator.wikimedia.org/T147313 [14:07:20] analytics1015 is the one running the zombie version of oozie [14:07:37] meanwhile 1026 has not been used in ages [14:07:45] I already discussed this with Andrew last week [14:08:00] 1026 might be wiped and re-used for the spare pool managed by ops [14:31:16] PROBLEM - Difference between raw and validated EventLogging overall message rates on graphite1001 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [30.0] [14:35:27] RECOVERY - Difference between raw and validated EventLogging overall message rates on graphite1001 is OK: OK: Less than 20.00% above the threshold [20.0] [15:21:26] Analytics-Kanban: Report puppet code for Event Logging and make sure monitoring is using the best counts - https://phabricator.wikimedia.org/T147321#2688873 (Milimetric) [15:32:13] nuria_, having problems to join... [15:32:19] mforns: k [15:32:40] mforns: just rejoined too [15:32:45] aha [15:33:59] nuria_, hangouts is timing out and does not let me in... [15:53:24] mforns: frozeeennn [17:01:06] elukey: staff on batcave .... [18:00:46] Analytics-EventLogging, ArchCom-RfC, Discovery, Graphs, and 9 others: RFC: Use YAML instead of JSON for structured on-wiki content - https://phabricator.wikimedia.org/T147158#2683091 (Bawolff) I'm not a fan of YAML, as it has certain features which are unsafe. Obviously these can be disabled, but... [18:11:34] PROBLEM - Difference between raw and validated EventLogging overall message rates on graphite1001 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [30.0] [18:16:43] RECOVERY - Difference between raw and validated EventLogging overall message rates on graphite1001 is OK: OK: Less than 20.00% above the threshold [20.0] [18:16:50] Analytics-EventLogging, MobileFrontend, Reading-Web-Backlog, Reading-Web-Tech-Debt, and 3 others: Should be possible to override sampling in EventLogging schemas for development purpose - https://phabricator.wikimedia.org/T125122#2689602 (MBinder_WMF) [18:33:16] wikimedia/mediawiki-extensions-EventLogging#602 (wmf/1.28.0-wmf.21 - 85ad55c : thcipriani): The build has errored. [18:33:16] Change view : https://github.com/wikimedia/mediawiki-extensions-EventLogging/commit/85ad55cd73a9 [18:33:16] Build details : https://travis-ci.org/wikimedia/mediawiki-extensions-EventLogging/builds/165030213 [19:07:46] Analytics-EventLogging: Please delete ChangesListFilters events from before 2016-09-22 - https://phabricator.wikimedia.org/T147346#2689833 (Catrope) [19:14:24] Pchelolo: updated my branch, fixes show up on PR hopefully this is the right workflow: https://github.com/wikimedia/restbase/pull/684#pullrequestreview-2781666 [19:15:21] nuria_: I'll wait for travis and merge [19:25:36] Analytics-Tech-community-metrics, Developer-Relations: Measuring Time To First Code Change (TTFCC) - https://phabricator.wikimedia.org/T137201#2689946 (Qgil) The #wikidev17 call for participation is open: https://www.mediawiki.org/wiki/Wikimedia_Developer_Summit/Call_for_participation [19:30:50] Pchelolo: and how does that get deployed? [19:31:22] nuria_: it will be deployed tomorrow with a regular RESTBase update. No action needed from you [19:31:59] Pchelolo: Thnak you. Ok, will keep an eye for metrics tomorrow cc elukey , thus far things are looking real good [19:32:26] nuria_: I'll ping you when this will go life. Most likely ~1pm PDT [19:37:26] Pchelolo: okeis, thank you. I am not super worried given our load tests and the fact that we barely go over 40 reqs per sec but it will be good to monitor. [19:37:46] Pchelolo: graphs here: https://grafana.wikimedia.org/dashboard/db/aqs-elukey [19:54:42] Analytics-EventLogging, MobileFrontend, Reading-Web-Backlog, Easy, and 2 others: Should be possible to override sampling in EventLogging schemas for development purpose - https://phabricator.wikimedia.org/T125122#2690063 (MBinder_WMF) [20:01:45] Analytics-EventLogging, ArchCom-RfC, Discovery, Graphs, and 9 others: RFC: Use YAML instead of JSON for structured on-wiki content - https://phabricator.wikimedia.org/T147158#2690117 (RobLa-WMF) >>! In T147158#2684521, @matmarex wrote: > I honestly don't think introducing YAML content would furth... [21:13:01] Analytics-EventLogging, ArchCom-RfC, Discovery, Graphs, and 9 others: RFC: Use YAML instead of JSON for structured on-wiki content - https://phabricator.wikimedia.org/T147158#2690462 (Yurik) A few examples where more human-oriented structure would help: == `` Vega JS "JSON programming lang... [21:15:04] mforns: quick chat about candidates? [21:17:25] omg it's super late for you, never mind [21:17:35] my brain is on another planet :/ [22:57:37] Analytics, Editing-Analysis, Notifications, Collaboration-Team-Triage (Collab-Team-Q2-Oct-Dec-2016): Numerous Notification Tracking Graphs Stopped Working at End of 2015 - https://phabricator.wikimedia.org/T132116#2691119 (jmatazzoni) [23:40:44] Analytics-Kanban, MediaWiki-extensions-WikimediaEvents, Collaboration-Team-Triage (Collab-Team-Q2-Oct-Dec-2016), Patch-For-Review, WMF-deploy-2016-10-04_(1.28.0-wmf.21): EL alarms raw/validated 20160926 - https://phabricator.wikimedia.org/T146674#2691263 (jmatazzoni)