[02:44:00] (PS1) Alex Monk: udp2log: link boost_system too [analytics/udplog] - https://gerrit.wikimedia.org/r/305610 [05:57:04] Analytics, Pageviews-API, Reading-analysis: Suddenly outrageous higher pageviews for main pages - https://phabricator.wikimedia.org/T141506#2566729 (HJiang-WMF) A workaround HQL query is in T142505, thanks to pointers from @Milimetric about the user-agent. Examining the same UA around July 20th, the... [08:05:55] Analytics-Wikimetrics, Community-Wikimetrics: Scheduled reports 404 despite alleged success - https://phabricator.wikimedia.org/T143218#2566887 (Nemo_bis) [08:48:30] (PS5) Addshore: Add echo statusNotifications script to 03 daily cron [analytics/wmde/scripts] - https://gerrit.wikimedia.org/r/302126 (https://phabricator.wikimedia.org/T140928) [08:48:33] (PS3) Addshore: Add echo statusNotifications script to 03 daily cron [analytics/wmde/scripts] - https://gerrit.wikimedia.org/r/302128 (https://phabricator.wikimedia.org/T140928) [08:48:36] (CR) Addshore: [C: 2] Add echo statusNotifications script to 03 daily cron [analytics/wmde/scripts] - https://gerrit.wikimedia.org/r/302126 (https://phabricator.wikimedia.org/T140928) (owner: Addshore) [08:48:39] (CR) Addshore: [C: 2] Add echo statusNotifications script to 03 daily cron [analytics/wmde/scripts] - https://gerrit.wikimedia.org/r/302128 (https://phabricator.wikimedia.org/T140928) (owner: Addshore) [08:48:42] (Merged) jenkins-bot: Add echo statusNotifications script to 03 daily cron [analytics/wmde/scripts] - https://gerrit.wikimedia.org/r/302126 (https://phabricator.wikimedia.org/T140928) (owner: Addshore) [08:48:45] (Merged) jenkins-bot: Add echo statusNotifications script to 03 daily cron [analytics/wmde/scripts] - https://gerrit.wikimedia.org/r/302128 (https://phabricator.wikimedia.org/T140928) (owner: Addshore) [08:59:49] (PS1) Addshore: Fix bad merge in echo statusNotifications [analytics/wmde/scripts] - https://gerrit.wikimedia.org/r/305625 [09:00:21] (PS1) Addshore: Fix bad merge in echo statusNotifications [analytics/wmde/scripts] - https://gerrit.wikimedia.org/r/305626 [09:00:27] (CR) Addshore: [C: 2] Fix bad merge in echo statusNotifications [analytics/wmde/scripts] - https://gerrit.wikimedia.org/r/305625 (owner: Addshore) [09:00:35] (Merged) jenkins-bot: Fix bad merge in echo statusNotifications [analytics/wmde/scripts] - https://gerrit.wikimedia.org/r/305625 (owner: Addshore) [09:00:38] (CR) Addshore: [C: 2] Fix bad merge in echo statusNotifications [analytics/wmde/scripts] - https://gerrit.wikimedia.org/r/305626 (owner: Addshore) [09:00:47] (Merged) jenkins-bot: Fix bad merge in echo statusNotifications [analytics/wmde/scripts] - https://gerrit.wikimedia.org/r/305626 (owner: Addshore) [11:02:34] Analytics-Engineering, Analytics-Wikimetrics: Can't run reports on Wikimetrics - https://phabricator.wikimedia.org/T143399#2567093 (KMARTE) [11:22:37] (PS23) Mforns: [WIP] Refactor Mediawiki History scala code [analytics/refinery/source] - https://gerrit.wikimedia.org/r/301837 (https://phabricator.wikimedia.org/T141548) (owner: Joal) [11:32:46] Analytics, Pageviews-API, Reading-analysis: Suddenly outrageous higher pageviews for main pages - https://phabricator.wikimedia.org/T141506#2567156 (Tbayer) >>! In T141506#2565537, @Nuria wrote: > @Tbayer: you can read plenty details on TLS issues here: https://phabricator.wikimedia.org/T141786 and... [12:25:55] Analytics-Kanban: Edit History: Review scala code functionality and make page and user output uniform - https://phabricator.wikimedia.org/T143322#2564570 (mforns) a:mforns [13:44:28] (CR) Ottomata: [C: 1] "Ok! I'm not going to test this, but this looks fine to me. Shall I merge?" [analytics/udplog] - https://gerrit.wikimedia.org/r/305610 (owner: Alex Monk) [13:52:15] ottomata, I'm just wondering how it ever worked in the first place :) [13:52:28] You packaged udplog/udp-filter/libanon/libdir years ago right? [13:55:14] libanon years ago yes [13:55:17] udplog no [13:58:46] ah [13:59:10] so basically these were put on apt.wm.o for precise, but never trusty/jessie [13:59:27] but we're trying to get rid of precise instances from labs now [13:59:49] (fluorine.eqiad.wmnet still runs precise) [14:00:59] I meat libcidr earlier, not libdir [14:05:47] does anyone still use those things? [14:31:10] ottomata, udp2log is what records the logs on fluorine [14:31:17] it depends on the other packages [14:31:49] ahhh, right, hm. [14:31:54] ha, mabye that should be changed :p [14:32:00] well [14:32:19] I think the puppet module uses the udplog and udp-filter packages [14:32:26] udp-filter depends on libanon+libcidr [14:32:35] hm,! myabe it doesn't need udp-filter [14:32:37] i doubt it does [14:32:39] though I don't know what it actually does [14:33:28] Krenair: it is a util programing to filter pipes/streams [14:33:36] so udp2log just listens for line based udp data [14:33:53] it has a config file that multiplexes that out to files and/or pipes of arbitrary commands reading from stdin [14:34:02] udp-filter can be one of those commands [14:34:26] it'll do things like geocode IPs, or filter for certain domain names, or anonymize IPs [14:34:28] these? [14:34:37] krenair@deployment-fluorine02:~$ grep pipe /etc/udp2log/mw [14:34:37] flush pipe 1 python /usr/local/bin/demux.py --basedir /srv/mw-log [14:34:37] pipe 1 egrep '^(fatal|exception) ' | /usr/bin/log2udp -h deployment-fluoride.eqiad.wmflabs -p 8423 [14:34:37] pipe 1 egrep '^(scap|scholarships|iegreview) ' | /usr/bin/log2udp -h deployment-logstash2.deployment-prep.eqiad.wmflabs -p 8324 [14:34:45] yup [14:34:53] (note deployment-fluoride doesn't exist, no idea what that's for) [14:35:02] thats filters.wm.erb right? [14:35:03] yeah [14:35:15] yeah so it doesn't use udp-filter [14:35:16] which makes sense [14:35:23] udp-filter was more for filtering webrequest logs [14:35:35] i'm not even sure if the mw log format would work with udp-filter [14:35:53] I tried it in prod too: [14:35:55] krenair@fluorine:~$ grep pipe /etc/udp2log/mw [14:35:55] flush pipe 1 python /usr/local/bin/demux.py --basedir /a/mw-log [14:35:55] pipe 1 egrep '^(fatal|exception) ' | /usr/bin/log2udp -h eventlog1001.eqiad.wmnet -p 8423 [14:35:55] pipe 1 egrep '^(scap|scholarships|iegreview) ' | /usr/bin/log2udp -h logstash1001.eqiad.wmnet -p 8324 [14:36:03] ja [14:36:11] its the same template file in puppet [14:36:34] https://github.com/wikimedia/operations-puppet/blob/production/templates/udp2log/filters.mw.erb [14:36:46] so, i think you can do whatever is needed in puppet to get rid of udp-filter [14:36:48] if you like [14:37:01] that'd make things easier for me [14:37:39] then I just need to package udplog [14:40:24] ja, i think that's totally fine [14:40:34] the mw logging is the only remaining use of udp2log [14:44:23] what process do I need to go through to get a udplog package on apt.wm.o for jessie? [14:45:01] I figure out how to build it and provide ops with the commands to build the binary and the dependencies, name, version, description etc.? [14:45:41] Analytics, Pageviews-API, Reading-analysis: Suddenly outrageous higher pageviews for main pages - https://phabricator.wikimedia.org/T141506#2567605 (Milimetric) If I had a button that would exclude these views from projectview_hourly and pageview_hourly, I would click it without hesitation. But as t... [14:48:24] Analytics-Kanban: Edit History: Review scala code functionality and make page and user output uniform - https://phabricator.wikimedia.org/T143322#2567610 (mforns) I reviewed the whole code looking for the things I believe we should tackle/decide before the vetting of the data, and made this list. Please comm... [14:51:08] mforns: hola! did you started another round of data loading? [14:51:14] nuria_, yes! [14:51:23] Krenair: hMmM yeah, but i can probably build it for you real quick... :) [14:51:29] gimme a sec, i'll try. [14:51:29] nuria_, I added the job id in the etherpad [14:51:58] that would be incredibly helpful [14:52:00] mforns: k, will baby sit and when it is done and compacting has started will start another one per erik's suggestion [14:52:17] nuria_, makes sense [14:52:22] the id is: 0073336-160630131625562-oozie-oozi-C [14:53:30] though I should learn how to do this myself at some stage :) [14:54:26] Krenair: ja, but i think probably this package isn't the best one to learn from :p [15:01:33] a-team, standupppppp :] [15:01:46] aah, how did that happen?! [15:02:43] OOO [15:02:49] Analytics, Pageviews-API, Reading-analysis: Suddenly outrageous higher pageviews for main pages - https://phabricator.wikimedia.org/T141506#2567679 (Nuria) My personal view on the matter is that this traffic should never be removed as it is actually real traffic. We probably should implement a way to... [15:28:04] (PS1) Ottomata: Adding gbp.conf [analytics/udplog] - https://gerrit.wikimedia.org/r/305654 [15:34:08] (CR) Ottomata: [C: 2 V: 2] udp2log: link boost_system too [analytics/udplog] - https://gerrit.wikimedia.org/r/305610 (owner: Alex Monk) [15:48:35] (PS2) Ottomata: Adding gbp.conf [analytics/udplog] - https://gerrit.wikimedia.org/r/305654 [15:49:02] (PS3) Ottomata: Adding gbp.conf [analytics/udplog] - https://gerrit.wikimedia.org/r/305654 [15:49:12] (CR) Ottomata: [C: 2 V: 2] Adding gbp.conf [analytics/udplog] - https://gerrit.wikimedia.org/r/305654 (owner: Ottomata) [15:53:22] Krenair: https://apt.wikimedia.org/wikimedia/pool/main/u/udplog/ [15:53:23] :) [15:53:37] yay [15:58:46] Everything appears to be working! [16:01:13] great! [16:21:02] Analytics-Kanban: Edit History: Review scala code functionality and make page and user output uniform - https://phabricator.wikimedia.org/T143322#2567933 (mforns) Following up with the conversation we had on the previous comment, these are the actions to take and implement in this task: 1. outputting errors:... [17:33:26] Analytics, Operations, Ops-Access-Requests: Add analytics team members to group aqs-admins to be able to deploy pageview APi - https://phabricator.wikimedia.org/T142101#2568165 (RobH) I won't be in the operations meeting next Monday for this to be reviewed, but I've emailed the operations team for it... [18:36:14] mforns, milimetric : any suggestions as to wording on task? [18:36:48] nuria_, looking [18:39:04] nuria_, I saw you added the python -m SimpleHTTPServer thing, that's what I was going to comment, the rest looks good to me! just added an "it" in: "it is not mobile friendly" [18:40:35] mforns: ok, will wait a bit for dan's input . [18:40:56] cool [19:17:27] mforns_brb, milimetric, ottomata : blogpost is up : https://blog.wikimedia.org/2016/08/19/most-popular-browser/ [19:18:18] nice! [19:33:16] whoohoo! [20:05:28] PROBLEM - cassandra SSL 10.64.32.175:7001 on aqs1002 is CRITICAL: SSL CRITICAL - failed to connect or SSL handshake:IO::Socket::SSL: connect: Connection refused [20:05:50] PROBLEM - cassandra-a SSL 10.64.32.189:7001 on aqs1005 is CRITICAL: SSL CRITICAL - failed to connect or SSL handshake:IO::Socket::SSL: connect: Connection refused [20:06:29] PROBLEM - cassandra-b SSL 10.64.32.190:7001 on aqs1005 is CRITICAL: SSL CRITICAL - failed to connect or SSL handshake:IO::Socket::SSL: connect: Connection refused [20:06:49] PROBLEM - cassandra SSL 10.64.0.123:7001 on aqs1001 is CRITICAL: SSL CRITICAL - failed to connect or SSL handshake:IO::Socket::SSL: connect: Connection refused [20:07:09] PROBLEM - cassandra-a SSL 10.64.0.126:7001 on aqs1004 is CRITICAL: SSL CRITICAL - failed to connect or SSL handshake:IO::Socket::SSL: connect: Connection refused [20:07:31] PROBLEM - cassandra-b SSL 10.64.0.127:7001 on aqs1004 is CRITICAL: SSL CRITICAL - failed to connect or SSL handshake:IO::Socket::SSL: connect: Connection refused [20:08:35] ottomata: yt? [20:14:52] ja [20:14:56] nuria_: hai [20:15:25] ottomata: i was about to acknowledge alarms on icinga but [20:15:33] ottomata: i do not know what those mean really [20:15:57] ottomata: as pageview api can be quried via http [20:16:02] ottomata: not https [20:16:19] ottomata: ah no, i guess it redirects [20:17:14] ottomata: ah sorry, reading ops channel [20:25:30] ACKNOWLEDGEMENT - cassandra SSL 10.64.0.123:7001 on aqs1001 is CRITICAL: SSL CRITICAL - failed to connect or SSL handshake:IO::Socket::SSL: connect: Connection refused daniel_zahn new check from cassandra role that is just for restbase* [20:25:33] ACKNOWLEDGEMENT - cassandra SSL 10.64.32.175:7001 on aqs1002 is CRITICAL: SSL CRITICAL - failed to connect or SSL handshake:IO::Socket::SSL: connect: Connection refused daniel_zahn new check from cassandra role that is just for restbase* [20:25:37] ACKNOWLEDGEMENT - cassandra-b SSL 10.64.0.127:7001 on aqs1004 is CRITICAL: SSL CRITICAL - failed to connect or SSL handshake:IO::Socket::SSL: connect: Connection refused daniel_zahn new check from cassandra role that is just for restbase* [20:36:01] PROBLEM - cassandra SSL 10.64.48.117:7001 on aqs1003 is CRITICAL: SSL CRITICAL - failed to connect or SSL handshake:IO::Socket::SSL: connect: Connection refused [20:36:40] PROBLEM - cassandra-a SSL 10.64.48.148:7001 on aqs1006 is CRITICAL: SSL CRITICAL - failed to connect or SSL handshake:IO::Socket::SSL: connect: Connection refused [20:37:10] PROBLEM - cassandra-b SSL 10.64.48.149:7001 on aqs1006 is CRITICAL: SSL CRITICAL - failed to connect or SSL handshake:IO::Socket::SSL: connect: Connection refused [22:04:30] Analytics-Wikistats: Metrics for 2015-2016 audit report - https://phabricator.wikimedia.org/T143456#2568851 (ezachte)