[06:01:31] <lexein>	 Where can I see "edits per minute" for the whole of en.wp?  Or, better, "edits per day"? Is it possible to see this for all Wikipedias at once?
[07:22:16] <drdee>	 yo qchris
[07:27:53] <drdee>	 yo average
[07:37:54] <grrrit-wm>	 (PS1) Rfaulk: merge. repair_runtime branch. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77663
[07:37:55] <grrrit-wm>	 (PS1) Rfaulk: merge. repair_runtime branch. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77664
[07:37:56] <grrrit-wm>	 (PS1) Rfaulk: add. create broker context. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77665
[07:37:57] <grrrit-wm>	 (PS1) Rfaulk: mod. Write to broker on request rather than multiprocessing queue. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77666
[07:37:58] <grrrit-wm>	 (PS1) Rfaulk: mod. Use umapi_broker_context to pull new requests from queue. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77667
[07:37:59] <grrrit-wm>	 (PS1) Rfaulk: merge. repair_runtime. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77668
[07:38:00] <grrrit-wm>	 (PS1) Rfaulk: mod. rename broker target for requests - there will be multiple [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77669
[07:38:01] <grrrit-wm>	 (PS1) Rfaulk: merge. repair_runtime. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77670
[07:38:02] <grrrit-wm>	 (PS1) Rfaulk: rm. Request notification handler to maintain job queue. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77671
[07:38:03] <grrrit-wm>	 (PS1) Rfaulk: merge. repair_runtime. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77672
[07:38:04] <grrrit-wm>	 (PS1) Rfaulk: mod. response handler to utilize file broker context. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77673
[07:38:05] <grrrit-wm>	 (PS1) Rfaulk: rm. obselete refs. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77674
[07:38:06] <grrrit-wm>	 (PS1) Rfaulk: rm. request notification deps. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77675
[07:38:07] <grrrit-wm>	 (PS1) Rfaulk: add. timouts between broker item polls. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77676
[07:38:08] <grrrit-wm>	 (PS1) Rfaulk: mod. fix logging for popping request. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77677
[07:38:09] <grrrit-wm>	 (PS1) Rfaulk: rm. wait_queue; no longer necessary. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77678
[07:38:10] <grrrit-wm>	 (PS1) Rfaulk: mod. Processing request item. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77679
[07:38:11] <grrrit-wm>	 (PS1) Rfaulk: mod. reconstruct response from job queue. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77680
[07:38:12] <grrrit-wm>	 (PS1) Rfaulk: add. method parse_request to parse user metrics request components. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77681
[07:38:13] <grrrit-wm>	 (PS1) Rfaulk: fix. typo / pep8. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77682
[07:38:14] <grrrit-wm>	 (PS1) Rfaulk: add. form request_obj from raw request. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77683
[07:38:15] <grrrit-wm>	 (PS1) Rfaulk: add. methods to handle encoding response for broker. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77684
[07:38:16] <grrrit-wm>	 (PS1) Rfaulk: mod. use pack_response_for_broker to add responses to broker. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77685
[07:43:05] <drdee>	 yo qchris
[07:43:14] <qchris>	 Hi drdee
[07:51:55] <drdee>	 hangout?
[07:52:05] <qchris>	 k
[07:52:11] <qchris>	 Gimme time to boo the Google machine.
[07:52:18] <qchris>	 s/boo/boot/
[07:52:50] <drdee>	 :)
[07:55:18] <qchris>	 I am in the hangout.
[08:13:54] <drdee>	 qchris, one more question
[08:14:12] <drdee>	 what's the status of the dclass java patch set?
[08:15:17] <drdee>	 see https://gerrit.wikimedia.org/r/#/c/75349/
[08:18:14] <qchris>	 drdee: Average did not yet address the comments for patch set 4. So I am waiting for that to happen.
[08:18:23] <drdee>	 okidoki
[09:39:30] <drdee>	 qchris, do you know how we can quickly count the number of different dashboards hosted by a single limn instance?
[09:40:32] <qchris>	 Sure
[09:40:42] <qchris>	 Let me do that and I'll post the command
[09:42:37] <qchris>	 drdee: Run
[09:42:40] <qchris>	 drdee: find /var/lib/limn/gp/gp-{,zero-,geowiki-}data-repository/graphs -type f | wc -l
[09:42:44] <qchris>	 drdee: on limn0
[09:43:28] <qchris>	 drdee: Currently gives 2298 graphs for me.
[09:43:40] <drdee>	 :O
[09:43:45] <drdee>	 and that's just 1 instance
[09:45:06] <drdee>	 find /var/lib/limn/*/*data-repository/graphs -type f | wc -l
[09:45:10] <drdee>	 gives 4425
[09:45:54] <drdee>	 qchris, and this is the number of charts, right?
[09:46:19] <qchris>	 I seem to get confused by when we call what a dashboard :-)
[09:46:34] <drdee>	 a dashboard is a single url with multiple charts
[09:46:44] <drdee>	 a chart is a single url that maps to a single chart
[09:46:57] <qchris>	 Ok. Thanks.
[09:47:04] <qchris>	 It's the number of charts. Yes.
[09:47:19] <drdee>	 so http://reportcard.wmflabs.org/  is a dashboard
[09:48:31] <drdee>	 what's the difference between 'data' and 'data-repository'  as folder? it seems to be the same
[09:49:29] <qchris>	 I do not know
[09:49:40] <qchris>	 I haven't looked into those directories up to now.
[09:49:52] <qchris>	 find /var/lib/limn/gp/gp-{,zero-,geowiki-}data-repository/dashboards -type f | wc -l
[09:49:55] <qchris>	 ^ gives 58
[09:50:09] <drdee>	 and datasources gives 2802
[09:50:54] <drdee>	 all the limn instances are running on limn0 or are there other machines that host limn?
[09:51:25] <qchris>	 drdee: I have no idea :-) All I know is that WP-Zero is running on limn0
[09:51:35] <drdee>	 ok, i think limn0 is the only one
[09:51:42] <drdee>	 but probably good to check with ottomata
[09:51:50] <qchris>	 Yes.
[10:10:47] <drdee>	 qchris, when i run
[10:10:49] <drdee>	 find /srv/stats.wikimedia.org/htdocs/*/*.tsv -type f | wc -l
[10:11:01] <drdee>	 i get : No such file or directory
[10:11:30] <drdee>	 which is weird because i know for a fact that there are tsv files
[10:11:50] <qchris>	 On which host?
[10:13:19] <drdee>	 stat1001
[10:14:41] <qchris>	 But the tsvs are not in a subdirectory of  /srv/stats.wikimedia.org/htdocs/
[10:14:46] <qchris>	 They are in subdirectories thereof
[10:14:50] <drdee>	 ok
[10:15:00] <drdee>	 so how can i do that recursively?
[10:15:07] <drdee>	 starting in htdocs
[10:15:13] <qchris>	 find /srv/stats.wikimedia.org/htdocs/ -type f -iname '*.tsv' | wc -l
[10:15:20] <qchris>	 ^ is that what you're looking for?
[10:15:26] <drdee>	 i guess let me try
[10:15:36] <qchris>	 In bash you can set glob setting to get **
[10:15:52] <qchris>	 Or you could use other shells (zsh) that come with such support
[10:25:47] <drdee>	 thx
[10:27:40] <qchris>	 yw
[14:21:53] <drdee>	 hey ottomata
[14:22:00] <drdee>	 did you do some work on this card https://mingle.corp.wikimedia.org/projects/analytics/cards/792 a couple of weeks ago?
[14:22:16] <drdee>	 and this one as well: https://mingle.corp.wikimedia.org/projects/analytics/cards/816
[14:22:55] <ottomata>	 792, no
[14:23:43] <ottomata>	 816, yes, but not to the full extent I would like
[14:23:49] <ottomata>	 I added process monitors for filter and collector
[14:24:01] <ottomata>	 i'd like to add a dropped packet monitor like udp2log has
[14:24:09] <ottomata>	 i'd also like to do that for the socat process
[14:24:23] <ottomata>	 i basically just need to make ori's /proc/net/udp ganglia plugin more generic
[14:24:27] <ottomata>	 so it works with any process, just not udp2log
[14:28:19] <drdee>	 :D
[14:28:25] <drdee>	 ok i will update 816
[14:30:33] <drdee>	 ty, card is updated fee free to add more details
[15:00:28] <drdee>	 hey ottomata, is webstatscollector still running? apparently 4 hours of data is missing
[15:02:15] <ottomata>	 uh ob
[15:03:50] <ottomata>	 processes are running
[15:04:01] <drdee>	 cronjob issue?
[15:04:10] <ottomata>	 which 4 hours?
[15:04:15] <ottomata>	 i see the files on gadolinium
[15:04:53] <drdee>	 no data written after 10.00 GMT on dumps apparently
[15:06:19] <ottomata>	 ok, hm
[15:06:20] <ottomata>	 the files exist
[15:06:25] <ottomata>	 trying to find this cronjob again
[15:06:28] <ottomata>	 i know its on snapshot1
[15:07:02] <ottomata>	 ok found it
[15:07:06] <ottomata>	 going to run it manually
[15:07:52] <ottomata>	 rsync: mkdir "/mnt/data/pagecounts/incoming" failed: No such file or directory (2) hm
[15:13:54] <drdee>	 poke apergos?
[15:14:20] <ottomata>	 well, i just created the directory and now it is running
[15:14:27] <ottomata>	 but oh geez it is copying all of the dumps first :/
[15:14:36] <drdee>	 ok, but weird that that folder was gone
[15:27:49] <ottomata>	 yo drdee
[15:28:01] <drdee>	 yoyoo
[15:28:12] <ottomata>	 do you know when/who changed the mediawiki Analytics/Kraken pages to redirect to Analytics/Infrastructure pages?
[15:28:29] <ottomata>	 http://www.mediawiki.org/w/index.php?title=Analytics/Kraken
[15:28:30] <drdee>	 1 sec
[15:28:50] <drdee>	 http://www.mediawiki.org/w/index.php?title=Analytics/Kraken&action=history
[15:28:56] <drdee>	 Guillom april 26th
[15:29:05] <drdee>	 this year
[15:49:30] <ottomata>	 running to lunch
[15:49:31] <ottomata>	 laatas
[15:49:37] <ottomata>	 be back for standup
[17:32:52] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] merge. repair_runtime branch. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77663 (owner: Rfaulk)
[17:33:07] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] merge. repair_runtime branch. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77664 (owner: Rfaulk)
[17:33:29] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] add. create broker context. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77665 (owner: Rfaulk)
[17:33:39] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] mod. Write to broker on request rather than multiprocessing queue. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77666 (owner: Rfaulk)
[17:33:52] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] mod. Use umapi_broker_context to pull new requests from queue. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77667 (owner: Rfaulk)
[17:34:03] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] merge. repair_runtime. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77668 (owner: Rfaulk)
[17:34:13] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] mod. rename broker target for requests - there will be multiple [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77669 (owner: Rfaulk)
[17:34:24] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] merge. repair_runtime. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77670 (owner: Rfaulk)
[17:34:39] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] rm. Request notification handler to maintain job queue. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77671 (owner: Rfaulk)
[17:34:49] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] merge. repair_runtime. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77672 (owner: Rfaulk)
[17:34:58] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] mod. response handler to utilize file broker context. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77673 (owner: Rfaulk)
[17:35:09] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] rm. obselete refs. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77674 (owner: Rfaulk)
[17:35:23] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] rm. request notification deps. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77675 (owner: Rfaulk)
[17:35:33] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] add. timouts between broker item polls. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77676 (owner: Rfaulk)
[17:35:44] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] mod. fix logging for popping request. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77677 (owner: Rfaulk)
[17:35:54] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] rm. wait_queue; no longer necessary. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77678 (owner: Rfaulk)
[17:36:09] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] mod. Processing request item. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77679 (owner: Rfaulk)
[17:36:26] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] mod. reconstruct response from job queue. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77680 (owner: Rfaulk)
[17:36:35] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] add. method parse_request to parse user metrics request components. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77681 (owner: Rfaulk)
[17:36:45] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] fix. typo / pep8. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77682 (owner: Rfaulk)
[17:36:55] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] add. form request_obj from raw request. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77683 (owner: Rfaulk)
[17:37:05] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] add. methods to handle encoding response for broker. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77684 (owner: Rfaulk)
[17:37:27] <grrrit-wm>	 (CR) Rfaulk: [C: 2 V: 2] mod. use pack_response_for_broker to add responses to broker. [analytics/user-metrics] - https://gerrit.wikimedia.org/r/77685 (owner: Rfaulk)
[18:42:24] <milimetric>	 hey ottomata
[18:42:44] <ottomata>	 yoyooyoyoyoyoyoyoyYO
[18:42:44] <milimetric>	 do you think you have time to show kenan (new person working with Howie) how to get around stat1?
[18:42:51] <ottomata>	 sure
[18:42:53] <milimetric>	 cool
[18:42:56] <milimetric>	 i'll write him
[18:43:00] <milimetric>	 I had a meeting with him later today
[18:43:03] <ottomata>	 i'm in an ops meeting now, and this cafe internet suuucks
[18:43:06] <milimetric>	 and I realize I don't know much about stat1
[18:43:06] <ottomata>	 so I might move
[18:43:09] <ottomata>	 sure!
[18:43:19] <ottomata>	 ja, email, CC me, give him my IRC, etc.
[18:43:21] <milimetric>	 that's cool, I'll just hook you guys up and you can chat whenever it works for you
[18:43:22] <milimetric>	 yep
[18:43:26] <milimetric>	 thank you!
[19:30:56] <ottomata>	 moving to better internet...
[22:39:40] <grrrit-wm>	 (PS1) Milimetric: test to prove namespaces bug, and fix [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/77833
[22:39:52] <grrrit-wm>	 (CR) Milimetric: [C: 2 V: 2] test to prove namespaces bug, and fix [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/77833 (owner: Milimetric)
[22:55:07] <milimetric>	 bye everyone, going on vacation :)