[00:16:07] 10Analytics: R execution on stat1005 -> 'stack smashing error' - https://phabricator.wikimedia.org/T174946#3790976 (10Erik_Zachte) Hmm, I could migrate all of Wikistats to stat1004 (prefer to keep all one machine, also charts are part of overall Wikistats job. Is stat1004 machine equivalent to stat1005? Does 'st... [03:47:48] 10Analytics, 10Patch-For-Review: Productionize navigation vectors - https://phabricator.wikimedia.org/T174796#3791247 (10Shilad) [07:55:28] 10Analytics, 10EventBus, 10MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), 10Patch-For-Review, 10Services (next): Timeouts on event delivery to EventBus - https://phabricator.wikimedia.org/T180017#3791458 (10Pchelolo) Also looks a lot like https://github.com/tornadoweb/tornado/issues/1667 [09:07:08] 10Analytics-Kanban, 10DBA, 10Operations, 10Patch-For-Review, 10User-Elukey: Decommission old dbstore hosts (db1046, db1047) - https://phabricator.wikimedia.org/T156844#3791689 (10Marostegui) ``` root@dbstore1002:~# mysql --skip-ssl Welcome to the MariaDB monitor. Commands end with ; or \g. Your MariaDB... [09:08:56] !log log database on dbstore1002 dropped for good [09:08:57] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [09:09:05] 1TB returned to dbstore1002 ! [09:52:54] 10Analytics-Kanban, 10Operations, 10hardware-requests: eqiad: (2) hardware request for jupyter notebook refresh (SWAP) - https://phabricator.wikimedia.org/T175603#3791731 (10faidon) a:05Ottomata>03RobH Reassigning, as it sounds like it's in @RobH's hands now (and why it likely fell through the cracks). [10:33:51] 10Analytics, 10ChangeProp, 10EventBus, 10MediaWiki-JobQueue, and 3 others: Services Q2 2017/18 goal: Migrate a subset of jobs to multi-DC enabled event processing infrastructure. - https://phabricator.wikimedia.org/T175212#3791813 (10mobrovac) [10:33:56] 10Analytics, 10ChangeProp, 10EventBus, 10MediaWiki-JobQueue, and 5 others: Select candidate jobs for transferring to the new infrastucture - https://phabricator.wikimedia.org/T175210#3791812 (10mobrovac) [10:34:13] 10Analytics, 10ChangeProp, 10EventBus, 10MediaWiki-JobQueue, and 3 others: [EPIC] Develop a JobQueue backend based on EventBus - https://phabricator.wikimedia.org/T157088#3791814 (10mobrovac) [10:34:16] 10Analytics, 10ChangeProp, 10EventBus, 10MediaWiki-JobQueue, and 3 others: Services Q2 2017/18 goal: Migrate a subset of jobs to multi-DC enabled event processing infrastructure. - https://phabricator.wikimedia.org/T175212#3586293 (10mobrovac) [11:41:37] * elukey lunch! [13:41:18] (03CR) 10Elukey: "Just submitted the change that was left pending" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/392624 (owner: 10Joal) [13:41:36] joal: --^ [14:06:55] 10Analytics: R execution on stat1005 -> 'stack smashing error' - https://phabricator.wikimedia.org/T174946#3792498 (10Ottomata) > Hmm, I could migrate all of Wikistats to stat1004 > Is stat1004 machine equivalent to stat1005? No, it's not. Hm. stat1004 exists more of as a place to connect to Hadoop and other t... [14:10:18] 10Analytics: Privacy pageview threshold for map report - https://phabricator.wikimedia.org/T181508#3792503 (10fdans) [14:11:24] ottomata: o/ - there is a big 3 patch refactoring attempt for you whenever you have time. It would definitely help for the prometheus hadoop stuff but I didn't proceed since I wanted to discuss it with you first [14:14:08] i see them! :) [14:14:54] really sorry for the huge pile of changes :( [14:15:41] naw i'm into it :) [14:16:28] going to reboot all the kafka analytics [14:18:55] +1 [14:19:16] elukey: you've mereged that delete topic patch ya? and puppet's been applied on all kafkas? [14:19:37] ottomata: yep, forced via cumin [14:20:01] elukey: about https://gerrit.wikimedia.org/r/#/c/393756/6/modules/profile/manifests/hadoop/common.pp [14:20:03] oh man [14:20:06] this is going to suck SO BAD [14:20:07] in labs [14:20:20] i always complain about this, but in this case, its going to be the aboslute worst [14:20:35] now in order to use hadoop, you have to enter hiera values in labs for every single one of those things [14:21:18] I know you wouldn't have liked the last one :) [14:21:27] but it is basically the same thing we have for druid [14:21:47] yeah, but for druid, at least the crazy configs are hidden in that properties hash [14:21:55] so defaults for most things can still be used [14:23:00] it will be only a copy/paste + tuning of some parameters in labs (puppet-prefix maybe?) only once [14:23:22] only once? [14:23:26] naw [14:23:42] in puppet prefix, yes [14:23:50] if you have a single hadoop cluster you maintain in labs, yeah [14:23:58] but i use labs for testing hadoop [14:24:03] will want to spawn and destroy hadoop clusters [14:24:10] with different names [14:24:11] different settings here and there [14:24:34] there are defaults in the module for a reason! [14:24:52] elukey: aghghgh, i think this rule is so dumb! [14:24:57] i might start an ops email thread discussion [14:26:24] I mean, I really don't see the huge deal with this config, but I like being explicit for profiles with hiera so exactly the opposite view :) [14:27:16] but, as said, I didn't take any action because I wanted consensus fist [14:27:19] *first [14:27:26] sooo I'll try to work around the third patch [14:27:35] it was a bold move but I had to try :D [14:27:42] hha [14:27:48] no wait, it is following the rules [14:27:54] i think you are doing the right thing according to the rules [14:27:56] the rules are just really bad [14:28:06] i just said UNGGHHH to _joe_ in mw-sec [14:28:06] :p [14:28:08] here we go! [14:28:45] 10Analytics, 10Operations, 10ops-eqiad, 10User-Elukey: Check analytics1037 power supply status - https://phabricator.wikimedia.org/T179192#3792547 (10Cmjohnson) On the server, the LED indicator for the power supply is green and not showing any signs of a problem. I even removed power from each side to ensu... [14:28:53] it is great for prod but not super great for labs quick testing, you are right [14:32:05] hi all [14:32:40] hey Dan! [14:41:19] !log restarting eventlogging on eventlog1001 for https://gerrit.wikimedia.org/r/#/c/393613/ [14:41:20] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [15:15:43] Hi team - I've been figthing with my computer all the afternoon after a hard-drive failure [15:16:27] I'm currently back in emergency mode, I will keep trying to make it work, but might not be in time for standup [15:52:16] joal: noted! [15:54:30] kafka1018 is not feeling well after the reboot [16:04:05] 10Analytics-Kanban, 10Analytics-Wikistats: Wikistats Bug – In tabular data view, format displayed values - https://phabricator.wikimedia.org/T179441#3724893 (10Nuria) [16:04:13] 10Analytics-Kanban, 10Operations, 10ops-eqiad: kafka1018 fails to boot - https://phabricator.wikimedia.org/T181518#3792843 (10elukey) [16:10:16] 10Analytics-Cluster, 10Analytics-Kanban, 10Analytics-Wikistats: Add "Pageviews by Country" AQS endpoint - https://phabricator.wikimedia.org/T181520#3792881 (10fdans) [16:15:57] 10Analytics-Cluster, 10Analytics-Kanban, 10Analytics-Wikistats: Add pageviews by country cassandra oozie job - https://phabricator.wikimedia.org/T181521#3792901 (10fdans) [16:19:13] (03CR) 10Ottomata: Deploy repo for superset (python) (031 comment) [analytics/superset/deploy] - 10https://gerrit.wikimedia.org/r/392933 (https://phabricator.wikimedia.org/T166689) (owner: 10Ottomata) [16:25:01] 10Analytics: R execution on stat1005 -> 'stack smashing error' - https://phabricator.wikimedia.org/T174946#3792972 (10Ottomata) @ezachte, this will be hard for us to reproduce and figure out. Can you try and make an isolated R script that reproduces this error? Then we can use that to troubleshoot. [16:29:04] 10Analytics: R execution on stat1005 -> 'stack smashing error' - https://phabricator.wikimedia.org/T174946#3792983 (10Erik_Zachte) Thanks, will do. [16:36:29] 10Analytics-Kanban, 10Operations, 10ops-eqiad: kafka1018 fails to boot - https://phabricator.wikimedia.org/T181518#3792843 (10Cmjohnson) Yes, there is definitely a bad disk but the memory errors are probably a bad CPU or motherboad. It would extremely bad fortune for all 8 DIMM to fail at one time. But I di... [16:46:00] fdans: did you had a code change that went with this ticket or that is wip? https://phabricator.wikimedia.org/T181520 [16:48:30] nuria y, changing commit right now - https://gerrit.wikimedia.org/r/#/c/393591/ [16:48:33] fdans: let's describe on ticket the data format we are planning to load into cassandra, there should only be 1 set of jobs needed as we are going to load that data from pageview_hourly table cc joal , correct? [16:49:35] (03PS2) 10Fdans: [wip] Add pageviews by country endpoint [analytics/aqs] - 10https://gerrit.wikimedia.org/r/393591 (https://phabricator.wikimedia.org/T181520) [16:50:53] nuria_: but we still need one job per granularity, right? one for daily and another one for monthly. I'm following how it's being done right now in top pageviews [16:52:05] fdans: yes, for top daily and monthly [16:52:36] fdans: that is not going to give you an agreggtae for all projects though, is it? [16:53:30] nuria_: nope, you're right [16:54:26] 10Analytics-Kanban, 10EventBus, 10Reading-Infrastructure-Team-Backlog, 10Trending-Service, and 2 others: Trending Edit's worker offsets disappear from Kafka - https://phabricator.wikimedia.org/T181346#3793137 (10mobrovac) [16:55:55] nuria_: I forgot top pageviews is not a global metric... I'll look at the pageviews aggregate query to see how to load all-projects data [16:56:50] fdans: that is what erik actually displays on wikistats now (other than his newest visualization) [16:57:19] fdans: see https://stats.wikimedia.org/wikimedia/squids/SquidReportPageViewsPerCountryOverview.htm [16:57:57] fdans: the case of "what countries use dutch wikipedia" is solved by your top metric [16:58:46] fdans: but the use case "pageviews arround the world" is not unless you add a third job that computes agreggates monthly and daily [16:59:01] fdans: makes sense? [16:59:08] yes [17:00:01] nuria_: do you have a recommendation for how to join an EL table in log with a table in a wiki DB? (e.g. TestSearchSatisfaction2 has an event_articleId and I want to join with page.page_id to get page.page_title & page.page_namespace) I was able to yesterday by connecting to analytics-store which had both, but now that log isn't analytics-store, is there any way to do this? [17:00:02] I'm guessing that's why we had that confusion yesterday in standup with joal [17:00:11] fdans: also we need to think about the entry point of the map: https://wikitech.wikimedia.org/wiki/Analytics/Wikistats2.0/Map_Component [17:01:10] fdans: how are you going to see "pageviews overall" ? and "pageviews per project"? is the entry point on the dashboard? I think we talked about this with marcel and milimetric but I am not sure what was decided, either way we need to have it documented in a mock [17:01:30] bearloga: using teh data lake? [17:01:56] bearloga: the mediawiki meta data is also on hadoop on monthly snapshots [17:02:16] bearloga: does that make sense? [17:02:35] nuria_: ah, yeah, once event logging data is reliably in hadoop. okie dokie, thanks! [17:02:58] nuria_: it'll be a new reading top metric with 'map' as its visualization type, much like pageviews by article is a top metric with 'table' as its vis type [17:03:18] I'll add that to the wiki doc [17:03:23] bearloga: for now you can just export the EL data, put a Hive table on top of it in your own hive database, and join that way [17:03:24] fdans: right but how do you get to it? now you get to tops metric through dashboard [17:03:38] yeah yeah, from the dashboard [17:04:32] nuria_: it will replace pageviews by article as long as we have a real estate of 3 slots [17:04:42] which will also give it visibility [17:04:48] fdans: ok, let's document on ttps://wikitech.wikimedia.org/wiki/Analytics/Wikistats2.0/Map_Component the option we decided to go with and how you will access it [17:05:16] nuria_: you can actually try the component by checking out https://gerrit.wikimedia.org/r/#/c/392661/ [17:05:43] fdans: will do, let's add that patch to a ticket [17:10:14] 10Analytics, 10Analytics-Cluster, 10Analytics-Wikistats: Add map component to Wikistats 2 - https://phabricator.wikimedia.org/T181529#3793204 (10fdans) [17:10:54] (03PS5) 10Fdans: [wip] Map component and Pageviews by Country metric [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/392661 (https://phabricator.wikimedia.org/T181529) [17:11:01] (03CR) 10jerkins-bot: [V: 04-1] [wip] Map component and Pageviews by Country metric [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/392661 (https://phabricator.wikimedia.org/T181529) (owner: 10Fdans) [17:26:14] joal: I think my spark jobs are wrapped! No rush on the code review, but wanted to let you know. [17:26:25] fdans, nuria_ : The current way to generate 'all' projects is to use the 'grouping sets' trick [17:26:38] Awesome Shilad - Thanks for pinging [17:27:14] np. I generated the pageview sessions since Sept 1st without problem (table shilad.sessions) [17:27:33] fdans, nuria_ : For the moment we don't generate grouped-top - we'll need to investigate [17:27:57] Shilad: I saw our message about cluster usage, but I think you were pretty alone in using the cluster last weekend :) [17:28:10] Yes. Very quiet! [17:28:43] Right now I'm using stat1004 for experiments with model building. I'm trying not to use more than 50% of resources, but it looks pretty quiet. [17:29:19] Shilad: stat1004 is not used as a working node but rather as a edge node, so you should be fine as long as you nice your processes :) [17:30:17] Thanks. I did nice them. I also thought about using 1006, but it doesn't have access to hdfs and I was worried about putting session data on it. [17:30:37] It seems like pseudo-private data. I wasn't sure about the policy on that. [17:31:11] Shilad: IIRC stat1006 is research-oriented box - I'm surprised it doesn't have access to hdfs [17:31:43] 10Analytics-Kanban, 10Operations, 10ops-eqiad: kafka1018 fails to boot - https://phabricator.wikimedia.org/T181518#3793359 (10elukey) Summary of what has been discussed so far on IRC: - Chris will try to find a used motherboard in the DC and see if it can be swapped on kafka1018, so a simple reimage should... [17:32:52] this is the tracking task for the kafka1018 issues --^ [17:33:46] Gone for dinner a-team, back after [17:34:24] joal: staff was moved to grosking Thursday in case you missed it [17:34:30] (forgot if you had dropped off) [17:35:33] joal: right! [17:35:42] joal: goal checkup on thursday [17:42:07] 10Analytics, 10Analytics-Wikistats, 10Research: Renovation of Wikistats production jobs - https://phabricator.wikimedia.org/T176478#3793407 (10Erik_Zachte) script stat1005:/home/ezachte/wikistats/dumps/bash/collect_edits.sh has been adapted to stat1005 it collects all edits from either one xml stub dump or... [17:52:09] (03CR) 10Ottomata: [C: 031] [WIP] Add scala-spark core class and job to import data sets to Druid (032 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/386882 (https://phabricator.wikimedia.org/T166414) (owner: 10Mforns) [17:56:48] 10Analytics, 10Analytics-Wikimetrics, 10Epic: EPIC: Longterm fix of data warehouse replicating to Labs - https://phabricator.wikimedia.org/T78009#3793434 (10Nuria) 05Open>03Resolved [17:57:00] 10Analytics, 10Analytics-Wikimetrics: change puppetization for scheduler/queue {ops} {dove} - https://phabricator.wikimedia.org/T76790#3793436 (10Nuria) [17:57:02] 10Analytics, 10Analytics-Wikimetrics: create new group for devs to sudo run wikimetrics admin script {ops} {dove} - https://phabricator.wikimedia.org/T76792#3793435 (10Nuria) 05Open>03Resolved [17:57:16] 10Analytics, 10Analytics-Wikimetrics, 10Epic: EPIC: Productionizing Wikimetrics {dove} - https://phabricator.wikimedia.org/T76726#3793438 (10Nuria) [17:57:18] 10Analytics, 10Analytics-Wikimetrics: Change wikimetrics admin script - no symlinking [8 pts] {dove} - https://phabricator.wikimedia.org/T76780#3793437 (10Nuria) 05Open>03Resolved [17:57:32] 10Analytics, 10Analytics-Wikimetrics, 10Epic: EPIC: Productionizing Wikimetrics {dove} - https://phabricator.wikimedia.org/T76726#818961 (10Nuria) 05Open>03Resolved [17:57:49] 10Analytics, 10Analytics-EventLogging: Create monitoring checks to make sure events end up in DB - https://phabricator.wikimedia.org/T75828#3793442 (10Nuria) 05Open>03Resolved [17:58:03] 10Analytics, 10Analytics-EventLogging: Establish support model for EL? (e.g. more ops involvement) - https://phabricator.wikimedia.org/T75824#3793445 (10Nuria) 05Open>03Resolved [17:58:17] 10Analytics, 10Analytics-EventLogging: Consider idea of 1 sprint for EL operational love sprint - https://phabricator.wikimedia.org/T75831#3793448 (10Nuria) 05Open>03Resolved [17:58:35] 10Analytics, 10Analytics-EventLogging: Dashboard of status of our systems (one stop shopping) - https://phabricator.wikimedia.org/T75830#3793450 (10Nuria) 05Open>03Resolved [17:59:06] 10Analytics, 10Analytics-EventLogging: Create single place to look at graphs indicating outages - https://phabricator.wikimedia.org/T75827#783372 (10Nuria) Resolving, this ticket predates grafana [17:59:13] 10Analytics, 10Analytics-EventLogging: Create single place to look at graphs indicating outages - https://phabricator.wikimedia.org/T75827#3793470 (10Nuria) 05Open>03Resolved [17:59:24] 10Analytics, 10Analytics-EventLogging: Talk to research about Mobile EL pipeline use case - https://phabricator.wikimedia.org/T75913#3793471 (10Nuria) 05Open>03declined [18:00:12] 10Analytics, 10Analytics-Wikimetrics: change puppetization for scheduler/queue {ops} {dove} - https://phabricator.wikimedia.org/T76790#3793487 (10Nuria) 05Open>03declined [18:00:33] 10Analytics, 10Analytics-Wikimetrics, 10Epic: EPIC: Productionizing Wikimetrics {dove} - https://phabricator.wikimedia.org/T76726#3793503 (10Nuria) [18:00:35] 10Analytics, 10Analytics-Wikimetrics: Debianize wikimetrics dependencies not in trusty {ops} {dove} - https://phabricator.wikimedia.org/T76789#3793502 (10Nuria) 05Open>03declined [18:01:10] 10Analytics, 10Analytics-EventLogging: Consider idea of 1 sprint for EL operational love sprint - https://phabricator.wikimedia.org/T75831#3793505 (10Nuria) 05Resolved>03declined [18:02:39] * elukey off! [18:13:31] 10Analytics, 10Research: [Open question] Improve bot identification at scale - https://phabricator.wikimedia.org/T138207#3793589 (10leila) @Nuria This task came up again, in a recent discussion with Search Platform team. They are looking in a few directions to improve search and it's hard to measure metrics ch... [18:14:05] 10Analytics: Privacy pageview threshold for map report - https://phabricator.wikimedia.org/T181508#3792503 (10Erik_Zachte) @fdans WiViVi doesn't use a threshold because the aggregation level is that high that individuals don't stand out from the crowd, except for fringe cases (and even then ... how serious is th... [18:15:22] 10Analytics-Dashiki, 10Analytics-Kanban: Browser-major numbers represented as a percentage (when they're not) on the desktop tabular view - https://phabricator.wikimedia.org/T181164#3793593 (10Nuria) [18:15:30] 10Analytics-Dashiki, 10Analytics-Kanban: Browser-major numbers represented as a percentage (when they're not) on the desktop tabular view - https://phabricator.wikimedia.org/T181164#3781638 (10Nuria) Fixed now, please take a look. [18:16:21] 10Analytics-Kanban, 10Analytics-Wikistats: Wikistats Bug – In tabular data view, format displayed values - https://phabricator.wikimedia.org/T179441#3724893 (10Nuria) Fixed, please take a look: https://stats.wikimedia.org/v2/#/all-projects/reading/total-pageviews [18:16:33] 10Analytics-Kanban, 10Analytics-Wikistats: Wikistats Bug – In tabular data view, format displayed values - https://phabricator.wikimedia.org/T179441#3793600 (10Nuria) 05Open>03Resolved [18:17:57] 10Analytics-Kanban, 10Analytics-Wikistats, 10Patch-For-Review: Alert user about adblocker preventing AQS requests - https://phabricator.wikimedia.org/T177491#3793603 (10Nuria) 05Open>03Resolved [18:19:45] 10Analytics-Kanban, 10Patch-For-Review: Move Wikimetrics to new cloud databases - https://phabricator.wikimedia.org/T180770#3793605 (10Nuria) 05Open>03Resolved [18:21:05] 10Analytics-EventLogging, 10Analytics-Kanban, 10Patch-For-Review: Implement EventLogging Hive refinement - https://phabricator.wikimedia.org/T162610#3793625 (10Nuria) [18:21:07] 10Analytics-EventLogging, 10Analytics-Kanban, 10Patch-For-Review: Refine should parse user agent field as it is done on refinery pipeline - https://phabricator.wikimedia.org/T178440#3793624 (10Nuria) 05Open>03Resolved [18:22:22] 10Analytics-EventLogging, 10Analytics-Kanban, 10Patch-For-Review: Refine should parse user agent field as it is done on refinery pipeline - https://phabricator.wikimedia.org/T178440#3692276 (10Nuria) [18:22:26] 10Analytics-EventLogging, 10Analytics-Kanban, 10Patch-For-Review: Resolve EventCapsule / MySQL / Hive schema discrepancies - https://phabricator.wikimedia.org/T179625#3793640 (10Nuria) 05Open>03Resolved [18:22:34] 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Add a prometheus metric exporter to all the Druid daemons - https://phabricator.wikimedia.org/T177459#3793644 (10Nuria) 05Open>03Resolved [18:22:37] 10Analytics, 10Patch-For-Review, 10User-Elukey: Move away from jmxtrans in favor of prometheus jmx_exporter - https://phabricator.wikimedia.org/T175344#3793645 (10Nuria) [18:24:03] 10Analytics-Dashiki, 10Analytics-Kanban: Browser-major numbers represented as a percentage (when they're not) on the desktop tabular view - https://phabricator.wikimedia.org/T181164#3793653 (10Jdforrester-WMF) Thank you! [18:31:20] 10Analytics: R execution on stat1005 -> 'stack smashing error' - https://phabricator.wikimedia.org/T174946#3793691 (10mpopov) >>! In T174946#3792498, @Ottomata wrote: > @mpopov, you use R on stat1005, yes? Have you ever had this problem? Nope, I've seen some weird errors in general but haven't seen this one. A... [18:37:13] noted team - Thanks ! [18:37:14] 10Analytics: R execution on stat1005 -> 'stack smashing error' - https://phabricator.wikimedia.org/T174946#3793714 (10mpopov) Might seem like a silly question and I hope this doesn't come off as offensive, but did you re-install all the R packages you were using before? Because even though your R package library... [18:38:01] milimetric: would you have second to double check the change I plan to do on page-history-reconstruction? [18:38:11] omw joal [18:52:23] 10Analytics: R execution on stat1005 -> 'stack smashing error' - https://phabricator.wikimedia.org/T174946#3793807 (10Erik_Zachte) @mpopov Thanks, I totally rely on Andrew for this, I don't have root access, which is fine to me, so I can't mess up ;-) And server migrations are rare anyway. I'll make a separate... [19:00:38] # (identifier) (location, eg sda5) (format, eg ext3 or ext4) (some settings) [19:00:44] oops [19:12:11] elukey: still there? [19:12:21] ohno, you said off [19:12:22] laters!~ [19:34:00] 10Analytics-Kanban, 10Analytics-Wikistats: Format timestamps as human-readable datetimes in Wikistats 2.0 table view - https://phabricator.wikimedia.org/T179971#3794096 (10Nuria) 05Open>03Resolved [20:50:46] (03CR) 10Krinkle: [C: 04-1] Grow RestbaseMetrics spark job to count MW API (032 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/392700 (https://phabricator.wikimedia.org/T176785) (owner: 10Joal) [20:58:17] ottomata: o/ - I just seen the ping [21:01:18] elukey: so'k was looking for brain bounce, got one from filippo [21:01:20] thanks [21:01:38] ah okk!! going afk again :) [21:01:41] o/ [21:06:31] 10Analytics-Kanban, 10Patch-For-Review, 10Services (watching): Add action api counts to graphite-restbase job - https://phabricator.wikimedia.org/T176785#3794382 (10JAllemandou) Last patch uses `analytics.mw_api.varnish_request` as matric name for action-api. Thanks @Krinkle for the reivew :) [21:49:53] (03PS3) 10Milimetric: [WIP] Work so far on simplifying and fixing breakdowns [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/391490 (https://phabricator.wikimedia.org/T180556) [21:50:04] (03CR) 10jerkins-bot: [V: 04-1] [WIP] Work so far on simplifying and fixing breakdowns [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/391490 (https://phabricator.wikimedia.org/T180556) (owner: 10Milimetric) [23:09:46] Does anybody know of a good workflow for installing a userland Python package in stat1004 (or 1005) [23:09:56] No pip, no access to internet. [23:19:25] Shilad: you cannot do it , rather need to ask ops and they can do it via puppet, if possible, what are you missing? [23:20:39] Thanks, nuria_. I need "annoy", a library that does accelerated KNN queries: https://github.com/spotify/annoy [23:21:51] Shilad: do create a phab ticket w/ request [23:25:06] nuria_: Thanks! Who should I assign it to, and what tags should I use? Sorry for the newbie questions. [23:25:57] Shilad: you can tag it with analytics , please have in mind that there is no guarantee we will get to this this week [23:27:05] That is no problem. Thank you!