[02:03:55] Analytics-Kanban, Patch-For-Review, Puppet: Puppet support for multiple Dashiki instances running on one server - https://phabricator.wikimedia.org/T120891#1876914 (madhuvishy) [02:04:17] Analytics-Kanban, Patch-For-Review, Puppet: Puppet support for multiple Dashiki instances running on one server - https://phabricator.wikimedia.org/T120891#1876916 (madhuvishy) a:yuvipanda>madhuvishy [04:35:17] Analytics-Kanban, Patch-For-Review, Puppet: Puppet support for multiple Dashiki instances running on one server - https://phabricator.wikimedia.org/T120891#1876982 (yuvipanda) Gerrrit Bot says uploaded by me, but was actually from @madhuvishy [07:03:33] Analytics, MediaWiki-extensions-Gadgets: Track the GadgetUsage statistics over time - https://phabricator.wikimedia.org/T121049#1877034 (Legoktm) graphite/grafana is probably the best counts over time visualizer we have right now. We'd want to hack into the update process somehow to send the counts every... [09:47:31] Analytics-Kanban: Remove all-access and spider from top endpoint {slug} - https://phabricator.wikimedia.org/T121300#1877168 (JAllemandou) Hey @milimetric, The script loads only `agentType = 'user'` and have the four possible values for access-method: `desktop`, `mobile-web`, `mobile-app`, `all-access`. Howeve... [12:03:28] Analytics-Kanban: Prepare EL queue sizes for backfilling {oryx} - https://phabricator.wikimedia.org/T121384#1877445 (mforns) NEW a:mforns [12:06:37] Analytics-Kanban: Prepare EL queue sizes for backfilling {oryx} - https://phabricator.wikimedia.org/T121384#1877455 (mforns) [12:06:38] Analytics-Kanban, DBA: 2 hour outage to update mysql on EL slaves - https://phabricator.wikimedia.org/T121120#1877454 (mforns) [13:06:11] Analytics-Tech-community-metrics, DevRel-December-2015: OwlBot seems to merge random user accounts in korma user data - https://phabricator.wikimedia.org/T119755#1877592 (Lcanasdiaz) a:Dicortazar>Lcanasdiaz [14:27:56] Analytics-Tech-community-metrics, DevRel-December-2015, Patch-For-Review: Review/update mailing list repositories in korma - https://phabricator.wikimedia.org/T116285#1877650 (Aklapper) Patch merged. Will resolve once http://korma.wmflabs.org/browser/mls-repos.html shows more than 26 mls repos. [14:38:58] Hi ottomata, have you reset hue credentials recently? [14:39:11] ottomata: seems I can't connect anymore [14:40:28] hello! [14:40:31] i have not, but let me see! [14:43:50] joal: i see in logs [14:43:51] [14/Dec/2015 14:43:31 +0000] backend WARNING Caught LDAPError while authenticating joal: SERVER_DOWN({'desc': "Can't contact LDAP server"},) [14:44:02] something has changed i think [14:44:07] finishing reading email then will ask ops [14:44:14] ottomata: Thanks Sir :) [14:58:42] Analytics-Cluster, operations: New LDAP IPs not reachable from analytics VLAN - https://phabricator.wikimedia.org/T121401#1877697 (Ottomata) NEW a:akosiaris [14:59:00] joal: we think it is because recently they upgraded ldap hosts [14:59:09] ottomata: ok :) [14:59:10] but didn't open the hole in the analytics firewall [14:59:39] ottomata: I'm the only one you think ? Or nobody'sd using hue anymore? [15:00:22] yeah nobody can use it [15:00:30] right [15:00:52] That gives us information on usage statistics I guess :) [15:01:00] since how long is it broken ? [15:02:25] maybe 10 days? [15:02:36] hehe [15:15:05] Analytics-Backlog, Analytics-Kanban, operations, Monitoring, Patch-For-Review: Turn off sqstat udp2log instance - https://phabricator.wikimedia.org/T117727#1877758 (Ottomata) [15:30:00] !log deployed new mysql-consumer queue sizes for EventLogging and restarted the server [15:32:36] Analytics-Backlog, Analytics-Cluster: Single Kafka partition replica periodically lags - https://phabricator.wikimedia.org/T121407#1877784 (Ottomata) NEW a:Ottomata [15:59:06] Analytics-EventLogging, Analytics-Kanban, EventBus, Patch-For-Review: Build tornado-sprocket python packages - https://phabricator.wikimedia.org/T121112#1877838 (Ottomata) Open>Resolved [15:59:07] Analytics-EventLogging, Analytics-Kanban, EventBus, Patch-For-Review: Send HTTP stats about eventlogging-service to statsd - https://phabricator.wikimedia.org/T118869#1877839 (Ottomata) [16:04:17] Analytics-Cluster, operations: New LDAP IPs not reachable from analytics VLAN - https://phabricator.wikimedia.org/T121401#1877845 (akosiaris) Open>Resolved ACLs update. Dropped labcontrol2001 and neptunium and added seaborgium/serpens. Tested from stat1003 and it now works fine. [16:18:43] Analytics-EventLogging, EventBus, Wikimedia-Logstash: eventlogging syslog message not properly recognized by logstash - https://phabricator.wikimedia.org/T120874#1877881 (hashar) I have no idea honestly :( Based on the upstream bug ( https://github.com/elastic/logstash/issues/2552 ) seems the column... [16:22:06] ottomata: Having seen the link above, I have tested: hue is accessible now, thanks :) [16:34:25] Analytics-Kanban, Patch-For-Review: Fix EL mysql consumer's deque push/pop {oryx} [3 pts] - https://phabricator.wikimedia.org/T120209#1877917 (mforns) [16:38:14] (CR) Milimetric: [C: -1] "Waiting to resolve formatting and details with Erik Z." [analytics/refinery] - https://gerrit.wikimedia.org/r/256355 (https://phabricator.wikimedia.org/T118323) (owner: Milimetric) [16:48:30] joal: ottomata ya i've been trying to use it too [16:48:54] hue [16:51:43] Analytics-Kanban: Update ops/puppet to use analytics-alert email alias instead of all engineers' emails {hawk} [1 pts] - https://phabricator.wikimedia.org/T121193#1877966 (Nuria) Open>Resolved [16:51:57] Analytics-EventLogging, Analytics-Kanban, EventBus, Patch-For-Review: Puppetize eventlogging-service - https://phabricator.wikimedia.org/T118780#1877971 (Nuria) [16:51:58] Analytics-EventLogging, Analytics-Kanban, EventBus, Patch-For-Review: Make eventlogging logs configurable via python config file [5 pts] {oryx} - https://phabricator.wikimedia.org/T118903#1877970 (Nuria) Open>Resolved [16:52:13] Analytics-Cluster, Analytics-Kanban: Research whether no cookie header numbers improve Last access uniques {bear} [13 pts] - https://phabricator.wikimedia.org/T115350#1877973 (Nuria) [16:52:14] Analytics-Cluster, Analytics-Kanban: Estimate number of users (or requests) that have cookies off (due to fresh session or incognito mode) [3 pts] - https://phabricator.wikimedia.org/T119653#1877972 (Nuria) Open>Resolved [16:52:25] Analytics-Kanban: Eventlogging devserver needs maintenance [3 pts] - https://phabricator.wikimedia.org/T120245#1877977 (Nuria) Open>Resolved [16:52:40] Analytics-Kanban, DBA, Patch-For-Review: Pending maintenance on the eventlogging databases (db1046, db1047, dbstore1002, other dbstores) - https://phabricator.wikimedia.org/T120187#1877981 (Nuria) [16:52:41] Analytics-Kanban, DBA, Patch-For-Review: Make EL create tables using TokuDB by default [5] - https://phabricator.wikimedia.org/T120967#1877979 (Nuria) Open>Resolved [16:52:58] Analytics-Kanban: Troubleshooting limn1 and wikimetrics1 self-hosted puppet woes [3 pts] - https://phabricator.wikimedia.org/T120968#1877982 (Nuria) Open>Resolved [16:53:16] Analytics-Kanban: Backfill EL data for 2015-11-27 incident {oryx} [5 pts] - https://phabricator.wikimedia.org/T119981#1877984 (Nuria) Open>Resolved [16:53:25] * elukey didn't know about HUE, really nice! [16:53:30] Analytics-Backlog, Analytics-EventLogging, Analytics-Kanban, Patch-For-Review: More solid Eventlogging alarms for raw/validated {oryx} [8 pts] - https://phabricator.wikimedia.org/T116035#1877986 (Nuria) Open>Resolved [16:53:46] Analytics-Kanban, Analytics-Wikistats, Patch-For-Review: Feed Wikistats traffic reports with aggregated hive data {lama} [21 pts] - https://phabricator.wikimedia.org/T114379#1877989 (Nuria) Open>Resolved [16:53:57] Analytics-Kanban, Analytics-Wikistats, Patch-For-Review: Feed Wikistats traffic reports with aggregated hive data {lama} [21 pts] - https://phabricator.wikimedia.org/T114379#1710144 (Nuria) Resolved>Open [16:55:26] elukey: nice but unfortunately unstable sometimes [16:55:56] :( [16:58:50] Analytics-EventLogging, EventBus, Wikimedia-Logstash: eventlogging syslog message not properly recognized by logstash - https://phabricator.wikimedia.org/T120874#1877996 (Ottomata) Hm, no it is on beta... [17:00:48] a-team, having problems to enter batcave... [17:02:14] mforns: :( we are all in [17:02:16] mforns: k, waiting [17:02:23] ok [17:02:51] mforns: i invited you, try to join? [17:02:53] whoops [17:03:01] (sometimes invites reset) [17:03:57] a-team, I think it's connection problems, you can start, I will try to fix it [17:04:13] Analytics-Tech-community-metrics, DevRel-December-2015, Patch-For-Review: Review/update mailing list repositories in korma - https://phabricator.wikimedia.org/T116285#1878028 (Lcanasdiaz) Patch merged, executing metrics and waiting :) [17:15:49] Analytics-Kanban, Patch-For-Review: Puppetize dashiki dashboard deployments - https://phabricator.wikimedia.org/T110351#1878073 (Milimetric) a:Milimetric>madhuvishy [17:16:09] Analytics-Kanban, Patch-For-Review: Fabric-alize dashiki dashboard deployments - https://phabricator.wikimedia.org/T110351#1878074 (Milimetric) [17:31:46] Analytics-Kanban, Services: Better Response times pageview API.. [8 pts] - https://phabricator.wikimedia.org/T119886#1878105 (Nuria) @GWicke : according to @milimetric seems that we agreed on deploying these changes to the frontend rather than trying to add caching headers to backend response. Let us know... [17:35:26] Analytics-Engineering, Analytics-Wikimetrics: Unable to add a custom cohort user - https://phabricator.wikimedia.org/T91751#1878119 (Milimetric) Open>Invalid Sounds like this is not an issue, please re-open if otherwise [17:35:43] Analytics-Engineering: Email engineering re: x-analytics deployed to all wikis - https://phabricator.wikimedia.org/T89748#1878121 (Milimetric) Open>declined [17:37:46] Analytics-Engineering, Analytics-EventLogging: Automate pruning of sampled logs after 90 days [0 pts] - https://phabricator.wikimedia.org/T74743#1878146 (Milimetric) [17:37:48] Analytics-Backlog, Analytics-Engineering, Analytics-EventLogging: Spike on requirements to prune EL data {oryx} - https://phabricator.wikimedia.org/T89293#1878143 (Milimetric) Open>Resolved a:Milimetric Done as part of {tick} [17:38:06] Analytics-Engineering: Hadoop errors - https://phabricator.wikimedia.org/T88537#1878149 (Milimetric) Open>declined a:Milimetric [17:40:06] heya is the analytics ops duty person listed somewhere? [17:40:45] ottomata: it's in the calendar [17:41:15] Analytics-Engineering: Request for current data about mobile editing in he.wikipedia - https://phabricator.wikimedia.org/T86793#1878160 (Milimetric) Open>declined a:Milimetric We'll work on this as part of larger projects. Some similar data is available on labsdb, but we hope to release broader data. [17:42:00] Analytics-Engineering: EL-Kafka pipeline that was disabled 6 months ago - https://phabricator.wikimedia.org/T86576#1878165 (Milimetric) Open>Resolved a:Milimetric [17:42:14] ask from ops: can that info (or at least info about where to look on the calendar) be put on this page? https://office.wikimedia.org/wiki/Technology/OOO_coverage#Analytics [17:44:47] Analytics-Engineering, Analytics-EventLogging: translate.googleusercontent.com in webHost for some client-side events - https://phabricator.wikimedia.org/T67508#1878178 (Milimetric) Open>declined a:Milimetric We don't really know what's going on here, please update if this is still an issue [17:46:31] Analytics-Engineering, Analytics-EventLogging: Don't accept data from automated bots in Event Logging - https://phabricator.wikimedia.org/T67508#1878181 (Milimetric) [17:46:39] Analytics-Engineering, Analytics-EventLogging: Don't accept data from automated bots in Event Logging - https://phabricator.wikimedia.org/T67508#1878184 (Milimetric) declined>Open [17:46:45] Analytics-Engineering: Don't accept data from automated bots in Event Logging - https://phabricator.wikimedia.org/T67508#1878185 (Milimetric) [17:47:22] Analytics-Engineering, Analytics-EventLogging: Deployment checklist - https://phabricator.wikimedia.org/T86381#1878188 (Milimetric) Open>declined a:Milimetric [17:48:35] Analytics-Engineering, Analytics-EventLogging: Performance testing of event logging to correctly estimate perf thresholds - https://phabricator.wikimedia.org/T86244#1878195 (Milimetric) Open>Resolved a:Milimetric available here: https://wikitech.wikimedia.org/wiki/Analytics/EventLogging/Performance [17:49:00] Analytics-Engineering: ImageView script: dump the data - https://phabricator.wikimedia.org/T86204#1878200 (Milimetric) Open>declined a:Milimetric sadly we don't know what this means any more [17:49:02] Analytics-Backlog, Analytics-Cluster: Epic: qchris transition - https://phabricator.wikimedia.org/T86135#1878203 (Milimetric) [17:50:10] Analytics-Engineering: ImageView script: Release the script but explain very clearly how the data is imprecise. (Let Erik or Dan write this explanation) - https://phabricator.wikimedia.org/T86203#1878206 (Milimetric) Open>Resolved a:Milimetric [17:50:11] Analytics-Backlog, Analytics-Cluster: Epic: qchris transition - https://phabricator.wikimedia.org/T86135#962018 (Milimetric) [17:50:17] ottomata: the "analytics ops duty" is about doing housekeeping in Analytics-Engineering? [17:50:33] Analytics-Backlog, Analytics-Cluster: Epic: qchris transition - https://phabricator.wikimedia.org/T86135#962018 (Milimetric) [17:50:34] Analytics-Engineering: ImageView script: update and merge UDF - https://phabricator.wikimedia.org/T86202#1878212 (Milimetric) Open>Resolved a:Milimetric [17:50:43] Analytics-Engineering, Analytics-EventLogging: Unit tests for Event Logging - https://phabricator.wikimedia.org/T86188#1878216 (Milimetric) Open>Resolved a:Milimetric [17:50:56] Analytics-Engineering, Analytics-Wikimetrics: Story: Analytics Eng locks wikimetrics-staging so nobody else can deploy to it. - https://phabricator.wikimedia.org/T86066#1878219 (Milimetric) Open>Invalid a:Milimetric [17:51:53] elukey: is more about having a person responsible for responding to any analytics/ops type alerts or outages or issues [17:51:57] usually nothing to do, just a go to person [17:52:37] ahhh okok! [17:53:33] Analytics-Engineering, Wikimedia-Logstash, operations: Convert Hadoop-Logstash logging to use Redis to address failures - https://phabricator.wikimedia.org/T85015#1878226 (Milimetric) Open>declined a:Milimetric We don't think anyone's going to work on this at this point. We're filing some oth... [17:54:26] Analytics-Kanban: Spike: Investigate situation of logstash and hadoop logs - https://phabricator.wikimedia.org/T121418#1878231 (Nuria) NEW [17:54:31] I was trying to figure out where to go to find all the tickets/tasks/etc.. that need some care [17:55:13] still trying to familiarize with phabricator :) [17:56:01] Analytics-Engineering: Provide a ua-parser service (ua-parser.wikimedia.org) using the One True Wikimedia UA-Parser™ - https://phabricator.wikimedia.org/T1336#1878242 (Milimetric) @Jdforrester-WMF can you say if you guys still need this, and if so, how important it is? [17:56:49] ellery: 'all' is difficult! [17:56:52] this is the best place to look [17:56:52] https://phabricator.wikimedia.org/tag/analytics-kanban/ [17:56:56] and/or [17:56:59] Analytics-Engineering, Wikimedia-Logstash: Zookeeper logging to Logstash - https://phabricator.wikimedia.org/T84908#933675 (Milimetric) Andrew is this possible / useful ? [17:57:05] https://phabricator.wikimedia.org/tag/analytics-kanban/ [17:57:40] Analytics-Engineering, Wikimedia-Logstash: Zookeeper logging to Logstash - https://phabricator.wikimedia.org/T84908#1878252 (Ottomata) Meh, let's close this, probably not really useful. We actually disabled the hadoop logging work we did because it was to noisy. [17:59:01] Analytics-Engineering: Oozie tutorial - https://phabricator.wikimedia.org/T78687#1878257 (Milimetric) Open>Resolved Handled by all the documentation on wikitech: https://wikitech.wikimedia.org/wiki/Analytics/Cluster/Oozie [17:59:46] Analytics-Backlog, Analytics-EventLogging, Documentation, Epic: {epic} Product Instrumentation and Visualization {oryx} - https://phabricator.wikimedia.org/T76795#1878266 (Milimetric) [17:59:48] Analytics-Engineering, Analytics-EventLogging: WMF has Visualization Roadmap - https://phabricator.wikimedia.org/T78444#1878263 (Milimetric) Open>declined a:Milimetric This is a bit outdated. [18:00:03] Analytics-Backlog, Analytics-EventLogging, Documentation, Epic: {epic} Product Instrumentation and Visualization {oryx} - https://phabricator.wikimedia.org/T76795#819854 (Milimetric) [18:00:04] Analytics-Engineering, Analytics-EventLogging: WMF Engineers have harmonized schemas - https://phabricator.wikimedia.org/T78442#1878269 (Milimetric) Open>Resolved a:Milimetric Done as part of {tick} [18:01:23] Analytics: THEME: Analyst uses an operationalized Saiku - https://phabricator.wikimedia.org/T75246#1878280 (Milimetric) [18:01:24] Analytics-Cluster, Analytics-Engineering: Backfill pageview data with WebstatsCollector data and/or Sampled Log data - https://phabricator.wikimedia.org/T76768#1878277 (Milimetric) Open>declined a:Milimetric we're not going to do this, but we'll have a discussion about what to do with legacy data [18:01:46] Analytics-Cluster, Analytics-Engineering: EPIC: Aggregating and Shaping the data for browsing - https://phabricator.wikimedia.org/T76761#1878285 (Milimetric) [18:01:47] Analytics-Cluster, Analytics-Engineering: make cubes as windows into warehouse - https://phabricator.wikimedia.org/T76767#1878282 (Milimetric) Open>declined a:Milimetric outdated metaphores :) [18:02:10] Analytics-Cluster, Analytics-Engineering: EPIC: Aggregating and Shaping the data for browsing - https://phabricator.wikimedia.org/T76761#819498 (Milimetric) [18:02:12] Analytics-Cluster, Analytics-Engineering: Mondrian has access to the PostgreSQL database - https://phabricator.wikimedia.org/T76766#1878287 (Milimetric) Open>declined a:Milimetric Doesn't look like this will happen and we're focusing on Druid instead of Postgres for analytics. [18:02:14] Analytics-Backlog, Analytics-Cluster: Upgrade to CDH 5.5 - https://phabricator.wikimedia.org/T119646#1878291 (ellery) I just did another experiment with using caching while running Spark 1.5 from a jar in my homedir, and it worked just fine. I was probably making a coding error or was too impatient when I... [18:02:51] Analytics-Cluster, Analytics-Engineering: EPIC: Aggregating and Shaping the data for browsing - https://phabricator.wikimedia.org/T76761#819498 (Milimetric) [18:02:52] Analytics-Cluster, Analytics-Engineering: Sqoop? data from Hadoop into a PostgreSQL database, Oozify and monitor this - https://phabricator.wikimedia.org/T76765#1878293 (Milimetric) Open>declined a:Milimetric too generic, but we're working on this idea [18:03:03] Analytics-Cluster, Analytics-Engineering: Schedule Oozie job and set up monitoring - https://phabricator.wikimedia.org/T76764#1878297 (Milimetric) Open>declined a:Milimetric [18:03:04] Analytics-Cluster, Analytics-Engineering: EPIC: Aggregating and Shaping the data for browsing - https://phabricator.wikimedia.org/T76761#819498 (Milimetric) [18:03:13] Analytics-Cluster, Analytics-Engineering: EPIC: Aggregating and Shaping the data for browsing - https://phabricator.wikimedia.org/T76761#819498 (Milimetric) [18:03:14] Analytics-Cluster, Analytics-Engineering: Define Oozie-executable job to aggregate the data (Hive?) - https://phabricator.wikimedia.org/T76763#1878302 (Milimetric) Open>declined a:Milimetric [18:03:27] Analytics-Cluster, Analytics-Engineering: Creating the data in Hadoop from the raw request data, with Oliver's definition - https://phabricator.wikimedia.org/T76762#1878306 (Milimetric) Open>Resolved a:Milimetric [18:03:28] Analytics-Cluster, Analytics-Engineering: EPIC: Aggregating and Shaping the data for browsing - https://phabricator.wikimedia.org/T76761#819498 (Milimetric) [18:03:48] Analytics: THEME: Analyst uses an operationalized Saiku - https://phabricator.wikimedia.org/T75246#1878311 (Milimetric) [18:03:49] Analytics-Cluster, Analytics-Engineering: EPIC: Aggregating and Shaping the data for browsing - https://phabricator.wikimedia.org/T76761#1878309 (Milimetric) Open>Resolved a:Milimetric [18:03:56] Analytics-Kanban: {puma} Mondrian & Saiku - https://phabricator.wikimedia.org/T76739#1878314 (Milimetric) [18:03:57] Analytics-Engineering: Have a PostgreSQL database to pull data from (warehouse database on analytics-store) - https://phabricator.wikimedia.org/T76758#1878312 (Milimetric) Open>declined a:Milimetric [18:04:06] Analytics-Kanban: {puma} Mondrian & Saiku - https://phabricator.wikimedia.org/T76739#819159 (Milimetric) [18:04:08] Analytics-Engineering: provision hardware and install - https://phabricator.wikimedia.org/T76757#1878315 (Milimetric) Open>declined a:Milimetric [18:04:40] Analytics-Engineering: user defined mysql functions on analytics-store - https://phabricator.wikimedia.org/T76366#1878322 (Milimetric) Open>declined a:Milimetric [18:06:34] ottomata: thanks! [18:13:59] Analytics-Backlog: analytics1032 has / mounted ro - https://phabricator.wikimedia.org/T118175#1878344 (Milimetric) [18:14:06] Analytics-Backlog: Story: VitalSignsUser selects Monthly Pageviews metric - https://phabricator.wikimedia.org/T75331#1878345 (Milimetric) [18:14:23] Analytics-Backlog, Need-volunteer: Validate JsonSchemaContent using MediaWIki core's handling - https://phabricator.wikimedia.org/T76432#1878349 (Milimetric) [18:16:44] ottomata: meeting done or not yet ? [18:16:44] Analytics-Backlog, Security, Zero, operations: Purge > 90 days stat1002:/a/squid/archive/zero - https://phabricator.wikimedia.org/T92343#1878361 (Milimetric) [18:16:50] ottomata: are you done with ops meeting to join us with tasking? [18:17:04] Analytics-Backlog, Security, Zero, operations: Purge > 90 days stat1002:/a/squid/archive/sampled - https://phabricator.wikimedia.org/T92342#1878362 (Milimetric) [18:17:10] Analytics-Backlog, Security, operations: Purge > 90 days stat1002:/a/squid/archive/glam_nara - https://phabricator.wikimedia.org/T92340#1878363 (Milimetric) [18:17:16] Analytics-Backlog, Security, Zero, operations, Mobile: Purge > 90 days stat1002:/a/squid/archive/mobile - https://phabricator.wikimedia.org/T92341#1878364 (Milimetric) [18:17:22] Analytics-Backlog, Security, operations: Purge > 90 days stat1002:/a/squid/archive/api - https://phabricator.wikimedia.org/T92338#1878365 (Milimetric) [18:17:42] Analytics-Kanban, Discovery, EventBus, MediaWiki-General-or-Unknown, and 7 others: EventBus MVP - https://phabricator.wikimedia.org/T114443#1878366 (Milimetric) [18:17:48] Analytics-Backlog, Deployment-Systems, Services, operations, Scap3: Deploy AQS with scap3 - https://phabricator.wikimedia.org/T114999#1878367 (Milimetric) [18:17:51] elukey: hola [18:19:39] nuria: joal coming, sorry was about to make lunch [18:22:27] Analytics-Backlog: analytics1032 has / mounted ro - https://phabricator.wikimedia.org/T118175#1878379 (Ottomata) Open>Resolved This was fixed in a reboot, but we don't know why it originally happened. [18:24:35] Analytics-Backlog, Security, Zero, operations: Purge > 90 days stat1002:/a/squid/archive/sampled - https://phabricator.wikimedia.org/T92342#1878382 (Milimetric) When doing this, please ping @milimetric because he (me) has to remove the tables created on top of a copy of this data in HDFS [18:33:57] Analytics-Backlog: Guidance on using the JSON output of T44259 - https://phabricator.wikimedia.org/T121314#1878419 (Milimetric) Open>Resolved here's a simple python api: https://github.com/mediawiki-utilities/python-mwviews The output won't be human readable but ask us in IRC / email if you have specif... [18:34:59] Analytics-Backlog, Analytics-Wikimetrics: Central repository of global metrics reports {kudu} - https://phabricator.wikimedia.org/T121286#1878424 (Milimetric) [18:35:15] Analytics-Backlog: Create Pageview API dashboard to monitor response times - https://phabricator.wikimedia.org/T121277#1878429 (Milimetric) p:Normal>High [18:36:54] Analytics-Backlog, Analytics-Wikimetrics: Display global metrics report results on same page as report inputs - https://phabricator.wikimedia.org/T121262#1873990 (Milimetric) [18:37:39] Analytics-Backlog, Analytics-Wikimetrics: Include all timezones in global metrics report interface {kudu} - https://phabricator.wikimedia.org/T121167#1871524 (Milimetric) [18:38:02] Analytics-Backlog: Remove queue of batches from EL code - https://phabricator.wikimedia.org/T121151#1878451 (Milimetric) [18:38:31] Analytics-Backlog, Analytics-Wikimetrics: Include all timezones in global metrics report interface {kudu} - https://phabricator.wikimedia.org/T121167#1878454 (Milimetric) p:Triage>Normal [18:40:02] Analytics-Backlog: Quaterly review 2016/01/22 - https://phabricator.wikimedia.org/T120844#1878457 (Milimetric) [18:40:57] Analytics-Backlog, Analytics-Wikimetrics, Puppet: Cleanup Wikimetrics puppet module so it can run puppet continuously without own puppetmaster {dove} - https://phabricator.wikimedia.org/T101763#1878462 (Milimetric) p:Low>High [18:42:03] Analytics-Backlog, Analytics-Wikimetrics: Bot to call global metrics to event page {kudu} - https://phabricator.wikimedia.org/T120330#1851192 (Milimetric) [18:42:35] Analytics-Backlog, Easy: Standardize logic, names, and null handling across UDFs in refinery-source {hawk} - https://phabricator.wikimedia.org/T120131#1845910 (Milimetric) [18:44:16] Analytics-Backlog, WMDE-Analytics-Engineering: Provide machine readable directory indexes on http://datasets.wikimedia.org/aggregate-datasets/ - https://phabricator.wikimedia.org/T117480#1878501 (Milimetric) Can you explain the value of this feature? [18:45:19] Analytics-Backlog: Vital Signs: Please provide an "all languages" de-duplicated stream for the Community/Content groups of metrics - https://phabricator.wikimedia.org/T120037#1878507 (Milimetric) p:Triage>Normal [18:45:23] Analytics-Backlog: Vital Signs: Please make the data for enwiki and other big wikis less sad, and not just be missing for most days - https://phabricator.wikimedia.org/T120036#1878508 (Milimetric) p:Triage>Normal [18:46:15] Analytics-Backlog: Have dashiki read and write GET params to pass stateful versions of dashboard pages {crow} - https://phabricator.wikimedia.org/T119996#1878512 (Milimetric) a:Nuria [18:46:33] Analytics-Kanban: Have dashiki read and write GET params to pass stateful versions of dashboard pages {crow} - https://phabricator.wikimedia.org/T119996#1842220 (Milimetric) [18:48:19] Analytics-Backlog, Analytics-Cluster: Upgrade to CDH 5.5 - https://phabricator.wikimedia.org/T119646#1878518 (Milimetric) p:Low>High [18:49:00] Analytics-Backlog, Analytics-Wikimetrics, Easy: Upgrade wikimetrics code to check labs lag table - https://phabricator.wikimedia.org/T119514#1878521 (Milimetric) p:Normal>Low [18:50:46] Analytics-Backlog: Provide a way to find out what is being searched for on a wiki - https://phabricator.wikimedia.org/T119439#1878535 (Milimetric) Open>declined a:Milimetric The pageview API is about a different data set. Exposing search data publicly is problematic because people tend to type in so... [18:51:20] Analytics-Backlog, Project-Creators: Dedicated and/or automated Wikimedia pageviews API project/tag in Phabricator Maniphest - https://phabricator.wikimedia.org/T119151#1878540 (Milimetric) p:Triage>High [19:09:23] * milimetric is starving [19:16:58] Analytics-Backlog, Wikipedia-iOS-App-Product-Backlog, operations, vm-requests, iOS-5-app-production: Request one server to suport piwik analytics - https://phabricator.wikimedia.org/T116312#1878668 (Dzahn) Since this changed from a VM request to real hardware i'm adjusting the relevent tags acco... [19:17:11] Analytics-Backlog, Wikipedia-iOS-App-Product-Backlog, hardware-requests, operations, iOS-5-app-production: Request one server to suport piwik analytics - https://phabricator.wikimedia.org/T116312#1878669 (Dzahn) [19:19:41] Analytics-Backlog, Wikipedia-iOS-App-Product-Backlog, hardware-requests, operations, iOS-5-app-production: Request one server to suport piwik analytics - https://phabricator.wikimedia.org/T116312#1878677 (Nuria) An update regarding hardware provisioning here will be great [19:37:10] Analytics-Backlog, Wikipedia-iOS-App-Product-Backlog, hardware-requests, operations, iOS-5-app-production: Request one server to suport piwik analytics - https://phabricator.wikimedia.org/T116312#1878755 (Ottomata) Hm, maybe we could host this on stat1001? It already hosts a couple of public an... [19:37:52] Analytics-Backlog, Wikipedia-iOS-App-Product-Backlog, hardware-requests, operations, iOS-5-app-production: Request one server to suport piwik analytics - https://phabricator.wikimedia.org/T116312#1878767 (Ottomata) stat1001 is still Precise though. We might want to upgrade it to Jessie before d... [19:50:38] madhuvishy: you have sudo on eventlog1001 now! [19:52:21] ottomata: yay thanks [19:55:06] ottomata: ok, so looking ta event bus notes post to even bus are no longer synschronous: https://gerrit.wikimedia.org/r/#/c/257420/2/EventBus.hooks.php [19:55:20] great, that is the way I would have expected them to owrk [19:55:23] *work [19:55:42] nuria: except aaron s is advising against that, i think. [19:55:51] (they are still synchronous in that, just deferred) [19:55:51] ottomata: ya, i saw it [19:55:54] (in the actual request) [19:56:04] ottomata: ya, after response is buffered [19:56:48] ottomata: ya, aaron seems to be in favor of batching and send before commit [19:56:58] ottomata: i guess he is teh one that knows the system best [19:57:01] *the [19:57:25] ya would just suck to delay response due to eventlogging-service + kafka latency [20:11:08] Analytics-Cluster: Fix file permissions for wmf.webrequest data - https://phabricator.wikimedia.org/T114327#1878968 (Ottomata) Open>Resolved [20:12:21] Analytics, operations: analytics1013 crashed, investigate... - https://phabricator.wikimedia.org/T97380#1878972 (Ottomata) Open>Resolved [20:15:42] Analytics-Backlog, Analytics-EventLogging, MediaWiki-extensions-CentralNotice, Traffic, operations: Eventlogging should transparently split large event payloads - https://phabricator.wikimedia.org/T114078#1878984 (Ottomata) Anyone mind if I decline this task? [20:17:56] Analytics-Backlog, Analytics-Cluster: Trouble with access to hue - https://phabricator.wikimedia.org/T114292#1878987 (Ottomata) Open>Resolved Oh! Just saw this. Done. [20:20:18] mili|lunch: ping when back :) [20:37:35] Analytics-Backlog, Analytics-Cluster: Single Kafka partition replica periodically lags - https://phabricator.wikimedia.org/T121407#1879050 (Ottomata) Hm, looks like this is our problem: https://issues.apache.org/jira/browse/KAFKA-2143 I'm not entirely sure what to do about it other than wait. Perhaps w... [20:39:19] madhuvishy: yt? [20:39:25] nuria: yup! [20:41:01] madhuvishy: been working on last access page to correct documentation and such. I think i am going to need a million edits so i can explain clearly how stuff is calculated, please free to edit at any time: [20:41:08] https://wikitech.wikimedia.org/wiki/Analytics/Unique_clients/Last_access_solution [20:41:16] madhuvishy: going back to wikimetrics tests now [20:41:34] nuria: cool, let me know if you wanna batcave [20:41:55] madhuvishy: yes, let's do it in a bit, lemme re run tests and think a bit [20:42:04] okay [20:43:36] (CR) Nuria: "Adding joal to review. Thank you for doing changes, will try to CR today." [analytics/refinery/source] - https://gerrit.wikimedia.org/r/247601 (https://phabricator.wikimedia.org/T115919) (owner: OliverKeyes) [20:51:54] hi madhuvishy [20:52:17] milimetric: hey! so i was trying to get dashiki locally following along your readme [20:52:37] and i run into this error [20:52:41] https://www.irccloud.com/pastebin/qYLMfv3T/ [20:53:01] when i try to do gulp --layout compare ... [20:53:36] I'll try to do a clean install too, see what's up [20:53:51] milimetric: for some reason even after bower install - the bower-modules/mediawiki-storage directory only has a LICENSE file - no dist directory [20:53:52] okay [20:54:13] madhuvishy: oh interesting, so that package has some problems then? Maybe... [20:54:40] milimetric: yeah - i changed the version from Latest to 0.3.0 to check - same [20:56:26] (installing dependencies) [20:56:35] madhuvishy: batcave? [20:56:47] nuria: sure [20:57:22] Analytics-Backlog, Analytics-Cluster, Patch-For-Review: Single Kafka partition replica periodically lags - https://phabricator.wikimedia.org/T121407#1879089 (Ottomata) I've made some puppet changes that will hopefully keep alerts from triggering for this. Let's wait a few days to see if we get any new... [21:01:48] madhuvishy: hm, I tried uninstalling and re-installing everything and it seems ok [21:02:10] my npm is 1.4.11 and bower is 1.3.5 [21:02:29] did you get an error when you did bower install? [21:04:06] (CR) Joal: "Will review tomorrow morning (CET)" [analytics/refinery/source] - https://gerrit.wikimedia.org/r/247601 (https://phabricator.wikimedia.org/T115919) (owner: OliverKeyes) [21:04:28] milimetric: no [21:04:44] brb chatting with nuria on batcave about wikimetrics test - sorry [21:05:16] np, i'm around [21:05:34] ping me when you're done and we can troubleshoot in the cave [21:08:23] milimetric: post tonight or shall I get to bed ? [21:08:36] joal: go to bed, you shouldn't wait around for silly things like blog posts [21:08:45] if it crashes and burns, it could do that at 3am anyway [21:08:53] true [21:09:09] I'd still ike to be here and monitor, just to see if the rate grows :) [21:09:25] milimetric: anyway, to bed :) [21:09:31] right, that's nice of you but 24h monitoring is the job of computers and teams with many more people than us [21:09:50] true [21:09:52] nite :) [21:09:59] Ciao ciao a-team ! [21:11:41] night, joal :) [21:12:06] milimetric: back - what should i uninstall? [21:12:14] I'll join the cave [21:31:19] a-team the blogpost is up http://blog.wikimedia.org/2015/12/14/pageview-data-easily-accessible/ [21:31:24] \o/ [21:31:45] sweet :) [21:31:54] !log pageview API blog post goes live [21:41:13] Analytics-EventLogging, EventBus, Wikimedia-Logstash: eventlogging syslog message not properly recognized by logstash - https://phabricator.wikimedia.org/T120874#1879231 (Ottomata) Hashar, I'm happy to change the log line to whatever format makes sense, but I'm not sure what it should be from that ti... [22:12:14] Analytics-EventLogging, EventBus, Wikimedia-Logstash: eventlogging syslog message not properly recognized by logstash - https://phabricator.wikimedia.org/T120874#1879293 (hashar) Seems that message is received as: <12>Dec 14 21:33:14 deployment-eventlogging04 eventlogging-service-eventbus[23 (Ma... [22:13:37] milimetric: I see https://meta.wikimedia.org/wiki/Config:VisualEditorAndWikitext but not the pages for MobileReportCard and LanguageReportCard [22:13:57] kevinator: milimetric ooh just seeing yayyy [22:15:41] yes... please retweet! [22:18:19] kevinator: done :) [22:23:38] milimetric: I have this so far [22:23:40] https://www.irccloud.com/pastebin/l4DxJY0t/ [22:24:06] Analytics-Kanban, Patch-For-Review: Prepare EL queue sizes for backfilling {oryx} [3 pts] - https://phabricator.wikimedia.org/T121384#1879326 (mforns) [22:31:20] Analytics-EventLogging, EventBus, Wikimedia-Logstash: eventlogging syslog message not properly recognized by logstash - https://phabricator.wikimedia.org/T120874#1879375 (hashar) The pattern seems to be `"<%{POSINT:priority}>%{SYSLOGLINE}"` with SYSLOGLINE being defined via: https://github.com/logst... [22:48:26] Analytics-Backlog, Analytics-EventLogging, MediaWiki-extensions-CentralNotice, Traffic, operations: Eventlogging should transparently split large event payloads - https://phabricator.wikimedia.org/T114078#1879425 (Tgr) Is there an alternative path towards making logging non-tiny amounts of data... [22:50:22] Analytics-Backlog, Analytics-EventLogging, MediaWiki-extensions-CentralNotice, Traffic, operations: Eventlogging should transparently split large event payloads - https://phabricator.wikimedia.org/T114078#1879426 (ori) I don't think it's a problem; excessively large event payloads are a misuse... [23:17:17] Analytics-Backlog, Analytics-EventLogging, MediaWiki-extensions-CentralNotice, Traffic, operations: Eventlogging should transparently split large event payloads - https://phabricator.wikimedia.org/T114078#1879499 (Tgr) "Excessively" seems to be currently defined as "more than 500 characters" (t...