[04:52:55] Analytics, Hovercards, Reading-Web-Sprint-71-m: Capture hovercards fetches as previews in analytics - https://phabricator.wikimedia.org/T129425#2197933 (phuedx) >>! In T129425#2196406, @GWicke wrote: > @phuedx, all accesses to RESTBase end points traverse text varnishes, which is where logging happen... [05:22:14] Analytics, Community-Tech-Tool-Labs, Developer-Relations, MediaWiki-API, and 4 others: Determine which Action API parameters to whitelist/blacklist for action_param_hourly aggregate table - https://phabricator.wikimedia.org/T132283#2197958 (bd808) >>! In T132283#2194878, @Anomie wrote: > I think... [05:55:23] Analytics-Tech-community-metrics, Developer-Relations (Apr-Jun-2016): Identify Wikimedia's most important/used info panels in korma.wmflabs.org - https://phabricator.wikimedia.org/T132421#2197987 (Aklapper) [06:00:24] Analytics-Tech-community-metrics, Differential, Developer-Relations (Apr-Jun-2016): Make MetricsGrimoire/korma support gathering Code Review statistics from Phabricator's Differential - https://phabricator.wikimedia.org/T118753#2198004 (Aklapper) As discussed in the meeting on 2016-04-08, the first s... [06:21:08] Analytics, DNS, Operations, Traffic: Create data.wikimedia.org - https://phabricator.wikimedia.org/T132407#2198010 (Peachey88) [06:21:17] Analytics, DNS, Operations, Traffic: Create data.wikimedia.org - https://phabricator.wikimedia.org/T132407#2197243 (Peachey88) Will it be a wiki? microsite? [06:35:46] (CR) Nikerabbit: [C: -1] "Per Kartik's inline comment." [analytics/limn-language-data] - https://gerrit.wikimedia.org/r/282228 (https://phabricator.wikimedia.org/T127283) (owner: Amire80) [07:14:27] Analytics, Operations: Upgrade stat1001 to Debian Jessie - https://phabricator.wikimedia.org/T76348#2198076 (elukey) a:Ottomata>elukey [07:14:53] Analytics-Kanban, Operations: Upgrade stat1001 to Debian Jessie - https://phabricator.wikimedia.org/T76348#798408 (elukey) [08:23:28] (PS1) Addshore: analyzer add more output when finding dumps [analytics/wmde/toolkit-analyzer] - https://gerrit.wikimedia.org/r/282867 [08:23:31] (PS1) Addshore: Switch final-name to toolkit-analyzer [analytics/wmde/toolkit-analyzer] - https://gerrit.wikimedia.org/r/282868 [08:24:53] (PS1) Addshore: New Biuld: Adds extra output when looking for dumps [analytics/wmde/toolkit-analyzer-build] - https://gerrit.wikimedia.org/r/282869 [08:25:12] (CR) Addshore: [C: 2 V: 2] New Biuld: Adds extra output when looking for dumps [analytics/wmde/toolkit-analyzer-build] - https://gerrit.wikimedia.org/r/282869 (owner: Addshore) [08:44:20] Analytics-Kanban, Operations: Upgrade stat1001 to Debian Jessie - https://phabricator.wikimedia.org/T76348#2198145 (elukey) @Dzahn: agreed! Moved the ticket to our "Next up" column and assigned to me, I believe it was something I should have done in the beginning as "training" :) I double checked and th... [09:01:17] (PS1) Addshore: Improve initial script output [analytics/wmde/toolkit-analyzer] - https://gerrit.wikimedia.org/r/282875 [09:32:21] Analytics, Operations, Traffic, Varnish: varnishstatsd crashes with ValueError in vsl_callback without being restarted by systemd - https://phabricator.wikimedia.org/T132430#2198273 (ema) [09:32:30] Analytics, Operations, Traffic, Varnish: varnishstatsd crashes with ValueError in vsl_callback without being restarted by systemd - https://phabricator.wikimedia.org/T132430#2198285 (ema) p:Triage>Normal [09:34:42] (PS2) Addshore: Get dumps from archive.org if we want [analytics/wmde/toolkit-analyzer] - https://gerrit.wikimedia.org/r/282731 [09:35:53] (PS2) Addshore: Improve initial script output [analytics/wmde/toolkit-analyzer] - https://gerrit.wikimedia.org/r/282875 [09:35:57] (PS3) Addshore: Get dumps from archive.org if we want [analytics/wmde/toolkit-analyzer] - https://gerrit.wikimedia.org/r/282731 [09:40:13] (PS4) Addshore: Get dumps from archive.org if we want [analytics/wmde/toolkit-analyzer] - https://gerrit.wikimedia.org/r/282731 [09:41:44] (PS1) Addshore: Enable archive.org & show better output [analytics/wmde/toolkit-analyzer-build] - https://gerrit.wikimedia.org/r/282882 [09:49:09] (PS1) Addshore: Actually set outputDir for processors [analytics/wmde/toolkit-analyzer] - https://gerrit.wikimedia.org/r/282884 [09:49:42] (PS1) Addshore: Actually set outputDir for processors [analytics/wmde/toolkit-analyzer-build] - https://gerrit.wikimedia.org/r/282885 [09:50:06] (CR) Addshore: [C: 2 V: 2] Enable archive.org & show better output [analytics/wmde/toolkit-analyzer-build] - https://gerrit.wikimedia.org/r/282882 (owner: Addshore) [09:50:14] (CR) Addshore: [C: 2 V: 2] Actually set outputDir for processors [analytics/wmde/toolkit-analyzer-build] - https://gerrit.wikimedia.org/r/282885 (owner: Addshore) [10:15:10] Analytics, Operations, Traffic, Varnish: varnishstatsd crashes with ValueError in vsl_callback without being restarted by systemd - https://phabricator.wikimedia.org/T132430#2198317 (ema) Another crash, this time on cp4017: Apr 12 07:30:32 cp4017 varnishstatsd[18631]: Traceback (most recent ca... [10:37:12] Analytics-Kanban, Operations, Traffic, Patch-For-Review: varnishkafka logrotate cronspam - https://phabricator.wikimedia.org/T129344#2198329 (elukey) ``` root@carbon:~# reprepro ls varnishkafka varnishkafka | 1.0.2-1 | precise-wikimedia | amd64, source varnishkafka | 1.0.6-1 | trusty-wikimedia |... [11:00:25] Analytics, Operations, Traffic, Varnish: varnishstatsd crashes with ValueError in vsl_callback without being restarted by systemd - https://phabricator.wikimedia.org/T132430#2198388 (BBlack) It looks like various crashes like these have been happening for a while, and puppet runs are what normall... [11:04:53] puppet runs on stat1003 are failing since three days: https://phabricator.wikimedia.org/P2885 [11:19:38] (CR) Addshore: [C: 2 V: 2] analyzer add more output when finding dumps [analytics/wmde/toolkit-analyzer] - https://gerrit.wikimedia.org/r/282867 (owner: Addshore) [11:19:41] (CR) Addshore: [C: 2 V: 2] Switch final-name to toolkit-analyzer [analytics/wmde/toolkit-analyzer] - https://gerrit.wikimedia.org/r/282868 (owner: Addshore) [11:19:44] (CR) Addshore: [C: 2 V: 2] Improve initial script output [analytics/wmde/toolkit-analyzer] - https://gerrit.wikimedia.org/r/282875 (owner: Addshore) [11:19:47] (CR) Addshore: [C: 2 V: 2] Get dumps from archive.org if we want [analytics/wmde/toolkit-analyzer] - https://gerrit.wikimedia.org/r/282731 (owner: Addshore) [11:19:50] (CR) Addshore: [C: 2 V: 2] Actually set outputDir for processors [analytics/wmde/toolkit-analyzer] - https://gerrit.wikimedia.org/r/282884 (owner: Addshore) [11:24:19] moritzm: got it, checking! [11:25:02] I would have thought to get alarms in ops [11:27:45] ahh snap! CPU9: Package temperature above threshold, cpu clock throttled (total events = 235728381) [11:28:25] Processor 9 heated above trip temperature. Throttling enabled. [11:33:12] we *really* need the new hosts [11:33:55] (PS1) Addshore: Remove legacy html stuff & fix dir structure [analytics/wmde/toolkit-analyzer] - https://gerrit.wikimedia.org/r/282903 [11:34:36] (CR) Addshore: [C: 2 V: 2] Remove legacy html stuff & fix dir structure [analytics/wmde/toolkit-analyzer] - https://gerrit.wikimedia.org/r/282903 (owner: Addshore) [11:34:56] joal: you there? [11:35:03] Yup [11:35:05] Wassup? [11:35:05] o/ [11:35:09] Hiiiiii ! [11:35:16] hellooooo [11:35:35] so stat1003 is overheated (poor machine) and also failing puppet https://phabricator.wikimedia.org/P2885 [11:35:49] namely [11:35:50] Notice: /Stage[main]/Geowiki::Job::Limn/Git::Clone[geowiki-data-public]/Exec[git_pull_geowiki-data-public]/returns: Permission denied (publickey). [11:35:52] Arrrf [11:36:15] elukey: I can't help on that one, I've never played with Limn [11:36:44] the first rule of the Analytics team is to avoid talking about Limn [11:37:33] elukey: :D [11:38:28] Analytics, Community-Tech-Tool-Labs, Developer-Relations, MediaWiki-API, and 4 others: Determine which Action API parameters to whitelist/blacklist for action_param_hourly aggregate table - https://phabricator.wikimedia.org/T132283#2198435 (Addshore) I can't immediately think of anything for Wiki... [11:50:24] mmmm also commits stopped 5 days ago https://github.com/wikimedia/analytics-geowiki-data-public/commits/master after ottomata changed the LDAP email [11:58:23] Analytics-Tech-community-metrics, Differential, Developer-Relations (Apr-Jun-2016): Make MetricsGrimoire/korma support gathering Code Review statistics from Phabricator's Differential - https://phabricator.wikimedia.org/T118753#2198466 (Qgil) >>! In T118753#2099132, @Qgil wrote: > @Lcanasdiaz could y... [12:03:09] Analytics-Tech-community-metrics, Developer-Relations (Apr-Jun-2016): Identify Wikimedia's most important/used info panels in korma.wmflabs.org - https://phabricator.wikimedia.org/T132421#2198475 (Qgil) Yes, I think this is a very important task. Korma has been growing organically during years, our prior... [12:22:15] I think I'd need milimetric to solve the mistery :) [12:22:35] elukey: you might, I'll be of no help for sure [12:25:26] * elukey hugs joal for the support [12:25:34] :) [12:25:39] * joal loves hughs :) [12:41:01] Analytics, Operations, Traffic, Varnish: varnishstatsd crashes with ValueError in vsl_callback without being restarted by systemd - https://phabricator.wikimedia.org/T132430#2198613 (elukey) The errors seems to be related to two tags: ``` 110 elif tag == 'BackendXID': 111 # Associate... [12:55:40] Analytics, Operations, Traffic, Varnish: varnishstatsd crashes with ValueError in vsl_callback without being restarted by systemd - https://phabricator.wikimedia.org/T132430#2198669 (elukey) ``` /usr/local/lib/python2.7/dist-packages/varnishlog.py 100 def _vsl_handler(priv, tag_id, fd, lengt... [13:13:56] Analytics-Tech-community-metrics, Developer-Relations (Apr-Jun-2016), developer-notice: Check whether it is true that we have lost 40% of (Git) code contributors in the past 12 months - https://phabricator.wikimedia.org/T103292#2198694 (Qgil) To me it is a good resolution of this task to conclude tha... [13:27:13] Analytics-Kanban: Puppet on stat1003 keeps failing for git errors - https://phabricator.wikimedia.org/T132445#2198763 (elukey) [13:28:58] Analytics-Kanban: Puppet on stat1003 keeps failing for git errors - https://phabricator.wikimedia.org/T132445#2198763 (MoritzMuehlenhoff) > Last but not the least, I am seeing a lot of CPU temperature alarms on this machine (that is running hot since days ago). You should open an ops-eqiad ticket to have th... [13:31:40] * joal is AFK for a bit [13:32:10] milimetric: aloha! Whenever you are online, let's talk about https://phabricator.wikimedia.org/T132445 [13:33:57] I'm making some breakfast and reading it [13:34:51] hellloooo [13:35:00] no hurry, you can read it even after standup [13:44:13] Analytics, DNS, Operations, Traffic: Create data.wikimedia.org - https://phabricator.wikimedia.org/T132407#2198830 (MZMcBride) >>! In T132407#2198012, @Peachey88 wrote: > Will it be a wiki? microsite? redirect to a page on meta? It sounds like this is more of a request for a server to host/run t... [13:53:56] Analytics, Operations, Traffic, Varnish: varnishstatsd crashes with ValueError in vsl_callback without being restarted by systemd - https://phabricator.wikimedia.org/T132430#2198859 (ema) >>! In T132430#2198388, @BBlack wrote: > 1. Fix the crashes Yep. > 2. systemd should restart it unless it's... [14:02:27] Analytics-Kanban: Puppet on stat1003 keeps failing for git errors - https://phabricator.wikimedia.org/T132445#2198875 (Milimetric) I think you're right, @elukey. Right now the remote it's trying to pull from is configured as `ssh://gerrit.wikimedia.org:29418/analytics/geowiki/data-public.git` which I didn't... [14:06:13] Analytics-Kanban: Puppet on stat1003 keeps failing for git errors - https://phabricator.wikimedia.org/T132445#2198880 (elukey) @Milimetric I think that it is running with the "stat" username: ``` git::clone { 'geowiki-data-public': ensure => 'latest', directory => $::geowiki::params::... [14:08:27] oh yeah, elukey, and that hasn't changed for a while [14:08:42] so then I don't understand, it's clearly not working when I do it manually with sudo -u stats [14:12:33] Analytics, DNS, Operations, Traffic: Create data.wikimedia.org - https://phabricator.wikimedia.org/T132407#2197243 (Milimetric) There's some debate about this. We haven't used data.wikimedia.org in the past because of the possible confusion with wikidata. The wmflabs domain seems less "producti... [14:24:06] Analytics-Kanban: Puppet on stat1003 keeps failing for git errors - https://phabricator.wikimedia.org/T132445#2198923 (elukey) Didn't find any change in the private git repo, puppet class and gerrit.. [14:29:03] milimetric: it is really weird, I thought something changed in gerrit but can't find a lot [14:29:37] * elukey tries to concentrate to ask the force to contact ottomata [14:40:47] Analytics-Kanban, Operations: Upgrade stat1001 to Debian Jessie - https://phabricator.wikimedia.org/T76348#2198968 (Dzahn) >>! In T76348#2198145, @elukey wrote: > the only thing that worries me a bit are all the /home directories with stuff in them, that probably will need to be backupped somewhere befor... [14:49:37] Analytics-Kanban, Operations: Upgrade stat1001 to Debian Jessie - https://phabricator.wikimedia.org/T76348#2198981 (elukey) @Dzahn another solution (more a hack) is to open a port / disable ferm for a bit (/me hides from @MoritzMuehlenhoff) and use netcat/openssl to copy files between hosts. [14:56:57] brb coffee :) [14:58:06] Analytics, Operations, Traffic, Varnish: varnishstatsd crashes with ValueError in vsl_callback without being restarted by systemd - https://phabricator.wikimedia.org/T132430#2199012 (ema) varnishstatsd has now crashed on cp4009, cp4017 and cp4018. For some reason it only seems to be crashing in u... [15:28:03] Analytics: Pageview API alarms - https://phabricator.wikimedia.org/T132456#2199129 (Nuria) [15:30:11] ---^ nuria +1, thanks! [15:32:17] Analytics, DNS, Operations, Traffic: Create data.wikimedia.org - https://phabricator.wikimedia.org/T132407#2199157 (Nuria) >It sounds like this is more of a request for a server to host/run tools than a request for just a DNS A record. I'm curious why Wikimedia Labs is insufficient. Being a prod... [15:39:54] Analytics-Kanban: Puppet on stat1003 keeps failing for git errors - https://phabricator.wikimedia.org/T132445#2199179 (elukey) ``` elukey@terbium:~$ ldaplist -l passwd stats ``` Shows two public keys, might be the ones used to authenticate on gerrit.. [15:43:08] milimetric: do you know by any chance how to check stats' public key on gerrit? [15:43:45] https://gerrit.wikimedia.org/r/#/admin/groups/uuid-a89e365b66e1bf7c442e7a32bb18887658b0d198,members [15:47:13] (CR) Mforns: [C: 2 V: 2] "Self-merging small fix." [analytics/reportupdater] - https://gerrit.wikimedia.org/r/282712 (https://phabricator.wikimedia.org/T131849) (owner: Mforns) [15:52:16] Analytics-Kanban: Add JJB support for Jenkins Maven Release Plugin {hawk} - https://phabricator.wikimedia.org/T132175#2199326 (madhuvishy) [15:58:50] ah the password is in pwstore \o/ [16:02:14] Analytics-Kanban: Puppet on stat1003 keeps failing for git errors - https://phabricator.wikimedia.org/T132445#2199375 (elukey) The Stats gerrit password is in pwstore, comparing the one used on stats1003 with the one registered. [16:07:15] Analytics-Kanban: Puppet on stat1003 keeps failing for git errors - https://phabricator.wikimedia.org/T132445#2199402 (elukey) a:elukey [16:08:58] Analytics-Kanban, Datasets-General-or-Unknown: cassandra backfill monitoring {slug} - https://phabricator.wikimedia.org/T115360#2199410 (Milimetric) a:JAllemandou [16:10:05] Analytics-Kanban: Make legends on graphs better and more generic - https://phabricator.wikimedia.org/T129497#2107463 (Milimetric) Open>declined A more complicated change that could be needed later, but for now not necessary. [16:12:01] Analytics-Kanban: limn-multimedia-data queries raising SQL syntax errors - https://phabricator.wikimedia.org/T132404#2199442 (Milimetric) +1 to the file solution. @MarkTraceur wanna weigh in here? [16:14:01] Analytics-Kanban: Puppet on stat1003 keeps failing for git errors - https://phabricator.wikimedia.org/T132445#2199453 (Milimetric) p:Triage>Unbreak! [16:14:14] Analytics-Kanban: limn-multimedia-data queries raising SQL syntax errors - https://phabricator.wikimedia.org/T132404#2199456 (Milimetric) p:Triage>Normal [16:14:33] Analytics-Kanban, Patch-For-Review: Fix limn-mobile-data mobile-options-last-3-months report after RU changes {lama} - https://phabricator.wikimedia.org/T131849#2199457 (Milimetric) p:Triage>Normal [16:17:17] * MarkTraceur gets pinged [16:18:11] Analytics-Kanban, Operations, Traffic, Patch-For-Review: varnishkafka logrotate cronspam - https://phabricator.wikimedia.org/T129344#2199461 (Milimetric) p:Triage>Normal [16:18:17] Analytics-Kanban, Operations, ops-eqiad: Analytics1039 host showed high temperature alarms - https://phabricator.wikimedia.org/T132256#2199462 (Milimetric) p:Triage>Normal [16:18:25] Analytics-Kanban: Put quaterly review together for Q3 - https://phabricator.wikimedia.org/T131947#2199463 (Milimetric) p:Triage>High [16:18:34] Analytics-Kanban: Research and validate assumptions for pageview sanitization with Research Team {mole} - https://phabricator.wikimedia.org/T120640#2199465 (Milimetric) p:Triage>Normal [16:18:42] Analytics-Kanban, Patch-For-Review: Allow filtering of data breakdowns in pageview metric - https://phabricator.wikimedia.org/T131547#2199466 (Milimetric) p:Triage>Normal [16:18:48] Analytics-Kanban: Update reportupdater's documentation - https://phabricator.wikimedia.org/T132326#2199467 (Milimetric) p:Triage>Normal [16:21:32] Analytics-Kanban: limn-multimedia-data queries raising SQL syntax errors - https://phabricator.wikimedia.org/T132404#2199474 (MarkTraceur) Uhh, well In the grander scheme of things, and maybe you can explain this to me in the context of 1. how it used to be and 2. how it changed, what is "wiki" supposed to... [16:28:34] a-team: are you gys done with standup? [16:28:38] *guys [16:28:43] Analytics-Kanban, Operations, Patch-For-Review: Upgrade stat1001 to Debian Jessie - https://phabricator.wikimedia.org/T76348#2199488 (Milimetric) Ok, there are two places I know have important files on stat1001. 1. The files served at datasets.wikimedia.org/ These are stored in three places, one... [16:28:58] hi nuria_ yes [16:29:02] k [16:32:39] Analytics-Kanban: Update reportupdater's documentation - https://phabricator.wikimedia.org/T132326#2194510 (Milimetric) nice, +2 Regarding this TODO: "* Make reportupdater output empty values, when the queries return no results. Today reportupdater outputs no results for that date, too; and this makes repor... [16:33:06] 18:32 RECOVERY - puppet last run on stat1003 is OK: OK: Puppet is currently enabled, last run 53 seconds ago with 0 failures [16:33:10] \o/ \o/ [16:33:26] milimetric: --^ [16:33:40] huh?! [16:33:53] you magic or random magic, elukey? [16:34:14] milimetric: elukey IS magic ! [16:34:24] no I know [16:34:31] I'm just not sure which magic happened here [16:34:59] joal: don't say absurd things :P [16:35:14] * joal stands his ground ! [16:35:25] milimetric: I added the ssh key that stats was using to gerrit using the password on pwstore [16:35:27] :-P [16:35:32] (where ops keeps the passwords) [16:35:38] (andrew stored the stats one in there) [16:35:39] elukey: yea, the secret repo [16:35:42] Analytics-Kanban, Wikipedia-iOS-App-Product-Backlog, iOS-app-feature-Analytics, Patch-For-Review, and 2 others: Invalid pageview data for iOS app - https://phabricator.wikimedia.org/T131824#2179692 (Fjalapeno) This can be verified by checking the headers using Charles proxy @JMinor do we want TS... [16:35:44] ooh, gotcha [16:36:04] elukey: now I remember they hacked it that way when they first set it up [16:36:06] cool [16:36:08] thx [16:36:21] it is still a bit obscure to me why the ssh key is under /var/lib/stats [16:36:26] but I'll ask to ottomata [16:36:38] now the thing should push stuff too theoretically [16:36:59] we'll check https://github.com/wikimedia/analytics-geowiki-data-public/commits/master [16:38:53] elukey: if it's been erroring, it might be that it has to catch up a lot, so no worries if you don't see a push for a day or so [16:39:25] * milimetric gonna grab some lunch [16:39:37] milimetric: all right! [16:39:49] Analytics-Kanban: Puppet on stat1003 keeps failing for git errors - https://phabricator.wikimedia.org/T132445#2199567 (elukey) Added the /var/lib/stats/.ssh to the Stats user in gerrit, puppet runs fine now! @Ottomata: can you double check that everything is correct? [16:40:41] gooood now I am relieved, going offline team! [16:43:13] byyyeeee o/ [16:54:14] Analytics-Kanban, Operations, Patch-For-Review: Upgrade stat1001 to Debian Jessie - https://phabricator.wikimedia.org/T76348#2199628 (Dzahn) >>! In T76348#2198981, @elukey wrote: > @Dzahn another solution (more a hack) is to open a port / disable ferm for a bit (/me hides from @MoritzMuehlenhoff) and... [16:56:34] wikimedia/mediawiki-extensions-EventLogging#549 (wmf/1.27-wmf.21 - 109bb7d : Chad Horohoe): The build has errored. [16:56:35] Change view : https://github.com/wikimedia/mediawiki-extensions-EventLogging/commit/109bb7d8caa3 [16:56:35] Build details : https://travis-ci.org/wikimedia/mediawiki-extensions-EventLogging/builds/122568351 [17:01:08] Analytics-Kanban, Operations, Patch-For-Review: Upgrade stat1001 to Debian Jessie - https://phabricator.wikimedia.org/T76348#2199650 (Dzahn) >>! In T76348#2199488, @Milimetric wrote: > 1. The files served at datasets.wikimedia.org/ These are stored in three places, one is in /var/www and the other... [17:08:04] Analytics: Making geowiki data public - https://phabricator.wikimedia.org/T131280#2199667 (Nuria) Notes from meeting on 2016/04/12. Attending: Dan, Asaf, Neil and Nuria We focused on use cases for this data and there are the main ones: 1. Emerging communities team needs knowledge of editors per country as... [17:22:07] Analytics, Operations, Traffic, Varnish: varnishmedia: repeated calls to flush_stats() - https://phabricator.wikimedia.org/T132474#2199721 (ema) [17:22:49] Analytics, Operations, Traffic, Varnish: varnishmedia: repeated calls to flush_stats() - https://phabricator.wikimedia.org/T132474#2199749 (ema) p:Triage>Normal [17:32:27] wikimedia/mediawiki-extensions-EventLogging#550 (wmf/1.27.0-wmf.21 - 5ec2f77 : Chad Horohoe): The build has errored. [17:32:27] Change view : https://github.com/wikimedia/mediawiki-extensions-EventLogging/commit/5ec2f77acbf1 [17:32:27] Build details : https://travis-ci.org/wikimedia/mediawiki-extensions-EventLogging/builds/122576397 [17:42:47] Analytics-Kanban: Update reportupdater's documentation - https://phabricator.wikimedia.org/T132326#2199793 (mforns) Thanks for the review @Milimetric! Yes, a task already exists, it's T117537. I'll move it to backlog->prioritized. [18:01:53] Analytics-Cluster, Operations, Traffic, HTTPS: HTTPS redirects for stats.wikimedia.org - https://phabricator.wikimedia.org/T132465#2199877 (Dzahn) [18:01:57] Analytics, Operations, Traffic: cronspam from cpXXXX hosts related to varnishkafka non existent processes - https://phabricator.wikimedia.org/T132346#2199879 (ema) p:Triage>Normal [18:04:50] Analytics-Kanban: limn-multimedia-data queries raising SQL syntax errors - https://phabricator.wikimedia.org/T132404#2199900 (mforns) @Milimetric @MarkTraceur Nothing did change. It was like this since the beginning: Using the `by_wiki` option implies that reportupdater will try to create reports for every... [18:06:22] Analytics-Kanban: limn-multimedia-data queries raising SQL syntax errors - https://phabricator.wikimedia.org/T132404#2199901 (MarkTraceur) OK, I'll take the file solution, then. Thanks @mforns for the information, and @milimetric for pinging me :) [18:07:22] Analytics-Kanban: limn-multimedia-data queries raising SQL syntax errors - https://phabricator.wikimedia.org/T132404#2199902 (mforns) Thanks @MarkTraceur for your feedback. I'll create a task for that. [18:13:08] * joal is off for diner ! [18:13:19] * joal waves goodnight to a-team [18:13:27] good night joal :] [18:13:51] Analytics: Make reportupdater support passing the values of an explode_by using a file path - https://phabricator.wikimedia.org/T132481#2199910 (mforns) [18:14:11] Analytics-Kanban: limn-multimedia-data queries raising SQL syntax errors - https://phabricator.wikimedia.org/T132404#2199923 (mforns) Here it is: T132481 [18:41:33] Analytics-Kanban, Wikipedia-iOS-App-Product-Backlog, iOS-app-feature-Analytics, Patch-For-Review, and 2 others: Invalid pageview data for iOS app - https://phabricator.wikimedia.org/T131824#2179692 (MBinder_WMF) This task is shared across multiple teams (iOS, Analytics), but has a point value. It... [18:47:36] mforns: can you take a look at quaterly review slides thus far? https://docs.google.com/presentation/d/1hhOeNKAVzFD23iVKCLYV5br9miGLrqWE6WenMS9EHHY/edit#slide=id.g1294076b72_0_170 [18:47:54] nuria_, sure [19:06:31] Analytics-Tech-community-metrics, Developer-Relations (Apr-Jun-2016): Create basic/high-level Kabana (dashboard) documentation - https://phabricator.wikimedia.org/T132323#2194419 (Qgil) One of the advantages of using Kibana is the fact that user documentation already exists? https://www.elastic.co/webin... [19:06:50] Analytics-Tech-community-metrics, Developer-Relations (Apr-Jun-2016): Create basic/high-level Kibana (dashboard) documentation - https://phabricator.wikimedia.org/T132323#2200234 (ori) [19:58:04] Analytics-Kanban, Wikipedia-iOS-App-Product-Backlog, iOS-app-feature-Analytics, Patch-For-Review, and 2 others: Invalid pageview data for iOS app - https://phabricator.wikimedia.org/T131824#2200635 (JMinor) @Fjalapeno I'm going to work with TSG on accessibility testing. Adding Charles testing on... [21:42:45] Analytics-Tech-community-metrics, Developer-Relations (Apr-Jun-2016), developer-notice: Check whether it is true that we have lost 40% of (Git) code contributors in the past 12 months - https://phabricator.wikimedia.org/T103292#2201145 (saper) Maybe instead of strategy and the annual plan we should j... [21:46:43] Analytics-Tech-community-metrics, Developer-Relations (Apr-Jun-2016), developer-notice: Check whether it is true that we have lost 40% of (Git) code contributors in the past 12 months - https://phabricator.wikimedia.org/T103292#2201188 (ori) Amen, @saper. Amen. [22:12:42] Analytics-Tech-community-metrics, Developer-Relations (Apr-Jun-2016), developer-notice: Check whether it is true that we have lost 40% of (Git) code contributors in the past 12 months - https://phabricator.wikimedia.org/T103292#2201373 (Qgil) Sorry for being so boring. :) Before the Amen though, ho... [22:38:40] i'm trying out beeline (again), but getting an error msg: [22:38:56] https://www.irccloud.com/pastebin/n1DihZvg/ [22:39:29] anyone know the reason? is this the right parameter? [22:41:06] .. https://wikitech.wikimedia.org/wiki/Analytics/Cluster/Ports seems to say that 10000 is the correct port [22:52:29] madhuvishy: ^ (i also tried values gleaned from your patch yesterday at https://phabricator.wikimedia.org/T116123#2195204 : [22:52:50] tbayer@stat1002:~$ beeline -u jdbc:hive2://analytics1015.eqiad.wmnet:1000 -n tbayer [22:52:54] ...same issue [22:53:21] HaeB: checking [22:53:50] HaeB: beeline -u jdbc:hive2://analytics1015.eqiad.wmnet:10000 [22:53:57] you pasted 1000 here [22:54:03] was that what you tried? [22:54:58] HaeB: analytics1015 and 10000 are correct. Hopefully when my patch is merged we should not have this trouble [22:55:28] i tried 1000. trying 10000 now.. [22:56:09] HaeB: oh my patch has a mistake - fixing [22:56:16] i put 1000 there - my bad [22:56:21] yes i got 1000 from https://gerrit.wikimedia.org/r/#/c/282713/1/hieradata/eqiad/cdh/hive.yaml [22:56:33] yup i see that [22:56:41] connected! \o/ [22:57:27] HaeB: great! [23:03:39] (PS1) Mforns: Fix bug in get_date_threshold [analytics/reportupdater] - https://gerrit.wikimedia.org/r/283101 (https://phabricator.wikimedia.org/T131849) [23:05:10] a-team, I forgot to remind you that tomorrow I'll be off (Emma's birthday), will send an email [23:05:18] see you on thursday!