[07:58:55] 10Analytics-Cluster, 10Analytics-Kanban, 10Patch-For-Review: Firewalls appear to be preventing spark executors from talking to spark driver on stat1005 - https://phabricator.wikimedia.org/T170496#3433298 (10MoritzMuehlenhoff) Instead of disabling base::firewall we should fix the root cause and configure Park... [09:09:11] 10Analytics-Tech-community-metrics, 10Developer-Relations (Jul-Sep 2017): Automatically sync mediawiki-identities/wikimedia-affiliations.json DB dump file with the data available on wikimedia.biterg.io - https://phabricator.wikimedia.org/T157898#3438589 (10Lcanasdiaz) Data is updated using @Aklapper SH databas... [09:39:21] 10Analytics-Cluster, 10Analytics-Kanban, 10Security, 10User-Addshore: Access rights for HDFS on stat100* for Sqoop tasks - https://phabricator.wikimedia.org/T170052#3438645 (10GoranSMilovanovic) @elukey Chaning to --target-dir /user/goransm (as suggested) doesn't work. An attempt to create a Hive table in... [09:42:46] 10Analytics, 10WMDE-Analytics-Engineering: Migrate WMDE campaign and WDCM analytics from stat1002, 1003 to stat1005, 1006 - https://phabricator.wikimedia.org/T170664#3438648 (10GoranSMilovanovic) [10:53:20] 10Analytics-Cluster, 10Analytics-Kanban, 10Security, 10User-Addshore: Access rights for HDFS on stat100* for Sqoop tasks - https://phabricator.wikimedia.org/T170052#3438872 (10GoranSMilovanovic) From the following sqoop command: sqoop import --connect jdbc:mysql://analytics-store.eqiad.wmnet/enwiki --pass... [11:00:15] 10Analytics-Cluster, 10Analytics-Kanban, 10Security, 10User-Addshore: Access rights for HDFS on stat100* for Sqoop tasks - https://phabricator.wikimedia.org/T170052#3438878 (10GoranSMilovanovic) Moreover, the usage of the --hive-overwrite argument is obsolete; once after the previous step was executed, att... [11:04:08] Please, if anyone is experienced with sqoop, contact me; I am facing serious difficulties with a simple task on stat1002 that is delaying my work on a large system under development for WMDE; in reference to: https://phabricator.wikimedia.org/T170052. Thank you very, very much. [11:46:26] 10Analytics-Kanban, 10User-Elukey: dbstore1002 /srv filling up - https://phabricator.wikimedia.org/T168303#3438933 (10Marostegui) This host reached this today: ``` Filesystem Type Size Used Avail Use% Mounted on /dev/mapper/tank-data xfs 6.3T 5.8T 477G 93% /srv ``` I have added 50G more... [11:52:00] 10Quarry: Slowdown of Quarry queries processing - https://phabricator.wikimedia.org/T168803#3438944 (10Mess) 05Open>03Resolved I solved the "issue": there wasn't a real slowdown actually, but a simple bad implementation of queries (see latest replies on https://www.mediawiki.org/wiki/Topic:Tt2l70vyi14eafza).... [12:08:17] 10Analytics-Kanban, 10User-Elukey: dbstore1002 /srv filling up - https://phabricator.wikimedia.org/T168303#3438962 (10Marostegui) From the last crash this host had (T170308) looks like there are two temporary files that were generated during the ALTER that were never cleaned up and are eating up 40GB in total:... [12:16:13] 10Analytics-Kanban, 10User-Elukey: dbstore1002 /srv filling up - https://phabricator.wikimedia.org/T168303#3438972 (10jcrespo) Actually, those are in use by: ``` Id: 3616956 ... db: log Command: Query Time: 6746 State: Queried about 106270000 rows Info: select id,uuid,userAgent,count(... [12:45:24] (03CR) 10Mforns: [V: 032 C: 032] "LGTM!" [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/364631 (https://phabricator.wikimedia.org/T170286) (owner: 10Nuria) [13:48:13] helloooo [13:50:14] 10Analytics-Cluster, 10Analytics-Kanban, 10Patch-For-Review: Firewalls appear to be preventing spark executors from talking to spark driver on stat1005 - https://phabricator.wikimedia.org/T170496#3439123 (10Ottomata) This isn't spark worker port. This is a CLI REPL launched by many users. Each user running... [14:32:17] 10Analytics-Kanban, 10Analytics-Wikistats: Define, Document (and test) Desktop and Mobile browser support for wikistats 2.0 - https://phabricator.wikimedia.org/T170457#3439201 (10mforns) Hey, after some cross-browser testing, here's the results: == Supported browsers Wikistats2 should support the following b... [14:33:44] mforns: yt? [14:33:50] yo! [14:33:55] batcave real quick? [14:33:58] hey ottomata :] [14:34:00] sure [14:57:12] 10Analytics-Kanban, 10Patch-For-Review: Add "desktop by browser" tab to browser reports - https://phabricator.wikimedia.org/T170286#3439312 (10Nuria) a:03Nuria [14:58:40] fdans: hola [14:59:28] omw! [15:21:39] mforns: nuria_ sorry my battery died [15:21:50] :] [15:27:31] oh no, no otto! :/ [15:32:04] 10Analytics-Cluster, 10Analytics-Kanban, 10WMDE-Analytics-Engineering, 10Patch-For-Review, 10User-Addshore: Move statistics::wmde jobs from stat1002 -> stat1005 - https://phabricator.wikimedia.org/T170472#3439400 (10Addshore) So it looks like all of the scripts seem to be working now in my testing, howev... [15:32:10] elukey around? :D [15:35:29] addshore: not either [15:35:48] okay! in that case I'll just remove time from the cron until next week :) [15:35:58] and then fully resolve it next week! [15:36:07] addshore: sounds good [16:04:20] mforns: wikiselector not working in chrome/safari for iOS [16:05:10] that's the only problem I see in iPhone [16:05:36] the search results aren't showing up [16:16:14] fdans, ok... that's also something to fix [16:16:18] will look at it! [16:25:33] mforns: I think reportupdater graphs are working, correct? https://analytics.wikimedia.org/datasets/periodic/reports/metrics/browser/ [16:39:13] nuria_, yes, looks good :] [16:46:55] it will take some time until both files are complete, but yea, seems it's working [17:03:29] mforns: ok, thank you [18:24:10] 10Analytics, 10Analytics-Wikistats, 10Wikimedia-Site-requests: Add kbpwiki and dinwiki to wikistats - https://phabricator.wikimedia.org/T170702#3439886 (10Urbanecm) [19:10:32] mforns: does the pageContentSavecomplete schema have an owner? (cc halfak in case he knows) [19:11:16] Hmm... not sure. I haven't looked at it in a long time. I had an old proposal to clean it up, but that didn't go anywhere. [19:11:40] https://etherpad.wikimedia.org/p/schema_edit [19:11:48] Oh. Looks like it was for Schema:Edit [20:56:59] 10Analytics, 10Analytics-Wikistats, 10Wikimedia-Site-requests: Add kbpwiki and dinwiki to wikistats - https://phabricator.wikimedia.org/T170702#3440344 (10Dzahn) @Urbanecm Please do not add Analytics-Wikistats to these kinds of tickets. That's not the same wikistats, it's not about Analytics or stats.wikimed... [21:07:15] halfak: ok, we will send e-mail and hopefully kill it [21:08:17] nuria_, one more though -- if there's a history of queries stored in analytics-store, it might be nice to see who has been querying it. [21:08:22] Oh wait. We're all "research" [21:08:24] nevermind. [21:09:48] halfak: ya, we will send a note to analytics@ and give people a month or more to respond plus look at gerrit to see original commits but in this case i think it was ori [21:10:34] gotcha [21:10:50] 10Analytics: Clean up PageContentSaveComplete event if there are no data users - https://phabricator.wikimedia.org/T170720#3440380 (10Nuria) [22:39:21] 10Analytics, 10Analytics-EventLogging, 10Community-Tech, 10Community-Tech-Sprint: Remove EventLogging for cookie blocks - https://phabricator.wikimedia.org/T166247#3440687 (10MaxSem) a:03MaxSem [22:54:23] (03PS1) 10Nuria: Add sunburst graph to "desktop by browser" tab [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/365415 (https://phabricator.wikimedia.org/T170286) [23:29:44] 10Analytics, 10Analytics-EventLogging, 10Community-Tech, 10Community-Tech-Sprint, 10Patch-For-Review: Remove EventLogging for cookie blocks - https://phabricator.wikimedia.org/T166247#3440784 (10kaldari) 05Open>03Resolved