[00:38:34] 10Analytics, 10Pageviews-Anomaly: Topviews Analysis of the Hungarian Wikipedia is flooded with spam - https://phabricator.wikimedia.org/T237282 (10MusikAnimal) Removing #tool-pageviews as this is an issue with the underlying data, not the tool itself. [02:21:05] (03PS2) 10Nuria: [WIP] Classification of actors for bot detection [analytics/refinery] - 10https://gerrit.wikimedia.org/r/562368 [07:00:28] milimetric: please ping me when you log in so we can chat about the kinit issue :) [07:49:16] 10Analytics: Purchase of GPUs to help support the open source software stack on top of AMD GPUs (donation to Debian) - https://phabricator.wikimedia.org/T241192 (10elukey) @faidon @MoritzMuehlenhoff hi :) How should we proceed? [07:49:36] 10Analytics: Refresh stat1004 with a new host and GPU - https://phabricator.wikimedia.org/T241187 (10elukey) [07:51:45] 10Analytics: Refresh stat1004 with a new host and GPU - https://phabricator.wikimedia.org/T241187 (10elukey) This is currently being discussed in T238587, when we'll have a final procurement task I'll add more info. [08:23:21] 10Analytics, 10Analytics-Kanban, 10User-Elukey: New Hadoop hardware. Refreshes and hosts with space for GPUs - https://phabricator.wikimedia.org/T241190 (10elukey) @Nuria I added some comments to T238587#5800760, please let me know if it makes sense or not. [08:28:24] 10Analytics, 10User-Elukey: Deprecation (if possible) of the #central channel on irc.wikimedia.org - https://phabricator.wikimedia.org/T242712 (10elukey) [08:28:40] 10Analytics, 10Tool-stewardbots, 10User-Elukey: Deprecation (if possible) of the #central channel on irc.wikimedia.org - https://phabricator.wikimedia.org/T242712 (10elukey) [08:28:52] 10Analytics, 10Event-Platform, 10User-Elukey: Event Stream's stream to replace irc.wikimedia.org's #central channel feed - https://phabricator.wikimedia.org/T240182 (10elukey) Created T242712 [08:43:07] brb [09:09:56] (03CR) 10Fdans: Add vue-i18n integration, English strings (031 comment) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/558702 (https://phabricator.wikimedia.org/T240617) (owner: 10Fdans) [09:10:49] 10Analytics, 10Analytics-Kanban, 10Analytics-Wikistats, 10Patch-For-Review: Create English strings json for vue-i18n to use - https://phabricator.wikimedia.org/T240617 (10fdans) [09:29:06] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Enable encryption in Spark 2.4 by default - https://phabricator.wikimedia.org/T240934 (10elukey) Today I can't repro anymore, pyspark --master yarn + spark-submit all work fine.. Could it be some weird capacity issue with dynamic allocation that happens in... [10:39:59] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Enable encryption in Spark 2.4 by default - https://phabricator.wikimedia.org/T240934 (10elukey) Comparing logs of the same application id, with one container successfully registering to the AM and the other one not (causing the failure): ` 20/01/14 09:45... [11:04:27] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Enable encryption in Spark 2.4 by default - https://phabricator.wikimedia.org/T240934 (10elukey) Example of app logs without the option set: ` elukey@an-tool1006:~$ yarn logs -applicationId application_1576771377404_19628 | grep -A 2 "Registering the Appl... [11:07:43] ok enough spark encryption today, very long rabbit hole :D [11:31:42] * elukey lunch! [12:44:29] 10Analytics, 10User-Elukey: No queries run in Hue - https://phabricator.wikimedia.org/T242306 (10elukey) I have restarted yesterday Hue to add (again) some hive query limits to avoid out of memory issues, let me know if the error re-appears. [13:48:53] (03CR) 10Milimetric: "a couple of the comments are meant for the whole change, like using single quotes" (0311 comments) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/558702 (https://phabricator.wikimedia.org/T240617) (owner: 10Fdans) [13:54:46] elukey: the docs on testing AQS seem to have given up on testing on staging: https://wikitech.wikimedia.org/wiki/Analytics/Systems/AQS#Deployment [13:56:00] should I really set up cassandra and zookeeper locally or is there a better way [13:56:35] milimetric: we have a cluster in deployment-prep [13:56:42] not sure who wrote to test only locally [13:57:10] :) ok, so I'll add instructions for testing on deployment-prep then [13:57:35] I can help, hopefully cassandra is running in there [13:57:36] lemme check [13:57:56] should be deployment-aqs01.eqiad.wmflabs deployment-aqs02.eqiad.wmflabs deployment-aqs03.eqiad.wmflabs [13:58:28] yep cassandra and aqs looks up [13:58:35] no idea what version they are running though [13:59:55] oh, I see, this is a note from the old docs: "Note2: Even if you're deploying to staging (beta), the code you want to deploy should be merged to master. Otherwise, the whole deployment process won't work." [14:00:21] makes sense, with the whole aqs-deploy setup [14:00:29] hm... is there some way around that... [14:01:36] I guess we could commit config for deployment-prep into aqs and run with that to test [14:02:01] meh, I'm just gonna merge this and test and if it breaks I'll undo... it's 99% gonna just work [14:03:00] yes I agree [14:03:41] (03PS2) 10Milimetric: Update service-runner version [analytics/aqs] - 10https://gerrit.wikimedia.org/r/562078 (https://phabricator.wikimedia.org/T236757) [14:03:47] (03CR) 10Milimetric: [V: 03+2 C: 03+2] Update service-runner version [analytics/aqs] - 10https://gerrit.wikimedia.org/r/562078 (https://phabricator.wikimedia.org/T236757) (owner: 10Milimetric) [14:08:05] (03PS1) 10Milimetric: Update aqs to f7add11 [analytics/aqs/deploy] - 10https://gerrit.wikimedia.org/r/564681 [14:08:47] (03CR) 10Milimetric: [V: 03+2 C: 03+2] Update aqs to f7add11 [analytics/aqs/deploy] - 10https://gerrit.wikimedia.org/r/564681 (owner: 10Milimetric) [14:23:33] ottomata: o/ I have done some homework and added some questions to the newpyter doc, we can go through it in bc if you want later on [14:23:39] (coffee, brb) [14:24:06] awesome, ya am checking email then let's get into it [14:34:27] see Luca, all you had to do to get in touch about superset/presto was to **post a screenshot of superset on enwiki**!!!!@?@? And you were foolishly trying to use crazy avenues like tasks and mailing lists. Lesson learned [14:35:03] milimetric: INDEED [14:39:22] elukey: bc? [14:39:25] actually, gimme 5 [14:39:26] then bc [14:40:16] milimetric: I exercise my fifth amendment right [14:40:28] ottomata: sure! [14:40:31] ping me when ready [14:42:13] 10Analytics: Removed not used CDH packages from Hadoop nodes - https://phabricator.wikimedia.org/T242754 (10elukey) [14:42:51] lol [14:43:24] elukey: here! [14:43:43] 10Analytics: Removed not used CDH packages from Hadoop nodes - https://phabricator.wikimedia.org/T242754 (10elukey) ` elukey@an-worker1080:~$ dpkg -l | grep cdh ii avro-libs 1.7.6+cdh5.16.1+143-1.cdh5.16.1.p0.3~jessie-cdh5.16.1 all Data serialization system ii bigtop-jsvc... [14:44:30] milimetric: don't understand this: [14:44:30] https://gerrit.wikimedia.org/r/#/c/analytics/wikistats2/+/558702/7/src/components/detail/DetailSidebar.vue@44 [14:44:59] ah you wanna use ternary [14:45:12] yeah sorry [14:46:31] milimetric: at the wmf we cherish our differences [14:47:30] I’m totally ok with the way you had it [14:48:09] I wish gerrit had a “strength of opinion” on the comment, that one would be set to meh [14:54:18] 10Analytics, 10Analytics-Kanban, 10service-runner, 10Patch-For-Review, 10User-Elukey: Upgrade service-runner on AQS to unblock rsyslog logging - https://phabricator.wikimedia.org/T236757 (10Milimetric) ok deployed and tested in deployment-prep, all good, ready for deploy to prod. [14:56:07] milimetric: regarding the 3 general changes... I agree with them but also the perspective of scanning the 21 vue files to apply them fills me with sorrow [14:56:36] fdans: I'm happy to do them, no problem [14:56:53] milimetric: thanks [14:57:24] fdans: let me know when I can jump in and do that [15:02:32] (03PS8) 10Fdans: Add vue-i18n integration, English strings [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/558702 (https://phabricator.wikimedia.org/T240617) [15:02:45] milimetric: just pushed the corrections you suggested, you can do it if you want [15:02:58] I'll post more changes for the bundling, but I'm still on that [15:06:39] 10Analytics, 10Product-Analytics (Kanban): Add Kerberos authentication to Product Analytics Oozie jobs - https://phabricator.wikimedia.org/T241092 (10Neil_P._Quinn_WMF) [15:07:12] 10Analytics, 10Product-Analytics: Add Kerberos authentication to Product Analytics Oozie jobs - https://phabricator.wikimedia.org/T241092 (10Neil_P._Quinn_WMF) [15:07:40] 10Analytics, 10Product-Analytics: Add Kerberos authentication to Product Analytics Oozie jobs - https://phabricator.wikimedia.org/T241092 (10Neil_P._Quinn_WMF) Moving to Epics since I have a separate task for the Toledo coordinator on the Kanban board. [15:32:29] 10Quarry, 10Cloud-Services, 10Security-Team, 10Security: Trivial Quarry XSS: Tabular data CSV / TSV are not escaped and sent as text/html - https://phabricator.wikimedia.org/T242355 (10sbassett) p:05High→03Normal [15:35:11] (03PS1) 10SBassett: SECURITY: Update mime and content types downloads [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/564707 (https://phabricator.wikimedia.org/T242355) [15:36:36] (03CR) 10Zhuyifei1999: [C: 03+2] SECURITY: Update mime and content types downloads [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/564707 (https://phabricator.wikimedia.org/T242355) (owner: 10SBassett) [15:36:57] (03Merged) 10jenkins-bot: SECURITY: Update mime and content types downloads [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/564707 (https://phabricator.wikimedia.org/T242355) (owner: 10SBassett) [15:39:05] 10Quarry, 10Cloud-Services, 10Security-Team, 10Security: Trivial Quarry XSS: Tabular data CSV / TSV are not escaped and sent as text/html - https://phabricator.wikimedia.org/T242355 (10sbassett) 05Open→03Resolved a:03sbassett [15:40:17] 10Quarry, 10Cloud-Services, 10Security-Team, 10Security, 10Vuln-XSS: Trivial Quarry XSS: Tabular data CSV / TSV are not escaped and sent as text/html - https://phabricator.wikimedia.org/T242355 (10sbassett) [15:40:20] 10Quarry, 10Cloud-Services, 10Security-Team, 10Security, 10Vuln-XSS: Trivial Quarry XSS: Tabular data CSV / TSV are not escaped and sent as text/html - https://phabricator.wikimedia.org/T242355 (10zhuyifei1999) @sbassett Thanks ;) I'm wondering, since I've never requested CVEs before, what is the standar... [15:47:51] 10Quarry, 10Cloud-Services, 10Security-Team, 10Security, 10Vuln-XSS: Trivial Quarry XSS: Tabular data CSV / TSV are not escaped and sent as text/html - https://phabricator.wikimedia.org/T242355 (10sbassett) @zhuyifei1999 - As a security-minded person, I tend to recommend requesting CVEs for pretty much a... [15:50:31] elukey: fyi this is an example of sharing notebooks in paws (labs) [15:50:32] https://paws-public.wmflabs.org/paws-public/User:YuviPanda/examples/revisions-sql.ipynb?kernel_name=python3 [15:50:35] pretty nice [15:51:54] ah yes very nice [15:52:52] fdans: I'll wait for your changes so we don't conflict [15:57:36] (03CR) 10Milimetric: Encode to pagecounts-ez format with a UDF (032 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/562597 (https://phabricator.wikimedia.org/T192474) (owner: 10Milimetric) [16:03:54] * elukey be back in a bit [16:04:51] elukey: can we make a jupyterhub keytab for testing from notebook1004? [16:05:03] i'd also want to configure hadoop to allow it to proxyuser stuff [16:13:27] hey teamm, sorry forgot to join [16:23:53] OH there is a jupyter keytab [16:23:53] cool [16:24:31] (03PS3) 10Mforns: Add anomaly detection to data quality stats workflow [analytics/refinery] - 10https://gerrit.wikimedia.org/r/563200 (https://phabricator.wikimedia.org/T235486) [16:24:52] (03CR) 10Mforns: [V: 03+2] "Thanks for the reviews Nuria and Joseph!" (0316 comments) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/563200 (https://phabricator.wikimedia.org/T235486) (owner: 10Mforns) [16:24:58] jupyterhub* [16:25:25] oph [16:25:30] ah no there isn't [16:30:52] ottomata: we usually add a keytab for the user, IIRC jupyterhub now runs as root right? [16:41:56] 10Analytics, 10Better Use Of Data, 10Epic, 10Patch-For-Review, and 2 others: Prototype client to log errors in vagrant - https://phabricator.wikimedia.org/T235189 (10jlinehan) a:05Milimetric→03jlinehan [16:47:25] yes true, i think we'd stop that though [16:47:39] we wouldn't need to anymore since we wouldn't be doing the systemd spawner stuff [16:47:45] we'd rely on yarn proxyuser stuff to do that [16:50:09] ottomata: what do you need a keytab for on the notebooks? (trying to to understand what to create) [16:50:27] I mean, can we use something like analytics-privatedata or anaylytics for testing? [17:01:20] brt [17:01:27] (to standup) [17:01:51] elukey: i can use anything for testinig ya [17:02:00] actually [17:02:03] i thikn i don't need one for testing maybe [17:03:17] 10Analytics: Removed not used CDH packages from Hadoop nodes - https://phabricator.wikimedia.org/T242754 (10elukey) ` elukey@an-coord1001:~$ dpkg -l | grep cdh ii avro-libs 1.7.6+cdh5.16.1+143-1.cdh5.16.1.p0.3~jessie-cdh5.16.1 all Data serialization system ii bigtop-js... [17:03:56] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Make stats.wikimedia.org point to wikistats2 by default - https://phabricator.wikimedia.org/T237752 (10saper) What about something like this: `lang=apache DocumentRoot /srv/stats.wikimedia.org/htdocs Options... [17:11:38] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Make stats.wikimedia.org point to wikistats2 by default - https://phabricator.wikimedia.org/T237752 (10saper) Also you might want to add some cache control parameters to js and css assets if you like, all that inside of `/srv/src/wikistats-v2/dist` directo... [17:17:00] 10Analytics: Removed not used CDH packages from Hadoop nodes - https://phabricator.wikimedia.org/T242754 (10elukey) ` elukey@an-master1001:~$ dpkg -l | grep cdh ii avro-libs 1.7.6+cdh5.16.1+143-1.cdh5.16.1.p0.3~jessie-cdh5.16.1 all Data serialization system ii bigtop-jsvc... [17:34:00] (03PS9) 10Fdans: Add vue-i18n integration, English strings [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/558702 (https://phabricator.wikimedia.org/T240617) [17:36:42] 10Quarry, 10Cloud-Services, 10Security-Team, 10Security, 10Vuln-XSS: Trivial Quarry XSS: Tabular data CSV / TSV are not escaped and sent as text/html - https://phabricator.wikimedia.org/T242355 (10zhuyifei1999) > I'm guessing Quarry probably isn't run outside of wmflabs? I'm pretty sure that's the case... [18:32:19] (03PS13) 10Mforns: Add Spark/Scala module for timeseries anomaly detection [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/561674 (https://phabricator.wikimedia.org/T235486) [18:32:37] (03CR) 10Mforns: [V: 03+2] "Thanks for the reviews guys!" (0313 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/561674 (https://phabricator.wikimedia.org/T235486) (owner: 10Mforns) [18:35:10] (03PS14) 10Mforns: Add Spark/Scala module for timeseries anomaly detection [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/561674 (https://phabricator.wikimedia.org/T235486) [18:47:09] 10Analytics, 10Research-Backlog, 10Wikidata: Copy Wikidata dumps to HDFS - https://phabricator.wikimedia.org/T209655 (10Isaac) > @JAllemandou Thank you - as ever! +1: these wikidata parquet (specifically item_page_link) dumps are super useful for us! [18:59:09] * elukey off! [19:05:30] 10Analytics, 10Operations, 10ops-eqiad, 10User-Elukey: replace onboard NIC in kafka-jumbo100[1-6] - https://phabricator.wikimedia.org/T236327 (10Cmjohnson) @Jclark-ctr where are you with these? [19:08:03] tizianop: hey, assuming you are "piccardi", right? [19:08:14] i am Daniel on the SSH access ticket [19:08:16] hi mutante, yes! [19:08:36] 10Analytics, 10Operations, 10ops-eqiad, 10User-Elukey: replace onboard NIC in kafka-jumbo100[1-6] - https://phabricator.wikimedia.org/T236327 (10Jclark-ctr) @Cmjohnson no nic installed or host moved yet. @RobH had helped with 10g interfaces [19:08:38] tizianop: so.. it's a bit mysterious to me because indeed things look like they should work.. but let's try this: [19:09:05] let's see if you can directly ssh to bast1002.wikimedia.org without jumping through any other bastions [19:09:22] so something like "ssh -vvv -i ~/.ssh/wikipedia piccardi@bast3004.wikimedia.org [19:09:51] where you directly specify they key with -i and then to one of the bastions but temp. comment out the proxy command in the config [19:09:59] for me too :) Especially because I was on a long vacation and I didn't touch much the laptop in these days. On my side the setup should be the same [19:10:47] done, and it's the same. It asks for the password [19:11:23] which one did you try? bast1002? [19:11:49] now both: bast1002 and bast3004 [19:12:31] the interesting part is: on bast3004 there is nothing in logs [19:12:37] like it never even gets there [19:12:51] while on 1002 we see the failed public key [19:14:37] on 3004 I tried before with Luca and he saw the same error [19:15:02] tizianop: what do you get when you run: ssh-keygen -lf ~/.ssh/wikipedia.pub [19:15:34] looks say you are trying with public key SHA256:wNTUKNPfq5Wyubriy6VGxmqrPq3m9l6GSiyF0SV/ywE [19:15:37] logs [19:15:51] and the command above should return that same hash [19:16:37] it's odd because on bast3004 the string "piccardi" is not in the log at all [19:16:46] it only is on bast1002 [19:17:26] 4096 SHA256:aw4jMdpq+mw0hkDDlqx+rJ6+qVHDj7UL7d9wyr+KXVg tiziano.piccardi@epfl.ch (RSA) [19:18:22] ok, apparently it takes the wrong key [19:18:24] tizianop: that is indeed the key that should work.. but for some reason not the key that the sshd server sees on connect [19:18:41] do you have "ssh-add" command ? [19:18:51] ssh-add -L .. does it show multiple keys by any chance? [19:19:15] or another mechanism how keys are stored on Mac ? [19:20:05] tizianop: maybe move the .ssh/config somewhere else temp. and just try ssh -i directly to bast1002 without any other config.. the simplest setup [19:21:58] ssh-add -D to remove all (other) keys from agent should also help debugging [19:22:31] yes, I have multiple keys. I just found that the hash that you see in the log is the default (id_rsa). It's like if something changed in the env from my side and ssh ignores the -i option [19:23:04] I'll try to copy the file somewhere else as you suggested [19:23:17] tizianop: ah! yea, sounds good [19:24:40] maybe /etc/ssh/ssh_config conflicts with ~/.ssh/config [19:24:44] it is loading both [19:31:10] yes, it is a problem in the config file. I renamed the file and called again "ssh -vvv -i ~/.ssh/wikipedia piccardi@bast3004.wikimedia.org" and it works [19:32:25] I think I can find a way to debug it now :) [19:32:54] tizianop: cool :) [19:33:08] important thing was to discover on which side the problem is! Thank you! [19:34:02] maybe compare to https://wikitech.wikimedia.org/wiki/Production_access#Setting_up_your_SSH_config or https://wikitech.wikimedia.org/wiki/Production_access#Advanced:_operations_config [19:34:14] i'd first remove all the things and then add them back step by step [19:34:24] trying between each step when it stops working [19:34:37] you're welcome, bbiaw [19:35:00] maybe it's just the "Host *" at the top [19:49:12] mutante FYI: the line that breaks everything is "ProxyCommand ssh -a -W %h:%p bastproduction" [19:56:08] elukey: is there a buster node in the analytics test cluster I can install some jupyter things on for trying stuff? [19:58:31] tizianop: hmm.. i have: ProxyCommand ssh -W %h:%p bastion [19:58:44] and: ForwardAgent no [19:58:51] which should be the same as the -a [20:01:17] neilpquinn: yt? [20:02:28] tizianop: https://phabricator.wikimedia.org/P10146 try that? [20:03:06] (got the additional IdenitityFile and IdentitiesOnly and ForwardAgent no but drops the -a).. not that it's obvious to me.. but that works [20:12:16] !log deployed aqs with new service-runner version 2.7.3 [20:12:18] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [20:16:46] mutante: I added "ForwardAgent" and "IdentitiesOnly" everywhere and it works! o.O No idea why and how it could work before. Thank you! [20:22:23] 10Analytics, 10Analytics-Wikistats: Wikimedia Statistics - Confusing number formatting/rounding on the vertical axis scale on the "Page to date" statistics graph - https://phabricator.wikimedia.org/T242790 (10Larske) [20:49:34] 10Analytics, 10Analytics-Wikistats: Wikimedia Statistics - Confusing number formatting/rounding on the vertical axis scale on the "Page to date" statistics graph - https://phabricator.wikimedia.org/T242790 (10Nuria) >A vertical axis with less confusing number formatting Indeed! [21:07:23] tizianop: ok, great! :) [21:34:06] (03PS10) 10Milimetric: Add vue-i18n integration, English strings [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/558702 (https://phabricator.wikimedia.org/T240617) (owner: 10Fdans) [21:35:57] (03CR) 10Milimetric: "I did " into ' and ' + into `${" [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/558702 (https://phabricator.wikimedia.org/T240617) (owner: 10Fdans) [21:38:47] 10Analytics, 10Pageviews-API, 10Tool-Pageviews: Add support for private wikis to Pageviews - https://phabricator.wikimedia.org/T242793 (10MusikAnimal) I was thinking this wouldn't be for #tool-pageviews, not just because it's private data, but also because that tool is hard-wired to use the public APIs. At... [21:40:46] 10Analytics, 10Pageviews-API, 10Tool-Pageviews: Add support for private wikis to pageviews API - https://phabricator.wikimedia.org/T242793 (10MusikAnimal) [21:56:39] 10Quarry, 10Cloud-Services, 10Security-Team, 10Security, 10Vuln-XSS: Trivial Quarry XSS: Tabular data CSV / TSV are not escaped and sent as text/html - https://phabricator.wikimedia.org/T242355 (10Framawiki) I don't think too that it's used by someone else, and code was not designated to such usage. Thus... [22:10:20] 10Analytics, 10Analytics-Kanban: The guava error still persists in data quality bundles - https://phabricator.wikimedia.org/T241375 (10mforns) [22:39:15] hmm anybody there still? [22:39:16] milimetric: ? [22:39:30] ya [22:39:41] can you try something for me? [22:39:43] ok [22:39:50] 10Analytics, 10Analytics-Kanban: The guava error still persists in data quality bundles - https://phabricator.wikimedia.org/T241375 (10mforns) Maven tree shows 4 different versions of guava: - 11.0.2 Used by json-schema-core.jackson-coreutils and CDH5.hadoop-common - 12.0 Used by reflection - 16.0.1 Used by ha... [22:39:53] (03CR) 10Fdans: Add vue-i18n integration, English strings (039 comments) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/558702 (https://phabricator.wikimedia.org/T240617) (owner: 10Fdans) [22:39:56] ssh -N stat1005.eqiad.wmnet -L 8100:localhost:8100 [22:40:02] http://localhost:8100 [22:40:08] log in like you normally would to jupyterhub [22:40:13] with shell username and ldap pw [22:40:42] 1. do you see your hdfs homedirf in the files listing? [22:40:50] not your stat1005 homedir? [22:42:23] Error Registering Plugins [22:42:26] hmm [22:42:45] oooh, cool, yeah, it's my wmf files [22:42:59] oh youu see it? [22:43:08] your hdfs:////user/milimetric stuff? [22:43:24] yeah [22:43:24] ok next [22:43:41] what does this do for you? [22:43:44] http://localhost:8100/user/otto/lab/tree/Untitled.ipynb [22:43:50] (I think the error was 'cause it was taking forever to login so I clicked it twice and it must've tried to register twice [22:44:03] i think it will redirect you to a copy of the notebook under your user [22:44:22] that says "Server at /user/otto/ (oauth URL: /user/otto/oauth_callback) would like permission to identify you. It will not be able to take actions on your behalf." [22:44:30] so you're trying to phish me? [22:44:47] hmm [22:44:51] Cannot find template: "403.html" [22:44:51] In "/home/otto/anaconda3/share/jupyter/lab/static" [22:45:17] hm [22:45:28] ok what abouut [22:45:33] http://localhost:8100/user/otto/lab/workspaces/auto-N [22:45:38] I get that error about the registering plugins each time btw [22:45:44] yeah i do too [22:45:45] hm [22:45:45] same, 403 [22:45:52] that's unauthorized no? [22:45:59] gotta give me permission to read those files in your home dir? [22:47:24] nm you should have that [22:47:28] ok hang on more things to twiddle... [22:47:55] OH [22:47:58] hm [22:48:42] ok makes sense, the jupyterhub stuff is all running as my user [22:48:50] and the thing tried to copy my notebook into your hdfs userdir [22:48:54] which i guuess i don't have perms to do :) [22:49:33] hm oh no that was just you trying to make a notebook there? [22:52:46] no clue :) [22:59:20] ok milimetric try this one [22:59:27] http://localhost:8100/services/share-link/open?token=ZXlKMGVYQWlPaUpLVjFRaUxDSmhiR2NpT2lKU1V6STFOaUo5LmV5SjFjMlZ5SWpvaWIzUjBieUlzSW5CaGRHZ2lPaUpWYm5ScGRHeGxaQzVwY0hsdVlpSXNJbTl3ZEhNaU9udDlMQ0psZUhBaU9qRTFOemt3TkRZek5EWjkuaEE4eFh0aXFQTWxfcE1LUUFOaFFQZklKMjNNLUQtRm5Oa3ZxQl9sdDBFMFM4dTZwZUVqVkxiZ3U5Zi1KQzQzdTV3M1lLcDU1UXNmS2Zvam9XeE5jMVczN3BFRms0Sy1xNmxBVW53VFc0OHZVVC1DYUxaQ1g3QzByZ1J3X1RHblJHUm9XM3YtV0FLdHhr [22:59:27] MFUxbTB6SkNGZjJLYzREcVA1RE5qcDBJWnFVSUFPR05uZkY5SGZyNFpIVDQzbS1HTlk5d0VYMlctQno2SmdQZVZZa0RfWjBZcVFyWFBETzA3STVUQmxSMW84QnhXM0FicFB4aDd3RTdKb1NWbkZXTzliQzljdXRHNzFYYWFJZURDTGt2OTQzdW5LRHJGT3RzQkkxeGZRUmZXRERzYWRaZnVwNkpDSms4MFp6Tnk0NWk5aW90UTRYeEV5XzZ0akxuRjdxQlU5aDNB [22:59:34] wow [22:59:36] crazy link [22:59:42] i guess copy/paste the thing [23:00:01] i'm trying to figure out ways we can help folks share notebooks with each other [23:00:06] i think this might not be it but I want to see how it works [23:00:08] hmmm [23:00:18] 500 [23:00:31] yeah my process can't write to your hdfs user dir [23:00:31] hmmm [23:00:35] ok hang on [23:03:07] I gotta run and make pizza but I can try stuff after [23:03:48] ok dan [23:03:48] one more [23:03:49] http://localhost:8100/services/share-link/open?token=ZXlKMGVYQWlPaUpLVjFRaUxDSmhiR2NpT2lKU1V6STFOaUo5LmV5SjFjMlZ5SWpvaWIzUjBieUlzSW5CaGRHZ2lPaUpJYVVSaGJpNXBjSGx1WWlJc0ltOXdkSE1pT250OUxDSmxlSEFpT2pFMU56a3dORFkyTWpSOS5Kai16X0Z4VmRES0dQUWxha1dCYTlzd0FxaHZWdnlzMkFhSDN4YWR3VmZReGJwM21DeF9WeXZvalMwTU1OaktBOEpkRmZpZXBNazcteVI1ZkY3U0FQNDRJRURXeVJlcFBuRGZpSmJ5Z0RNYlFoUHJ3NWhER1AzOE5HTWhsR2YzSnZKSWRmQno3WEkzbFFnZ0Js [23:03:49] UV8xUnd1Z1VwWVVKUGxOeENUWjIyZU9oSDdWcDl4YXJqelpEaHBaSGJzc3F1SEZFY2tUb0RfQVRFUEhwM2J2TXJ1TllEdWlJck1ucFZTYWlmZUJHVnVRVWNlb0JodDFJZ3p2RjA1c1RxejFIVWVkMHRCS3J1OGo2YllkNGZaX2E1OTloZGw3YVBKbDhVY2FtdS05M3lPZ2lqWlhvWHRFLVZDbkotOWlqRWY0UWtvTXBDM2lhLVBQTk5iaXBUbWUyMUMtOVE= [23:03:54] milimetric: one more! [23:03:59] then i quit for the day too :) [23:26:48] 10Analytics: Requesting kerberos access for jwang - https://phabricator.wikimedia.org/T242813 (10jwang)