[04:19:49] 10Analytics, 10Better Use Of Data, 10Desktop Improvements, 10Product-Infrastructure-Team-Backlog, and 7 others: Client side error logging production launch - https://phabricator.wikimedia.org/T226986 (10Krinkle) >>! In T226986#5956043, @Ottomata wrote: >> Breakdown by wiki domain (derived from webpage url?... [04:32:42] 10Analytics, 10ContentTranslation, 10Language-Team (Language-2020-January-March): Test Performance of Marian NMT translation in stat cluster - https://phabricator.wikimedia.org/T247245 (10santhosh) Thanks. I was able to login. The first thing missing in stat1006 is `cmake`. Also I noticed I cannot connect to... [04:41:47] 10Analytics, 10ContentTranslation, 10Language-Team (Language-2020-January-March): Test Performance of Marian NMT translation in stat cluster - https://phabricator.wikimedia.org/T247245 (10Nuria) @santhosh you need to use an http proxy to access the outside world: https://wikitech.wikimedia.org/wiki/HTTP_proxy [05:39:09] 10Analytics, 10Product-Analytics (Kanban): SQL definition for structure data in commons metrics - https://phabricator.wikimedia.org/T247101 (10jwang) Structured data on commons is defined as pieces of structured data attached to one particular item in commons stored in the MediaInfo database. **Metric defini... [05:42:06] 10Analytics, 10Product-Analytics (Kanban): SQL definition for structure data in commons metrics - https://phabricator.wikimedia.org/T247101 (10jwang) @Nuria Please review the initial calculation. Feel free to comment or discuss in our meeting. Jennifer [06:46:21] morning! Reminder that I'll be afk for ~2/3h from now, but I have my laptop with me :) [07:28:37] 10Analytics, 10wmfdata-python, 10Epic, 10Product-Analytics (Kanban): Analysts cannot reliably use wmfdata to run SQL queries against Hive databases - https://phabricator.wikimedia.org/T245891 (10nshahquinn-wmf) [07:33:41] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Virtual pageviews should set access_type to mobile if webhost is a mobile one - https://phabricator.wikimedia.org/T246309 (10nshahquinn-wmf) >>! In T246309#5956434, @Nuria wrote: > @nshahquinn-wmf the other thing to do is to make sure that kaiOS is sending... [08:13:55] 10Analytics, 10Better Use Of Data, 10Desktop Improvements, 10Product-Infrastructure-Team-Backlog, and 7 others: Client side error logging production launch - https://phabricator.wikimedia.org/T226986 (10Tgr) Putting the MW request ID into a JS error event seems not so useful anyway. It's pretty unlikely th... [09:22:22] 10Analytics, 10ContentTranslation, 10Language-Team (Language-2020-January-March): Test Performance of Marian NMT translation in stat cluster - https://phabricator.wikimedia.org/T247245 (10santhosh) Ok, I installed cmake as non-root users and set up marian, but the perfromace is even below my own laptop. Main... [09:26:36] 10Analytics, 10ContentTranslation, 10Language-Team (Language-2020-January-March): Test Performance of Marian NMT translation in stat cluster - https://phabricator.wikimedia.org/T247245 (10elukey) @santhosh importing the debian packages shouldn't be a big problem, but the license for sure. Looping in @MoritzM... [09:38:35] 10Analytics, 10ContentTranslation, 10Language-Team (Language-2020-January-March): Test Performance of Marian NMT translation in stat cluster - https://phabricator.wikimedia.org/T247245 (10MoritzMuehlenhoff) From a quick check, MKL doesn't appear to be FLOSS, but just a bundle of pre-compiled, shared librarie... [09:41:07] 10Analytics, 10ContentTranslation, 10Language-Team (Language-2020-January-March): Test Performance of Marian NMT translation in stat cluster - https://phabricator.wikimedia.org/T247245 (10elukey) >>! In T247245#5959567, @MoritzMuehlenhoff wrote: > From a quick check, MKL doesn't appear to be FLOSS, but just... [09:53:14] 10Analytics, 10ContentTranslation, 10Language-Team (Language-2020-January-March): Test Performance of Marian NMT translation in stat cluster - https://phabricator.wikimedia.org/T247245 (10elukey) @santhosh at this point I'd try to test if OpenBLAS could be a viable alternative. Do you think that some perf tu... [10:48:54] 10Analytics, 10ContentTranslation, 10Language-Team (Language-2020-January-March): Test Performance of Marian NMT translation in stat cluster - https://phabricator.wikimedia.org/T247245 (10santhosh) >>! In T247245#5959606, @elukey wrote: > @santhosh at this point I'd try to test if OpenBLAS could be a viable... [11:17:40] 10Analytics, 10ContentTranslation, 10Language-Team (Language-2020-January-March): Test Performance of Marian NMT translation in stat cluster - https://phabricator.wikimedia.org/T247245 (10elukey) >>! In T247245#5959690, @santhosh wrote: >>>! In T247245#5959606, @elukey wrote: >> @santhosh at this point I'd t... [12:01:05] 10Analytics, 10Analytics-Kanban, 10Release Pipeline, 10Patch-For-Review, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10akosiaris) @ottomata, eventstreams has been switched to kubernetes and TLS. The following 2 graphs show the migration of th... [12:07:15] 10Analytics, 10ContentTranslation, 10Language-Team (Language-2020-January-March): Test Performance of Marian NMT translation in stat cluster - https://phabricator.wikimedia.org/T247245 (10santhosh) @elukey no problem. @Nuria what do you advice? Is there any other system that is not shared for doing this tes... [12:13:22] 10Analytics, 10ContentTranslation, 10Language-Team (Language-2020-January-March): Test Performance of Marian NMT translation in stat cluster - https://phabricator.wikimedia.org/T247245 (10MoritzMuehlenhoff) Instead of relying on random comments let's get some actual number of the performance benefit of MKL o... [12:17:26] 10Analytics, 10ContentTranslation, 10Language-Team (Language-2020-January-March): Test Performance of Marian NMT translation in stat cluster - https://phabricator.wikimedia.org/T247245 (10elukey) >>! In T247245#5959836, @MoritzMuehlenhoff wrote: > Instead of relying on random comments let's get some actual n... [12:31:59] 10Analytics, 10Analytics-Kanban, 10Release Pipeline, 10Patch-For-Review, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10akosiaris) I 've bumped CPU limits for eventstreams itself by 25%. The cause was that inexplicable CPU throttling event[1] th... [13:21:41] 10Analytics, 10Better Use Of Data, 10Desktop Improvements, 10Product-Infrastructure-Team-Backlog, and 7 others: Client side error logging production launch - https://phabricator.wikimedia.org/T226986 (10Ottomata) > I'm not sure where that comes form then. Ah, [[ https://github.com/wikimedia/service-templa... [13:23:16] 10Analytics, 10Better Use Of Data, 10Desktop Improvements, 10Product-Infrastructure-Team-Backlog, and 7 others: Client side error logging production launch - https://phabricator.wikimedia.org/T226986 (10jlinehan) >>! In T226986#5956043, @Ottomata wrote: >> The type key is clashing with Logstash-wide key >... [13:24:57] 10Analytics, 10Better Use Of Data, 10Desktop Improvements, 10Product-Infrastructure-Team-Backlog, and 7 others: Client side error logging production launch - https://phabricator.wikimedia.org/T226986 (10Ottomata) Hm, what service-template-node should most properly do is [[ https://github.com/wikimedia/pupp... [13:25:17] 10Analytics, 10Better Use Of Data, 10Desktop Improvements, 10Product-Infrastructure-Team-Backlog, and 7 others: Client side error logging production launch - https://phabricator.wikimedia.org/T226986 (10Ottomata) [13:36:10] 10Analytics, 10Better Use Of Data, 10Desktop Improvements, 10Product-Infrastructure-Team-Backlog, and 7 others: Client side error logging production launch - https://phabricator.wikimedia.org/T226986 (10Pchelolo) >>! In T226986#5960122, @Ottomata wrote: > Hm, what service-template-node should most properly... [13:59:42] 10Analytics, 10ContentTranslation, 10Language-Team (Language-2020-January-March): Test Performance of Marian NMT translation in stat cluster - https://phabricator.wikimedia.org/T247245 (10Nuria) @MoritzMuehlenhoff @santhosh has done the testing with both MNL and OpenBlas and the former renders a much better... [14:00:55] 10Analytics, 10Discovery, 10Discovery-Search (Current work), 10Patch-For-Review: Data for events from wdqs needs to be deleted after 90 days and/or sanitized - https://phabricator.wikimedia.org/T247034 (10dcausse) @nuria thanks, unless @JAllemandou thinks we need more 3 month is OK for me. [14:01:24] 10Analytics, 10Discovery, 10Discovery-Search (Current work), 10Patch-For-Review: Data for events from wdqs needs to be deleted after 90 days and/or sanitized - https://phabricator.wikimedia.org/T247034 (10Nuria) 05Open→03Resolved [14:01:38] 10Analytics, 10Better Use Of Data, 10Desktop Improvements, 10Product-Infrastructure-Team-Backlog, and 7 others: Client side error logging production launch - https://phabricator.wikimedia.org/T226986 (10Ottomata) > If we could get it to eventgate puppet role Kubernetes :/ [14:01:49] 10Analytics, 10Discovery, 10Discovery-Search (Current work), 10Patch-For-Review: Data for events from wdqs needs to be deleted after 90 days and/or sanitized - https://phabricator.wikimedia.org/T247034 (10Nuria) 05Resolved→03Open [14:02:06] mforns: o/ - ok to merge https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/577469/ ? [14:37:16] 10Analytics, 10Analytics-Kanban, 10Product-Analytics: Definition of not rich tech content metrics for tunning session - https://phabricator.wikimedia.org/T247417 (10Nuria) [14:42:37] 10Analytics, 10wmfdata-python, 10Product-Analytics (Kanban): wmfdata cannot recover from a crashed Spark session - https://phabricator.wikimedia.org/T245713 (10nshahquinn-wmf) p:05High→03Medium Spark crashes are much less frequent now due to T245097, so I'm lowering the priority. However, if a crash ha... [14:49:04] !log add xmldumps mountpoints on stat1004 and stat1005 [14:49:06] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [14:49:07] \o/ [15:00:36] 10Analytics, 10Analytics-Kanban, 10Product-Analytics: Technical contributors metrics definition - https://phabricator.wikimedia.org/T247419 (10Nuria) [15:43:47] elukey, I'm testing jupyter in stats machines and getting some error, do you have time to bc before standup? [15:46:51] it's probably sth stupid from my side [15:49:29] wait I think I have it [15:59:21] mforns: sorry I was in a meeting! [16:14:04] hey a-team: Neil asked a question about whether there's a need for hashing user IDs in https://phabricator.wikimedia.org/T244931 Not sure which one of you would be a good candidate to answer that question, so here's a ping :) [16:21:00] Nettrom, will look into that! [16:21:04] thx [16:22:03] mforns: awesome, thanks! [16:22:52] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Virtual pageviews should set access_type per schema definition - https://phabricator.wikimedia.org/T246309 (10Nuria) [16:25:03] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Virtual pageviews should set access_type per schema definition - https://phabricator.wikimedia.org/T246309 (10Nuria) > I'll make sure we set that field we do. Sounds good, thanks for the prompt response. @fdans the schema (https://meta.wikimedia.org/wik... [16:46:43] * elukey be back in a bit! [17:15:35] back [17:40:16] 10Analytics, 10Product-Analytics, 10Inuka-Team (Kanban): Set up pageview counting for KaiOS app - https://phabricator.wikimedia.org/T244547 (10SBisson) [17:48:06] 10Analytics, 10Product-Analytics, 10Inuka-Team (Kanban): Set up pageview counting for KaiOS app - https://phabricator.wikimedia.org/T244547 (10SBisson) a:03SBisson I don't know what's going on but I **can** set the UA on the API calls (not sendBeacon though) See https://github.com/wikimedia/wikipedia-kaio... [17:56:35] elukey, not managing to make scala spark YARN work in stat1005 [17:56:59] I'm looking at the logs and I get an Address already in use error? [17:59:57] 10Analytics, 10Product-Analytics, 10Inuka-Team (Kanban): Set up pageview counting for KaiOS app - https://phabricator.wikimedia.org/T244547 (10SBisson) >>! In T244547#5865738, @fdans wrote: > The user agent of the app must be changed to "WikipediaApp" (at the beginning of the string). Additionally, if you ca... [18:00:32] mforns: weird, in theory it should try and use other ones.. do you have more than one notebook running? [18:00:52] elukey, I was checking that, but no [18:02:45] Mar 11 17:55:38 stat1005 bash[377]: 20/03/11 17:55:38 ERROR ZeroMQSocketRunnable: Unexpected exception in 0mq socket runnable! [18:02:48] Mar 11 17:55:38 stat1005 bash[377]: org.zeromq.ZMQException: Errno 48 : Address already in use [18:02:51] ok this is weird [18:02:54] ZeroMQ ? [18:03:11] ah that seems toree [18:03:46] yep [18:03:51] toree? [18:04:03] I see [18:06:21] I did upgrade it to 0.3 [18:07:34] elukey, nother thing that is interesting is, in the web client, I get console errors just when connecting through stat1005 [18:08:04] which have some weird effects in the UI, like the cursor doesn't show (you can still write, but it's invisible) [18:08:04] mforns: what kind of console errors? [18:08:33] something in vendors-main [18:08:57] I don't with chrome, what browser are you using? [18:09:03] chrome [18:09:19] elukey, but can you see the cursor when using 2005? [18:09:21] 1005? [18:09:25] yes [18:10:26] hm [18:10:29] mforns: was it from the start? [18:10:40] I'm trying to reproduce another time [18:13:49] elukey, def when I connect through 1005 there's this 404 when requesting a font: http://localhost:8000/user/mforns/lab/api/themes/@jupyterlab/theme-light-extension/43bb4cbf1d0ecfdb1309e4cb67264f35.ttf [18:14:00] and this is breaking the cursor I guess [18:14:10] probably nothing to do with the other error [18:15:48] elukey, queries from stat1005 still not working, I see the same zeromq error [18:17:11] mforns: what kernel did you use? [18:17:20] scala spark YARN [18:17:32] I am using the same and I can't repro [18:17:38] super weird [18:17:39] hm [18:17:51] let me try firefox [18:21:03] elukey, firefox doesn't have the font/cursor error, but fails the same when querying [18:30:11] mforns: so I think that the way that I upgraded toree might not be ok, or the new versio contains bugs [18:30:24] aha [18:34:09] or, maybe I need to rebuild the kernels with the updated toree version [18:34:23] ottomata: are you around by any chance? [18:34:32] yes [18:34:57] toree suuuuCKKKSs haha but i don't know if we have anything better [18:35:30] ottomata: I used 0.3.0 via pip for buster, meanwhile we use 0.2.0 via tarball for stretch [18:35:38] do I need to rebuild the kernels for 0.3? [18:35:40] you got toree via pip? cool. [18:35:53] i don'ot know if anything has changed, you mean like change the args passed to toree? [18:35:54] I just noticed the kernel dir [18:36:11] nono I mean rebuilding them, because marcel is getting a strange issue [18:36:15] mforns: does the spark_local_scala work? [18:36:24] ottomata, in a meeting [18:36:42] oh yes elukey the kernels reference the toree path explicitly [18:36:45] so you'd need to change that [18:38:06] ottomata: you mean following README in the kernels dir and create a new one for buster? [18:38:18] jupyter toree install etc.. [18:38:57] otherwise I can fallback to 0.2.0 via pip even for buster [18:39:04] or via the tarball already deployed [18:39:24] and then think about moving to toree 0.3.0 [18:39:49] prbably new toree is better [18:39:59] dunno how it works via pip though...there is a jar [18:40:56] AH i tis in the pip package [18:40:57] opk [18:40:59] ok i think it would work [18:40:59] yeah [18:41:47] ok interesting yeah this should be simpler with pip luca [18:42:12] there is a bin/run.sh script in the toree pip package [18:42:12] (03PS1) 10Amire80: WIP Update for hive [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/579022 (https://phabricator.wikimedia.org/T223958) [18:42:20] and it should find the jar on its own [18:43:18] OH hm, that is for brunel, no. i think we should drop brunel, no one uses it [18:43:29] no idea what it is :D [18:43:45] its a scala notebook viz libary [18:43:50] graphing, etc. [18:43:59] ok so I'd need to create a docker buster container, run that script to recreate kernels, and then use it for buster [18:44:02] ah okok [18:44:18] kernels are just json files [18:44:29] and they aren't 'created' as part of the venv [18:44:43] they are installed from the git repo manually during swap install setup [18:45:11] luca you can try to make a custom one to find one that works first [18:45:12] https://wikitech.wikimedia.org/wiki/SWAP#Custom_Spark_Notebook_Kernels [18:45:22] i'd say [18:45:30] get rid of the --jars ...brunel.jar [18:45:31] and [18:45:40] try launching via the pip packages run.sh script [18:45:44] not sure the correct pathh [18:45:47] nono I know that they are not created [18:45:49] but the easiest one is from the jupyterhub venv [18:46:02] /srv/jupyterhub/venv/lib/python3.7/site-packages/toree/bin/run.sh [18:46:04] with the venv, but I saw the "kernels" dir in the repo [18:46:24] ya, you don't have to rebuild artifacts thhough [18:46:27] to change kernels [18:47:03] is there any easy way to query kafka for consumer group offsets, outside of actually consuming? Basically i'm suspicious that kafka_burrow_partition_lag in prometheus is no longer reporting the consumer lag [18:47:11] the create venv script just installs them into the venv at the end [18:48:03] hm, ebernhardson on the broker the kafka CLI has a consumer-offset-checker [18:48:36] hm maybe not [18:48:36] Error: Could not find or load main class kafka.tools.ConsumerOffsetChecker [18:48:59] which cluster/consumer group you looking for? [18:49:07] :) Ok i'm sure i can find that jar somewhere [18:49:11] :) [18:49:23] thhat migth be old thhen if it doesnt exist anymore [18:49:26] this is alos a consumer-groups command [18:49:28] that does work [18:49:33] and has a --describe flag [18:49:35] ottomata: jumbo-eqiad, topic eqiad.swift.(.*).upload-complete, with cirrussearch_updates_eqiad consumer grou [18:49:52] so, probably eqiad.swift.search_popularity_score.upload-complete [18:50:12] https://www.irccloud.com/pastebin/HtO8rtuk/ [18:50:21] basically it reports no spike when we produce ~1500 records and consume them over the next ~24 hours, but my daemon reports it's processing messages [18:50:54] ok that seems to agree, there should be >1k lag, but no lag reported in prometheus :( https://grafana.wikimedia.org/d/000000591/elasticsearch-mjolnir-bulk-updates?orgId=1&fullscreen&panelId=8&from=now-30d&to=now&edit [18:51:07] i'll file a ticket, it's not needed just this second :) [18:52:48] ebernhardson: keep in mind that burrow uses some heuristic IIRC to decide if a consumer is lagging, not only the fact that a ton of messages are enqueued and they are processed during x hours [18:53:22] elukey: interesting, i didn't realize that. Still though it should report the same numbers it did last week at least [18:53:35] oh yes it is worth to open a task, I might misremember [18:53:40] and/or we may need to upgrade burrow [18:53:45] could be a good excuse :) [18:53:47] :) [18:54:33] ottomata: I am still a bit confused why the kernels dir in the jupyterhub repo would be fine with toree 0.2.0, there are dirs (for each kernel) containing python files [18:54:41] related to toree 0.2.0 [18:55:07] I'd expect those to be different if I re-run $venv/bin/jupyter toree install etc.. no? [18:55:58] (03CR) 10Mforns: WIP Update for hive (037 comments) [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/579022 (https://phabricator.wikimedia.org/T223958) (owner: 10Amire80) [18:56:31] no, the krenels are manual [18:56:40] if toree now has an install command to install kernel itself [18:56:41] that's great [18:56:45] i don't think it did before [18:57:05] if it does, then you probably dont' need the spark yarn kernels...except that it might confuse swap users now since they expect them [18:57:07] I found the toree install etc. in the README :D [18:57:11] aye cool [18:57:26] I mean, your readme [18:57:27] but also, the custom kernels we have do extra stuff [18:57:29] oh [18:57:30] OH [18:57:31] hehehhe [18:57:54] ? [18:57:55] toree install? [18:58:20] i don't see that in the readme [18:58:23] in my readme [18:58:32] it is inside the kernels dir [18:58:42] AH that one [18:58:55] I didn't notice it before today [18:58:57] :D [19:00:02] OK greate, then yese thaht should work, but those commands were used to generate the kernels originally, then they were copied into the kernels/ dir in the git repo, edited for differnet settings, and then they are installed when create_virtualenv.sh is run on the server [19:01:00] elukey: i think joseph recently updated the kernels with other settings too, and I doubt he did it the way thhe readme says [19:01:30] Hi folks - Trying to process the backlog [19:01:56] I didn't README nope [19:02:28] joal: the TL;DR is that I boldly used toree 0.3.0 for the buster jupytherhub stuff [19:02:40] \o/ Moar recent shtuff :) [19:02:42] and Marcel found some weird behavior with spark kernels on 1005 [19:02:42] (03PS2) 10Amire80: WIP Update for hive [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/579022 (https://phabricator.wikimedia.org/T223958) [19:03:01] so I was trying to figure out if the kernels need to be rebuilt or similar [19:03:05] I wouldn't have doubt something like that [19:03:30] elukey: Some settings we should keep (sizing mostly) - Others we can remove [19:03:38] elukey: the jar added we can remove for isntance [19:03:57] since brunel doesn't work with our spark version anymore (but vegas does :) [19:06:17] elukey: am I relatively on the spot, or should I just stop talking for now? :) [19:06:53] 10Analytics, 10ContentTranslation, 10Language-Team (Language-2020-January-March): Test Performance of Marian NMT translation in stat cluster - https://phabricator.wikimedia.org/T247245 (10faidon) OK, so to recap, I read two concerns: First, the use of stat* boxes for a short-term performance evaluation proj... [19:07:15] joal: no no please I am a lot ignorant about this subject, I am trying to get what I should update :D [19:08:00] elukey: ack! [19:10:11] joal: maybe we can chat tomorrow morning if you have time? [19:10:18] or any time, it is not really urgent [19:10:29] sure elukey :) I have time now as well, but it's probably the moment you should stop :) [19:10:37] (03CR) 10Mforns: WIP Update for hive (032 comments) [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/579022 (https://phabricator.wikimedia.org/T223958) (owner: 10Amire80) [19:10:41] yeah sorry I am a bit fried now :D [19:11:03] Please don't be sorry - Have a good night elukey :) [19:11:12] let's see if we can find some time tomorrow, thanks :) [19:11:19] have a good evening folks! [19:12:05] (joal: btw - xmldumps mount points on stat1004/stat1005, analytics keytab removed from stat boxes) [19:12:47] ack elukey awesome :) [19:22:00] 10Analytics, 10ContentTranslation, 10Language-Team (Language-2020-January-March): Test Performance of Marian NMT translation in stat cluster - https://phabricator.wikimedia.org/T247245 (10Nuria) Just making sure that @Pginer-WMF and @SubrahamanyamVarma are aware of licensing issues @santhosh would you car... [19:34:46] (03PS4) 10Joal: Add automated agent-type to pageview_hourly [analytics/refinery] - 10https://gerrit.wikimedia.org/r/578373 (https://phabricator.wikimedia.org/T238363) [19:53:34] heya nuria - quick question for you [19:54:27] in T238363 last comment you mention 'translation requests' - I remember ou telling that yesterday, and should have asked as I don't understand what those are :S [19:54:28] T238363: Vet high volume bot spike detection code - https://phabricator.wikimedia.org/T238363 [20:05:27] joal: translation requests are the ones done via the google translation extension [20:05:38] nuria: ah - the weblight? [20:05:50] joal: no, weblight is a proxy [20:05:56] hm [20:06:01] joal: one sec and i can tell you the domain [20:07:20] joal: "translate.google" [20:07:53] joal: these might only matter for Eventlogging data [20:08:08] joal: as that would be teh host sending events [20:08:15] nuria: rephrasing to be sure I understand - We want to check if "translate.google" send us traffic that would be categorized as automated [20:08:28] joal: yes, sorry i was not clear [20:08:52] nuria: you know me - I always rephrae everything :) [20:11:08] Thanks for the explanation nuria :) [20:14:15] 10Analytics, 10Growth-Team, 10Product-Analytics: Hash edit session ID in EditAttemptStep and VisualEditorFeatureUse whitelisting - https://phabricator.wikimedia.org/T244931 (10mforns) @nettrom_WMF @nshahquinn-wmf Yes, if we choose to hash some fields in EditAttemptStep, we should also hash all identifiers... [20:35:52] 10Analytics, 10Product-Analytics (Kanban): SQL definition for structure data in commons metrics - https://phabricator.wikimedia.org/T247101 (10Nuria) >SQL How many file pages on Commons contain at least one structured data element (statement or caption)? (ref: T239565) This is the syntax if you run the querie... [20:45:44] ottomata: what was the top url for teh endpoint for schemas? [20:45:54] ottomata: not schemas.wikimedia.org? [20:46:31] schema.wikimedia.org [21:18:55] 10Analytics, 10Analytics-Kanban, 10Release Pipeline, 10Patch-For-Review, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10Ottomata) I've added some debug logging in the eqiad canary pod and got a clue. ` [2020-03-11T20:51:37.421Z] INFO: eventstr... [21:42:01] (03CR) 10Nuria: [C: 04-1] Remove graph trend from Wikistats detail page (031 comment) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/577531 (https://phabricator.wikimedia.org/T212032) (owner: 10Fdans) [21:44:17] 10Analytics, 10Operations, 10ops-eqiad: (Need by: TBD) rack/setup/install kafka-jumbo100[789].eqiad.wmnet - https://phabricator.wikimedia.org/T244506 (10Jclark-ctr) [21:45:11] 10Analytics, 10Operations, 10ops-eqiad: (Need by: TBD) rack/setup/install kafka-jumbo100[789].eqiad.wmnet - https://phabricator.wikimedia.org/T244506 (10Jclark-ctr) racked host , cabled ,updated netbox handing off to Chris for bios configuration host rack unit switchport kafka-jumbo1007 c6 33 35 kafka-jum... [21:45:27] 10Analytics, 10Operations, 10ops-eqiad: (Need by: TBD) rack/setup/install kafka-jumbo100[789].eqiad.wmnet - https://phabricator.wikimedia.org/T244506 (10Jclark-ctr) a:05Jclark-ctr→03Christopher [23:14:51] 10Analytics, 10Pageviews-API: Add wikimania.wikimedia.org to pageview definition - https://phabricator.wikimedia.org/T216525 (10Quiddity) >>! In T216525#5954060, @fdans wrote: > This is a minor change, but can we have a reason why this is needed? We're wondering who's interested in this data. From a wiki-main...