[07:07:48] <wikibugs>	 10Analytics: Add urlshortener to Turnilo - https://phabricator.wikimedia.org/T233336 (10ayounsi) Ping? SRE relies a lot on Turnilo and we often end up sharing links to each others, especially while investigating issues. If this is an easy fix it would be great to implement it. On the other hand, if it's more com...
[07:23:39] <wikibugs>	 10Analytics: Add urlshortener to Turnilo - https://phabricator.wikimedia.org/T233336 (10RhinosF1) >>! In T233336#6401764, @ayounsi wrote: > Ping? SRE relies a lot on Turnilo and we often end up sharing links to each others, especially while investigating issues. > If this is an easy fix it would be great to impl...
[07:24:58] <wikibugs>	 10Analytics: Add urlshortener to Turnilo - https://phabricator.wikimedia.org/T233336 (10RhinosF1) I see https://github.com/wikimedia/operations-mediawiki-config/blob/83b34e1bd1ed804a70f67e089580e082f89e2a0f/wmf-config/CommonSettings.php#L1207 which should allow *.wikimedia.org
[07:27:39] <wikibugs>	 10Analytics: Add urlshortener to Turnilo - https://phabricator.wikimedia.org/T233336 (10ayounsi) Yes, the url shortener works fine with Turnilo URLs, the "feature request" is to integrate it in Turnilo UI. To have a one click short url generation kind of thing instead of having to copy paste the URL between Turn...
[07:29:14] <wikibugs>	 10Analytics: Add urlshortener to Turnilo - https://phabricator.wikimedia.org/T233336 (10Bugreporter) It is already possible:  https://w.wiki/a3X https://w.wiki/a3Z
[07:36:52] <wikibugs>	 10Analytics: Add urlshortener to Turnilo - https://phabricator.wikimedia.org/T233336 (10RhinosF1) >>! In T233336#6401796, @ayounsi wrote: > Yes, the url shortener works fine with Turnilo URLs, the "feature request" is to integrate it in Turnilo UI. > To have a one click short url generation kind of thing instead...
[08:06:40] <wikibugs>	 10Analytics, 10Two-Column-Edit-Conflict-Merge: Sanitize and store historical conflict events - https://phabricator.wikimedia.org/T260965 (10awight)
[08:12:54] <wikibugs>	 10Analytics, 10Two-Column-Edit-Conflict-Merge: Sanitize and store historical conflict events - https://phabricator.wikimedia.org/T260965 (10awight)
[08:18:12] <awight>	 I've found a sanitized EventLogging stream which includes userId.  According to the data retention page, this seems to be a problem.  Can someone verify for me?
[08:20:00] <awight>	 a-team ^
[08:26:15] <awight>	 Sorry for the spam, this was incorrect!  I double-checked and the sanitized data only has nulls in the sensitive columns.
[08:36:44] <wikibugs>	 (03PS1) 10Awight: Preserve sanitized TwoColConflict events [analytics/refinery] - 10https://gerrit.wikimedia.org/r/621682 (https://phabricator.wikimedia.org/T260965)
[08:37:26] <wikibugs>	 10Analytics, 10Two-Column-Edit-Conflict-Merge, 10Patch-For-Review, 10User-awight: Sanitize and store historical conflict events - https://phabricator.wikimedia.org/T260965 (10awight)
[08:46:07] <wikibugs>	 (03PS1) 10Awight: Sanitize ReferencePreviews events [analytics/refinery] - 10https://gerrit.wikimedia.org/r/621683 (https://phabricator.wikimedia.org/T260969)
[10:12:12] <joal>	 Hey awight  - Thanks for double checking :)
[10:42:27] <wikibugs>	 (03PS1) 10Joal: Update mediawiki-history-dumps parameters [analytics/refinery] - 10https://gerrit.wikimedia.org/r/621702 (https://phabricator.wikimedia.org/T254233)
[12:15:19] <wikibugs>	 10Analytics, 10Analytics-Kanban: jsonschema-tools should have option to materialize schemas with default max/min validation for e.g. max long, max double, etc. - https://phabricator.wikimedia.org/T258659 (10fdans) PR created in Github: https://github.com/wikimedia/jsonschema-tools/pull/16
[13:04:35] <wikibugs>	 10Analytics: Add urlshortener button to Turnilo - https://phabricator.wikimedia.org/T233336 (10CDanis)
[13:05:03] <wikibugs>	 10Analytics: Add urlshortener button to Turnilo - https://phabricator.wikimedia.org/T233336 (10CDanis) As a workaround, you can add a bookmarklet to your bookmarks bar: https://edg2s.github.io/w.wiki-bookmarklet/
[13:11:17] <RhinosF1>	 cdanis: that's a good tool that, might add it anyway
[13:11:33] <cdanis>	 yeah pretty handy
[13:11:48] <wikibugs>	 10Analytics, 10MediaWiki-REST-API, 10Patch-For-Review, 10Platform Team Sprints Board (Sprint 2), and 2 others: System administrator reviews API usage by client - https://phabricator.wikimedia.org/T251812 (10Naike)
[13:46:04] <isaacj>	 general question -- where would i check to see if a SWAP notebook that is running a PySpark session is still running? does it show up under `mapred job -list` or somewhere else?
[13:47:25] <joal>	 hi isaacj 
[13:47:41] <joal>	 easiest is using the yarn.wikimedia.org UI
[13:48:03] <joal>	 isaacj: more precisely - https://yarn.wikimedia.org/cluster/scheduler
[13:48:23] <wikibugs>	 10Analytics: Add urlshortener button to Turnilo - https://phabricator.wikimedia.org/T233336 (10Milimetric) Adding this is dead simple, but Turnilo is upstream and so far we haven't customized it at all:  Deploying is literally just npm install and run the build output: https://gerrit.wikimedia.org/r/plugins/giti...
[13:48:25] <joal>	 isaacj: if you have more than 1 notebook, a little investigation might be needed
[13:49:12] <isaacj>	 hey joal ! thanks - this helps a lot. much more information that mapred job list!
[13:49:52] <joal>	 isaacj: by clicking on the rightmost link of a job, you get access to its dedicated UI - For spark it provides interesting info :)
[13:53:44] <isaacj>	 yeah, thanks for that pointer. looks like all the executors for this job were removed after an hour so i'm guessing that means i exceeded memory or something equivalent and the job was killed
[13:55:05] <joal>	 isaacj: spark runs by default in dynamic allocation mode - meaning, when the computation is done, executors get released, leaving on ly a single yarn container for the spark driver - maybe that is what happened?
[13:56:17] <isaacj>	 yeah, i'm only guessing based on what i expected to have happened -- they seem to have all been released at the same time according to the event timeline: https://yarn.wikimedia.org/proxy/application_1596639839773_71114/
[13:57:59] <joal>	 isaacj: indeed, seems coherent with the expected behavior
[14:01:37] <isaacj>	 joal: thanks! i'll see about giving it some more memory and maybe run it on a smaller dataset to make sure i know what a complete run looks like
[15:14:26] <milimetric>	 fdans: what a gem: https://vuex.vuejs.org/guide/strict.html
[15:15:00] <fdans>	 milimetric: oooo what the hell I've been looking for something like that for a while
[15:15:04] <fdans>	 it was there all along
[15:15:10] <milimetric>	 I know, same
[15:15:18] <fdans>	 milimetric: i was using Object.freeze on getters
[15:15:21] <milimetric>	 they say it's expensive to use, so only good for dev mode but that's totally fine
[15:15:44] <milimetric>	 yeah, so I think when we do our big refactor that'll be a great tool
[16:17:56] <wikibugs>	 10Analytics, 10Platform Team Sprints Board (Sprint 2), 10Platform Team Workboards (Green): Ingest api-gateway.request events to turnillo - https://phabricator.wikimedia.org/T261002 (10Pchelolo)
[16:45:43] <wikibugs>	 10Analytics-Radar, 10MediaWiki-REST-API, 10Patch-For-Review, 10Platform Team Sprints Board (Sprint 2), 10Platform Team Workboards (Green): Unify access log schema for Action API and API Gateway/REST API - https://phabricator.wikimedia.org/T259736 (10Naike)
[16:58:06] <wikibugs>	 10Analytics, 10Event-Platform, 10Technical-blog-posts: Story idea for Blog: Wikimedia's Event Platform - https://phabricator.wikimedia.org/T253649 (10srodlund) @Ottomata The third post looks good, too. I'm going to move it to the blog and schedule these to come out over the next few weeks. The last bit of in...
[17:48:24] <wikibugs>	 10Analytics, 10Growth-Team, 10Product-Analytics: PrefUpdate captures user preference modifications at registration - https://phabricator.wikimedia.org/T260867 (10nettrom_WMF) One question came up when discussing this task in the Growth team: are we seeing this pattern for user preferences from other extensio...