[06:21:42] morning! [06:50:26] hola :) [07:10:46] fdans: there are two refine failures in alerts@, can you check them today? [07:11:27] elukey: yes, will check now [07:11:36] super thanks [07:16:02] 10Analytics, 10Operations, 10serviceops, 10vm-requests, 10Patch-For-Review: Create a ganeti VM in eqiad: an-tool1008 - https://phabricator.wikimedia.org/T244717 (10elukey) 05Open→03Stalled Setting this to stalled since I'd need to figure out exactly how much disk space this host needs. [07:16:05] 10Analytics: Unify puppet roles for stat and notebook hosts - https://phabricator.wikimedia.org/T243934 (10elukey) [07:30:51] very weird, refinery-drop-older-than returns 0 when the exception of wrong checksum is raised [07:43:56] (03CR) 10Addshore: [C: 03+2] Add Time limit to scripts executed on stat1007 [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/572705 (https://phabricator.wikimedia.org/T243894) (owner: 10Rosalie Perside (WMDE)) [07:44:01] (03PS1) 10Addshore: Add Time limit to scripts executed on stat1007 [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/573211 (https://phabricator.wikimedia.org/T243894) [07:44:09] (03CR) 10Addshore: [C: 03+2] Add Time limit to scripts executed on stat1007 [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/573211 (https://phabricator.wikimedia.org/T243894) (owner: 10Addshore) [07:44:21] (03Merged) 10jenkins-bot: Add Time limit to scripts executed on stat1007 [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/572705 (https://phabricator.wikimedia.org/T243894) (owner: 10Rosalie Perside (WMDE)) [07:44:32] (03Merged) 10jenkins-bot: Add Time limit to scripts executed on stat1007 [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/573211 (https://phabricator.wikimedia.org/T243894) (owner: 10Addshore) [07:45:23] 10Analytics, 10Wikidata, 10Patch-For-Review, 10Wikidata-Campsite (Wikidata-Campsite-Iteration-∞): Add time limits to scripts executed on stat1007 as part of analytics/wmde/scripts - https://phabricator.wikimedia.org/T243894 (10Addshore) Moving to verification, and we should wait a couple of days to make su... [07:51:06] 10Analytics, 10Analytics-Kanban, 10ArticlePlaceholder, 10Wikidata, and 4 others: ArticlePlaceholder dashboard stopped tracking page views - https://phabricator.wikimedia.org/T236895 (10Addshore) Moving to waiting as we are waiting for analytics here, ping @JAllemandou @Nuria :) [07:56:59] (03PS1) 10Elukey: Improve logging and return codes in refinery-drop-older-than [analytics/refinery] - 10https://gerrit.wikimedia.org/r/573215 [08:05:32] 10Analytics: Unify puppet roles for stat and notebook hosts - https://phabricator.wikimedia.org/T243934 (10elukey) @JAllemandou after a chat with Andrew another idea came up, namely using an-tool1008 (or whatever we wanna call it) as generic Hadoop Job launcher, and move camus/timers/etc.. that are currently on... [08:10:26] elukey: the schema for which there are refine alerts is no longer used according to edit history in meta: https://meta.wikimedia.org/w/index.php?title=Schema:MobileWebMainMenuClickTracking&action=history [08:10:47] I can't remember what we do exactly if we want to stop refining this schema [08:14:15] (03CR) 10Fdans: [C: 03+1] "I agree it makes more sense to throw an error, so lgtm. Just one minor nit." (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/573215 (owner: 10Elukey) [08:17:50] fdans: ah I think we'd need to blacklist it in puppet [08:19:30] elukey: ah like this https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/556976/ [08:19:39] (03CR) 10Elukey: Improve logging and return codes in refinery-drop-older-than (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/573215 (owner: 10Elukey) [08:19:40] I'll update docs for this case [08:20:19] fdans: exactly! Do you want to send the code change? [08:20:32] elukey: yes I'll do it [08:20:45] (03CR) 10Fdans: [C: 03+1] Improve logging and return codes in refinery-drop-older-than (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/573215 (owner: 10Elukey) [08:55:57] elukey: ok with you to deploy refinery source? [08:58:41] hi team [08:58:57] fdans: yep! [08:59:12] thanks [08:59:16] fdans: There is plenty stuff to be reviewed before deploy [08:59:17] hello joal! [08:59:32] While some of it can wait, I think some should still be merged now [08:59:34] hi :) [08:59:43] sorry kids day, trying to do everything at once ?P) [08:59:45] :) [09:01:08] joal: oh I see the "to merge" sections of today's etherpad [09:01:23] fdans: just added that now to help :) [09:01:33] fdans: ok for you (need to leave in minutes) [09:01:36] ? [09:01:48] yeah [09:01:53] this is ready to be merged it seems https://gerrit.wikimedia.org/r/#/c/analytics/refinery/source/+/571981/ [09:02:29] indeed :) [09:03:02] There are 4 patches to merge, and 4 to wait [09:04:40] joal: to merge = we can merge them now? [09:04:59] to wait = we are not deploying them today? [09:06:43] correct fdans :) [09:07:12] fdans: I need to drop - I hope it all goes well :S Sorry for the short notice [09:07:49] joal: that's cool! I'll move the wait ones to next week's slot [09:09:12] great - thanks a lot! [09:20:07] (03CR) 10Fdans: [C: 03+2] Remove BannerImpressions streaming job and deps [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/571981 (https://phabricator.wikimedia.org/T245151) (owner: 10Joal) [09:21:11] (03CR) 10Fdans: [V: 03+2 C: 03+2] Remove BannerImpressions streaming job and deps [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/571981 (https://phabricator.wikimedia.org/T245151) (owner: 10Joal) [09:31:18] joal: I merged this one because it has +1s from nuria and ottomata, but the other three still need reviews [09:31:35] I'm helping with those reviews but I don't feel comfortable merging them myself right now [09:31:56] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Dropping data from druid takes down aqs hosts - https://phabricator.wikimedia.org/T226035 (10elukey) 05Open→03Resolved Didn't get any response from upstream, I think that the only feasible option is now to upgrade Druid and see if it r... [09:33:01] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Investigate sporadic failures in oozie hive actions due to Kerberos auth - https://phabricator.wikimedia.org/T241650 (10elukey) 05Open→03Resolved The issue didn't re-occur, closing :) [09:33:16] someone else should +1 those patches [09:33:30] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Enable encryption in Spark 2.4 by default - https://phabricator.wikimedia.org/T240934 (10elukey) 05Open→03Resolved [09:34:42] 10Analytics, 10Analytics-Kanban, 10service-runner, 10Patch-For-Review, 10User-Elukey: Upgrade service-runner on AQS to unblock rsyslog logging - https://phabricator.wikimedia.org/T236757 (10elukey) 05Open→03Resolved This has been successfully deployed to prod AQS and it worked. [09:34:46] 10Analytics, 10Analytics-Kanban, 10Operations, 10Wikimedia-Logstash, and 6 others: Move AQS logging to new logging pipeline - https://phabricator.wikimedia.org/T219928 (10elukey) [09:35:05] 10Analytics, 10Analytics-Kanban, 10Operations, 10Wikimedia-Logstash, and 6 others: Move AQS logging to new logging pipeline - https://phabricator.wikimedia.org/T219928 (10elukey) 05Open→03Resolved [09:50:39] brb [10:26:54] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: profile::hive::site_hdfs should work with kerberos-run-command - https://phabricator.wikimedia.org/T240880 (10elukey) The only issue left should be to enable the exec on a host with hive-site.xml and the hdfs keytab. I propose to elect as... [11:36:42] * elukey lunch! [11:56:46] 10Analytics, 10Operations: missing pig package on an-tool1006.eqiad.wmnet & analytics1030.eqiad.wmnet - https://phabricator.wikimedia.org/T245605 (10jbond) [11:57:01] 10Analytics, 10Operations: missing pig package on an-tool1006.eqiad.wmnet & analytics1030.eqiad.wmnet - https://phabricator.wikimedia.org/T245605 (10jbond) [11:57:16] 10Analytics, 10Operations: missing pig package on an-tool1006.eqiad.wmnet & analytics1030.eqiad.wmnet - https://phabricator.wikimedia.org/T245605 (10jbond) p:05Triage→03Medium [13:50:03] (03CR) 10Ottomata: [C: 03+1] Improve logging and return codes in refinery-drop-older-than [analytics/refinery] - 10https://gerrit.wikimedia.org/r/573215 (owner: 10Elukey) [13:53:00] 10Analytics, 10Operations: missing pig package on an-tool1006.eqiad.wmnet & analytics1030.eqiad.wmnet - https://phabricator.wikimedia.org/T245605 (10elukey) Hey John, yes I am aware of this, I am testing bigtop in Hadoop test and still wondering if users need pig or not. I'll find a solution very soon :) [13:58:45] 10Analytics, 10Operations: missing pig package on an-tool1006.eqiad.wmnet & analytics1030.eqiad.wmnet - https://phabricator.wikimedia.org/T245605 (10jbond) >>! In T245605#5897105, @elukey wrote: > Hey John, > > yes I am aware of this, I am testing bigtop in Hadoop test and still wondering if users need pig or... [14:31:09] questio for everybody - do we use pig in Hadoop? [14:31:19] (it is not present in BigTop) [14:31:31] nope! [14:31:39] not since 2011 :) [14:31:40] hehehh [14:31:48] ottomata: o/ [14:32:06] can I remove it from puppet then? I mean not deploying cdh::pig [14:32:13] yes i think so [14:32:14] https://github.com/wikimedia/kraken/tree/master/pig [14:32:17] heheh [14:32:41] the kraken! [14:44:34] stat1004 and stat1005 have now the same role! [14:46:59] 10Analytics, 10Analytics-Kanban, 10serviceops, 10Patch-For-Review: Create production and canary releases for existent eventgate helmfile services - https://phabricator.wikimedia.org/T245203 (10akosiaris) [15:10:20] elukey, you there? we're getting an "Exec format error" when running spark2-submit with kerberos-run-command, does it ring a bell to you? [15:10:41] mforns: from a timer? [15:10:48] no no, by hand [15:10:57] ah yes sorry it does [15:11:07] spark-submit doesn't have !#/bin/bash [15:11:11] at the top\ [15:11:13] so it fails [15:11:31] elukey, here's the code: https://pastebin.com/z0mtBPtq [15:11:49] (in a meeting, will check in a sec) [15:12:54] no worries, it works now! thanks :] [15:13:58] hey ottomata, I'm trying to do some work with pyspark on the notebook machines, and just discover that packages I install with pip are not recognized when I use the pypsark kernel. I don't the packages (mwutils) in all workers, just in the master [15:14:13] any works around for this? [15:14:37] dsaez: [15:14:37] https://wikitech.wikimedia.org/wiki/SWAP#PySpark_in_YARN_with_python_dependencies [15:15:06] oh but, i think you might not be able to use the provided pyspark kernel [15:15:16] (which is one of the reasons i'm considering getting rid of it) [15:15:45] I see [15:15:47] this section is relevant [15:15:48] https://wikitech.wikimedia.org/wiki/SWAP#Custom_Spark_Notebook_Kernels [15:15:58] you can do your own custom kernel with your own args to ship the venv [15:15:59] or [15:16:09] you can just use the python kernel and manually instantiate the sparksession [15:16:18] Yep, I have done some costumization to change the spark workers.. [15:16:23] ok cool [15:16:27] let see [15:16:36] ooh, manually start sounds also good [15:16:41] oh right you do that pyspark with some --notebook flag [15:16:50] ya [15:16:51] https://wikitech.wikimedia.org/wiki/SWAP#Launching_as_SparkSession_in_a_Python_Notebook [15:16:52] also [15:17:00] neil's wmfdata library has some wrapper to help with that [15:17:13] https://github.com/neilpquinn/wmfdata/blob/master/wmfdata/spark.py#L46 [15:18:13] also [15:18:14] https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Spark#Custom_virtual_environment [15:18:15] is relevant [15:29:35] (03PS1) 10Ottomata: Change default swift event_service_url to new eventgate-analytics port [analytics/refinery] - 10https://gerrit.wikimedia.org/r/573309 (https://phabricator.wikimedia.org/T245203) [15:33:34] elukey: yt? [15:35:58] 10Analytics, 10Analytics-Kanban, 10serviceops, 10Patch-For-Review: Create production and canary releases for existent eventgate helmfile services - https://phabricator.wikimedia.org/T245203 (10Ottomata) [15:41:04] ottomata: I am yes, in a meeting but free soon [15:41:07] what's ip? [15:41:12] ahhaha *up [15:41:41] heya [15:41:48] need to check on some analytics vlan stuuff [15:41:58] for [15:41:58] https://phabricator.wikimedia.org/T245203 [15:42:02] Make sure Analytics VLAN can reach eventgate-analytics on ports 35192 and 4592 [15:42:37] ah the new eventgate stuff [15:42:37] sure [15:42:37] (03PS2) 10Ottomata: Change default swift event_service_url to new eventgate-analytics port [analytics/refinery] - 10https://gerrit.wikimedia.org/r/573309 (https://phabricator.wikimedia.org/T245203) [15:43:27] never done via tool, going to file the code review now [15:44:05] ah wait [15:44:06] https://gerrit.wikimedia.org/r/#/c/operations/homer/public/+/562842/1/templates/cr/firewall.conf [15:44:14] ottomata: this right? --^ [15:44:52] ah cool! no we are changing those, but we can't quite remove them yet [15:44:56] until clients are changed [15:45:06] we need ports 35192 and 4592 opened [15:45:11] you can skip adding 4192 [15:45:12] if you like [15:45:37] w can remove 31192 and 4192 as part of the wrap up of the task [15:45:39] will add todo [15:46:33] 10Analytics, 10Analytics-Kanban, 10serviceops, 10Patch-For-Review: Create production and canary releases for existent eventgate helmfile services - https://phabricator.wikimedia.org/T245203 (10Ottomata) [15:47:57] ottomata: so basically destination-port [ 31192 35192 4592 ] right? [15:48:15] ya that should do it [15:48:24] and the ip is always the same? eventgate-analytics.svc.eqiad.wmnet ? [15:48:31] and we'll remove 31192 once clients are using new ports [15:48:34] yup that is the same [15:48:39] actually, discovery IP is good [15:48:43] which will route to that now [15:48:49] hmmm [15:48:55] not sure what best practice is [15:49:03] maybe best to add both codfw and eqiad ips elukey ? [15:49:13] eventgate-analytics.svc.codfw.wmnet too [15:49:14] I was about to say the same [15:49:16] k [15:51:40] ottomata: updated https://gerrit.wikimedia.org/r/#/c/operations/homer/public/+/562842/ [15:51:52] ty +1! [15:55:02] ottomata: [15:55:05] dsaez@notebook1003:~$ pip install --upgrade --no-index --ignore-installed --find-links=/srv/jupyterhub/deploy/artifacts/stretch/wheels --requirement=/srv/jupyterhub/deploy/frozen-requirements.txt [15:55:05] WARNING: Requirement './toree-0.2.0.tar.gz' looks like a filename, but the file does not exist [15:55:05] Looking in links: /srv/jupyterhub/deploy/artifacts/stretch/wheels [15:55:05] Processing ./toree-0.2.0.tar.gz [15:55:06] ERROR: Could not i [15:55:24] (sorry for bothering you, don't need to answer now) [15:55:54] oh hm [15:56:51] dsaez: try cd-ing into /srv/jupyterhub/deploy [15:56:52] and then running [15:57:23] I love the verb cd-ing [15:57:57] that works, thanks! [16:05:24] ottomata: done! [16:06:43] 10Analytics, 10Analytics-Kanban, 10serviceops, 10Patch-For-Review: Create production and canary releases for existent eventgate helmfile services - https://phabricator.wikimedia.org/T245203 (10Ottomata) [16:07:06] verified it works, thank you [16:07:33] (03CR) 10Ottomata: [V: 03+2 C: 03+2] Change default swift event_service_url to new eventgate-analytics port [analytics/refinery] - 10https://gerrit.wikimedia.org/r/573309 (https://phabricator.wikimedia.org/T245203) (owner: 10Ottomata) [16:07:44] 10Analytics, 10Inuka-Team, 10Product-Analytics: Set up pageview counting for KaiOS app - https://phabricator.wikimedia.org/T244547 (10hueitan) > Ahh, okay. Based on a quick check of the code, it looks like the app is [fetcing pages](https://github.com/wikimedia/wikipedia-kaios/blob/master/src/api/getArticle.... [16:09:48] ottomata: homer is soooo nice, all automated [16:09:57] that is so coool [16:09:57] I don't have to re-type the same config in all routers [16:10:01] I am crying [16:14:22] so amazing ya [16:14:22] thank you [16:14:28] a-team i haven't done refinery deploys in a while [16:14:51] is it ok if I deploy this https://gerrit.wikimedia.org/r/c/analytics/refinery/+/573309 [16:14:58] there are a few discovery oozie coords to restart [16:15:01] i can do that with them [16:15:07] ? [16:18:02] ottomata: i was going to delay the train to tomorrow because there are a lot of patches in the train etherpad that aren't merged yet [16:19:15] aye, i don't need any source changes for this [16:20:19] ottomata: if you wanna deploy... can you wait a second to correct the refine whitelist? [16:20:26] sure! [16:21:20] (03PS1) 10Mforns: Correct indentation of EventLogging sanitization white-list [analytics/refinery] - 10https://gerrit.wikimedia.org/r/573324 (https://phabricator.wikimedia.org/T245285) [16:22:03] (03CR) 10Fdans: [V: 03+2 C: 03+2] "ಠ_ಠ" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/573324 (https://phabricator.wikimedia.org/T245285) (owner: 10Mforns) [16:22:24] ottomata: feel free to proceed! [16:23:42] (03CR) 10Ottomata: "Just realized we use 4 space yaml and that is different than everywhere else ( ✜︵✜ )" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/573324 (https://phabricator.wikimedia.org/T245285) (owner: 10Mforns) [16:23:51] ok ty! [16:45:15] (03CR) 10Mforns: [C: 03+1] "1 nit-picky comment, but looks great to me!" (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/573215 (owner: 10Elukey) [16:58:29] !log Deployed refinery using scap, then deployed onto hdfs [16:58:30] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [16:59:45] 10Analytics, 10Analytics-Cluster: Hadoop Hardware Orders FY2019-2020 - https://phabricator.wikimedia.org/T243521 (10Ottomata) [17:00:23] 10Analytics, 10Analytics-Cluster: Hadoop Hardware Orders FY2019-2020 - https://phabricator.wikimedia.org/T243521 (10Ottomata) FYI @robh, we will only need 22 10G ports in eqiad now, since we are not refreshing the leased nodes this year :) [17:05:59] 10Analytics, 10Operations, 10Patch-For-Review: missing pig package on an-tool1006.eqiad.wmnet & analytics1030.eqiad.wmnet - https://phabricator.wikimedia.org/T245605 (10elukey) 05Open→03Resolved [17:11:05] (03PS2) 10Elukey: Improve logging and return codes in refinery-drop-older-than [analytics/refinery] - 10https://gerrit.wikimedia.org/r/573215 [17:11:17] (03CR) 10Elukey: ">" (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/573215 (owner: 10Elukey) [17:13:05] (03PS3) 10Elukey: Improve logging and return codes in refinery-drop-older-than [analytics/refinery] - 10https://gerrit.wikimedia.org/r/573215 [17:17:12] (03CR) 10Mforns: [C: 03+2] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/573215 (owner: 10Elukey) [17:23:44] 10Analytics, 10Release-Engineering-Team-TODO, 10Continuous-Integration-Infrastructure (phase-out-jessie), 10Release-Engineering-Team (CI & Testing services): Migrate analytics/refinery/source release jobs to Docker - https://phabricator.wikimedia.org/T210271 (10Jdforrester-WMF) For clarity, this needs the... [17:25:13] 10Analytics, 10Analytics-Kanban, 10serviceops: Clarify multi-service instance concepts in helm charts and enable canary releases - https://phabricator.wikimedia.org/T242861 (10Ottomata) [17:25:44] (03CR) 10Joal: "comment on comment and a dumb question - should be merged tonight I think." (034 comments) [analytics/aqs] - 10https://gerrit.wikimedia.org/r/570608 (https://phabricator.wikimedia.org/T244373) (owner: 10Fdans) [17:26:00] fdans: --^ Let's make a quick turnaround on that and have it merged :) [17:26:40] (03CR) 10Elukey: [V: 03+2] Improve logging and return codes in refinery-drop-older-than [analytics/refinery] - 10https://gerrit.wikimedia.org/r/573215 (owner: 10Elukey) [17:27:16] 10Analytics, 10Analytics-Kanban, 10serviceops: Clarify multi-service instance concepts in helm charts and enable canary releases - https://phabricator.wikimedia.org/T242861 (10Ottomata) [17:29:22] 10Analytics, 10Analytics-Kanban, 10serviceops: Clarify multi-service instance concepts in helm charts and enable canary releases - https://phabricator.wikimedia.org/T242861 (10Ottomata) Updated the task description with details of the way eventgate is now doing this. [17:31:52] 10Analytics, 10Analytics-Kanban, 10serviceops: Clarify multi-service instance concepts in helm charts and enable canary releases - https://phabricator.wikimedia.org/T242861 (10Ottomata) [17:45:45] 10Analytics, 10Release-Engineering-Team-TODO, 10Continuous-Integration-Infrastructure (phase-out-jessie), 10Release-Engineering-Team (CI & Testing services): Migrate analytics/refinery/source release jobs to Docker - https://phabricator.wikimedia.org/T210271 (10Ottomata) Ah I don't think we were aware ther... [18:04:00] (03PS4) 10Fdans: Url encode file name before querying the data store [analytics/aqs] - 10https://gerrit.wikimedia.org/r/570608 (https://phabricator.wikimedia.org/T244373) [18:04:10] (03CR) 10Fdans: Url encode file name before querying the data store (033 comments) [analytics/aqs] - 10https://gerrit.wikimedia.org/r/570608 (https://phabricator.wikimedia.org/T244373) (owner: 10Fdans) [18:10:54] (03CR) 10Joal: [C: 03+2] "LGTM ! Merging - Thanks Fran" [analytics/aqs] - 10https://gerrit.wikimedia.org/r/570608 (https://phabricator.wikimedia.org/T244373) (owner: 10Fdans) [18:11:05] Thanks fdans :) [18:11:33] (03Merged) 10jenkins-bot: Url encode file name before querying the data store [analytics/aqs] - 10https://gerrit.wikimedia.org/r/570608 (https://phabricator.wikimedia.org/T244373) (owner: 10Fdans) [18:13:56] * elukey ofF! [18:29:05] joal: many thanks for reviewing this joseph, will deploy tomorrow as part of the train [18:30:24] 10Analytics, 10Analytics-Kanban, 10Multimedia, 10Tool-Pageviews, 10Patch-For-Review: Fix double encoding of urls on mediarequests api - https://phabricator.wikimedia.org/T244373 (10fdans) @MusikAnimal FYI this change will be deployed tomorrow [18:36:52] ack fdans :) [18:39:35] ottomata: if you have a minute, I have revamped the design doc again :) [18:39:47] leaving for diner :) [18:53:19] joal: hey [18:53:22] looking! [19:07:13] joal: i'm going to try and stuff to the long term plan section ... :) [19:12:36] 10Analytics-EventLogging, 10Analytics-Kanban, 10Event-Platform, 10CPT Initiatives (Modern Event Platform (TEC2)), and 2 others: Modern Event Platform (TEC2) - https://phabricator.wikimedia.org/T185233 (10Ottomata) [19:19:13] 10Analytics-EventLogging, 10Analytics-Kanban, 10Event-Platform, 10CPT Initiatives (Modern Event Platform (TEC2)), and 2 others: Modern Event Platform (TEC2) - https://phabricator.wikimedia.org/T185233 (10Ottomata) [19:24:27] 10Analytics-EventLogging, 10Analytics-Kanban, 10Event-Platform, 10CPT Initiatives (Modern Event Platform (TEC2)), and 2 others: Modern Event Platform (TEC2) - https://phabricator.wikimedia.org/T185233 (10Ottomata) [19:48:11] ok, edited a bit, added some stuff in long term plan [19:48:20] also have some comments [20:32:12] 10Analytics, 10Analytics-EventLogging, 10Event-Platform, 10Operations, and 5 others: Public EventGate instance and endpoint for analytics event intake: eventgate-analytics-external - https://phabricator.wikimedia.org/T233629 (10Ottomata) [20:33:29] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Event-Platform, and 6 others: Public EventGate instance and endpoint for analytics event intake: eventgate-analytics-external - https://phabricator.wikimedia.org/T233629 (10Ottomata) [20:33:53] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Event-Platform, and 6 others: Public EventGate instance and endpoint for analytics event intake: eventgate-analytics-external - https://phabricator.wikimedia.org/T233629 (10Ottomata) a:03Ottomata [20:35:15] 10Analytics, 10Analytics-Kanban, 10serviceops, 10Patch-For-Review: Create production and canary releases for existent eventgate helmfile services - https://phabricator.wikimedia.org/T245203 (10Ottomata) [22:03:04] 10Analytics, 10Analytics-Kanban: Support CSV uploads in Superset - https://phabricator.wikimedia.org/T245679 (10Ottomata) [22:05:55] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Support CSV uploads in Superset - https://phabricator.wikimedia.org/T245679 (10Ottomata) We just need https://gerrit.wikimedia.org/r/c/operations/puppet/+/573393. That + enabling this for the mysql_staging database in superset (which I already did) works!... [22:15:05] 10Analytics, 10Better Use Of Data, 10Performance-Team, 10Product-Analytics, and 2 others: Switch mw.user.sessionId back to session-cookie persistence - https://phabricator.wikimedia.org/T223931 (10mpopov) Thanks @jlinehan for announcing the change to product-all@, research-internal@lists, and analytics@lists