[01:11:16] 10Analytics: Optimization tips and feedback - https://phabricator.wikimedia.org/T245373 (10Nuria) 05Open→03Resolved [04:59:15] (03PS1) 10AndyRussG: Add CentralNoticeBannerHistory schema to EventLogging whitelist [analytics/refinery] - 10https://gerrit.wikimedia.org/r/572767 (https://phabricator.wikimedia.org/T245285) [04:59:53] 10Analytics, 10Fundraising-Backlog, 10Fundraising Sprint CAPS LOCK CULTS, 10Patch-For-Review: Whitelist CentralNotice banner history events for sanitaization and long-term storage - https://phabricator.wikimedia.org/T245285 (10AndyRussG) [07:31:29] 10Analytics: Create a Kerberos access for sguebo - https://phabricator.wikimedia.org/T244913 (10elukey) 05Open→03Resolved [07:35:33] 10Analytics, 10Operations: Remove references to m4-master - https://phabricator.wikimedia.org/T245238 (10elukey) [07:35:59] 10Analytics, 10Operations: Remove references to m4-master - https://phabricator.wikimedia.org/T245238 (10elukey) My bad, I thought that this task was only for the DNS change :) [07:43:13] 10Analytics, 10Analytics-Kanban, 10LDAP-Access-Requests, 10Operations: LDAP access to the wmf group for CherRaye Glenn (superset, turnilo, hue) - https://phabricator.wikimedia.org/T244410 (10elukey) Done! [07:43:16] 10Analytics, 10Analytics-Kanban, 10LDAP-Access-Requests, 10Operations: LDAP access to the wmf group for CherRaye Glenn (superset, turnilo, hue) - https://phabricator.wikimedia.org/T244410 (10elukey) 05Open→03Resolved [07:43:21] 10Analytics, 10Pageviews-API: Pageviews missing for titles with emojis since April 23, 2019 - https://phabricator.wikimedia.org/T245468 (10fdans) yep https://en.wikipedia.org/w/index.php?title=%F0%9F%8D%86&redirect=no [08:21:36] 10Analytics, 10Analytics-Kanban: Change link in wikis footer so that they point to stats.wikimedia.org - https://phabricator.wikimedia.org/T244961 (10fdans) a:03fdans [08:33:30] 10Analytics, 10Analytics-Kanban: Make history and current wikitext available in hadoop - https://phabricator.wikimedia.org/T238858 (10JAllemandou) It's been done a few days ago :) https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake/Content/XMLDumps/Mediawiki_wikitext_current exists as well. [08:36:25] Good morning team ! I found a nurse-replacement, I'll be able to work at normal times today (hopefully) [08:37:25] bonjour :) [08:38:15] elukey, how are you? [08:38:32] good, how's Nae doing? [08:38:35] I'm sorry not to have been present for our usual casual morning talks [08:39:32] All good - We think the floutishing peak is behind (possibly a magical thought, but still feels good) [08:41:45] well you had stuff to do :) [08:43:36] elukey joal am I missing something or we used to be able to edit with the visual editor in wikitech and now I don't see the option? [08:43:56] I'm here editing the ops week doc in wikitext like we're in 1765 [08:43:56] fdans: it makes some time I'm not able to see the option either :( [08:44:17] yeah same thing, not sure why VE is disabled [08:46:21] hmm, in normal wikis you'd see that in the "beta" page [08:46:25] but not sure about wikitech [08:56:24] (03PS1) 10Fdans: Add Saizakaya Wikipedia to sqoop list [analytics/refinery] - 10https://gerrit.wikimedia.org/r/572819 (https://phabricator.wikimedia.org/T237378) [08:56:54] (03PS2) 10Fdans: Add Sakizaya Wikipedia to sqoop list [analytics/refinery] - 10https://gerrit.wikimedia.org/r/572819 (https://phabricator.wikimedia.org/T237378) [08:57:58] 10Analytics: Revise wiki scoop list from labs once a quarter - https://phabricator.wikimedia.org/T239136 (10fdans) Checked! Sakizaya Wikipedia added to the list. [08:58:33] 10Analytics: Revise wiki scoop list from labs once a quarter - https://phabricator.wikimedia.org/T239136 (10fdans) a:05fdans→03None [08:58:35] (03CR) 10Mforns: Fix webrequest host normalization (032 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/572726 (https://phabricator.wikimedia.org/T245453) (owner: 10Joal) [09:00:35] (03CR) 10Mforns: [C: 03+2] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/572819 (https://phabricator.wikimedia.org/T237378) (owner: 10Fdans) [09:01:06] thank you mforns :) you’re early today! [09:01:17] :] hey! [09:01:26] yes [09:20:05] hey folks, has anybody checked the refine failures in alerts@? [09:20:19] I have not elukey [09:20:55] fdans: if you have the on-call week, can you check them when you have a moment? [09:28:04] elukey: yesh [09:29:28] (03CR) 10Fdans: [V: 03+2] Add Sakizaya Wikipedia to sqoop list [analytics/refinery] - 10https://gerrit.wikimedia.org/r/572819 (https://phabricator.wikimedia.org/T237378) (owner: 10Fdans) [09:36:55] opened two jiras to bigtop yesterday, got all the answers during the night [09:37:05] strange feeling, I was used to cloudera [09:37:10] elukey: Much love to them <3 [09:37:13] :) [09:38:01] elukey: are those answers positive in any way? [09:38:39] joal: sort of, for debian buster I think that it should be easy to add the builds to their CI [09:38:55] Yay! [09:39:02] for the openssl thing I have some info about how to check their docker images [09:39:08] I think it will be a long one [09:39:10] sigh [09:40:04] :( [10:35:31] (03PS3) 10Joal: Add wikidata item_page_link spark job [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/572746 [10:37:11] (03PS1) 10Joal: Add wikidata item_page_link oozie job [analytics/refinery] - 10https://gerrit.wikimedia.org/r/572834 [11:00:04] ah! https://github.com/apache/hadoop/commit/138c1ed5660f713d24bfebc44ea1846f76c00cb9 [11:00:11] I think this is what is missing from bigtop [11:00:49] moritzm: --^ [11:00:51] Wow - elukey, master of hadoop code [11:02:00] joal: suuuuuure [11:02:20] I am basically trying to make sense of openssl: false EVP_CIPHER_CTX_cleanup [11:02:28] that commit was not backported to BigTop [11:02:52] (03PS2) 10Joal: Add wikidata item_page_link oozie job [analytics/refinery] - 10https://gerrit.wikimedia.org/r/572834 [11:03:10] mwarf, forgot to rebase [11:07:31] (03PS6) 10Joal: Add oozie job converting wikidata dumps to parquet [analytics/refinery] - 10https://gerrit.wikimedia.org/r/569836 (https://phabricator.wikimedia.org/T209655) [11:07:33] (03PS3) 10Joal: Add wikidata item_page_link oozie job [analytics/refinery] - 10https://gerrit.wikimedia.org/r/572834 [11:07:35] the fact that only we are seeing the issue tells a lot about how many people use encryption in hadoop :P [11:07:36] here we go [11:07:47] mwhahaha :) [11:08:03] encryption - what an idea when Gleugleu knows all about us :) [11:09:38] security is overrated, I keep telling that to Moritz [11:09:42] * elukey runs away [11:11:49] (03CR) 10Ladsgroup: [C: 03+1] "LGTM, I let it wait for a bit and then I merge if no one else beats me to it." [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/572705 (https://phabricator.wikimedia.org/T243894) (owner: 10Rosalie Perside (WMDE)) [11:25:20] (03PS4) 10Joal: Add wikidata item_page_link oozie job [analytics/refinery] - 10https://gerrit.wikimedia.org/r/572834 [11:25:51] * elukey lunch! [11:32:25] (03PS1) 10Joal: Update jar version in wikitext-dump jobs [analytics/refinery] - 10https://gerrit.wikimedia.org/r/572840 [11:33:22] 10Analytics, 10Analytics-Kanban, 10Research-Backlog, 10Wikidata, 10Patch-For-Review: Copy Wikidata dumps to HDFS + parquet - https://phabricator.wikimedia.org/T209655 (10JAllemandou) [11:34:11] 10Analytics, 10Analytics-Kanban: Fix wikitext-generation jobs (use 0.0.114 jar) - https://phabricator.wikimedia.org/T245496 (10JAllemandou) [11:34:25] 10Analytics, 10Analytics-Kanban: Fix wikitext-generation jobs (use 0.0.114 jar) - https://phabricator.wikimedia.org/T245496 (10JAllemandou) a:03JAllemandou [11:34:54] (03PS2) 10Joal: Update jar version in wikitext-dump jobs [analytics/refinery] - 10https://gerrit.wikimedia.org/r/572840 (https://phabricator.wikimedia.org/T245496) [11:36:48] (03PS7) 10Joal: Add oozie job converting wikidata dumps to parquet [analytics/refinery] - 10https://gerrit.wikimedia.org/r/569836 (https://phabricator.wikimedia.org/T209655) [11:36:49] (03PS5) 10Joal: Add wikidata item_page_link oozie job [analytics/refinery] - 10https://gerrit.wikimedia.org/r/572834 [11:39:35] (03PS4) 10Joal: Add wikidata item_page_link spark job [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/572746 [11:51:34] (03PS2) 10Joal: Fix GetGeoDataUDF and underlying function [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/553726 (https://phabricator.wikimedia.org/T238432) [11:58:05] (03CR) 10Joal: "Tested on cluster :)" (034 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/553726 (https://phabricator.wikimedia.org/T238432) (owner: 10Joal) [12:05:12] (03PS1) 10Joal: Bump webrequest load hive jar to 0.0.114 [analytics/refinery] - 10https://gerrit.wikimedia.org/r/572846 (https://phabricator.wikimedia.org/T245453) [12:08:48] (03CR) 10Joal: Fix webrequest host normalization (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/572726 (https://phabricator.wikimedia.org/T245453) (owner: 10Joal) [12:15:21] (03PS3) 10Joal: Fix GetGeoDataUDF and underlying function [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/553726 (https://phabricator.wikimedia.org/T238432) [12:17:47] (03PS5) 10Joal: Add wikidata item_page_link spark job [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/572746 [12:26:36] 10Analytics, 10User-Elukey: CDH Jessie dependencies not available on Stretch - https://phabricator.wikimedia.org/T214364 (10elukey) 05Open→03Declined Focusing on BigTop for the moment, will re-open if necessary. [12:40:51] (03PS8) 10Joal: Add oozie job converting wikidata dumps to parquet [analytics/refinery] - 10https://gerrit.wikimedia.org/r/569836 (https://phabricator.wikimedia.org/T209655) [12:40:53] (03PS6) 10Joal: Add wikidata item_page_link oozie job [analytics/refinery] - 10https://gerrit.wikimedia.org/r/572834 [12:48:31] (03CR) 10Addshore: [C: 03+1] Add Time limit to scripts executed on stat1007 [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/572705 (https://phabricator.wikimedia.org/T243894) (owner: 10Rosalie Perside (WMDE)) [12:55:47] 10Analytics, 10Analytics-Kanban: Move the Analytics infrastructure to Debian Buster - https://phabricator.wikimedia.org/T234629 (10elukey) [12:56:05] \o/ ! Finally I got it right :) [12:56:31] (03CR) 10Joal: "Tested on cluster" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/572834 (owner: 10Joal) [13:04:31] elukey: helloooo do you have a few minutes to delete some data with me when you're back? [13:35:34] fdans: I am here! [13:35:58] elukey: helloooo bc? [13:36:04] sure! [14:24:12] 10Analytics, 10Product-Analytics, 10Growth-Team (Current Sprint): Homepage: purge sanitized event data through 2019-11-04 - https://phabricator.wikimedia.org/T244312 (10fdans) Purge complete! For `event_sanitized.homepagevisit` ` PYTHONPATH=/srv/deployment/analytics/refinery/python /srv/deployment/analytics... [14:29:54] 10Analytics, 10Product-Analytics: Check home leftovers of dfoy - https://phabricator.wikimedia.org/T239571 (10fdans) Just removed `/wmf/data/archive/backup/zero-raw-logs-for-dan-foy` so this concludes this task. [14:30:45] 10Analytics, 10Analytics-Kanban, 10Product-Analytics: Check home leftovers of dfoy - https://phabricator.wikimedia.org/T239571 (10fdans) [14:31:00] 10Analytics, 10Analytics-Kanban, 10Product-Analytics, 10Growth-Team (Current Sprint): Homepage: purge sanitized event data through 2019-11-04 - https://phabricator.wikimedia.org/T244312 (10fdans) [14:36:29] 10Analytics, 10Patch-For-Review: Install Debian Buster on Hadoop - https://phabricator.wikimedia.org/T231067 (10elukey) 05Open→03Stalled The current idea is to move to BigTop first (on Stretch) and then wait for the upcoming 1.5 release that should natively support Buster. Marking this task as stalled unt... [14:36:31] 10Analytics, 10Analytics-Kanban: Move the Analytics infrastructure to Debian Buster - https://phabricator.wikimedia.org/T234629 (10elukey) [14:57:30] 10Analytics, 10Analytics-Kanban: Move the Analytics infrastructure to Debian Buster - https://phabricator.wikimedia.org/T234629 (10elukey) [14:58:15] 10Analytics, 10Analytics-Kanban: Move the Analytics infrastructure to Debian Buster - https://phabricator.wikimedia.org/T234629 (10elukey) [14:58:31] 10Analytics, 10Analytics-Kanban: Move the Analytics infrastructure to Debian Buster - https://phabricator.wikimedia.org/T234629 (10elukey) [15:01:35] 10Analytics, 10Analytics-Kanban, 10Product-Analytics, 10Growth-Team (Current Sprint): Homepage: purge sanitized event data through 2019-11-04 - https://phabricator.wikimedia.org/T244312 (10nettrom_WMF) 05Open→03Resolved Verified in Hive that data is not available for any of the three schemas up through... [15:20:57] ottomata: heya - I have updated quite some the document on dataflow - Would you mind having a read so that we can discuss and modify? [15:21:16] dataflow? [15:21:47] ottomata: that's the name of the thing we work with CPT [15:21:54] ah! [15:21:56] haha ok dataflow [15:21:59] :) [15:22:00] link? [15:22:02] sure [15:22:05] https://docs.google.com/document/d/1IacO1l5Y0uGrVnOZQ-3JskZaRqtiwqvpAffmAlJZquQ/edit#heading=h.j97d9ffe2e95 [15:28:43] * elukey afk for a bit! [15:31:52] joal looks really really good [15:31:53] very clear [15:31:57] and understandable [15:32:11] \o/ ! [15:32:25] added one comment [15:32:43] it'd be nice if the code page-stats-updater code was both flink if we are planning to do streaming updates eventuually [15:32:56] for batch too [15:33:24] also, for a more general page-stats store, we really should consider other things than just cassandra [15:35:52] ottomata: I'm not opposed doing flink for batch - I'm afraid because I don't know it as well as spark but it's worth a try :) [15:36:03] indeed [15:36:23] ya, and maybe we already have spark stuff ready to go? [15:36:32] for this specific use case spark might be right [15:36:39] but if we do plan to go lambda arch [15:36:48] we should start unifiying the code that does computation with flink [15:37:09] As for datastores, I'm gonna add a paragraph in the lambda section explaining different use-cases [15:38:13] ottomata: I wouldn't talk about unification for real before having tried flink for batch and prove that it's as good as spark :) [15:38:29] ottomata: It's the burden of lambda: possibly 2 code bases [15:38:57] joal: ya but, ideally flink reduces that burden , no? [15:39:42] ottomata: it'll be for us to try to find whether the cost of maintaining spark+flink is higher than to solve flink only issues :) [15:39:57] intersting times [15:40:58] indeed. if we are coding new stuff that we don't yet have done in spark, flink might be the way to go. But we already some ingestion code in spark, (we already have druid and cassandra, right?), it probably is not worth re-writing that in flink now [15:41:22] ottomata: I'd also like to discuss datastores if you have a minute - While I'm very open to datastore matching use-cases, I think in the precise example we have cassandra is probably the correct one to use [15:41:42] oh ya? [15:41:59] 10Analytics, 10Fundraising-Backlog, 10WMDE-Analytics-Engineering, 10WMDE-FUN-Team, 10WMDE-Fundraising-Tech: Find a better way for WMDE to get impression counts for their banners - https://phabricator.wikimedia.org/T243092 (10AndyRussG) > if the sampling ratio of the data on that table is good enough then... [15:42:06] i think petr might disagree, not sure. but i think my other datastore suggestion is more around the generic use case, not just this one [15:42:16] i think you are right for this specific use case we shouldl just buildl it into AQS [15:42:25] but i think folks will want to be able to more easily add new stats and featurues [15:42:31] one day [15:42:46] and iiuc cassandra isn't the easiest to do this in; too much pre-computation is needed [15:43:20] hm [15:44:29] ottomata: trying to provide a simplified view of my mind for datastores: cassandra = KV store, druid = OLAP, ES = Search engine [15:44:51] I think ES = Search engine might be too limited :) [15:44:57] but there also might be others out there [15:45:05] there is something in between KV and OLAP that might be needed [15:45:21] tell me more please ottomata :) [15:45:21] the big picture here is to enable features in mediawiki that mediawiki+mysql can't handle [15:45:32] not just page status [15:45:32] right [15:45:33] stats* [15:45:38] but actual user features [15:46:32] often product folks are limited because they can't build something because mysql won't handle it, or MW won't handle it [15:46:43] JADE maybe is a good example (not sure) [15:47:13] the big picture is to have a secondary non MW datastore (and computation framework) that allows devs to build new features [15:47:26] this datastore+engine won't solve ALL use cases [15:47:36] but we'd like it to solve many of them that MySQL currently lcan't [15:47:44] ok let's put it this way then ottomata - Since 1-size-fit-all is a fail, we'll probably need data-duplication in various systems with various pivoting/reshaping depending on use-cases [15:48:04] 1 size fits all is fail for sure. we are looking for 1 size fits most/many [15:49:02] in the meetings we had recently we wanted to collect more use cases to try and fit big picture sollution to 'many' of them [15:49:18] YES --^ [15:49:19] dependency tracking probably would not fit here; the graph db stuff is too different [15:49:26] but there are many others [15:49:27] agreed [15:49:36] we're talking user-oriented data features [15:49:42] ya [15:50:13] likely the WDQS updates stuff is relevant; not so much for final WDQS arch, but perhaps intermediate datasets used for it [15:50:36] and, i think these use cases will mostly be around user-oriented 'derived' data features [15:50:48] agreed [15:51:23] the datastore won't necessarily store any canonical data (that would be a much bigger project), but should conatain be realtimish (lamba) updateable data that is also queryable by many different user facing services [15:52:03] on that --^ I kinda disagree [15:52:32] which part? [15:52:42] I think we need a store to serve canonical data - The use case about page-stats is exactly that [15:53:03] I don't discuss the store to have to handle [15:53:24] real-time-ish data, but it also should be able to handle more canonical I think [15:53:45] And then, which store in my mind depends a lot of how data is to accessed [15:54:21] if we think of that data to access at granular level, cassandra will be our friend - If we think agregate then druid [15:55:31] The reason for which I don't like ES for those use cases is because it's extremely good at handling text and search through text and associated stats, but it less performant in term of read/write than the other two [15:55:57] anyway - Thanks for the read, will add my views on serving-layer datastores to the doc :) [15:56:34] joal: aye, maybe ES isn't the answer but we should explore it and maybe other options too [15:56:54] yessir :) At some point we're gonna do some hbase :-P [15:56:57] druid might be too time series based. Cassandra requires a lot of precomputation [15:56:59] hahah [15:57:15] but for canonical data, not sure we want to tackle that. [15:57:39] by canoncial data, i mean data that mediawiki itself needs for operation [15:58:00] e.g. revision table [15:58:17] the stuff we should tackle here is derived data [15:58:33] data that could theoretical be re-derived from stuff in mysql [15:58:58] ottomata: I understand the point and agre very much [16:00:30] the definition of what is derived is also interestingly subject ot change - Will be FUN ! [16:02:47] :) [16:17:45] 10Analytics, 10Analytics-Kanban, 10Product-Analytics: Check home leftovers of dfoy - https://phabricator.wikimedia.org/T239571 (10Nuria) 05Open→03Resolved [16:27:45] 10Analytics: Revise wiki scoop list from labs once a quarter - https://phabricator.wikimedia.org/T239136 (10Nuria) @fdans code change for scoop list? [16:28:34] 10Analytics: Revise wiki scoop list from labs once a quarter - https://phabricator.wikimedia.org/T239136 (10Nuria) Ah, i see it is here: https://gerrit.wikimedia.org/r/#/c/572819/ [16:28:38] 10Analytics: Revise wiki scoop list from labs once a quarter - https://phabricator.wikimedia.org/T239136 (10fdans) @Nuria in the task about it: https://phabricator.wikimedia.org/T237378 https://gerrit.wikimedia.org/r/572819 [16:31:44] 10Analytics, 10Fundraising-Backlog, 10Fundraising Sprint CAPS LOCK CULTS, 10Patch-For-Review: Whitelist CentralNotice banner history events for sanitaization and long-term storage - https://phabricator.wikimedia.org/T245285 (10Nuria) This would take effect once we deploy it but #analytics needs to run a re... [16:32:45] (03CR) 10Nuria: [C: 03+2] Add CentralNoticeBannerHistory schema to EventLogging whitelist [analytics/refinery] - 10https://gerrit.wikimedia.org/r/572767 (https://phabricator.wikimedia.org/T245285) (owner: 10AndyRussG) [16:32:51] (03CR) 10Nuria: [V: 03+2 C: 03+2] Add CentralNoticeBannerHistory schema to EventLogging whitelist [analytics/refinery] - 10https://gerrit.wikimedia.org/r/572767 (https://phabricator.wikimedia.org/T245285) (owner: 10AndyRussG) [16:33:57] 10Analytics, 10Fundraising-Backlog, 10Fundraising Sprint CAPS LOCK CULTS, 10Patch-For-Review: Whitelist CentralNotice banner history events for sanitaization and long-term storage - https://phabricator.wikimedia.org/T245285 (10AndyRussG) >>! In T245285#5893524, @Nuria wrote: > This would take effect once w... [16:51:15] 10Analytics, 10Fundraising-Backlog, 10Fundraising Sprint CAPS LOCK CULTS, 10Patch-For-Review: Whitelist CentralNotice banner history events for sanitaization and long-term storage - https://phabricator.wikimedia.org/T245285 (10Ottomata) > needs to run a refine job from the begging of the data stream being... [17:00:31] 10Analytics, 10Analytics-Kanban, 10serviceops: Create production and canary releases for existent eventgate helmfile services - https://phabricator.wikimedia.org/T245203 (10Ottomata) [17:01:13] standuuuuppp [17:01:20] ottomata, joal, mforns [17:01:41] ping ottomata , mforns , joal [17:01:52] 10Analytics, 10Fundraising-Backlog, 10Fundraising Sprint CAPS LOCK CULTS, 10Patch-For-Review: Whitelist CentralNotice banner history events for sanitaization and long-term storage - https://phabricator.wikimedia.org/T245285 (10AndyRussG) >>! In T245285#5893599, @Ottomata wrote: > There should be 90 days av... [17:01:55] 5 dollars in the jar for every minute [17:01:58] :D [17:03:13] IUH OH [17:03:57] 10Analytics, 10Analytics-Kanban: Analytics datasets should be under a free license - https://phabricator.wikimedia.org/T244685 (10Nuria) [17:16:41] 10Analytics, 10Fundraising-Backlog, 10Fundraising Sprint CAPS LOCK CULTS, 10Patch-For-Review: Whitelist CentralNotice banner history events for sanitaization and long-term storage - https://phabricator.wikimedia.org/T245285 (10Nuria) a:05AndyRussG→03fdans [17:19:00] 10Analytics, 10Fundraising-Backlog, 10Fundraising Sprint CAPS LOCK CULTS, 10Patch-For-Review: Whitelist CentralNotice banner history events for sanitaization and long-term storage - https://phabricator.wikimedia.org/T245285 (10Nuria) cc @mforns [17:36:03] 10Analytics, 10Fundraising-Backlog, 10Fundraising Sprint CAPS LOCK CULTS, 10Patch-For-Review: Whitelist CentralNotice banner history events for sanitization and long-term storage - https://phabricator.wikimedia.org/T245285 (10Nuria) [17:46:43] ottomata, do you have some time later today to look at the eventClient code? [17:48:47] fdans, whenever you want to do the bannerHistory thing, ping me, I'll be working today until late (22-23h) and tomorrow will start at 15-16h, unless you want to meet at other time? [17:49:52] yep tomorrow when you stay sounds good! [17:49:58] thank you mforns [17:50:10] ok! [18:08:46] drum roll [18:08:48] "we will be reviving the repo, however we would need to rely on the community for the contribution & testing." [18:09:12] this is a Dropbox engineer working for Superset, talking about PyHive [18:09:22] \o/ \o/ \o/ [18:09:29] \o/! [18:15:45] yay [18:23:32] 10Analytics, 10Product-Analytics: Publish data on editors per country for sister projects - https://phabricator.wikimedia.org/T245466 (10cchen) [18:28:29] 10Analytics, 10Growth-Team, 10Product-Analytics: Hash edit session ID in EditAttemptStep and VisualEditorFeatureUse whitelisting - https://phabricator.wikimedia.org/T244931 (10nettrom_WMF) p:05Triage→03Medium [18:54:19] * elukey off! [19:10:08] mforns: sorry was in meetings sinc eyou know when [19:10:12] yes anytime! [20:05:59] 10Analytics, 10Analytics-Kanban, 10serviceops: Create production and canary releases for existent eventgate helmfile services - https://phabricator.wikimedia.org/T245203 (10Ottomata) [20:10:18] 10Analytics, 10Analytics-Kanban, 10serviceops: Create production and canary releases for existent eventgate helmfile services - https://phabricator.wikimedia.org/T245203 (10Ottomata) [20:11:58] 10Analytics, 10Analytics-Kanban, 10serviceops, 10Patch-For-Review: Create production and canary releases for existent eventgate helmfile services - https://phabricator.wikimedia.org/T245203 (10Ottomata) p:05Triage→03High [20:13:42] Gone for tonight [20:18:07] 10Analytics, 10Analytics-Kanban, 10serviceops, 10Patch-For-Review: Create production and canary releases for existent eventgate helmfile services - https://phabricator.wikimedia.org/T245203 (10Ottomata) [20:28:12] 10Analytics, 10Event-Platform, 10Wikimedia-Extension-setup, 10Patch-For-Review, and 2 others: Deploy EventStreamConfig extension - https://phabricator.wikimedia.org/T242122 (10Ottomata) [20:55:44] 10Analytics, 10Event-Platform, 10Wikimedia-Extension-setup, 10Patch-For-Review, and 2 others: Deploy EventStreamConfig extension - https://phabricator.wikimedia.org/T242122 (10Ottomata) [21:18:41] 10Analytics, 10Fundraising-Backlog, 10Patch-For-Review: Whitelist CentralNotice banner history events for sanitization and long-term storage - https://phabricator.wikimedia.org/T245285 (10DStrine) [22:58:25] 10Analytics, 10DC-Ops, 10Operations, 10ops-eqiad: (no date provided) rack/setup/install an-druid1001 and druid1007 - https://phabricator.wikimedia.org/T245569 (10RobH) [22:58:32] 10Analytics, 10DC-Ops, 10Operations, 10ops-eqiad: (no date provided) rack/setup/install an-druid1001 and druid1007 - https://phabricator.wikimedia.org/T245569 (10RobH)