[00:01:12] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Release Pipeline, 10Patch-For-Review, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10Ottomata) I think I found the leak.  https://github.com/Blizzard/node-rdkafka/issues/731#issuecomment-600915799
[01:22:24] <wikibugs>	 10Analytics, 10EventStreams: KafkaSSE issue tracker and continuous integration - https://phabricator.wikimedia.org/T248044 (10Krinkle)
[06:26:15] <wikibugs>	 10Analytics, 10ContentTranslation, 10Language-Team (Language-2020-Focus-Sprint): Test Performance of Marian NMT translation in stat cluster - https://phabricator.wikimedia.org/T247245 (10santhosh) Due to the recent changes in priorities, I may not get back to this testing immediately. But there is a dependen...
[06:43:52] <wikibugs>	 10Analytics, 10ContentTranslation, 10Language-Team (Language-2020-Focus-Sprint): Test Performance of Marian NMT translation in stat cluster - https://phabricator.wikimedia.org/T247245 (10elukey) >>! In T247245#5982840, @santhosh wrote: > Due to the recent changes in priorities, I may not get back to this tes...
[07:11:28] <wikibugs>	 10Analytics, 10Event-Platform, 10serviceops, 10Patch-For-Review, 10Wikimedia-production-error: Lots of "EventBus: Unable to deliver all events" - https://phabricator.wikimedia.org/T247484 (10Joe) After one day, what we found is that errors we see now are of the "UF" (upstream failed) type, which seems to...
[07:48:42] <wikibugs>	 (03CR) 10Thiemo Kreuz (WMDE): [C: 03+2] Count disables of the TwoColumnConflict interface [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/577213 (https://phabricator.wikimedia.org/T246104) (owner: 10WMDE-Fisch)
[07:49:15] <wikibugs>	 (03Merged) 10jenkins-bot: Count disables of the TwoColumnConflict interface [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/577213 (https://phabricator.wikimedia.org/T246104) (owner: 10WMDE-Fisch)
[10:36:29] <wikibugs>	 (03PS1) 10WMDE-Fisch: Count disables of the TwoColumnConflict interface [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/581500 (https://phabricator.wikimedia.org/T246104)
[10:41:59] <wikibugs>	 (03CR) 10Ladsgroup: [C: 03+2] "deploying" [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/581500 (https://phabricator.wikimedia.org/T246104) (owner: 10WMDE-Fisch)
[10:42:23] <wikibugs>	 (03Merged) 10jenkins-bot: Count disables of the TwoColumnConflict interface [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/581500 (https://phabricator.wikimedia.org/T246104) (owner: 10WMDE-Fisch)
[12:41:21] * elukey lunch!
[13:17:27] <joal>	 heya fdans  are you nearby?
[13:17:47] <fdans>	 joal: o/
[13:18:15] <joal>	 fdans: I'm gonna remove your comment on refinery/deploy after having explained if ok )
[13:18:30] <joal>	 fdans: we currently deploy 2 versions of refinery
[13:19:05] <fdans>	 joal: awesome, that's why I left that message :)
[13:19:25] <joal>	 The classical one contains everything, and the 'thin' one contains all the scripts/code but not the jars (git-fat disabled)
[13:20:02] <fdans>	 joal: I see
[13:20:07] <joal>	 The goal of the above is to deploy smaller versions, as every deployed version is a few Gb
[13:20:49] <joal>	 I think we'll be able to get back to the single repo once we get to bigger machines
[13:32:40] <wikibugs>	 10Analytics, 10EventStreams: KafkaSSE issue tracker and continuous integration - https://phabricator.wikimedia.org/T248044 (10Ottomata) I've preferred to keep re-usable and non WMF/Medaiwiki specific code in Github where it is more easily discoverable and contributable by non Mediawiki developers.    > It woul...
[13:33:13] <wikibugs>	 10Analytics, 10EventStreams: KafkaSSE issue tracker and continuous integration - https://phabricator.wikimedia.org/T248044 (10Ottomata) a:03Ottomata
[13:42:41] <wikibugs>	 10Analytics, 10Research-Backlog: Provide a spark job processing history and text to extract citations diffs - https://phabricator.wikimedia.org/T158896 (10JAllemandou) Removing myself as assignee - will get back to this when we tackle text-processing intermediate datasets.
[13:42:53] <wikibugs>	 10Analytics, 10Research-Backlog: Provide a spark job processing history and text to extract citations diffs - https://phabricator.wikimedia.org/T158896 (10JAllemandou) a:05JAllemandou→03None
[13:45:50] <wikibugs>	 10Analytics: Create dashboard for interlanguage navigation stats - https://phabricator.wikimedia.org/T185156 (10Amire80) 05Open→03Resolved Resolved long ago, the dashboard is available at https://language-reportcard.wmflabs.org/interlanguage/
[13:50:49] <wikibugs>	 10Analytics, 10Analytics-SWAP, 10Product-Analytics: pip not accessible in new SWAP virtual environments - https://phabricator.wikimedia.org/T247752 (10nshahquinn-wmf) >>! In T247752#5975620, @elukey wrote: > Ok so the $PATH is correctly picked up in kernels (I tested a py3 one) but not from the Terminal. Not...
[14:32:17] <wikibugs>	 10Analytics, 10EventStreams: EventStreams (via KafkaSSE) does not consume from newly added partitions in topic - https://phabricator.wikimedia.org/T173006 (10Ottomata) a:05Ottomata→03None
[15:01:00] <wikibugs>	 10Analytics, 10Technical blog: Setup Matomo beacon for techblog.wikimedia.org - https://phabricator.wikimedia.org/T247918 (10bd808) >>! In T247918#5978187, @bd808 wrote: > We will try using https://wordpress.org/plugins/wp-piwik/ to manage the tracker script integration with the blog. To do this we will appare...
[15:03:33] <bd808>	 nuria: I think that the help I need on T247918 is just a few minutes of clicking by someone with admin rights on https://piwik.wikimedia.org/. I hate to be pushy, but is there someone who could hit those buttons today? I'm trying to get the upstream code review done and need the new SiteId as part of that.
[15:03:34] <stashbot>	 T247918: Setup Matomo beacon for techblog.wikimedia.org - https://phabricator.wikimedia.org/T247918
[15:04:27] <nuria>	 bd808: OMG it is happening , on it, give me a sec
[15:05:09] <bd808>	 :)
[15:08:10] <wikibugs>	 10Analytics, 10Technical blog: Setup Matomo beacon for techblog.wikimedia.org - https://phabricator.wikimedia.org/T247918 (10Nuria) Matomo code:  `  <!-- Matomo --> <script type="text/javascript">   var _paq = window._paq || [];   /* tracker methods like "setCustomDimension" should be called before "trackPageV...
[15:13:29] <mforns>	 hey teamm
[15:22:39] <ottomata>	 yoohooo
[16:01:11] <nuria>	 ping fdans 
[16:11:13] <lexnasser>	 nuria: milimetric: If you could take a look at the geoeditors api design doc, I added an alternative shape for the API output below the initial one, let me know what you think
[16:17:57] <wikibugs>	 10Analytics: Grant needs kerberos credentials - https://phabricator.wikimedia.org/T248014 (10elukey) ` elukey@krb1001:~$ sudo manage_principals.py create gsingers --email_address=gingersoll@wikimedia.org Principal successfully created. Make sure to update data.yaml in Puppet. Successfully sent email to gingersol...
[16:19:01] <wikibugs>	 10Analytics, 10Patch-For-Review: Grant needs kerberos credentials - https://phabricator.wikimedia.org/T248014 (10elukey) 05Open→03Resolved
[16:27:20] <wikibugs>	 10Analytics, 10Fundraising-Backlog, 10fundraising-tech-ops: Install superset on front end server for analytics - https://phabricator.wikimedia.org/T245755 (10Jgreen)
[16:29:08] <wikibugs>	 10Analytics, 10Product-Analytics: Hive access - https://phabricator.wikimedia.org/T248097 (10nettrom_WMF) Tagging Analytics Engineering, I'm hoping they can help figure out what exactly is needed and how to make that happen.
[16:34:20] <wikibugs>	 10Analytics, 10Operations, 10Product-Analytics, 10SRE-Access-Requests: Hive access - https://phabricator.wikimedia.org/T248097 (10Nuria)
[16:36:24] <wikibugs>	 10Analytics, 10Operations, 10Product-Analytics, 10SRE-Access-Requests: Hive access - https://phabricator.wikimedia.org/T248097 (10Nuria) Please take a look at https://wikitech.wikimedia.org/wiki/Analytics/Data_access  You need to provide ssh keys
[17:15:36] <wikibugs>	 10Analytics, 10Operations, 10Product-Analytics, 10SRE-Access-Requests: Hive access - https://phabricator.wikimedia.org/T248097 (10mpopov) @spatton: we have some additional information on [[ https://www.mediawiki.org/wiki/Product_Analytics/Onboarding#SSH_Keys,_Stat_machines,_Notebooks,_HUE,_Datagrip,_Groups...
[17:16:17] <Nettrom>	 hey elukey! thanks for getting Debian Buster up on stat1005, the newer R version enables me to do more analysis there. awesome!
[17:18:53] <elukey>	 Nettrom: \o/
[17:19:01] <elukey>	 there is also stat1008 with buster :)
[17:19:27] <Nettrom>	 great to know, I'll pass that on to the Product Analytics team
[17:19:50] <wikibugs>	 10Analytics, 10Operations, 10Product-Analytics, 10SRE-Access-Requests: Hive access - https://phabricator.wikimedia.org/T248097 (10Nuria) @spatton: Can you also explain a little what are you trying to do? (this is not needed for access but it help us to understand your use case)
[17:36:08] <joal>	 nuria: I assume you're in a meeting - Can we try to find some time later today (in 1h30 for instance)?
[17:39:40] <mforns>	 ottomata: I think I managed to test that EL client works as expected, wanna check?
[17:40:33] <ottomata>	 mforns ya!  was going to bike home in between meetings, will you still be onlinle in 30 miinutes? 
[17:40:35] <nuria>	 joal: yes!
[17:40:36] <ottomata>	 if not now is fine too
[17:42:52] <mforns>	 ottomata: no no, will be here
[17:43:51] * elukey off!
[17:43:56] <ottomata>	 ok! back in a bit
[17:44:00] <mforns>	 k
[17:44:36] <nuria>	 milimetric (for later), ping in CR https://gerrit.wikimedia.org/r/#/c/analytics/reportupdater-queries/+/580136/
[17:52:16] <ottomata>	 hey mforns  actually am still here for a bit
[17:52:18] <ottomata>	 bc?
[17:59:36] <wikibugs>	 (03PS4) 10Lex Nasser: Configure geoeditors monthly public Oozie job to work with geoeditors public monthly table [analytics/refinery] - 10https://gerrit.wikimedia.org/r/576618 (https://phabricator.wikimedia.org/T244597)
[18:20:30] <ottomata>	 yoohoo mforns ?
[18:26:50] <mforns>	 hey ottomata still there?
[18:26:56] <mforns>	 was having a snack
[18:29:42] <ottomata>	 mforns:  ya!~
[18:29:53] <mforns>	 k, bc?
[18:29:55] <ottomata>	 ya
[18:29:57] <mforns>	 k
[18:30:36] <wikibugs>	 (03CR) 10Milimetric: [V: 03+2 C: 03+2] "merging - but keep in mind if you want to rerun reports you have to make sure old data is available and then follow the rerun docs." [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/580136 (https://phabricator.wikimedia.org/T247101) (owner: 10Nuria)
[18:54:56] <elukey>	 ottomata: https://grafana.wikimedia.org/d/pMd25ruZz/presto?orgId=1&from=now-1h :)
[18:55:14] <elukey>	 before last hour it shows some duplicated metrics, my bad with the prometheus master cfg
[18:55:18] <elukey>	 but a lot of good info
[18:55:39] <elukey>	 I am super interested in seeing how https://grafana.wikimedia.org/d/pMd25ruZz/presto?orgId=1&from=now-1h&to=now&var-datasource=eqiad%20prometheus%2Fanalytics&var-instance=an-coord1001:10281&fullscreen&panelId=19 evolves
[18:56:44] <elukey>	 if the heap stays in reasonable limits, maybe we could think about multi-instance presto server on beefy nodes? (like the hadoop workers)
[18:58:09] <joal>	 awesome elukey :)
[18:59:35] <nuria>	 joal: can talk bots now
[18:59:48] <joal>	 Hey nuria 
[18:59:53] <joal>	 perfect timing :)
[19:00:00] <joal>	 cave?
[19:00:38] <nuria>	 joal: omw
[19:02:50] <elukey>	 need to better differenciate between coordinator and workers, still wip :)
[19:02:57] <elukey>	 will dig a bit more into metrics tomorrow
[19:14:24] <wikibugs>	 10Analytics, 10ExternalGuidance, 10Product-Analytics: Measure the impact of externally-originated contributions - https://phabricator.wikimedia.org/T212414 (10dr0ptp4kt)
[19:52:07] <dsaez>	 hey joal, qq I'm using Wikidata item page link table, but I from here https://phabricator.wikimedia.org/T244707 I can't understand if this updated or not
[19:53:02] <joal>	 Hi dsaez, in the task ou pasted there is a link to a doc page showing schema and some other info.
[19:53:14] <joal>	 dsaez: The table is updated weekly
[19:53:27] <dsaez>	 ok, so no need to put snapshot anymore? 
[19:53:40] <joal>	 dsaez: a new snapshot every week
[19:54:39] <joal>	 dsaez: makes sense?
[19:54:51] <dsaez>	 joal but if I do SELECT snapshot FROM wmf.wikidata_item_page_link  GROUP BY snapshot
[19:55:05] <dsaez>	 last snapsht I get is |2020-02-24|
[19:55:57] <dsaez>	 I was not sure how to know which is the last snapshot, so I did that, and found this. 
[19:56:08] <joal>	 dsaez: show partitions wmf.wikidata_item_page_link;
[19:56:23] <dsaez>	 great
[19:57:52] <dsaez>	 got, you last is from 2020-03-02 ... i think this makes sense
[19:58:30] <joal>	 dsaez: this snapshot means you have data for the week of the 2nd of March
[19:58:43] <joal>	 dsaez: therefore up to the 8th of march
[19:58:43] <dsaez>	 got you.
[19:59:05] <joal>	 dsaez: The next snapshot has not yet been released (takes some days to be produced)
[19:59:21] <dsaez>	 excellent, now I understand
[20:00:10] <joal>	 great dsaez :)
[20:12:58] <dsaez>	 joal SELECT wiki_db,page_title,item_id,page_id  FROM wmf.wikidata_item_page_link WHERE
[20:12:58] <dsaez>	                         snapshot='2020-03-02' 
[20:12:58] <mforns>	 man airflow is so cool
[20:13:05] <dsaez>	 returns empty answer :S
[20:14:18] <dsaez>	 but snapshot='2020-02-24' seems to be ok.
[23:22:20] <wikibugs>	 10Analytics, 10Product-Analytics, 10Readers-Web-Backlog (Needs Product Owner Decisions), 10covid-19: Weekly updates on editors & readers - https://phabricator.wikimedia.org/T247873 (10Jdlrobson)