[06:07:12] 10Analytics, 10Performance-Team, 10Research, 10Security-Team, 10WMF-Legal: A Large-scale Study of Wikipedia Users' Quality of Experience: data release - https://phabricator.wikimedia.org/T217318 (10Gilles) @JBennett @JFishback_WMF could we get an update on when this might get looked at? [06:17:34] Good moring :) [06:21:24] Wow - That refine alert is not looking good :( [06:28:48] morning! [06:44:38] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Dropping data from druid takes down aqs hosts - https://phabricator.wikimedia.org/T226035 (10elukey) Got an answer from druid-users: > I'm not aware of an existing bug/issue that matches the situation described, would you be able to provi... [06:44:53] joal: the last two updates in --^ might be interesting [06:45:00] let me know your thoughts whenever you have time [06:45:34] Ahhhh :) [06:45:45] interesting elukey [06:46:21] (03PS1) 10Joal: Update mediawiki-history for page-history refactor [analytics/refinery] - 10https://gerrit.wikimedia.org/r/519349 (https://phabricator.wikimedia.org/T221825) [06:47:57] also joal very interesting that oozie says [06:47:59] "<<< Invocation of Beeline command completed <<<" [06:48:04] in the hive2 actions [06:48:11] this is why probably I was confused yesterday [06:48:15] Ok! Then it must use beeline :) [06:48:21] it seems that it just execute it behind the scenes [06:48:59] do you think that it would be feasible to move refinery to hive2 actions? [06:49:43] I mean without any auth for the moment [06:49:53] and then add it later on [06:50:40] elukey: I don't see why not - We'll probably move slowly (as we did for analytics user) even if the risk is slow [06:53:05] another roll restart of a ton of hosts :( [06:53:34] :S [06:53:37] anyway, webrequest_load seems to work fine with kerberos now [06:53:40] that is great :) [06:53:51] I've seen that yesterday - Awesome wirk on that elukey :D [06:55:24] thanksss [07:11:08] 10Analytics, 10Analytics-Kanban: Drop of editor numbers for earlier months - https://phabricator.wikimedia.org/T226338 (10JAllemandou) Done ! Sorry for the delay. [07:13:13] 10Analytics, 10Anti-Harassment, 10Product-Analytics: Mediawiki history has no data on IP blocks - https://phabricator.wikimedia.org/T211627 (10JAllemandou) Actually I haven't had time to tackle this issue in this round of change, sorry about that :( Keeping the task in the bakclog of things to do for mediawi... [07:14:29] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10Product-Analytics: A few alterblocks events have event_timestamps from before 2001 - https://phabricator.wikimedia.org/T218824 (10JAllemandou) I haven't have time to fix this with this bunch of changes. Keeping it in backlog of things to do for m... [07:14:37] 10Analytics, 10Analytics-Data-Quality, 10Product-Analytics: A few alterblocks events have event_timestamps from before 2001 - https://phabricator.wikimedia.org/T218824 (10JAllemandou) [07:16:01] 10Analytics, 10Product-Analytics: Identify imported revisions in mediawiki_history - https://phabricator.wikimedia.org/T221482 (10JAllemandou) Some information in that respect is provided as part of T221825 with the new field `page_is_from_before_page_creation`. But this is incomplete as it only accounts for p... [07:23:52] just tried jstack on a broker for druid1003, worked fine [07:23:59] sudo -u druid jstack -l PID [07:30:28] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Run critical Analytics Hadoop jobs and make sure that they work with the new auth settings. - https://phabricator.wikimedia.org/T212259 (10elukey) Summary of things done: 1) hue works now with oozie 2) oozie is kerberized 3) camus works f... [07:41:00] 10Analytics, 10Analytics-Wikistats, 10Patch-For-Review: Create report for "articles with most contributors" in Wikistats2 - https://phabricator.wikimedia.org/T204965 (10JAllemandou) [07:41:07] 10Analytics, 10Analytics-Wikistats: Active Editors metric per project family - https://phabricator.wikimedia.org/T188265 (10JAllemandou) [07:42:38] 10Analytics, 10Analytics-Kanban: Drop of editor numbers for earlier months - https://phabricator.wikimedia.org/T226338 (10JAllemandou) p:05Normal→03High [07:43:03] 10Analytics, 10Analytics-Data-Quality, 10Product-Analytics: A few alterblocks events have event_timestamps from before 2001 - https://phabricator.wikimedia.org/T218824 (10JAllemandou) a:05JAllemandou→03None [07:43:21] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Issues with page deleted dates on data lake - https://phabricator.wikimedia.org/T190434 (10JAllemandou) p:05Normal→03High [07:44:19] 10Analytics, 10Analytics-Wikistats, 10Patch-For-Review: Create report for "articles with most contributors" in Wikistats2 - https://phabricator.wikimedia.org/T204965 (10JAllemandou) a:05JAllemandou→03None [07:44:22] 10Analytics, 10Analytics-Wikistats: Active Editors metric per project family - https://phabricator.wikimedia.org/T188265 (10JAllemandou) a:05JAllemandou→03None [07:46:09] 10Analytics, 10Research: Provide data dumps in the Analytics Data Lake - https://phabricator.wikimedia.org/T186559 (10JAllemandou) a:05JAllemandou→03None [07:56:20] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10Product-Analytics: mediawiki_history missing page events - https://phabricator.wikimedia.org/T205594 (10JAllemandou) Results confirmed after page-history algorithm refactor. Marking as done :) [08:26:27] just added https://wikitech.wikimedia.org/wiki/Analytics/Ops_week#Debug_Java_applications_in_trouble [08:26:30] a-team --^ [08:26:54] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Dropping data from druid takes down aqs hosts - https://phabricator.wikimedia.org/T226035 (10elukey) Added https://wikitech.wikimedia.org/wiki/Analytics/Ops_week#Debug_Java_applications_in_trouble [08:27:24] nice elukey ! [08:28:37] I should have done it before restarting druid daemons sigh [08:28:48] right - next time! [08:28:54] yeah [08:29:13] one thing that I added to the incident report is to find if possible, a way to avoid systemd timers over the weekend [08:29:32] never thought about it, but it should be better to have them running during the work week [08:29:38] more chances to have people around [08:32:50] makes sense elukey ! [08:49:52] joal: https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/519361/ [08:49:57] this is a interim solution [08:50:56] Sounds ok - Doesn't care of monthly but eh, as you said, first toward better [08:51:11] yeah :( [08:51:30] also, before you leave, do we have time to try to drop something from druid? [08:51:42] if we could trigger the problem it would be awesome [08:52:00] i failed to trigger it last time I tested, but will try again :) [09:01:32] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Run critical Analytics Hadoop jobs and make sure that they work with the new auth settings. - https://phabricator.wikimedia.org/T212259 (10elukey) For the scope of this task, I would call it done. Several follow ups will need to be done, b... [09:01:38] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Run critical Analytics Hadoop jobs and make sure that they work with the new auth settings. - https://phabricator.wikimedia.org/T212259 (10elukey) [09:02:42] 10Analytics, 10Analytics-Kanban, 10User-Elukey: Check if HDFS offers a way to prevent/limit/throttle users to overwhelm the HDFS Namenode - https://phabricator.wikimedia.org/T220702 (10elukey) [09:05:38] 10Analytics, 10Analytics-Kanban, 10User-Elukey: Check if HDFS offers a way to prevent/limit/throttle users to overwhelm the HDFS Namenode - https://phabricator.wikimedia.org/T220702 (10elukey) We didn't find a way to properly limit users (more specifically, their HDFS usage) but we added logging and monitori... [09:08:45] elukey: In order to drop, I'll first need to reload [09:09:23] elukey: I'm planning on doing so on druid-publicm as it is the one having failed, and also containing bigger datasource - ok for you? [09:09:24] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Enable encryption and authentication for TLS-based Hadoop services - https://phabricator.wikimedia.org/T217412 (10elukey) We have carefully selected what services needed TLS, and which ones could live without it. HDFS requires it when enab... [09:09:50] 10Analytics, 10Analytics-Kanban, 10User-Elukey: Update the Camus checker to be able to authenticate via Kerberos - https://phabricator.wikimedia.org/T226232 (10elukey) p:05Triage→03Normal [09:10:27] 10Analytics, 10Analytics-Kanban, 10User-Elukey: Update the Camus checker to be able to authenticate via Kerberos - https://phabricator.wikimedia.org/T226232 (10elukey) Systemd timers now support kerberos auth, and Joseph's change for the checker seems to work perfectly. No more actions left! [09:11:22] joal: ack! [09:41:20] 10Analytics, 10Analytics-Kanban, 10User-Elukey: Allow all Analytics tools to work with Kerberos auth - https://phabricator.wikimedia.org/T226698 (10elukey) [10:02:18] 10Analytics, 10Operations, 10SRE-Access-Requests: Requesting access to stats machines/ores hosts hosts for Andy Craze - https://phabricator.wikimedia.org/T226204 (10jbond) @Nuria I have checked with moritz and cn=wmf should be all that is required for access to turnilo. @ACraze I have checked the logs on... [10:02:36] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Coarse alarm on data quality for refined data based on entrophy calculations - https://phabricator.wikimedia.org/T215863 (10fgiunchedi) >>! In T215863#5286219, @mforns wrote: > @fgiunchedi thanks a lot for the help! > >> From the design document my unders... [10:22:32] 10Analytics, 10Fundraising-Backlog, 10LDAP-Access-Requests, 10Operations, 10Wikimedia-Fundraising: Turnilo access for Camille de Nes (Advancement) - https://phabricator.wikimedia.org/T226614 (10jbond) @spatton i dont see Camille de Nes on either [[https://office.wikimedia.org/wiki/Contact_list | their c... [10:23:42] joal: hue works fine, oozie + hive :) [10:23:47] (in the testing cluster) [10:26:02] 10Analytics, 10Fundraising-Backlog, 10LDAP-Access-Requests, 10Operations, 10Wikimedia-Fundraising: Turnilo access for Camille de Nes (Advancement) - https://phabricator.wikimedia.org/T226614 (10MoritzMuehlenhoff) @jbond: These staff pages are often slow get updated by T&C (or whoever keeps them updated),... [10:32:17] 10Analytics, 10Analytics-Kanban, 10User-Elukey: Allow all Analytics tools to work with Kerberos auth - https://phabricator.wikimedia.org/T226698 (10elukey) [10:36:35] 10Analytics, 10Fundraising-Backlog, 10LDAP-Access-Requests, 10Operations, 10Wikimedia-Fundraising: Turnilo access for Camille de Nes (Advancement) - https://phabricator.wikimedia.org/T226614 (10jbond) 05Open→03Resolved a:03jbond >>! In T226614#5288539, @MoritzMuehlenhoff wrote: > @jbond: These staf... [10:48:35] 10Analytics, 10Analytics-Kanban: Deal with truncated values in uniques - https://phabricator.wikimedia.org/T220098 (10fdans) a:03fdans [10:55:36] * elukey lunch! [11:39:01] a-team: I can't write to the /srv/published-datasets folder on the SWAP hosts from Jupyter consoles and notebooks, even though I can from a basic SSH shell and `whoami` shows `neilpquinn-wmf` both places. [11:39:07] Any idea what's going on? [11:41:14] (I need to use Jupyter because that's the only way I have access to the `jupyter nbconvert` utility) [11:43:12] neilpquinn: I assume it's due to write perms issue, but I'm no-ops (should I say noop in that case?) - Let's wait for elukey :) [11:43:35] thanks joal! [11:59:09] (03PS30) 10Joal: Refactor mediawiki-page-history computation [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/493390 (https://phabricator.wikimedia.org/T190434) [12:14:02] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Coarse alarm on data quality for refined data based on entrophy calculations - https://phabricator.wikimedia.org/T215863 (10mforns) > The README says that Prometheus itself if it doesn't see a metric for 5 minutes it'll think it is stale, however a metric... [12:23:52] (03PS1) 10Fdans: Add zeroes to truncated values and UI about truncation [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/519382 (https://phabricator.wikimedia.org/T220098) [12:39:38] ok elukey - I have 2 fake datasources ready to be deleted in druid-public [12:47:23] 10Analytics, 10Fundraising-Backlog, 10LDAP-Access-Requests, 10Operations, 10Wikimedia-Fundraising: Turnilo access for Camille de Nes (Advancement) - https://phabricator.wikimedia.org/T226614 (10spatton) Thanks @jbond and @MoritzMuehlenhoff! [12:47:53] (03PS2) 10Fdans: Add zeroes to truncated values and UI about truncation [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/519382 (https://phabricator.wikimedia.org/T220098) [12:49:43] milimetric, mforns nuria this is how the charts with truncated values look like [12:49:55] https://usercontent.irccloud-cdn.com/file/H4TQugsn/Screen%20Shot%202019-06-27%20at%202.47.41%20PM.png [12:50:21] O.oU [12:51:06] Oh! understand :] [12:51:10] looks cool! [12:51:27] this is great! [12:51:43] :) [12:51:58] maybe I'd change the word accuracy, no? [12:52:13] yea the text should be changed to something better worded [12:52:37] I think it's good! just change accuracy by privacy [12:53:09] but it's not really because privacy right? it's because the error is too high [12:53:36] hmmm, yea maybe in this case [12:53:55] ok, let's discuss in standup no? [12:59:01] joal: here I am! [12:59:07] if you have time, let's do it :) [13:00:11] ok elukey [13:00:28] we're going to use the dletion script, as in timer, but using a different basename [13:00:36] ok? [13:00:37] joal: super [13:00:43] ok [13:00:54] joal: 2 datasources right? [13:00:58] correct [13:01:16] hm - let's wait a minute for the second one to be fully loaded in historicals [13:01:22] sorry for the wrong ping [13:01:35] still some segments to copy over [13:01:47] ack [13:01:54] I am prepping with tail ec.. [13:02:07] elukey: datasource basename is: test_drop_mediawiki_histor_reduced_YYYY_MM [13:06:24] ack [13:08:06] let me know before you start so I can monitor [13:11:39] elukey: sudo -u analytics PYTHONPATH=${PYTHONPATH}:/srv/deployment/analytics/refinery/python /srv/deployment/analytics/refinery/bin/refinery-drop-druid-snapshots -d test_drop_mediawiki_history_reduced -t druid1004.eqiad.wmnet -s 0 -f /var/log/refinery/drop-druid-public-snapshots-test-joal-2019-06-27.log [13:11:53] ok? [13:12:44] +1 [13:14:21] elukey: Starting [13:16:47] nothing is breaking so far [13:19:07] Job is finished and happy :S [13:19:14] * joal prepares to cry [13:21:25] it seems done, historical logs are not updating [13:21:26] And druid coord UI looks happy as well [13:21:36] :( [13:27:31] I doubt that the last changes were effective [13:27:44] so I can assume that the bug is triggered in a weird use case [13:27:56] I can only think the same [13:28:19] Or, the fact of having datasources loaded and never queried is actually the weird case [13:28:39] Or, last idea - What is problematic for the broker is cache invalidation (as usual?) [13:28:49] And since new datasource, no cahce [13:28:52] And since new datasource, no cache [13:31:35] all possible explanations, but with a jstack trace we'd be in a differnet position :( [14:01:03] PROBLEM - Check if the Hadoop HDFS Fuse mountpoint is readable on analytics1041 is CRITICAL: CRITICAL [14:02:19] I can see how come aqs servers show up here: https://github.com/wikimedia/puppet/tree/production/hieradata/hosts, but why do those hadoop nodes show up there? And none of the other hadoop nodes or other nodes on our cluster, like druid, etc? Seems weird [14:02:34] fuse is on an41??? [14:02:58] no no it is me [14:03:01] testing cluster [14:03:05] oh ok [14:03:06] phew [14:03:10] milimetric: the hieradata is config [14:03:18] there are several layers of configs [14:03:27] some levels override others [14:03:32] these are host specific overrides [14:03:35] it is the druid testing node, I wanted to add hadoop client things.. but I forgot about firewall [14:03:40] oh ok [14:03:46] thanks ottomata [14:05:40] joal: Tim figured out our mystery import: https://en.wikipedia.org/wiki/Special:Log/import [14:05:56] a bunch of stuff is being imported from nostalgia wiki basically [14:06:01] \o/ !!! [14:06:14] Thanks milimetric - Feels a lot better :) [14:06:18] :) [14:06:21] how'd the data check go? [14:06:31] milimetric: I'm gathering more and more confidence on that patch as I update it for small improvements [14:07:15] ok awesome, I'm going over it, but am available all day for brain bouncing [14:07:28] Will let you know :) [14:20:07] (03CR) 10Milimetric: [C: 04-1] "noticed a couple of small things. And I was pretty confused by the word "truncated". I think that usually means cutting off one of the e" (033 comments) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/519382 (https://phabricator.wikimedia.org/T220098) (owner: 10Fdans) [14:21:19] did someone already look into that failed refine hour last night? [14:21:34] nope milimetric, I concentrated on MWH - sorry :( [14:22:01] joal: I'm on it, no worries [14:22:09] Thanks mate [14:24:38] looks like it just temporarily couldn't access the schemas on meta, maybe there was a bad deploy or restart or something. I'll find out how to rerun that hour and do so [14:26:00] k milimetric [14:35:52] mforns: ping :) [14:36:04] oh elukey! omw [14:37:51] ok dropping for kids - talk at standup :) [15:02:05] (03PS3) 10Fdans: Add zeroes to truncated values and UI about truncation [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/519382 (https://phabricator.wikimedia.org/T220098) [15:04:40] (03PS2) 10Fdans: Use current date as end date in relative time ranges [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/519017 (https://phabricator.wikimedia.org/T226421) [15:05:40] ottomata: time for a quick code review? [15:06:13] sure! [15:07:01] ottomata: https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/519422 :) [15:07:14] that is basically along the lines of what we did for yarn/hdfs/etc.. [15:08:04] (03CR) 10Fdans: Use current date as end date in relative time ranges (031 comment) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/519017 (https://phabricator.wikimedia.org/T226421) (owner: 10Fdans) [15:08:09] just wanted to know if it makes sense for you [15:08:18] ya makes sense! [15:08:20] +1 [15:08:52] thanksss [15:09:50] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10Product-Analytics: mediawiki_history missing page events - https://phabricator.wikimedia.org/T205594 (10Nuria) Let's mark it as done when the snapshot that has the fixes is live, i think that should be June, correct? [15:10:29] 10Analytics, 10Analytics-Kanban: Drop of editor numbers for earlier months - https://phabricator.wikimedia.org/T226338 (10Nuria) 05Open→03Resolved [15:21:58] (03PS1) 10Milimetric: Specify actual date format [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/519426 [15:27:57] (03CR) 10Nuria: [C: 03+1] Specify actual date format (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/519426 (owner: 10Milimetric) [15:28:41] (03CR) 10Nuria: [C: 03+2] Use current date as end date in relative time ranges [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/519017 (https://phabricator.wikimedia.org/T226421) (owner: 10Fdans) [15:31:06] (03Merged) 10jenkins-bot: Use current date as end date in relative time ranges [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/519017 (https://phabricator.wikimedia.org/T226421) (owner: 10Fdans) [15:32:05] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Dropping data from druid takes down aqs hosts - https://phabricator.wikimedia.org/T226035 (10Nuria) No alarms so test went well just with changing timeouts? or better, random bug we were not able to repro. [15:40:58] milimetric: About? [15:42:43] Or nuria? [15:57:11] Reedy: hola! [15:57:22] mind if I pm? :) [15:57:58] Reedy: not at all [15:58:02] thanks [15:58:50] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Dropping data from druid takes down aqs hosts - https://phabricator.wikimedia.org/T226035 (10elukey) Sadly I believe the latter, I didn't see any impact on brokers.. Joseph loaded two snapshots and dropped them, I think that we missed to r... [16:01:39] ping fdans , ottomata [16:01:47] Oop [16:46:29] 10Analytics, 10Operations, 10SRE-Access-Requests: Requesting access to stats machines/ores hosts hosts for Andy Craze - https://phabricator.wikimedia.org/T226204 (10ACraze) Ahh ok, I'm able to get in to turnilo now, thanks! [16:47:14] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Run critical Analytics Hadoop jobs and make sure that they work with the new auth settings. - https://phabricator.wikimedia.org/T212259 (10Nuria) Nice, major milestone. [16:47:20] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Set up a Kerberos KDC service in production with minimal puppet automation - https://phabricator.wikimedia.org/T212257 (10Nuria) [16:47:23] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Run critical Analytics Hadoop jobs and make sure that they work with the new auth settings. - https://phabricator.wikimedia.org/T212259 (10Nuria) 05Open→03Resolved [17:26:24] 10Analytics-Kanban, 10Cloud-Services: Public Edit Data Lake: Mediawiki history snapshots available in SQL data store to cloud (labs) users - https://phabricator.wikimedia.org/T204950 (10Ottomata) [17:26:28] 10Analytics, 10Operations, 10netops, 10ops-eqiad: Move cloudvirtan* hardware out of CloudVPS back into production Analytics VLAN. - https://phabricator.wikimedia.org/T225128 (10Ottomata) [17:35:56] 10Analytics, 10Operations, 10SRE-Access-Requests: Requesting access to stats machines/ores hosts hosts for Andy Craze - https://phabricator.wikimedia.org/T226204 (10jbond) 05Open→03Resolved a:03jbond great, i think this is done now so closing please re open if there is still an issue [17:38:03] 10Analytics, 10Fundraising-Backlog, 10fundraising-tech-ops: investigate recent divot in landingpage log activity - https://phabricator.wikimedia.org/T224733 (10Jgreen) a:05Jgreen→03None unassigning b/c it does not look like there's anything wrong with the frack part of the pipeline (kafkatee and filters) [17:47:27] 10Analytics, 10Analytics-EventLogging: Sunset MySQL data store for eventlogging - https://phabricator.wikimedia.org/T159170 (10Ottomata) a:03Ottomata [17:47:45] 10Analytics, 10Analytics-EventLogging: Move reportupdater reports that pull data from eventlogging mysql to pull data from hadoop - https://phabricator.wikimedia.org/T223414 (10Ottomata) a:03fdans [17:57:45] (03CR) 10Ottomata: [C: 03+2] Specify actual date format [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/519426 (owner: 10Milimetric) [18:51:50] 10Analytics, 10Analytics-Kanban: Move reportupdater queries from limn-* repositories to reportupdater-queries - https://phabricator.wikimedia.org/T222739 (10Nuria) Ping @fdans should this ticket be in ready-to-deploy? I think is in-progress right? The one ready to deploy seems this one: T221064? [18:52:20] 10Analytics, 10Continuous-Integration-Config, 10Patch-For-Review, 10Release-Engineering-Team (Watching / External): Status of analytics/limn-*-data git repositories? - https://phabricator.wikimedia.org/T221064 (10Nuria) a:05Milimetric→03fdans [18:53:56] 10Analytics, 10Analytics-Kanban: Move reportupdater queries from limn-* repositories to reportupdater-queries - https://phabricator.wikimedia.org/T222739 (10Nuria) I think queries have been moved but for this work to be ready-to-deploy more chnages are needed like changing the puppet of the reportupdater jobs? [19:10:25] \o/ ! All vetted with low-margin error [19:10:32] Going to have diner, then deploy [19:12:48] (03PS31) 10Joal: Refactor mediawiki-page-history computation [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/493390 (https://phabricator.wikimedia.org/T190434) [19:55:45] fdans: would you by any chance be nearby?| [19:56:23] joal: helloooo whats up? :) [19:56:45] Confirming with you I should update webrequest job to https://phabricator.wikimedia.org/T225792 [19:57:40] joal: yesss please and thank you! [19:57:54] okey [20:02:00] (03PS1) 10Joal: Bump jar version for oozie webrequest load bundle [analytics/refinery] - 10https://gerrit.wikimedia.org/r/519506 (https://phabricator.wikimedia.org/T225792) [20:02:46] fdans: please --^ :) [20:04:59] (03CR) 10Fdans: [C: 03+2] "Thank you for doing this Joal!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/519506 (https://phabricator.wikimedia.org/T225792) (owner: 10Joal) [20:17:43] milimetric: can I pick your brain for a minute? [20:19:38] (03CR) 10Joal: [C: 03+2] "Merging for deploy!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/493390 (https://phabricator.wikimedia.org/T190434) (owner: 10Joal) [20:24:40] (03Merged) 10jenkins-bot: Refactor mediawiki-page-history computation [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/493390 (https://phabricator.wikimedia.org/T190434) (owner: 10Joal) [20:40:38] sorry joal, had to run out unexpectedly [20:40:46] np milimetric - batcave? [20:41:14] I’ll be back in 30, but maybe I can cave from here, let’s try [21:05:37] (03PS1) 10Joal: Fix mediawiki-history-page create event [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/519521 (https://phabricator.wikimedia.org/T221825) [21:08:24] 10Analytics, 10Research, 10Wikidata: Improve interlingual links across wikis through Wikidata IDs - https://phabricator.wikimedia.org/T215616 (10Krinkle) [21:09:26] 10Analytics, 10MediaWiki-General-or-Unknown, 10Research, 10Wikidata: Improve interlingual links across wikis through Wikidata IDs - https://phabricator.wikimedia.org/T215616 (10Krinkle) (Does this appear to be an issue with the wikimedia-rdbms PHP library, and not a bug or specific feature request for the... [21:14:26] 10Analytics, 10MediaWiki-Page-deletion: Store data about reasons for deletion in a way that is easier to analyze - https://phabricator.wikimedia.org/T194891 (10Krinkle) [21:53:59] 10Analytics, 10Analytics-Kanban, 10OOUI: Add Piwik stats to OOUI Demo pages - https://phabricator.wikimedia.org/T224657 (10Jdforrester-WMF) [21:55:04] 10Analytics, 10OOUI, 10Wikimedia-General-or-Unknown, 10Security: "Sign In" dialog for piwik.wikimedia.org shown when accessing OOUI demos on doc.wikimedia.org - https://phabricator.wikimedia.org/T225882 (10Jdforrester-WMF) [22:31:33] Ok team - I still have errors, but I need some rest - Will continue fixing tomorrow