[00:09:42] 10Analytics, 10Pageviews-API, 10Wikipedia-iOS-App-Backlog, 10iOS-app-Bugs, 10iOS-app-v6.0.1-Walrus-On-A-Golf-Cart: Large increase on 404s from the Wikipedia IOS app - https://phabricator.wikimedia.org/T203688 (10Nuria) @Jminor You can see here (this is sampled 1/100) the amount of traffic that the app is... [00:28:59] 10Analytics, 10Pageviews-API, 10Wikipedia-iOS-App-Backlog, 10iOS-app-Bugs, 10iOS-app-v6.0.1-Walrus-On-A-Golf-Cart: Large increase on 404s from the Wikipedia IOS app - https://phabricator.wikimedia.org/T203688 (10JMinor) Thanks @nuria I can't seem to get past the http authentication for that report? So,... [00:31:23] 10Analytics, 10Pageviews-API, 10Wikipedia-iOS-App-Backlog, 10iOS-app-Bugs, 10iOS-app-v6.0.1-Walrus-On-A-Golf-Cart: Large increase on 404s from the Wikipedia IOS app - https://phabricator.wikimedia.org/T203688 (10JMinor) Oooh, just realized access issue might be because I'm at home. Do I need to VPN in to... [06:18:18] (morning! Need a couple of hours for an errand, but if you need me I am available via phone :) [07:38:17] 10Analytics, 10Pageviews-API, 10Wikipedia-iOS-App-Backlog, 10iOS-app-Bugs, 10iOS-app-v6.0.1-Walrus-On-A-Golf-Cart: Large increase on 404s from the Wikipedia IOS app - https://phabricator.wikimedia.org/T203688 (10jcrespo) You can see in this graph that there was a large rise around 14:19 until 0:03 yester... [07:42:43] 10Analytics, 10Pageviews-API, 10Wikipedia-iOS-App-Backlog, 10iOS-app-Bugs, 10iOS-app-v6.0.1-Walrus-On-A-Golf-Cart: Large increase on 404s from the Wikipedia IOS app - https://phabricator.wikimedia.org/T203688 (10jcrespo) As @Nuria correctly says, this is not the first time it happens, the amount of 404 r... [08:47:38] (still running errand, will take the morning off sorry a-team :( [08:59:37] 10Quarry, 10Cloud-Services, 10Community-Wikimetrics, 10DBA, and 2 others: Evaluate future of wmf puppet module "mysql" - https://phabricator.wikimedia.org/T165625 (10jcrespo) 05Open>03Resolved a:03jcrespo This has been evaluate, mysql will disappear, leaving this for historical documentation, forces... [10:31:56] 10Analytics, 10Analytics-Dashiki, 10Analytics-Kanban, 10CX-analytics, 10Language-2018-July-September: Setup Config:Dashiki:CX2Translations as a public chart and update the Dashiki documentation accordingly - https://phabricator.wikimedia.org/T203516 (10Amire80) a:05Amire80>03None [11:05:01] ok so going to disable camus and then I'll reboot analytics1003 and 100[12] [11:11:34] elukey: Didn't think about thin [11:11:44] elukey: Can we wait next monday for an1003? [11:12:05] We have the sqoop-jobs running, and they don't restart from failure [11:12:07] :( [11:12:30] elukey: I'm very sorry for not having thought of that yesterday when you said you'd reboot :( [11:21:18] 10Analytics: Upgrade Hive to ≥1.3 or ≥2.1 - https://phabricator.wikimedia.org/T203498 (10elukey) Hi! Thanks a lot for this task, it triggered some useful discussions. A couple of notes after checking the CDH release details: * CDH 6.0 community edition (we don't use the enterprise/paid one) seems to come with [... [11:22:52] joal: ahhhh okok makes sense, lemme re-enable everything [11:22:57] I'll send an email for monday [11:23:08] I'm super sorry not to have noticed [11:25:32] didn't think it either :( [11:25:37] not a big deal :) [11:26:38] so cdh 6 seems to come with hive 2.1 [11:26:46] I added some comments in --^ [11:26:51] Just saw that yes [11:26:56] weirdly the download page lists only ubuntu [11:27:12] this might be a good topic to discuss during the offsite [11:27:16] my wonder about CDH6: WHEN??? [11:27:44] what do you mean? [11:28:22] Well, IIRC we've been told in about a quarter when we were in Sevilla, 2 years ago :) [11:29:18] :D [11:29:29] it seems out no https://www.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_cdh_6_release_notes.html? [11:29:37] there should be also a community available [11:32:58] Out from beginning of September it seems - I wonder how it passed by me unnoticed :( [11:40:13] 10Analytics, 10User-Elukey: Return to real time banner impressions in Druid - https://phabricator.wikimedia.org/T203669 (10elukey) a:03elukey [11:41:26] 10Analytics, 10User-Elukey: Return to real time banner impressions in Druid - https://phabricator.wikimedia.org/T203669 (10elukey) @Jseddon hi! I should be able to work on this next quarter, @JAllemandou had a prototype work fine a couple of months ago, it should be only a matter of productionizing it. Any par... [11:41:57] joal: you brought back a lot of memories, seville! [11:42:02] it was two years ago?? [11:48:40] 10Analytics, 10Operations, 10Patch-For-Review: Decommission Ganeti vm meitnerium.wikimedia.org (old Archiva host) - https://phabricator.wikimedia.org/T203087 (10elukey) [11:52:48] 10Analytics, 10Operations, 10Patch-For-Review: Decommission Ganeti vm meitnerium.wikimedia.org (old Archiva host) - https://phabricator.wikimedia.org/T203087 (10elukey) [11:54:20] (03PS1) 10Fdans: Add total article count metric [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/458784 (https://phabricator.wikimedia.org/T203180) [11:54:50] 10Analytics-Tech-community-metrics, 10Code-Health, 10Release-Engineering-Team (Kanban): Develop canonical/single record of origin, machine readable list of all repos deployed to WMF sites. - https://phabricator.wikimedia.org/T190891 (10Aklapper) > What systems would you see consuming this list? * Supersede m... [12:17:56] 10Analytics, 10Analytics-Kanban, 10User-Elukey: Replace the Analytics HDFS/Yarn masters (hardware refresh) - https://phabricator.wikimedia.org/T203635 (10elukey) [12:19:59] joal: whenever you have time I'd like to go through --^ with you [12:20:07] to see how many things I have missed :) [12:46:16] 10Quarry: Allow quarry scripts to be executed by someone else without the need to fork - https://phabricator.wikimedia.org/T203791 (10Herzi.Pinki) [12:55:40] 10Analytics, 10Analytics-Kanban: Reboot Analytics hosts for kernel security upgrades - https://phabricator.wikimedia.org/T203165 (10elukey) [13:01:55] good call on waiting for spark jobs to finish! [13:02:32] Joseph is always a wise man, I am the bad one :( [13:02:37] morninggg [13:06:57] o/ :) [14:36:16] 10Analytics, 10Analytics-Dashiki, 10Analytics-Kanban, 10CX-analytics, 10Language-2018-July-September: Setup Config:Dashiki:CX2Translations as a public chart and update the Dashiki documentation accordingly - https://phabricator.wikimedia.org/T203516 (10Nuria) a:03fdans [14:37:12] nuria: was just looking at it :) [14:40:00] PROBLEM - Check systemd state on analytics1003 is CRITICAL: CRITICAL - degraded: The system is operational but one or more units failed. [14:40:40] this is me testing --^ [15:08:09] 10Analytics, 10Operations, 10Patch-For-Review: Decommission Ganeti vm meitnerium.wikimedia.org (old Archiva host) - https://phabricator.wikimedia.org/T203087 (10Dzahn) note that the docs say "A Phabricator ticket for the decommission of the system should be placed in the #hardware-request project and the app... [15:09:58] 10Analytics, 10Operations, 10Patch-For-Review: Decommission Ganeti vm meitnerium.wikimedia.org (old Archiva host) - https://phabricator.wikimedia.org/T203087 (10elukey) >>! In T203087#4566582, @Dzahn wrote: > note that the docs say "A Phabricator ticket for the decommission of the system should be placed in... [15:10:14] 10Analytics, 10Operations, 10hardware-requests, 10ops-eqiad: Decommission Ganeti vm meitnerium.wikimedia.org (old Archiva host) - https://phabricator.wikimedia.org/T203087 (10elukey) [15:11:22] 10Analytics, 10Operations, 10hardware-requests, 10ops-eqiad: Decommission Ganeti vm meitnerium.wikimedia.org (old Archiva host) - https://phabricator.wikimedia.org/T203087 (10Dzahn) I forgot for a moment this is a virtual machine. You can probably ignore that. Sorry. [15:21:18] 10Analytics: Upgrade Hive to ≥1.13 or ≥2.1 - https://phabricator.wikimedia.org/T203498 (10mpopov) [15:21:34] 10Analytics: Upgrade Hive to ≥1.13 or ≥2.1 - https://phabricator.wikimedia.org/T203498 (10mpopov) Whoops, realized I was missing a digit in the version. [15:24:49] 10Analytics: Upgrade Hive to ≥1.13 or ≥2.1 - https://phabricator.wikimedia.org/T203498 (10mpopov) >>! In T203498#4565957, @elukey wrote: > Hi! Thanks a lot for this task, it triggered some useful discussions. A couple of notes after checking the CDH release details: > > On a more general note, we are currently... [15:26:08] 10Analytics, 10Pageviews-API, 10Wikipedia-iOS-App-Backlog, 10iOS-app-Bugs, 10iOS-app-v6.0.1-Walrus-On-A-Golf-Cart: Large increase on 404s from the Wikipedia IOS app - https://phabricator.wikimedia.org/T203688 (10Nuria) @jminor: turnilo just requires ldap access, just like piwik, please do file a ticket... [15:28:31] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Update superset (we have 0.20.6, 0.26.3 is available) - https://phabricator.wikimedia.org/T201430 (10mpopov) Sorry, I haven't checked my Phabricator emails in a while!!! Thanks so much @Ottomata!!! The upgrade has fixed the chart that wasn't working and h... [15:53:27] 10Analytics-Kanban: Refactor Refine job scalaopt to use property files and CLI overrides - https://phabricator.wikimedia.org/T203804 (10Ottomata) [15:53:39] (03PS2) 10Ottomata: Add ConfigHelper trait to auto load config files and CLI opts [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/415174 (https://phabricator.wikimedia.org/T203804) [15:55:56] (03CR) 10jerkins-bot: [V: 04-1] Add ConfigHelper trait to auto load config files and CLI opts [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/415174 (https://phabricator.wikimedia.org/T203804) (owner: 10Ottomata) [15:56:11] (03PS3) 10Ottomata: Add ConfigHelper trait to auto load config files and CLI opts [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/415174 (https://phabricator.wikimedia.org/T203804) [15:57:25] (03PS4) 10Ottomata: Add ConfigHelper trait to auto load config files and CLI opts [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/415174 (https://phabricator.wikimedia.org/T203804) [15:59:09] elukey: Excuse me for not having answered [15:59:20] elukey: Can we discuss after standup? [15:59:36] sorry people will be 2 mins late to standup, it is rainining and I have laundry outside /o\ [16:01:42] ping fdans [16:05:14] (03PS5) 10Ottomata: Add ConfigHelper trait to auto load config files and CLI opts [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/415174 (https://phabricator.wikimedia.org/T203804) [16:17:42] 10Analytics, 10Pageviews-API, 10Wikipedia-iOS-App-Backlog, 10iOS-app-Bugs, 10iOS-app-v6.0.1-Walrus-On-A-Golf-Cart: Large increase on 404s from the Wikipedia IOS app - https://phabricator.wikimedia.org/T203688 (10Nuria) Maybe there is an issue with loading pageviews... [16:31:47] 10Analytics, 10Pageviews-API, 10Wikipedia-iOS-App-Backlog, 10iOS-app-Bugs, 10iOS-app-v6.0.1-Walrus-On-A-Golf-Cart: Large increase on 404s from the Wikipedia IOS app - https://phabricator.wikimedia.org/T203688 (10Nuria) Wait no.. see nb.wikipedia.org does not exist as a project ... @jminor: There are sev... [16:42:30] 10Analytics: Sqoop e-mail is emailing errors in try1 for actions that suceeed in try 3 - https://phabricator.wikimedia.org/T203811 (10Nuria) [16:42:55] * elukey off! [16:56:02] 10Analytics, 10Readers-Web-Backlog, 10Wikimedia-Site-requests, 10MobileFrontend (MobileFrontend.js): Turn on MinervaErrorLogSamplingRate (Schema:WebClientError) - https://phabricator.wikimedia.org/T203814 (10Jdlrobson) @Ottomata can you guide me with a hard limit on events per minute for an EventLogging sc... [16:56:29] 10Analytics, 10Readers-Web-Backlog, 10Wikimedia-Site-requests, 10MobileFrontend (MobileFrontend.js): Turn on MinervaErrorLogSamplingRate (Schema:WebClientError) - https://phabricator.wikimedia.org/T203814 (10Jdlrobson) [16:56:35] 10Analytics, 10Readers-Web-Backlog: [Bug] Beta cluster events not logged - https://phabricator.wikimedia.org/T203815 (10Niedzielski) [16:57:02] 10Analytics, 10Readers-Web-Backlog: [Bug] Beta cluster events not logged - https://phabricator.wikimedia.org/T203815 (10Niedzielski) [16:59:03] 10Analytics, 10Pageviews-API, 10Wikipedia-iOS-App-Backlog, 10iOS-app-Bugs, 10iOS-app-v6.0.1-Walrus-On-A-Golf-Cart: Large increase on 404s from the Wikipedia IOS app - https://phabricator.wikimedia.org/T203688 (10JMinor) Thanks for the details @Nuria and and @jcrespo [16:59:21] 10Analytics, 10Readers-Web-Backlog, 10Wikimedia-Site-requests, 10MobileFrontend (MobileFrontend.js): Turn on MinervaErrorLogSamplingRate (Schema:WebClientError) - https://phabricator.wikimedia.org/T203814 (10Ottomata) Naw that should be fine! In general - if your rate is ~100 / sec or less, no need to no... [17:00:22] 10Analytics, 10Readers-Web-Backlog, 10Wikimedia-Site-requests, 10MobileFrontend (MobileFrontend.js): Turn on MinervaErrorLogSamplingRate (Schema:WebClientError) - https://phabricator.wikimedia.org/T203814 (10Jdlrobson) [17:01:41] 10Analytics, 10Readers-Web-Backlog, 10Wikimedia-Site-requests, 10MobileFrontend (MobileFrontend.js): Turn on MinervaErrorLogSamplingRate (Schema:WebClientError) - https://phabricator.wikimedia.org/T203814 (10Jdlrobson) I think blacklisting from MySQL might be sensible anyway, given a bug in MediaWiki:Mobil... [17:04:34] (03PS6) 10Ottomata: Add ConfigHelper trait to auto load config files and CLI opts [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/415174 (https://phabricator.wikimedia.org/T203804) [17:05:19] (03CR) 10Ottomata: "I had to put ConfigHelper in its own module so we can import in other projects with" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/415174 (https://phabricator.wikimedia.org/T203804) (owner: 10Ottomata) [17:12:17] 10Analytics, 10Readers-Web-Backlog, 10Wikimedia-Site-requests, 10MobileFrontend (MobileFrontend.js): Turn on MinervaErrorLogSamplingRate (Schema:WebClientError) - https://phabricator.wikimedia.org/T203814 (10Jdlrobson) p:05Triage>03High [17:25:29] 10Analytics, 10Discovery-Analysis, 10Product-Analytics, 10Reading-analysis, 10Patch-For-Review: Productionize per-country daily & monthly active app user stats - https://phabricator.wikimedia.org/T186828 (10Dbrant) Just to answer @Tbayer's question about background requests made from the app, here is a r... [17:28:52] a-team: Sqoop jobs havbe succeeded, but mediawiki-history jobs haven't start [17:29:12] this is related to project-namespace-map not being available for 2018-08 [17:29:23] I'm investigating, and will rerun the script manually [17:32:38] !log Manually rerun download-project-namespace-map on analytics1003 after cron's failure [17:32:40] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [17:38:50] 10Analytics: Per-editor edits stats - Community-liaison help - https://phabricator.wikimedia.org/T203826 (10JAllemandou) [17:40:13] 10Analytics: Fix download-project-namespace-map script to send alert if it fails - https://phabricator.wikimedia.org/T203824 (10JAllemandou) [17:42:45] 10Analytics: Decide whether enable per-editor edits stats (community decision) - https://phabricator.wikimedia.org/T203826 (10JAllemandou) [17:49:06] Hi Pchelolo - I just sent a PR to comment some endpoints [17:49:17] will look shortly [17:49:35] Pchelolo: I'm sorry for not having caught that before the previous PR [17:49:58] a-team: namespace script has failed again [17:50:03] will try to debug [17:50:23] 10Analytics, 10Community-consensus-needed: Decide whether enable per-editor edits stats (community decision) - https://phabricator.wikimedia.org/T203826 (10Cirdan) [[https://xtools.wmflabs.org/ec/de.wikipedia.org/KompostBot|Here]] you can see an example of what X!Tool's edit counter shows for a user account wh... [17:51:11] 10Analytics, 10Pageviews-API, 10Wikipedia-iOS-App-Backlog, 10iOS-app-Bugs, 10iOS-app-v6.1-Narwhal-On-A-Bumper-Car: Large increase on 404s from the Wikipedia IOS app - https://phabricator.wikimedia.org/T203688 (10LGoto) [17:51:30] looks good joal obviously, but I will not deploy it right away, no deploys on Friday :) [17:51:52] for sure Pchelolo :) No issue, thanks for looking at it :0 [17:52:04] Pchelolo: Will ping you on monda to make sure it moves :) [17:52:11] Have a good weekend Pchelolo :) [17:53:18] kk, you too.. My day only begins, too early to think about the weekend [17:54:02] Arf - Sorry then Pchelolo - My weekend has not yet started, but will soon :) [17:55:52] 10Analytics, 10Community-consensus-needed: Decide whether enable per-editor edits stats (community decision) - https://phabricator.wikimedia.org/T203826 (10JAllemandou) Thank you for the quick response ! We definitely don't want to enable the tools "silently". As for "perception" of privacy breach, this is exa... [17:57:59] (03PS6) 10Framawiki: Add an option to show a maintenance msg [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/440248 [17:59:20] (03CR) 10Framawiki: [C: 032] Add an option to show a maintenance msg [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/440248 (owner: 10Framawiki) [17:59:40] (03Merged) 10jenkins-bot: Add an option to show a maintenance msg [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/440248 (owner: 10Framawiki) [18:00:36] (03CR) 10Framawiki: [C: 032] "I just understand why yuvi had put these lines in this way... merging as we thought" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/440248 (owner: 10Framawiki) [18:01:10] Ah! I think the namespace-download problem comes from new firewall rules [18:01:40] 10Analytics, 10Community-consensus-needed: Decide whether enable per-editor edits stats (community decision) - https://phabricator.wikimedia.org/T203826 (10Cirdan) Did you have any use cases in mind? If there are third parties (researchers, staff etc.) who would like to get convenient access to that data, I su... [18:06:23] joal: oohhhh [18:06:33] confirmed team [18:06:38] ping ottomata which should be able to help with firewall rules [18:06:44] I'm on the patch to use the proxy [18:07:12] I'll have a version working soon, then the regular review-process for next month with the patch [18:07:38] Also nuria, see comunity response on T203826 [18:07:38] T203826: Decide whether enable per-editor edits stats (community decision) - https://phabricator.wikimedia.org/T203826 [18:09:11] 10Analytics, 10Community-consensus-needed: Decide whether enable per-editor edits stats (community decision) - https://phabricator.wikimedia.org/T203826 (10Nuria) ping @Johan for any thoughts [18:09:24] joal: ping-ed johan [18:09:31] Thanks nuria [18:09:57] joal: want to look at issue with project-namepsace map? [18:10:21] nuria: give me 5 minutes and I'll have a patch [18:13:30] 10Quarry, 10Patch-For-Review: Do the big Quarry migration - https://phabricator.wikimedia.org/T202588 (10Framawiki) I've set the following maintenance message: >Quarry will be subject to server maintenance on Wednesday, September 12 from 7pm UTC. The site will be read-only for a few hours, but should remain... [18:17:17] (03PS1) 10Joal: Add proxy to namespace-downloader script [analytics/refinery] - 10https://gerrit.wikimedia.org/r/458860 [18:18:06] !log Manually downoad namespaces for 2018-08 [18:18:07] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [18:18:08] 10Analytics: Upgrade Hive to ≥1.13 or ≥2.1 - https://phabricator.wikimedia.org/T203498 (10Neil_P._Quinn_WMF) >>! In T203498#4565957, @elukey wrote: > After this looong post, I just want to say that we support this request and that we'll try to do everything that we can to upgrade asap, but it might require a cou... [18:19:37] (03CR) 10Joal: [V: 031] "Tested on cluster - Allowed us to download 2018-08 snapshot" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/458860 (owner: 10Joal) [18:19:56] 10Analytics, 10Readers-Web-Backlog, 10Wikimedia-Site-requests, 10MobileFrontend (MobileFrontend.js): Turn on MinervaErrorLogSamplingRate (Schema:WebClientError) - https://phabricator.wikimedia.org/T203814 (10Ottomata) > I think blacklisting from MySQL might be sensible anyway, given a bug in MediaWiki:Mobi... [18:20:08] Good a-team, problem solved - mediawiki-history jobs have started [18:20:14] 10Analytics: Update CDH to 6 or alternatives - https://phabricator.wikimedia.org/T203693 (10Neil_P._Quinn_WMF) [18:20:16] 10Analytics: Default hive table creation to parquet - needs hive 2.3.0 - https://phabricator.wikimedia.org/T168554 (10Neil_P._Quinn_WMF) [18:20:50] 10Analytics: Default hive table creation to parquet - needs hive 2.3.0 - https://phabricator.wikimedia.org/T168554 (10Neil_P._Quinn_WMF) [18:20:52] 10Analytics: Update CDH to 6 or alternatives - https://phabricator.wikimedia.org/T203693 (10Neil_P._Quinn_WMF) [18:22:21] 10Analytics: Update CDH to 6 or alternatives - https://phabricator.wikimedia.org/T203693 (10Neil_P._Quinn_WMF) [18:22:23] 10Analytics: Upgrade Hive to ≥1.13 or ≥2.1 - https://phabricator.wikimedia.org/T203498 (10Neil_P._Quinn_WMF) [18:22:38] 10Analytics: Update CDH to 6 or alternatives - https://phabricator.wikimedia.org/T203693 (10Neil_P._Quinn_WMF) [18:22:42] 10Analytics: Upgrade Hive to ≥1.13 or ≥2.1 - https://phabricator.wikimedia.org/T203498 (10Neil_P._Quinn_WMF) [18:23:36] 10Analytics, 10Analytics-Cluster: Upgrade Hive to ≥1.13 or ≥2.1 - https://phabricator.wikimedia.org/T203498 (10Neil_P._Quinn_WMF) [18:25:21] 10Analytics, 10Analytics-Cluster: Update to Cloudera CDH 6 or other Hadoop distribution - https://phabricator.wikimedia.org/T203693 (10Neil_P._Quinn_WMF) [18:25:35] 10Analytics, 10Analytics-Cluster: Update to CDH 6 or other Hadoop distribution - https://phabricator.wikimedia.org/T203693 (10Neil_P._Quinn_WMF) [18:25:42] 10Analytics, 10Analytics-Cluster: Update to CDH 6 or other up-to-date Hadoop distribution - https://phabricator.wikimedia.org/T203693 (10Neil_P._Quinn_WMF) [18:26:10] 10Analytics, 10Cloud-Services: Discuss labsdb visibility of rev_text_id and ar_comment - https://phabricator.wikimedia.org/T158166 (10Marostegui) [18:28:16] joal: why do we need to download teh project/namepsace , are numbers for namespace different per wiki? [18:29:11] *the [18:31:19] 10Analytics, 10DBA, 10Growth-Team, 10Notifications: Purge all Schema:Echo data after 90 days - https://phabricator.wikimedia.org/T128623 (10Marostegui) What should we do with this task? [18:33:39] joal: wanna quick brain bounce to see if we can think of something nice to do about param doc strings? right now i've got it all custom per job, and maybe that's the way it should be [18:33:49] buuut, maybe it could be in ConfigHelper somehow? dunno, maybe too fancy [18:34:42] (03PS7) 10Ottomata: Add ConfigHelper trait to auto load config files and CLI opts [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/415174 (https://phabricator.wikimedia.org/T203804) [18:38:03] (03PS1) 10Ottomata: Use ConfigHelper for RefineMonitor instead of scopt [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/458862 (https://phabricator.wikimedia.org/T203804) [18:43:07] Heya ottomata - We can talk if you want :) [18:43:44] coo [18:43:53] 30 sec... [18:44:14] nuria: we download namespace names (canonical and internationalized) [18:44:36] nuria: and indeed numbers and names and all are different per wikis [18:44:57] joal: i see [18:45:26] (03CR) 10Nuria: [C: 032] Add proxy to namespace-downloader script [analytics/refinery] - 10https://gerrit.wikimedia.org/r/458860 (owner: 10Joal) [18:45:33] (03PS2) 10Ottomata: Use ConfigHelper for RefineMonitor instead of scopt [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/458862 (https://phabricator.wikimedia.org/T203804) [18:56:28] 10Analytics, 10Readers-Web-Backlog, 10Wikimedia-Site-requests, 10MobileFrontend (MobileFrontend.js): Turn on MinervaErrorLogSamplingRate (Schema:WebClientError) - https://phabricator.wikimedia.org/T203814 (10Jdlrobson) I'm hoping for few events and we do plan on ramping up the sampling, but but because of... [18:58:19] 10Analytics-Kanban, 10Patch-For-Review: Make sampling by session more obvious in eventlogging module - https://phabricator.wikimedia.org/T203612 (10Nuria) [18:59:29] 10Analytics-Kanban: Correct end point documentation about parameter specification on AQS api docs - https://phabricator.wikimedia.org/T203403 (10Nuria) [18:59:54] (03PS3) 10Nuria: Correct end-point documentation [analytics/aqs] - 10https://gerrit.wikimedia.org/r/456573 (https://phabricator.wikimedia.org/T203403) (owner: 10Joal) [19:16:44] (03PS1) 10Zhuyifei1999: .maintenance-msg: font-size: 18.75px; => font-weight: bold; [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/458873 [19:30:22] I'm here ottomata :) [19:30:26] ou can join when ou know more [19:30:33] or we can discuss on IRC :) [19:30:44] ok, few mins....i think it worked this time??? the macro... [19:31:59] then it's the deconstruction? [19:32:12] checking [19:32:23] no, now it is working with deconstruction... [19:32:25] ???? [19:32:30] Meeeeeh [19:32:42] Ok I think I have bad aura with scala tonight :) [19:33:11] (03CR) 10Framawiki: "Thanks for your patch" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/458873 (owner: 10Zhuyifei1999) [19:36:12] (03PS2) 10Zhuyifei1999: Style changes regarding navbar and maintenance-msg [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/458873 [19:44:09] (03PS3) 10Zhuyifei1999: Style changes regarding navbar and maintenance-msg [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/458873 [19:53:33] (03CR) 10Framawiki: [C: 032] Style changes regarding navbar and maintenance-msg [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/458873 (owner: 10Zhuyifei1999) [19:53:51] (03Merged) 10jenkins-bot: Style changes regarding navbar and maintenance-msg [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/458873 (owner: 10Zhuyifei1999) [20:03:04] (03PS1) 10Zhuyifei1999: position:sticky needs top:0 [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/458886 [20:12:56] joal: if you still want to have some scala fun [20:13:05] this --config-file finder is not easy to do all funcitonal style! [20:13:21] :) [20:13:54] Recursive for the win ! [20:14:18] haha [20:14:19] (03PS2) 10Zhuyifei1999: position:sticky needs top:0 & higher z-index [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/458886 [20:15:22] 10Quarry: Do the big Quarry migration - https://phabricator.wikimedia.org/T202588 (10Framawiki) [20:17:43] 10Quarry: Do the big Quarry migration - https://phabricator.wikimedia.org/T202588 (10Framawiki) [20:19:36] (03CR) 10Framawiki: [C: 032] app.py: Load Redis for session from Connections [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/458351 (https://phabricator.wikimedia.org/T202588) (owner: 10Zhuyifei1999) [20:23:23] (03PS2) 10Zhuyifei1999: app.py: Load Redis for session from Connections [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/458351 (https://phabricator.wikimedia.org/T202588) [20:24:01] (03CR) 10Framawiki: [C: 032] app.py: Load Redis for session from Connections [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/458351 (https://phabricator.wikimedia.org/T202588) (owner: 10Zhuyifei1999) [20:24:31] (03Merged) 10jenkins-bot: app.py: Load Redis for session from Connections [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/458351 (https://phabricator.wikimedia.org/T202588) (owner: 10Zhuyifei1999) [20:30:42] ottomata: something like that should do: https://gist.github.com/jobar/9bd397bd7616779103012559f8dc5856 [20:30:56] ottomata: not tested, but compiles and sounds reasonnably correct :) [20:36:23] Gone for tonight - See you on monday team [20:39:59] AHHH! [20:40:01] i was working on it too [20:40:02] looking [20:40:03] wow [20:56:36] (03CR) 10Framawiki: [C: 032] "This patch has caused a Bad Gateway after its deploy. Currently investigated after its revert by Zhuyifei." [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/458351 (https://phabricator.wikimedia.org/T202588) (owner: 10Zhuyifei1999) [21:01:23] (03PS1) 10Zhuyifei1999: connections.py: use Redis instead of StrictRedis [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/458901 [21:02:10] (03PS2) 10Zhuyifei1999: connections.py: use Redis instead of StrictRedis [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/458901 [21:03:02] (03CR) 10Zhuyifei1999: [C: 032] "The relevant traceback is:" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/458901 (owner: 10Zhuyifei1999) [21:03:18] joal amazing, playing with that, getting it to do nice stuff [21:03:19] thank you [21:03:41] (03Merged) 10jenkins-bot: connections.py: use Redis instead of StrictRedis [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/458901 (owner: 10Zhuyifei1999) [21:03:48] (03CR) 10Framawiki: [C: 032] "Will (should) be fixed by https://gerrit.wikimedia.org/r/#/c/analytics/quarry/web/+/458901/." [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/458351 (https://phabricator.wikimedia.org/T202588) (owner: 10Zhuyifei1999) [21:05:04] (03CR) 10Zhuyifei1999: [C: 032] position:sticky needs top:0 & higher z-index [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/458886 (owner: 10Zhuyifei1999) [21:05:21] (03Merged) 10jenkins-bot: position:sticky needs top:0 & higher z-index [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/458886 (owner: 10Zhuyifei1999) [21:17:57] 10Analytics, 10EventBus, 10MediaWiki-General-or-Unknown, 10Multi-Content-Revisions, 10Services (done): It should be possible to understand the reason of revision creation from RevisionRecordInserted hook - https://phabricator.wikimedia.org/T188396 (10Pchelolo) 05Open>03declined We do not really need... [21:21:26] 10Quarry: Do the big Quarry migration - https://phabricator.wikimedia.org/T202588 (10Framawiki) [21:25:53] 10Quarry, 10Patch-For-Review: Do the big Quarry migration - https://phabricator.wikimedia.org/T202588 (10Framawiki) [22:14:21] 10Analytics, 10EventBus, 10Pywikibot-core, 10Wikimedia-Stream: https://stream.wikimedia.org/v2/stream/recentchange 502 Bad Gateway - https://phabricator.wikimedia.org/T191108 (10Pchelolo) 05Open>03Resolved a:03Pchelolo I believe after T199813 was fixed this should not happen again. [22:16:26] 10Analytics, 10EventBus, 10Services (done), 10User-Elukey: Kafka sometimes misses to rebalance topics properly - https://phabricator.wikimedia.org/T179684 (10Pchelolo) 05Open>03Resolved This did not happen for a while, resolving. Please reopen if happens again. [22:47:20] 10Analytics, 10Operations, 10procurement: rack/setup/install stat1007.eqiad.wmnet (stat1005 user replacement) - https://phabricator.wikimedia.org/T203852 (10RobH) p:05Triage>03Normal [22:47:33] 10Analytics, 10Operations, 10ops-eqiad: rack/setup/install stat1007.eqiad.wmnet (stat1005 user replacement) - https://phabricator.wikimedia.org/T203852 (10RobH) [22:48:44] 10Analytics, 10Operations, 10ops-eqiad: rack/setup/install stat1007.eqiad.wmnet (stat1005 user replacement) - https://phabricator.wikimedia.org/T203852 (10RobH) So my racking proposal may be overly restrictive. I'm not sure what services will share between stat boxes, so to be safe I simply stated not to ra... [23:46:27] 10Analytics, 10Readers-Web-Backlog: [Bug] Beta cluster events not logged - https://phabricator.wikimedia.org/T203815 (10Nuria) @Niedzielski please ping us on channel for issues such as this one, eventlogging on beta needed to be restarted bu i can see vents now coming into log [23:46:36] 10Analytics, 10Readers-Web-Backlog: [Bug] Beta cluster events not logged - https://phabricator.wikimedia.org/T203815 (10Nuria) 05Open>03Resolved