[00:55:22] 10Analytics-Kanban, 10WMDE-Analytics-Engineering, 10Patch-For-Review, 10User-GoranSMilovanovic: SparkR on Spark 2.3.0 - Cannot run program "Rscript" - https://phabricator.wikimedia.org/T192348#4138169 (10GoranSMilovanovic) [00:56:57] 10Analytics-Kanban, 10WMDE-Analytics-Engineering, 10Patch-For-Review, 10User-GoranSMilovanovic: SparkR on Spark 2.3.0 - Testing on Large Data Sets - https://phabricator.wikimedia.org/T192348#4135629 (10GoranSMilovanovic) [07:04:21] 10Analytics, 10Analytics-Wikistats, 10Wikimedia-Site-requests: Add li: Wikibooks to stats.wikimedia.org - https://phabricator.wikimedia.org/T165634#4138464 (10Dcljr) @Nuria, thanks for the heads-up, but I only edited the task name. Perhaps you meant to ping the task creator? [08:04:29] trivia for today: how many znodes in the zk main eqiad cluster? [08:04:32] ~42k [08:04:40] :O [08:05:07] I am re-doing the zk dashboard again https://grafana.wikimedia.org/dashboard/db/zookeeper [08:05:30] yestserday I discovered that some metrics were duplicated, the zk jmx settings are a bit weird [08:06:11] but good news is that zk 3.4.9 works fine in codfw [08:06:32] so I think we are good to probably deploy it on eqiad (even on Druid possibly?) [08:07:35] I am thinking of doing it asap since when we'll migrate to druid 0.12 (or the latest stable, not sure what that is) we'll drop java-7 support [08:07:52] and we'll be ready for Stretch [08:08:04] the procedure at that point would be super simple [08:08:13] 1) remove one node from the cluster, reimage, done [09:10:47] 10Analytics-Kanban, 10WMDE-Analytics-Engineering, 10Patch-For-Review, 10User-GoranSMilovanovic: SparkR on Spark 2.3.0 - Testing on Large Data Sets - https://phabricator.wikimedia.org/T192348#4135629 (10elukey) This morning I removed the old apt config for jessie backports (since after https://gerrit.wikime... [09:13:45] so about --^ [09:13:55] now r packages are deployed to all the worker nodes [09:14:10] but there is a difference between jessie and stretch [09:18:55] 10Analytics-Kanban, 10Patch-For-Review: Puppetize job that saves old versions of Maxmind geoIP database - https://phabricator.wikimedia.org/T136732#4138643 (10fdans) As discussed post standup, we're planning on incorporating this task to the MaxMind module in puppet. This would mean: - Archiving isn't done... [09:37:51] 10Analytics-Kanban, 10WMDE-Analytics-Engineering, 10Patch-For-Review, 10User-GoranSMilovanovic: SparkR on Spark 2.3.0 - Testing on Large Data Sets - https://phabricator.wikimedia.org/T192348#4138708 (10GoranSMilovanovic) @elukey The ideal situation would be to have the same version of R installed across al... [10:05:44] 10Analytics-Kanban, 10WMDE-Analytics-Engineering, 10Patch-For-Review, 10User-GoranSMilovanovic: SparkR on Spark 2.3.0 - Testing on Large Data Sets - https://phabricator.wikimedia.org/T192348#4138750 (10elukey) Ok! I am going to chat with Andrew about https://gerrit.wikimedia.org/r/427159, since adding `r-b... [10:22:41] (03CR) 10Lucas Werkmeister (WMDE): [C: 032] Track number of constraint definition snaks over time [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/425872 (https://phabricator.wikimedia.org/T191891) (owner: 10Ladsgroup) [10:22:49] (03Merged) 10jenkins-bot: Track number of constraint definition snaks over time [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/425872 (https://phabricator.wikimedia.org/T191891) (owner: 10Ladsgroup) [10:25:12] (03PS1) 10Ladsgroup: Track number of constraint definition snaks over time [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/427348 (https://phabricator.wikimedia.org/T191891) [10:25:22] (03CR) 10Ladsgroup: [C: 032] Track number of constraint definition snaks over time [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/427348 (https://phabricator.wikimedia.org/T191891) (owner: 10Ladsgroup) [10:25:31] (03Merged) 10jenkins-bot: Track number of constraint definition snaks over time [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/427348 (https://phabricator.wikimedia.org/T191891) (owner: 10Ladsgroup) [10:26:38] * elukey lunch + errand! be back in ~2h [10:57:20] (03CR) 10Fdans: "Just nits about naming and spacing. Other than that this looks good!" (038 comments) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/427042 (https://phabricator.wikimedia.org/T182718) (owner: 10Nuria) [12:47:53] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10New-Readers, and 6 others: Proxies information gone from Zero portal. Opera mini pageviews geolocating to wrong country - https://phabricator.wikimedia.org/T187014#4139073 (10Mholloway) [13:07:10] 10Analytics-Kanban, 10Patch-For-Review: Puppetize job that saves old versions of Maxmind geoIP database - https://phabricator.wikimedia.org/T136732#4139109 (10elukey) >>! In T136732#4138643, @fdans wrote: > > The total size of the archive as it is right now is 17Gb. @Ottomata @elukey is it sustainable to sync... [13:13:57] (03CR) 10Mforns: [V: 032 C: 032] "> Looks good, do we also need changes on python version?" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/420795 (https://phabricator.wikimedia.org/T190202) (owner: 10Mforns) [13:17:01] very nice reading: [13:17:03] Please note that after upgrading to 0.12.0, it is no longer possible to downgrade to a version older than 0.11.0, due to changes made in #4762. It is still possible to roll back to version 0.11.0. [13:17:29] https://github.com/druid-io/druid/releases [13:45:06] 10Analytics-Kanban, 10Patch-For-Review: Puppetize job that saves old versions of Maxmind geoIP database - https://phabricator.wikimedia.org/T136732#4139232 (10Ottomata) Great! 17G is a little big for puppetmasters as is now, but we can ask ops if we can expand the partition, or add another one. We'll talk abo... [13:45:55] 10Analytics, 10Patch-For-Review, 10User-Elukey: Update druid to latest release (0.11) - https://phabricator.wikimedia.org/T164008#4139249 (10elukey) Restarting to work on this after the Hadoop cluster has been migrated to Java 8. The latest stable release is currently 0.12, meanwhile we are running 0.9.2. Th... [13:53:49] 10Analytics-Kanban, 10WMDE-Analytics-Engineering, 10Patch-For-Review, 10User-GoranSMilovanovic: SparkR on Spark 2.3.0 - Testing on Large Data Sets - https://phabricator.wikimedia.org/T192348#4139338 (10Ottomata) Whaa? I did the very cumin rm apt-get update thing you did yesterday! Puppet ran everywhere f... [13:56:42] ottomata: o/ [13:57:06] I'd like to restart kafka on kafka2001/1001 for openjdk upgrades, just to test the new version before the big rolling restarts for zookeeper [13:57:13] anything against it? [13:57:49] 10Analytics, 10Patch-For-Review, 10User-Elukey: Update druid to latest release (0.11) - https://phabricator.wikimedia.org/T164008#4139350 (10Ottomata) K sounds good. I'd go for 0.11 (after labs testing), but if you prefer to 0.10 first, that sounds fine too. [13:57:55] nope proceed! [13:58:06] ack! [14:00:34] 10Analytics-Kanban, 10Patch-For-Review: Puppetize job that saves old versions of Maxmind geoIP database - https://phabricator.wikimedia.org/T136732#4139357 (10fdans) @elukey yeah that's right. The piece that I'm missing is (and it's probably a trivial thing) how do we put the past archive in /usr/shared so tha... [14:03:19] 10Analytics, 10Operations, 10Patch-For-Review: rack/setup/install notebook100[34] - https://phabricator.wikimedia.org/T183935#4139369 (10Ottomata) 05Open>03Resolved [14:05:20] 10Analytics-Kanban, 10Patch-For-Review: Puppetize job that saves old versions of Maxmind geoIP database - https://phabricator.wikimedia.org/T136732#4139382 (10Ottomata) @Fdans, puppet will do that. The puppetmasters are the only ones that include `geoip::data::maxmind`. Every other puppet client node uses `g... [14:07:26] * elukey afk for 10m [14:07:41] kafka on kafka2001 just restarted, all metrics are fine [14:11:49] 10Analytics, 10Analytics-Kanban, 10Analytics-Wikistats, 10Google-Summer-of-Code (2018): GSoC Proposal 2018 : [Analytics] Improvements to Wikistats2 front-end - https://phabricator.wikimedia.org/T189964#4139392 (10sahil505) [14:16:21] (03PS2) 10Fdans: Adds/fixes touch interactions in graphs [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/423904 (https://phabricator.wikimedia.org/T188277) [14:16:45] heya teaam [14:20:16] (03CR) 10Ottomata: "Some comments, but I'm not totally sure of what the best thing to do is. Maybe RefineTargets should be able to instantiate PartitionedDat" (033 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/427187 (owner: 10Joal) [14:20:23] heyaaa [14:31:46] hmm, fdans thought: you sure you want to do directories? it is def easier, but I'd guess that not all maxmind files change each week [14:33:18] ottomata: i guess that depends on if we want consistency across the files for a particular date right? [14:36:06] hm [14:36:19] true [14:36:31] i guess we could do it with hardlinks? [14:36:35] instead of copying the files? [14:36:41] make hte timestamp dir [14:36:47] then hardlink each file into it [14:37:00] then identical files won't take extra space [14:37:24] ottomata: gotta say tho, i've checked the diff a couple times from one week to the other: [14:37:28] https://www.irccloud.com/pastebin/yBs9K3uY/ [14:37:44] ottomata: it does appear to change across all the files [14:37:49] fdans: every week every file changes? [14:37:49] hmm ok [14:38:01] does that mean the archive currently grows by about 300MB / week? [14:38:49] oh this is fun math [14:39:01] ottomata: git rev-list --count master [14:39:01] 200 [14:39:18] so there's 19gb of data for 200 commits [14:40:12] that averages 95mb per commit, but it's probably because the earlier commits contain way less data [14:40:30] right [14:40:32] ok, makes sense [14:40:46] so yeah, i'd say 300mb per week [14:42:06] 10Analytics-Tech-community-metrics, 10Code-Health, 10Release-Engineering-Team (Kanban): Develop canonical/single record of origin, machine readable list of all repos deployed to WMF sites. - https://phabricator.wikimedia.org/T190891#4139496 (10Aklapper) [14:42:06] soooo whatcha think we should do ottomata [14:42:27] ottomata: interesting thing that I observed in the past - https://grafana.wikimedia.org/dashboard/db/kafka?refresh=5m&panelId=19&fullscreen&orgId=1&var-cluster=main-codfw&var-kafka_brokers=All&var-kafka_servers=All&from=now-3h&to=now [14:42:29] 10Analytics, 10Patch-For-Review, 10User-Elukey: Update druid to latest release (0.11) - https://phabricator.wikimedia.org/T164008#4139499 (10Nuria) +1 to plan [14:42:34] do you have any idea what is happening? [14:42:52] I had a chat with Peter but nothing came up, and burrow metrics don't show any weirdness [14:42:52] fdans: not sure, i just sent email to ops list with proposal, we'll bring it up today in the SRE meeting [14:43:00] elukey: that link shows no data points for me [14:44:54] whatttt [14:46:02] mforns: El doing well https://grafana.wikimedia.org/dashboard/db/eventlogging-schema?orgId=1&var-datasource=eqiad%20prometheus%2Fops&var-schema=VirtualPageView&from=now-7d&to=now [14:46:23] mforns: napkin math holding up, i re-did it yesterday and i think we will be doing 1100 events at peak [14:47:06] 10Analytics, 10Analytics-Wikistats, 10Wikimedia-Site-requests: Add li: Wikibooks to stats.wikimedia.org - https://phabricator.wikimedia.org/T165634#4139519 (10Nuria) ping @Ooswesthoesbes [14:47:31] ottomata: not sure what the hell happens to grafana, but it is kafka bytes out for main-codfw [14:47:34] :( [14:48:42] ok looking [14:48:47] wow [14:48:51] yeah [14:48:55] that happened since restart elukey? [14:49:01] I already seen this a couple of time after my restarts [14:49:02] yep yep [14:49:12] you restarted all three? [14:49:14] oh it goes back down? [14:49:17] elukey sounds like replication [14:49:22] but that would be really weird [14:49:22] only one [14:49:26] 2001 [14:49:37] is 2001 re-replicating everything? [14:49:41] from the other 2? [14:49:50] I didn't check, this is a good point to verify [14:49:51] hm, bytes in on 2001 doesn't really go back up [14:49:58] ah right [14:51:07] nuria_: I got what you meant yesterday but just in case you were curious about the results of this query: [14:51:12] https://www.irccloud.com/pastebin/SFuD8BST/ [14:51:39] of 352507 users with the popups property set, 275117 have it off [14:51:47] milimetric: right, that would be logedd in users [14:51:59] yep [14:52:17] nuria_: also, geowiki numbers are a lot closer once I realized I was accidentally counting anon on the hadoop side [14:52:33] but there are small-ish differences (10%) that I don't understand [14:52:47] if you or anyone else wants to brainbounce, I'm happy to, meanwhile I'm just digging into it [14:52:55] milimetric: the bulk of traffic is not logged in you can see it here: https://grafana.wikimedia.org/dashboard/db/eventlogging-schema?orgId=1&var-datasource=eqiad%20prometheus%2Fops&var-schema=VirtualPageView&from=now-7d&to=now [14:53:15] nuria_: no, totally, I understood that, sorry to make you repeat yourself [14:53:25] elukey: you said you did leader eleciton already? [14:53:37] milimetric: sure, let's talk on batcave [14:53:42] moving convoe to services [14:54:09] in the cave nuria_ [14:54:20] milimetric: give me 5 mins [15:14:18] 10Analytics-Kanban, 10Patch-For-Review: Puppetize job that saves old versions of Maxmind geoIP database - https://phabricator.wikimedia.org/T136732#2345955 (10faidon) I don't feel strongly about this, but I'm a bit skeptical about keeping this in puppet/volatile, given these are fairly out of scope for Puppet... [15:16:27] 10Analytics-Kanban, 10Patch-For-Review: Puppetize job that saves old versions of Maxmind geoIP database - https://phabricator.wikimedia.org/T136732#4139610 (10Ottomata) We could do that, but we wanted something centralized and reproducable (e.g. include a puppet class, get the historical dbs). We would have j... [15:19:24] nuria_, I see, are we already at "real" 100%? or real 50%? [15:26:07] 10Analytics, 10EventBus, 10MediaWiki-JobQueue, 10wikitech.wikimedia.org, 10Services (later): Transfer wikitech jobs to Kafka queue - https://phabricator.wikimedia.org/T192361#4139628 (10mobrovac) a:05Pchelolo>03None It turns out Wikitech [does not use the Redis-based queue](https://github.com/wikimed... [15:26:21] 10Analytics, 10EventBus, 10MediaWiki-JobQueue, 10wikitech.wikimedia.org, 10Services (later): Transfer wikitech jobs to Kafka queue - https://phabricator.wikimedia.org/T192361#4139631 (10mobrovac) [15:26:26] 10Analytics, 10EventBus, 10MediaWiki-JobQueue, 10Goal, and 3 others: FY17/18 Q4 Program 8 Services Goal: Complete the JobQueue transition to EventBus - https://phabricator.wikimedia.org/T190327#4139632 (10mobrovac) [15:29:21] elukey: batcave is occupied! using a-batcave-2 [15:29:36] ottomata: I was about to say the same :) [15:43:39] 10Analytics, 10Analytics-Kanban: Update version of ua-parser in refinery source - https://phabricator.wikimedia.org/T192463#4139693 (10fdans) p:05Triage>03High [15:45:18] 10Analytics, 10Operations, 10hardware-requests, 10ops-eqiad, 10Patch-For-Review: Decommission kafka1018 - https://phabricator.wikimedia.org/T182955#4139708 (10Cmjohnson) [15:45:21] 10Analytics, 10Analytics-Kanban: Update ua-parser-core submodule in wmf ua-parser - https://phabricator.wikimedia.org/T192464#4139709 (10fdans) p:05Triage>03High [15:45:52] 10Analytics, 10Operations, 10hardware-requests, 10ops-eqiad, 10Patch-For-Review: Decommission kafka1018 - https://phabricator.wikimedia.org/T182955#3839641 (10Cmjohnson) 05Open>03Resolved removed from rack and network port updated (ge-8/0/0). updated racktables and tracking sheet [15:48:31] mforns: 100% now [15:48:34] wowowow [15:48:40] ok! [15:48:45] 10Analytics, 10Analytics-Kanban: Pull wmf ua-parser-core from the upstream repo - https://phabricator.wikimedia.org/T192465#4139735 (10fdans) p:05Triage>03High [15:49:03] mforns: restbase is doing ok at a higher rate it has ever had https://grafana-admin.wikimedia.org/dashboard/db/restbase?panelId=15&fullscreen&orgId=1&from=1523895148889&to=now&refresh=1m [15:50:29] 10Analytics, 10Analytics-Kanban: Update ua-parser-core submodule in wmf ua-parser - https://phabricator.wikimedia.org/T192464#4139749 (10Nuria) We are updating regex files for sure, not sure if core package has changed. The meat of matter is on the regex file where new browsers get added. [15:54:11] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10New-Readers, and 6 others: Proxies information gone from Zero portal. Opera mini pageviews geolocating to wrong country - https://phabricator.wikimedia.org/T187014#4139751 (10dr0ptp4kt) The lack of tagging did not appear to be related to any conf... [15:54:49] cool [15:56:55] (03PS1) 10Fdans: Add all changes to repo since Feb 2016 [analytics/ua-parser/uap-core] - 10https://gerrit.wikimedia.org/r/427415 (https://phabricator.wikimedia.org/T192465) [15:59:16] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10New-Readers, and 6 others: Proxies information gone from Zero portal. Opera mini pageviews geolocating to wrong country - https://phabricator.wikimedia.org/T187014#4139773 (10Nuria) @dr0ptp4kt trying to understand: is this the bug that makes the... [16:00:48] 10Analytics-Tech-community-metrics, 10Code-Health, 10Release-Engineering-Team (Kanban): Develop canonical/single record of origin, machine readable list of all repos deployed to WMF sites. - https://phabricator.wikimedia.org/T190891#4086695 (10Legoktm) https://phabricator.wikimedia.org/source/tool-ci/browse/... [16:01:15] ping fdans elukey [16:04:23] 10Analytics-Kanban, 10Patch-For-Review: Puppetize job that saves old versions of Maxmind geoIP database - https://phabricator.wikimedia.org/T136732#2345955 (10herron) Recursively managing a set of large files with puppet is going to be slow. In particular subsequent runs after the files have been populated wi... [16:05:06] 10Analytics-Kanban, 10Patch-For-Review: Puppetize job that saves old versions of Maxmind geoIP database - https://phabricator.wikimedia.org/T136732#4139794 (10Ottomata) That'd be fine! [16:10:26] 10Analytics, 10EventBus, 10MediaWiki-JobQueue, 10wikitech.wikimedia.org, 10Services (later): Transfer wikitech jobs to Kafka queue - https://phabricator.wikimedia.org/T192361#4139799 (10mobrovac) 05Open>03declined Actually, we cannot move the wikitech jobs as they are currently because of security im... [16:10:30] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10New-Readers, and 6 others: Proxies information gone from Zero portal. Opera mini pageviews geolocating to wrong country - https://phabricator.wikimedia.org/T187014#4139798 (10dr0ptp4kt) >>! In T187014#4139773, @Nuria wrote: > @dr0ptp4kt trying to... [16:20:54] 10Analytics-Kanban, 10WMDE-Analytics-Engineering, 10Patch-For-Review, 10User-GoranSMilovanovic: SparkR on Spark 2.3.0 - Testing on Large Data Sets - https://phabricator.wikimedia.org/T192348#4139832 (10GoranSMilovanovic) @Ottomata Everything seems to be fine thus far. However, I am not testing any really l... [16:40:32] 10Analytics, 10Analytics-Kanban: Upgrade Kafka on main cluster with security features - https://phabricator.wikimedia.org/T167039#4139902 (10Ottomata) [16:49:13] 10Analytics-Kanban, 10Patch-For-Review, 10Puppet: Puppetize job that saves old versions of Maxmind geoIP database - https://phabricator.wikimedia.org/T136732#4139952 (10fgiunchedi) [16:55:55] 10Analytics-Kanban, 10Analytics-Wikistats: Beta Release: Resiliency, Rollback and Deployment of Data - https://phabricator.wikimedia.org/T177965#4139974 (10JAllemandou) [16:56:30] 10Analytics-Kanban, 10Analytics-Wikistats: Wikistats 2 Backend: Resiliency, Rollback and Deployment of Data - https://phabricator.wikimedia.org/T177965#3676320 (10JAllemandou) [17:24:46] (03PS2) 10Framawiki: Don't use "None" if the query has no title [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/427025 [17:29:12] 10Analytics: Refactor pagecounts-ez generation - https://phabricator.wikimedia.org/T192474#4140140 (10Nuria) [17:30:07] (03CR) 10Framawiki: [C: 031] Enhance top menu by adding links for quick access to database tables [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/361299 (owner: 10XXN) [17:35:16] (03CR) 10Zhuyifei1999: [C: 032] Don't use "None" if the query has no title [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/427025 (owner: 10Framawiki) [17:35:33] (03Merged) 10jenkins-bot: Don't use "None" if the query has no title [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/427025 (owner: 10Framawiki) [17:38:00] 10Analytics, 10Research: Refactor pagecounts-ez generation - https://phabricator.wikimedia.org/T192474#4140184 (10leila) [17:38:51] (03CR) 10Zhuyifei1999: [C: 032] "Btw, @Framawiki do you want to maintain Quarry?" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/427025 (owner: 10Framawiki) [17:41:22] 10Analytics, 10Analytics-Kanban: Update ua-parser-core submodule in wmf ua-parser - https://phabricator.wikimedia.org/T192464#4140197 (10fdans) @Nuria core is the repo that contains the regex files: https://github.com/ua-parser/uap-core [17:47:27] (03PS3) 10Nuria: Friendly Titles for Wikistats2 Pages [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/427042 (https://phabricator.wikimedia.org/T182718) [18:12:06] * elukey off! [18:18:21] mforns, milimetric : "Wikistats - bm.wikipedia.org - Unique Devices" does scheme this sound ok as title? cc fdans [18:27:44] nuria_: I'd go with the name of the wiki instead of the URL [18:28:13] so like Wikistats - Afrikaans Wikipedia - Unique Devices [18:37:10] milimetric: mmm.. i wonder if that is gettable from state store, need to look and do a little refactor. will cehck back [18:37:15] *check [18:38:10] nuria_: no, it probably needs the sitematrix, but should be a quick lookup [18:38:20] (because the sitematrix is cached anyway) [18:45:15] 10Analytics-Kanban, 10Analytics-Wikistats: Add Mediawiki-History data-quality check stage in oozie using statistics - https://phabricator.wikimedia.org/T192481#4140380 (10JAllemandou) [18:48:09] 10Analytics-Kanban, 10Analytics-Wikistats: Make mediawiki-history-reduced table permanent (snapshot partitioning) - https://phabricator.wikimedia.org/T192482#4140406 (10JAllemandou) [18:51:12] 10Analytics-Kanban, 10Analytics-Wikistats: Add data-quality check on mediawiki-history-reduced before druid indexation - https://phabricator.wikimedia.org/T192483#4140423 (10JAllemandou) [18:51:24] 10Analytics-Kanban, 10Analytics-Wikistats: Wikistats 2 Backend: Resiliency, Rollback and Deployment of Data - https://phabricator.wikimedia.org/T177965#4140437 (10JAllemandou) Anoher round of discussion with team: - Quality checks should happen **before** data gets loaded into druid - Since T155507, we now h... [18:51:35] nuria_: --^ [19:14:59] (03CR) 10Joal: "Comments inline" (033 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/427187 (owner: 10Joal) [19:19:32] (03PS7) 10Amire80: WIP Analyzing failed ULS searches [analytics/limn-language-data] - 10https://gerrit.wikimedia.org/r/413270 (https://phabricator.wikimedia.org/T190630) [19:31:24] nuria_, sorry was having dinner, I agree with Dan [19:31:39] 10Analytics-Kanban, 10Patch-For-Review, 10Puppet: Puppetize job that saves old versions of Maxmind geoIP database - https://phabricator.wikimedia.org/T136732#4140523 (10herron) Ok, now thinking about options for the rsync source/server side... I tend to agree that volatile isn't very well suited for archive... [19:34:20] (03CR) 10Zhuyifei1999: [C: 032] "Nice :) Sorry for not seeing this patch." [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/361299 (owner: 10XXN) [19:34:28] 10Analytics, 10Analytics-EventLogging, 10Cognate, 10Collaboration-Team-Triage, and 14 others: Possible PHP7 compatibility issues in WMF-deployed extensions - https://phabricator.wikimedia.org/T173850#4140541 (10Krinkle) 05Open>03Resolved [19:34:40] (03Merged) 10jenkins-bot: Enhance top menu by adding links for quick access to database tables [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/361299 (owner: 10XXN) [19:38:52] milimetric: agreed, will chnage it so the mixing does that no the state store, will send CR today cc mforns [19:39:22] cool, thanks nuria_, yeah, the state store doesn't need to know about that [19:39:56] (03PS3) 10Zhuyifei1999: More options for the number of shown rows of resultset. [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/328602 (https://phabricator.wikimedia.org/T126540) (owner: 10XXN) [19:40:01] joal: reading [19:41:27] (03CR) 10Zhuyifei1999: [C: 04-1] "Modifying code under vendor/ (third-party code) is not a good idea. We could somehow override the values with our own code." [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/328602 (https://phabricator.wikimedia.org/T126540) (owner: 10XXN) [19:51:36] (03PS5) 10Sturmkrahe: Darken subdued text and alter footer area for WCAG AA compliance [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/419958 (https://phabricator.wikimedia.org/T185533) [19:56:01] 10Analytics: Expose page previews in Rest pageview API - https://phabricator.wikimedia.org/T192490#4140572 (10Nuria) [20:29:23] 10Analytics, 10Analytics-Wikistats, 10Accessibility, 10Easy, 10Patch-For-Review: Wikistats Beta: Fix accessibility/markup issues of Wikistats 2.0 - https://phabricator.wikimedia.org/T185533#4140675 (10Sturmkrahe) Here are before and after pictures for change 426848 (https://gerrit.wikimedia.org/r/419958/... [20:47:46] (03CR) 10VolkerE: [C: 031] "Very valued! The advantage of `text-decoration` is, you get things like https://developer.mozilla.org/en-US/docs/Web/CSS/text-decoration-s" [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/419958 (https://phabricator.wikimedia.org/T185533) (owner: 10Sturmkrahe) [21:00:05] (03CR) 10Sturmkrahe: "> Very valued! The advantage of `text-decoration` is, you get things" [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/419958 (https://phabricator.wikimedia.org/T185533) (owner: 10Sturmkrahe) [21:30:08] (03CR) 10Framawiki: [C: 032] Add a space between href attribute and class attribute [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/343548 (owner: 10MZMcBride) [21:30:26] (03Merged) 10jenkins-bot: Add a space between href attribute and class attribute [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/343548 (owner: 10MZMcBride) [21:41:19] (03CR) 10Framawiki: "Although my knowledge of admin sys and python is much less than yours or yuvi, it would indeed be an honor to be one of Quarry's maintaine" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/427025 (owner: 10Framawiki) [21:42:42] 10Analytics-Tech-community-metrics: Using an author_name filter on Gerrit, I get a different author listed (original author_name is only mentioned in the commit message) - https://phabricator.wikimedia.org/T192366#4140954 (10Aklapper) 05Open>03Invalid PEBKAC. `:` vs `=`, again. Sigh. [21:58:27] 10Quarry: Add current git version somewhere in the interface - https://phabricator.wikimedia.org/T192506#4141022 (10Framawiki) [21:59:14] 10Analytics-Kanban, 10Analytics-Wikistats, 10Patch-For-Review: SEO Friendly HTML titles for Wikistats 2.0 - https://phabricator.wikimedia.org/T182718#4141032 (10Nuria) [22:22:19] (03CR) 10Zhuyifei1999: [C: 032] "Done :)" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/427025 (owner: 10Framawiki) [22:27:11] 10Quarry: Add current git version somewhere in the interface - https://phabricator.wikimedia.org/T192506#4141022 (10zhuyifei1999) Git version is complicated... The web interface (`quarry-main-01`) runs a copy of the code, and two more query runners (`quarry-runner-0[12]`) run two more copies of the code. The co... [22:42:18] 10Analytics, 10Pageviews-API: Pageview API: Better filtering of bot traffic on top enpoints - https://phabricator.wikimedia.org/T123442#1929942 (10EBernhardson) I was talking to someone about bot detection, and they mentioned that they have gotten good mileage in bot filtering by grading ip addresses by the ra... [22:58:09] (03PS4) 10Nuria: SEO oriented chnages for Wikistats2 Pages [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/427042 (https://phabricator.wikimedia.org/T182718) [22:58:38] (03PS5) 10Nuria: SEO oriented changes for Wikistats2 Pages [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/427042 (https://phabricator.wikimedia.org/T182718) [23:01:02] (03CR) 10Nuria: "@fdans I changed naming but also changed code significantly to be able to print prettier titles. Please check whether the way I am watchin" [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/427042 (https://phabricator.wikimedia.org/T182718) (owner: 10Nuria) [23:02:40] (03PS6) 10Nuria: SEO oriented changes for Wikistats2 Pages [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/427042 (https://phabricator.wikimedia.org/T182718) [23:04:20] milimetric: did changes for title "Wikimedia Statistics - Arabic Wikiquote - Page Views by Country" [23:04:33] milimetric: can change as needed/wanted [23:07:34] nuria_: great, will take a look tomorrow [23:08:03] nuria_: with geowiki I have to step through the code ‘cause it makes no sense what’s happening from a high level [23:08:15] milimetric: argh, old code? [23:08:36] milimetric: the old code that is right? [23:09:04] yeah, it’s easy to step through though, so I will get on that tomorrow, should’ve started that way actually [23:10:01] milimetric: ok, we can touch base tomorrow