[03:39:04] (03CR) 10Nuria: "Looks good, please list bug on commit message. See: https://www.mediawiki.org/wiki/Gerrit/Commit_message_guidelines" [analytics/dashiki] - 10https://gerrit.wikimedia.org/r/377290 (owner: 10Nettrom) [08:01:17] 10Analytics-Cluster, 10Analytics-Kanban, 10Operations, 10ops-eqiad, 10User-Elukey: Analytics hosts showed high temperature alarms - https://phabricator.wikimedia.org/T132256#3599508 (10elukey) >>! In T132256#3598540, @Cmjohnson wrote: > @elukey we finished these...correct? Nope still to do :) Updated l... [08:26:23] 10Analytics, 10Analytics-Cluster, 10Operations, 10ops-eqiad, and 2 others: rack/setup/install new kafka nodes kafka-jumbo100[1-6] - https://phabricator.wikimedia.org/T167992#3599528 (10elukey) [08:26:26] 10Analytics-Cluster, 10Analytics-Kanban, 10Operations, 10Patch-For-Review, 10User-Elukey: kafka-jumbo.cfg partman recipe creation/troubleshooting - https://phabricator.wikimedia.org/T174457#3599527 (10elukey) 05Open>03Resolved [09:03:13] 10Analytics, 10Analytics-Cluster, 10Operations, 10ops-eqiad, and 2 others: rack/setup/install new kafka nodes kafka-jumbo100[1-6] - https://phabricator.wikimedia.org/T167992#3599635 (10ops-monitoring-bot) Script wmf_auto_reimage was launched by volans on sarin.codfw.wmnet for hosts: ``` ['kafka-jumbo1002.e... [09:24:41] 10Analytics, 10Analytics-Cluster, 10Operations, 10ops-eqiad, and 2 others: rack/setup/install new kafka nodes kafka-jumbo100[1-6] - https://phabricator.wikimedia.org/T167992#3599688 (10ops-monitoring-bot) Completed auto-reimage of hosts: ``` ['kafka-jumbo1002.eqiad.wmnet', 'kafka-jumbo1003.eqiad.wmnet', 'k... [09:26:59] elukey: Hello, can I bug you a bit on opening that hole in our beloved network? [09:28:15] joal: o/ - in 10 mins? [09:28:20] sure elukey :) [09:28:26] ping me when ready [09:30:38] joal: what hole do you need? (I'll read in a bit) [09:30:58] elukey: for AQS to talk to Druid (port 8082) [09:32:50] joal: I think that we first need to get approvals from ops to let AQS to talk with Druid [09:33:19] I am not a fan of this solution as I stated before [09:33:36] but if the ops team agrees with this I'll stop complaining [09:33:59] :) [09:34:10] elukey: I can hear that, but what do you suggest as another solution? [09:34:59] the optimal one would be a cluster for public data and a cluster for sensitive data [09:35:14] but it might not be feasible/possible [09:35:27] and it might also be me too paranoid as always [09:35:37] sooo this is why I'd need to ask what ops thinks [09:36:17] joal: what do you think if we send an email to the ops mailing list explaining our goals and asking for green/red light? [09:42:34] elukey: I like the idea [09:42:50] elukey: I'm going to write something, then ask you to reread [09:44:41] +2 [09:53:13] 10Analytics, 10Analytics-Cluster, 10Operations, 10ops-eqiad, and 2 others: rack/setup/install new kafka nodes kafka-jumbo100[1-6] - https://phabricator.wikimedia.org/T167992#3352701 (10Volans) For the record they were reimaged correctly, the new reimage script hit a small bug in the post-reimage part, I've... [10:26:57] speaking of AQS elukey and joal, it should probably be updated at some point (hyperswitch, config, ...) :P [10:27:01] just saying :) [10:27:17] hm mobrovac - We should indeed do that [10:27:40] * elukey blames mobrovac [10:27:42] :D [10:28:20] there's already a club for that elukey ;) [10:28:35] mobrovac: I definitely want to be part of it! [10:29:09] 10Analytics-Cluster, 10Analytics-Kanban, 10Patch-For-Review: Replacement of stat1002 and stat1003 - https://phabricator.wikimedia.org/T152712#3599825 (10Erik_Zachte) [10:29:11] 10Analytics: Pagecounts-ez not generating - https://phabricator.wikimedia.org/T172032#3599822 (10Erik_Zachte) 05Open>03Resolved a:03Erik_Zachte Ah I forgot to close this task. Scripts are running again. [10:31:37] 10Analytics, 10Analytics-Cluster, 10Operations, 10ops-eqiad, and 2 others: rack/setup/install new kafka nodes kafka-jumbo100[1-6] - https://phabricator.wikimedia.org/T167992#3599827 (10elukey) Proposed new term for the analytics-in4 filter on cr1/cr2 eqiad: ``` term mysql { from { destination-... [10:43:55] kafka-jumbo is up and running [10:44:10] this time correctly not reachable from the analytics vlan until we explicitly whitelist it [10:54:17] * elukey lunch! [11:50:54] (03PS4) 10Joal: Add mediawiki history edits metrics endpoint [analytics/aqs] - 10https://gerrit.wikimedia.org/r/373961 (https://phabricator.wikimedia.org/T174174) [12:02:14] elukey: another change on email, thanks for reading :) [12:03:01] elukey: also, I'm sorry to have put you in the team prefering to use the internal cluster - I know uou prefer the other way around ;) [13:28:50] 10Analytics-Cluster, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Audit users and account expiry dates for stat boxes - https://phabricator.wikimedia.org/T170878#3600254 (10elukey) Remaining to check as far as I can see: @egalvezwmf, @cwdent, @dchen, @dduvall, @DFoy, @DStrine, @Etonkovidova, @JMi... [13:33:25] 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Improve purging for analytics-slave data on Eventlogging - https://phabricator.wikimedia.org/T156933#3600278 (10mforns) Imagine we have purged everything except the giant tables. Would we want to consider stopping EL and replication for like 1 day, to b... [13:38:50] 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Improve purging for analytics-slave data on Eventlogging - https://phabricator.wikimedia.org/T156933#3600292 (10elukey) >>! In T156933#3600278, @mforns wrote: > Imagine we have purged everything except the giant tables. > Would we want to consider stopp... [13:48:36] 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Improve purging for analytics-slave data on Eventlogging - https://phabricator.wikimedia.org/T156933#3600330 (10mforns) > Probably not, the huge UPDATE batches are affecting too much disk usage.. But maybe, if we stop replication from both EL master an... [14:08:03] mforns: I do think that 100k are too much to be sustainable for those databases, but we could try next week if the results are not really encouraging. The main problem would be that the hue tables would requires a couple of days of complete stop of everything else [14:08:40] maybe 10k/20k batches could be sustainable [14:08:43] elukey, we maybe could use a couple week-ends? :(((((( [14:09:13] but then we'd create a huge backlog of replication and people could complain not finding stuff on the slaves [14:09:29] elukey, yes... replication backlog... hmmmmm [14:10:37] one good thing is that we found a sustainable batch/sleep combination [14:10:43] that is currently working very well [14:11:48] 10Analytics-Cluster, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Audit users and account expiry dates for stat boxes - https://phabricator.wikimedia.org/T170878#3600400 (10cwdent) @elukey - at this point I do not need access, deactivate at will [14:13:17] elukey, awesome :] [14:25:26] 10Analytics, 10Analytics-Cluster, 10Operations, 10ops-eqiad, and 2 others: rack/setup/install new kafka nodes kafka-jumbo100[1-6] - https://phabricator.wikimedia.org/T167992#3363320 (10akosiaris) LGTM. Minor nitpick: I love comments about which hostname IPs match to . e.g. ``` term puppet { from {... [14:30:11] (03CR) 10Fdans: Add mediawiki history edits metrics endpoint (032 comments) [analytics/aqs] - 10https://gerrit.wikimedia.org/r/373961 (https://phabricator.wikimedia.org/T174174) (owner: 10Joal) [14:34:16] 10Analytics, 10Performance-Team: Explore NavigationTiming by faceted properties - EventLogging refine - https://phabricator.wikimedia.org/T166414#3600547 (10Gilles) [14:41:12] elukey: what did we decide about jmxtrans? [14:41:22] i should just try to rebuild deb as is for now? [14:42:19] ottomata: morning :) [14:42:31] I checked today and I think that the debian branch is built now [14:42:37] but it differs from master [14:42:47] so I wanted to wait to discuss with you what to do [14:43:02] atm I am adding the kafka-jumbo ips to the VLAN firewall [14:43:23] gr8 :) [14:43:54] elukey: either we build jmxtrans (however we have to do that) with the usual version we use, or we go prometheus [14:44:18] I'm having trouble logging into https://yarn.wikimedia.org/. Does anybody know if this is automagically tied to the other hadoop permissions, or do I have to request it separately? [14:45:01] Shilad: that one should be your ldap account creds [14:45:04] so not your shell username [14:46:04] ottomata: No luck will my ldap. Any other ideas? [14:46:21] hm [14:47:45] I just logged in/out of Phabricator with ldap to make sure I wasn't confused about ldap credentials. [14:49:23] 10Analytics, 10Analytics-Cluster, 10Operations, 10ops-eqiad, and 2 others: rack/setup/install new kafka nodes kafka-jumbo100[1-6] - https://phabricator.wikimedia.org/T167992#3600621 (10elukey) Added them with annotations! [14:50:00] Shilad: what is your ldap username? [14:50:26] ottomata: just checked and I can telnet on 9092 from an1003 to all the jumbos :) [14:50:40] we need to remember that atm only 9092 is open [14:51:03] ok cool, that should be all we need, right? [14:51:08] oh [14:51:11] no, if we enabled TLS [14:51:13] probably 9093 [14:51:24] elukey: if you are in there now, maybe just go ahead and do 9093 too? [14:51:43] it takes a minute to add it, let's do it when we select the port [14:51:48] ottomata: I have a space in my ldap name: "Shilad Sen". Could that be the problem? Perhaps Yarn isn't happy with that? Totally stretching for ideas here. [14:51:49] (already committed) [14:54:07] elukey: ok [14:54:18] Shilad: i think you are not in the correct ldap group [14:56:14] elukey: can you tell? this ticket is Shilad's access request [14:56:22] it looks like he should ahve been added to the nda ldap group [14:56:23] https://phabricator.wikimedia.org/T171988 [14:56:24] but istn' [14:56:44] can I just add him? or do we need another ticket? [15:02:38] ottomata: Thanks for tracking this down! [15:03:23] I think we can use that task, will check after standup :) [15:05:48] Hey folks! I think this is an unflagged bot. What do you think? [15:05:48] https://tools.wmflabs.org/pageviews/?project=en.wikipedia.org&platform=all-access&agent=all-agents&range=all-time&pages=Earth [15:05:56] Note the step on June 17th 2016 [15:05:59] ~ [15:06:19] Note this also shows when you select "user" [15:09:16] 10Analytics-Cluster, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Audit users and account expiry dates for stat boxes - https://phabricator.wikimedia.org/T170878#3600729 (10elukey) [15:13:35] Thanks halfak for noticing - Will have a look [15:18:59] 10Analytics-Cluster, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Audit users and account expiry dates for stat boxes - https://phabricator.wikimedia.org/T170878#3600768 (10Reedy) WMF staff, security team... Am I ok to keep access? :) [15:24:37] sorry lads - What did I miss at the end of standup? [15:25:22] halfak: The culprit seems to be PhantomJS [15:25:37] Creating a task to discuss if we should count this one as a bot [15:28:26] 10Analytics: Add "PhantomJS" to the list of bots in webrequest definition. - https://phabricator.wikimedia.org/T175707#3600811 (10JAllemandou) [15:28:29] halfak: --^ [15:28:41] awesome. Thank you. [15:28:51] no, thank you halfak :) [15:29:04] \o/ [15:29:04] I gotta run pick up the car from the shop, will probably miss the geekout :( [15:29:51] (03CR) 10Joal: Add mediawiki history edits metrics endpoint (031 comment) [analytics/aqs] - 10https://gerrit.wikimedia.org/r/373961 (https://phabricator.wikimedia.org/T174174) (owner: 10Joal) [15:38:51] (03PS5) 10Joal: Add mediawiki history edits metrics endpoint [analytics/aqs] - 10https://gerrit.wikimedia.org/r/373961 (https://phabricator.wikimedia.org/T174174) [15:40:37] I'm going to be late to the geekout too because of tech mgmt meeting [15:40:44] It cuts 30 mins off for me :( [15:41:08] Shilad: can you try to login now? [15:41:30] halfak: unformtunately I wass o leave early :( [15:41:35] I'll miss you [15:41:38] noooo [15:42:05] ottomata, are you going to be around for the geekout? i wanna talk schemas [15:42:06] :) [15:42:12] 10Analytics-Cluster, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Audit users and account expiry dates for stat boxes - https://phabricator.wikimedia.org/T170878#3600855 (10elukey) >>! In T170878#3600768, @Reedy wrote: > WMF staff, security team... Am I ok to keep access? :) I am not sure if I t... [15:42:29] halfak: ya can make it [15:42:49] 10Analytics, 10Operations, 10Ops-Access-Requests, 10Research, and 2 others: NDA, MOU and LDAP (analytics cluster) for Shilad Sen - https://phabricator.wikimedia.org/T171988#3482327 (10elukey) Added the user `shiladsen` to the `nda` LDAP group to allow yarn/pivot/etc.. access. [15:43:36] ottomata, great! I'll be 30 mins late. be advised :| [15:45:47] haah ok [15:55:06] 10Analytics, 10Analytics-Cluster, 10Operations, 10ops-eqiad, and 2 others: rack/setup/install new kafka nodes kafka-jumbo100[1-6] - https://phabricator.wikimedia.org/T167992#3600884 (10elukey) Cleaned up placeholders lvm partitions, now the next steps are: 1) decide a TLS port for the Kafka cluster and wh... [16:06:25] 10Analytics, 10Operations, 10Ops-Access-Requests, 10Research, and 2 others: NDA, MOU and LDAP (analytics cluster) for Shilad Sen - https://phabricator.wikimedia.org/T171988#3600914 (10Shilad) Indeed, I now have Yarn access! Thanks @elukey! [16:07:00] elukey: Sorry, in the middle of lecture when you sent the message. It works now. Thanks! [16:08:13] good! :) [16:28:49] * elukey off! [17:15:37] hola a-team [17:15:43] Hi nuria_ [17:20:00] 10Analytics-Kanban, 10Patch-For-Review: Use hive dynamic partitioning to split webrequest on tags - https://phabricator.wikimedia.org/T164020#3601170 (10Smalyshev) [17:20:17] 10Analytics-Kanban, 10Patch-For-Review: Use hive dynamic partitioning to split webrequest on tags - https://phabricator.wikimedia.org/T164020#3218541 (10Smalyshev) [17:20:44] 10Analytics-Kanban, 10Patch-For-Review: Use hive dynamic partitioning to split webrequest on tags - https://phabricator.wikimedia.org/T164020#3218541 (10Smalyshev) [17:24:55] 10Analytics, 10EventBus, 10ORES, 10Reading-Infrastructure-Team-Backlog, and 3 others: Emit revision-score event to EventBus and expose in EventStreams - https://phabricator.wikimedia.org/T167180#3601203 (10Halfak) Looks like we'll have that deployed on Sept. 25th [17:38:16] 10Analytics: Determine: What percentage of new articles are created by non-autoconfirmed editors - https://phabricator.wikimedia.org/T149021#3601300 (10Nuria) [17:39:20] 10Analytics: Determine: What percentage of new articles are created by non-autoconfirmed editors - https://phabricator.wikimedia.org/T149021#2769577 (10Nuria) I have added analytics but likely @kaldari has a better project? [17:48:21] (03CR) 10Mforns: [V: 031 C: 031] "LGTM! Awesome. I didn't test it in the cluster, so did not +2 it. But feel free to merge it on my side :]" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/374987 (https://phabricator.wikimedia.org/T174484) (owner: 10Joal) [18:26:52] 10Analytics, 10Performance-Team: Explore NavigationTiming by faceted properties - EventLogging refine - https://phabricator.wikimedia.org/T166414#3601485 (10Nuria) Ping @giless, we included this item as a goal for next quarter [18:27:50] 10Analytics, 10Performance-Team: Explore NavigationTiming by faceted properties - EventLogging refine - https://phabricator.wikimedia.org/T166414#3601486 (10Nuria) Ping @Gilles added some work on this regard for next quarter [18:39:35] 10Analytics-Cluster, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Audit users and account expiry dates for stat boxes - https://phabricator.wikimedia.org/T170878#3601557 (10Nuria) @elukey: Let me know if you think this is something that will be completed on Q1 or rather we need to continue on Q2 [18:43:44] 10Analytics, 10ChangeProp, 10EventBus, 10Epic, 10Services (doing): Support topic arrays in ChangeProp config - https://phabricator.wikimedia.org/T175727#3601581 (10Pchelolo) [18:46:29] (03CR) 10Nuria: [V: 031 C: 031] "When a raise SomeError is hit the stacktrace will go to STDERR as things are now so I think it is what we expect, correct?" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/355601 (https://phabricator.wikimedia.org/T162034) (owner: 10Mforns) [18:57:26] 10Analytics-Cluster, 10Analytics-Kanban: Port Clients to new jumbo cluster - https://phabricator.wikimedia.org/T175461#3601677 (10Ottomata) FYI, kafka-jumbo is now in deployment-prep: deployment-kafka-jumbo-[12]. [19:06:05] wikimedia/mediawiki-extensions-EventLogging#691 (wmf/1.30.0-wmf.18 - 807040b : Translation updater bot): The build has errored. [19:06:05] Change view : https://github.com/wikimedia/mediawiki-extensions-EventLogging/compare/wmf/1.30.0-wmf.18 [19:06:05] Build details : https://travis-ci.org/wikimedia/mediawiki-extensions-EventLogging/builds/274739920 [19:14:12] Joal: having a cluster with just public data for druid is feasible [19:14:23] cc elukey we have teh hardware for it [19:14:32] it is just higher maintenance burden [19:58:04] 10Analytics-Cluster, 10Analytics-Kanban: Backup HDFS NameNode fsimage metadata - https://phabricator.wikimedia.org/T175740#3601958 (10Ottomata) [19:58:12] 10Analytics-Cluster, 10Analytics-Kanban: Backup HDFS NameNode fsimage metadata - https://phabricator.wikimedia.org/T175740#3601972 (10Ottomata) [20:14:53] 10Analytics, 10Operations, 10Traffic: A/B Testing solid framework - https://phabricator.wikimedia.org/T135762#3602063 (10Jan_Dittrich) Is there some progress on this issue? The last experiments I was in contact with (and responsible for thinking up) were still hack-ish. I wonder if packaging one of the hac... [20:27:01] 10Analytics, 10Operations, 10Traffic: A/B Testing solid framework - https://phabricator.wikimedia.org/T135762#3602138 (10Nuria) We will not be doing more work towards this as statistically we did not find a more private conscoius way to do ab testing than the one event logging -based experiments offers. You... [20:40:05] 10Analytics-Kanban, 10User-Elukey: Archive PageContentSaveComplete in hdfs while we continue collecting data - https://phabricator.wikimedia.org/T170720#3602185 (10Nuria) Tables moved and docs updated: https://wikitech.wikimedia.org/wiki/Analytics/Systems/EventLogging#Hadoop._Archived_Data [20:40:37] 10Analytics-Kanban, 10Patch-For-Review: Monthly Mediawiki Sqoop job failed - https://phabricator.wikimedia.org/T172426#3602190 (10Nuria) 05Open>03Resolved [20:40:55] 10Analytics-Kanban, 10Patch-For-Review: Troubleshoot Wikimetrics "magic button" - https://phabricator.wikimedia.org/T173585#3602191 (10Nuria) 05Open>03Resolved [20:41:44] 10Analytics-Kanban, 10User-Elukey: Calculate how much Popups events EL databases can host - https://phabricator.wikimedia.org/T172322#3602206 (10Nuria) 05Open>03Resolved [20:42:43] 10Analytics-Kanban, 10Research, 10Patch-For-Review: Add QuickSurvey schemas to EventLogging white-list - https://phabricator.wikimedia.org/T172112#3602225 (10Nuria) 05Open>03Resolved [20:44:25] 10Analytics-Kanban, 10Patch-For-Review: Add normalized_host.project_family and deprecate and remove normalized_host.project_class - https://phabricator.wikimedia.org/T168874#3602243 (10Nuria) 05Open>03Resolved [20:45:10] 10Analytics-Kanban, 10Analytics-Wikistats: Use daily granularity for 1-month time ranges - https://phabricator.wikimedia.org/T173372#3602245 (10Nuria) [20:46:01] 10Analytics-Kanban, 10Patch-For-Review: Fix reportupdater graphite tests - https://phabricator.wikimedia.org/T173345#3602249 (10Nuria) 05Open>03Resolved [20:46:27] 10Analytics-Kanban: Wikimetrics is trying to use more than 10 connections at the same time - https://phabricator.wikimedia.org/T173062#3602252 (10Nuria) 05Open>03Resolved [20:46:44] 10Analytics-Cluster, 10Analytics-Kanban, 10Patch-For-Review: Update puppet for new Kafka cluster and version - https://phabricator.wikimedia.org/T166162#3602253 (10Nuria) 05Open>03Resolved [20:46:46] 10Analytics-Cluster, 10Analytics-Kanban: Provision new Kafka cluster(s) with security features - https://phabricator.wikimedia.org/T152015#3602254 (10Nuria) [20:47:10] 10Analytics-Kanban: Add time_to_user_next_edit and time_to_page_next_edit in Mediawiki Denormalized History - https://phabricator.wikimedia.org/T161896#3602258 (10Nuria) 05Open>03Resolved [20:47:30] 10Analytics-Kanban, 10Analytics-Wikistats: Add piwik to wikistats 2.0 site - https://phabricator.wikimedia.org/T171642#3602260 (10Nuria) 05Open>03Resolved [20:48:07] 10Analytics-Kanban, 10EventBus, 10Scap, 10Patch-For-Review, 10User-Elukey: eventlogging-service-eventbus scap deployments should depool/pool during deployment - https://phabricator.wikimedia.org/T171506#3602262 (10Nuria) 05Open>03Resolved [21:16:55] 10Analytics-Kanban, 10Patch-For-Review: Oliver Keyes analytics cluster access to check on some old data - https://phabricator.wikimedia.org/T171696#3602338 (10Nuria) 05Open>03Resolved [21:17:13] 10Analytics-Kanban, 10Operations, 10Patch-For-Review, 10User-Elukey: Analytics Kafka cluster causing timeouts to Varnishkafka since July 28th - https://phabricator.wikimedia.org/T172681#3602339 (10Nuria) 05Open>03Resolved [21:17:39] 10Analytics-Cluster, 10Analytics-Kanban, 10Operations, 10Patch-For-Review: rack/setup/install druid100[456].eqiad.wmnet - https://phabricator.wikimedia.org/T171626#3602340 (10Nuria) 05Open>03Resolved [21:17:59] 10Analytics-Kanban, 10Discovery, 10Discovery-Analysis, 10Patch-For-Review: Add purge info for Kartographer schema - https://phabricator.wikimedia.org/T171622#3602342 (10Nuria) 05Open>03Resolved [21:18:24] 10Analytics-Data-Quality, 10Analytics-Kanban, 10Readers-Web-Backlog (Tracking): Pageview drop in ro.wikipedia hu.wikipedia and fr.wikipedia - https://phabricator.wikimedia.org/T170845#3602343 (10Nuria) 05Open>03Resolved [21:19:13] 10Analytics-Cluster, 10Analytics-Kanban, 10Patch-For-Review: Cannot request more than 4 cores per spark executor - https://phabricator.wikimedia.org/T172018#3602351 (10Nuria) 05Open>03Resolved [21:24:36] (03CR) 10Nuria: [V: 031 C: 031] Add oozie mediawiki-history-reduced job (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/376235 (https://phabricator.wikimedia.org/T174915) (owner: 10Joal) [21:41:33] HaeB: FYI that i moved teh archived eventlogging tables to 'archive' database [21:42:26] *the [21:42:41] HaeB: so they do not show up on eventlogging db anymore [21:44:45] nuria_: coo, thanks for the heads-up. (you mean not showing up in the wmf database?) [21:44:59] HaeB: ah sorry, wmf db [21:45:09] yup [21:45:39] and thanks for creating the intermediate popups copy too - will follow up on the task [22:09:11] 10Analytics, 10Analytics-EventLogging, 10Contributors-Analysis, 10EventBus, and 3 others: Visualize page create events for all wikis - https://phabricator.wikimedia.org/T170850#3602435 (10Nuria) Here is your dashboard: https://page-creation.wmflabs.org/#projects=nlwiki,eswiki,plwiki,itwiki,enwiki,viwiki,ja... [22:09:48] (03PS2) 10Nuria: Add page creation dashboard configuration [analytics/dashiki] - 10https://gerrit.wikimedia.org/r/377290 (https://phabricator.wikimedia.org/T170850) (owner: 10Nettrom) [22:10:20] (03CR) 10Nuria: [V: 032 C: 032] "Merging after changing commit message" [analytics/dashiki] - 10https://gerrit.wikimedia.org/r/377290 (https://phabricator.wikimedia.org/T170850) (owner: 10Nettrom) [22:54:40] 10Analytics, 10Analytics-EventLogging, 10Contributors-Analysis, 10EventBus, and 3 others: Visualize page create events for all wikis - https://phabricator.wikimedia.org/T170850#3602563 (10Nettrom) @Nuria : Thanks for taking care of this! Sorry I didn't get around to updating the commit message as you reque... [23:13:36] 10Analytics-Kanban: Stop collecting Data for PageCreation schema, archive table on hdfs - https://phabricator.wikimedia.org/T171629#3602607 (10Nuria) [23:14:56] 10Analytics-Kanban: Stop collecting Data for PageCreation schema, archive table on hdfs - https://phabricator.wikimedia.org/T171629#3471480 (10Nuria) [23:15:12] 10Analytics-Kanban: Stop collecting Data for PageCreation schema, archive table on hdfs - https://phabricator.wikimedia.org/T171629#3471480 (10Nuria) a:03Nuria [23:26:55] 10Analytics, 10Analytics-EventLogging, 10Contributors-Analysis, 10EventBus, and 3 others: Visualize page create events for all wikis - https://phabricator.wikimedia.org/T170850#3602665 (10Nettrom) @kaldari : The three last metrics are only defined for English Wikipedia, partly because I saw them as ACTRIAL... [23:29:51] 10Analytics-Kanban, 10Patch-For-Review: Stop collecting Data for PageCreation schema, archive table on hdfs - https://phabricator.wikimedia.org/T171629#3602668 (10Nuria) We can probably do the same for these three schemas: https://meta.wikimedia.org/wiki/Schema:PageDeletion https://meta.wikimedia.org/wiki/Sc... [23:51:11] 10Analytics, 10Analytics-EventLogging, 10Contributors-Analysis, 10EventBus, and 3 others: Visualize page create events for all wikis - https://phabricator.wikimedia.org/T170850#3602748 (10kaldari) Ah, right you are! [23:51:30] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Community-Tech, and 6 others: Record an event every time a new content namespace page is created - https://phabricator.wikimedia.org/T150369#3602751 (10kaldari) [23:51:33] 10Analytics, 10Analytics-EventLogging, 10Contributors-Analysis, 10EventBus, and 3 others: Visualize page create events for all wikis - https://phabricator.wikimedia.org/T170850#3602749 (10kaldari) 05Open>03Resolved a:03kaldari