[01:29:06] 10Analytics: chooseCRANmirror() and install.packages problems in R on production - https://phabricator.wikimedia.org/T171790#3476888 (10mpopov) ```lang=R Sys.setenv( http_proxy = "http://webproxy.eqiad.wmnet:8080", https_proxy = "http://webproxy.eqiad.wmnet:8080" ) install.packages("dplyr", repos = c(CRAN =... [08:54:23] 10Analytics, 10Patch-For-Review, 10User-Elukey: Puppetize clickhouse - https://phabricator.wikimedia.org/T150343#3477287 (10elukey) 05Open>03declined Moving this to declined for the moment since there is no clear idea if clickhouse will be used or not in the future of the Analytics team. Will re-open if... [09:11:06] 10Analytics, 10Operations, 10ops-eqiad, 10User-Elukey: SATA errors for stat1004 in the dmesg - https://phabricator.wikimedia.org/T162770#3477300 (10elukey) 05Open>03Resolved The issue seemed transient, didn't see any trace of it anymore in dmesg. Will re-open if necessary :) [09:28:13] 10Analytics: chooseCRANmirror() and install.packages problems in R on production - https://phabricator.wikimedia.org/T171790#3477347 (10GoranSMilovanovic) Proxy, of course. Thank you Mikhail! [09:28:35] 10Analytics: chooseCRANmirror() and install.packages problems in R on production - https://phabricator.wikimedia.org/T171790#3477348 (10GoranSMilovanovic) 05Open>03Resolved [10:48:03] * elukey lunch! [12:55:22] 10Analytics, 10Analytics-Cluster, 10Operations, 10Research-management: GPU upgrade for stats machine - https://phabricator.wikimedia.org/T148843#3477870 (10Ottomata) Oook, I'm going to have to find some time to do a driver dance before we can test this. Nithum is totally willing to run some tensorflow stu... [12:55:32] 10Analytics, 10Analytics-Cluster, 10Operations, 10Research-management: GPU upgrade for stats machine - https://phabricator.wikimedia.org/T148843#3477871 (10Ottomata) p:05Normal>03Low [12:56:11] 10Analytics, 10Analytics-Cluster, 10Operations, 10Research-management: GPU upgrade for stats machine - https://phabricator.wikimedia.org/T148843#2734568 (10Ottomata) FYI, some links from Nithum: - https://www.codeplay.com/portal/03-30-17-setting-up-tensorflow-with-opencl-using-sycl - http://www.amd.com/en... [12:58:58] 10Analytics-Kanban, 10Analytics-Wikistats: Productionise line graph - https://phabricator.wikimedia.org/T171766#3477880 (10fdans) [12:59:43] oh nice, adding Ref does attach the revision to the task [13:02:44] elukey: do you want to preserve backups/bohrium/mysqldump_20170706.sql from stat1002? [13:06:05] ottomata: we can nuke it [13:07:05] ottomata: TIL that kafka will use the ANONYMOUS user for all the clients connected via PLAINTEXT and it will try to match it with ACLs [13:07:15] aye ok [13:07:18] cool [13:07:31] I wasn't been able to produce to plaintext though :P [13:07:34] still wip [13:07:38] hmm, weird [13:07:38] ok [13:08:23] auth works but the producer emits weird errors.. I updated confluent-kafka2.11 today, reset the cluster and re-done everything, not sure if I am missing some config [13:19:12] elukey: updated to 0.11? [13:23:26] 10Analytics, 10Analytics-Kanban: Wikistats2 bugs (1/4) - Dashboard and general UI - https://phabricator.wikimedia.org/T170933#3477921 (10fdans) [13:23:28] 10Analytics-Kanban, 10Analytics-Wikistats: Addition of Unique Devices metric - https://phabricator.wikimedia.org/T170461#3477922 (10fdans) [13:26:39] ottomata: I wanted to ask you this question, since confluent-platform (not kafka sorry) seems to be 2.11 but dpkg's version is 10.X (I updated via apt only a minor) [13:27:15] sorry even kafka [13:27:16] confluent-kafka-2.11 0.10.2.1-2 [13:27:32] so I guess I am using kafka 0.10.2 [13:29:58] ya, we stick their debs in our apt. but i think we don't have 0.10 in our apt, i think I just dpkg -i them in labs [13:30:22] since i didn't want to maybe accidetnaly affect prod with the new version yet [13:30:32] orrrr [13:30:37] maybe i add their apt repo as a source [13:30:39] in labs [13:30:42] not sure [13:31:57] i think i made it possible a while ago to specify both scala version (2.11) and kakfa version (0.10.2) via confluent puppet module [13:32:05] oh! is that your q? [13:32:11] ya the version in the package name is the scala version [13:32:54] ahhh okok :) [13:32:58] you added the apt repo [13:32:59] :) [13:34:10] https://github.com/wikimedia/puppet/blob/production/modules/confluent/manifests/kafka/client.pp#L12-L25 [13:36:56] gotcha thanks [13:44:04] now I have created a new topic and it works [13:44:06] grrrrr [13:46:15] ok it works with plaintext and SSL [13:46:17] \o/ [13:46:28] hellooooo [13:46:32] [2017-07-27 13:46:00,573] DEBUG Principal = User:ANONYMOUS is Allowed Operation = Write from host = 10.68.22.62 on resource = Topic:elukey2 (kafka.authorizer.logger) [13:46:47] mforns: o/ [13:46:55] :] [13:47:59] yeehawww! [13:48:03] nice [13:48:46] the only weird thing is [13:48:48] Current ACLs for resource `Topic:elukey2`: User:CN=client* has Allow permission for operations: Write from hosts: * [13:49:04] but on the logs [13:49:05] [2017-07-27 13:48:04,015] DEBUG Principal = User:CN=client1,OU=Services,O=WMF,C=US is Denied Operation = Describe from host = 10.68.22.62 on resource = Topic:elukey2 (kafka.authorizer.logger) [13:49:30] sorry the correct ACL to list was [13:49:30] User:CN=client* has Allow permission for operations: Describe from hosts: * [13:49:48] so the wildcard in the username seems not working [13:52:03] unless, the * means "repeat n times the last char" [13:52:30] "The support for wildcards is limited to `*` at this point. Sorry for the [13:52:33] confusion. If you're interested to submit a PR to clarify the [13:52:36] documentation, that would be great. :)" [13:54:00] mmmmmm [13:54:56] or maybe * == all [13:55:00] like User:* [13:55:45] ah yes User:* works [13:55:53] so it is "all" [13:56:02] * elukey cries in a corner [13:57:12] haha [13:57:18] :( [14:15:18] ok I think that we got what we need, going to write up a summary in the task [14:19:16] fdans, yt? [14:24:31] elukey, ottomata: did you see the warning for analytics1034? "eth0 has different negotiated speed than requested" [14:24:35] usually a broken cable [14:29:18] mforns: hellooo [14:29:28] fdans, o/ :] [14:29:46] just checking if you were there and wanted to look at CI [14:30:10] moritzm: nope, thanks for the heads up! Will check asap [14:30:25] mforns: having a super late lunch atm, mind if we do it after standup? [14:30:33] fdans, sure, np [14:30:36] i might have already fixed it, but don't know yet :) [14:30:47] mforns: thanks :D [14:31:01] ok, cool :] [14:50:11] 10Analytics-Cluster, 10Analytics-Kanban, 10User-Elukey: Understand Kafka ACLs and figure out what ACLs we want for production topics - https://phabricator.wikimedia.org/T167304#3478277 (10elukey) After a lot of tests here's the list of the most important things that I found: * The `authorizer.class.name=kaf... [14:58:31] 10Analytics-Kanban, 10Patch-For-Review: Add tagging to webrequest refine process - https://phabricator.wikimedia.org/T171760#3478321 (10Nuria) a:03Nuria [14:59:03] 10Analytics-Kanban: Oliver Keyes analytics cluster access to check on some old data - https://phabricator.wikimedia.org/T171696#3478325 (10Nuria) [15:00:48] ping ottomata [15:05:38] 10Analytics-Cluster, 10Analytics-Kanban, 10Operations, 10Patch-For-Review: Firewalls appear to be preventing spark executors from talking to spark driver on stat1005 - https://phabricator.wikimedia.org/T170496#3478332 (10Nuria) 05Open>03Resolved [15:05:40] 10Analytics-Cluster, 10Analytics-Kanban, 10Operations, 10Patch-For-Review: Firewalls appear to be preventing spark executors from talking to spark driver on stat1005 - https://phabricator.wikimedia.org/T170496#3478334 (10Ottomata) a:03Ottomata [15:05:47] 10Analytics-Cluster, 10Analytics-Kanban, 10Operations, 10Patch-For-Review: Firewalls appear to be preventing spark executors from talking to spark driver on stat1005 - https://phabricator.wikimedia.org/T170496#3433298 (10Ottomata) [15:12:48] 10Analytics-Cluster, 10Analytics-Kanban, 10User-Elukey: Understand Kafka ACLs and figure out what ACLs we want for production topics - https://phabricator.wikimedia.org/T167304#3478363 (10Ottomata) Nice! We'll move all this stuff to a wiki page one day. Thanks luca! > full zookeeper path needs to be spec... [15:25:25] 10Analytics-Kanban, 10Patch-For-Review: Add normalized_host.project_family and deprecate and remove normalized_host.project_class - https://phabricator.wikimedia.org/T168874#3379221 (10Ottomata) Hm, I don't think you need to drop the table for this. ``` ALTER TABLE webrequest CHANGE COLUMN `normalized_host`... [15:34:20] 10Analytics, 10Analytics-Wikistats: Add piwik to wikistats 2.0 site - https://phabricator.wikimedia.org/T171642#3478475 (10fdans) [15:34:54] 10Analytics, 10Analytics-Kanban, 10Analytics-Wikistats: Add piwik to wikistats 2.0 site - https://phabricator.wikimedia.org/T171642#3471959 (10fdans) [15:35:08] 10Analytics-Kanban, 10Analytics-Wikistats: Add piwik to wikistats 2.0 site - https://phabricator.wikimedia.org/T171642#3471959 (10fdans) [15:37:58] 10Analytics: Stop collecting Data for PageCreation schema, archive table on hdfs - https://phabricator.wikimedia.org/T171629#3471480 (10fdans) p:05Triage>03Normal [15:38:52] 10Analytics-Cluster, 10Analytics-Kanban, 10Operations, 10ops-eqiad: rack/setup/install druid100[456].eqiad.wmnet - https://phabricator.wikimedia.org/T171626#3478489 (10fdans) [15:39:49] 10Analytics-Kanban, 10Discovery, 10Discovery-Analysis: Add purge info for Kartographer schema - https://phabricator.wikimedia.org/T171622#3478491 (10fdans) a:03mforns [15:41:46] 10Analytics-Kanban, 10Analytics-Wikistats: Fix Wikistats build in Jenkins - https://phabricator.wikimedia.org/T171599#3478497 (10fdans) a:03fdans [15:45:34] 10Analytics, 10EventBus, 10Scap: eventlogging-service-eventbus scap deployments should depool/pool during deployment - https://phabricator.wikimedia.org/T171506#3478506 (10fdans) p:05Triage>03Normal [15:46:55] 10Analytics-Kanban, 10Analytics-Wikistats: Wikistats2 bugs (1/4) - Dashboard and general UI - https://phabricator.wikimedia.org/T170933#3478514 (10fdans) [15:49:11] 10Analytics, 10Wikimedia-Mailing-lists: Delete eventlogging alerts e-mail list - https://phabricator.wikimedia.org/T170864#3445422 (10fdans) Hey @RobH thanks for that. Has this already been done? [15:50:08] 10Analytics, 10Analytics-EventLogging, 10Contributors-Analysis, 10EventBus, and 2 others: Visualize page create events for all wikis - https://phabricator.wikimedia.org/T170850#3478533 (10fdans) [15:53:45] 10Analytics, 10RESTBase, 10Services (later), 10User-mobrovac: Expose pageview data in each project's REST API - https://phabricator.wikimedia.org/T119094#3478565 (10fdans) a:05Milimetric>03Nuria [15:54:41] 10Analytics-Kanban, 10RESTBase, 10Services (later), 10User-mobrovac: Expose pageview data in each project's REST API - https://phabricator.wikimedia.org/T119094#1817629 (10fdans) [15:54:56] 10Analytics, 10Wikimedia-Mailing-lists: Delete eventlogging alerts e-mail list - https://phabricator.wikimedia.org/T170864#3478570 (10RobH) 05Open>03Resolved I never circled back to this, but I just completed this. ``` robh@fermium:~$ sudo -i rmlist -a eventlogging-alerts Removing list info Removing priv... [15:59:11] 10Analytics, 10RESTBase, 10Services (blocked): REST API entry point web request statistics at the Varnish level - https://phabricator.wikimedia.org/T122245#1899324 (10fdans) @Pchelolo helloo! Is this still blocked? [16:08:36] 10Analytics, 10Analytics-EventLogging, 10WMF-Legal, 10Privacy: Allow opting out from logging some of the default EventLogging fields on a schema-by-schema basis - https://phabricator.wikimedia.org/T108757#1529694 (10fdans) User agent isn't raw anymore and the IP has been dropped so this doesn't pertain any... [16:08:55] 10Analytics, 10Analytics-EventLogging, 10WMF-Legal, 10Privacy: Allow opting out from logging some of the default EventLogging fields on a schema-by-schema basis - https://phabricator.wikimedia.org/T108757#3478644 (10fdans) 05Open>03declined [16:11:11] 10Analytics: Evaluate whether to rewrite varnishkafka in python - https://phabricator.wikimedia.org/T131938#3478664 (10fdans) 05Open>03declined [16:11:33] ottomata: ah! I got fooled by my instance of kafka that has ZOOKEEPER_URL, you are right [16:11:38] fixing the code review [16:11:47] haha, yeah, i forgot i renamed it recently [16:17:29] mforns: how late you around today? [16:17:53] milimetric, I'll be here for 5 more hours [16:18:15] oh ok, then I'll have lunch now and check back with you after, we can talk backend [16:21:12] milimetric, cool :] [16:22:52] ottomata: qq - are you feel strongly about keeping all the conditionals for KAFKA_ZOOKEEPER_URL in one line/block? I like them more separated buuuut I will not oppose if you don't like it ) [16:22:56] :) [16:23:05] naww its fine :) [16:23:09] I +1ed [16:23:13] <3 [16:23:15] :) [16:23:23] mforns: so i looked into the java regex named group matching [16:23:24] it works! [16:23:24] but [16:23:32] there is no way to get the named groups after the fact [16:23:35] you have to know them ahead of time [16:23:38] there are ways [16:23:41] but they look like this [16:23:45] ottomata, aha [16:23:46] https://github.com/tony19/named-regexp/blob/master/src/main/java/com/google/code/regexp/Pattern.java#L54 [16:23:55] a regex to extact the names from the regex [16:24:24] ottomata, I see [16:24:47] i think maybe keeping the two cli opts and using scala opts is less bad? [16:25:05] ottomata, I agree [16:25:27] k [16:25:39] 10Analytics-Kanban: Oliver Keyes analytics cluster access to check on some old data - https://phabricator.wikimedia.org/T171696#3478727 (10Nuria) Per @DarTar notes we want to make this a bounded collaboration for @Ironholds to help us with some data requests, we need a "a 0-dollar contract driven by Legal" so we... [16:42:47] goood kafka acls command fixed [16:47:37] nice [16:49:21] ottomata: tomorrow I am going to start working on the puppet code + raid10 [16:49:32] going to send the email now [16:50:45] awesooome [16:50:48] thanks elukey yeah [16:50:51] put a note on that ticket though [16:50:56] that keeps them from racking with the wrong names [16:51:02] they've already started [16:51:08] tell them to pause [16:53:52] ottomata: I -1ed the code review from chris [16:54:27] but we should decide what to do in the meantime, namely in place replacement or not :) [16:54:43] haha, yeah that will require some arguing with robh :) [16:55:08] I think that Rob will say "WHATEVER MAN" [16:55:14] ? [16:55:34] translation == [16:55:39] i think my 'whatever man' would be totally in lowercase [16:55:46] uppercase whatever man seems really passive aggressive ;] [16:55:49] "I don't really care about those names Andrew" [16:55:58] hahahaha sorry it wasn't mean to be that :D [16:56:17] just document your hostnames on https://wikitech.wikimedia.org/w/index.php?title=Infrastructure_naming_conventions [16:56:37] and the main thing I dislike is folks dont get it updated properly (ie: mgmt dns, physical label, racktables, production dns) [16:56:37] :) [16:56:54] oh, and switch port description update [16:56:55] yep I -1ed for the moment the DNS code review [16:57:00] (see, its enough i forgot one!) [16:57:15] basically make a task and track the name change is all [16:57:29] but my point was that from my point of view you don't care about naming changes if they makes sense and if they are documented [16:57:31] im happy to review and ensure all the steps were taken. i ran out of fucks to give about actual names used about half a decade ago ;] [16:57:37] elukey: indeed! [16:57:50] ottomata likely recalls when i still actually had a viewpoint on naming [16:57:51] heh [16:57:56] the uppercase was not meant to upset anybody FTR :) [16:58:06] oh, my comment was a joke i wasnt upset [16:58:18] ive been smiling this whole time no worries ;] [16:58:25] gooood! I can't see you from IRC so better be clear :D [16:59:03] all right so I'll comment on the task asap [16:59:08] I will point out that much of ops and the rest of the engineering seem confused on analytics/stat box naming (its pretty evident when access requests come in) [16:59:59] they are a bit, and we are slowly improving the current situation..a lot of use cases to support :( [17:00:01] but i just handle enough access requests that im aware of https://wikitech.wikimedia.org/wiki/Analytics/Data_access#Access_Groups [17:00:13] which pretty much tells folks what is needed (they just need to know about it) [17:00:34] elukey: yep, ive had many a discussion with otto about it in the past, since everytime i get a new server we have to figure out a hostname =] [17:00:55] but the wikitech page i linked tends to stop most folks bitching about it not being clear, since that page makes it quite clear who needs what [17:01:05] \o/ [17:01:42] robh what you are not going to like is the ordering [17:01:51] we are considering keeping the same node numbers from the current boxes [17:01:52] :D [17:01:53] so [17:01:56] kafka-jumbo1012 [17:02:00] instead of 1001 [17:03:00] i think we need to test some things first [17:03:40] ottomata: so that part doesnt make sense [17:03:50] why wouldnt you lower the sequence numbers? [17:04:18] atm kafka1012 has a meaning for us, namely kafka broker with id 12 [17:04:39] we are exploring the possibility of in place replcement of kafka brokers one at the time [17:04:46] Well, I've argued against this for the analytics to kafka sequencing, its caused confusion [17:04:58] and for what its worth, i think its a horrible way to rename things and I'd -1 it [17:05:00] robh: [17:05:05] https://wikitech.wikimedia.org/wiki/Kafka/Administration#Replica_Elections [17:05:08] it could cause more confusing [17:05:20] for reasons that might make this upgrade WAY smooter, we are considering keep [17:05:23] for us and clients [17:05:37] Please document the reasoning for breaking naming conventions on the renaming task [17:05:38] we are considering keeping the broker.ids (which are static in zookeeper) [17:05:50] because your last reasoning sounds very similar to this [17:05:55] it was the same :) [17:05:56] yeah [17:05:57] and i didnt agree then [17:06:11] if you had to look at the output linked above often [17:06:21] and mentally map from that ID to a differently numbered hostname [17:06:23] you might agree :) [17:06:28] you shouldnt have to base your sequencing on the data of config files [17:06:30] no one else does that [17:06:32] its not a config file [17:06:42] its more like a database id [17:06:46] rephase, no one else bases the hostname sequence number off database ids [17:07:00] the broker.id is like the logical broker name [17:07:06] so you doing so causes confusion and breaks convention iwth the rest of our naming schema [17:07:25] aye well, luckely we are not 100% that we want to do this yet :) [17:07:27] gotta test some stuff [17:07:33] so let's argue more later when the time comes [17:07:36] I mean, I'm not in charge, so I cannot stop you [17:07:38] =] [17:07:49] and arguing in irc is pointless as well [17:08:03] but yeah, before we actually do the rename, please, please list off this reasoning in a task [17:08:10] and then lets review it in an ops meeting or soemthing [17:08:10] +1 will do [17:08:16] sounds good [17:08:21] because the last time i wasn't in the loop until afterwards and its caused some issues =] [17:08:25] (again though im not mad!) [17:08:30] well it is not pointless, it is good to know your pov [17:08:45] yeah but otto and i had this exact same conversation is what i mean [17:08:46] hehe [17:09:04] (i dont always have to agree with someone i work with though, so its quite alright) [17:09:10] "i ran out of fucks to give about actual names used about half a decade ago ;]" [17:09:14] i think robh still has a few! :D [17:09:16] those arent names! [17:09:19] those are sequencing numbers [17:09:20] haha [17:09:22] looool [17:09:24] which come into play on procurement [17:09:34] i'll take my stand on the semantics mountain now. [17:09:36] its kinda cold up here. [17:09:48] ;D [17:09:49] so you'd prefer kafka-jumbo1001->1006 right? [17:10:03] if they are all newer machines in the same purchase lot, yep! [17:10:13] ottomata: I think we can live with that [17:10:15] but if we have a documented reason of why they wont be that way [17:10:18] it is not a bit deal [17:10:19] i'd prefer that too, unless we decide to keep broker.ids (for migration purposes), in that case we will bikeshed and see [17:10:44] also that documentation for why they are that way should likely be included on the infrastrucutre naming page [17:11:06] elukey: we could it more like adding new brokers, assign new ids, manually migrate partitions one by one [17:11:15] that would still keep it as the same cluster, and preserve offsets [17:11:19] but would be a lot more manual work [17:11:23] yeah [17:11:25] so, transparent to clients, more manual work for us [17:11:31] would make robh happy though [17:11:44] it would be fine to use 1001->1006 and keep the ids [17:12:13] So to be clear, if you guys really dont want to do that, and you have reasoning not to, just make sure Faidon or Mark agrees and you'll not hear me block it any longer ;] [17:12:24] but when adding new hosts to the cluster later, its easier if the sequencing is in line [17:13:07] ok robh, we'll discuss it and then update the taks [17:13:09] *task [17:13:15] sorry to add to your workload =P [17:13:27] we shall share a 6 pack of naming bikeshed beer in the future. [17:23:34] +2! [17:30:40] (03PS6) 10EBernhardson: [cirrus] Distinguish morelike vs fulltext api search requests [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/345863 (owner: 10DCausse) [17:37:45] 10Analytics-Kanban: Oliver Keyes analytics cluster access to check on some old data - https://phabricator.wikimedia.org/T171696#3478987 (10DarTar) I just confirmed verbally with @ZhouZ that Legal will reach out to @Ironholds and set expectations about server access and the duration of this work. We'll track this... [17:44:47] 10Analytics, 10Analytics-Cluster, 10Operations, 10ops-eqiad, 10Patch-For-Review: rack/setup/install new kafka nodes kafka-jumbo100[1-6] - https://phabricator.wikimedia.org/T167992#3479047 (10elukey) I'd ask if possible to pause naming and configurations for these hosts since me and @Ottomata are thinking... [17:46:18] all right ottomata updated every task that I knew of, going offline if you are ok! [17:46:25] also sent the email to ops [17:47:35] 10Analytics-Kanban: Oliver Keyes analytics cluster access to check on some old data - https://phabricator.wikimedia.org/T171696#3479050 (10Nuria) Ok, let's plan on giving @Ironholds access for just one month. [17:47:58] (I guess yes so I am going afk, check laterzzz :) [17:49:44] (03CR) 10EBernhardson: [C: 032] [cirrus] Distinguish morelike vs fulltext api search requests [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/345863 (owner: 10DCausse) [17:53:12] (03Merged) 10jenkins-bot: [cirrus] Distinguish morelike vs fulltext api search requests [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/345863 (owner: 10DCausse) [17:58:12] great elukey thanks! laterz! [18:04:47] mforns: ok, back [18:04:58] hey milimetric [18:05:04] cave? [18:05:30] omw! [18:13:17] neilpquinn: hello [18:13:41] neilpquinn: do you think you will have some time to vet edit count on data lake within this week or next? [18:23:36] nuria_: hey, sorry about the delay! I was sick for a couple of days earlier this week and now I'm trying to catch up. I'm trying to get it done today or tomorrow. [18:24:09] neilpquinn: no problem, just wanted to have gauge of when could thishappen, next week is good too [18:31:09] 10Analytics, 10ChangeProp, 10EventBus, 10MW-1.30-release-notes (WMF-deploy-2017-08-01_(1.30.0-wmf.12)), and 3 others: Support posting Jobs to EventBus simultaneously with normal job processing - https://phabricator.wikimedia.org/T163380#3479201 (10Pchelolo) Ok, the code is life on all wikis, now it's time... [18:47:20] 10Analytics, 10Analytics-EventLogging, 10Community-Tech, 10DBA: Drop CookieBlock* tables from EventLogging DB - https://phabricator.wikimedia.org/T171883#3479233 (10MaxSem) [18:51:12] 10Analytics, 10Analytics-EventLogging, 10Community-Tech, 10DBA: Drop CookieBlock* tables from EventLogging DB - https://phabricator.wikimedia.org/T171883#3479248 (10MaxSem) [18:54:21] 10Analytics, 10Analytics-Cluster, 10Operations, 10ops-eqiad, 10Patch-For-Review: rack/setup/install new kafka nodes kafka-jumbo100[1-6] - https://phabricator.wikimedia.org/T167992#3479258 (10RobH) So we had a discussion about this earlier in IRC, and after that agreed to document some of it here. @eluke... [19:00:09] 10Analytics, 10Analytics-Dashiki: Convert Extension:Dashiki to use extension registration - https://phabricator.wikimedia.org/T171884#3479265 (10MarcoAurelio) [19:05:20] 10Analytics, 10Analytics-Dashiki: Convert Extension:Dashiki to use extension registration - https://phabricator.wikimedia.org/T171884#3479303 (10MarcoAurelio) Hmm. So https://github.com/wikimedia/mediawiki-extensions-Dashiki displays that there's already an extension.json file which is not at rEAND. Special:Ve... [19:23:19] 10Analytics, 10Analytics-Dashiki: Convert Extension:Dashiki to use extension registration - https://phabricator.wikimedia.org/T171884#3479368 (10MarcoAurelio) Note that http://tools.wmflabs.org/extreg-wos/ might also be wrong then. [20:20:52] (03PS32) 10Ottomata: JsonRefine: refine arbitrary JSON datasets into Parquet backed hive tables [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/346291 (https://phabricator.wikimedia.org/T161924) (owner: 10Joal) [20:21:44] (03PS33) 10Ottomata: JsonRefine: refine arbitrary JSON datasets into Parquet backed hive tables [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/346291 (https://phabricator.wikimedia.org/T161924) (owner: 10Joal) [20:41:29] (03PS34) 10Ottomata: JsonRefine: refine arbitrary JSON datasets into Parquet backed hive tables [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/346291 (https://phabricator.wikimedia.org/T161924) (owner: 10Joal) [21:43:13] ottomata: I'm smiling at your thread in Analytics. :D [21:43:21] it's a moving set of deadlines, ottomata. [21:43:25] * leila looks into it. [21:46:37] hahah [21:59:38] 10Analytics-Cluster, 10Analytics-Kanban, 10Patch-For-Review: Replacement of stat1002 and stat1003 - https://phabricator.wikimedia.org/T152712#3426373 (10leila) @Ottomata I checked stat1002:/a/. Can you copy psinger's folder to stat1005? that's my only request. thanks. [22:09:19] leila: it should be at [22:09:53] /srv/stat1002-a/user_difs_from_stat1002/psinger [22:09:58] and also /home/psinger [22:12:12] great. thanks ottomata [22:18:10] ottomata, what's the status with stat1003? [22:18:20] Going to get shut off today too? [22:18:50] naw no hurry there halfak [22:18:52] just stat1002 [22:18:56] kk cool :) [22:35:18] 10Analytics: Vet Analysis on June 2017 Data - https://phabricator.wikimedia.org/T171914#3479956 (10Nuria) [22:36:23] 10Analytics: Vet Analysis on June 2017 Data - https://phabricator.wikimedia.org/T171914#3479956 (10Nuria) Vet Analysis on June 2017 Data, backup data and analysis