[03:35:43] 10Analytics-Kanban, 10Analytics-Wikimetrics: Move Wikimetrics to new cloud databases - https://phabricator.wikimedia.org/T180770#3768850 (10Milimetric) [03:36:39] (03PS1) 10Milimetric: Fix database access by pointing to new servers [analytics/wikimetrics-deploy] - 10https://gerrit.wikimedia.org/r/391993 (https://phabricator.wikimedia.org/T180770) [03:38:08] (03CR) 10Milimetric: [V: 032 C: 032] Fix database access by pointing to new servers [analytics/wikimetrics-deploy] - 10https://gerrit.wikimedia.org/r/391993 (https://phabricator.wikimedia.org/T180770) (owner: 10Milimetric) [03:40:43] 10Analytics-Kanban, 10Analytics-Wikimetrics, 10Patch-For-Review: Move Wikimetrics to new cloud databases - https://phabricator.wikimedia.org/T180770#3768871 (10Milimetric) a:05Milimetric>03R3609901 [03:45:14] 10Analytics-Kanban, 10Analytics-Wikimetrics, 10Patch-For-Review: Move Wikimetrics to new cloud databases - https://phabricator.wikimedia.org/T180770#3768877 (10Milimetric) Uh... wtf... @mmodell or @Aklapper do you know why this task got re-assigned to this @R3609901 user by Herald? [03:45:28] 10Analytics-Kanban, 10Analytics-Wikimetrics, 10Patch-For-Review: Move Wikimetrics to new cloud databases - https://phabricator.wikimedia.org/T180770#3768881 (10Milimetric) p:05Triage>03High a:05R3609901>03Milimetric [03:45:50] .... k...... Herald wants to mess with me. Ok, Herald, you win [03:55:05] 10Analytics-Kanban, 10Patch-For-Review: Move Wikimetrics to new cloud databases - https://phabricator.wikimedia.org/T180770#3768896 (10Milimetric) a:05R3609901>03Milimetric [03:55:28] hahaha, nope [04:25:43] 10Analytics-Kanban, 10Patch-For-Review: Move Wikimetrics to new cloud databases - https://phabricator.wikimedia.org/T180770#3768933 (10Liuxinyu970226) >>! In T180770#3768877, @Milimetric wrote: > Uh... wtf... @mmodell or @Aklapper do you know why this task got re-assigned to this @R3609901 user by Herald? T17... [04:27:30] (03CR) 10Ottomata: "Eh? This will be a no op if puppet isn't changed. KafkaConsumer can take a single string topic or topic regex, or a list of topic names." [analytics/statsv] - 10https://gerrit.wikimedia.org/r/391703 (https://phabricator.wikimedia.org/T179093) (owner: 10Ottomata) [04:30:15] 10Analytics-Kanban, 10Patch-For-Review: Move Wikimetrics to new cloud databases - https://phabricator.wikimedia.org/T180770#3768944 (10mmodell) a:05R3609901>03Milimetric [08:17:22] stat boxes rebooted :) [09:18:08] yay! thanks! [10:37:01] Hi elukey - I'm having problems with SWAP notebooks [10:37:11] elukey: could be related to the reboot? [10:37:26] Ah - Actually, looks like it started [10:39:51] joal: bonjour! [10:39:59] Bonjour à toi elukey :) [10:40:04] all good now ? [10:40:19] Looks so - difficult start for notebooks, but now seems fine [10:40:59] elukey: do we take some time today to look at cassandra loading code, or do we do that next week? [10:54:24] joal: maybe later on in the afternoon? [10:56:13] elukey: For sure - I'll take my usual break between 2 and 4, but around that we can do :) [11:00:23] +1 [11:22:05] * elukey lunch! [11:55:19] ah joal https://phabricator.wikimedia.org/P6338 [11:55:38] those were the buckets requested [11:57:03] elukey: I'm sorry I don't find the format super easy to follow :S [11:57:10] can you give me more info? [12:00:40] joal: sure! Those are basically the values for query/bytes and query/time for druid queries [12:00:52] sx the count, dx the value [12:01:00] grepping in the metrics log files [12:02:51] the druid_exporter now uses [12:02:57] ['10', '100', '500', '1000', '10000', 'inf', 'sum'] [12:03:07] that is super generic but it should be fine for both metrics [12:03:18] (those are the buckets for the histograms) [12:04:50] elukey: I have to global idea, but still can't really make sense of the metrics inner values :) [12:05:13] I'm glad it works though, it means we'll have them in charts soon I assume :) [12:12:19] I am building the deb package \o/ [12:15:44] ! [12:42:31] (of course I am not even passing the first step of meeting the required dependencies, but I'll eventually make it :D) [12:54:24] 10Analytics, 10ChangeProp, 10EventBus, 10Services (watching), 10User-Elukey: Export burrow metrics to prometheus - https://phabricator.wikimedia.org/T180442#3769470 (10fgiunchedi) I took a quick look at burrow_exporter (without building/running it) and it looks sane. It seems to be polling burrow asynchr... [13:59:23] 10Analytics-Kanban, 10Patch-For-Review: Move Wikimetrics to new cloud databases - https://phabricator.wikimedia.org/T180770#3769587 (10Milimetric) thank you both :) [14:49:15] 10Analytics, 10DBA, 10Operations, 10Patch-For-Review, 10User-Elukey: Prep to decommission old dbstore hosts (db1046, db1047) - https://phabricator.wikimedia.org/T156844#3769759 (10ops-monitoring-bot) Completed auto-reimage of hosts: ``` ['dbproxy1004.eqiad.wmnet'] ``` and were **ALL** successful. [15:10:59] 10Analytics-Tech-community-metrics, 10Developer-Relations (Oct-Dec 2017): Make Qgil a fallback for Bitergia access (lock-in) - https://phabricator.wikimedia.org/T178381#3769861 (10Qgil) 05Open>03Resolved As far as I can see, I have permissions for all the places I needed to access. Thank you for your patie... [15:13:25] joal: if you want to explore cassandra land I am free now [15:45:35] Hey elukey [15:45:45] sorry I'm late for cass exploration [15:45:56] Given I have a meeting after standup with [15:46:06] Dario, maybe on monday morning if ok for you? [15:46:10] elukey: --^ [15:47:13] ack! [15:49:03] joal: would you mind to ask Dario if we can review https://phabricator.wikimedia.org/T156844#3767146 by any chance? :) [15:49:15] there is a db with his name on db1047 [15:49:35] I'll try to remember even if the topic is not exactly aligned :) [15:49:56] oh yes sure, otherwise I'll send him an email [15:51:12] elukey: I actually have another off-topic I'd like to discuss wih him, I'll try and let you know (mostly depends on his availability) [16:50:36] * elukey off! [17:36:34] 10Analytics, 10DBA, 10Operations, 10Patch-For-Review, 10User-Elukey: Prep to decommission old dbstore hosts (db1046, db1047) - https://phabricator.wikimedia.org/T156844#3107358 (10mforns) Re @elukey Seems to me that the DROP DATABASE list is correct. To the list of databases to review I would add: akh... [18:08:56] 10Analytics, 10DBA, 10Operations, 10Patch-For-Review, 10User-Elukey: Prep to decommission old dbstore hosts (db1046, db1047) - https://phabricator.wikimedia.org/T156844#3770727 (10DarTar) I just spoke to @JAllemandou, we can help review these legacy tables early next week. [19:59:12] J-Mo: I'm running a bit late. [19:59:37] bd808: no prob. see you soon [20:00:05] I should be with you in ~3 mins :) [21:37:41] (03PS14) 10Mforns: [WIP] Add scala-spark core class and job to import data sets to Druid [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/386882 (https://phabricator.wikimedia.org/T166414) [21:46:47] (03PS15) 10Mforns: [WIP] Add scala-spark core class and job to import data sets to Druid [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/386882 (https://phabricator.wikimedia.org/T166414) [21:56:33] 10Analytics, 10EventBus, 10Wikibase-Quality-Constraints, 10Wikidata, and 3 others: AddUsagesForPageJob doesn't really report execution status - https://phabricator.wikimedia.org/T178997#3771439 (10Krinkle) [22:15:53] (03CR) 10Mforns: "@Andrew, I think this can be reviewed. I still have to add support for blacklisted nested fields (with addition of user agent map) and new" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/386882 (https://phabricator.wikimedia.org/T166414) (owner: 10Mforns) [22:18:31] bye a-team, have a nice weekend! and milimetric, I guess I don't see you next week, and after next I'll be off, so... see ya from india :]