[02:18:08] 10Analytics-Tech-community-metrics: Inconsistent numbers for new Gerrit developers ("Summary" vs "New Authors" widgets) - https://phabricator.wikimedia.org/T177569#3663243 (10Aklapper) [02:19:29] 10Analytics-Tech-community-metrics: Inconsistent numbers for new Gerrit developers ("Summary" vs "New Authors" widgets) - https://phabricator.wikimedia.org/T177569#3663243 (10Aklapper) [02:34:56] 10Analytics-Tech-community-metrics: Inconsistent numbers for new Gerrit developers ("Summary" vs "New Authors" widgets) - https://phabricator.wikimedia.org/T177569#3663259 (10Aklapper) ...and taking those 47 entries in that list on "C_Gerrit_Demo" to construct an explicit query to apply on "Gerrit": `author_nam... [02:36:17] 10Analytics-EventLogging, 10Analytics-Kanban, 10Patch-For-Review, 10Readers-Web-Backlog (Tracking): Schema:Popups suddenly stopped logging events in MariaDB, but they are still being sent according to Grafana - https://phabricator.wikimedia.org/T174815#3663262 (10Tbayer) >>! In T174815#3651818, @Nuria wro... [02:37:01] (03PS1) 10Milimetric: Implement Topic Selector [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382636 (https://phabricator.wikimedia.org/T167676) [02:38:31] (03CR) 10Milimetric: [C: 04-1] "I did it! Marcel was totally right, I was over-complicating myself with the vue transitions. Pure CSS animations are much easier and mor" [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382636 (https://phabricator.wikimedia.org/T167676) (owner: 10Milimetric) [02:41:08] 10Analytics-EventLogging, 10Analytics-Kanban, 10Patch-For-Review, 10Readers-Web-Backlog (Tracking): Schema:Popups suddenly stopped logging events in MariaDB, but they are still being sent according to Grafana - https://phabricator.wikimedia.org/T174815#3663267 (10Tbayer) >>! In T174815#3627902, @Nuria wrot... [06:32:32] good morning! [06:42:03] morningzzz [07:12:00] (03PS1) 10Fdans: Add link on each metric to its definition in meta-wiki [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382656 (https://phabricator.wikimedia.org/T176241) [07:52:50] Heya [08:01:11] (03CR) 10Fdans: [C: 032] Merge branch 'develop' into master [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382466 (https://phabricator.wikimedia.org/T177288) (owner: 10Fdans) [08:02:57] (03Abandoned) 10Fdans: Add stub of new contributing and content metrics [analytics/wikistats2] (develop) - 10https://gerrit.wikimedia.org/r/382143 (https://phabricator.wikimedia.org/T175268) (owner: 10Fdans) [08:03:06] 10Analytics, 10DBA: Drop MoodBar tables from all wikis - https://phabricator.wikimedia.org/T153033#3663654 (10Marostegui) I have backuped the tables on: ``` root@dbstore1001:/srv/tmp/T153033# pwd /srv/tmp/T153033 root@dbstore1001:/srv/tmp/T153033# ls -lh total 16M -rw-r--r-- 1 root root 14M Oct 6 07:56 moodb... [08:03:37] (03PS1) 10Fdans: Add stub of new contributing and content metrics [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382659 (https://phabricator.wikimedia.org/T175268) [08:04:51] (03Abandoned) 10Fdans: Keep breakdowns selection regardless of time range [analytics/wikistats2] (develop) - 10https://gerrit.wikimedia.org/r/382164 (owner: 10Fdans) [08:11:44] joal: o/ - I'd need to do a rolling restart of Druid, anything that I need to check/stop before that? [08:20:35] 10Analytics, 10DBA: Drop MoodBar tables from all wikis - https://phabricator.wikimedia.org/T153033#3663680 (10Marostegui) a:03Marostegui I have imported those tables into db1047 and dbstore1002 with the name of the wiki at the start: ``` root@EVENTLOGGING m4[staging]> select @@hostname; +------------+ | @@ho... [08:49:07] !log restarted all the druid broker daemons to pick up the new logging changes [08:49:08] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [09:13:06] as FYI we are preparing dbstore1002 for a mysql restart due to swap usage, I just stopped EL sync and wiki replica [09:31:04] !log restart all the druid daemons on druid1005 to apply the new logging rules [09:31:05] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [10:01:40] 10Analytics-EventLogging, 10Analytics-Kanban, 10Page-Previews, 10Readers-Web-Backlog, and 5 others: EventLogging subscriber module in ready state but not sending tracked events - https://phabricator.wikimedia.org/T175918#3663909 (10phuedx) >>! In T175918#3658220, @Tbayer wrote: > Can someone summarize whic... [10:44:02] ok dbstore1002's maintenance done [10:44:12] all good and we have ~1TB of free space back [10:59:40] well done elukey [11:00:13] elukey: Druid restart didn't affect any job as of now [11:03:14] joal: o/ - is there any new procedure that we'd like to follow from now on? [11:04:06] my script restart (sequentially): the broker, coordinator, historical, middlemanager and overlord [11:04:11] (on each host) [11:04:34] elukey: I don't think so, spark real-time jobs aren't affected from restarts so it looks good :) [11:05:54] super, going to do it to the other hosts then [11:06:10] elukey: Ah! I thought you did it on every host :) [11:06:23] nope, the broker on every host and all the daemons on 1005 [11:06:50] elukey: got it - It's probable the spark jobs weren't using that machine as realtime indexers [11:07:07] elukey: Please go ahead and restart, I'll double check Spark [11:07:49] joal: I am so happy that now I have a vague idea about the realtime indexers, meanwhile before I was completely clueless [11:07:56] hehe [11:08:24] elukey: restart killed a batch indexing job from what I see, I'll restart it [11:08:35] !log Rerun pageview-druid-hourly-wf-2017-10-6-9 [11:08:36] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [11:08:43] wait a sec [11:08:49] I am doing the other nodes [11:08:55] yes ok, sure [11:09:36] joal: is there any correlation between coordinator and overlord/middlemanager? [11:09:50] elukey: They talk to each other I htink [11:10:41] !log restart all druid daemons to pick up new logging changes [11:10:42] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [11:10:51] When indexation jobs are finished (overloard / middlemanager / peons), coordinator gets notified, and then coordinator notifies historical for new segments to be loaded [11:11:04] ahhh makes sense [11:11:29] how are the indexation jobs started? You guys talked about it during standup but I didn't get it :( [11:12:18] elukey: oozie uses a python script that send a json request to druid [11:13:05] ah and the overlord starts the indexation [11:13:20] restarts completed! [11:14:01] elukey: correct, the oozie-python script send a json message to the overlord, asking for a new indexation task (with onfiguration) [11:14:18] Ok great elukey, rerunning failed oozie job [11:15:35] about the druid metrics and the prometheus poller (you can read later if you want) [11:15:41] there are two ways to do it [11:16:30] 1) the prometheus agent on each druid host reads the metrics file in /var/log/druid/etc.. that we just created, and whenever it gets polled by the prometheus master it somehow returns a list of metrics [11:17:51] 2) the prometheus agent exposes a http endpoint to receive posts by druid daemons (containing the same json data dropped in the logs), aggregates and keep in memory metrics to expose later on to the prometheus master's polls [11:18:37] there is also a graphite emitter afaics (community extension) but not sure if ops will like to get more graphite metrics [11:22:51] elukey: interesting results on realtime-indexation - Tasks got killed at restart, but spark didn't fail nor complain (but data is not available) [11:23:05] elukey: Need to investigate for at least having spark failing [11:23:30] :) [11:24:37] elukey: About metrics for prometheus, I don't see why polling files wouldn't be good [11:24:51] elukey: In any case, we'd have to aggregate metrics I think [11:25:24] yeah it is a stream of metrics constantly appended, not the hardest job in the world but it needs some thinking to be efficient :) [11:25:56] elukey: Let's push it to kafka, aggregate it via spark, and send it to druid for presentation ;) [11:26:15] exactly! [11:27:23] I am trying to think if implementing what they call an emitter in druid would be easier [11:27:59] like something that instead of constantly appending metrics it just emits a list of correctly formatted metrics for prometheus to a file every 1/5m [11:29:46] going to lunch and then a little errand, ttl! [11:29:49] * elukey lunch [11:30:03] later [12:29:10] 10Analytics, 10Proton, 10Readers-Web-Backlog, 10Patch-For-Review, 10Readers-Web-Kanban-Board: Implement Schema:Print purging strategy - https://phabricator.wikimedia.org/T175395#3664251 (10bmansurov) > @bmansurov, is this something we could still do easily (despite T169730#3654848)? @Tbayer, yes we can... [13:08:22] 10Analytics, 10Proton, 10Readers-Web-Backlog, 10Patch-For-Review, 10Readers-Web-Kanban-Board: Implement Schema:Print purging strategy - https://phabricator.wikimedia.org/T175395#3664303 (10ovasileva) Cross-posting from https://phabricator.wikimedia.org/T169730#3664250, but we would want to keep the Miner... [13:16:47] 10Analytics: Export Druid metrics and build a grafana dashboard - https://phabricator.wikimedia.org/T175343#3664310 (10elukey) [13:16:49] 10Analytics, 10Patch-For-Review, 10User-Elukey: Add the prometheus jmx exporter to all the Druid daemons - https://phabricator.wikimedia.org/T177459#3664312 (10elukey) [13:17:24] 10Analytics, 10Patch-For-Review, 10User-Elukey: Add a prometheus metric exporter to all the Druid daemons - https://phabricator.wikimedia.org/T177459#3659740 (10elukey) [13:22:04] 10Analytics, 10Operations, 10netops, 10User-Elukey: Review ACLs for the Analytics VLAN - https://phabricator.wikimedia.org/T157435#3664332 (10elukey) 05Open>03stalled [13:22:37] 10Analytics-Cluster, 10Analytics-Kanban, 10Operations, 10ops-eqiad, 10User-Elukey: Analytics hosts showed high temperature alarms - https://phabricator.wikimedia.org/T132256#3664334 (10elukey) 05Open>03stalled [13:33:26] 10Analytics, 10Operations, 10Ops-Access-Requests: analytics-privatedata-users access for Jeff Green - https://phabricator.wikimedia.org/T177602#3664354 (10Jgreen) [13:35:59] 10Analytics, 10Operations, 10Ops-Access-Requests: analytics-privatedata-users access for Jeff Green - https://phabricator.wikimedia.org/T177602#3664354 (10elukey) This guy seems trustable, approved :) [13:42:10] (03CR) 10Joal: [C: 04-1] "Small comments and 1 error (-1 for that one)." (036 comments) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382659 (https://phabricator.wikimedia.org/T175268) (owner: 10Fdans) [13:43:10] merci beaucoup joal !!! [13:44:28] fdans: lol, I just got an email about https://phabricator.wikimedia.org/D735 [13:44:36] :) [13:45:05] OH JUST IN TIME milimetric [13:45:08] fdans, milimetric : Let's discuss names and all when you want [13:45:21] one sec, and I'll be in cave [13:45:47] 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: dbstore1002 /srv filling up - https://phabricator.wikimedia.org/T168303#3664386 (10jcrespo) 05Open>03Resolved Seems healthy to me, both on disk space and memory usage. @Elukey, I think no matter how large is the available disk, it will fill up in mos... [13:46:04] milimetric: joal I need 10min, I’m in my way back from some errands [13:46:15] no prob, in 10 :) [14:09:06] joal milimetric cave? [14:09:17] yea we there [14:10:44] 10Analytics-Cluster, 10Analytics-Kanban, 10monitoring, 10User-Elukey: Decide on casing convention for JMX metrics in Prometheus - https://phabricator.wikimedia.org/T177078#3664430 (10Gehel) I don't care all that much about the coherence of the metric names. I would be nice to have coherent metric names, bu... [14:23:06] 10Analytics-Cluster, 10Analytics-Kanban, 10monitoring, 10User-Elukey: Decide on casing convention for JMX metrics in Prometheus - https://phabricator.wikimedia.org/T177078#3664526 (10elukey) During the last chat with Filippo and Eric we analyzed the most horrible looking metric names for kafka: ``` kafka_... [14:30:58] FAILED: SemanticException [Error 10004]: Line 25:4 Invalid table alias or column reference 'event_user_seconds_to_previous_revision': [14:31:18] this is from the failed oozie job for mediawiki history druid [14:31:23] is it known? [14:31:50] elukey: It is - give me aminute [14:31:54] ahhhh [14:32:09] Sorry -- this is the previous deploy [14:32:12] I should have known that you were on top of it [14:32:39] ottomata: the discovery-parent-pom has been released... let me know if you want a short prez, if you are interested in reusing some of it... [14:34:02] http://central.maven.org/maven2/org/wikimedia/discovery/ [14:35:01] 10Analytics, 10Patch-For-Review, 10User-Elukey: Add a prometheus metric exporter to all the Druid daemons - https://phabricator.wikimedia.org/T177459#3664583 (10elukey) All the daemons are now emitting metrics to `/var/log/druid/$daemon-metrics.log`, and it seems that we have already all we need in there wit... [14:39:02] gehel: def will, next week sometime ok? [14:39:19] ottomata: sure, whenever you want! [14:39:35] I'll try to add some docs as well, but not sure when... [14:46:46] a-team: loooook at this nice page https://github.com/varnishcache/varnish-cache/blob/master/doc/changes.rst [14:46:55] 5.2 [14:46:56] C APIs (for vmod and utility authors) [14:46:56] The VSM API for accessing the shared memory segment has been totally rewritten. Things should be simpler and more general. [14:47:26] we are now packaging 5.1.3 that should be ok [14:47:33] fancy [14:47:50] it's 2017 and you have an API already?! So modern ;) [14:47:55] they changed everything again [14:48:10] that api is the one that varnishkafka uses :) [14:54:37] a-team i'm going to skip standup today, only working a half day. [14:54:49] yesterday: i pretty much only worked on helping jeff with kafkatee stuff [14:54:56] we eliminated some possible causes [14:54:59] he is investigating more [14:55:10] this morning I am starting the backup of data [14:58:37] ottomata: What have you decided finally about checksums? [14:59:00] joal: haven't waiting for stroz :/ [14:59:05] but want to start copying now [14:59:09] ottomata: ok [14:59:29] ottomata: I can try to jump in if you want, helping extracting checksums in parallel ? [15:05:48] (03PS2) 10Milimetric: Implement Topic Selector [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382636 (https://phabricator.wikimedia.org/T167676) [15:06:15] (03PS3) 10Milimetric: Implement Topic Selector [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382636 (https://phabricator.wikimedia.org/T167676) [15:07:20] 10Analytics-Kanban, 10Patch-For-Review, 10Release-Engineering-Team (Kanban): Move Wikistats 2 from Differential to Gerrit - https://phabricator.wikimedia.org/T177288#3664670 (10Nuria) [15:09:29] joal: sure, still waiting for stroz to respond [15:09:34] i'm hoping we don't have to do that [15:09:48] since the .crcs that -copyToLocal create are easier to use for the local data in the future [15:09:56] ottomata: I understand, if you need / want help parallelizing, I can jump in [15:10:00] thanks :) [15:10:13] np, it's not a fun mess [15:12:33] ottomata: what happen with LVS private/public fronting druid? [15:20:28] nuria_: nohting [15:20:33] i made a ticket, no respond [15:20:39] i didn' thave any time to work on decomming druid [15:20:46] nodes [15:21:23] ottomata: if you want I can try to follow up on Monday EU daytime [15:22:20] for lvs q? [15:22:24] would be helpful elukey thanks [15:22:27] oh, but monday is a holiday? [15:25:25] is it a US only or all holiday? [15:26:24] I think only US, if so I'll follow up with the EU people [15:27:16] elukey: realtime indexing jobs that have failed can't be restarted for the same segment-granularity (https://groups.google.com/forum/#!topic/druid-development/Ot0z3n_Tp4E) [15:27:52] 10Analytics-Kanban, 10Operations, 10User-Elukey: LVS for Druid - https://phabricator.wikimedia.org/T177511#3664734 (10elukey) [15:29:54] 10Analytics-Kanban, 10User-Elukey: Alarms on pageview API latency increase - https://phabricator.wikimedia.org/T164243#3664757 (10Nuria) a:03elukey [15:35:54] elukey: that sounds good [15:35:58] elukey: thank you [15:36:14] elukey: i will work monday so we can talk then [15:37:50] wow, hive creation scripts for mediawiki_history table is all messed up [15:43:59] I apologize a-team for that mess - Will try to fix it now [15:45:32] Ahhhhhhh ! I found it :) [15:46:14] milimetric: I missed one of your ommit that introduce bugs [15:47:36] milimetric: if you have minute I'm interested to discuss how we want to handle [15:48:11] mforns: you want to cave and talk about transitioning the change to gerrit? [15:48:23] joal: this one? https://github.com/wikimedia/analytics-refinery/commit/e4655a679ee50a90a8eaaa7ca5888effbc2e99a4#diff-0d6e4fdd6aad22d890c29dbe7fe3a11c [15:48:25] fdans, sure! I'm trying it right now [15:48:27] omw [15:48:38] milimetric: precisely [15:48:41] joal: a-batcave-2? [15:48:45] sure ! [15:56:37] (03PS1) 10Joal: Correct bugs in mediawiki_history scripts [analytics/refinery] - 10https://gerrit.wikimedia.org/r/382733 [15:56:53] milimetric, nuria_ --^ if you have a minute -- I'll deploy on monday [15:57:27] joal: I'll look [15:57:28] joal: will CR [15:57:32] Thanks [15:58:06] (03PS1) 10Mforns: Fix bug when some of aqs requests return 202 and others 404 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382734 (https://phabricator.wikimedia.org/T176261) [16:05:41] (03PS2) 10Fdans: Add stub of new contributing and content metrics [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382659 (https://phabricator.wikimedia.org/T175268) [16:07:40] (03PS5) 10Milimetric: Create Oozie job for interlanguage nav table [analytics/refinery] - 10https://gerrit.wikimedia.org/r/365517 (https://phabricator.wikimedia.org/T170764) (owner: 10Amire80) [16:08:32] (03CR) 10Milimetric: "new patch addresses "done" stuff, but I have some questions/comments in reply to some of yours" (038 comments) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/365517 (https://phabricator.wikimedia.org/T170764) (owner: 10Amire80) [16:08:36] (03CR) 10Fdans: [C: 032] Fix bug when some of aqs requests return 202 and others 404 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382734 (https://phabricator.wikimedia.org/T176261) (owner: 10Mforns) [16:08:57] thank youuuu [16:09:56] (03CR) 10Fdans: [V: 032 C: 032] Fix bug when some of aqs requests return 202 and others 404 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382734 (https://phabricator.wikimedia.org/T176261) (owner: 10Mforns) [16:29:25] (03PS1) 10Fdans: Add top articles by pageviews metric [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382737 (https://phabricator.wikimedia.org/T175266) [16:29:31] (03CR) 10jerkins-bot: [V: 04-1] Add top articles by pageviews metric [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382737 (https://phabricator.wikimedia.org/T175266) (owner: 10Fdans) [16:32:00] 10Analytics, 10Proton, 10Readers-Web-Backlog, 10Patch-For-Review, 10Readers-Web-Kanban-Board: Implement Schema:Print purging strategy - https://phabricator.wikimedia.org/T175395#3665022 (10Jdlrobson) > need to be able to restrict analysis to desktop only, The minerva skin is available on desktop so this... [16:33:37] (03PS2) 10Fdans: Add top articles by pageviews metric [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382737 (https://phabricator.wikimedia.org/T175266) [16:33:43] (03CR) 10jerkins-bot: [V: 04-1] Add top articles by pageviews metric [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382737 (https://phabricator.wikimedia.org/T175266) (owner: 10Fdans) [16:37:08] 10Analytics, 10Proton, 10Readers-Web-Backlog, 10Patch-For-Review, 10Readers-Web-Kanban-Board: Implement Schema:Print purging strategy - https://phabricator.wikimedia.org/T175395#3665041 (10Jdlrobson) The following queries show skin cannot be relied on as a field meaning "desktop": select * from Print_17... [16:38:03] (03Abandoned) 10Fdans: Add top articles by pageviews metric [analytics/wikistats2] (develop) - 10https://gerrit.wikimedia.org/r/382139 (https://phabricator.wikimedia.org/T175266) (owner: 10Fdans) [16:48:49] (03PS3) 10Fdans: Add top articles by pageviews metric [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382737 (https://phabricator.wikimedia.org/T175266) [16:48:56] (03CR) 10jerkins-bot: [V: 04-1] Add top articles by pageviews metric [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382737 (https://phabricator.wikimedia.org/T175266) (owner: 10Fdans) [16:49:27] 10Analytics-EventLogging, 10Analytics-Kanban, 10Patch-For-Review, 10Readers-Web-Backlog (Tracking): Schema:Popups suddenly stopped logging events in MariaDB, but they are still being sent according to Grafana - https://phabricator.wikimedia.org/T174815#3665062 (10Nuria) >While doing so, I noticed that the... [16:53:24] (03CR) 10Nuria: [V: 032 C: 032] "Pending amir's review, but looks good to merge if data gathered seems sound." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/365517 (https://phabricator.wikimedia.org/T170764) (owner: 10Amire80) [16:56:27] (03PS4) 10Fdans: Add top articles by pageviews metric [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382737 (https://phabricator.wikimedia.org/T175266) [17:01:52] (03PS5) 10Fdans: Add top articles by pageviews metric [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382737 (https://phabricator.wikimedia.org/T175266) [17:03:02] (03CR) 10Mforns: [C: 032] Add link on each metric to its definition in meta-wiki [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382656 (https://phabricator.wikimedia.org/T176241) (owner: 10Fdans) [17:03:25] (03CR) 10Mforns: [V: 031 C: 032] Add top articles by pageviews metric [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382737 (https://phabricator.wikimedia.org/T175266) (owner: 10Fdans) [17:03:30] (03CR) 10Fdans: [V: 032] Add top articles by pageviews metric [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/382737 (https://phabricator.wikimedia.org/T175266) (owner: 10Fdans) [17:05:58] * elukey off! byyee [17:09:14] (03PS1) 10Fdans: Release 2.0.8 [analytics/wikistats2] (release) - 10https://gerrit.wikimedia.org/r/382741 [17:15:25] (03PS2) 10Fdans: Release 2.0.8 [analytics/wikistats2] (release) - 10https://gerrit.wikimedia.org/r/382741 [17:16:11] (03CR) 10Fdans: [C: 032] Release 2.0.8 [analytics/wikistats2] (release) - 10https://gerrit.wikimedia.org/r/382741 (owner: 10Fdans) [17:48:13] 10Analytics-EventLogging, 10Analytics-Kanban, 10Patch-For-Review, 10Readers-Web-Backlog (Tracking): Schema:Popups suddenly stopped logging events in MariaDB, but they are still being sent according to Grafana - https://phabricator.wikimedia.org/T174815#3665368 (10Nuria) >All event fields are strings now, e... [17:49:24] 10Analytics, 10Proton, 10Readers-Web-Backlog, 10Patch-For-Review, 10Readers-Web-Kanban-Board: Implement Schema:Print purging strategy - https://phabricator.wikimedia.org/T175395#3665372 (10mforns) @Jdlrobson Answering to you comment on gerrit: > Could you elaborate on this by giving an example? Why would... [17:51:53] 10Analytics, 10Proton, 10Readers-Web-Backlog, 10Patch-For-Review, 10Readers-Web-Kanban-Board: Implement Schema:Print purging strategy - https://phabricator.wikimedia.org/T175395#3665379 (10Jdlrobson) > And there's only 3 people in the world with that skin (me and 2 more). I'm from Barcelona and the other... [17:55:17] a-team, latest wikistats changes except for topic selector are in prod stats.wikimedia.org/v2/#/ [17:56:06] cooool :) [17:56:40] mforns: niceeeee [17:56:51] yeaaa [17:57:02] mforns: does that include your fix for Promise.all and fetches from aqs? [17:57:36] nuria_, yes [18:00:28] mforns: nice, much better, now bugs are about refinment not basic functionality, great, feeling more like alpha now [18:00:41] cool [18:00:42] cc fdans [18:01:33] \o/ [18:06:04] fdans: nice work on top metric [18:10:49] fdans, milimetric , mforns : much better quality now, i am leaning towards announcing it [18:13:19] nuria_: without the edit aqs cluster, it seems like not at all a wikistats replacement alpha, but more like a clone of a tiny set of the pageview tool features. [18:13:38] without the public druid cluster I mean [18:13:49] milimetric: yaya [18:13:56] milimetric: not externally [18:14:08] oh, yeah, internally totally, anytime [18:14:39] milimetric: ya externally w/o editing data is kind of meaningless [18:20:34] 10Analytics: Add link to footer of wikistats with "file a bug" - https://phabricator.wikimedia.org/T177642#3665482 (10Nuria) [18:22:13] 10Analytics, 10Proton, 10Readers-Web-Backlog, 10Patch-For-Review, 10Readers-Web-Kanban-Board: Implement Schema:Print purging strategy - https://phabricator.wikimedia.org/T175395#3665497 (10mforns) @Jdlrobson You're right, one would have to know which skin do I use. For example: If someone suspects that I... [18:22:33] 10Analytics: Alpha Release: Link on message box on stats.wikimedia.org to new wikistats 2.0 domain - https://phabricator.wikimedia.org/T177643#3665498 (10Nuria) [18:22:53] 10Analytics, 10Analytics-Wikistats: Alpha Release: Link on message box on stats.wikimedia.org to new wikistats 2.0 domain - https://phabricator.wikimedia.org/T177643#3665509 (10Nuria) [18:31:39] 10Analytics, 10Analytics-Wikistats: Beta Release: Breakdown selection disapears when you change timespam - https://phabricator.wikimedia.org/T177646#3665552 (10Nuria) [18:32:11] 10Analytics: Varnishkafka does not play well with varnish 5.2 - https://phabricator.wikimedia.org/T177647#3665564 (10Nuria) [18:51:13] (03CR) 10Joal: [V: 032 C: 032] "LGTM as well - One picky stuff inside, not needed to move on." (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/365517 (https://phabricator.wikimedia.org/T170764) (owner: 10Amire80) [19:15:49] (03PS1) 10Joal: Filter banners sample_rate = Infinity from Druid [analytics/refinery] - 10https://gerrit.wikimedia.org/r/382764 (https://phabricator.wikimedia.org/T175248) [19:16:27] nuria_, milimetric if you have a minute --^ For me to deploy next Monday [19:16:45] Gone for tonight team - See you [19:19:45] yeah, joal I'll review it before I leave for the day, have a great weekend [19:21:53] 10Analytics-EventLogging, 10Analytics-Kanban, 10Page-Previews, 10Readers-Web-Backlog, and 5 others: EventLogging subscriber module in ready state but not sending tracked events - https://phabricator.wikimedia.org/T175918#3665782 (10Tbayer) >>! In T175918#3663909, @phuedx wrote: >>>! In T175918#3658220, @Tb... [19:26:23] (03CR) 10Nuria: Filter banners sample_rate = Infinity from Druid (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/382764 (https://phabricator.wikimedia.org/T175248) (owner: 10Joal) [19:36:41] o/ [19:36:53] Looks like I don't have some packages installed on stat1006 that I expected. [19:36:57] aspell-ar specifically. [19:37:30] 10Analytics, 10Proton, 10Readers-Web-Backlog, 10Patch-For-Review, 10Readers-Web-Kanban-Board: Implement Schema:Print purging strategy - https://phabricator.wikimedia.org/T175395#3665833 (10mforns) @Jdlrobson (c.c.@Tbayer) Reevaluating this... I think you got a very good point. `skin` is not like `edit... [19:37:33] https://github.com/wikimedia/puppet/blob/production/modules/ores/manifests/base.pp#L22 [19:37:39] It *should* be there I think. [19:37:53] ores::base should be enabled on stat1006. I'm not quite sure how to check. [19:38:17] looks like otto is out [19:40:21] (03CR) 10Joal: "SQL types are weird ..." (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/382764 (https://phabricator.wikimedia.org/T175248) (owner: 10Joal) [19:52:57] (03CR) 10Milimetric: [V: 032 C: 032] Filter banners sample_rate = Infinity from Druid [analytics/refinery] - 10https://gerrit.wikimedia.org/r/382764 (https://phabricator.wikimedia.org/T175248) (owner: 10Joal) [19:55:31] (03CR) 10Milimetric: [V: 032 C: 032] "sorry again for the rushed assumption that caused this bug" (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/382733 (owner: 10Joal) [20:06:28] * halfak spins up a VM in Cloud instead [20:59:08] bye team, have a nice weekend! [21:24:37] 10Analytics-EventLogging, 10Analytics-Kanban, 10Patch-For-Review, 10Readers-Web-Backlog (Tracking): Schema:Popups suddenly stopped logging events in MariaDB, but they are still being sent according to Grafana - https://phabricator.wikimedia.org/T174815#3666240 (10Nuria) >You can cast field while querying,...