[00:03:48] 10Analytics, 10Analytics-Dashiki, 10CX-analytics: Dashiki: CX2 translations fails to load - https://phabricator.wikimedia.org/T217506 (10jeblad) Kind of bad when [[ https://www.mediawiki.org/wiki/Content_translation/V2 | mw:Content translation/V2 ]] has broken links. I've updated the page. ([[ https://www.me... [00:04:03] 10Analytics, 10Analytics-Dashiki, 10CX-analytics: Dashiki: CX2 translations fails to load - https://phabricator.wikimedia.org/T217506 (10jeblad) 05Open→03Resolved a:03jeblad [02:07:49] 10Analytics, 10Analytics-SWAP, 10Product-Analytics: Publishing html files generated on notebook hosts - https://phabricator.wikimedia.org/T217619 (10chelsyx) [02:22:24] joal: done [02:24:04] PROBLEM - Check if the Hadoop HDFS Fuse mountpoint is readable on stat1004 is CRITICAL: CRITICAL [02:55:18] (03PS3) 10Milimetric: [WIP] Create geoeditors edits monthly and yearly [analytics/refinery] - 10https://gerrit.wikimedia.org/r/489313 (https://phabricator.wikimedia.org/T215655) [03:14:54] (03CR) 10Milimetric: "Looked this over, it generally looks good. I'm going to play with the CSS transitions on the dashboard and then do another pass in more d" [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/494241 (https://phabricator.wikimedia.org/T187806) (owner: 10Fdans) [03:23:40] 10Analytics, 10ExternalGuidance, 10Product-Analytics, 10MW-1.33-notes (1.33.0-wmf.18; 2019-02-19), 10Patch-For-Review: Measure the impact of externally-originated contributions - https://phabricator.wikimedia.org/T212414 (10chelsyx) >>! In T212414#4997570, @Pginer-WMF wrote: > If I understand this correc... [06:30:30] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Discovery, and 3 others: Rewrite Avro schemas (ApiAction, CirrusSearchRequestSet) as JSONSchema and produce to EventGate - https://phabricator.wikimedia.org/T214080 (10akosiaris) >>! In T214080#4999866, @Ottomata wrote: > @akosiaris, I deployed t... [07:26:18] RECOVERY - Check if the Hadoop HDFS Fuse mountpoint is readable on stat1004 is OK: OK [07:27:31] morning! [08:05:35] morning elukey :) [08:08:21] Many thanks HaeB :) [08:43:47] (03CR) 10WMDE-leszek: [C: 03+2] Rewrite user_langauges.php to use babel table and Inclusion–exclusion principle [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/494245 (https://phabricator.wikimedia.org/T213894) (owner: 10Ladsgroup) [08:43:56] (03Merged) 10jenkins-bot: Rewrite user_langauges.php to use babel table and Inclusion–exclusion principle [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/494245 (https://phabricator.wikimedia.org/T213894) (owner: 10Ladsgroup) [08:43:58] (03Merged) 10jenkins-bot: Remove WikimediaDb::getPdo() [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/494248 (https://phabricator.wikimedia.org/T213894) (owner: 10Ladsgroup) [08:56:11] 10Analytics, 10Performance-Team, 10Patch-For-Review: ServerTiming schema value for duration is 0 - https://phabricator.wikimedia.org/T217111 (10Gilles) @milimetric is the data for "duration" in Hive currently stored as integer? [08:56:29] 10Analytics, 10Performance-Team: ServerTiming schema value for duration is 0 - https://phabricator.wikimedia.org/T217111 (10Gilles) [09:11:31] 10Analytics, 10ExternalGuidance, 10Product-Analytics, 10MW-1.33-notes (1.33.0-wmf.18; 2019-02-19), 10Patch-For-Review: Measure the impact of externally-originated contributions - https://phabricator.wikimedia.org/T212414 (10Pginer-WMF) >>! In T212414#5000325, @chelsyx wrote: > @Pginer-WMF you mean clicki... [09:45:06] 10Analytics, 10Operations, 10vm-requests, 10User-Elukey: Replace analytics-tool1003 ganeti VM with another VM with Buster - https://phabricator.wikimedia.org/T217640 (10elukey) p:05Triage→03Normal [09:45:48] 10Analytics, 10Operations, 10vm-requests, 10User-Elukey: Replace analytics-tool1003 ganeti VM with another VM with Buster - https://phabricator.wikimedia.org/T217640 (10elukey) ` elukey@ganeti1003:~$ sudo gnt-group list Group Nodes Instances AllocPolicy NDParams row_A 4 33 preferred ovs=False... [10:08:56] Hello! [10:09:12] I've seen some strange behavior of the analytics-mysql tool from stat1004: [10:09:38] Namely, running it with a system() call from withing an interactive R session (ssh on stat1004) does the job [10:10:04] Second, running it from server directly (no R interface): works superfine; however, [10:10:39] starting an R script from a crontab on stat1004, my script's log says: sh: 1: analytics-mysql: not found [10:10:55] Does anyone have any idea on why could this be happening? Thanks! [10:11:59] GoranSM: I assume it's a $PATH definition issue [10:13:01] analytics-mysql is located at /srv/deployment/analytics/refinery/bin, and actually need some twqeak in python-path: PYTHONPATH=/srv/deployment/analytics/refinery/python:$PYTHONPATH [10:19:25] 10Analytics, 10Operations, 10vm-requests, 10Patch-For-Review, 10User-Elukey: Replace analytics-tool1003 ganeti VM with another VM with Buster - https://phabricator.wikimedia.org/T217640 (10elukey) @akosiaris IIRC there is a bridge + interface for the Analytics VLAN on the Ganeti host, that takes care of... [10:22:42] 10Analytics, 10Operations, 10vm-requests, 10Patch-For-Review, 10User-Elukey: Replace analytics-tool1003 ganeti VM with another VM with Buster - https://phabricator.wikimedia.org/T217640 (10akosiaris) >>! In T217640#5000872, @elukey wrote: > @akosiaris IIRC there is a bridge + interface for the Analytics... [10:37:01] 10Analytics, 10Operations, 10vm-requests, 10Patch-For-Review, 10User-Elukey: Replace analytics-tool1003 ganeti VM with another VM with Buster - https://phabricator.wikimedia.org/T217640 (10elukey) @akosiaris nope I don't feel adventurous today :D I added a change to makevm to support this use case, not s... [10:48:10] 10Analytics, 10Operations, 10vm-requests, 10Patch-For-Review, 10User-Elukey: Replace analytics-tool1003 ganeti VM with another VM with Buster - https://phabricator.wikimedia.org/T217640 (10elukey) Worked nicely! ` elukey@ganeti1003:~$ sudo makevm This is an interactive script to make it easier to create... [10:49:28] joal: I think that GoranSM just need to call /usr/local/bin/analytics-mysql from the cron [10:49:50] Ah ok :) Thanks elukey :) [10:49:53] (sorry just seen the msgs) [10:50:01] basically /usr/local/bin/analytics-mysql does [10:50:11] PYTHONPATH=${PYTHONPATH}:/srv/deployment/analytics/refinery/python /srv/deployment/analytics/refinery/bin/analytics-mysql "$@" [10:50:24] Ah right [10:50:48] I am currently creating analytics-tool1004 [10:50:51] in ganeti [10:50:57] that will host superset + buster [11:18:50] 10Analytics, 10Analytics-Cluster: Upgrade Hive to ≥ 2.0 - https://phabricator.wikimedia.org/T203498 (10Neil_P._Quinn_WMF) It looks like CDH 6.1, which [includes](https://www.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_cdh_61_packaging.html) Hive 2.1.1, [was released in December](https://blo... [11:31:38] 10Analytics, 10Operations, 10hardware-requests: GPU upgrade for stat1005 - https://phabricator.wikimedia.org/T216226 (10elukey) @RobH, @EBernhardson - while we wait for a response from AMD, I'd also like to understand if T216528 gave us more info about the possibility of ordering a GPU like RX vega 64 via re... [11:43:33] 10Quarry: Table field templatelink.tl_from in database does not always match page.page_namespace - https://phabricator.wikimedia.org/T217647 (10Aklapper) [11:54:34] 10Analytics-Kanban, 10Product-Analytics: Superset Updates - https://phabricator.wikimedia.org/T211706 (10elukey) [11:54:39] 10Analytics, 10User-Elukey: Staging environment for upgrades of superset - https://phabricator.wikimedia.org/T212243 (10elukey) 05Stalled→03Open [12:09:58] joal: do you think that we could test CDH6 next fiscal ? [12:10:25] with the assumption to hold the hadoop testing cluster [12:10:30] otherwise it will be too painful [12:32:31] elukey: why not :) a lot of adjustments I imagine, but the road to better stuff [12:33:15] :) [12:38:38] * elukey lunch! [12:52:16] (03PS1) 10WMDE-Fisch: Add reference previews beta feature [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/494479 (https://phabricator.wikimedia.org/T215891) [13:10:48] heya team [13:11:08] elukey, I just checked the deletion script and everything seems OK :] it worked as expected [13:16:33] (03PS2) 10Fdans: Display exact period of time in widgets instead of "last year" [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/493260 (https://phabricator.wikimedia.org/T216105) [13:16:59] (03PS3) 10Fdans: Display exact period of time in widgets instead of "last year" [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/493260 (https://phabricator.wikimedia.org/T216105) [14:03:15] joal: testing elukey's suggestion now [14:05:55] 10Analytics, 10Knowledge-Integrity, 10Research, 10Epic, 10Patch-For-Review: Citation Usage: run third round of data collection - https://phabricator.wikimedia.org/T213969 (10bmansurov) @RyanSteinberg also note that some internal links are being marked as external (T217567). It maybe something to keep in... [14:07:47] 10Analytics, 10Performance-Team: ServerTiming schema value for duration is 0 - https://phabricator.wikimedia.org/T217111 (10Milimetric) @Gilles yes, bigint: pageviewToken: string description: string duration: bigint name: string [14:13:07] 10Analytics, 10Analytics-Kanban: [Bug] Type mismatch for a few other schemas - https://phabricator.wikimedia.org/T216771 (10Gilles) [14:13:10] 10Analytics, 10Performance-Team: ServerTiming schema value for duration is 0 - https://phabricator.wikimedia.org/T217111 (10Gilles) 05Open→03Resolved [14:17:25] mforns: \o/ [14:28:22] ottomata: o/ [14:28:29] morningggg [14:28:35] question for whenever you have time [14:28:42] today I have created analytics-tool1004 [14:28:45] for superset [14:29:07] (03PS1) 10Mforns: Add getMainComponent to routes [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/494491 (https://phabricator.wikimedia.org/T187806) [14:29:07] hiyaaaa [14:29:08] but then I've read https://wikitech.wikimedia.org/wiki/Infrastructure_naming_conventions#Servers [14:29:15] and we are supposed to use an-tool? [14:29:33] OH we did switch to an- after we maade the analytics-tool ones! [14:29:42] elukey: we probably should [14:29:45] sigh [14:29:50] dunno if it is worth going back [14:29:52] not really a big deal [14:29:55] just next time? [14:30:16] for the staging tool maybe? an-tool1005? [14:31:19] ya [14:31:25] for future ones we should do that. [14:32:30] all right, this spares me to destroy the vm etc.. :) [14:34:56] 10Analytics, 10Operations, 10vm-requests, 10Patch-For-Review, 10User-Elukey: Replace analytics-tool1003 ganeti VM with another VM with Buster - https://phabricator.wikimedia.org/T217640 (10elukey) I just realized that in https://wikitech.wikimedia.org/wiki/Infrastructure_naming_conventions we have 'an-to... [14:43:08] elukey: Thank you for your suggestion - solved! [14:43:49] elukey: which shard should the centralauth replica be on? I think x1 but it's not there. [14:44:14] GoranSM: nice! [14:44:25] neilpquinn: hello! no idea, lemme check [14:45:52] so from mediawiki-config I can see wmf-config/db-eqiad.php:78: 'centralauth' => 's7', [14:46:19] but it is not in s7.dblist [14:46:21] mmmmm [14:48:24] yeah s7 neilpquinn [14:49:33] I used mysql -h dbstore1003.eqiad.wmnet -P 3317 centralauth [14:50:02] I am asking to the experts :) [14:50:10] (why centralauth is not in the dblist) [14:50:55] 10Analytics, 10EventBus, 10Services (watching): EventGate (in k8s) takes a long time to load new schemas - https://phabricator.wikimedia.org/T217661 (10Ottomata) [14:51:20] elukey: thank you! yeah, it would be nice if analytics-mysql (which is great, by the way!) returned the target for non-wiki databases like centralauth, wikishared, and staging :) [14:51:56] oh, staging does work already. Nice :) [14:52:04] neilpquinn: will do asap, I wasn't aware of these non wiki use cases sigh [14:52:30] elukey: no problem...there are always bugs to out! [14:52:35] *to work out [14:53:32] neilpquinn: staging already works though [14:53:50] hahaha, yeah, I realized ^ :) [14:54:05] one bug removed! [14:54:06] :P [14:56:00] (03PS1) 10Mforns: Fix small bug in refinery-drop-older-than [analytics/refinery] - 10https://gerrit.wikimedia.org/r/494495 (https://phabricator.wikimedia.org/T209503) [14:56:01] neilpquinn: wikishared is also available, just needs --use-x1 [14:56:11] the only missing one is centralauth [14:56:19] that I'll probably need to add as special case [14:56:26] Ahh, okay [14:56:32] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Discovery, and 4 others: Rewrite Avro schemas (ApiAction, CirrusSearchRequestSet) as JSONSchema and produce to EventGate - https://phabricator.wikimedia.org/T214080 (10Ottomata) Awesome, with 20 replicas I can make a single ab with -c1000 push ~6... [14:57:54] elukey: is there a way to have wikishared not need the --use-x1? Unlike, say, enwiki's x1 database, there's no ambiguity there because it's always on x1. [15:01:27] neilpquinn: I'd prefer not since it would add another corner case to the code, in this way it is all taken by mediawiki config [15:01:34] so if anything changes, analytics-mysql will keep working [15:01:49] (03PS1) 10Elukey: Add the 'centralauth' db use case in refinery utils.py [analytics/refinery] - 10https://gerrit.wikimedia.org/r/494496 [15:03:44] (03CR) 10Elukey: [C: 03+1] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/494495 (https://phabricator.wikimedia.org/T209503) (owner: 10Mforns) [15:31:16] 10Analytics, 10Analytics-Kanban, 10Analytics-SWAP, 10Product-Analytics: Publishing html files generated on notebook hosts - https://phabricator.wikimedia.org/T217619 (10Ottomata) p:05Triage→03Normal a:03Ottomata [15:31:24] 10Analytics, 10Analytics-Kanban, 10Analytics-SWAP, 10Product-Analytics: Publishing html files generated on notebook hosts - https://phabricator.wikimedia.org/T217619 (10Ottomata) [15:40:36] (03CR) 10Thiemo Kreuz (WMDE): [C: 03+2] Add reference previews beta feature [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/494479 (https://phabricator.wikimedia.org/T215891) (owner: 10WMDE-Fisch) [15:40:45] (03Merged) 10jenkins-bot: Add reference previews beta feature [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/494479 (https://phabricator.wikimedia.org/T215891) (owner: 10WMDE-Fisch) [15:51:04] hey elukey, can I copy the /srv/mediawiki-config folder to my local machine for testing? or is there any private infos? [15:54:00] oh elukey, reading README, thanks! [15:54:01] 10Analytics, 10Operations, 10hardware-requests: GPU upgrade for stat1005 - https://phabricator.wikimedia.org/T216226 (10EBernhardson) At this point I'm not really expecting a response from AMD anymore, generally i would expect under a week but the only response I've gotten so far is the automated response sa... [15:55:31] mforns: nono it is a public repo in gerrit, you can check it out! [15:55:45] oh elukey cool :] [15:57:29] 10Analytics, 10Operations, 10hardware-requests: GPU upgrade for stat1005 - https://phabricator.wikimedia.org/T216226 (10elukey) Thanks @EBernhardson! @RobH What do you think? Would it be feasible for you to check from our vendors if we can get a RX Vega 64? [16:00:26] 10Analytics, 10Operations, 10hardware-requests: GPU upgrade for stat1005 - https://phabricator.wikimedia.org/T216226 (10RobH) So the only vendor we have terms with that may have this is https://neweggbusiness.com https://www.neweggbusiness.com/product/productlist.aspx?Submit=ENE&DEPA=0&Order=BESTMATCH&N=-1... [16:03:26] (03CR) 10Ottomata: [V: 03+2 C: 03+2] Fix small bug in refinery-drop-older-than [analytics/refinery] - 10https://gerrit.wikimedia.org/r/494495 (https://phabricator.wikimedia.org/T209503) (owner: 10Mforns) [16:03:36] 10Analytics, 10Operations, 10hardware-requests: GPU upgrade for stat1005 - https://phabricator.wikimedia.org/T216226 (10Nuria) I am ok with the $800 cost of this proof of concept, benefit in terms of engineering hours if this is to work is pretty significant [16:03:36] thanxxx [16:06:37] 10Analytics, 10Operations, 10hardware-requests: GPU upgrade for stat1005 - https://phabricator.wikimedia.org/T216226 (10elukey) Those cards afaics are only 8G, meanwhile we'd need 16G (if possible). The only model that would suit us that I found is: https://www.neweggbusiness.com/product/product.aspx?item=9... [16:06:55] 10Analytics, 10Operations, 10hardware-requests: GPU upgrade for stat1005 - https://phabricator.wikimedia.org/T216226 (10EBernhardson) Newegg looks to only have models with aftermarket cooling in stock,I would have some size concerns with these as well. Ideally we want the stock form factor, like the (out of... [16:10:47] 10Analytics, 10Operations, 10hardware-requests: GPU upgrade for stat1005 - https://phabricator.wikimedia.org/T216226 (10EBernhardson) >>! In T216226#5001885, @elukey wrote: > Those cards afaics are only 8G, meanwhile we'd need 16G (if possible). The only model that would suit us that I found is: > > https:/... [16:11:57] nuria: in about 5 minutes the price jumped to $1400 (our vendor only has aftermarket card versions which may not fit nearly as well) which may need separate approval :) [16:12:29] 10Analytics, 10Operations, 10hardware-requests: GPU upgrade for stat1005 - https://phabricator.wikimedia.org/T216226 (10RobH) Can you guys (as a team) decide on a GPU card and provide me the exact model and a url for purchase? All pricing should technically take place in the S4 space, so I created a sub tas... [16:18:57] PROBLEM - eventbus grafana alert on icinga2001 is CRITICAL: CRITICAL: EventBus ( https://grafana.wikimedia.org/d/000000201/eventbus ) is alerting: EventBus POST Response Status alert. [16:22:33] RECOVERY - eventbus grafana alert on icinga2001 is OK: OK: EventBus ( https://grafana.wikimedia.org/d/000000201/eventbus ) is not alerting. [16:23:45] (03PS4) 10Joal: Refactor mediawiki-page-history computation [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/493390 (https://phabricator.wikimedia.org/T190434) [16:34:37] PROBLEM - eventbus grafana alert on icinga2001 is CRITICAL: CRITICAL: EventBus ( https://grafana.wikimedia.org/d/000000201/eventbus ) is alerting: EventBus POST Response Status alert. [16:39:31] RECOVERY - eventbus grafana alert on icinga2001 is OK: OK: EventBus ( https://grafana.wikimedia.org/d/000000201/eventbus ) is not alerting. [16:43:59] 10Analytics, 10Operations, 10hardware-requests: GPU upgrade for stat1005 - https://phabricator.wikimedia.org/T216226 (10RobH) So we aren't 100% certain from photos on T216528 if the left hand side PCIe riser has one or two slots on the back of the chassis. Chris will update T216528 with a photo to show the... [16:44:51] I am seeing something like [16:44:52] 10Analytics, 10Analytics-Kanban, 10Operations, 10ops-eqiad: confirm gpu form factor in stat1005 - https://phabricator.wikimedia.org/T216528 (10RobH) Chris, As discussed in IRC, we want to know how many slots are on this system's rear chassis. (Not slots in the riser, but mounting slots on the back.) Ple... [16:44:52] (MainThread) Failed loading schema from file:///srv/event-schemas/jsonschema/mediawiki/api/request/0.0.1.yaml: Invalid revision ID type: [16:45:00] ottomata: --^ [16:46:51] elukey: interesting! [16:47:05] in eventbus.... [16:47:06] hm [16:47:34] that is a strange error...probably not related to any problems elukey [16:47:46] that schema isn't used by eventbus...it also probablay shouldn't be loadaed [16:47:51] ack then [16:48:00] I was a bit confused :) [16:48:55] ahhh, yes its trying to load the '0.0.1' in the filename as a eventlogging schema revision id [16:49:12] but, that will only log the error on startup (or sighup, which i'm sure just happened because I merged a change). [16:49:35] i'd asasumed the alert to be still caused by those job queue cirrus search messaage too large errors? [16:55:41] I didn't find any but I checked very quickly [16:57:17] I don't know if labsdb is suffering high volume queries or anything, but we experience difficulties in sqoop :( [16:58:18] joal: I think that labsdb1011 is down for maintenance, lemme check [17:00:36] I just asked [17:00:48] what kind of difficulties joal ? [17:01:04] some sqooping jobs erratically failing :S [17:01:36] a lot of 2-tries, some error after 3 tries (meaning we'll have to manually update etc :( [17:03:54] joal: yep 1011 is down to allow data to be transferred to 1012 [17:11:13] 10Analytics, 10Operations, 10hardware-requests: GPU upgrade for stat1005 - https://phabricator.wikimedia.org/T216226 (10EBernhardson) If only one slot is confirmed, I'm not sure there is a way forward. As far as i can tell even the datacenter gpu's (MI10, MI25) require the second slot. If dual slot is confi... [17:12:32] (03PS2) 10Elukey: Add the 'centralauth' db use case in refinery utils.py [analytics/refinery] - 10https://gerrit.wikimedia.org/r/494496 (https://phabricator.wikimedia.org/T212386) [17:22:09] 10Analytics, 10Operations, 10hardware-requests: GPU upgrade for stat1005 - https://phabricator.wikimedia.org/T216226 (10Nuria) +1 to 16G test [17:23:44] 10Analytics, 10EventBus, 10Services (watching): EventGate (in k8s) takes a long time to load new schemas - https://phabricator.wikimedia.org/T217661 (10Ottomata) BTW, just checked, and I believe the 'blocking' only happens for requests that use a schema that is in the process of being compiled by AJV. This... [17:30:23] 10Analytics, 10Operations, 10vm-requests, 10Patch-For-Review, 10User-Elukey: Replace analytics-tool1003 ganeti VM with another VM with Buster - https://phabricator.wikimedia.org/T217640 (10elukey) To keep archives happy: @MoritzMuehlenhoff is currently testing the Buster debian installer for Ganeti VMs,... [18:38:25] sorry elukey i'm half doing that patch and making lunch and am in a meeting... :) [18:38:48] ottomata: :D [18:39:10] the only thing left I think is that statistics::rsync::published_datasets in profile::swap does not have the 'destination' parameter [18:39:16] the rest looks fine! [18:39:26] if the puppet compiler agrees it is +1 from me [18:43:38] Gone for tonight - See you team [19:00:17] * elukey off! [19:48:53] (03CR) 10Nuria: [C: 03+2] Add the 'centralauth' db use case in refinery utils.py [analytics/refinery] - 10https://gerrit.wikimedia.org/r/494496 (https://phabricator.wikimedia.org/T212386) (owner: 10Elukey) [20:02:55] 10Analytics, 10Analytics-Cluster: Upgrade Hive to ≥ 2.0 - https://phabricator.wikimedia.org/T203498 (10Tbayer) >>! In T203498#5001047, @Neil_P._Quinn_WMF wrote: > It looks like CDH 6.1, which [includes](https://www.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_cdh_61_packaging.html) Hive 2.1.... [20:06:02] 10Analytics, 10Analytics-Cluster: Upgrade Hive to ≥ 2.0 - https://phabricator.wikimedia.org/T203498 (10Ottomata) >> I've heard the larger plan is to move away from Hive and towards Presto > Is that indeed the plan? Not quite! We'd love to be able to use Presto in production one day, and it may well work bet... [20:08:49] 10Analytics, 10Knowledge-Integrity, 10Research, 10Epic, 10Patch-For-Review: Citation Usage: run third round of data collection - https://phabricator.wikimedia.org/T213969 (10Lauren.maggio) Just to make sure I'm tracking this correctly, it seems that some of the internal clicks are being mislabeled / inc... [20:14:15] (03PS1) 10Fdans: [wip]Create metrics matrix component [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/494546 [20:17:18] (03CR) 10jerkins-bot: [V: 04-1] [wip]Create metrics matrix component [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/494546 (owner: 10Fdans) [20:21:48] 10Analytics, 10Knowledge-Integrity, 10Research, 10Epic, 10Patch-For-Review: Citation Usage: run third round of data collection - https://phabricator.wikimedia.org/T213969 (10bmansurov) >>! In T213969#5002887, @Lauren.maggio wrote: > > Just to make sure I'm tracking this correctly, it seems that some of... [20:50:21] 10Analytics, 10Analytics-Kanban: Set a timeout for regex parsing in the Eventlogging processors - https://phabricator.wikimedia.org/T200760 (10Nuria) Rather than closing I am going to move this one to "deprioritized" for now so as not to loose track of it completely. [20:50:30] 10Analytics, 10Analytics-Kanban: Set a timeout for regex parsing in the Eventlogging processors - https://phabricator.wikimedia.org/T200760 (10Nuria) 05Declined→03Open p:05High→03Low [20:50:34] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Eventlogging's processors stopped working - https://phabricator.wikimedia.org/T200630 (10Nuria) [20:51:03] 10Analytics, 10Analytics-Kanban: Set a timeout for regex parsing in the Eventlogging processors - https://phabricator.wikimedia.org/T200760 (10Nuria) p:05Low→03Triage [20:52:41] (03CR) 10Nuria: "Let's keep this one on deprioritized for now as there is a bunch of work that has higher priority." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/471722 (https://phabricator.wikimedia.org/T164020) (owner: 10Joal) [21:50:51] I'm probably doing something stupid here, but I'm having trouble access the analytics-store mysql replica from stat1007 [21:53:51] oh, I'm googling, I guess that is deprecated [21:57:44] The docs seemed to suggest mysql -h s1-analytics-replica.eqiad.wmnet -P 3321 [21:57:48] But that didn't seem to work [22:03:46] So umm, am I missing something, or how do i get db replica access from stats? [22:10:55] ok, i found the analytics-login tool [22:27:18] 10Analytics, 10EventBus, 10Services (watching): EventGate (in k8s) takes a long time to load new schemas - https://phabricator.wikimedia.org/T217661 (10Ottomata) https://github.com/wikimedia/eventgate/commit/d048e2d79673eaf0b7788771eefb5ef1a58600b5 [22:44:12] (03CR) 10Nuria: [C: 03+2] Event(Logging) schema loader [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/492399 (https://phabricator.wikimedia.org/T215442) (owner: 10Ottomata) [22:45:54] (03CR) 10Nuria: "Sorry, did not meant to +2. I think making sure only 1 instance of each loader can exist is good. Now, this version still has the same iss" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/492399 (https://phabricator.wikimedia.org/T215442) (owner: 10Ottomata) [23:03:34] (03CR) 10Nuria: Event(Logging) schema loader (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/492399 (https://phabricator.wikimedia.org/T215442) (owner: 10Ottomata) [23:04:21] (03PS8) 10Ottomata: Event(Logging) schema loader [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/492399 (https://phabricator.wikimedia.org/T215442) [23:12:23] (03CR) 10Nuria: "Can we remove WIP if patch is working?" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/489313 (https://phabricator.wikimedia.org/T215655) (owner: 10Milimetric) [23:43:07] (03CR) 10Nuria: [C: 03+2] "Ok. The shortcoming is see is that jsonschemaloader should be passed explicitly on the constructor as a dependency rather than being creat" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/492399 (https://phabricator.wikimedia.org/T215442) (owner: 10Ottomata)