[00:00:00] is this supported? [00:10:37] i'm hacking around it by installing pip using easy_install and then installing pvenv [00:10:50] just under ~/.local [00:10:53] hope this is okay [00:15:08] actually that doesn't work since I still don't have ensurepip [00:32:47] 10Analytics, 10Analytics-Kanban, 10Better Use Of Data, 10Product-Analytics, 10Patch-For-Review: "Edit" equivalent of pageviews daily available to use in Turnilo and Superset - https://phabricator.wikimedia.org/T211173 (10Nuria) pinging @Neil_P._Quinn_WMF cause i think some of the concerns listed on tick... [01:39:02] groceryheist: would `virtualenv` work? [01:39:32] I believe it works on the stat machines [01:39:44] https://virtualenv.pypa.io/en/stable/userguide/#usage [02:15:15] a-team: I seem to have deleted my base venv on SWAP 😧 Can anyone help reset it? [02:17:16] it seems like my jupyter instance will have to be stopped and the hub restarted... [02:46:51] 10Analytics, 10Analytics-Data-Quality, 10Product-Analytics: Many revision events in mediawiki_history have missing page and namespace information - https://phabricator.wikimedia.org/T221338 (10Neil_P._Quinn_WMF) [02:48:03] 10Analytics, 10Analytics-Data-Quality, 10Product-Analytics: Many revision events in mediawiki_history have missing page and namespace information - https://phabricator.wikimedia.org/T221338 (10Neil_P._Quinn_WMF) [02:48:05] 10Analytics-Kanban, 10Product-Analytics: Address data quality issues in the mediawiki_history dataset - https://phabricator.wikimedia.org/T204953 (10Neil_P._Quinn_WMF) [06:27:31] neilpquinn: o/ - we can surely help for the notebook - which one are you referring to (1003/4) ? Because I can see your notebook running fine (with venv) on 1003 [06:34:42] groceryheist: o/ - you can create a python 3 venv on stat1006 with python3 -m venv name_of_the_venv [06:35:06] and then activate it as always (nit: remember to set https://wikitech.wikimedia.org/wiki/HTTP_proxy before using pip) [06:35:14] ping us if you don't manage to do it [06:38:26] joal: bonjour! afaics all good from the CDH upgrade side? [06:43:39] stat1006 with python3 -m venv name_of_the_venv [06:43:47] The virtual environment was not created successfully because ensurepip is not [06:43:50] available. On Debian/Ubuntu systems, you need to install the python3-venv [06:43:53] package using the following command. [06:43:56] apt-get install python3-venv [06:43:56] ^ I got that error [06:43:59] You may need to use sudo with that command. After installing the python3-venv [06:44:02] package, recreate your virtual environment. [06:44:04] Failing command: ['/srv/home/nathante/editquality/name_of_the_venv/bin/python3', '-Im', 'ensurepip', '--upgrade', '--default-pip'] [06:44:08] elukey: ^ [06:55:10] strange I have executed it before writing the command [06:55:12] lemme retry [06:57:59] now it doesn't work :D [06:58:15] I'll add python3-venv in a second to all the stat boxes [06:58:17] really weird [07:04:55] groceryheist: python3-venv should now be on all the stat boxes [07:04:58] can you retry? [07:06:27] it works now! [07:06:29] thank you! [07:06:34] gooood! [07:06:53] remember to use the http_proxy pointed out above [07:07:03] * groceryheist nods [07:07:11] i figured that out already [07:07:44] i was working with easy_install with prefix=~/.local [07:08:11] sweet thanks again [07:10:48] thank you! [07:17:31] elukey: Hello :) [07:17:54] elukey: no alert, looks like the flawless was a real flawless - congrats elukey :) [07:18:49] * elukey dances [07:19:26] * joal is still a bit afraid of moving to 6 [07:22:55] especially given the fact that it is supported on ubuntu :( [07:23:56] meh [07:32:43] Which Ubuntu release? [07:39:12] moritzm: Xenial IIRC [07:41:08] that's more or less the base line of what's in stretch and given that we've discovered that there are deb-src for cdh we can probably just rebuild that without much overhead [07:42:32] moritzm: from https://www.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_os_requirements.html#cdh_cm_supported_os (that is for 6.0 enterprise but should be the same) seems that 18.04 is also supported [07:44:27] ack [07:53:29] moritzm: would it be feasible to import all the packages somewhere and rebuild them for say buster-wikimedia? [07:57:38] yeah, it's pretty straightforward: [07:57:43] - on boron set the proxy [07:58:08] - dget $PATH_TO_CLOUDERA/foo.dsc [07:58:30] - bump the build versions with "dch" [07:58:37] - DIST=buster pdebuild [07:59:21] on install1002: rsync rsync://boron.eqiad.wmnet/pbuilder-result/buster-wikimedia/*foo* . [07:59:30] reprepro include etc. [08:00:14] i'd expect their packages to be fairly downwards compatible as they will also support old distros, do I doubt any code changes are needed at all [08:00:59] nice! [08:01:12] going to add these info to the related task [08:01:29] if this is the case, I'd feel way more comfortable to use CDH6 [08:02:15] it's useful anyway as it will also enable us to patch e.g. security issues without having to wait for the next CDH release [08:05:06] the above procedure is also good, before deciding to upgrade, to test if all the packages builds correctly on buster [08:08:28] one thing to consider for buster is that it has Java 11 instead of 8 [08:10:31] ah! [08:11:33] per https://usn.ubuntu.com/3949-1/ Ubuntu 18.04 also ships 11, though, so if that is supported by Cloudera it should be fine [08:11:45] yep definitely [08:17:05] 10Analytics, 10Product-Analytics, 10Readers-Web-Backlog: strange virtual pageview jump on 2019-04-16-03 - https://phabricator.wikimedia.org/T221181 (10phuedx) I've been noodling on proposing that @Stashbot and/or scap create [annotations in Grafana](https://grafana.com/docs/reference/annotations/). I think s... [08:17:08] 10Analytics, 10Product-Analytics, 10Readers-Web-Backlog: strange virtual pageview jump on 2019-04-16-03 - https://phabricator.wikimedia.org/T221181 (10phuedx) Also! Thanks, everyone! [08:32:26] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Upgrade analytics cluster to Cloudera CDH 5.16.1 - https://phabricator.wikimedia.org/T218343 (10elukey) [08:32:37] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Upgrade analytics cluster to Cloudera CDH 5.16.1 - https://phabricator.wikimedia.org/T218343 (10elukey) Upgrade done, no errors reported! [08:40:19] 10Analytics, 10Analytics-Cluster, 10User-Elukey: Update to CDH 6 or other up-to-date Hadoop distribution - https://phabricator.wikimedia.org/T203693 (10elukey) Had an interesting chat with Moritz today about CDH6 and Debian. The following procedure could be used to import all the CDH6 packages and rebuild th... [08:55:25] going to reboot the kafka1012-23 hosts (kernel + openjdk upgrades) [09:08:11] (03PS1) 10Joal: Fix mediawiki-history user event join [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/504834 [09:08:12] ack elukey [09:51:45] (03PS1) 10Elukey: Swap hdfs user with analytics [analytics/refinery] - 10https://gerrit.wikimedia.org/r/504846 (https://phabricator.wikimedia.org/T220971) [09:52:39] joal: for your joy --^ :P [09:56:02] 10Analytics, 10Analytics-Kanban, 10EventBus, 10Operations, and 5 others: Create schema[12]00[12] (schema.svc.{eqiad,codfw}.wmnet) - https://phabricator.wikimedia.org/T219556 (10akosiaris) >>! In T219556#5120409, @Ottomata wrote: > ganeti1001, 1002 and 2001 have been installed. I dunno what's up with ganet... [10:13:57] /o\ man that cr [10:14:46] ahahahha [10:17:50] I am reviewing things to change and it is not as straightforward as I thought [10:18:08] we probably want to keep using 'hdfs' as user for admin-related tasks like creat/drop/etc.. from hdfs [10:18:25] but 'analytics' only for anything that runs a job on yarn [11:17:43] kafka analytics cluster rebooted [11:17:45] all good [11:17:55] great :) [11:49:25] * elukey lunch! [11:51:05] 10Analytics, 10Operations, 10User-Elukey: Investigate if a Prometheus exporter for the AMD GPU(s) can be easily created - https://phabricator.wikimedia.org/T220784 (10elukey) 05Openβ†’03Stalled Upstream told me that they are already working on a more generic version of my pull request (see gh issue), and t... [11:51:07] 10Analytics, 10Operations, 10Research-management, 10Patch-For-Review, 10User-Elukey: Remove computational bottlenecks in stats machine via adding a GPU that can be used to train ML models - https://phabricator.wikimedia.org/T148843 (10elukey) [13:09:16] going to roll restart cassandra for openjdk upgrades [13:09:21] (on aqs) [13:28:27] brb [13:46:00] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Discovery, and 4 others: Rewrite Avro schemas (ApiAction, CirrusSearchRequestSet) as JSONSchema and produce to EventGate - https://phabricator.wikimedia.org/T214080 (10Ottomata) We are good to go on the CirrusSearch php extension change. I'd lik... [13:49:47] elukey: when you have time would love some thoughts on https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/504787/ [13:56:24] ottomata: sure! Just went through it quickly, going to do another pass in a bit (after the cassandra roll restart) [13:56:27] is it ok? [13:56:47] ya! [14:09:00] AQS roll restart should be done [14:11:05] dsaez, neilpquinn, ottomata, joal: btw I had a 3.0G ~/.cache on notebook1003 which I had caches from various python libraries and/or jupyter. so just a heads-up that's where a bulk of your homedir disk usage may be coming from, if you want to make elukey happy :) [14:11:35] :) [14:13:24] hello team, deploying source and cluster now [14:14:35] every time I run "rm " I can feel elukey smiling [14:15:16] ahahahahha [14:16:15] except if you run `sudo rm -rf /` ;P [14:24:44] (03PS1) 10Fdans: Update changelog.md for v0.0.86 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/504883 [14:25:58] (03CR) 10Fdans: [V: 03+2 C: 03+2] Update changelog.md for v0.0.86 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/504883 (owner: 10Fdans) [14:29:39] !log releasing version 0.0.86 of refinery source to maven [14:29:41] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [14:43:04] ottomata elukey for some reason it's not transfering the files to the maven repo, it says it's not authorized [14:43:04] https://integration.wikimedia.org/ci/job/analytics-refinery-release/170/console [14:44:28] hm [14:46:09] ha, i am also unauthorized! [14:46:13] in jenkins to do anything. [14:47:23] checking [14:49:25] elukey: have we deployed since archiva ldap stuff has changed? [14:49:32] i cannot log into archiva using archiva-ci anymore [14:49:54] yes for sure we have deployed [14:49:58] it happened a long time ago [14:50:26] "Password Expired, You must change your password." [14:50:28] there you go [14:50:29] :D [14:50:30] ah! [14:50:38] i'm in there too, i'm going to try to reset it to the originial one [14:50:43] because I can't do anythiign in jenkins... [14:51:05] Your password cannot match any of your previous 6 password(s). [14:51:06] grr [14:51:17] well that is annoying! [14:51:17] can't win [14:51:26] ottomata: change the password 7 times? [14:51:31] hahah [14:52:32] elukey: can you access https://integration.wikimedia.org/ci/credentials/ [14:52:32] ? [14:52:57] nope [14:53:05] I think that only releng can [14:53:09] i used to be able to [14:53:11] making ticket... [14:56:26] I am asking to other people in the meantime [14:57:56] i poked in #releng, no word yet [14:57:57] https://phabricator.wikimedia.org/T221379 [14:58:09] fdans: sorry we now blocked until ^ [14:58:55] oh no the choo choo train is stopped [14:59:07] thank you for submitting it ottomata :) [15:10:33] ok we should be able to unblock the train now [15:11:19] ops really have supa-powa... Unblocking a train... [15:14:22] elukey I'm having problems when reading some dumps on notebook1003: OSError: [Errno 30] Read-only file system [15:14:51] I don't understand [15:15:26] dsaez: what are you trying to do? [15:16:28] the error msg sounds like you are trying to write to the mountpoint [15:18:12] hmm, weird, I'm processing the xml dumps, but get problems with eswiki but not with cawiki, I'll check again [15:21:24] elukey: thank youuuu! [15:22:09] dsaez: let me know what kind of operation you are trying to do so I can try to repro [15:22:43] !log restarting release of version 0.0.86 of refinery source to maven [15:22:45] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [15:22:57] fdans: nono wait still need to add the password :D [15:23:03] I am waiting for andrew [15:23:13] oh shit [15:23:14] canceling [15:23:37] aborted [15:24:09] I am re-change the password and apply it to jenkins so you are unblocked [15:25:25] fdans: let's retry now [15:25:33] retrying [15:25:45] ottomata: re-changed the pass in archiva to unblock Fran [15:25:57] (also uploaded it to jenkins) [15:26:25] oh great! [15:28:28] elukey I'm using the mwxml parser [15:29:52] elukey https://gist.github.com/digitalTranshumant/229711466c912462aa9cb17319a3be13 [15:31:30] dsaez: are you running it from your home dir? Or maybe by mistake while in the dumps dir? [15:32:06] this a ln to the dumps dir [15:32:23] lrwxrwxrwx 1 dsaez wikidev 62 Aug 14 2018 dumps -> /mnt/nfs/dumps-labstore1007.wikimedia.org/xmldatadumps/public/ [15:33:46] dsaez: do you get the line tha triggers the OSError exception? [15:34:11] ---> 43 for result in mwxml.map(process_dump, paths, threads = 168): [15:36:23] 168 threads on notebook1003? :D [15:36:29] jejeje [15:36:33] yes [15:36:41] I'll chage that :D [15:36:54] I wrote that code for stat1007 [15:37:19] I am wondering if Aaron's library mwxml's map uses some temp file or similar while processing [15:40:05] but with 'cawiki' works good [15:40:27] anoyhow, cawiki has one file, so not real parallel processing [15:40:30] (03CR) 10Joal: "All good on the ones already done, some miss (property to be added, not yet present):" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/504846 (https://phabricator.wikimedia.org/T220971) (owner: 10Elukey) [15:42:21] fdans: how is it going? [15:43:40] elukey: aaaahhh yea, now it's failing because 0.0.86 already exists [15:44:01] elukey, is weird, I've used the same code in the past in other machines and it works [15:45:38] elukey, I'm running the same code now in stat1007 without problems [15:45:59] elukey should I do the dodgy rewriting of history or skip a version? [15:53:32] (03PS1) 10Joal: Remove leftover files in oozie folders [analytics/refinery] - 10https://gerrit.wikimedia.org/r/504914 [15:54:42] fdans: no idea, let's ask to the other people during standup [15:58:46] elukey, the only difference that I see between stat1007 and notebook1003 (for this use case) is that I'm using python 3.6 in stat1007 and I think notebook is python 3.5 [15:59:28] elukey, but I think is something related with the virtual env https://github.com/pypa/virtualenv/issues/209 [16:01:01] dsaez: do you have the full stack trace? [16:01:11] I thought it was related to xmldumps' path [16:01:36] elukey, I'm not sure what you mean by full stack here [16:01:51] dsaez: the stacktrace of the exception [16:17:03] 10Analytics, 10Analytics-Data-Quality, 10Product-Analytics: Many revision events in mediawiki_history have missing page and namespace information - https://phabricator.wikimedia.org/T221338 (10fdans) p:05Triageβ†’03High [16:17:13] 10Analytics: Decide: start_timestamp for mediawiki history - https://phabricator.wikimedia.org/T220507 (10fdans) p:05Triageβ†’03High [16:19:43] 10Analytics: PHP serialization can contain null bytes - https://phabricator.wikimedia.org/T221283 (10fdans) p:05Triageβ†’03Normal [16:19:55] 10Analytics, 10Analytics-Kanban: Decide: start_timestamp for mediawiki history - https://phabricator.wikimedia.org/T220507 (10Milimetric) [16:21:41] 10Analytics, 10Analytics-Kanban, 10Discovery, 10EventBus, 10Services (watching): Make sure any monolog + eventbus fields with binary data are base64 encoded - https://phabricator.wikimedia.org/T221390 (10Ottomata) [16:22:05] 10Analytics, 10Analytics-EventLogging, 10MW-1.34-release, 10Technical-Debt (Deprecation): Remove deprecated EventLogging schema modules - https://phabricator.wikimedia.org/T221281 (10Milimetric) @Krinkle: so how is this going to move forward? Do you search around for all uses of `schema.Something` and mak... [16:22:07] 10Analytics, 10EventBus, 10MediaWiki-Maintenance-scripts, 10WMF-JobQueue, 10Wikimedia-General-or-Unknown: showJobs.php maintenance script useless and misleading in production - https://phabricator.wikimedia.org/T221224 (10fdans) [16:22:50] 10Analytics: Improve mediawiki-user-history bot-by-name regex - https://phabricator.wikimedia.org/T221114 (10fdans) p:05Triageβ†’03Normal [16:23:48] 10Analytics: Status of analytics/limn-*-data git repositories? - https://phabricator.wikimedia.org/T221064 (10fdans) a:03Milimetric [16:23:52] 10Analytics: Status of analytics/limn-*-data git repositories? - https://phabricator.wikimedia.org/T221064 (10fdans) p:05Triageβ†’03High [16:26:29] elukey, error added in the same gist https://gist.github.com/digitalTranshumant/229711466c912462aa9cb17319a3be13 [16:33:23] ottomata: puppet is failing on 17 out of the 19 VMs in the analytics VPS project. Could you (or someone) have a look at that? [16:43:20] (note that VMs that don't run puppet are likely to just break forever anytime I make cloud-wide changes) [16:43:47] milimetric: I confirm the data generated using the last patch passes the checker (it generates errors, but only expected ones :) [16:48:18] elukey: when I ssh into SWAP and go to http://localhost:8000/user/neilpquinn-wmf/lab, I get `Cannot find template: "index.html" in "/srv/home/neilpquinn-wmf/venv/share/jupyter/lab/static"`. And my `~/venv` directory is empty, so I assume I accidentally deleted it when trying to clear up large files πŸ˜› [16:48:23] does that match what you're seeing? [16:48:56] (this is notebook1003) [16:57:01] joal do you know how to revert maven's tags? the current scm tag already exists [16:57:01] https://integration.wikimedia.org/ci/job/analytics-refinery-release/173/console [16:57:20] fdans: IIRC you need to push tabs [16:57:27] tags sorry [17:03:06] stat1005 doesn't like me :( [17:03:40] elukey are you still around? [17:03:42] dsaez: stat1005 has been deprecated for quite some time now if I remember correctly [17:03:53] ok [17:03:54] dsaez: and replaced by stat1007 [17:04:00] got you. [17:10:00] dsaez: yep stat1005 is currently a testing host for GPU :) [17:10:45] oook [17:10:56] haven you seen the error on notebook? [17:12:37] still in a meeting, going to check in a few [17:16:09] joal: can we batcave for a second? I've messed something up [17:16:29] sure [17:16:50] fdans: --^ [17:19:08] dsaez: from the look of the stacktrace it seems as some file (locking?) tries to be created on a read only fs (the xml dump one) [17:20:11] neilpquinn: all right lemme try something [17:20:30] elukey, got you but apparently it's a virtualenv issue [17:20:54] neilpquinn: can you try to access your notebook? [17:22:03] dsaez: it might be but the stack traces are different.. (the issue in the report on gh seems to start into venv's stuff, this one seems to be generated by the mwxml lib) [17:22:17] maybe follow up wit Aaron and see what he thinks about? [17:23:50] elukey, ok, but given that works good on stat1007 I think is something related with the server, not package [17:24:02] halfak are you around? [17:24:13] hey! Yes. [17:24:16] dsaez: ah ok sorry this bit wasn't clear to me, yes in this case you are probably right! [17:24:20] I have 6 minutes. What's up? [17:24:39] * halfak tries to find the beginning of scrollback that is relevant [17:25:07] neilpquinn: [17:25:08] elukey@notebook1003:~$ ls /srv/home/neilpquinn-wmf/venv [17:25:09] bin etc include lib lib64 pyvenv.cfg shar [17:25:11] better now :) [17:25:33] dsaez, o/ [17:25:57] halfak getting an error with xmldump package, do you know if the package creates any lock file? [17:26:12] It shouldn't. [17:26:16] Are you using mwxml? [17:26:27] yes [17:26:29] https://gist.github.com/digitalTranshumant/229711466c912462aa9cb17319a3be13 [17:26:50] What's the error? [17:26:59] Oh I see it at the bottom [17:27:17] yep [17:27:18] Oh! that's internal multiprocessing stuff. [17:27:27] WEIRD! [17:27:38] That's internal to python's standard library. [17:28:04] elukey, halfak, problem solved by changing the folder permission to 777 [17:28:11] weird [17:28:13] werid! [17:28:27] ha! I wonder if Stack Overflow knows about this. [17:29:04] https://github.com/saltstack/salt/issues/41092 [17:29:17] "/dev/shm needs to be rw and can't run without that. So the only answer would be to remount /dev/shm." [17:29:36] ottomata: can you join us in the bc a minute? [17:29:40] stack overflow ... [17:29:47] <3 [17:29:56] Expert programmers use google. :D [17:30:14] "WTF is this error? Someone must have seen this before and figured it out!" [17:35:25] nice! [17:35:39] going off! [17:35:43] o/ [17:35:44] bye elukey [17:39:15] fdans: ya hyea [17:42:27] elukey: I'm back! Thank you so much! Out of curiosity, what did you do? [17:42:40] *it's back! [17:44:57] (he’s gone for the night, but he’ll prolly answer tomorrow) [17:50:05] (03PS2) 10Joal: Fix mediawiki-history user event join [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/504834 [17:52:14] (03CR) 10jerkins-bot: [V: 04-1] Fix mediawiki-history user event join [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/504834 (owner: 10Joal) [17:52:55] WAT? [17:53:38] joal: I'm seeing the same thing... build is failing on master [17:53:47] Aouch :0 [17:53:52] ok [17:54:19] checking that [17:55:07] joal: there's a strange warning at the beginning here: [17:55:07] https://integration.wikimedia.org/ci/job/analytics-refinery-release/174/console [18:00:32] fdans: patch is ready, I wait for the local build to succeed before sending for CR [18:00:55] joal: gotcha, thank you [18:04:03] (03PS1) 10Joal: Fix HiveExtension failing test [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/504932 [18:04:12] fdans: --^ [18:04:40] joal: does this have a CI check? [18:05:06] fdans: we can wait for that, you can even C+2 and jenkins will merge :) [18:05:35] (03CR) 10Fdans: [C: 03+2] Fix HiveExtension failing test [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/504932 (owner: 10Joal) [18:10:54] (03CR) 10Joal: [C: 03+2] "To trigger a new validation, and merge" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/504932 (owner: 10Joal) [18:11:02] Mabe? [18:11:18] Actually: manually merged :) [18:11:49] fdans: you should be good to go [18:12:06] thank you joseph [18:18:33] (03PS1) 10Fdans: Update changelog.md for v0.0.86 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/504934 [18:19:06] (03CR) 10Fdans: [V: 03+2 C: 03+2] Update changelog.md for v0.0.86 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/504934 (owner: 10Fdans) [18:29:32] Gone for diner [18:29:48] ottomata: I'm getting again the unauthorized message :( [18:29:52] https://integration.wikimedia.org/ci/job/analytics-refinery-release/175/console [18:30:18] whaaa [18:31:06] hmmm i wonder what elukey changed the password to! [18:35:59] fdans: ok, i just changed and upataed pw again... [18:36:00] try again? [18:36:03] i'm also watching logs now [18:36:26] can somebody install some aspell packages on stat1006 for me? [18:36:39] is there a process for requesting this? [18:37:05] groceryheist: we'd neeed to puppetize, ya, make a phab ticket, tag analytics and assign to me, if the packages exist in deb stretchh i can probably do it real quick [18:37:15] sweet thanks [18:40:08] ottomata: trying again [18:52:58] ottomata: finally worked :_) [18:53:43] !log Release of v0.0.86 in maven succeeded [18:53:45] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [18:55:24] !log updated jars [18:55:25] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [18:57:30] woooowww [18:57:32] nice fdans [18:57:59] so glad [19:03:09] 10Analytics, 10Analytics-Kanban, 10Discovery, 10EventBus, and 2 others: Make sure any monolog + eventbus fields with binary data are base64 encoded - https://phabricator.wikimedia.org/T221390 (10Ottomata) @bd808 this means that e.g. params with binary string values will end up looking like this: `"data:ap... [19:07:00] (03PS1) 10Fdans: Update jar version for webrequest load [analytics/refinery] - 10https://gerrit.wikimedia.org/r/504949 [19:07:07] ottomata: can you take a quick look? ^ [19:07:22] I'm paranoid and don't trust myself [19:10:53] looks right fdans, the job will need restarted too [19:11:01] yeap [19:11:05] do you want to do this now? [19:11:07] thank youuu [19:11:19] yeah I'll do that now [19:12:06] (03CR) 10Fdans: [V: 03+2 C: 03+2] Update jar version for webrequest load [analytics/refinery] - 10https://gerrit.wikimedia.org/r/504949 (owner: 10Fdans) [19:13:30] i guess i mean, is your evening on a thursday the time when you want to do that? [19:13:52] are you prepared to babysit it fdans ? :D [19:15:06] you fill my heart with doubt ottomata [19:15:23] luca is not here, he does that for me [19:15:27] so i have to fill in for him [19:17:16] okaaaay I'll do it monday ottomata [19:17:43] I'm tired and sad [19:18:18] better to be tired and sad than tired and sad and frantic [19:18:24] :) [19:46:23] 10Analytics: Status of analytics/limn-*-data git repositories? - https://phabricator.wikimedia.org/T221064 (10hashar) > hashar: these actually don't have anything to do with limn, they all hold configuration for reportupdater reports. We would rename them but that's not possible in gerrit, right? Indeed Gerrit... [19:46:59] 10Analytics, 10Continuous-Integration-Config, 10Release-Engineering-Team (Watching / External): Status of analytics/limn-*-data git repositories? - https://phabricator.wikimedia.org/T221064 (10hashar) [19:59:28] 10Analytics, 10Product-Analytics: Metrics request on portal namespace usage - https://phabricator.wikimedia.org/T205681 (10kzimmerman) 05Openβ†’03Stalled Hi @AfroThundr3007730, I'm Head of Product Analytics (joined Wikimedia Foundation toward the end of 2018). Tilman is no longer at the Foundation and I'm wo... [20:00:05] 10Analytics, 10Product-Analytics: Metrics request on portal namespace usage - https://phabricator.wikimedia.org/T205681 (10kzimmerman) a:05Tbayerβ†’03None [21:00:53] 10Analytics: Puppet broken on most VMs in the 'analytics' project - https://phabricator.wikimedia.org/T221408 (10Andrew) [21:01:03] 10Analytics: Puppet broken on most VMs in the 'analytics' project - https://phabricator.wikimedia.org/T221408 (10Andrew) p:05Triageβ†’03High [21:02:39] 10Analytics: Puppet broken on most VMs in the 'analytics' project - https://phabricator.wikimedia.org/T221408 (10Andrew) btw, you might want to clean up membership in your project as well -- there are a lot of admins that are former WMF staff, absent for several years. [21:04:16] 10Analytics: Puppet broken on most VMs in the 'analytics' project - https://phabricator.wikimedia.org/T221408 (10Andrew) For your convenience... https://tools.wmflabs.org/openstack-browser/project/analytics [23:17:50] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Discovery, and 4 others: Rewrite Avro schemas (ApiAction, CirrusSearchRequestSet) as JSONSchema and produce to EventGate - https://phabricator.wikimedia.org/T214080 (10mobrovac) [23:17:58] 10Analytics, 10Analytics-Kanban, 10Discovery, 10EventBus, and 2 others: Make sure any monolog + eventbus fields with binary data are base64 encoded - https://phabricator.wikimedia.org/T221390 (10mobrovac) 05Openβ†’03Resolved p:05Triageβ†’03High Fix deployed, all looking good.