[00:04:11] <wikibugs>	 Analytics, MediaWiki-API, Reading-Infrastructure-Team: Add pageview stats to the action API - https://phabricator.wikimedia.org/T144865#2631418 (Tgr)
[00:06:17] <wikibugs>	 Analytics, MediaWiki-API, Reading-Infrastructure-Team: Add pageview stats to the action API - https://phabricator.wikimedia.org/T144865#2612941 (Legoktm) Would this be a proxy to the pageview API or would we store some of the data in the MW database?
[00:51:53] <wikibugs>	 Analytics, MediaWiki-API, Reading-Infrastructure-Team: Add pageview stats to the action API - https://phabricator.wikimedia.org/T144865#2631476 (Tgr) Some open questions: * The pageview REST API deals with URLs; the action API deals with pages. There are many ways in which the two do no align (page m...
[00:52:47] <wikibugs>	 Analytics, MediaWiki-API, Reading-Infrastructure-Team: Add pageview stats to the action API - https://phabricator.wikimedia.org/T144865#2631478 (Tgr) @Legoktm I hope that non-answers your question :)
[00:55:42] <wikibugs>	 Analytics, MediaWiki-API, Reading-Infrastructure-Team: Add pageview stats to the action API - https://phabricator.wikimedia.org/T144865#2631479 (Tgr)
[01:20:50] <wikibugs>	 Analytics, MediaWiki-API, Reading-Infrastructure-Team: Add pageview stats to the action API - https://phabricator.wikimedia.org/T144865#2631487 (Tgr) Also, if this is written as an extension (which it probably will be), how (and to what extent) should we avoid making it Wikimedia-specific? MediaWiki...
[01:23:41] <wikibugs>	 Analytics, MediaWiki-API, Reading-Infrastructure-Team: Add pageview stats to the action API - https://phabricator.wikimedia.org/T144865#2631489 (Legoktm) I was told that the pageviews API was Wikimedia-specific, so I created the WikimediaPageViewInfo extension for displaying its counts on action=info...
[01:33:42] <wikibugs>	 Analytics, MediaWiki-API, Reading-Infrastructure-Team: Add pageview stats to the action API - https://phabricator.wikimedia.org/T144865#2631511 (Tgr) Should we also expose unique devices data? I guess there is no reason not to; it's per-site only so most of the complexity with pageview data does not...
[04:06:14] <wikibugs>	 Analytics, Dumps-Generation, Security: Pageview dumps incorrectly formatted, looks like a result of possibly malicious activity - https://phabricator.wikimedia.org/T144100#2588550 (Bawolff) "<" and ">" are invalid character to use in titles, and should result in a 400 status code. Does the pageviews...
[08:11:47] <wikibugs>	 Analytics, Operations: kafkatee's logrotate/syslog default pkg files needs to be removed - https://phabricator.wikimedia.org/T145490#2631941 (elukey)
[10:35:49] <mforns>	 hi team
[10:36:10] <elukey>	 o/
[10:38:20] <joal>	 hey mforns !
[10:38:33] <mforns>	 hello guys!
[11:10:00] <elukey>	 joal,mforns: can you try to ssh to druid1001.eqiad.wmnet?
[11:10:07] <mforns>	 elukey, sure
[11:10:11] <elukey>	 you are now in the druid-admins group
[11:10:33] <mforns>	 woohoo! yes :]
[11:10:34] <joal>	 elukey: YAY, works for me :)
[11:10:46] <elukey>	 good :)
[11:10:49] <joal>	 Thanks elukey !
[11:10:54] <mforns>	 thx!
[11:10:57] <elukey>	 I am going to send an email with a recap, you can do a lot now :)
[11:11:07] <elukey>	 curiosity - can you try journalctl?
[11:11:23] <joal>	 No journal files were found.
[11:11:27] <joal>	 elukey: --^
[11:11:35] <elukey>	 something like sudo journalctl -u druid-overlord.service ?
[11:11:58] <joal>	 elukey: no work :(
[11:12:10] <joal>	 elukey: asks for password, and without sudo no journal
[11:12:25] <elukey>	 ah ok I thought it wasn't taken care by a patch that Marko worked on for services
[11:12:28] <elukey>	 will add it
[11:13:06] <joal>	 elukey: As you've noticed, I don't know how to use journalctl, so for me it's not that important ;)
[11:13:44] <mforns>	 joal, btw, the changes we did in scala, work!
[11:14:18] <mforns>	 I still changed a <= to just <, because there was a shift in the states, but now it looks perfect
[11:14:28] <joal>	 mforns: I didn't check, wanted to but got to do other things
[11:14:32] <joal>	 mforns: That's great :)
[11:14:36] <joal>	 mforns: data looks reaso
[11:14:46] <mforns>	 yes
[11:14:47] <joal>	 again: mforns: data looks reasonably correct?
[11:14:57] <joal>	 that's really great :)
[11:15:09] <mforns>	 joal, the Billz example looks really good, which is a good sign
[11:15:15] <joal>	 YAY
[11:15:44] <mforns>	 joal, I should check now that the user side makes sense, and I think we'll be good
[11:15:54] <joal>	 mforns: sounds awesome!
[11:16:34] <joal>	 also mforns, since we have changed the code quite a bit, maybe we can try to rerun the thing for enwiki as well, in case it changes something :)
[11:16:52] <mforns>	 joal, sure
[11:17:08] <mforns>	 joal, how much memory did you use per node?
[11:17:25] <joal>	 mforns: tried with up to 32G per worker I think
[11:17:55] <joal>	 but mforns, other thing I didn't try is to raise partition number
[11:18:03] <joal>	 smaller splits
[11:18:13] <joal>	 Not sure it'll do, but who knows
[11:18:20] <mforns>	 joal, aha, ok, and driver memory?
[11:18:27] <joal>	 mforns: 8G
[11:18:39] <joal>	 errors were memory errors on workers
[11:18:45] <mforns>	 how many partitions did you use with 32 gigs?
[11:19:11] <joal>	 mforns: I'll also try to load the simplewiki data in druid, see how it looks using pivot :D
[11:19:23] <mforns>	 joal, awesome!
[11:34:38] <grrrit-wm>	 (CR) Thiemo Mättig (WMDE): [C: 1] "I still can not merge in this repository. ;-) +2, the change is correct and my question is resolved. Thanks for the explanation and the mi" [analytics/statsv] - https://gerrit.wikimedia.org/r/308959 (owner: Addshore)
[11:34:45] * elukey lunch!
[12:04:47] <grrrit-wm>	 (PS4) Mforns: Add re-run script [analytics/reportupdater] - https://gerrit.wikimedia.org/r/308977 (https://phabricator.wikimedia.org/T117538)
[12:07:44] <grrrit-wm>	 (CR) Mforns: [C: -1] "The dependency needs to be deployed first." [analytics/reportupdater] - https://gerrit.wikimedia.org/r/308977 (https://phabricator.wikimedia.org/T117538) (owner: Mforns)
[12:55:17] <wikibugs>	 Analytics-Kanban: Compile a request data set for caching research and tuning - https://phabricator.wikimedia.org/T128132#2632731 (Danielsberger) Open>Resolved I have finally been able to take a look at the data set: it's great - exactly what we need to analyze caching performance.  Below are the over...
[13:38:05] <elukey>	 is there any soul with a bit of compassion that can answer my questions about the pivot UI? :D
[13:38:30] <joal>	 elukey: I can always try :)
[13:40:38] <joal>	 elukey: But it has nothing to do with compassion ;)
[13:41:07] <elukey>	 ahahhaah
[13:41:25] <elukey>	 so it has probably something to do with my understanding of how we deploy nodejs apps
[13:41:53] <elukey>	 we now have https://gerrit.wikimedia.org/r/#/admin/projects/analytics/pivot/deploy and https://gerrit.wikimedia.org/r/#/admin/projects/analytics/pivot
[13:41:56] <elukey>	 thanks to Dan
[13:42:50] <elukey>	 my understanding is that /pivot/deploy contains nodejs modules and it uses the /pivot repo as submodule in its src dir
[13:43:00] <ottomata>	 elukey:  that's my understanding too
[13:43:05] <elukey>	 so we deploy the /pivot/deploy repo and we are good
[13:43:11] <elukey>	 hello ottomata !
[13:43:11] <joal>	 elukey: if it works the same way restbase does, that's the thing
[13:43:38] <elukey>	 so service-runner needs an entry point
[13:43:55] <elukey>	 and the one currently used in our screen session is bin/pivot
[13:44:11] <elukey>	 that calls build/server/www.js
[13:44:44] <elukey>	 but I have no idea how it is created
[13:44:50] <ottomata>	 hm
[13:44:56] <ottomata>	 build/server/www.js doesn't exist?
[13:45:26] <elukey>	 it does in your repo on stat1002
[13:45:33] <elukey>	 but I don't find it in the gerrit one..
[13:46:00] <ottomata>	 elukey:  i probably ran the instructions in the pivot readme
[13:46:06] <ottomata>	 for dev mode
[13:46:48] <ottomata>	 uh, what's the pivot github repo now?
[13:46:58] <elukey>	 ahhh now I found it
[13:47:03] <elukey>	 npm install
[13:47:19] <elukey>	 and gulp
[13:47:30] <ottomata>	 aye
[13:53:46] <elukey>	 and then the next step would be something like https://wikitech.wikimedia.org/wiki/Analytics/AQS#Update_the_deploy_repository
[14:01:00] <ottomata>	 joal:  want to come to dba meeting?
[14:01:27] <ottomata>	 milimetric:  ^ ?
[14:02:11] <milimetric>	 aww damn, I feel awful but I really do.  Yeah, ok
[14:02:24] <ottomata>	 s'ok you don't have to!
[14:02:26] <ottomata>	 if you want to: https://hangouts.google.com/hangouts/_/wikimedia.org/analytics-dba
[14:02:42] <ottomata>	 y/n ?
[14:03:30] <milimetric>	 brt
[14:04:49] <joal>	  hoooo, forgot about that
[14:04:53] <joal>	 joiniong !
[14:43:59] <joal>	 elukey, ottomata, question for you
[14:44:04] <ottomata>	 woah, check this out:
[14:44:09] <ottomata>	 http://debezium.io/
[14:44:12] <ottomata>	 particularly
[14:44:38] <ottomata>	 grr, i can't link, but
[14:44:38] <ottomata>	 http://debezium.io/docs/tutorial/
[14:44:47] <ottomata>	 search for 'Here’s that new event’s value formatted to be easier to read:
[14:44:47] <ottomata>	 '
[14:45:04] <ottomata>	  we see no changes in the schema section and a couple of changes in the payload section:
[14:45:04] <ottomata>	 	•	The op field value is now u, signifying that this row changed because of an update
[14:45:04] <ottomata>	 	•	The before field now has the state of the row with the values before the database commit
[14:45:05] <ottomata>	 	•	The after field now has the updated state of the row, and here was can see that the first_name value is now Anne Marie.
[14:45:13] <joal>	 elukey, ottomata: Do you know if pivot ui keeps datasource metadata in cache or something?
[14:45:49] <ottomata>	 i think it writes to a file or something by default
[14:46:02] <ottomata>	 we should prob configure it to save in mysql metastore or something
[14:46:11] <joal>	 ottomata: k
[14:46:35] <joal>	 ottomata: My question was more, can we get rid of that easily?
[14:48:42] <wikibugs>	 Analytics, MediaWiki-API, Reading-Infrastructure-Team: Add pageview stats to the action API - https://phabricator.wikimedia.org/T144865#2612941 (Anomie) >>! In T144865#2631487, @Tgr wrote: > MediaWiki core has a pageview counting feature (which no one uses [citation needed]),  Wasn't that removed in...
[14:48:45] <ottomata>	 joal:  whatcha mean?
[14:49:19] <joal>	 ottomata: I have created a test datasource, and changed its structure after first loading :(
[14:49:33] <joal>	 ottomata: looks like pivot doesn't add the field I added
[14:49:50] <ottomata>	 hm
[14:49:54] <elukey>	 joal: is it Edit test data?
[14:50:00] <joal>	 elukey: correct
[14:50:52] <elukey>	 what is the field ? Just to double check
[14:51:11] <joal>	 elukey: it's a measure field, named : edits
[14:51:50] <elukey>	 okok I wanted to make sure that Varnish wasn't caching something but this is not the case, sorry :)
[14:52:22] <joal>	 elukey: no prob, all potential solutions are good
[14:52:30] <elukey>	 joal: maybe I can try to restart it to see if it works?
[14:52:39] <elukey>	 the usual turn off/on again solution
[14:52:43] <joal>	 elukey: why not (if easy)
[14:53:25] <elukey>	 joal: done
[14:53:55] <joal>	 elukey: Yay ! Worked :)
[14:53:59] <joal>	 elukey: thanks mate :)
[14:54:16] <elukey>	 ah so the thing caches as Andrew mentioned
[14:54:26] <elukey>	 probably there is an option to tune this
[14:54:30] <elukey>	 will check :)
[14:54:53] <ottomata>	 hm
[14:55:00] <ottomata>	 i'm not sure what it is, and i can't remember how I changed it!
[14:55:03] <joal>	 mforns, milimetric : If you want to have a look at simplewiki edit data in druid, it's now available :)
[14:55:34] <joal>	 ottomata, elukey : Most of the time, caching data schemas is the right thing to do :)
[14:58:16] <elukey>	 so pivot does
[14:58:18] <elukey>	 Adding Druid data source: 'edit-history-test'
[14:58:18] <elukey>	 Adding Druid data source: 'pageviews-daily'
[14:58:18] <elukey>	 Adding Druid data source: 'pageviews-hourly'
[14:58:18] <elukey>	 Initial load and introspection complete. Got 3 data sources, 3 queryable
[14:58:56] <elukey>	 maybe after this bootstrap it doesn't recognize new stuff like measures?
[14:59:14] <elukey>	 it could be an option
[14:59:38] <joal>	 elukey: I assume after it loads a datasource it doesn't update its schema
[15:00:01] <elukey>	 more elegant, yes :)
[15:03:33] <wikibugs>	 Analytics, Operations: kafkatee's logrotate/syslog default pkg files needs to be removed - https://phabricator.wikimedia.org/T145490#2633102 (elukey) p:Triage>Low
[15:33:22] <wikibugs>	 Analytics: Project: deploy notebook solution on top of hadoop to replace mysql eventlogging database - https://phabricator.wikimedia.org/T145527#2633255 (Nuria)
[15:56:37] <nuria_>	 elukey: irc for deploy?
[15:56:42] <ottomata>	 goin lunchin + trying again at phone fixing bbl
[15:56:52] <elukey>	 nuria_: sure :)
[15:57:16] <nuria_>	 elukey: head of branch is this one: https://gerrit.wikimedia.org/r/#/c/309604/
[15:57:54] <nuria_>	 elukey: so i think when we do the pull in tin or similar we have to do git pull origin new-aqs-cluster
[15:59:34] <elukey>	 nuria_: will it create a new branch or use the current one?
[15:59:41] <elukey>	 I have some doubts now
[15:59:50] <elukey>	 because it would be great to have two branches on tin too
[15:59:57] <nuria_>	 elukey: it will use that branch
[16:00:13] <nuria_>	 elukey: so when you pull if you do > git branch
[16:00:23] <nuria_>	 you shall see two branches master and this one
[16:01:13] <elukey>	 ah you already created it
[16:01:14] <elukey>	 checking
[16:02:05] <nuria_>	 elukey: we can do batcave and share screen if you want
[16:03:18] <elukey>	 nuria_: qq - I thought that you were going to deploy and I was going to check the service, is it the right understanding or do you want me to do it?
[16:04:08] <nuria_>	 elukey: i am not sure i have permits to deploy, i did not last time i tried
[16:04:13] <wikibugs>	 Analytics-Cluster, Operations: Migrate titanium to jessie (archiva.wikimedia.org upgrade) - https://phabricator.wikimedia.org/T123725#1936502 (Dzahn) Cool, i'll take it as a reminder to shut titanium down after a waiting period.
[16:04:25] <wikibugs>	 Analytics-Cluster, Operations: Migrate titanium to jessie (archiva.wikimedia.org upgrade) - https://phabricator.wikimedia.org/T123725#2633405 (Dzahn) a:Dzahn
[16:04:43] <nuria_>	 elukey: jaja i thought we were doing it the other way around
[16:04:43] <elukey>	 nuria_: you should be able to
[16:04:48] <elukey>	 okok :)
[16:04:56] <elukey>	 so https://gerrit.wikimedia.org/r/#/c/309604/ needs to be merged right?
[16:05:31] <elukey>	 because what I thought we were going to do was
[16:05:33] <elukey>	 merge the code
[16:05:36] <elukey>	 git fetch
[16:05:39] <nuria_>	 elukey: no need to merge
[16:05:44] <elukey>	 git checkout new-aqs-cluster
[16:05:52] <elukey>	 scap deploy
[16:06:01] <nuria_>	 elukey: ah sorry. merge to that branch right
[16:06:31] <nuria_>	 elukey: ahem, yes. batcave?
[16:06:33] <elukey>	 (scap deploy only to aqs100[456])
[16:07:33] <nuria_>	 elukey: batcave 2?
[16:07:49] <elukey>	 sure
[16:07:53] <nuria_>	 elukey: https://hangouts.google.com/hangouts/_/wikimedia.org/a-batcave-2
[16:08:54] <nuria_>	 elukey: i  am there
[16:09:09] <elukey>	 ah the '-'
[16:11:21] <grrrit-wm>	 (CR) Nuria: [C: 2 V: 2] Update per-article compression scheme to default (LCS) [analytics/aqs] (new-aqs-cluster) - https://gerrit.wikimedia.org/r/309602 (https://phabricator.wikimedia.org/T140866) (owner: Nuria)
[16:13:56] <grrrit-wm>	 (CR) Nuria: [C: 2 V: 2] Map null count values to 0 in per-article output [analytics/aqs] (new-aqs-cluster) - https://gerrit.wikimedia.org/r/309604 (https://phabricator.wikimedia.org/T144521) (owner: Nuria)
[16:47:29] <travis-ci>	 wikimedia/mediawiki-extensions-EventLogging#598 (wmf/1.28.0-wmf.19 - 40402c6 : Chad Horohoe): The build has errored.
[16:47:29] <travis-ci>	 Change view : https://github.com/wikimedia/mediawiki-extensions-EventLogging/commit/40402c668b63
[16:47:29] <travis-ci>	 Build details : https://travis-ci.org/wikimedia/mediawiki-extensions-EventLogging/builds/159648232
[16:47:48] <grrrit-wm>	 (PS4) Nuria: Map null count values to zeros in output [analytics/aqs] (new-aqs-cluster) - https://gerrit.wikimedia.org/r/309604 (https://phabricator.wikimedia.org/T144521)
[16:51:59] <grrrit-wm>	 (PS5) Nuria: Map null values to zeros in output in per-article endpoint [analytics/aqs] (new-aqs-cluster) - https://gerrit.wikimedia.org/r/309604 (https://phabricator.wikimedia.org/T144521)
[16:53:54] <elukey>	 mobrovac: o/ do you have a min for a docker question?
[16:54:22] <elukey>	 I am trying to run the server.js --deploy-repo from Mac Os
[16:54:43] <mobrovac>	 uh
[16:54:49] <elukey>	 is it a dead end or somebody tried?
[16:54:54] <elukey>	 ah ok I guess no
[16:54:58] <elukey>	 I can see a weird Step 5 : RUN groupadd -g 20 -r rungroup && useradd -m -r -g rungroup -u 502 runuser
[16:55:02] <elukey>	 that fails
[16:55:20] <elukey>	 I have a group with id 20 on macos
[16:55:21] <mobrovac>	 aren't those your user's uid/gid?
[16:55:34] <elukey>	 yes they are
[16:55:38] <mobrovac>	 it's needed for the mapping
[16:55:41] <mobrovac>	 of files
[16:55:58] <mobrovac>	 it fails with what error?
[16:56:38] <grrrit-wm>	 (PS6) Nuria: Map null values to zeros in output in per-article endpoint [analytics/aqs] (new-aqs-cluster) - https://gerrit.wikimedia.org/r/309604 (https://phabricator.wikimedia.org/T144521)
[16:56:49] <elukey>	 GID 20 exists, but I thought it was doing it inside the container
[16:56:57] <mobrovac>	 yes
[16:56:59] <mobrovac>	 it does
[16:57:10] <mobrovac>	 so maybe it already exists inside the container
[16:57:11] <mobrovac>	 hm
[16:57:15] <mobrovac>	 damn permissions
[16:57:22] <elukey>	 it says
[16:57:22] <elukey>	 The command '/bin/sh -c groupadd -g 20 -r rungroup && useradd -m -r -g rungroup -u 502 runuser' returned a non-zero code: 4
[16:57:54] <mobrovac>	 yup, that's gid not unique
[16:58:00] <elukey>	 ahhh ok got it now,
[16:58:02] <Pchelolo>	 elukey: are you using native docker for mac or boot2docker?
[16:58:12] <elukey>	 Pchelolo: o/
[16:58:13] <grrrit-wm>	 (PS7) Nuria: Map null values to zeros in output in per-article endpoint [analytics/aqs] (new-aqs-cluster) - https://gerrit.wikimedia.org/r/309604 (https://phabricator.wikimedia.org/T144521)
[16:58:16] <elukey>	 native docker
[16:58:18] <Pchelolo>	 only native (latest) docker for mac is supported
[16:58:36] <mobrovac>	 elukey: i think i have a solution
[16:58:40] <mobrovac>	 lemme do a quick pr
[16:58:45] <grrrit-wm>	 (CR) Nuria: [C: 2 V: 2] Map null values to zeros in output in per-article endpoint [analytics/aqs] (new-aqs-cluster) - https://gerrit.wikimedia.org/r/309604 (https://phabricator.wikimedia.org/T144521) (owner: Nuria)
[16:58:45] <elukey>	 thanks a lot!
[16:58:48] <elukey>	 sorry for the trouble
[16:59:10] <nuria_>	 elukey: sorry about this, now merged: https://gerrit.wikimedia.org/r/#/c/309604/
[16:59:27] <Pchelolo>	 elukey: make sure you have service-runner 2.0.6+
[16:59:39] <Pchelolo>	 after that version is should work out of the box
[17:02:50] <mobrovac>	 elukey: Pchelolo: https://github.com/wikimedia/service-runner/pull/126
[17:02:53] <mobrovac>	 that ought to fix it
[17:03:11] <Pchelolo>	 mobrovac: em... https://github.com/wikimedia/service-runner/pull/126/files#diff-f68e1ed72a6a9bbc03d6989560fa9708R214
[17:03:21] <Pchelolo>	 this code shouldn't be run on mac at all
[17:03:49] <mobrovac>	 hmm
[17:04:28] <mobrovac>	 and yet, it is executed on elukey's box
[17:04:53] <Pchelolo>	 mobrovac: that check was added in version 2.0.6, maybe elukey has older version installed?
[17:05:12] <mobrovac>	 Pchelolo: either way, the non-unique uid/gid should be supported
[17:05:31] <mobrovac>	 elukey: what version of service-runner are you using?
[17:05:55] <Pchelolo>	 mobrovac: ye, no question, just it has to work out of the box on  Mac, at least works for me
[17:06:19] <elukey>	 I was trying to figure it out, bare in mind that I've started today to check this
[17:06:22] <elukey>	 :)
[17:06:48] <mobrovac>	 elukey: grep version package.json
[17:07:06] <mobrovac>	 or node_modules/service-runner/package.json
[17:07:51] <elukey>	 0.1.0 afaics
[17:08:02] <mobrovac>	 elukey: what did you clone / install?
[17:08:18] * mobrovac is lost a bit here
[17:08:23] <elukey>	 nono "version": "1.3.1"
[17:08:30] <mobrovac>	 uh that's old
[17:08:34] <elukey>	 this is from node_modules/service-runner/package.json
[17:08:41] <mobrovac>	 where did you get this version from?
[17:08:45] <elukey>	 I just checked out the aqs deploy repo :)
[17:08:48] <nuria_>	 ottomata: updated couple dumps tickets: https://phabricator.wikimedia.org/T128513
[17:09:14] <mobrovac>	 elukey: yeah, aqs needs to be brought up to date with the latest service-runner/hyperswitch developments
[17:09:34] <mobrovac>	 elukey: just npm install service-runner
[17:10:12] <Pchelolo>	 mobrovac: It's pretty up to date in src repo as far as I can tell (it's 2.0 service-runner at least)
[17:13:38] <elukey>	 mobrovac: it installs 1.3.1
[17:13:45] <elukey>	 basically this is a bit old right? https://github.com/wikimedia/analytics-aqs/blob/master/package.json#L26-L30
[17:14:11] <elukey>	 but I don't know what ^ means
[17:14:15] <Pchelolo>	 elukey: AQS is hosted in gerrit I thought?
[17:14:24] <elukey>	 sorry people if you want I can RTFM myself and come back tomorrow
[17:14:26] <mobrovac>	 elukey: because it is reading package.json, try npm install service-runner@2.1.2
[17:14:57] <nuria_>	 msg elukey walking to library, we can touch base later or tomorrow
[17:15:08] <Pchelolo>	 elukey: https://gerrit.wikimedia.org/r/#/admin/projects/analytics/aqs
[17:15:19] <nuria_>	 Pchelolo: yes, it is hosted in gerrit
[17:15:32] <nuria_>	 Pchelolo: it is just easy to link to latest code on giuthub
[17:15:35] <nuria_>	 *github
[17:16:27] <elukey>	 nuria_: tomorrow would be better, would it be ok?
[17:16:43] <elukey>	 Pchelolo: I get service-runner@2.1.2  invalid
[17:16:59] <elukey>	   └─┬ limitation@0.1.9
[17:16:59] <elukey>	     └── kad@1.3.6  (git+https://github.com/gwicke/kad.git#f35971036f43814043245da82b12d035b7bbfd16)
[17:17:11] <mobrovac>	 elukey: why do you need to be in the aqs repo?
[17:17:21] <mobrovac>	 elukey: just go elsewhere
[17:17:52] <mobrovac>	 elukey: what is the end goal here?
[17:17:54] <mobrovac>	 :)
[17:19:25] <elukey>	 mobrovac: thanks for the help but I'll read some stuff before bothering you, I am just trying to deploy aqs
[17:19:28] <elukey>	 that's it
[17:19:36] <elukey>	 I'll figure out a way
[17:19:53] <elukey>	 thanks Pchelolo too for the help
[17:21:49] <nuria_>	 elukey: yes tomorrow works, i will continue the deployment
[17:21:56] <nuria_>	 mobrovac: we are trying to deploy aqs
[17:22:09] <nuria_>	 mobrovac: and running into issues
[17:25:00] <elukey>	 nuria_: it seems that my build issue could be resolved using a more recent version of service-runner
[17:25:02] <nuria_>	 mobrovac: so question (for Pchelolo also)
[17:25:26] <nuria_>	 elukey: right, but the version we have on aqs package.json is  "^1.1.0",
[17:25:40] <nuria_>	 mobrovac: we deployed just like 1 month ago and that was fine cc Pchelolo
[17:25:47] <nuria_>	 mobrovac: does that need to be updated?
[17:26:01] <Pchelolo>	 nuria_: that was not a deploy natively from OSX.
[17:26:24] <Pchelolo>	 that was supported all the time. building natively on OSX is supported only v 2.0.6+
[17:26:30] <Pchelolo>	 so you need to update service-runner
[17:26:38] <nuria_>	 Pchelolo:right, cause deploying from OS at the time it did not work, ok
[17:26:52] <nuria_>	 Pchelolo: because of the group id issue, correct?
[17:27:06] <Pchelolo>	 nuria_: yes.
[17:27:14] <nuria_>	 Pchelolo: ok, will do and try to build again
[17:27:49] <elukey>	 nuria_: I would not upgrade service-runner now, but maybe ask joal to build the docker image
[17:27:56] <elukey>	 too many changes in flight
[17:28:09] <elukey>	 we can definitely schedule a version bump after this
[17:28:44] <nuria_>	 elukey: right, i was going to build from mu ubuntu image ..
[17:28:56] <nuria_>	 *my ubuntu
[17:28:59] <elukey>	 ah okok, super :)
[17:29:07] <nuria_>	 elukey: be back in a bit
[17:29:57] <elukey>	 I am going to go afk, will sync with you tomorrow ok? Let me know if you succeed, otherwise I'll create a VM or ask joal to build
[17:30:00] <elukey>	 thanks!
[17:30:38] <mobrovac>	 or jsut build it in labs this time around
[17:30:57] <elukey>	 sure
[17:31:13] <elukey>	 thanks for the help, going afk!
[17:46:49] <wikibugs>	 Analytics, MediaWiki-API, Reading-Infrastructure-Team: Add pageview stats to the action API - https://phabricator.wikimedia.org/T144865#2633788 (Tgr) You are right, it was migrated to [[https://www.mediawiki.org/wiki/Extension:HitCounters|HitCounters]], which actually it easier to check how widely it...
[17:57:43] <wikibugs>	 Analytics, MediaWiki-API, Reading-Infrastructure-Team: Add pageview stats to the action API - https://phabricator.wikimedia.org/T144865#2633851 (Anomie) >>! In T144865#2633788, @Tgr wrote: > ```lang=php >     public function getPageData( Title $title, $metric = self::METRIC_VIEW ); > ```  Ideally the...
[18:51:22] <wikibugs>	 Analytics-Kanban: Compile a request data set for caching research and tuning - https://phabricator.wikimedia.org/T128132#2634143 (Nuria) >I had one minor question: Am I right to assume that the dates of this dataset are August 17 to August 31?  no, dates are not those, since we did not need timestamps for th...
[19:04:36] <wikibugs>	 Analytics, MediaWiki-API, Reading-Infrastructure-Team: Add pageview stats to the action API - https://phabricator.wikimedia.org/T144865#2634288 (Tgr) Good point, updated.
[19:42:13] <nuria_>	 Pchelolo: yt?
[19:42:20] <Pchelolo>	 nuria_: ??
[19:45:08] <nuria_>	 Pchelolo: my aqs install in ubuntu fails with dependency issues on sqllite3
[19:45:43] <nuria_>	 Pchelolo: on mac Os deps look like this for restbase-mod-table-sqlite
[19:45:57] <nuria_>	 Pchelolo:
[19:46:03] <nuria_>	 https://www.irccloud.com/pastebin/2nleAxlr/
[19:46:56] <Pchelolo>	 nuria_: sqlite3 has native code, so why is your module compiled for darwin while it's inside ubunty?
[19:47:22] <nuria_>	 Pchelolo: what I pasted is MAC OS X
[19:48:14] <nuria_>	 Pchelolo: the dir on ubuntu the lib directory for sqllite3 doesn't have any bindings ...?
[19:49:37] <wikibugs>	 Analytics, Dumps-Generation, Security: Pageview dumps incorrectly formatted, looks like a result of possibly malicious activity - https://phabricator.wikimedia.org/T144100#2634472 (Nuria) Also, I can see garbage like requests in pageview_hourly table, on that hour:  <<script>document.vulnerable=true;...
[19:49:43] <Pchelolo>	 nuria_: it should contain bindings compiled for ubuntu. Try doing 'rm -rf ./node-modules; npm i' inside ubuntu VM - it has to compile it for you
[19:51:03] <Pchelolo>	 sqlite3 module wasn't updated any time recently, so if it worked before for you it should work now. Although if for some reason it doesn't, you can skip it with npm i --production
[19:53:47] <nuria_>	 Pchelolo: mmm.. will try again but i just did that
[19:54:03] <nuria_>	 Pchelolo: who will compile the bindings? npm?
[19:54:07] <Pchelolo>	 nuria_: yep
[19:54:39] <Pchelolo>	 I'll be afk for 5 minutes
[20:08:40] <nuria_>	 Pchelolo: ok , found some info on github
[20:15:14] <nuria_>	 Pchelolo: ok, fixed , for some reason it compiles properly when installed globally (????)
[20:16:13] <Pchelolo>	 em..... no idea why is that.. I've used that ubuntu VM before to do that right?
[20:17:42] <wikibugs>	 Analytics, Dumps-Generation, Security: Pageview dumps incorrectly formatted, looks like a result of possibly malicious activity - https://phabricator.wikimedia.org/T144100#2634568 (Bawolff)  > But it could be that < were "&lt"? as that one is allowed once it is urlencoded.   &lt is allowed, but &lt;...
[20:33:59] <nuria_>	 Pchelolo: there are too many hurdles on this  process
[20:34:01] <nuria_>	 Pchelolo:
[20:34:07] <nuria_>	 https://www.irccloud.com/pastebin/n5JXRIus/
[20:34:23] <nuria_>	 docker is running but build script seems like it cannot connect
[20:35:02] <Pchelolo>	 nuria_: what would 'docker -v' tell you from the console?
[20:35:07] <nuria_>	 Pchelolo: I get the node stuff is just what it is and that you guys cannot do anything about it
[20:35:44] <nuria_>	 Pchelolo: but I think this would be a lot easier if services team should provide a build machine for service owners where all this is taken care of  cc gwicke
[20:36:04] <nuria_>	 https://www.irccloud.com/pastebin/e4ea3ss5/
[20:36:25] <Pchelolo>	 nuria_: hm that's weird...
[20:37:05] <nuria_>	 Pchelolo: does docker need to run as an specific user?
[20:37:13] <nuria_>	 Pchelolo: or with an specific set of permits?
[20:37:59] <Pchelolo>	 nuria_: nope.. The script is actually just calling docker command, so it should use the exact same docker instance you have on the console
[20:38:57] <nuria_>	 Pchelolo: let me restart docker
[20:40:12] <nuria_>	 Pchelolo: docker is running as root though
[20:40:45] <Pchelolo>	 nuria_: that's fine the daemon should run as root as far as I'm concerned
[20:42:09] <nuria_>	 Pchelolo: well......it no work
[20:42:39] <nuria_>	 Pchelolo: let's take this again tomorrow, we really need to deploy these changes
[20:42:48] <nuria_>	 Pchelolo: thanks for your help thus far
[20:44:59] <ottomata>	 NOOOOOOOOOOOOOOOOOOOOO MY BIKE WAS STOLEN
[20:45:01] <ottomata>	 NOOOOOOOOOO
[20:45:03] <ottomata>	 NOOOOOOOOOOOOO
[20:45:06] <nuria_>	 what????
[20:45:13] <nuria_>	 man......
[20:45:16] <Pchelolo>	 omg ottomata!!!
[20:45:21] <ottomata>	 had my nice (newer) travel bike locked out, left it out for ONE NIGHT
[20:45:22] <ottomata>	 GAHHH
[20:45:25] <ottomata>	 just got home and it sgone
[20:45:26] <ottomata>	 GAHHHH
[20:45:27] <ottomata>	 NoOoOOOOOO
[20:46:07] <nuria_>	 argh SO SORRY!
[20:48:52] <nuria_>	 Pchelolo: it's going to be permits i bet
[20:50:19] <ottomata>	 my phone is so broken, i can't even dial 911
[20:50:21] <ottomata>	 GAHHHhhHHH
[20:50:45] <ottomata>	 ok, going to the police dept...bad day... :( :( :(
[20:52:08] <grrrit-wm>	 (PS1) Ppchelko: Update analytics-query-service to 532ba2a [analytics/aqs/deploy] - https://gerrit.wikimedia.org/r/310416
[20:52:21] <Pchelolo>	 nuria_: https://gerrit.wikimedia.org/r/310416
[20:52:54] <Pchelolo>	 nuria_: ups, not that one, sorry, it's just dependencies. I'll redo
[20:52:59] <grrrit-wm>	 (Abandoned) Ppchelko: Update analytics-query-service to 532ba2a [analytics/aqs/deploy] - https://gerrit.wikimedia.org/r/310416 (owner: Ppchelko)
[20:54:07] <Pchelolo>	 nuria_: hm.. looks like there's nothing to deploy in AQS gerrit repo?