[10:17:24] (PS13) Joal: Add initial oozie job for ApiAction [analytics/refinery] - https://gerrit.wikimedia.org/r/273557 (https://phabricator.wikimedia.org/T108618) (owner: BryanDavis) [10:20:36] (CR) Joal: [C: 2 V: 2] "LGTM :) Tested by ottomata." [analytics/refinery] - https://gerrit.wikimedia.org/r/273557 (https://phabricator.wikimedia.org/T108618) (owner: BryanDavis) [10:23:23] !log Deploying refinery from tin [10:26:57] !log Deploying refinery on HDFS [10:33:02] !log Restart load job with SLA [10:36:56] (PS1) Joal: Correct bug in SLA addition to load job [analytics/refinery] - https://gerrit.wikimedia.org/r/277209 [10:37:36] (CR) Joal: [C: 2 V: 2] "Self merging for deploy." [analytics/refinery] - https://gerrit.wikimedia.org/r/277209 (owner: Joal) [10:59:27] joal: o/ [10:59:32] Hi elukey :) [10:59:59] oozie is creating dumps nicely, I checked and we are close to august [11:00:08] Gresat :) [11:00:08] a couple of days and it should be done [11:00:40] this morning I discovered that varnishkafka was consuming 100% cpu utilization in idle /o\ [11:00:43] elukey: You see, with a reasonably small number in concurrency and throttle, oozie doesn't flood the cluster, and things go smooth (even if longer) [11:01:07] elukey: the new version ? [11:02:12] (PS1) Mforns: Make reportupdater support removing columns [analytics/reportupdater] - https://gerrit.wikimedia.org/r/277215 (https://phabricator.wikimedia.org/T127326) [11:03:02] joal: yep! basically a new lib function doesn't sleep anymore (apparently) but just returns to the caller.. Put it in a while as it was before, and 100% cpu utilization raises in a small amount of time :P [11:03:16] put a nanosleep 0.1s and now it is 0.3 cpu utilization stable [11:03:32] (I was testing it in MediaWiki vagrant [11:04:06] k [11:04:12] weird :( [11:14:49] (CR) Mforns: [C: -1] "Still testing." [analytics/reportupdater] - https://gerrit.wikimedia.org/r/277215 (https://phabricator.wikimedia.org/T127326) (owner: Mforns) [11:15:03] Analytics-Kanban, Operations, Traffic, Patch-For-Review: varnishkafka integration with Varnish 4 for analytics - https://phabricator.wikimedia.org/T124278#2117559 (elukey) Status update: * Tested the code in mediawiki-vagrant and discovered some bugs, fixed in the latest patchset. Now varnishkafk... [11:16:29] Analytics-Tech-community-metrics: top-contributors.html only displays secen entries - https://phabricator.wikimedia.org/T129837#2117561 (Aklapper) [11:16:49] Analytics-Tech-community-metrics, DevRel-March-2016, Regression: top-contributors.html only displays secen entries - https://phabricator.wikimedia.org/T129837#2117561 (Aklapper) p:Triage>High [11:17:00] Analytics-Tech-community-metrics: top-contributors.html empty due to 404s for several JSON files - https://phabricator.wikimedia.org/T126971#2117576 (Aklapper) Last issues split into T129837 [11:17:24] Analytics-Tech-community-metrics, DevRel-March-2016, Regression: top-contributors.html only displays seven entries - https://phabricator.wikimedia.org/T129837#2117561 (Aklapper) [11:17:47] Analytics-Tech-community-metrics, DevRel-March-2016, Regression: top-contributors.html only displays seven entries - https://phabricator.wikimedia.org/T129837#2117561 (Aklapper) [11:17:49] Analytics-Tech-community-metrics, DevRel-March-2016: Key performance indicator: Top contributors: Find good Ranking algorithm fix bugs on page - https://phabricator.wikimedia.org/T64221#2117579 (Aklapper) [11:29:09] Analytics-Cluster: Add automatic failover to the Hadoop's name node - https://phabricator.wikimedia.org/T129838#2117585 (elukey) [11:41:30] Analytics-Tech-community-metrics, Developer-Relations, DevRel-March-2016, Patch-For-Review, developer-notice: Check whether it is true that we have lost 40% of (Git) code contributors in the past 12 months - https://phabricator.wikimedia.org/T103292#2117626 (Aklapper) https://github.com/Bitergia... [12:33:17] joal did you read the link that I posted about kafka streams? [12:33:42] elukey: Not sure I read precisely yours, but read stuff yes :) [12:34:52] ahhh okok! I posted it over the weekend - http://www.confluent.io/blog/introducing-kafka-streams-stream-processing-made-simple [12:35:03] just wanted to know what you think about it :) [12:35:05] I read that one indeed [12:36:00] I think the core thought to bear in mind is that one: they are closer to being a kind of asynchronous microservice rather than being a faster version of a batch analytics job. [12:36:24] ah yes yes [12:36:54] So if we have some core plateform functionnality that needs our data, maybe straming (whatever technology), if not, maybe not then :) [12:38:02] elukey: I'm happy about Jay Kreps saying that actually, it'll help us making technology decisions :) [12:40:48] still need to get a better grasp of the term [12:40:53] "streaming" though :) [12:42:07] elukey: usually streaming means 'newar real-time processing of data flows' [12:43:05] elukey: What J.K says is that if your application as some need for those kind of data, do it, but don't do streaming as a replacement of batch processing for analytics [12:44:28] joal: thanks! [12:44:40] elukey: np, hope it helps :) [12:45:18] yes it does! But I still need to put my hands on real examples etc.. before saying "YES I got it!" [12:47:07] elukey: Ask ottomata to show real-time page trends :) [12:47:27] elukey: ottomata as this as a streaming demo in spark [13:25:09] Analytics-Cluster: Add automatic failover to the Hadoop's name node - https://phabricator.wikimedia.org/T129838#2117811 (Ottomata) +1 :) [13:44:02] * joal AFK - back for standup [15:03:28] ottomata: holaaa eventbus? [15:04:21] AHHH [15:14:31] Analytics-Tech-community-metrics, DevRel-March-2016: Make GrimoireLib display *one* consistent name for one user - https://phabricator.wikimedia.org/T118169#2118378 (Lcanasdiaz) ITS panels show now a consistent name. https://github.com/VizGrimoire/GrimoireLib/commit/90b27e2fdfbb7c0f809cb2ebb9e6207dfefe9... [15:14:41] Analytics-Tech-community-metrics, DevRel-March-2016: Many profiles on profile.html do not display identity's name though data is available - https://phabricator.wikimedia.org/T117871#2118381 (Lcanasdiaz) [15:14:43] Analytics-Tech-community-metrics, DevRel-March-2016: Make GrimoireLib display *one* consistent name for one user - https://phabricator.wikimedia.org/T118169#2118379 (Lcanasdiaz) Open>Resolved [15:14:45] Analytics-Tech-community-metrics, Developer-Relations, DevRel-March-2016: Who are the top 50 independent contributors and what do they need from the WMF? - https://phabricator.wikimedia.org/T85600#2118382 (Lcanasdiaz) [15:24:32] Analytics-Tech-community-metrics, DevRel-March-2016: Many profiles on profile.html do not display identity's name though data is available - https://phabricator.wikimedia.org/T117871#2118443 (Lcanasdiaz) With the latest changes in T118169 we have the ITS panels with only two errors: * Rob Church http://ko... [15:32:34] madhuvishy, joal: standduppp [15:37:17] Analytics-Kanban: Fill new AQS endpoint with data from Hadoop - https://phabricator.wikimedia.org/T129519#2118512 (JAllemandou) a:JAllemandou [15:43:01] (Abandoned) EBernhardson: Update camus to support reading avro schemas from an avro protocol [analytics/refinery/source] - https://gerrit.wikimedia.org/r/274307 (https://phabricator.wikimedia.org/T128530) (owner: EBernhardson) [15:43:15] Analytics-Kanban, Patch-For-Review: Clean up Event Logging server side forwarder - https://phabricator.wikimedia.org/T129402#2118583 (madhuvishy) a:madhuvishy [15:43:20] Analytics, Discovery, Discovery-Search-Sprint, Patch-For-Review: Update camusto be able to read/write avro protocols for logging - https://phabricator.wikimedia.org/T128530#2118584 (EBernhardson) Open>declined determined to be unnecessary. avro-tools idl2schemata can build an appropriate .avs... [15:46:03] (PS2) Ottomata: Upgrade camus-wmf dependency to camus-wmf7 [analytics/refinery/source] - https://gerrit.wikimedia.org/r/276122 (owner: Joal) [15:46:09] (CR) Ottomata: [C: 2 V: 2] Upgrade camus-wmf dependency to camus-wmf7 [analytics/refinery/source] - https://gerrit.wikimedia.org/r/276122 (owner: Joal) [15:50:31] Analytics-Tech-community-metrics, DevRel-March-2016: Key performance indicator: Top contributors: Find good Ranking algorithm fix bugs on page - https://phabricator.wikimedia.org/T64221#2118614 (Lcanasdiaz) [15:50:33] Analytics-Tech-community-metrics, DevRel-March-2016: Many profiles on profile.html do not display identity's name though data is available - https://phabricator.wikimedia.org/T117871#2118612 (Lcanasdiaz) Open>Resolved >>! In T117871#2118443, @Lcanasdiaz wrote: > With the latest changes in T118169 we... [15:55:55] nuria: http://spinnaker.io/online_docs/overview/overview.html#deployment-management <--- would be super cool to test stuff from beta to prod [15:57:23] elukey: let's keep it in mind for our meeting on improvment sto deploy to cluster [16:05:44] Analytics, Pageviews-API, Wikimedia-General-or-Unknown, I18n: PLURAL needed on $1 - https://phabricator.wikimedia.org/T129633#2111302 (Milimetric) Can someone explain how the PLURAL support is blocked by this? [16:07:56] Analytics, MediaWiki-API, Reading-Infrastructure-Team, MW-1.27-release-notes, and 3 others: Publish detailed Action API request information to Hadoop - https://phabricator.wikimedia.org/T108618#2118668 (bd808) [16:08:04] Analytics: Remove eventlogging code from blog. Use piwik to count pageviews - https://phabricator.wikimedia.org/T129558#2118670 (Milimetric) p:Triage>Low [16:08:36] Analytics, Pageviews-API, I18n: [[Wikimedia:Pageviews-select2-max-chars/en]] needs PLURAL support - https://phabricator.wikimedia.org/T129442#2105775 (Milimetric) Could someone explain how the pageview API is blocking this? [16:11:16] Analytics, Analytics-Wikimetrics: Usernames with commas not supported {dove} - https://phabricator.wikimedia.org/T129422#2118689 (Milimetric) p:Triage>Normal [16:12:13] Analytics: Terms of use for Wikimetrics needs updating {dove} - https://phabricator.wikimedia.org/T129383#2118698 (Milimetric) p:Triage>Normal [16:12:35] Analytics, Analytics-Wikimetrics: Terms of use for Wikimetrics needs updating {dove} - https://phabricator.wikimedia.org/T129383#2103935 (Milimetric) [16:13:00] Analytics, MediaWiki-API, Reading-Infrastructure-Team, MW-1.27-release-notes, and 3 others: Publish detailed Action API request information to Hadoop - https://phabricator.wikimedia.org/T108618#2118709 (bd808) Now at the "Wait for analytics to deploy new versions of refinery and refinery-source to... [16:14:49] Analytics, Graph, Pageviews-API: Unable to get pageviews for the title with ' in the name - https://phabricator.wikimedia.org/T129346#2118723 (Milimetric) Seems like a problem in english too: https://wikimedia.org/api/rest_v1/metrics/pageviews/per-article/en.wikinews.org/all-access/user/Men%27s_Heal... [16:15:06] Analytics, Graph, Pageviews-API: Unable to get pageviews for the title with ' in the name - https://phabricator.wikimedia.org/T129346#2118724 (Milimetric) p:Triage>High [16:15:51] Analytics: Make deployment process to the cluster easier, more streamlined {hawk} - https://phabricator.wikimedia.org/T129253#2118729 (Milimetric) p:Triage>Normal [16:16:43] Analytics, Analytics-Cluster, Deployment-Systems, scap, Scap3 (Scap3-Adoption-Phase1): Deploy analytics-refinery with scap3 - https://phabricator.wikimedia.org/T129151#2096617 (Milimetric) p:Triage>Normal [16:30:01] Analytics, Graph, Pageviews-API: Unable to get pageviews for the title with ' in the name - https://phabricator.wikimedia.org/T129346#2118836 (Yurik) I'm not sure if this is analytics it wiki escaping issue. The HTML escaping happens before URL encoding [16:31:15] ottomata: coming to goals? or still in ops meeting? [16:35:09] oh in ops meeting [16:35:10] uhhh [16:35:27] perusing agenda, will prob come to goals [16:37:18] Analytics, MediaWiki-API, Reading-Infrastructure-Team, MW-1.27-release-notes, and 3 others: Publish detailed Action API request information to Hadoop - https://phabricator.wikimedia.org/T108618#2118864 (EBernhardson) keep intending to work on a way for camus to read the schema's from outside of the... [16:59:45] Analytics, MediaWiki-API, Reading-Infrastructure-Team: Create wmf_raw.ApiAction table - https://phabricator.wikimedia.org/T129886#2118965 (bd808) [17:01:05] ottomata: any issue with https://phabricator.wikimedia.org/T129260#2118958 ? I don't think so but just to double check [17:05:20] naw totally fine [17:05:29] proceed! [17:06:54] Analytics, Graph, Pageviews-API: Unable to get pageviews for the title with ' in the name - https://phabricator.wikimedia.org/T129346#2102915 (JAllemandou) Hi, This requests works: [[ https://wikimedia.org/api/rest_v1/metrics/pageviews/per-article/ru.wikipedia/all-access/all-agents/Men's%20Health/dai... [17:18:26] Analytics, Reading-Infrastructure-Team: Create mediawiki_ApiAction Kafka topic - https://phabricator.wikimedia.org/T129889#2119091 (bd808) [17:22:57] Analytics, MediaWiki-API, Reading-Infrastructure-Team, MW-1.27-release-notes, and 3 others: Publish detailed Action API request information to Hadoop - https://phabricator.wikimedia.org/T108618#2119120 (bd808) [17:23:20] Analytics, MediaWiki-API, Reading-Infrastructure-Team, MW-1.27-release-notes, and 3 others: Publish detailed Action API request information to Hadoop - https://phabricator.wikimedia.org/T108618#1671906 (bd808) [17:34:16] Analytics, Graph, Pageviews-API: Unable to get pageviews for the title with ' in the name - https://phabricator.wikimedia.org/T129346#2119180 (Yurik) `{{Graph:PageViews|100|Men's Health}}` on en wiki works fine, encoding the value as `https://wikimedia.org/api/rest_v1/metrics/pageviews/per-article/en... [17:45:55] madhuvishy: Over here, or there ? [17:48:08] joal: aah [17:48:09] sorry [17:48:11] yes here [17:48:20] np madhu, wherever :) [17:48:22] so the ua-parser thingy [17:48:26] sure [17:49:08] joal: I updated uap-core submodule here -https://gerrit.wikimedia.org/r/#/c/276787/ [17:49:14] not sure how to package it though [17:51:05] madhuvishy: In the pom.xml file of the uap-java folder, you'll see the trick :) [17:51:17] joal: aha! looking [17:52:08] oh cool [17:52:18] so just mvn package there and upload new jar [17:52:29] Yes [17:52:32] joal: so I'll bump up the version? [17:52:38] The thing to double check is version number :) [17:52:55] I can't recall how we did it (whether -wmf or not) [17:53:07] I think ottomata manually uploaded the thing [17:53:43] joal: refinery-source says [17:53:46] https://www.irccloud.com/pastebin/NbAnoqxo/ [17:53:59] yessssss [17:54:15] So Let's have a wmf3 :) [17:54:16] in uap-java pom the version is defined as 1.3.1-SNAPSHOT [17:54:19] hmmm [17:54:35] manual change at build time I guess ? [17:54:40] aah [17:54:48] should I update the source? [17:54:53] ottomata: can you help on this? I cn't recall how we did that [17:54:54] also the url has changed [17:55:06] Have you mvn release prepare ? [17:55:06] https://github.com/ua-parser [17:55:24] is the one that houses all the uap libraries now [17:55:37] https://github.com/tobie/ua-parser is deprecated [17:59:12] milimetric, do you have 10 mins for me to show you the dashboard? [17:59:16] madhuvishy: An update would be welcome then :) [18:00:41] Madhu: I think manual build with version update and manual upload is the way to go for that one [18:02:36] sorry was lunchin [18:02:41] yeah you thikn I can remember this?! [18:02:46] :D [18:03:00] Manual build and upload sounds right, no? [18:03:17] ottomata: does it make any sense? https://phabricator.wikimedia.org/T129344#2119283 [18:03:20] I am a bit confused [18:03:29] there are config files everywhere :D [18:03:35] Analytics, Graph, Pageviews-API: Unable to get pageviews for the title with ' in the name - https://phabricator.wikimedia.org/T129346#2119340 (Yurik) This problem can easily be solved with Lua, or decoding html entries, e.g. `{{#htmldecode | {{ARTICLEPAGENAME}} }}` (doesn't exist). The `{{ARTICLEP... [18:03:52] ottomata, madhuvishy : In archiva there is no source not javadoc artifacts, making me think it was manually uploaded - Let's go for that option [18:04:23] joal: ottomata okayy [18:04:28] sure mforns, let's batcave if you still have time [18:04:40] milimetric, sure, omw [18:04:44] most likley it was manually uploaded [18:04:56] hang on, back from lunch several chats to respond to [18:05:01] will be with ya shortly...or just proceed! :) [18:05:18] Yeah, proceed ! [18:05:21] :D [18:06:14] elukey: see the comment [18:06:24] on line 31 of class varnishkafka [18:06:25] init.pp [18:06:47] the 'varnishkafka' one [18:06:51] is for /var/log/varnishkafka [18:06:55] the -stats ones [18:07:02] are for hte json stats files that each varnishkafka instance creates [18:07:08] in /var/cache/varnishkafka/... [18:08:42] joal: the upstream url for the uap-java pom is wrong - so I'll just leave it - because we don't have commits that we make - if i've to update it, probably pull request upstream [18:08:42] the varnishkafka package expects to only be used as a single instance [18:08:58] and installs a /etc/init.d/varnishkafka script [18:09:04] and logrotate files appropriate for a singel instance [18:09:06] perfect madhuvishy [18:09:08] the puppetization overrides that [18:09:14] and uses upstart or systemd [18:09:16] madhuvishy: Should I merge your CR ? [18:09:20] to support multi instance [18:09:24] joal: so i'm gonna ignore it for now. yeah let's do that [18:09:45] ottomata: all right because I was referring to the multiple reference for /var/log/varnishkafka indeed [18:09:48] ok Madhu, merging ! [18:10:19] (CR) Joal: [C: 2 V: 2] "LGTM !" [analytics/ua-parser] - https://gerrit.wikimedia.org/r/276787 (https://phabricator.wikimedia.org/T129672) (owner: Madhuvishy) [18:10:44] a-team: will be deploying dashiki to prod and adding snippet that reports data to piwik [18:10:46] there is one in files/varnish/varnishkafka_rsyslog.conf, one in the deb package and one in the varnishkafka class (modules/varnishkafka/varnishkafka_logrotate) [18:10:51] elukey: multiple reference...meaning the package vs puppet? [18:10:58] files/varnish?!?! [18:11:03] yesssss [18:11:06] super weird [18:11:11] is the one mentioned by faidon [18:11:15] Nuria: You can use logbot for ;) [18:11:39] (PS2) Milimetric: Make datasets api more flexible [analytics/dashiki] - https://gerrit.wikimedia.org/r/276492 (https://phabricator.wikimedia.org/T129497) [18:11:42] HmM, this is very familiar, but i'm not sure why its in files/varnish....llooking [18:11:51] used in puppet/modules/role/manifests/cache/kafka.pp [18:12:22] ja [18:12:34] OHHH [18:12:36] i know. [18:13:04] /etc/rsyslog.d if fully managed by puppet [18:13:05] Analytics, Pageviews-API: Improve pageviews error messages on invalid project - https://phabricator.wikimedia.org/T129899#2119381 (GWicke) [18:13:17] the package installs this file [18:13:20] but [18:13:23] since puppet manages that directory [18:13:29] if it doesn't have a reference to it in puppet [18:13:35] it will delete the file [18:13:53] in 25a3e56a61f598d3a55b1199328368ebfbd09650 [18:13:59] i added the same file to puppet [18:14:00] previous to that [18:14:03] we just ensured it was a file [18:14:06] so that puppet wouldn't delete it [18:14:11] but, there was some chicken / egg problem [18:14:42] at some point, i remember o r i had some problem where it was deleted anyway [18:14:47] and then puppet would just ensure an empty file existed [18:15:13] that file should probably be moved to the cache role module [18:15:39] joal: how do i specify version at build time? [18:15:46] elukey: does that make sense? [18:15:50] Analytics, Pageviews-API: Improve pageviews error messages on invalid project - https://phabricator.wikimedia.org/T129899#2119405 (GWicke) p:Triage>Normal [18:16:19] madhuvishy: Changing pom.xml then mvn build packge [18:16:20] I think [18:16:24] ohhh [18:16:25] okay [18:16:29] elukey: will updated ticket [18:17:24] Analytics-EventLogging, Analytics-Kanban, DBA, Patch-For-Review: Add autoincrement id to EventLogging MySQL tables. {oryx} - https://phabricator.wikimedia.org/T125135#2119447 (jcrespo) a:jcrespo>None I will probably be able to work on this on one months' time(?) [18:18:29] ottomata: mmmmmm I kinda got it, but you are the puppet expert so I can't really argue.. I thought that those configs should have belonged only in varnishkafka::instance [18:20:04] Analytics, Graph, Pageviews-API: Unable to get pageviews for the title with ' in the name - https://phabricator.wikimedia.org/T129346#2119468 (Yurik) [18:20:04] which one? [18:20:09] the rsyslog conf file elukey? [18:20:28] no, because (r)syslog is dumb, and in all cases the programname of an instance is just 'varnishkafka' [18:20:42] it would be nice if we had per instance varnishkafka log files, but we don't [18:20:42] (PS1) Nuria: VitalSigns dashboard reports metrics to production piwik [analytics/dashiki] - https://gerrit.wikimedia.org/r/277299 (https://phabricator.wikimedia.org/T128866) [18:20:53] hmmm joal the build seems to be failing because tests fail [18:21:44] madhuvishy: that is expected for a ua parser update [18:22:01] nuria: really? [18:22:05] madhuvishy: we need to look into failing tests and see what might have changed, probably document it [18:22:12] nuria: well [18:22:14] madhuvishy: and fix tests acordingly [18:22:18] i'm not building refinery [18:22:23] i'm building uap-java [18:22:25] madhuvishy: You are talking about up-parser inner tests, right? [18:22:28] we dont maintain the source [18:22:29] ah sorry [18:22:30] ya [18:22:32] not refinery ones [18:22:35] I thought it would be our own tests [18:22:39] right [18:22:40] my mistake [18:22:55] madhuvishy: I don't even manage to submodule update :( [18:23:06] (Abandoned) Nuria: VitalSigns dashboard reports metrics to production piwik [analytics/dashiki] - https://gerrit.wikimedia.org/r/277299 (https://phabricator.wikimedia.org/T128866) (owner: Nuria) [18:23:29] joal: did you just fork it? I did git submodule init and git submodule update --recursive to set it up [18:23:57] and then I pulled from uap-core - commited the submodule [18:24:10] (PS1) Nuria: Correcting whitespace issue on config.yaml [analytics/dashiki] - https://gerrit.wikimedia.org/r/277303 (https://phabricator.wikimedia.org/T128866) [18:24:22] madhuvishy: Unable to checkout '095b648d9350854e05d442137326d73c3a401882' in submodule path 'uap-core' [18:24:30] ottomata: all right I am ignorant, I'll wait for your comment in the phab task : [18:24:33] :( [18:24:35] joal: hmmm [18:24:49] wonder if i should have done something different. [18:25:04] milimetric: can you look at: https://gerrit.wikimedia.org/r/#/c/277303/1/config.yaml I think i missed a whitespace prior [18:25:28] joal: I think I understand why [18:25:38] in .gitmodules [18:26:00] our urls are gerrit urls [18:26:17] i did nothing to push all these commits to that gerrit codebase [18:26:39] i wasnt sure if I should just git review for the 20 or so new commits [18:26:44] joal: ^ [18:26:47] right [18:26:59] may be i should [18:27:04] madhuvishy: What did I merge then ? [18:27:04] (CR) Milimetric: [C: 2 V: 2] "Sorry I missed this in my review, my yaml and json linters have a bug" [analytics/dashiki] - https://gerrit.wikimedia.org/r/277303 (https://phabricator.wikimedia.org/T128866) (owner: Nuria) [18:27:29] joal: you merged a patch to the ua-parser repo - that updates the submodule commit [18:27:41] but I pulled from github to update it [18:27:47] riiiiiiight [18:27:50] and now you are trying to pull from gerrit [18:27:55] I'll revert that [18:28:02] (PS1) Joal: Revert "Update uap-core with latest code from upstream" [analytics/ua-parser] - https://gerrit.wikimedia.org/r/277306 [18:28:08] Dome [18:28:18] joal: well - i think we should push uap-core to gerrit and that patch can stay [18:28:29] i dont know how to push it [18:28:43] Mwarf, I don't know actually :) [18:28:45] elukey: commented [18:28:47] ottomata: let me know when you have a minute [18:28:48] I reverted it (in case ) [18:28:59] madhuvishy: yes! [18:29:01] joal: ya okay we can re revert once fixed [18:29:02] i have minutes for you! [18:29:05] ottomata: okay [18:29:06] so [18:29:15] this uap-core submodule that I updated [18:29:24] I updated by pulling from source in github [18:29:30] Analytics-Tech-community-metrics, DevRel-March-2016, Regression: top-contributors.html only displays seven entries - https://phabricator.wikimedia.org/T129837#2119518 (Aklapper) [18:29:32] Analytics-Tech-community-metrics, DevRel-March-2016: For some people, top-contributors.html displays three-digit numbers instead of names - https://phabricator.wikimedia.org/T128171#2119517 (Aklapper) [18:29:40] but - the gerrit repo that is specified in .gitmodules is now not updated no? [18:29:50] link? [18:29:57] oh uhhh [18:29:59] i see lemme see [18:30:10] https://github.com/wikimedia/analytics-ua-parser/blob/master/.gitmodules [18:30:22] ottomata, I prepared a revert, but did not merge it [18:30:23] https://gerrit.wikimedia.org/r/277306 is my patch [18:30:33] ottomata, madhuvishy let me know if needed [18:30:55] or rather revert of my patch [18:31:04] madhuvishy: i don't understand [18:31:11] Analytics-Tech-community-metrics, DevRel-March-2016: Many profiles on profile.html do not display identity's name though data is available - https://phabricator.wikimedia.org/T117871#2119548 (Aklapper) @Lcanasdiaz: Hmm. Going to http://korma.wmflabs.org/browser/mls.html under "Last 30 days" I see [[ http:... [18:31:11] ua-parser has submodule to our repos [18:31:21] you changed the sha for ssh://gerrit.wikimedia.org:29418/analytics/ua-parser/uap-core [18:31:22] ja? [18:31:25] ottomata: I'll check tomorrow, thanks! [18:31:46] k! [18:31:59] Analytics-Tech-community-metrics, DevRel-March-2016, Regression: top-contributors.html only displays seven entries - https://phabricator.wikimedia.org/T129837#2119554 (Aklapper) This either got fixed or has magically fixed itself in the meantime? http://korma.wmflabs.org/browser/top-contributors.html s... [18:32:19] ottomata: I don't know if I did. I did git pull origin https://github.com/ua-parser/uap-core on our submodule [18:32:39] Analytics-Tech-community-metrics, DevRel-March-2016: Make GrimoireLib display *one* consistent name for one user - https://phabricator.wikimedia.org/T118169#2119557 (Aklapper) \o/ Thanks! [18:32:39] ? [18:32:45] and committed the update at our ua-parser gerrit repo [18:32:52] Analytics-Tech-community-metrics, Developer-Relations, DevRel-March-2016: Play with Bitergia's Kabana UI (which might potential replace our current UI on korma.wmflabs.org) - https://phabricator.wikimedia.org/T127078#2119558 (Aklapper) p:Low>Normal [18:33:29] madhuvishy: how did you update the submodule [18:33:34] ? [18:33:40] git pull origin https://github.com/ua-parser/uap-core [18:33:40] from where? [18:33:50] OH [18:33:52] madhuvishy: yes [18:33:53] ottomata: from inside uap-core [18:33:53] ok, i see [18:33:54] yeah [18:33:57] yeah [18:34:03] so its not in our gerrit copy [18:34:04] you updated it to a commit that does not exist in our repo [18:34:06] ja [18:34:09] yes yes [18:34:12] you need to merge the upstream change into our copy [18:34:15] push that to gerrit [18:34:18] how? [18:34:18] then update teh submodule with that [18:34:20] don't change the remote [18:34:21] git review? [18:34:22] of a submodule [18:34:32] sure, uh, or maybe just push, since you aren't reviewing any of your own code [18:34:35] so [18:34:39] clone the submodule repo [18:34:40] ah [18:34:41] directly [18:34:46] add a remote to github [18:34:57] pull, and then push? [18:34:57] git remote add upstream https://github.com/... [18:35:02] okay [18:35:04] git pull upstream [18:35:05] yeah [18:35:05] then push [18:35:09] if you can't push, lemme know [18:35:11] ok [18:35:20] Thanks for the exaplanation ottomata ! [18:35:21] THEN you'll have new shas in our version [18:35:34] then you can update the submodule's sha in ua-parser [18:35:36] ottomata: no need to revert the inital then : [18:35:49] hopefully not, as long as the sha is the same [18:35:50] going offline a-team, talk with you tomorrow in the EU evening! [18:35:54] byyeeeee o/ [18:35:55] Bye elukey [18:35:56] madhuvishy: you might want to try a rebase instead of a merge, if you can... [18:35:57] not sure [18:36:00] bye elukey ! [18:36:03] git rebase upstream/master [18:36:11] byyyee! [18:36:14] I'm signing off too, see you tomorrow a-team [18:36:15] ottomata: sure - should be no different butya [18:36:20] hopefully :) [18:36:21] Bye mforns :) [18:36:27] :] [18:36:39] often I pull (merge) my puppet (production) master [18:36:44] on which I have never made any local cahnges [18:36:48] and it does merge commits anyway [18:36:48] madhuvishy: Do you need me or shall I leave too ? [18:37:00] joal: you should go! I'll be fine :) [18:37:07] I mean, ottomata is more helpful than I do madhuvishy :) [18:37:08] ja go, i will help [18:37:09] :) [18:37:15] ;) [18:37:22] Thanks lads [18:38:32] ottomata: yeah I can't git push origin master [18:38:40] can only git review [18:38:54] which might cause tons of patches and i dont wanna do that [18:42:50] ja hang on [18:43:59] madhuvishy: try now [18:44:02] uap-core, right? [18:44:21] ottomata: yes [18:44:26] k ja try now [18:46:02] ottomata: cool [18:46:04] done [18:46:18] it's the same commit so no need to merge the other revert [18:47:01] great [18:47:12] ottomata: however [18:47:16] the tests fail [18:47:35] when i try to package uap-java [18:47:48] jaa better [18:47:53] i have stuff now [18:47:56] oh, madhuvishy? [18:48:08] madhuvishy: you may be entering unknown territory for me! :p [18:48:38] ottomata: he he okay i'll figure it out [18:50:11] https://github.com/ua-parser/uap-java/issues/15 [18:53:10] Ironholds: around? what does it take for ua-parser pull requests to be merged? I see you merge stuff :) The build on uap-java is currently failing - there seems to be an open pull request for it though [19:02:01] Analytics-Tech-community-metrics: Mismatch between numbers for code merges per organization - https://phabricator.wikimedia.org/T129910#2119640 (Aklapper) [19:02:12] Analytics-Tech-community-metrics: Mismatch between numbers for code merges per organization - https://phabricator.wikimedia.org/T129910#2119640 (Aklapper) p:Triage>Normal [19:03:16] Analytics-Tech-community-metrics, DevRel-March-2016, Patch-For-Review: What is contributors.html for, in contrast to who_contributes_code.html and sc[m,r]-contributors.html and top-contributors.html? - https://phabricator.wikimedia.org/T118522#1802427 (Aklapper) https://github.com/Bitergia/mediawiki-d... [19:05:43] madhuvishy, lemme take a look [19:05:55] where is the PR? [19:09:12] Ironholds: https://github.com/ua-parser/uap-java/pull/14 [19:09:40] Ironholds: there's one more https://github.com/ua-parser/uap-java/pull/12 [19:09:59] i think they achieve the same thing [19:10:38] and pull request 11 too [19:11:12] Analytics, Operations, hardware-requests, Patch-For-Review: eqiad: (3) AQS replacement nodes - https://phabricator.wikimedia.org/T124947#2119680 (Ottomata) Bump! :) [19:11:14] the build fails without unit test passing? fucking java. [19:11:31] Ironholds: I can skipTests [19:11:36] I'd rather not though [19:12:58] madhuvishy, yeah, understandably. merged! [19:13:05] Ironholds: thank you! [19:13:17] ottomata: can you also give me rights to push to uap-java? [19:13:29] yes [19:13:44] go madhuvishy :) [19:18:51] milimetric: just changed piwik cron [19:18:56]