[04:30:18] 06Revision-Scoring-As-A-Service, 10wikilabels: Review staging protocol for Wikilabels - https://phabricator.wikimedia.org/T133557#2235728 (10yuvipanda) >>! In T133557#2241625, @Ladsgroup wrote: > - Since both wikilabels and wikilabels-staging coexist in a project, using hiera is not an option You can set... [09:47:38] 06Revision-Scoring-As-A-Service, 10wikilabels: Review staging protocol for Wikilabels - https://phabricator.wikimedia.org/T133557#2242314 (10Ladsgroup) >>! In T133557#2241913, @yuvipanda wrote: >>>! In T133557#2241625, @Ladsgroup wrote: >> - Since both wikilabels and wikilabels-staging coexist in a projec... [12:18:51] 06Revision-Scoring-As-A-Service, 10wikilabels: Review staging protocol for Wikilabels - https://phabricator.wikimedia.org/T133557#2242615 (10Ladsgroup) Regarding the DB issue, this resolves it: http://dba.stackexchange.com/questions/46125/why-does-postgres-generate-an-already-used-pk-value ``` SELECT setval('... [13:09:29] o/ [13:09:36] Hey Amir1 [13:09:59] hey halfak [13:10:05] :) [13:10:16] I'm going to get a new version of revscoring in pypi. Sorry for the delay. [13:11:14] no problem at all [13:11:27] I spent some time on this: https://phabricator.wikimedia.org/T133557 [13:11:37] halfak: I have some PRs in wikilabels [13:11:46] it would be great if you take a look at them [13:12:31] halfak: you implement it with hashing vectorizer [13:17:08] o/ GhassanMas [13:17:22] we have been experimenting with hashing vectorizers, yeah. [13:17:39] sabya|away, is working on using one to improve our edit quality models. [13:19:47] Amir1, revscoring 1.2.2 is now uploaded to pypi [13:19:58] awesome [13:20:05] I'll be working on it ASAP [13:20:28] do we need a new version of editquality? since we have them as a submodule [13:20:54] We'll want to update the requirements.txt of editquality and push a new commit. [13:21:04] then we can update the submodule in ores-wikimedia-config. [13:21:32] so we need a new version of them working in pypi as well [13:21:43] Amir1, negative [13:22:03] okay [13:22:09] that would make things much eaiser [13:22:48] https://github.com/wiki-ai/wikilabels/pulls [13:22:53] I need to run away [13:23:05] kk will look at those next [14:52:31] halfak: do you have some time to review these? https://github.com/wiki-ai/wikilabels/pull/114 [14:52:36] https://github.com/wiki-ai/wikilabels/pull/115 [14:52:46] I tested them in labels-experiment [15:06:43] o/ halfak. downloaded all the conent for 19.7K revids and their parents.. phew. now I'll start hv.transforming them. [15:07:16] o/ sabya [15:07:28] I should have showed you that we have utilities for doing this *fast* [15:07:48] But you should continue with what you have for now and I'll show you what we have if you need them later. [15:08:58] ok. [15:10:15] sabya from where can I get the data that you downloaded [15:11:05] i downloaded it on my macbook. [15:12:32] I'' try and see if I can compress and upload it somewhere. currently it stands 947MB uncompressed. [15:12:53] GhassanMas:^ [15:18:28] and you are going to extract the features of 947mb of data from your macbook? [15:26:33] GhassanMas, the hashingvectorizer seems to be fast enough to extract features on a single core. [15:26:44] So I wouldn't worry too much about experimenting on a laptop. [15:26:58] If it does not work for you, I can help you get access to a compute server. [15:28:03] halfak: I'm better now, what is the next to do [15:28:41] Clone halfak so that he can both attend meetings and work. Have one clone review your PRs [15:28:42] ;) [15:30:07] got you halfak [15:30:55] :)))) [15:31:04] it would be nice to review my own patches [15:31:47] Will get to them shortly. [15:31:53] I have to keep going in and out of meeting stuff. [15:43:50] totally fine [15:55:08] Amir1, I hope you don't mind me self-merging into ores wheels. [15:59:07] We're online: https://ores-staging.wmflabs.org/ [15:59:45] Woah! Forgot to update the config! [15:59:48] For the new wikis. [18:14:23] * halfak hacks puppet to add new dicts [18:18:21] YuviPanda, if you have a minute, it would be great to get this simple puppet patch merged: https://gerrit.wikimedia.org/r/#/c/285690/ [18:20:00] halfak: done [18:20:09] Thanks, dude :) [18:23:59] To staging again! [18:32:33] OK. Looks good. I should wait until puppet has a chance to run on the deployment nodes before giving that a try [18:35:17] 06Revision-Scoring-As-A-Service, 10wikilabels: Review staging protocol for Wikilabels - https://phabricator.wikimedia.org/T133557#2244470 (10Halfak) I think we can code `host:` in the staging config. I'll look into that and report back. [18:40:07] 06Revision-Scoring-As-A-Service, 10ores: Deploy updates for ORES - https://phabricator.wikimedia.org/T133558#2244493 (10Halfak) Updates are not on https://ores-staging.wmflabs.org [19:02:21] 06Revision-Scoring-As-A-Service, 10wikilabels: Review staging protocol for Wikilabels - https://phabricator.wikimedia.org/T133557#2244588 (10Halfak) OK. I think this will work: https://github.com/wiki-ai/wikilabels-wikimedia-config/pull/24 [19:58:18] OK time to deploy. :) [20:47:18] 10Revision-Scoring-As-A-Service-Backlog, 10ores: Set up graphite dashboard for ores - https://phabricator.wikimedia.org/T127594#2244891 (10Halfak) https://grafana-admin.wikimedia.org/dashboard/db/ores [20:47:27] 06Revision-Scoring-As-A-Service, 10ores: Set up graphite dashboard for ores - https://phabricator.wikimedia.org/T127594#2244892 (10Halfak) [20:47:39] 06Revision-Scoring-As-A-Service, 10ores: Set up graphite dashboard for ores - https://phabricator.wikimedia.org/T127594#2047856 (10Halfak) a:03Halfak [20:58:14] 06Revision-Scoring-As-A-Service, 10ores: Set up graphite dashboard for ores - https://phabricator.wikimedia.org/T127594#2244927 (10Halfak) This is a better URL. It doesn't require login: https://grafana.wikimedia.org/dashboard/db/ores