[07:48:52] (03CR) 10Thiemo Kreuz (WMDE): [V: 04-1 C: 032] "Needs a manual rebase." [extensions/ORES] - 10https://gerrit.wikimedia.org/r/365544 (owner: 10Felipe L. Ewald) [07:48:59] (03CR) 10jerkins-bot: [V: 04-1] Adjusting the punctuation. [extensions/ORES] - 10https://gerrit.wikimedia.org/r/365544 (owner: 10Felipe L. Ewald) [09:43:47] 10Scoring-platform-team (Current), 10Bad-Words-Detection-System, 10revscoring, 10User-Ladsgroup, 10artificial-intelligence: Add language support for Serbian - https://phabricator.wikimedia.org/T174687#4271282 (10Ladsgroup) Hey there, We already trained models for srwiki and [[https://github.com/wiki-ai/e... [10:38:06] 10Scoring-platform-team (Current), 10editquality-modeling, 10User-Zoranzoki21, 10artificial-intelligence: Train / test reverted model for srwiki - https://phabricator.wikimedia.org/T194745#4271475 (10awight) [10:39:20] 10Scoring-platform-team (Current), 10editquality-modeling, 10User-Zoranzoki21, 10artificial-intelligence: Train / test reverted model for srwiki - https://phabricator.wikimedia.org/T194745#4271493 (10awight) Models merged in: https://github.com/wiki-ai/editquality/pull/160 We should be able to deploy some... [10:46:38] 10Scoring-platform-team (Current), 10Wikilabels, 10articlequality-modeling, 10artificial-intelligence: Train/test article quality model for euwiki - https://phabricator.wikimedia.org/T171119#3454661 (10awight) Model was merged here: https://github.com/wiki-ai/articlequality/pull/67 Deployment is still on... [10:47:26] 10Scoring-platform-team (Current), 10editquality-modeling, 10User-Ladsgroup, 10artificial-intelligence: Deploy pilot edittype model - https://phabricator.wikimedia.org/T196634#4271504 (10awight) [10:53:16] 10Scoring-platform-team (Current), 10editquality-modeling, 10User-Ladsgroup, 10artificial-intelligence: Train/test reverted edittype model for Catalan Wikipedia - https://phabricator.wikimedia.org/T182611#4271532 (10awight) I realized we don't have a model to deploy here, so I'm moving out of "pending depl... [10:54:56] 10Scoring-platform-team (Current), 10editquality-modeling, 10User-Ladsgroup, 10artificial-intelligence: Deploy pilot edittype model - https://phabricator.wikimedia.org/T196634#4271550 (10awight) [10:55:09] 10Scoring-platform-team (Current), 10edittypes-modeling, 10User-Ladsgroup, 10artificial-intelligence: Deploy pilot edittype model - https://phabricator.wikimedia.org/T196634#4263928 (10awight) [10:55:28] 10Scoring-platform-team (Current), 10edittypes-modeling, 10User-Ladsgroup, 10artificial-intelligence: Train/test reverted edittype model for Catalan Wikipedia - https://phabricator.wikimedia.org/T182611#4271552 (10awight) [10:56:54] 10Scoring-platform-team (Current), 10editquality-modeling, 10revscoring, 10artificial-intelligence: Catch a specific new badword in English - https://phabricator.wikimedia.org/T196468#4257592 (10awight) @Halfak Is it correct that we have to rebuild enwiki* editquality models to deploy this change? [11:01:27] 10Scoring-platform-team, 10ORES, 10Patch-For-Review: Implement twemproxy for ORES in production - https://phabricator.wikimedia.org/T122676#4271585 (10awight) p:05Low>03Normal Increasing priority, this is at least normal if not high. I'll create a subtask for the transaction investigation. [11:02:01] 10Scoring-platform-team (Current), 10ORES, 10Patch-For-Review: Implement twemproxy for ORES in production - https://phabricator.wikimedia.org/T122676#4271587 (10awight) [11:05:45] (03PS1) 10Awight: Enable srwiki models [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/439570 (https://phabricator.wikimedia.org/T194745) [11:09:14] (03PS1) 10Awight: Enable euwiki wp10 model [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/439573 (https://phabricator.wikimedia.org/T171119) [11:10:52] (03PS1) 10Awight: Enable bswiki editquality models [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/439575 (https://phabricator.wikimedia.org/T194876) [11:19:57] (03CR) 10Awight: [C: 04-1] Let scores of wp10 models stay in the database forever (034 comments) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/437797 (https://phabricator.wikimedia.org/T194298) (owner: 10Ladsgroup) [11:26:51] 10Scoring-platform-team (Current), 10ORES: Investigate what is creating Redis transactions and whether it can be fixed - https://phabricator.wikimedia.org/T196889#4271684 (10awight) p:05Triage>03Normal [11:28:54] bio time. [11:32:31] (03CR) 10Ladsgroup: Let scores of wp10 models stay in the database forever (033 comments) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/437797 (https://phabricator.wikimedia.org/T194298) (owner: 10Ladsgroup) [11:38:48] 10Scoring-platform-team (Current), 10edittypes-modeling, 10User-Ladsgroup, 10artificial-intelligence: Train/test reverted edittype model for Catalan Wikipedia - https://phabricator.wikimedia.org/T182611#4271726 (10Ladsgroup) a:05Ladsgroup>03None [11:44:08] I'm going to deploy wikilabels [12:01:52] new ui in wikilabels is up \o/ [12:12:46] 10Scoring-platform-team (Current), 10ORES: Investigate what is creating Redis transactions and whether it can be fixed - https://phabricator.wikimedia.org/T196889#4271814 (10awight) This recent discussion makes it look like Celery is responsible for the transaction, and that it's a side-effect of using pipelin... [12:28:44] 10Scoring-platform-team (Current), 10ORES, 10Wikimedia-Hackathon-2018: Using ORES to score your stuff - https://phabricator.wikimedia.org/T194076#4271863 (10Ladsgroup) a:03Halfak [12:28:57] 10Scoring-platform-team (Current), 10ORES, 10Wikimedia-Hackathon-2018: Using ORES to score your stuff - https://phabricator.wikimedia.org/T194076#4187934 (10Ladsgroup) This is done. [12:46:38] 10Scoring-platform-team (Current), 10revscoring, 10User-Ladsgroup, 10artificial-intelligence: Rewrite scoring libraries to replace pywikibase with mwbase - https://phabricator.wikimedia.org/T194758#4271894 (10Ladsgroup) a:03Ladsgroup I will do this [13:00:32] halfak: Amir1: meets? [13:00:41] yup [13:00:45] on my way [13:54:59] 10Scoring-platform-team (Current), 10ORES, 10Wikimedia-Hackathon-2018: Rewrite ORES "reference" UI using React - https://phabricator.wikimedia.org/T195274#4272154 (10awight) @Ladsgroup is waiting on a license for `wikimedia-react-components`, and we'll be able to update the CSS to new style guidelines. [13:56:07] 10Scoring-platform-team (Current), 10ORES, 10Wikimedia-Hackathon-2018: Rewrite ORES "reference" UI using React - https://phabricator.wikimedia.org/T195274#4272160 (10Halfak) I need to review this from a Product perspective. Maybe @harej can start with this as an introductory task. [14:00:26] (03CR) 10Awight: [C: 032] Let scores of wp10 models stay in the database forever (032 comments) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/437797 (https://phabricator.wikimedia.org/T194298) (owner: 10Ladsgroup) [14:02:01] halfak: o/ [14:04:10] codezee: hi! Congratulations: https://ores.wikimedia.org/v3/scores/enwiki/123457?models=drafttopic [14:04:52] awight: oh! i wasn't aware :) [14:05:06] i was planning to attend bs today but saw that it got shifted :D [14:05:35] codezee: We were just juggling timezones, is all... do let us know if the new time is possible for you or not [14:06:20] awight: you all shouldn't adjust bec of me, as i don't know when i'll attend. I'll just join when possible :) [14:06:57] awight: any issues that came up in deployment? [14:07:58] (03Merged) 10jenkins-bot: Let scores of wp10 models stay in the database forever [extensions/ORES] - 10https://gerrit.wikimedia.org/r/437797 (https://phabricator.wikimedia.org/T194298) (owner: 10Ladsgroup) [14:07:58] codezee: Quite a few related to LFS, but that's all the major stuff. [14:08:18] There are minor glitches due to overused or irrelevant project labels [14:08:40] We're working on how to filter those, in coordination with Marshall Miller (WMF) [14:09:06] (03CR) 10jenkins-bot: Let scores of wp10 models stay in the database forever [extensions/ORES] - 10https://gerrit.wikimedia.org/r/437797 (https://phabricator.wikimedia.org/T194298) (owner: 10Ladsgroup) [14:09:21] i'm excited to see the degree of impact that it'll have [14:11:45] codezee: That'll be its own study I'm sure, we should lure you back to be involved in that ;-) [14:36:12] 10Scoring-platform-team (Current), 10ORES, 10Release-Engineering-Team, 10Scap: ORES deployments blocked by mysterious tin.eqiad.wmnet error - https://phabricator.wikimedia.org/T196663#4272342 (10thcipriani) [14:37:41] 10Scoring-platform-team (Current), 10ORES, 10Release-Engineering-Team, 10Scap: ORES deployments blocked by mysterious tin.eqiad.wmnet error - https://phabricator.wikimedia.org/T196663#4264985 (10thcipriani) New scap package was built and the version bump merged in puppet. The new version should be on all t... [14:45:02] Amir1: halfak: looks like the ^ scap thing is unblocked, so head up that I'll try to deploy our pending stuff in today's window, about 6hr from now. [14:46:01] 10Scoring-platform-team (Current), 10ORES, 10Release-Engineering-Team, 10Scap: ORES deployments blocked by mysterious tin.eqiad.wmnet error - https://phabricator.wikimedia.org/T196663#4272360 (10awight) @thcipriani Thanks! I'll retry our deployment in tonight's window and will report back either way. [14:47:01] codezee: u can try the "importScript" line if you want, https://en.wikipedia.org/wiki/User:Adamw/common.js [14:56:01] back in a few. [15:48:17] The enwiki dump (articles) has some strange issue, the "Computer science" article writes about Catalons, not computer science. [15:48:31] - The 2016 11 01 version at least. [15:48:32] 04Error: Command “the” not recognized. Please review and correct what you’ve written. [15:49:10] - The XML version that is. [15:49:11] 04Error: Command “the” not recognized. Please review and correct what you’ve written. [15:49:28] - XML version that is. [15:49:28] 04Error: Command “xml” not recognized. Please review and correct what you’ve written. [16:01:17] 10Scoring-platform-team (Current), 10Bad-Words-Detection-System, 10revscoring, 10User-Ladsgroup, 10artificial-intelligence: Add language support for Serbian - https://phabricator.wikimedia.org/T174687#4272751 (10Acamicamacaraca) @Ladsgroup Okay. I will say to Wikipedians on Serbian Wikipedia. [18:05:30] LUNCH! [18:05:59] apergos, see pressure679's comment [18:06:54] 2016? that's a bit far back hrm [18:58:07] pressure679: if you provide a link I can look at the specific file, but given that it's rather old we would not be republishing it [19:50:29] o/ [19:50:34] Anyone planning to do a deployment today? [19:53:56] * halfak rushes to get a few changes in :) [19:57:50] 10Scoring-platform-team (Current), 10editquality-modeling, 10revscoring, 10artificial-intelligence: Catch a specific new badword in English - https://phabricator.wikimedia.org/T196468#4273592 (10Halfak) yes. that's right. [20:04:40] (03CR) 10Halfak: [C: 04-1] Enable euwiki wp10 model (031 comment) [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/439573 (https://phabricator.wikimedia.org/T171119) (owner: 10Awight) [20:16:24] (03PS1) 10Halfak: Adds models for bswiki, euwiki, and srwiki. [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/439656 [20:18:05] (03PS2) 10Halfak: Adds models for bswiki, euwiki, and srwiki. [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/439656 (https://phabricator.wikimedia.org/T194745) [20:19:25] (03PS3) 10Halfak: Adds models for bswiki, euwiki, and srwiki. [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/439656 (https://phabricator.wikimedia.org/T194745) [20:23:14] 10Scoring-platform-team (Current), 10Bad-Words-Detection-System, 10revscoring, 10User-Ladsgroup, 10artificial-intelligence: Add language support for Serbian - https://phabricator.wikimedia.org/T174687#4273693 (10Halfak) I just put together https://gerrit.wikimedia.org/r/#/c/mediawiki/services/ores/deploy... [20:24:02] 10Scoring-platform-team (Current), 10editquality-modeling, 10Patch-For-Review, 10User-Ladsgroup, 10artificial-intelligence: Train damaging/goodfaith models for Bosnian Wikipedia - https://phabricator.wikimedia.org/T194876#4273699 (10Halfak) I just put together https://gerrit.wikimedia.org/r/#/c/mediawiki... [20:24:25] 10Scoring-platform-team (Current), 10Wikilabels, 10articlequality-modeling, 10Patch-For-Review, 10artificial-intelligence: Train/test article quality model for euwiki - https://phabricator.wikimedia.org/T171119#4273700 (10Halfak) I just put together https://gerrit.wikimedia.org/r/#/c/mediawiki/services/o... [20:25:03] 10Scoring-platform-team (Current), 10Wikilabels, 10articlequality-modeling, 10Patch-For-Review, 10artificial-intelligence: Train/test article quality model for euwiki - https://phabricator.wikimedia.org/T171119#4273704 (10Halfak) This covers @awight's change, addresses my note and handles srwiki and bswi... [20:27:47] pressure679: looks ok in enwiki-20160113-pages-articles [20:28:07] (table skipped) '''Computer science''' is the [[science|scientific]] and practical approach to [[computation]] and its applications. … [20:28:08] 10[1] 04https://meta.wikimedia.org/wiki/science13 => [20:28:11] 10[2] 04https://meta.wikimedia.org/wiki/computation [20:37:15] 10Scoring-platform-team (Current), 10editquality-modeling, 10Patch-For-Review, 10User-Ladsgroup, 10artificial-intelligence: Train damaging/goodfaith models for Bosnian Wikipedia - https://phabricator.wikimedia.org/T194876#4273767 (10Halfak) Arg! I am just realizing that all of these changes were submitt... [20:37:58] (03CR) 10Halfak: [C: 04-1] "This should require an update of the editquality submodule" [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/439575 (https://phabricator.wikimedia.org/T194876) (owner: 10Awight) [21:07:56] (03CR) 10jenkins-bot: Localisation updates from https://translatewiki.net. [extensions/JADE] - 10https://gerrit.wikimedia.org/r/439713 (owner: 10L10n-bot) [21:20:40] (03CR) 10jenkins-bot: Localisation updates from https://translatewiki.net. [extensions/ORES] - 10https://gerrit.wikimedia.org/r/439728 (owner: 10L10n-bot) [21:30:35] 10Scoring-platform-team, 10revscoring, 10Chinese-Sites, 10artificial-intelligence: Chinese language utilities - https://phabricator.wikimedia.org/T109366#4273979 (10Halfak) Sorry for the late reply. We've been really backed up this quarter. I'm hoping to come back to this modeling work in a couple of wee... [21:35:09] precache: {} eh [21:36:10] cool, I see a .rf. model infix I missed, too [21:36:50] (03CR) 10Awight: [C: 032] "Thanks for the cleanup!" [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/439656 (https://phabricator.wikimedia.org/T194745) (owner: 10Halfak) [21:37:49] (03CR) 10Awight: [V: 032 C: 032] Adds models for bswiki, euwiki, and srwiki. [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/439656 (https://phabricator.wikimedia.org/T194745) (owner: 10Halfak) [21:53:35] IT"S HAPENINGF [21:56:40] apergos: The 2016 (1st of Nov.) version has been deprecated. I just wanted to note it in case the error had not been reported. [21:57:03] at thi point I have no idea about dumps that far back... [21:57:26] Platonides: Ok, cool, I am downloading the latest wikipedia dump right now. [21:57:27] thanks for the report though [22:05:43] and it's ok in latest dump, too [22:05:54] bzgrep -A 35 'Computer science<' enwiki-20180601-pages-articles.xml.bz2 [22:06:09] <Platonides> (…) '''Computer science''' is the study of the theory, experimentation, and engineering that form the basis for the design and use… [22:07:00] <Platonides> it's realatively early in the dump [22:07:26] <Platonides> line 681073 [22:28:21] <wikibugs> 10Scoring-platform-team (Current), 10editquality-modeling, 10Patch-For-Review, 10User-Ladsgroup, 10artificial-intelligence: Train damaging/goodfaith models for Bosnian Wikipedia - https://phabricator.wikimedia.org/T194876#4274053 (10awight) 05Open>03Resolved [22:32:26] <awight> halfak: Strange, the ORES home page wasn't updated. I don't see https://github.com/wiki-ai/ores/pull/247 merged to my clone... [22:32:34] <awight> but it's on beta [22:33:16] <awight> probably better to grok in the morning [22:34:01] <wikibugs> 10Scoring-platform-team (Current), 10editquality-modeling, 10Patch-For-Review, 10User-Zoranzoki21, 10artificial-intelligence: Train / test reverted model for srwiki - https://phabricator.wikimedia.org/T194745#4274058 (10awight) 05Open>03Resolved a:03awight [22:38:15] <wikibugs> 10Scoring-platform-team, 10ORES, 10editquality-modeling, 10Collaboration-Team-Triage (Collab-Team-This-Quarter), 10artificial-intelligence: Enable ORES filters on srwiki - https://phabricator.wikimedia.org/T195870#4274077 (10awight) [22:38:17] <wikibugs> 10Scoring-platform-team (Current), 10editquality-modeling, 10Patch-For-Review, 10User-Ladsgroup, 10artificial-intelligence: Train / test damaging and goodfaith models for srwiki - https://phabricator.wikimedia.org/T195063#4274075 (10awight) 05Open>03Resolved [22:38:47] <wikibugs> 10Scoring-platform-team, 10articlequality-modeling, 10artificial-intelligence: Extend feature extractors for euwiki wp10 model - https://phabricator.wikimedia.org/T195604#4274086 (10awight) [22:38:49] <wikibugs> 10Scoring-platform-team (Current), 10Wikilabels, 10articlequality-modeling, 10Patch-For-Review, 10artificial-intelligence: Train/test article quality model for euwiki - https://phabricator.wikimedia.org/T171119#4274083 (10awight) 05Open>03Resolved a:03awight [22:39:56] <wikibugs> 10Scoring-platform-team (Current), 10Analytics, 10EventBus, 10ORES, and 3 others: Numeric keys in ORES models causing downstream Hive ingestion to fail - https://phabricator.wikimedia.org/T195979#4274092 (10awight) Deployed, but I'm not resolving the task until after the Hive revert. [22:41:54] <wikibugs> 10Scoring-platform-team, 10drafttopic-modeling: Rewrite draft topic scripts to fetch linked pages and prepare training data - https://phabricator.wikimedia.org/T193594#4274098 (10awight) [23:06:42] <travis-ci> wiki-ai/revscoring#1492 (2.2.5 - 36ebbde : Adam Wight): The build failed. https://travis-ci.org/wiki-ai/revscoring/builds/391017919 [23:15:29] <wikibugs> (03Abandoned) 10Awight: Enable srwiki models [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/439570 (https://phabricator.wikimedia.org/T194745) (owner: 10Awight) [23:15:38] <wikibugs> (03Abandoned) 10Awight: Enable euwiki wp10 model [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/439573 (https://phabricator.wikimedia.org/T171119) (owner: 10Awight) [23:15:41] <wikibugs> (03Abandoned) 10Awight: Enable bswiki editquality models [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/439575 (https://phabricator.wikimedia.org/T194876) (owner: 10Awight) [23:23:18] <wikibugs> (03PS1) 10Awight: New wheel for revscoring 2.2.5 [research/ores/wheels] - 10https://gerrit.wikimedia.org/r/439785 [23:40:00] <wikibugs> (03PS2) 10Awight: New wheel for revscoring 2.2.5; update libraries [research/ores/wheels] - 10https://gerrit.wikimedia.org/r/439785 [23:41:06] <wikibugs> (03PS1) 10Awight: Fix Makefile for wheel edge cases [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/439789 [23:41:08] <wikibugs> (03PS1) 10Awight: Bump wheels, including revscoring 2.2.5; fix articlequality typo [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/439790 [23:48:59] <travis-ci> wiki-ai/articlequality#89 (T196468 - 317a90f : Adam Wight): The build passed. https://travis-ci.org/wiki-ai/articlequality/builds/391029354 [23:50:52] <awight> o/ [23:52:37] <wikibugs> 10Scoring-platform-team (Current), 10editquality-modeling, 10revscoring, 10artificial-intelligence: Catch a specific new badword in English - https://phabricator.wikimedia.org/T196468#4274217 (10awight) Models are rebuilding on ores-misc-01