[05:35:43] 10Scoring-platform-team, 10Toolforge, 10Wikilabels, 10cloud-services-team (Kanban): Move toolsdb and wikilabels cluster servers for datacenter reconfiguration - https://phabricator.wikimedia.org/T197245#4301486 (10Ladsgroup) I don't think this even needs announcement for wikilabels. [05:40:26] 10Scoring-platform-team, 10ORES, 10UI-Standardization, 10Epic: Make the ORES UIs better - https://phabricator.wikimedia.org/T195607#4301491 (10Ladsgroup) [05:40:36] 10Scoring-platform-team, 10ORES, 10UI-Standardization, 10Epic: Make the ORES UIs better - https://phabricator.wikimedia.org/T195607#4232142 (10Ladsgroup) [05:41:20] 10Scoring-platform-team, 10ORES, 10UI-Standardization, 10Epic: Make the ORES UIs better - https://phabricator.wikimedia.org/T195607#4232142 (10Ladsgroup) For swagger, I'm not sure. The UI is sort of out of our control. Isn't it third party installation of swagger UI? [05:44:37] 10Scoring-platform-team, 10Wikilabels: Labeling campaign for dewiki shows 'revision not found' for all revisions - https://phabricator.wikimedia.org/T194457#4301498 (10Ladsgroup) Can you try again. I just tried and works just fine for me. For any edit that is not found, please skip the edit. [05:47:36] 10Scoring-platform-team, 10Release-Engineering-Team: Another round of discussion about wiki-ai's GitHub->gerrit mirroring - https://phabricator.wikimedia.org/T194212#4192258 (10Ladsgroup) Maybe we should start the work by moving our repos from wiki-ai org to wikimedia. I get notifications for pull request in r... [05:50:39] 10Scoring-platform-team, 10ORES: ORES beta will need more disk space - https://phabricator.wikimedia.org/T192311#4134487 (10Ladsgroup) deployment-ores01 is 80 GB per horizon. Should we call this done? [05:57:47] 10Scoring-platform-team (Current), 10ORES, 10Epic: Migrate Scoring services to Debian Stretch - https://phabricator.wikimedia.org/T186238#4301523 (10Ladsgroup) [06:01:03] 10Scoring-platform-team: Scoring Platform FY18 Q3 - https://phabricator.wikimedia.org/T183198#4301526 (10Ladsgroup) 05Open>03Resolved a:03Halfak Q4 is about to finish. Let's close this. [06:15:57] 10Scoring-platform-team, 10User-Ladsgroup: Could use some more disk space on ores-misc-01.ores-staging.eqiad.wmflabs:/srv - https://phabricator.wikimedia.org/T179592#4301529 (10Ladsgroup) 05Open>03Resolved a:03Ladsgroup The instance is renewed and everything in it is cleaned: ``` ladsgroup@ores-misc-01:/... [07:43:50] 10Scoring-platform-team (Current), 10ORES-Support-Checklist, 10User-Ladsgroup: Cleanup the code for ores-support-checklist - https://phabricator.wikimedia.org/T191769#4301638 (10Ladsgroup) a:03Ladsgroup https://github.com/wiki-ai/ores-support-checklist/pull/3 [07:44:36] wiki-ai/ores-support-checklist#9 (cleanup - b1f394f : Amir Sarabadani): The build passed. https://travis-ci.org/wiki-ai/ores-support-checklist/builds/394437870 [07:46:10] 10Scoring-platform-team (Current), 10ORES-Support-Checklist, 10User-Ladsgroup: Cleanup the code for ores-support-checklist - https://phabricator.wikimedia.org/T191769#4301644 (10Ladsgroup) There's one thing that hasn't been done and it's the hardcoded path in updater.sh, It's hard to load yaml files in bash... [07:54:48] 10Scoring-platform-team, 10MediaWiki-extensions-ORES, 10User-Ladsgroup: Some of the version strings in the ores_model table have quotation marks around them and some don't - https://phabricator.wikimedia.org/T196238#4301672 (10Ladsgroup) 05Open>03Resolved a:03Ladsgroup Yes, It won't be used, so resolvi... [07:55:36] 10Scoring-platform-team (Current), 10ORES, 10UI-Standardization, 10Epic: Make the ORES UIs better - https://phabricator.wikimedia.org/T195607#4301676 (10Ladsgroup) [07:56:13] 10Scoring-platform-team, 10editquality-modeling, 10artificial-intelligence: Train / test a reverted model for bswiki - https://phabricator.wikimedia.org/T194743#4207207 (10Ladsgroup) We have the advanced support for bswiki now. Should we decline this? [08:03:39] 10Scoring-platform-team, 10ORES: ORES beta will need more disk space - https://phabricator.wikimedia.org/T192311#4301695 (10awight) 05Open>03Resolved a:03awight Yes, thanks for noticing! The big difference was actually the /srv puppet role, which made the bulk of the disk accessible. For future referen... [08:06:58] 10Scoring-platform-team (Current), 10Analytics, 10Analytics-Kanban, 10EventBus, and 4 others: Modify revision-score schema so that model probabilities won't conflict - https://phabricator.wikimedia.org/T197000#4301699 (10awight) I'm not sure if it's in a format that might be helpful for this task, but we h... [08:19:38] Amir1: I'm reading about your work to stop logging autopatrolled edits, but I haven't found an example of what these records looked like. Can you share clues? [08:20:19] awight: I deleted all the records, even in beta cluster :d [08:20:23] aha! [08:20:43] wowza, > I have already deleted 1.1B rows from the database [08:20:44] it was half a million just in wikidata in beta cluster [08:20:57] awight: the correct number is 1.4B now [08:22:02] awight: if you want to see https://www.wikidata.org/w/index.php?title=Special%3ALog&type=patrol&user=&page=&year=&month=-1&tagfilter=&hide_thanks_log=1&hide_patrol_log=0&hide_tag_log=1 [08:22:33] 10Scoring-platform-team (Current), 10Analytics, 10Analytics-Kanban, 10EventBus, and 4 others: Modify revision-score schema so that model probabilities won't conflict - https://phabricator.wikimedia.org/T197000#4275600 (10Gaboe420) El El mar, 12 de junio de 2018 a la(s) 07:38, Ottomata < no-reply@phabricato... [08:24:00] Cool--What I was most curious about was how many manual patrolling actions there are. Counting on frwiki at the moment... [08:24:09] select count(*) from logging where log_timestamp > '20170620000000' and log_action = 'patrol'; [08:24:17] 212k [08:25:06] 10Scoring-platform-team, 10ORES: Discuss whether we can have ORES provide explanations for its predictions - https://phabricator.wikimedia.org/T196475#4301712 (10awight) Also, https://github.com/adamwight/ores-lime/blob/master/Explain%20draft%20topic.ipynb [08:25:07] Amir1: You might like ^ [08:25:17] I put some very rough drafts together, and the results are fun. [08:26:45] awight: thanks! [08:27:27] awight: I added lots of comments in tickets you are subscribed to. Please take a look [08:27:33] were doing a little bit of clean up [08:27:40] If it seems useful, I think we should write a custom perturbation module to explore things like how each word in a diff contributes to its score. [08:29:21] 10Scoring-platform-team, 10ORES, 10Wikibase-Quality-Constraints, 10Wikidata: quick overview of the quality of an item - https://phabricator.wikimedia.org/T195703#4234701 (10Ladsgroup) A little bit of design help would be really appreciated <3 [08:32:42] awight: The delete stats https://docs.google.com/spreadsheets/d/1EKI_dCGLd9JTmz15JBRvgf0G58bhCzGiJKKTihLMr3k/edit#gid=0 [08:33:48] That's quite a scoreboard :-D [08:45:32] scoreboard of honor :D [08:45:39] heck yeah man [08:46:10] I think I have PTSD from running commands in the fundraising CMS DB... [08:46:40] I'm officially done with the thing, currently working on normalizing change_tag table. The most horrible table in mediawiki (TM) [08:46:48] I started playing tricks on myself like starting SQL lines with "EXPLAIN " before I typed anything else. [08:46:56] hehe thanks for doing all that [08:48:09] Both are my infrastructure work for wikidata, autpatrol logs were 99.1% of logging table in wikidata and change tag in wikidata is crazy (absolute crazy) [08:49:04] They don't have you doing the easy stuff [08:49:29] https://www.flickr.com/photos/somabiswas/36047314642/in/album-72157686969614425/ [08:49:58] That looks so awesome! [08:51:10] my kids were licking the walls... [08:51:42] According to local lore, nobody knows why a salt river shoots out of the mountain, nor whether it will run out one day. [08:53:16] If it runs out, it will be problematic for people who make a living out of it :/ [08:55:13] 10Scoring-platform-team (Current), 10JADE, 10Operations, 10User-Joe: Extension:JADE scalability concerns due to creating a page per revision - https://phabricator.wikimedia.org/T196547#4301801 (10awight) Back to giving a reasonable estimate, now that we're only planning for human patrolling actions. frwik... [08:55:23] 10Scoring-platform-team (Current), 10ORES, 10Wikidata, 10User-Ladsgroup: new ORES labeling campaign for Wikidata - https://phabricator.wikimedia.org/T195701#4301803 (10Ladsgroup) a:03Ladsgroup I'm on this. Making two queries for now: https://quarry.wmflabs.org/query/27748 and https://quarry.wmflabs.org/q... [09:28:37] Amir1: Do you agree we should close the parent task and leave T186239 active? [09:28:37] T186239: Migrate ORES CI to Stretch - https://phabricator.wikimedia.org/T186239 [09:36:06] awight: it would work for me! [09:37:59] 10Scoring-platform-team (Current), 10ORES, 10Epic: Migrate Scoring services to Debian Stretch - https://phabricator.wikimedia.org/T186238#4301964 (10awight) 05Open>03Resolved a:03awight The only subtask is in CI and has been decoupled from the more critical work, closing this epic. [09:39:49] 10Scoring-platform-team, 10Release-Engineering-Team: Another round of discussion about wiki-ai's GitHub->gerrit mirroring - https://phabricator.wikimedia.org/T194212#4301982 (10awight) >>! In T194212#4301513, @Ladsgroup wrote: > Maybe we should start the work by moving our repos from wiki-ai org to wikimedia.... [09:47:38] 10Scoring-platform-team, 10ORES: Experiment with LIME integration for ORES, providing explanations for its predictions - https://phabricator.wikimedia.org/T196475#4302011 (10awight) [09:51:55] What is "webservice" on tools.wmflab? [09:52:31] omg, something specific to toollabs [09:52:32] nvm [10:04:40] awight: webservice is, I think, the thing that lets your webpage display [10:04:58] the tool webpage [10:05:03] or instance [10:07:18] 10Scoring-platform-team, 10Release-Engineering-Team: Another round of discussion about wiki-ai's GitHub->gerrit mirroring - https://phabricator.wikimedia.org/T194212#4302077 (10awight) @Ladsgroup, I realized that I don't understand a key part of your plan: Would GitHub or Gerrit be the master repo if we move t... [10:08:08] Hauskatze: Thanks--and webservice comes with a pretty simple command line! [10:08:28] I guess I need to add to the documentation, with an explanation of how to run the flask app on a local machine. [10:10:34] 10Scoring-platform-team, 10Release-Engineering-Team: Another round of discussion about wiki-ai's GitHub->gerrit mirroring - https://phabricator.wikimedia.org/T194212#4302083 (10Ladsgroup) Yes, https://github.com/wikimedia/readinglists-extension-safari and https://github.com/wikimedia/change-propagation are som... [10:11:07] cool! [10:11:09] wiki-ai/ores-support-checklist#12 (rel_path - 9bd25ef : Adam Wight): The build passed. https://travis-ci.org/wiki-ai/ores-support-checklist/builds/394486713 [10:11:24] awight: afaik, webservice --stop and webservice --start does it [10:11:33] 10Scoring-platform-team, 10Release-Engineering-Team: Another round of discussion about wiki-ai's GitHub->gerrit mirroring - https://phabricator.wikimedia.org/T194212#4302084 (10awight) :D okay, I'm all for the plan in that case. [10:11:40] 10Scoring-platform-team, 10Release-Engineering-Team: Another round of discussion about wiki-ai's GitHub->gerrit mirroring - https://phabricator.wikimedia.org/T194212#4302085 (10Ladsgroup) Also, why not moving them to gerrit? I +1 on moving it to gerrit. [10:12:09] there are other things I think but for the webservice I run on stewardbots the page is very 1999-style so I don't need much else ;) [10:14:51] 10Scoring-platform-team, 10Release-Engineering-Team: Another round of discussion about wiki-ai's GitHub->gerrit mirroring - https://phabricator.wikimedia.org/T194212#4302092 (10awight) Hehe, I see you've upped the ante. Well, we can't get a much lower volume of outsider patches so I don't see much argument fo... [10:20:46] Amir1: Two PRs waiting for you in ores-support-checklist [10:20:52] wiki-ai/ores-support-checklist#15 (doc - 2fd3a37 : Adam Wight): The build passed. https://travis-ci.org/wiki-ai/ores-support-checklist/builds/394490021 [10:21:16] I'll try to wire up GH notifications [10:21:25] speaking of non-standard :p [10:25:42] Oooh, poison. https://github.com/marketplace [10:26:47] wait until it start to look like [10:26:50] https://usercontent.irccloud-cdn.com/file/K94Etcb8/image.png [10:27:18] lawl nice [10:27:21] "5 free commits unlocked" [10:27:52] clippy! [10:28:17] nihilist design exercise [11:07:06] 10Scoring-platform-team, 10Research, 10Wikilabels, 10Research-2017-18-Q3, 10Research-2017-18-Q4: Design a data collection pilot using WikiLabels platform (mining reasons) - https://phabricator.wikimedia.org/T186351#4302295 (10Miriam) [11:53:33] 10Scoring-platform-team (Current), 10ORES, 10Wikidata, 10User-Ladsgroup: new ORES labeling campaign for Wikidata - https://phabricator.wikimedia.org/T195701#4302437 (10Ladsgroup) Given that the query got killed because it took too long, I did it manually on stat1005. {P7273} @Halfak If this looks fine to y... [14:00:32] 10Scoring-platform-team (Current), 10Analytics, 10Analytics-Kanban, 10EventBus, and 4 others: Modify revision-score schema so that model probabilities won't conflict - https://phabricator.wikimedia.org/T197000#4302780 (10Ottomata) @awight that is interesting. The judgement definitions seem to at least des... [14:35:07] o/ [14:35:11] I made it! [14:42:12] Curses upon BART [14:42:20] How's the blood pressure... [14:42:50] I'm having a hard time finding a page that drafttopic doesn't work for :-) [14:53:17] 10Scoring-platform-team, 10Multi-Content-Revisions, 10ORES: MCR support in ORES - https://phabricator.wikimedia.org/T195779#4236781 (10awight) Thanks for bringing this up! We probably have the same issue with JADE, it's targeting (wiki, rev_id), but now we need (wiki, rev_id, slot_id). [14:57:53] 10Scoring-platform-team, 10JADE: Host JADE schemas on metawiki - https://phabricator.wikimedia.org/T194220#4302976 (10awight) 05Open>03Invalid I think this was a bad idea. `Schema` is used for another format of schema, but we want to stick with JSON-schema. [15:01:40] 10Scoring-platform-team: Clean up all revscoring 2.0 requirements, -> 2.1 - https://phabricator.wikimedia.org/T185897#4303023 (10awight) 05Open>03declined [15:06:27] 10Scoring-platform-team, 10ORES, 10Operations: Tuning profile::ores::celery parameters should cause a Celery service restart - https://phabricator.wikimedia.org/T182203#3816483 (10awight) 05Open>03declined I learned that Ops would rather restart the services explicitly [15:14:00] awight, you coming to docs meeting? [15:37:11] I need to run my rental bike back. I'll be back in a bit [20:25:22] 10Scoring-platform-team (Current), 10Documentation, 10Easy: Document JADE judgment structure - https://phabricator.wikimedia.org/T179301#4303851 (10Halfak) Both should have guid. We should be able to extract author information from the API or elsewhere. It's sort of like storing only the Qid in a wikidata... [20:29:20] awight, still around? [20:29:29] I'm not sure I understand your comment in ^ [20:38:31] 10Scoring-platform-team (Current), 10ORES, 10UI-Standardization, 10Epic: Make the ORES UIs better - https://phabricator.wikimedia.org/T195607#4303872 (10Halfak) There's more that we could do for swagger UI, but it wouldn't be style-related. I think a review of what shows up in swagger and a set of propose... [20:39:29] 10Scoring-platform-team, 10editquality-modeling, 10artificial-intelligence: Train / test a reverted model for bswiki - https://phabricator.wikimedia.org/T194743#4303873 (10Halfak) 05Open>03declined [20:41:24] 10Scoring-platform-team, 10ORES, 10Wikibase-Quality-Constraints, 10Wikidata: quick overview of the quality of an item - https://phabricator.wikimedia.org/T195703#4303875 (10Halfak) @Lydia_Pintscher do you want some design work on this before we resolve or should we consider this done for now? [20:44:06] 10Scoring-platform-team (Current), 10ORES, 10Wikidata, 10User-Ladsgroup: new ORES labeling campaign for Wikidata - https://phabricator.wikimedia.org/T195701#4303876 (10Halfak) What's the purpose of the editcount restriction? [20:45:40] 10Scoring-platform-team (Current), 10Analytics, 10Analytics-Kanban, 10EventBus, and 4 others: Modify revision-score schema so that model probabilities won't conflict - https://phabricator.wikimedia.org/T197000#4303877 (10Halfak) Looks like we have some issues in the schema, but this is the access pattern w... [20:47:17] 10Scoring-platform-team (Current), 10Analytics, 10Analytics-Kanban, 10EventBus, and 4 others: Modify revision-score schema so that model probabilities won't conflict - https://phabricator.wikimedia.org/T197000#4303879 (10Ottomata) This is not long at all! I will submit a patch and attempt to just include... [20:47:40] 10Scoring-platform-team (Current), 10Analytics, 10Analytics-Kanban, 10EventBus, and 3 others: Fix "score_schema" -- invalid JSON Schema - https://phabricator.wikimedia.org/T197828#4303880 (10Halfak) p:05Triage>03High [20:48:08] 10Scoring-platform-team (Current), 10Analytics, 10Analytics-Kanban, 10EventBus, and 3 others: Fix "score_schema" -- invalid JSON Schema - https://phabricator.wikimedia.org/T197828#4303894 (10Halfak) Any other issues? [20:55:02] 10Scoring-platform-team (Current), 10Analytics, 10Analytics-Kanban, 10EventBus, and 3 others: Fix "score_schema" -- invalid JSON Schema - https://phabricator.wikimedia.org/T197828#4303902 (10Ottomata) OO true! ok [21:23:20] 10Scoring-platform-team (Current), 10Analytics, 10EventBus, 10ORES, and 3 others: Invalid field names in ORES models causing downstream Hive ingestion to fail - https://phabricator.wikimedia.org/T195979#4303927 (10Ottomata) Hey @Ladsgroup @awight ... https://ores.wikimedia.org/v3/scores/enwiki/?model_info... [21:33:56] 10Scoring-platform-team (Current), 10Analytics, 10Analytics-Kanban, 10EventBus, and 4 others: Modify revision-score schema so that model probabilities won't conflict - https://phabricator.wikimedia.org/T197000#4303970 (10Ottomata) Oh, this is not easy. The schema's have a few incompatible field names as n... [21:37:34] 10Scoring-platform-team, 10Analytics, 10Analytics-Kanban, 10EventBus, and 5 others: Emit revision-score event to EventBus and expose in EventStreams - https://phabricator.wikimedia.org/T167180#4303988 (10Ottomata) Due to the very harry problems in T195979 and T197000, I'm considering removing revision-scor... [22:09:47] 10Scoring-platform-team (Current), 10Documentation, 10Easy: Document JADE judgment structure - https://phabricator.wikimedia.org/T179301#4304042 (10awight) >>! In T179301#4303851, @Halfak wrote: > Both should have guid. We should be able to extract author information from the API or elsewhere. It's sort of...