[00:37:14] 10Scoring-platform-team, 10Edit-Review-Improvements-Integrated-Filters, 10Growth-Team, 10Patch-For-Review, 10User-Harej: Enable ORES RCFilters for German Wikipedia (dewiki) - https://phabricator.wikimedia.org/T215354 (10Harej) a:05Harej→03None [00:37:25] 10Scoring-platform-team, 10Edit-Review-Improvements-Integrated-Filters, 10Growth-Team, 10Patch-For-Review, 10User-Harej: Enable ORES RCFilters for German Wikipedia (dewiki) - https://phabricator.wikimedia.org/T215354 (10Harej) As a heads up, I will no longer be able to support this project. [00:38:49] 10Scoring-platform-team, 10Goal, 10User-Harej: Bootstrap the Wikimedia AI community - https://phabricator.wikimedia.org/T197979 (10Harej) 05Open→03Declined a:05Harej→03None [00:39:20] 10Jade, 10Scoring-platform-team, 10User-Harej: Determine which wikis will get Jade and when - https://phabricator.wikimedia.org/T199520 (10Harej) a:05Harej→03None [00:39:35] 10Scoring-platform-team, 10Goal: Bootstrap the Wikimedia AI community - https://phabricator.wikimedia.org/T197979 (10Harej) [00:39:51] 10Jade, 10Scoring-platform-team: Determine which wikis will get Jade and when - https://phabricator.wikimedia.org/T199520 (10Harej) [00:40:18] 10Jade: Write API contract for Jade - https://phabricator.wikimedia.org/T217904 (10Harej) a:05Harej→03None [00:41:10] 10Scoring-platform-team, 10Edit-Review-Improvements-Integrated-Filters, 10Growth-Team, 10Patch-For-Review: Enable ORES RCFilters for German Wikipedia (dewiki) - https://phabricator.wikimedia.org/T215354 (10Harej) [00:50:35] 10Jade, 10Scoring-platform-team (Current), 10Design, 10User-Harej: Jade Wireframes: Entity view mode - https://phabricator.wikimedia.org/T212379 (10Harej) a:03Harej [00:51:59] 10Jade, 10Scoring-platform-team (Current), 10User-Testing, 10Design, 10User-Harej: Jade Wireframes: Diff view controls - https://phabricator.wikimedia.org/T212377 (10Harej) a:03Harej [14:53:28] 10Scoring-platform-team (Current), 10Release-Engineering-Team (Watching / External), 10Wikimedia-Incident: [Spike] Write reports about why Ext:ORES is helping cause server 500s and write tasks to fix - https://phabricator.wikimedia.org/T181010 (10Halfak) [14:53:31] 10Scoring-platform-team, 10Documentation, 10Wikimedia-Incident: Document ORES architecture from a robustness perspective - https://phabricator.wikimedia.org/T181831 (10Halfak) 05Open→03Declined I'm not sure what this task is asking for and it has been sitting for a long time. So I'm declining. Please f... [15:00:29] 10ORES, 10Scoring-platform-team: [Discuss] Future ORES architecture - https://phabricator.wikimedia.org/T226193 (10Halfak) [15:03:11] 10ORES, 10Scoring-platform-team, 10RESTBase, 10RESTBase-API, and 2 others: Use RESTBase for ORES precaching - https://phabricator.wikimedia.org/T166161 (10Halfak) We certainly aren't struggling with serving cached results, so I don't think doing this will result in a "significant" decrease in load to the O... [15:06:31] 10ORES, 10Scoring-platform-team: [Discuss] Future ORES architecture - https://phabricator.wikimedia.org/T226193 (10Halfak) We could address quite a lot of **MWAPI IO** by having ChangeProp package data with the request to ORES. We already have the functionality in place to take in such data during a request t... [15:08:03] 10ORES, 10Scoring-platform-team: [Discuss] Future ORES architecture - https://phabricator.wikimedia.org/T226193 (10Halfak) From T166161: > But FWIW, we also use redis for managing our queue of celery workers. So even if we were able to drop the use of redis as a score cache, we'd still have redis as a SPOF fo... [15:38:32] 10ORES, 10Scoring-platform-team, 10RESTBase, 10RESTBase-API, and 2 others: Use RESTBase for ORES precaching - https://phabricator.wikimedia.org/T166161 (10Joe) Hi! ORES is one of the few tools managing its own cache, which is actually **a good thing**. SRE has been asking for a long time not to use restb... [15:56:04] wikimedia/wikilabels#504 (campaign-stats-fix - f5dc8ab : Andy Craze): The build failed. https://travis-ci.org/wikimedia/wikilabels/builds/548276594 [16:02:24] wikimedia/wikilabels#506 (campaign-stats-fix - de8494b : Andy Craze): The build was fixed. https://travis-ci.org/wikimedia/wikilabels/builds/548279763 [16:47:40] PROBLEM - puppet on ORES-web02.Experimental is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [16:53:08] PROBLEM - check disk on ORES-web02.Experimental is CRITICAL: connect to address 172.16.6.234 port 5666: Connection refusedconnect to host ores-web-02.ores.eqiad.wmflabs port 5666: Connection refused [16:54:04] PROBLEM - check load on ORES-web02.Experimental is CRITICAL: connect to address 172.16.6.234 port 5666: Connection refusedconnect to host ores-web-02.ores.eqiad.wmflabs port 5666: Connection refused [16:54:18] icinga2, shhhh [16:54:21] You're crazy [16:54:43] PROBLEM - check users on ORES-web02.Experimental is CRITICAL: connect to address 172.16.6.234 port 5666: Connection refusedconnect to host ores-web-02.ores.eqiad.wmflabs port 5666: Connection refused [16:55:08] ores-web-02 seems to be fine [16:59:22] o/ accraze [16:59:36] I'm running late to "ORES deploy?" but I have some thoughts about what to cover there. [16:59:41] Maybe let's meet at 10 after? [16:59:44] Would that be OK? [17:07:37] OK I'm in [17:16:43] RECOVERY - check users on ORES-web02.Experimental is OK: USERS OK - 1 users currently logged in [17:17:06] RECOVERY - puppet on ORES-web02.Experimental is OK: OK: Puppet is currently enabled, last run 53 seconds ago with 0 failures [17:17:08] RECOVERY - check disk on ORES-web02.Experimental is OK: DISK OK [17:18:04] RECOVERY - check load on ORES-web02.Experimental is OK: OK - load average: 0.83, 0.53, 0.75 [18:00:46] 10Scoring-platform-team, 10Beta-Cluster-Infrastructure: Grant Andy Craze deployment access for beta cluster - https://phabricator.wikimedia.org/T226207 (10Halfak) [18:01:06] 10Scoring-platform-team, 10Beta-Cluster-Infrastructure: Grant Andy Craze deployment access for beta cluster - https://phabricator.wikimedia.org/T226207 (10Halfak) He is https://wikitech.wikimedia.org/wiki/User:Accraze [18:01:23] 10Scoring-platform-team, 10Beta-Cluster-Infrastructure: Grant Andy Craze deployment access for beta cluster - https://phabricator.wikimedia.org/T226207 (10Halfak) AKA: @ACraze [18:32:24] o/ accraze [18:32:30] ready for some more deployment stuff? [18:34:09] yep! i was able to ssh in to ores-web-01.eqiad.wmflabs [18:38:09] Nice! [19:09:32] accraze, before you get to the Wikipedia essays, consider reading this research paper: http://stuartgeiger.com/papers/cscw-sustaining-order-wikipedia.pdf [19:09:39] It's really well written and tells a story. [19:09:58] It's not dry like most research papers ^_^ [19:10:14] It sets up the context of work that our users are doing [19:15:40] OK essay time: [19:18:21] https://etherpad.wikimedia.org/p/aarons_essay_recommendations [19:18:35] There's a few of them I think are fun and useful for a newcomer. [19:20:05] My favorite of the dry essays: https://en.wikipedia.org/wiki/Wikipedia:Verifiability,_not_truth [19:23:43] awesome! thanks for sending these, I'll go through them this afternoon [19:42:45] halfak: thinking about how best to integrate this stuff with mediawiki-utilities [19:43:11] groceryheist, link me to your repo :) [19:43:11] right now it's a bit hacky: I have one script that loads the info for all wikis [19:43:49] one sec let me get to a decent state [19:47:35] https://github.com/groceryheist/mw_revert_tool_detector [19:49:11] so I'm thinking about refactoring it so that there's a wiki-level class [19:58:36] halfak: ^ [20:00:45] Why is "RevertCommentMatcher" a class? [20:00:54] Doesn't seem to do anything but provide a couple of methods [20:04:17] it's just there to store undo_regexes [20:04:33] I could also store that as a global I guess [20:04:58] i usually prefer having state in a class, but i'm comfortable with top-level functions for some reason [20:05:23] I admit my software engineering fundamentals are rusty and abused from too much research hacking [20:06:03] but in this case the initialization is slow. [20:07:15] 10Scoring-platform-team, 10Beta-Cluster-Infrastructure: Grant Andy Craze deployment access for beta cluster - https://phabricator.wikimedia.org/T226207 (10Reedy) I've added him as a member to `deployment-prep`... Does he need to be a project admin too? To answer the question... @Halfak can you deploy ORES on... [20:07:16] Seems like storing the regexes as an asset would make sense. [20:08:23] 10Scoring-platform-team, 10Beta-Cluster-Infrastructure: Grant Andy Craze deployment access for beta cluster - https://phabricator.wikimedia.org/T226207 (10Halfak) Seems like I don't need those rights. So I should be OK. I imagine we gave others those rights in the past so that we could clean up scap direct... [20:09:35] I imagined seeing a function that takes a string (comment) and returns either a tool name or None. [20:09:49] brb [20:09:50] k [20:10:10] yeah that's match_comment [20:10:17] 10Scoring-platform-team, 10Beta-Cluster-Infrastructure: Grant Andy Craze deployment access for beta cluster - https://phabricator.wikimedia.org/T226207 (10Reedy) 05Open→03Resolved a:03Reedy >>! In T226207#5272262, @Halfak wrote: > I imagine we gave others those rights in the past so that we could clean u... [20:10:20] i'm almost done adding rollback and huggle to it [20:11:00] but yeah storing the regexes as an asset makes sense [20:27:50] from wmcomment import match [20:27:56] match(comment) == "undo" [20:28:15] i see [20:28:20] "wmcomment" rather than "mwcomment" [20:28:24] for Wikimedia [20:28:36] But still maybe mwcomment makes more sense. [20:28:45] Wikia still has undo and rollback [20:28:49] Maybe even Huggle! [20:28:59] idk about huggle [20:29:27] but this is pretty tightly coupled to wikimedia right now [20:29:55] so I should make a module that exports a match function [20:30:08] it will bt match(comment, wiki) [20:30:15] *be [20:30:40] so we can just check 1 regex (in most cases) instead of 300 [20:31:11] match(comment, wiki_db) [20:34:59] That sounds good. [20:35:25] cool [20:37:39] 10Scoring-platform-team, 10Beta-Cluster-Infrastructure: Grant Andy Craze deployment access for beta cluster - https://phabricator.wikimedia.org/T226207 (10Halfak) Makes sense. Thanks for your help. [21:16:52] 10ORES, 10Scoring-platform-team, 10Wikidata, 10editquality-modeling, 10artificial-intelligence: ORES is too slow for ORC tool - https://phabricator.wikimedia.org/T226120 (10Halfak) @YMS, I just heard about this. I'd like to see how we might make ORES work better for the ORC tool. Can you let us know an...