[09:59:42] 10ORES, 10Scoring-platform-team, 10MediaViewer, 10MediaWiki-Core-Testing, and 7 others: Audit tests/selenium/LocalSettings.php file aiming at possibly deprecating the feature - https://phabricator.wikimedia.org/T199939 (10awight) [10:00:19] 10ORES, 10Scoring-platform-team, 10MediaViewer, 10MediaWiki-Core-Testing, and 7 others: Audit tests/selenium/LocalSettings.php file aiming at possibly deprecating the feature - https://phabricator.wikimedia.org/T199939 (10awight) [10:02:02] 10ORES, 10Scoring-platform-team, 10MediaViewer, 10MediaWiki-Core-Testing, and 7 others: Audit tests/selenium/LocalSettings.php file aiming at possibly deprecating the feature - https://phabricator.wikimedia.org/T199939 (10awight) [12:48:10] 10ORES, 10Scoring-platform-team (Current), 10Patch-For-Review, 10Puppet: Require git-lfs in ores::base puppet role - https://phabricator.wikimedia.org/T232494 (10akosiaris) I wonder how was though git-lfs populated in the first place on the old worker nodes? manually perhaps? Anyway, one clean way out of t... [13:45:51] 10MediaWiki-extensions-ORES, 10Scoring-platform-team, 10Advanced-Search, 10CirrusSearch, and 7 others: Delete selenium-daily-beta-EXTENSION Jenkins jobs that are broken more than 30 days - https://phabricator.wikimedia.org/T232608 (10zeljkofilipin) [13:47:32] 10MediaWiki-extensions-ORES, 10Scoring-platform-team, 10Advanced-Search, 10CirrusSearch, and 8 others: Delete selenium-daily-beta-EXTENSION Jenkins jobs that are broken more than 30 days - https://phabricator.wikimedia.org/T232608 (10zeljkofilipin) [13:58:53] 10MediaWiki-extensions-ORES, 10Scoring-platform-team, 10Advanced-Search, 10CirrusSearch, and 8 others: Delete selenium-daily-beta-EXTENSION Jenkins jobs that are broken more than 30 days - https://phabricator.wikimedia.org/T232608 (10zeljkofilipin) [14:02:47] Technical Advice IRC meeting starting in 60 minutes in channel #wikimedia-tech, hosts: @amir1 & @nuria - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [14:42:16] 10MediaWiki-extensions-ORES, 10Scoring-platform-team, 10Advanced-Search, 10CirrusSearch, and 9 others: Delete selenium-daily-beta-EXTENSION Jenkins jobs that are broken more than 30 days - https://phabricator.wikimedia.org/T232608 (10zeljkofilipin) [14:52:46] Technical Advice IRC meeting starting in 10 minutes in channel #wikimedia-tech, hosts: @amir1 & @nuria - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [15:20:52] 10MediaWiki-extensions-ORES, 10Scoring-platform-team, 10Advanced-Search, 10CirrusSearch, and 8 others: Delete selenium-daily-beta-EXTENSION Jenkins jobs that are broken more than 30 days - https://phabricator.wikimedia.org/T232608 (10zeljkofilipin) >>! In T232608#5483361, @dcausse wrote: > I'm not sure we... [15:42:38] (03PS1) 10Paladox: Modify access rules [research/ores/wheels] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/535878 [15:43:32] (03CR) 10Halfak: [V: 03+2 C: 03+2] Modify access rules [research/ores/wheels] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/535878 (owner: 10Paladox) [15:49:25] (03PS1) 10Paladox: Grant force push to research-ores [research/ores/wheels] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/535880 [15:49:33] (03Abandoned) 10Paladox: Modify access rules [research/ores/wheels] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/535721 (owner: 10Paladox) [16:21:17] * halfak wonders where accraze is [17:01:58] o/ halfak [17:02:13] Aha! on time today I see. :P [17:47:26] o/ accraze [17:47:37] Just saw your email. [17:51:37] cool, yeah power is back on now [17:53:40] My standup is: [17:54:36] y: Wrote a sub-pitch for the opportunity fund. Reviewed and contributed to docs PRs. Uploaded the ORES paper to arxiv (waiting for it to become public). Started working on offsite planning. [17:55:31] Y: Continue offsite planning. Some fixing to do with the arxiv record. More uwsgi doom (forgot I did a bunch with that yesterday). And working on an ORES deploy (got unblocked on the wheels repo -- maybe). [17:55:38] *T: [17:55:40] lol [17:55:42] 10Scoring-platform-team, 10MediaWiki-API, 10Wikimedia-database-error, 10Wikimedia-production-error: Certain prop=revisions API queries timeout with "internal_api_error_DBQueryError" - https://phabricator.wikimedia.org/T121333 (10WDoranWMF) [17:55:43] Two yesterdays [17:55:44] :) [17:56:08] let me know if you need any help with the deploy [17:56:20] 10Scoring-platform-team, 10MediaWiki-API, 10Wikimedia-database-error, 10Wikimedia-production-error: Certain prop=revisions API queries timeout with "internal_api_error_DBQueryError" - https://phabricator.wikimedia.org/T121333 (10eprodromou) We think this isn't something we can be helpful with, so I'm unta... [18:43:12] Mirroring is broken for our ORES gerrit mirror. [18:43:27] WHAT THE FLOWERS! ---,--'--@ [18:46:18] Oh. Nevermind. I was working from a branch :| [18:46:45] Nope. Still broken [18:52:42] Yup. Officially broken. [18:52:49] * halfak sticks head in sand and yells [18:55:52] oof [19:01:24] (03CR) 10Halfak: [V: 03+2 C: 03+2] Grant force push to research-ores [research/ores/wheels] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/535880 (owner: 10Paladox) [19:21:12] 10Scoring-platform-team, 10Analytics, 10EventBus: Change event.mediawiki_revision_score schema to use map types - https://phabricator.wikimedia.org/T225211 (10Ottomata) [19:22:54] 10Scoring-platform-team, 10Analytics, 10EventBus: Change event.mediawiki_revision_score schema to use map types - https://phabricator.wikimedia.org/T225211 (10Ottomata) @JAllemandou @Pchelolo Q: do we want to have `scores` be a map type keyed by model name, or still an array of objects? (We'll certainly cha... [19:23:48] 10Scoring-platform-team, 10Analytics, 10EventBus: Change event.mediawiki_revision_score schema to use map types - https://phabricator.wikimedia.org/T225211 (10Ottomata) [19:24:04] 10ORES, 10Scoring-platform-team (Current): ORES deploy early Sept. 2019 - https://phabricator.wikimedia.org/T232660 (10Halfak) [19:24:48] 10ORES, 10Scoring-platform-team (Current): ORES deploy early Sept. 2019 - https://phabricator.wikimedia.org/T232660 (10Halfak) [19:24:50] 10ORES, 10Scoring-platform-team (Current): POST method not allowed for some ORES endpoints - https://phabricator.wikimedia.org/T232500 (10Halfak) [19:24:52] 10ORES, 10Scoring-platform-team (Current): Feature injection doesn't work when using "?revids=" param - https://phabricator.wikimedia.org/T232143 (10Halfak) [19:24:54] 10ORES, 10Scoring-platform-team (Current): ORES is creating a lot of metrics. This is due to revid count-based metrics - https://phabricator.wikimedia.org/T232164 (10Halfak) [19:25:32] 10ORES, 10Scoring-platform-team (Current), 10Repository-Admins: Update k18 password in phab diffusion - https://phabricator.wikimedia.org/T232661 (10Halfak) [19:25:43] 10ORES, 10Scoring-platform-team (Current), 10Repository-Admins: Update k18 password in phab diffusion - https://phabricator.wikimedia.org/T232661 (10Halfak) a:05Halfak→03None [19:25:48] 10ORES, 10Scoring-platform-team (Current), 10Repository-Admins: Update k18 password in phab diffusion - https://phabricator.wikimedia.org/T232661 (10Halfak) Seems to have gone out of date. [19:26:58] 10Scoring-platform-team, 10Analytics, 10EventBus: Change event.mediawiki_revision_score schema to use map types - https://phabricator.wikimedia.org/T225211 (10Ottomata) [19:27:18] 10ORES, 10Scoring-platform-team (Current), 10Repository-Admins: Update k18 password in phab diffusion - https://phabricator.wikimedia.org/T232661 (10Halfak) FYI, this all started with me not seeing changes from https://phabricator.wikimedia.org/source/ores pushed to https://gerrit.wikimedia.org/r/scoring/ore... [19:36:47] 10Scoring-platform-team, 10Analytics, 10EventBus: Change event.mediawiki_revision_score schema to use map types - https://phabricator.wikimedia.org/T225211 (10Pchelolo) >>! In T225211#5485276, @Ottomata wrote: > @JAllemandou @Pchelolo Q: do we want to have `scores` be a map type keyed by model name, or still... [19:41:10] 10Scoring-platform-team, 10Analytics, 10EventBus: Change event.mediawiki_revision_score schema to use map types - https://phabricator.wikimedia.org/T225211 (10JAllemandou) I like the idea of having the model-name as map-key. Only limitation I can think of is that only one model version can be reported on a r... [19:42:19] 10Scoring-platform-team, 10Analytics, 10EventBus: Change event.mediawiki_revision_score schema to use map types - https://phabricator.wikimedia.org/T225211 (10Ottomata) I think we were told by ORES folks that that would never happen (at least not for a given revision-score event). If a revision is again scor... [20:00:16] Fail! No deplpoyment [20:00:20] Blocked on releng [20:08:39] 10Scoring-platform-team, 10Analytics, 10EventBus: Change event.mediawiki_revision_score schema to use map types - https://phabricator.wikimedia.org/T225211 (10JAllemandou) I recall that as well @Ottomata - My note was purely theoretical :) I'm fully in favor of having a map keyed by model names. [20:09:08] 10Scoring-platform-team, 10Analytics, 10EventBus: Change event.mediawiki_revision_score schema to use map types - https://phabricator.wikimedia.org/T225211 (10Ottomata) :) [20:30:55] accraze, I'm running late for backlog grooming if you were planning to join me. [20:37:29] oh yeah be there in a sec, got lost in jade stuff [21:02:39] 10ORES, 10Scoring-platform-team (Current): Investigate intermittent delay for basic uwsgi requests. - https://phabricator.wikimedia.org/T232228 (10Halfak) a:03Halfak [21:05:31] 10ORES, 10Scoring-platform-team, 10good first bug: Limit rev_ids in an ORES request to 50. - https://phabricator.wikimedia.org/T232005 (10Halfak) [21:06:04] 10Scoring-platform-team, 10editquality-modeling, 10artificial-intelligence: Why is jawiki's goodfaith model so bad? - https://phabricator.wikimedia.org/T230953 (10Halfak) p:05Triage→03Low [21:07:48] 10Scoring-platform-team, 10editquality-modeling, 10artificial-intelligence: Why is jawiki's goodfaith model so bad? - https://phabricator.wikimedia.org/T230953 (10Halfak) We need someone from Japanese Wikipedia to help out with this. @keegan, do you have any suggestions for how we might find a Japanese Wiki... [21:11:36] 10ORES, 10Scoring-platform-team (Current), 10Operations, 10serviceops: celery-ores-worker service failed on ores100[2,4,5] without any apparent reason or significant log - https://phabricator.wikimedia.org/T230917 (10Halfak) @Dzahn, what would it take to implement a check like the one I described above? I... [21:12:09] 10ORES, 10Scoring-platform-team (Current): Monitor ORES celery worker status - https://phabricator.wikimedia.org/T230931 (10Halfak) [21:13:31] 10Scoring-platform-team, 10drafttopic-modeling: Key-value extraction misses on Wikipedia:WikiProject Council/Directory/WikiProject template invocations - https://phabricator.wikimedia.org/T229401 (10Halfak) p:05Triage→03Normal [21:13:51] 10Jade, 10Scoring-platform-team, 10Epic, 10Goal: Complete Jade documentation - https://phabricator.wikimedia.org/T229967 (10Halfak) p:05Triage→03Low [21:14:28] 10Jade, 10Scoring-platform-team, 10Documentation, 10Epic, 10Goal: Write Jade extension documentation - https://phabricator.wikimedia.org/T229968 (10Halfak) p:05Triage→03Low [21:15:29] 10Scoring-platform-team, 10revscoring, 10artificial-intelligence, 10good first bug: Consistent ordering in model_info files - https://phabricator.wikimedia.org/T229445 (10Halfak) p:05Triage→03Normal [21:15:47] 10ORES, 10Scoring-platform-team, 10good first bug: Limit rev_ids in an ORES request to 50. - https://phabricator.wikimedia.org/T232005 (10Halfak) p:05Triage→03Normal [21:16:05] 10ORES, 10Scoring-platform-team: Add all models to fakewiki - https://phabricator.wikimedia.org/T228799 (10Halfak) p:05Triage→03Lowest [21:16:21] 10Jade, 10Scoring-platform-team, 10Epic: Implement Jade Entity pages - https://phabricator.wikimedia.org/T229973 (10Halfak) p:05Triage→03Low [21:16:48] 10Jade, 10Scoring-platform-team, 10Epic: Implement New Filters integration (RecentChanges/Watchlist) - https://phabricator.wikimedia.org/T229975 (10Halfak) p:05Triage→03Low [21:17:20] 10Jade, 10Scoring-platform-team, 10Epic: Impement secondary Jade Integrations - https://phabricator.wikimedia.org/T229974 (10Halfak) p:05Triage→03Low [21:17:59] 10ORES, 10Scoring-platform-team: [Discuss] Changes to ores codebase for migrating to kubernets - https://phabricator.wikimedia.org/T219708 (10Halfak) p:05High→03Normal [21:18:15] 10ORES, 10Scoring-platform-team, 10Operations: [Epic] Deploy ORES in kubernetes cluster - https://phabricator.wikimedia.org/T182331 (10Halfak) p:05High→03Normal [21:19:08] 10Scoring-platform-team, 10WMF-Legal, 10Wikilabels: Add legal language to wikilabels - https://phabricator.wikimedia.org/T223313 (10Halfak) Still waiting on some direction here. Should this still be considered high priority? [21:19:40] 10ORES, 10Scoring-platform-team: Build a test setup for redis sentinel in cloud VPS - https://phabricator.wikimedia.org/T210577 (10Halfak) 05Open→03Stalled p:05High→03Lowest [21:19:42] 10ORES, 10Scoring-platform-team: Implement sentinel for ORES production Redis - https://phabricator.wikimedia.org/T122676 (10Halfak) [21:20:19] 10ORES, 10Scoring-platform-team: Build a test setup for redis sentinel in cloud VPS - https://phabricator.wikimedia.org/T210577 (10Halfak) We're marking this lowest because it's stalled on operations concluding whether they want to support sentinel or not. [21:20:35] 10ORES, 10Scoring-platform-team, 10Patch-For-Review, 10Puppet: Write puppet for redis-sentinel - https://phabricator.wikimedia.org/T210580 (10Halfak) p:05High→03Low [21:20:43] 10ORES, 10Scoring-platform-team: Run a test failover in labs before migrating prod to sentinel - https://phabricator.wikimedia.org/T210605 (10Halfak) p:05High→03Low [21:21:05] 10ORES, 10Scoring-platform-team, 10Operations, 10Performance: Stress test ORES/kubernetes (above 4.5k scores/second) - https://phabricator.wikimedia.org/T214054 (10Halfak) 05Open→03Stalled p:05High→03Low [21:21:08] 10ORES, 10Scoring-platform-team, 10Operations: [Epic] Deploy ORES in kubernetes cluster - https://phabricator.wikimedia.org/T182331 (10Halfak) [21:21:32] 10Jade, 10Scoring-platform-team (Current): Design Jade entity UI - https://phabricator.wikimedia.org/T212370 (10Halfak) p:05High→03Normal [21:21:48] 10ORES, 10Scoring-platform-team, 10edittypes-modeling, 10artificial-intelligence: Train and test edit type model for Catalan Wikipedia - https://phabricator.wikimedia.org/T186749 (10Halfak) p:05High→03Normal a:05Halfak→03None [21:21:59] 10ORES, 10Scoring-platform-team: Implement sentinel for ORES production Redis - https://phabricator.wikimedia.org/T122676 (10Halfak) p:05High→03Low [21:29:36] 10ORES, 10Scoring-platform-team (Current), 10Repository-Admins: Update k18 password in phab diffusion - https://phabricator.wikimedia.org/T232661 (10MarcoAurelio) I've tried to force the update via HTTP and via SSH. None of them do work. I'm mentioning @mmodell and @thcipriani so they can take a look at the... [21:37:14] o/ [22:14:57] 10ORES, 10Scoring-platform-team (Current), 10Repository-Admins, 10Release-Engineering-Team-TODO (201909): Update k18 password in phab diffusion - https://phabricator.wikimedia.org/T232661 (10thcipriani) p:05Triage→03Normal a:03mmodell >>! In T232661#5485794, @MarcoAurelio wrote: > I've tried to force... [22:44:12] 10Jade: Update Jade for changes in AbuseFilter and SpamBlacklist API error responses - https://phabricator.wikimedia.org/T232684 (10matmarex)