[15:02:02] 10Lift-Wing, 10Machine-Learning-Team (Active Tasks), 10Patch-For-Review: Create ml-serve k8s cluster - https://phabricator.wikimedia.org/T272918 (10ops-monitoring-bot) Icinga downtime set by klausman@cumin1001 for 2:00:00 4 host(s) and their services with reason: Reimaging for T272918 ` ml-serve[1001-1004].e... [15:04:47] 10Lift-Wing, 10Machine-Learning-Team (Active Tasks), 10Patch-For-Review: Create ml-serve k8s cluster - https://phabricator.wikimedia.org/T272918 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by klausman on cumin1001.eqiad.wmnet for hosts: ` ['ml-serve1001.eqiad.wmnet'] ` The log can be found in... [15:20:39] 10Lift-Wing, 10Machine-Learning-Team (Active Tasks), 10Patch-For-Review: Create ml-serve k8s cluster - https://phabricator.wikimedia.org/T272918 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by klausman on cumin1001.eqiad.wmnet for hosts: ` ['ml-serve1002.eqiad.wmnet'] ` The log can be found in... [15:21:41] 10Lift-Wing, 10Machine-Learning-Team (Active Tasks), 10Patch-For-Review: Create ml-serve k8s cluster - https://phabricator.wikimedia.org/T272918 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by klausman on cumin1001.eqiad.wmnet for hosts: ` ['ml-serve1001.eqiad.wmnet'] ` The log can be found in... [15:29:01] 10Lift-Wing, 10Machine-Learning-Team (Active Tasks), 10Patch-For-Review: Create ml-serve k8s cluster - https://phabricator.wikimedia.org/T272918 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by klausman on cumin1001.eqiad.wmnet for hosts: ` ['ml-serve1002.eqiad.wmnet'] ` The log can be found in... [15:29:05] 10Lift-Wing, 10Machine-Learning-Team (Active Tasks), 10Patch-For-Review: Create ml-serve k8s cluster - https://phabricator.wikimedia.org/T272918 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by klausman on cumin1001.eqiad.wmnet for hosts: ` ['ml-serve1001.eqiad.wmnet'] ` The log can be found in... [15:37:58] 10Lift-Wing, 10Machine-Learning-Team (Active Tasks), 10Patch-For-Review: Create ml-serve k8s cluster - https://phabricator.wikimedia.org/T272918 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by klausman on cumin1001.eqiad.wmnet for hosts: ` ['ml-serve1002.eqiad.wmnet'] ` The log can be found in... [15:38:01] 10Lift-Wing, 10Machine-Learning-Team (Active Tasks), 10Patch-For-Review: Create ml-serve k8s cluster - https://phabricator.wikimedia.org/T272918 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by klausman on cumin1001.eqiad.wmnet for hosts: ` ['ml-serve1001.eqiad.wmnet'] ` The log can be found in... [18:26:44] Thanks accraze for the AI governance doc. I am interested to see Research and Trust & Safety have as perspectives. [18:27:02] But it is super important and something we need to push forward on [19:33:50] chrisalbon: agreed, very excited to see us focus on this direction. [19:36:43] hopefully we will have a public document or phab task to allow for a public conversation around this stuff soon [19:53:06] @accraze can you get a precise list of the models we are currently serving? I have a rough list but for AI governance we are going to need a detailed list [19:53:07] 04Error: Command “accraze” not recognized. Please review and correct what you’ve written. [19:55:03] accraze [19:56:34] kbazira when you get farther on the migration of that model, can you write up some instructions. Once we have the procedure down it would be a great task for new volunteers, and frankly I'd like to get my hands dirty on it myself [19:57:09] chrisalbon: sure no problem! i figured we would need to do a full inventory on current models soon [19:58:37] thank you sir [20:08:45] this was shared in the wmf-staff channel earlier today: https://themarkup.org/ask-the-markup/2021/02/23/can-auditing-eliminate-bias-from-algorithms [20:09:45] definitely relevant to what we've been talking about around governance and ethical AI [21:44:03] 10Lift-Wing, 10Machine-Learning-Team (Active Tasks): Prepare 4 ORES English models for Lift Wing - https://phabricator.wikimedia.org/T272874 (10Theofpa) Some thoughts on building a custom image per model. At KFServing, although we have the capability of serving custom images per model, it's not best practice... [23:11:53] 10artificial-intelligence, 10Machine-Learning-Team (Active Tasks): Model Inventory - https://phabricator.wikimedia.org/T275709 (10ACraze)