[09:12:54] 10Lift-Wing, 10Machine-Learning-Team (Active Tasks), 10Patch-For-Review: Create ml-serve k8s cluster - https://phabricator.wikimedia.org/T272918 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by klausman on cumin2001.codfw.wmnet for hosts: ` ['ml-serve2001.codfw.wmnet'] ` The log can be found in... [09:13:32] 10Lift-Wing, 10Machine-Learning-Team (Active Tasks), 10Patch-For-Review: Create ml-serve k8s cluster - https://phabricator.wikimedia.org/T272918 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by klausman on cumin2001.codfw.wmnet for hosts: ` ['ml-serve2004.codfw.wmnet'] ` The log can be found in... [09:13:38] 10Lift-Wing, 10Machine-Learning-Team (Active Tasks), 10Patch-For-Review: Create ml-serve k8s cluster - https://phabricator.wikimedia.org/T272918 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by klausman on cumin2001.codfw.wmnet for hosts: ` ['ml-serve2003.codfw.wmnet'] ` The log can be found in... [09:13:43] 10Lift-Wing, 10Machine-Learning-Team (Active Tasks), 10Patch-For-Review: Create ml-serve k8s cluster - https://phabricator.wikimedia.org/T272918 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by klausman on cumin2001.codfw.wmnet for hosts: ` ['ml-serve2002.codfw.wmnet'] ` The log can be found in... [09:15:42] elukey: ^^^ same reinstall for codfw as I did for eqiad yesterday [09:16:20] ack! [09:16:40] I can take care of the codfw VMs later on if it is ok [09:16:47] (the ml-serve-ctl200x) [09:31:56] sgtm. I'll do the eqiad ones once I am done with the physical stuff [09:40:43] 10Lift-Wing, 10Machine-Learning-Team (Active Tasks), 10Patch-For-Review: Create ml-serve k8s cluster - https://phabricator.wikimedia.org/T272918 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['ml-serve2001.codfw.wmnet'] ` and were **ALL** successful. [10:11:48] 10Lift-Wing, 10Machine-Learning-Team (Active Tasks), 10Patch-For-Review: Create ml-serve k8s cluster - https://phabricator.wikimedia.org/T272918 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['ml-serve2004.codfw.wmnet'] ` and were **ALL** successful. [10:13:40] 10Lift-Wing, 10Machine-Learning-Team (Active Tasks), 10Patch-For-Review: Create ml-serve k8s cluster - https://phabricator.wikimedia.org/T272918 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['ml-serve2003.codfw.wmnet'] ` and were **ALL** successful. [12:44:20] * klausman lunch and groceries. Back in <1h [14:15:16] klausman: o/ lemme know when you are done with makevm, I'll kick off one for codfw [14:15:35] Will do [14:17:19] 10Lift-Wing, 10Machine-Learning-Team (Active Tasks), 10Patch-For-Review: Create ml-serve k8s cluster - https://phabricator.wikimedia.org/T272918 (10elukey) [14:21:54] Ugh. and the make vm broke again because I canceled an earlier call [14:35:20] elukey: all done [14:48:40] super [16:39:17] elukey: shamelessly copied your patch to make the same changes for the eqiad ctrl machines [16:39:29] https://gerrit.wikimedia.org/r/c/operations/puppet/+/666951 [17:02:38] +1ed [19:36:59] 10Machine-Learning-Team, 10ORES, 10Services (watching): Trending API should consult ORES - https://phabricator.wikimedia.org/T145829 (10Jdlrobson) 05Open→03Declined Trending service no longer exists [22:18:14] isaacj could you give a little presentation to my team about your topic model? It is most likely going to be one of the first models we deploy on Lift Wing [22:52:45] chrisalbon: sure thing -- just throw time on my calendar and let me know if anything in particular you want me to focus on etc. [22:53:02] if it happens next week, that's fine. i'm out then the following but will be back in mid-march