[05:38:05] <icinga2-wm>	 PROBLEM - check disk on ORES-web02.Experimental is WARNING: DISK WARNING - free space: / 1080 MB (5% inode=92%);
[06:26:05] <icinga2-wm>	 RECOVERY - check disk on ORES-web02.Experimental is OK: DISK OK
[07:46:33] <wikibugs>	 10Scoring-platform-team, 10Cloud-VPS, 10Wikilabels, 10Epic, and 2 others: Replace labsdb100[4567] with instances on cloudvirt1019 and cloudvirt1020 - https://phabricator.wikimedia.org/T193264 (10Marostegui) @Bstorm what is left to be able to decommission labsdb1004 and labsdb1005? Is it: {T217922} or is th...
[09:02:31] <icinga-wm>	 PROBLEM - ores-extension grafana alert on icinga2001 is CRITICAL: CRITICAL: ORES extension ( https://grafana.wikimedia.org/d/000000263/ores-extension ) is alerting: Service hits for obtaining thresholds alert. https://wikitech.wikimedia.org/wiki/ORES
[09:03:37] <icinga-wm>	 RECOVERY - ores-extension grafana alert on icinga2001 is OK: OK: ORES extension ( https://grafana.wikimedia.org/d/000000263/ores-extension ) is not alerting. https://wikitech.wikimedia.org/wiki/ORES
[10:28:53] <wikibugs>	 10Scoring-platform-team (Current), 10articlequality-modeling, 10Turkish-Sites, 10artificial-intelligence: Implement wp10 model for trwiki - https://phabricator.wikimedia.org/T164671 (10Liuxinyu970226)
[12:26:41] <icinga-wm>	 PROBLEM - ORES web node labs ores-web-02 on ores.wmflabs.org is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 INTERNAL SERVER ERROR - 5687 bytes in 5.291 second response time https://wikitech.wikimedia.org/wiki/ORES
[12:26:49] <icinga-wm>	 PROBLEM - ORES web node labs ores-web-01 on ores.wmflabs.org is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 INTERNAL SERVER ERROR - 5687 bytes in 5.265 second response time https://wikitech.wikimedia.org/wiki/ORES
[12:29:01] <icinga-wm>	 RECOVERY - ORES web node labs ores-web-02 on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 540 bytes in 0.329 second response time https://wikitech.wikimedia.org/wiki/ORES
[12:29:11] <icinga-wm>	 RECOVERY - ORES web node labs ores-web-01 on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 540 bytes in 0.352 second response time https://wikitech.wikimedia.org/wiki/ORES
[15:37:01] <wikibugs>	 10Scoring-platform-team, 10Cloud-VPS, 10Wikilabels, 10Epic, and 2 others: Replace labsdb100[4567] with instances on cloudvirt1019 and cloudvirt1020 - https://phabricator.wikimedia.org/T193264 (10Bstorm) It's just that and any activity remaining for T216441.
[16:02:20] <halfak>	 Amir1, hare: are we doing standup?
[17:21:27] <wikibugs>	 10Scoring-platform-team (Current), 10Cloud-VPS, 10Wikilabels: Migrate Wikilabels from labsdb1004 to clouddb1002 - https://phabricator.wikimedia.org/T217922 (10Halfak) I've successfully deployed the new credentials to staging and restarted the service.  It seems like everything is working as intended.   We're...
[17:22:16] <wikibugs>	 10ORES, 10Scoring-platform-team, 10Growth-Team: Add ORES topic prediction to the NewPagesFeed - https://phabricator.wikimedia.org/T218132 (10Halfak)
[17:34:13] <wikibugs>	 10ORES, 10Scoring-platform-team, 10Growth-Team, 10MediaWiki-extensions-PageCuration: Add ORES topic prediction to the NewPagesFeed - https://phabricator.wikimedia.org/T218132 (10kostajh)