[04:02:43] 10Scoring-platform-team, 10Community comms and outreach, 10CommRel-Specialists-Support (Jul-Sep-2019): Outreach campaign to raise awareness of Scoring Platform - https://phabricator.wikimedia.org/T217232 (10Kudpung) @Halfak I am surprised again to hear that bugetary topics are an issue. They are frequently r... [08:09:54] PROBLEM - ORES web node labs ores-web-01 on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/ORES [08:10:16] PROBLEM - ORES web node labs ores-web-02 on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/ORES [08:12:10] PROBLEM - ORES worker labs on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/ORES [08:13:36] RECOVERY - ORES worker labs on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 979 bytes in 0.051 second response time https://wikitech.wikimedia.org/wiki/ORES [09:41:54] 10ORES, 10Scoring-platform-team (Current), 10Repository-Admins, 10Release-Engineering-Team-TODO (201909): Update k18 password in phab diffusion - https://phabricator.wikimedia.org/T232661 (10MarcoAurelio) Note that K18 still needs to be updated just in case any other repo is using it, cc. @mmodell, but sco... [11:06:36] 10Scoring-platform-team, 10editquality-modeling, 10Growth-Team (Current Sprint), 10Patch-For-Review, and 2 others: Update ORES filter thresholds for huwiki - https://phabricator.wikimedia.org/T230031 (10Tgr) One thing I noted while playing around with the data is that the frequency of edits matching damagi... [12:43:48] PROBLEM - ORES worker labs on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/ORES [12:45:18] RECOVERY - ORES worker labs on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 981 bytes in 4.186 second response time https://wikitech.wikimedia.org/wiki/ORES [13:05:46] PROBLEM - ORES worker labs on ores.wmflabs.org is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 SERVICE UNAVAILABLE - 512 bytes in 0.030 second response time https://wikitech.wikimedia.org/wiki/ORES [13:13:05] 10Scoring-platform-team, 10editquality-modeling, 10User-Tgr, 10artificial-intelligence: Create ORES dataset for huwiki edits in the last two years or so - https://phabricator.wikimedia.org/T223900 (10Tgr) @Halfak is there a way to recover the threshold settings for the old (pre-T228078) model? I'd like to... [13:16:50] RECOVERY - ORES worker labs on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 1007 bytes in 0.101 second response time https://wikitech.wikimedia.org/wiki/ORES [13:43:56] PROBLEM - ORES worker labs on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/ORES [13:48:32] RECOVERY - ORES worker labs on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 1007 bytes in 0.776 second response time https://wikitech.wikimedia.org/wiki/ORES [14:04:22] PROBLEM - ORES worker labs on ores.wmflabs.org is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 SERVICE UNAVAILABLE - 512 bytes in 0.023 second response time https://wikitech.wikimedia.org/wiki/ORES [15:27:40] 10Scoring-platform-team, 10Community comms and outreach, 10CommRel-Specialists-Support (Jul-Sep-2019): Outreach campaign to raise awareness of Scoring Platform - https://phabricator.wikimedia.org/T217232 (10Aklapper) @Kudpung: Please note that [meta-level discussions on general priorities (or budgets within... [15:29:28] 10Scoring-platform-team, 10VPS-project-icinga2, 10User-Zppix: ORES-web[01,02] not existent? - https://phabricator.wikimedia.org/T232921 (10Zppix) [17:31:38] RECOVERY - ORES worker labs on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 981 bytes in 4.897 second response time https://wikitech.wikimedia.org/wiki/ORES [17:36:28] PROBLEM - ORES worker labs on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/ORES [18:01:36] RECOVERY - ORES worker labs on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 1009 bytes in 0.037 second response time https://wikitech.wikimedia.org/wiki/ORES [18:06:22] PROBLEM - ORES worker labs on ores.wmflabs.org is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 SERVICE UNAVAILABLE - 512 bytes in 0.019 second response time https://wikitech.wikimedia.org/wiki/ORES [18:31:40] RECOVERY - ORES worker labs on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 1011 bytes in 0.121 second response time https://wikitech.wikimedia.org/wiki/ORES [18:36:24] PROBLEM - ORES worker labs on ores.wmflabs.org is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 SERVICE UNAVAILABLE - 512 bytes in 0.020 second response time https://wikitech.wikimedia.org/wiki/ORES [19:38:00] 10Scoring-platform-team, 10VPS-project-icinga2, 10User-Zppix: Have ORES-web[01,02] been removed? - https://phabricator.wikimedia.org/T232921 (10Reedy) [19:47:19] 10Scoring-platform-team, 10VPS-project-icinga2, 10User-Zppix: Have ORES-web[01,02] been removed? - https://phabricator.wikimedia.org/T232921 (10Krenair) https://tools.wmflabs.org/openstack-browser/project/ores does not list them, but does list ores-web0[456], which suggests they were deleted. [19:48:29] 10Scoring-platform-team, 10VPS-project-icinga2, 10User-Zppix: Have ORES-web[01,02] been removed? - https://phabricator.wikimedia.org/T232921 (10Zppix) >>! In T232921#5493535, @Krenair wrote: > https://tools.wmflabs.org/openstack-browser/project/ores does not list them, but does list ores-web0[456], which sug...