[00:12:31] PROBLEM - puppet on ORES-lb02.Experimental is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 24 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[ldap-utils] [01:12:36] PROBLEM - puppet on ORES-lb02.Experimental is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 24 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[ldap-utils] [02:12:40] PROBLEM - puppet on ORES-lb02.Experimental is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 24 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[ldap-utils] [03:12:45] PROBLEM - puppet on ORES-lb02.Experimental is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 24 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[ldap-utils] [03:30:08] 10Scoring-platform-team (Current), 10ORES, 10Wikimedia-Hackathon-2018: Rewrite ORES "reference" UI using React - https://phabricator.wikimedia.org/T195274#4221652 (10awight) [04:12:50] PROBLEM - puppet on ORES-lb02.Experimental is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 25 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[ldap-utils] [05:12:54] PROBLEM - puppet on ORES-lb02.Experimental is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 25 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[ldap-utils] [06:12:59] PROBLEM - puppet on ORES-lb02.Experimental is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 27 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[ldap-utils] [07:13:04] PROBLEM - puppet on ORES-lb02.Experimental is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 26 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[ldap-utils] [08:13:08] PROBLEM - puppet on ORES-lb02.Experimental is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 26 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[ldap-utils] [09:13:13] PROBLEM - puppet on ORES-lb02.Experimental is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 26 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[ldap-utils] [10:13:18] PROBLEM - puppet on ORES-lb02.Experimental is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 26 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[ldap-utils] [11:13:23] PROBLEM - puppet on ORES-lb02.Experimental is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 26 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[ldap-utils] [12:01:54] 10Scoring-platform-team, 10draftquality-modeling, 10artificial-intelligence: Productionize monthly article quality prediction datasets - https://phabricator.wikimedia.org/T194741#4222182 (10JAllemandou) Adding analytics tag :) [12:02:01] 10Scoring-platform-team, 10Analytics, 10draftquality-modeling, 10artificial-intelligence: Productionize monthly article quality prediction datasets - https://phabricator.wikimedia.org/T194741#4222183 (10JAllemandou) [12:13:23] PROBLEM - puppet on ORES-lb02.Experimental is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 27 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[ldap-utils] [13:13:28] PROBLEM - puppet on ORES-lb02.Experimental is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 26 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[ldap-utils] [13:59:13] 10Scoring-platform-team, 10MediaWiki-extensions-FlaggedRevs, 10ORES, 10User-Cirdan: Create FR data set for dewiki - https://phabricator.wikimedia.org/T194594#4222373 (10Cirdan) Borrowing some ideas from @Zache, [[ https://quarry.wmflabs.org/query/27156 | Quarry 27156 ]] generates diffs between a manually r... [13:59:13] 10[1] 04https://meta.wikimedia.org/wiki/https://quarry.wmflabs.org/query/27156 [14:09:23] 10Scoring-platform-team, 10Bad-Words-Detection-System, 10editquality-modeling, 10Easy, and 2 others: migrate bad words detection to editquality repo - https://phabricator.wikimedia.org/T131861#4222391 (10Vacio) Hi guys, I tried to take on myself this task during the hackathon, and although it's tagged as e... [14:13:28] PROBLEM - puppet on ORES-lb02.Experimental is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 27 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[ldap-utils] [15:13:33] PROBLEM - puppet on ORES-lb02.Experimental is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 26 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[ldap-utils] [16:13:37] PROBLEM - puppet on ORES-lb02.Experimental is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 26 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[ldap-utils] [17:13:42] PROBLEM - puppet on ORES-lb02.Experimental is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 27 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[ldap-utils] [17:45:45] 10Scoring-platform-team, 10MediaWiki-extensions-FlaggedRevs, 10ORES, 10User-Cirdan: Create FR data set for dewiki - https://phabricator.wikimedia.org/T194594#4223023 (10Cirdan) Similarly, [[https://quarry.wmflabs.org/query/27161|Quarry 27161]] generates a list of revisions of a page which have not been fla... [17:45:45] 10[2] 04https://meta.wikimedia.org/wiki/https://quarry.wmflabs.org/query/27161 [17:47:40] stfu AsimovBot [17:47:47] cute, though [17:50:07] 10Scoring-platform-team, 10MediaWiki-extensions-FlaggedRevs, 10ORES, 10User-Cirdan: Create FR data set for dewiki - https://phabricator.wikimedia.org/T194594#4223031 (10Cirdan) [17:52:15] 10Scoring-platform-team (Current), 10ORES, 10Wikimedia-Hackathon-2018: Rewrite ORES "reference" UI using React - https://phabricator.wikimedia.org/T195274#4223033 (10awight) This project got fun. Anyone have thought about how to represent classifier outputs graphically? I was thinking a bar chart, with cat... [17:57:34] 10Scoring-platform-team, 10editquality-modeling, 10artificial-intelligence: Deploy edit quality models for dewiki - https://phabricator.wikimedia.org/T130257#4223042 (10Cirdan) [18:01:26] 10Scoring-platform-team, 10Wikilabels, 10editquality-modeling, 10artificial-intelligence: Complete dewiki edit quality campaign - https://phabricator.wikimedia.org/T129700#4223045 (10Cirdan) [18:01:28] 10Scoring-platform-team, 10ORES, 10Wikilabels: Labeling campaign for dewiki shows 'revision not found' for all revisions - https://phabricator.wikimedia.org/T194457#4223044 (10Cirdan) [18:04:01] oh. sklearn includes a function precision_recall_curve [18:13:42] PROBLEM - puppet on ORES-lb02.Experimental is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 26 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[ldap-utils] [19:13:47] PROBLEM - puppet on ORES-lb02.Experimental is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 26 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[ldap-utils] [19:15:22] What icinga is complaining about is the same thing we're seeing all aroung the beta cluster: T194926 [19:15:23] T194926: puppet fails over libldap/ldap-utils downgrade on various deployment-prep hosts - https://phabricator.wikimedia.org/T194926 [19:15:41] jfyi in case anyone wants to investigate this. [19:48:12] 10Scoring-platform-team (Current), 10ORES, 10Wikimedia-Hackathon-2018: Rewrite ORES "reference" UI using React - https://phabricator.wikimedia.org/T195274#4223336 (10awight) Future directions: * graph confusion matrix (statistics.counts.predictions) TP, TN, FP, FN, heat map, legend * Colorize prediction bar... [20:10:54] RECOVERY - puppet on ORES-lb02.Experimental is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures