[00:49:26] 06Revision-Scoring-As-A-Service, 10Edit-Review-Improvements, 10rsaas-editquality, 06Collaboration-Team-Triage (Collab-Team-Q2-Oct-Dec-2016): Research how to present ORES scores to users in a way that is understandable and meets their reviewing goals - https://phabricator.wikimedia.org/T146333#2740828 (10jma... [08:47:36] 06Revision-Scoring-As-A-Service, 10Edit-Review-Improvements, 10rsaas-editquality, 06Collaboration-Team-Triage (Collab-Team-Q2-Oct-Dec-2016): Research how to present ORES scores to users in a way that is understandable and meets their reviewing goals - https://phabricator.wikimedia.org/T146333#2741178 (10Pgi... [08:54:57] 06Revision-Scoring-As-A-Service: Review ORES Grafana metrics - https://phabricator.wikimedia.org/T149015#2741203 (10awight) Notes on the graphs --- Snapshot of the ORES Grafana configuration: https://wikitech.wikimedia.org/wiki/Grafana.wikimedia.org/ores.json --- "Total scores processed" looks good, except the... [09:25:50] 06Revision-Scoring-As-A-Service: Review ORES Grafana metrics - https://phabricator.wikimedia.org/T149015#2741254 (10awight) Argh, foiled! Seems that the by-node magic is lost when we use functions. I tried: > applyByNode(ores.scb*.scores_request.rate, 1, "sumSeries(%.scores_request.rate, %.score_cache_hit.rate... [09:30:02] 06Revision-Scoring-As-A-Service: Review ORES Grafana metrics - https://phabricator.wikimedia.org/T149015#2741259 (10awight) [16:46:52] 06Revision-Scoring-As-A-Service, 10Edit-Review-Improvements, 10rsaas-editquality, 06Collaboration-Team-Triage (Collab-Team-Q2-Oct-Dec-2016): Research how to present ORES scores to users in a way that is understandable and meets their reviewing goals - https://phabricator.wikimedia.org/T146333#2742066 (10jma... [18:30:29] o/ [18:35:19] I'm looking into the metrics again [18:35:26] It looks like the metrics are very goofy [19:28:47] OK. Updates complete https://grafana.wikimedia.org/dashboard/db/ores [19:29:31] 06Revision-Scoring-As-A-Service: Review ORES Grafana metrics - https://phabricator.wikimedia.org/T149015#2739711 (10Halfak) I just made a bunch of updates. See https://grafana.wikimedia.org/dashboard/db/ores [19:49:54] 06Revision-Scoring-As-A-Service: Review ORES Grafana metrics - https://phabricator.wikimedia.org/T149015#2742572 (10Halfak) > score_processed = score_cache_hit + score_cache_miss That's not true. It's actually `score_process + score_errored = score_cache_miss`. > scores_request = score_processed + score_error... [20:13:46] 06Revision-Scoring-As-A-Service: Review ORES Grafana metrics - https://phabricator.wikimedia.org/T149015#2742660 (10Halfak) https://github.com/wiki-ai/ores/pull/174 [22:06:06] 10Revision-Scoring-As-A-Service-Backlog, 10Data-release, 06Research-and-Data, 10rsaas-articlequality : Mini blogpost for Article Quality Score dataset - https://phabricator.wikimedia.org/T146709#2743183 (10Halfak) https://docs.google.com/document/d/144w27s1VktfCPuovdU1dUl4as_dLfJyHvknMv1Zt48E/edit?ts=57e99... [22:06:22] 06Revision-Scoring-As-A-Service, 10Data-release, 06Research-and-Data, 10rsaas-articlequality : Mini blogpost for Article Quality Score dataset - https://phabricator.wikimedia.org/T146709#2743184 (10Halfak) a:03Halfak [22:06:50] 06Revision-Scoring-As-A-Service, 10Data-release, 06Research-and-Data, 10rsaas-articlequality : Mini blogpost for Article Quality Score dataset - https://phabricator.wikimedia.org/T146709#2669118 (10Halfak) I imagine reading the summary in Billy Mays' voice. I'm not sure that's such a great idea, but it wa... [23:06:53] 06Revision-Scoring-As-A-Service, 10Data-release, 06Research-and-Data, 10rsaas-articlequality : Mini blogpost for Article Quality Score dataset - https://phabricator.wikimedia.org/T146709#2743385 (10Nettrom) I'm thinking the 2015 CSCW paper is a better citation for this dataset (and ORES in general moving f...