[00:10:05] PROBLEM - ORES worker labs on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:11:55] RECOVERY - ORES worker labs on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 443 bytes in 0.552 second response time [00:28:05] PROBLEM - ORES worker labs on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:29:55] RECOVERY - ORES worker labs on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 443 bytes in 1.034 second response time [00:35:12] 10Revision-Scoring-As-A-Service-Backlog, 10ORES, 15User-Ladsgroup: Silence or address E_WOULDBLOCK warning - https://phabricator.wikimedia.org/T152012#3041790 (10awight) [[ https://github.com/TrackMaven/celery-once/blob/master/celery_once/tasks.py | Reading ]] celery_once, I think they actually didn't lock t... [00:35:13] 10[1] 04https://meta.wikimedia.org/wiki/https://github.com/TrackMaven/celery%2Donce/blob/master/celery_once/tasks.py [02:29:05] PROBLEM - ORES worker labs on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:30:55] RECOVERY - ORES worker labs on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 443 bytes in 0.571 second response time [02:44:05] PROBLEM - ORES worker labs on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:44:55] RECOVERY - ORES worker labs on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 443 bytes in 1.059 second response time [02:50:05] PROBLEM - ORES worker labs on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:50:55] RECOVERY - ORES worker labs on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 443 bytes in 0.557 second response time [03:02:59] 06Revision-Scoring-As-A-Service, 10MediaWiki-Recent-changes, 10MediaWiki-Watchlist, 10MediaWiki-extensions-ORES, and 4 others: Add class to diff and history links in changes lists for easier selecting in CSS/javascript - https://phabricator.wikimedia.org/T157178#3041950 (10EddieGP) The patch adressing Spec... [03:38:05] PROBLEM - ORES worker labs on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:39:55] RECOVERY - ORES worker labs on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 443 bytes in 1.039 second response time [03:40:05] RECOVERY - ORES web node labs ores-web-03 on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 443 bytes in 9.439 second response time [06:26:53] 10Revision-Scoring-As-A-Service-Backlog, 10ORES, 15User-Ladsgroup: Silence or address E_WOULDBLOCK warning - https://phabricator.wikimedia.org/T152012#2835200 (10Tgr) At the risk of saying something stupid (as I am not familiar with either Celery or ORES internals), it feels like there are two different issu... [07:18:32] 06Revision-Scoring-As-A-Service, 10Mobile-Content-Service, 10ORES, 10Reading-Web-Trending-Service, 06Services (designing): Trending API should consult ORES - https://phabricator.wikimedia.org/T145829#3042156 (10Tgr) To wrap up the annual planning aspect of this, does everyone agree that implementing this... [07:19:01] 06Revision-Scoring-As-A-Service, 10Mobile-Content-Service, 10ORES, 10RESTBase-API, and 2 others: Add ORES WP10 data to summaries? - https://phabricator.wikimedia.org/T157132#3042160 (10Tgr) To wrap up the annual planning aspect of this, does everyone agree that implementing this task is relatively straight... [13:24:26] 06Revision-Scoring-As-A-Service, 10Wikidata, 15User-Ladsgroup, 05WMDE-Tech-Communication-Mentoring-And-Events: [Discuss] item quality in Wikidata - https://phabricator.wikimedia.org/T157489#3042691 (10Glorian_WD) I have adjusted the quality criteria to reflect the outcome of the discussion on https://www.w... [15:50:18] 06Revision-Scoring-As-A-Service, 10Mobile-Content-Service, 10ORES, 10RESTBase-API, and 2 others: Add ORES WP10 data to summaries? - https://phabricator.wikimedia.org/T157132#3043234 (10mobrovac) >>! In T157132#3042160, @Tgr wrote: > To wrap up the annual planning aspect of this, does everyone agree that im... [16:45:16] 06Revision-Scoring-As-A-Service, 06Research-and-Data, 07Epic: Estimate ORES capex for FY2017-18 - https://phabricator.wikimedia.org/T157222#2999472 (10Ottomata) Does this relate to the Kubernetes work at all? Could ORES be run as a Kube container? [17:19:08] 06Revision-Scoring-As-A-Service, 10Mobile-Content-Service, 10ORES, 10RESTBase-API, and 2 others: Add ORES WP10 data to summaries? - https://phabricator.wikimedia.org/T157132#3043609 (10Fjalapeno) Seems reasonable to me [17:58:21] 06Revision-Scoring-As-A-Service, 10Edit-Review-Improvements-RC-Page, 10ORES, 06Collaboration-Team-Triage (Collab-Team-Q3-Jan-Mar-2017), 06Community-Liaisons (Jan-Mar 2017): Enable the ORES review tool by-default on wikis that have it as a Beta feature - https://phabricator.wikimedia.org/T158225#3043733 (1... [17:59:46] 06Revision-Scoring-As-A-Service, 10Edit-Review-Improvements-RC-Page, 10ORES, 06Collaboration-Team-Triage (Collab-Team-Q3-Jan-Mar-2017), 06Community-Liaisons (Jan-Mar 2017): Enable the ORES review tool by-default on wikis that have it as a Beta feature - https://phabricator.wikimedia.org/T158225#3030378 (1... [17:59:49] 10Revision-Scoring-As-A-Service-Backlog, 10Edit-Review-Improvements-RC-Page, 10ORES, 06Collaboration-Team-Triage (Collab-Team-Q3-Jan-Mar-2017): Turn on ORES good faith test model in production for all supported wikis targeted for RC Page release - https://phabricator.wikimedia.org/T158441#3043740 (10jmatazz... [18:14:19] 06Revision-Scoring-As-A-Service, 10Mobile-Content-Service, 10ORES, 10RESTBase-API, and 2 others: Add ORES WP10 data to summaries? - https://phabricator.wikimedia.org/T157132#3043837 (10GWicke) >>! In T157132#3005228, @dr0ptp4kt wrote: > If I understand correctly, an updated scoring model shouldn't require... [18:36:07] Failure rate is crazy: https://grafana.wikimedia.org/dashboard/db/ores-extension [18:36:11] 0.7% wooooo [18:41:50] 06Revision-Scoring-As-A-Service, 10ChangeProp, 10ORES, 13Patch-For-Review, and 2 others: Use minified JSON format in ChangeProp - https://phabricator.wikimedia.org/T157693#3043969 (10Pchelolo) 05Open>03Resolved Change deployed. Resolving. [18:55:11] 06Revision-Scoring-As-A-Service, 10Mobile-Content-Service, 10ORES, 10RESTBase-API, and 2 others: Add ORES WP10 data to summaries? - https://phabricator.wikimedia.org/T157132#3044024 (10dr0ptp4kt) Thanks, @GWicke, for the clarification. [19:21:00] 10Revision-Scoring-As-A-Service-Backlog, 10ORES, 15User-Ladsgroup: Silence or address E_WOULDBLOCK warning - https://phabricator.wikimedia.org/T152012#3044118 (10awight) @Tgr Thanks for setting me back on the right track! Yeah, all we need to do for this specific bug is change the way we convert into a depe... [21:46:13] 10Revision-Scoring-As-A-Service-Backlog, 10ORES: Silence or address E_WOULDBLOCK warning - https://phabricator.wikimedia.org/T152012#3044758 (10Ladsgroup) a:05Ladsgroup>03None [22:31:09] 06Revision-Scoring-As-A-Service, 10MediaWiki-Patrolling, 10ORES: Selective patrol: an AI-based system to prioritize patrolling of edits - https://phabricator.wikimedia.org/T157715#3014170 (10jmatazzoni) @Cenarium wrote that "we need a way to" > on wikis using full RC patrol UI, highlight some edits as being...