[00:26:52] wikimedia/editquality#647 (readme-docs-link - be6dbd6 : Andy Craze): The build passed. https://travis-ci.org/wikimedia/editquality/builds/568619690 [00:27:18] 10Scoring-platform-team (Current), 10editquality-modeling, 10artificial-intelligence: editquality docs - https://phabricator.wikimedia.org/T229133 (10ACraze) @Halfak the docs are now live at: https://editquality.readthedocs.io readthedocs will build each time we merge new code into the master branch. I hav... [00:29:45] 10ORES, 10Scoring-platform-team, 10WMF-JobQueue, 10Growth-Team (Current Sprint), and 2 others: Fatal error during RecentChange::notifyEdit (deferred update) from ORES/RecentChangeSaveHookHandler - https://phabricator.wikimedia.org/T225199 (10Etonkovidova) 05Open→03Resolved a:03Etonkovidova Since the... [00:50:10] 10Scoring-platform-team (Current): Develop automated release strategy from travis CI - https://phabricator.wikimedia.org/T229850 (10ACraze) braindumping details here: - We will be deploying to PyPI using our scoring-internal acct: https://pypi.org/user/scoring-internal/ - Packaging will be handled using twine:... [01:01:45] 10Scoring-platform-team (Current): Develop automated release strategy from travis CI - https://phabricator.wikimedia.org/T229850 (10ACraze) @Halfak can you please add scoring-internal as a maintainer on travis-ci? https://travis-ci.org/scoring-internal Once that's done I can configure a couple of environment v... [06:32:36] PROBLEM - check disk on ORES-web01.Experimental is CRITICAL: connect to address 172.16.3.131 port 5666: Connection refusedconnect to host ores-web-01.ores.eqiad.wmflabs port 5666: Connection refused [06:32:38] PROBLEM - check users on ORES-web01.Experimental is CRITICAL: connect to address 172.16.3.131 port 5666: Connection refusedconnect to host ores-web-01.ores.eqiad.wmflabs port 5666: Connection refused [06:33:15] PROBLEM - check load on ORES-web01.Experimental is CRITICAL: connect to address 172.16.3.131 port 5666: Connection refusedconnect to host ores-web-01.ores.eqiad.wmflabs port 5666: Connection refused [06:35:40] PROBLEM - puppet on ORES-web01.Experimental is CRITICAL: connect to address 172.16.3.131 port 5666: Connection refusedconnect to host ores-web-01.ores.eqiad.wmflabs port 5666: Connection refused [07:22:38] RECOVERY - check users on ORES-web01.Experimental is OK: USERS OK - 1 users currently logged in [07:23:16] RECOVERY - check load on ORES-web01.Experimental is OK: OK - load average: 0.23, 0.14, 0.18 [07:24:37] RECOVERY - check disk on ORES-web01.Experimental is OK: DISK OK [07:24:53] RECOVERY - puppet on ORES-web01.Experimental is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [07:44:34] PROBLEM - ORES web node labs ores-web-02 on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/ORES [07:44:54] PROBLEM - ORES web node labs ores-web-01 on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/ORES [07:46:04] RECOVERY - ORES web node labs ores-web-02 on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 1011 bytes in 2.874 second response time https://wikitech.wikimedia.org/wiki/ORES [07:46:20] RECOVERY - ORES web node labs ores-web-01 on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 1011 bytes in 0.042 second response time https://wikitech.wikimedia.org/wiki/ORES [13:35:31] o/ [14:02:51] Technical Advice IRC meeting starting in 60 minutes in channel #wikimedia-tech, hosts: @Lucas_WMDE & @tgr - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [14:52:47] Technical Advice IRC meeting starting in 10 minutes in channel #wikimedia-tech, hosts: @Lucas_WMDE & @tgr - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [15:39:12] 10Scoring-platform-team, 10Growth-Team, 10editquality-modeling, 10artificial-intelligence: Update ORES filter thresholds for huwiki - https://phabricator.wikimedia.org/T230031 (10Halfak) [15:51:34] 10Scoring-platform-team, 10Growth-Team, 10editquality-modeling, 10artificial-intelligence: Update ORES filter thresholds for huwiki - https://phabricator.wikimedia.org/T230031 (10Halfak) [15:51:36] 10Scoring-platform-team (Current), 10editquality-modeling, 10User-Tgr, 10artificial-intelligence: Retrain damaging/goodfaith models for huwiki - https://phabricator.wikimedia.org/T228078 (10Halfak) [15:52:12] 10ORES, 10Scoring-platform-team (Current): ORES deployment, Early August 2019 - https://phabricator.wikimedia.org/T229848 (10Halfak) 05Open→03Resolved [15:52:20] 10Scoring-platform-team (Current), 10articlequality-modeling, 10draftquality-modeling, 10drafttopic-modeling, and 3 others: Retrain models with revscoring 2.5.1 - https://phabricator.wikimedia.org/T229351 (10Halfak) 05Open→03Resolved [15:52:24] 10ORES, 10Scoring-platform-team (Current): ORES deployment, Early August 2019 - https://phabricator.wikimedia.org/T229848 (10Halfak) [15:52:36] 10Scoring-platform-team (Current), 10editquality-modeling, 10artificial-intelligence: editquality docs - https://phabricator.wikimedia.org/T229133 (10Halfak) 05Open→03Resolved a:03Halfak [15:52:46] 10Scoring-platform-team (Current), 10revscoring, 10artificial-intelligence: Solve version mismatch between revscoring and pytest (more-itertools) - https://phabricator.wikimedia.org/T229125 (10Halfak) 05Open→03Resolved [15:52:50] 10Scoring-platform-team (Current), 10revscoring, 10artificial-intelligence: Improved error logging for cv_train - https://phabricator.wikimedia.org/T229063 (10Halfak) 05Open→03Resolved [15:52:53] 10Scoring-platform-team (Current), 10revscoring, 10artificial-intelligence: trim() function returns duplicates of features - https://phabricator.wikimedia.org/T229049 (10Halfak) 05Open→03Resolved [15:53:06] 10Scoring-platform-team (Current), 10revscoring, 10artificial-intelligence: Wikibase references is a count of ref claims, should be reference statements - https://phabricator.wikimedia.org/T229029 (10Halfak) 05Open→03Resolved [15:53:08] 10ORES, 10Scoring-platform-team (Current): ORES deployment, Early August 2019 - https://phabricator.wikimedia.org/T229848 (10Halfak) [15:53:21] 10ORES, 10Scoring-platform-team (Current), 10Analytics-EventLogging, 10Analytics-Kanban, and 4 others: Fix "Must provide the 'topic' parameter" in ORES /precache endpoint - https://phabricator.wikimedia.org/T228689 (10Halfak) 05Open→03Resolved [15:53:23] 10ORES, 10Scoring-platform-team (Current): ORES deployment, Early August 2019 - https://phabricator.wikimedia.org/T229848 (10Halfak) [15:53:30] 10Scoring-platform-team (Current), 10articlequality-modeling, 10draftquality-modeling, 10drafttopic-modeling, and 3 others: Decide on criteria for releases/versioning of model repos - https://phabricator.wikimedia.org/T228215 (10Halfak) 05Open→03Resolved [15:53:32] 10Scoring-platform-team, 10articlequality-modeling, 10draftquality-modeling, 10drafttopic-modeling, and 2 others: Implement versioning in the model repos - https://phabricator.wikimedia.org/T229248 (10Halfak) [15:53:34] 10Scoring-platform-team (Current), 10editquality-modeling, 10User-Tgr, 10artificial-intelligence: Retrain damaging/goodfaith models for huwiki - https://phabricator.wikimedia.org/T228078 (10Halfak) 05Open→03Resolved [15:53:36] 10Scoring-platform-team, 10Growth-Team, 10editquality-modeling, 10artificial-intelligence: Update ORES filter thresholds for huwiki - https://phabricator.wikimedia.org/T230031 (10Halfak) [15:53:39] 10ORES, 10Scoring-platform-team (Current): ORES deployment, Early August 2019 - https://phabricator.wikimedia.org/T229848 (10Halfak) [15:53:44] 10Scoring-platform-team (Current), 10revscoring, 10artificial-intelligence: On en.wikipedia, ref tags inserted by the shortened footnote template, {{sfn}}, are not counted in ORES features - https://phabricator.wikimedia.org/T227153 (10Halfak) 05Open→03Resolved [15:53:45] 10[1] 10https://meta.wikimedia.org/wiki/Template:sfn [15:53:46] 10ORES, 10Scoring-platform-team (Current): ORES deployment, Early August 2019 - https://phabricator.wikimedia.org/T229848 (10Halfak) [15:53:50] 10Scoring-platform-team (Current), 10Patch-For-Review: Add Andy Craze to icinga notification for ORES related monitoring - https://phabricator.wikimedia.org/T226417 (10Halfak) 05Open→03Resolved [16:16:11] accraze, forgot about follow-up but the deployments during Wikimania & the PDP stuff are the only things I had. [16:16:22] And you know what's up there so we can probably skip [16:16:28] haha ok sounds good! [16:29:54] hey halfak, I setup the env vars so the release automation PR should be ready to merge: https://github.com/wikimedia/editquality/pull/205 [16:30:31] merged! [16:31:38] thanks! now lets see if it works :) [16:35:33] yay! it didn't upload anything: "Skipping editquality-0.4.2-py2.py3-none-any.whl because it appears to already exist" [16:41:50] Is there a nice way we could get an IRC message whenever a new version is uploaded? [16:42:08] halfak: I have our 1:1 on my calendar for 10. meet in 15 min? [16:42:28] 10 PDT? [16:42:29] Yes. [16:44:50] halfak: maybe, lemme dig around a bit and see if any solutions come to mind [17:02:39] ping groceryheist [17:04:32] 10Scoring-platform-team, 10Edit-Review-Improvements-Integrated-Filters, 10editquality-modeling, 10Growth-Team (Current Sprint), 10artificial-intelligence: Deploy ORES filters for jawiki - https://phabricator.wikimedia.org/T225563 (10SBisson) a:03SBisson [17:09:26] hey [17:09:29] hit traffic [17:09:33] I'm ready [17:27:58] PROBLEM - ORES web node labs ores-web-01 on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/ORES [17:28:57] 10Scoring-platform-team, 10Growth-Team, 10editquality-modeling, 10User-Tgr, 10artificial-intelligence: Update ORES filter thresholds for huwiki - https://phabricator.wikimedia.org/T230031 (10Tgr) [17:29:30] RECOVERY - ORES web node labs ores-web-01 on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 981 bytes in 6.069 second response time https://wikitech.wikimedia.org/wiki/ORES [18:59:24] 10ORES, 10Scoring-platform-team (Current), 10Analytics-EventLogging, 10Analytics-Kanban, and 4 others: Fix "Must provide the 'topic' parameter" in ORES /precache endpoint - https://phabricator.wikimedia.org/T228689 (10Halfak) This change has been deployed. Should be good to remove the work-around. [19:04:28] PROBLEM - ORES worker labs on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/ORES [19:05:58] RECOVERY - ORES worker labs on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 1009 bytes in 2.693 second response time https://wikitech.wikimedia.org/wiki/ORES [20:35:47] gonna go get some food, back in a bit [23:17:18] PROBLEM - ORES web node labs ores-web-01 on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/ORES [23:22:02] PROBLEM - ORES web node labs ores-web-02 on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/ORES [23:25:36] PROBLEM - ORES worker labs on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/ORES [23:26:38] RECOVERY - ORES web node labs ores-web-02 on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 1009 bytes in 0.074 second response time https://wikitech.wikimedia.org/wiki/ORES [23:26:42] RECOVERY - ORES web node labs ores-web-01 on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 1011 bytes in 0.508 second response time https://wikitech.wikimedia.org/wiki/ORES [23:31:56] RECOVERY - ORES worker labs on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 1007 bytes in 5.568 second response time https://wikitech.wikimedia.org/wiki/ORES [23:41:14] PROBLEM - ORES web node labs ores-web-01 on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/ORES [23:42:46] RECOVERY - ORES web node labs ores-web-01 on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 979 bytes in 9.253 second response time https://wikitech.wikimedia.org/wiki/ORES [23:47:54] PROBLEM - ORES worker labs on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/ORES [23:50:58] RECOVERY - ORES worker labs on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 981 bytes in 2.413 second response time https://wikitech.wikimedia.org/wiki/ORES [23:57:28] PROBLEM - ORES worker labs on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/ORES [23:59:02] RECOVERY - ORES worker labs on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 1009 bytes in 7.086 second response time https://wikitech.wikimedia.org/wiki/ORES