[05:56:32] 06Revision-Scoring-As-A-Service, 10DBA, 10MediaWiki-extensions-ORES, 07Blocked-on-schema-change: Review and deploy 309825 - https://phabricator.wikimedia.org/T147734#2733734 (10Marostegui) p:05Triage>03Normal a:03Marostegui [06:05:39] (03CR) 10Ladsgroup: [C: 032] Action API integration for ORES (031 comment) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/313831 (https://phabricator.wikimedia.org/T143614) (owner: 10Anomie) [06:07:26] (03CR) 10Ladsgroup: [C: 031] "Can you split this patch so we merge all parts except the watchlist until the core patch gets merged?" [extensions/ORES] - 10https://gerrit.wikimedia.org/r/313831 (https://phabricator.wikimedia.org/T143614) (owner: 10Anomie) [08:53:57] 06Revision-Scoring-As-A-Service, 10DBA, 10MediaWiki-extensions-ORES, 07Blocked-on-schema-change: Review and deploy 309825 - https://phabricator.wikimedia.org/T147734#2733873 (10Marostegui) Hi, I have deployed this new index in `db2034.codfw.wmnet` S1.enwiki and this is the final table schema: ``` MariaD... [09:05:00] 06Revision-Scoring-As-A-Service, 10DBA, 10MediaWiki-extensions-ORES, 07Blocked-on-schema-change: Review and deploy 309825 - https://phabricator.wikimedia.org/T147734#2733886 (10Ladsgroup) It should be as the same as the schema [[ https://github.com/wikimedia/mediawiki-extensions-ORES/blob/master/sql/ores_m... [09:08:15] 06Revision-Scoring-As-A-Service, 10DBA, 10MediaWiki-extensions-ORES, 07Blocked-on-schema-change: Review and deploy 309825 - https://phabricator.wikimedia.org/T147734#2733888 (10Marostegui) >>! In T147734#2733886, @Ladsgroup wrote: > It should be as the same as the schema [[ https://github.com/wikimedia/med... [09:14:41] 06Revision-Scoring-As-A-Service, 10DBA, 10MediaWiki-extensions-ORES, 07Blocked-on-schema-change: Review and deploy 309825 - https://phabricator.wikimedia.org/T147734#2733898 (10Ladsgroup) Thank you! > If you need it somewhere else faster, I can also do that for you. Nah, There is no need. Thanks [09:16:03] 06Revision-Scoring-As-A-Service, 10DBA, 10MediaWiki-extensions-ORES, 07Blocked-on-schema-change: Review and deploy 309825 - https://phabricator.wikimedia.org/T147734#2733900 (10jcrespo) > Which looks the same except varchar turned into var binary. Which I don't know is expected or not. Yes, mediawiki at W... [09:18:59] 06Revision-Scoring-As-A-Service, 10DBA, 10MediaWiki-extensions-ORES, 07Blocked-on-schema-change: Review and deploy 309825 - https://phabricator.wikimedia.org/T147734#2733901 (10Marostegui) Change applied to all S1 codfw hosts: ``` root@neodymium:/home/marostegui/git# for i in `cat software/dbtools/s1.host... [09:26:57] 06Revision-Scoring-As-A-Service, 10DBA, 10MediaWiki-extensions-ORES, 07Blocked-on-schema-change: Review and deploy 309825 - https://phabricator.wikimedia.org/T147734#2733934 (10Ladsgroup) Thanks for explanation and the deployment. [09:43:10] 06Revision-Scoring-As-A-Service, 10DBA, 10MediaWiki-extensions-ORES, 07Blocked-on-schema-change: Review and deploy 309825 - https://phabricator.wikimedia.org/T147734#2733973 (10Marostegui) Deployed in S1.enwiki eqiad. So S1 is done: ``` root@neodymium:/home/marostegui/git# mysql -hdb1069 -P3311 enwiki -e... [09:59:33] 06Revision-Scoring-As-A-Service, 10DBA, 10MediaWiki-extensions-ORES, 07Blocked-on-schema-change: Review and deploy 309825 - https://phabricator.wikimedia.org/T147734#2734014 (10Marostegui) Deployed in S5 wikidatawiki: ``` root@neodymium:/home/marostegui/git# mysql -hdb1069 -P3315 wikidatawiki -e "show cre... [10:16:27] 06Revision-Scoring-As-A-Service, 10DBA, 10MediaWiki-extensions-ORES, 07Blocked-on-schema-change: Review and deploy 309825 - https://phabricator.wikimedia.org/T147734#2734037 (10Marostegui) S7 fawiki is deployed: ``` root@neodymium:/home/marostegui/git# mysql -hdb1069 -P3317 fawiki -e "show create table or... [10:39:17] 06Revision-Scoring-As-A-Service, 10DBA, 10MediaWiki-extensions-ORES, 07Blocked-on-schema-change: Review and deploy 309825 - https://phabricator.wikimedia.org/T147734#2734049 (10Marostegui) S2 - ptwiki is deployed: ``` root@neodymium:/home/marostegui/git# mysql -hdb1069 -P3312 ptwiki -e "show create table... [13:01:22] 06Revision-Scoring-As-A-Service, 10DBA, 10MediaWiki-extensions-ORES, 07Blocked-on-schema-change: Review and deploy 309825 - https://phabricator.wikimedia.org/T147734#2734245 (10Marostegui) S2 - plwiki is deployed ``` KEY `ores_model_status` (`oresm_name`,`oresm_is_current`) dbstore2002.codfw.wmnet KEY... [13:08:01] 06Revision-Scoring-As-A-Service, 10DBA, 10MediaWiki-extensions-ORES, 07Blocked-on-schema-change: Review and deploy 309825 - https://phabricator.wikimedia.org/T147734#2734263 (10Marostegui) S2 - nlwiki is deployed: ``` KEY `ores_model_status` (`oresm_name`,`oresm_is_current`) dbstore2002.codfw.wmnet KE... [13:16:21] 06Revision-Scoring-As-A-Service, 10DBA, 10MediaWiki-extensions-ORES, 07Blocked-on-schema-change: Review and deploy 309825 - https://phabricator.wikimedia.org/T147734#2734269 (10Marostegui) S6 - ruwiki is deployed: ``` root@neodymium:/home/marostegui/git# mysql -hdb1069 -P3316 ruwiki -e "show create table... [13:23:10] 06Revision-Scoring-As-A-Service, 10DBA, 10MediaWiki-extensions-ORES, 07Blocked-on-schema-change: Review and deploy 309825 - https://phabricator.wikimedia.org/T147734#2734271 (10Marostegui) S2 - trwiki is deployed: ``` KEY `ores_model_status` (`oresm_name`,`oresm_is_current`) dbstore2002.codfw.wmnet KE... [13:23:41] 06Revision-Scoring-As-A-Service, 10DBA, 10MediaWiki-extensions-ORES, 07Blocked-on-schema-change: Review and deploy 309825 - https://phabricator.wikimedia.org/T147734#2734272 (10Marostegui) @Ladsgroup I believe all of them are done, let me know if this can be closed. Cheers Manuel. [13:28:32] 06Revision-Scoring-As-A-Service, 10DBA, 10MediaWiki-extensions-ORES, 07Blocked-on-schema-change: Review and deploy 309825 - https://phabricator.wikimedia.org/T147734#2702076 (10Ladsgroup) 05Open>03Resolved [13:34:48] 06Revision-Scoring-As-A-Service, 10DBA, 10MediaWiki-extensions-ORES, 07Blocked-on-schema-change: Review and deploy 309825 - https://phabricator.wikimedia.org/T147734#2734302 (10Ladsgroup) Thanks! [13:48:52] o/ [13:48:54] * halfak reads scrollback [13:49:00] o/ Amir1 [13:49:17] hey halfak [13:49:27] I see that you got the schema changes finished while I was sleeping [13:52:32] I just answered some questions :D [14:06:58] 06Revision-Scoring-As-A-Service, 10ORES: Implement prioritization of request processing - https://phabricator.wikimedia.org/T148594#2734362 (10Halfak) OK. New idea. I think that ORES should independently flag the priority of requests and that a scoring system could then use those priorities to decide when it... [14:07:14] Amir1, ^ [14:07:20] I think that might make more sense. [14:07:41] thanks halfak [14:07:45] Eventually, we could alter the priority system to be able to set priority based on OAuth or something like that. [14:08:09] So I imagine the scoring system would remember its map of priority-name --> queue size. [14:08:26] And that a "priority" could be provided with ever "score" request. [14:08:47] For all scoring systems that aren't celery, it seems that this would just be an ignored parameter. [14:23:41] 06Revision-Scoring-As-A-Service, 10ChangeProp, 10EventBus, 06Services (watching), 15User-mobrovac: Rewrite ORES precaching change propagation configuration as a code module - https://phabricator.wikimedia.org/T148714#2734398 (10Halfak) OK. I was thinking about this more last night. We can have a precac... [16:46:20] (03PS1) 10Ladsgroup: Add CacheTest.php (was Extensive CI tests, part III) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/317172 (https://phabricator.wikimedia.org/T146560) [16:52:09] (03PS2) 10Ladsgroup: Add CacheTest.php (was Extensive CI tests, part III) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/317172 (https://phabricator.wikimedia.org/T146560) [16:54:29] (03CR) 10jenkins-bot: [V: 04-1] Add CacheTest.php (was Extensive CI tests, part III) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/317172 (https://phabricator.wikimedia.org/T146560) (owner: 10Ladsgroup) [16:55:17] (03CR) 10Ladsgroup: "recheck" [extensions/ORES] - 10https://gerrit.wikimedia.org/r/317172 (https://phabricator.wikimedia.org/T146560) (owner: 10Ladsgroup) [16:55:31] recheck you stupid prat [17:05:19] github, twitter, spotify and several others are down due to a huge DDoS [17:22:22] halfak: I just saw this: http://stackoverflow.com/questions/15239880/task-priority-in-celery-with-redis Do you think it would be useful for us? [17:22:49] Amir1, maybe, yeah. [17:23:19] Right now, we don't make use of priority. [17:28:51] yeah, Let's have it! [17:29:09] halfak: Do you want me to give a shot at it? [17:29:31] Yeah. Make sure you can demonstrate that it works in practice. [17:30:08] okay! [17:30:41] * halfak --> lunch [17:41:41] (03CR) 10Thiemo Mättig (WMDE): [C: 031] Add CacheTest.php (was Extensive CI tests, part III) (034 comments) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/317172 (https://phabricator.wikimedia.org/T146560) (owner: 10Ladsgroup) [18:39:51] * halfak <-- lunch [18:47:29] NOOO GITHUB ARG [18:48:46] 06Revision-Scoring-As-A-Service, 10rsaas-articlequality : Update wikiclass for revscoring 1.3.0 - https://phabricator.wikimedia.org/T147201#2684543 (10Halfak) That PR is now ready, but I can't remove the "(WIP)" from the title right now because DynDNS is getting DDoS'd and that's taken down github. [18:56:31] (03CR) 10Ladsgroup: Add CacheTest.php (was Extensive CI tests, part III) (034 comments) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/317172 (https://phabricator.wikimedia.org/T146560) (owner: 10Ladsgroup) [18:58:32] (03PS3) 10Ladsgroup: Add CacheTest.php (was Extensive CI tests, part III) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/317172 (https://phabricator.wikimedia.org/T146560) [18:59:28] (03CR) 10jenkins-bot: [V: 04-1] Add CacheTest.php (was Extensive CI tests, part III) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/317172 (https://phabricator.wikimedia.org/T146560) (owner: 10Ladsgroup) [19:04:04] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels, 10rsaas-editquality: Train/deploy article quality models for ptwiki - https://phabricator.wikimedia.org/T138726#2735024 (10He7d3r) [19:09:18] (03PS4) 10Ladsgroup: Add CacheTest.php (was Extensive CI tests, part III) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/317172 (https://phabricator.wikimedia.org/T146560) [19:10:04] (03CR) 10jenkins-bot: [V: 04-1] Add CacheTest.php (was Extensive CI tests, part III) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/317172 (https://phabricator.wikimedia.org/T146560) (owner: 10Ladsgroup) [19:11:26] (03PS5) 10Ladsgroup: Add CacheTest.php (was Extensive CI tests, part III) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/317172 (https://phabricator.wikimedia.org/T146560) [21:04:11] 06Revision-Scoring-As-A-Service, 10revscoring: Implement sentences datascources & experiment with normalization. - https://phabricator.wikimedia.org/T148867#2735271 (10Halfak) [21:10:05] 10Revision-Scoring-As-A-Service-Backlog, 10revscoring: Sentence bank for personal attacks - https://phabricator.wikimedia.org/T148035#2735313 (10Halfak) [21:10:08] 10Revision-Scoring-As-A-Service-Backlog, 10revscoring: Sentence bank for vandalism - https://phabricator.wikimedia.org/T148034#2735314 (10Halfak) [21:10:09] 10Revision-Scoring-As-A-Service-Backlog, 10revscoring: Sentence bank for Featured Articles - https://phabricator.wikimedia.org/T148033#2735315 (10Halfak) [21:10:12] 10Revision-Scoring-As-A-Service-Backlog, 10revscoring: Sentence bank for spam - https://phabricator.wikimedia.org/T148032#2735316 (10Halfak) [21:10:14] 06Revision-Scoring-As-A-Service, 10revscoring: Implement sentences datascources & experiment with normalization. - https://phabricator.wikimedia.org/T148867#2735312 (10Halfak) [21:10:56] 06Revision-Scoring-As-A-Service, 10revscoring: Implement sentences datascources & experiment with normalization. - https://phabricator.wikimedia.org/T148867#2735271 (10Halfak)