[06:33:21] 10Scoring-platform-team (Current), 10Scap, 10Patch-For-Review, 10Release-Engineering-Team (Kanban): Support git-lfs in scap - https://phabricator.wikimedia.org/T180627#4259920 (10awight) [06:33:23] 10Scoring-platform-team (Current), 10ORES, 10drafttopic-modeling, 10Patch-For-Review, 10artificial-intelligence: Deploy drafttopic model to production ORES - https://phabricator.wikimedia.org/T176336#4259919 (10awight) [10:22:43] 10Scoring-platform-team (Current), 10ORES, 10drafttopic-modeling, 10Patch-For-Review, 10artificial-intelligence: Deploy drafttopic model to production ORES - https://phabricator.wikimedia.org/T176336#3621858 (10awight) Drafttopic code is live on ores2002, the word2vec file has cloned successfully after a... [10:23:38] 10Scoring-platform-team (Current), 10Scap, 10Patch-For-Review, 10Release-Engineering-Team (Kanban): Support git-lfs in scap - https://phabricator.wikimedia.org/T180627#4260482 (10awight) @mmodell Awesome, thanks for this workaround. I confirmed that running your command from deploy1001 made the following... [11:12:36] walking for an hour [11:27:23] 10Scoring-platform-team, 10JADE, 10Wikimedia-Extension-setup, 10Design, 10Wikimedia-extension-review-queue: Design review for JADE - https://phabricator.wikimedia.org/T190690#4260568 (10Prtksxna) I think we can safely skip {icon smile-o} [12:31:42] (03CR) 10Ladsgroup: [C: 032] Change schema to contain multiple judgments and endorsements [extensions/JADE] - 10https://gerrit.wikimedia.org/r/437447 (https://phabricator.wikimedia.org/T194219) (owner: 10Awight) [12:34:24] 10Scoring-platform-team (Current), 10Analytics, 10EventBus, 10MediaWiki-JobQueue, and 4 others: ORESFetchScoreJob fails quite a lot - https://phabricator.wikimedia.org/T196076#4260693 (10mobrovac) 05Open>03Resolved Thank you @Ladsgroup ! [12:36:23] (03Merged) 10jenkins-bot: Change schema to contain multiple judgments and endorsements [extensions/JADE] - 10https://gerrit.wikimedia.org/r/437447 (https://phabricator.wikimedia.org/T194219) (owner: 10Awight) [12:36:52] 10Scoring-platform-team (Current), 10monitoring: ORES changeprop graph is broken - https://phabricator.wikimedia.org/T196543#4260706 (10awight) [12:37:52] (03CR) 10jenkins-bot: Change schema to contain multiple judgments and endorsements [extensions/JADE] - 10https://gerrit.wikimedia.org/r/437447 (https://phabricator.wikimedia.org/T194219) (owner: 10Awight) [12:39:46] Amir1: cool, thank you! [12:40:19] :) [12:42:06] 10Scoring-platform-team, 10JADE, 10Wikimedia-Extension-setup, 10Wikimedia-extension-review-queue: Extension review for JADE - https://phabricator.wikimedia.org/T188307#4260718 (10awight) [12:42:09] 10Scoring-platform-team, 10JADE, 10Wikimedia-Extension-setup, 10Design, 10Wikimedia-extension-review-queue: Design review for JADE - https://phabricator.wikimedia.org/T190690#4260716 (10awight) 05Open>03Resolved a:03awight [12:42:25] 10Scoring-platform-team (Current), 10JADE: Deploy JADE extension to production - https://phabricator.wikimedia.org/T183381#4260723 (10awight) [12:42:27] 10Scoring-platform-team, 10JADE, 10Wikimedia-Extension-setup, 10Wikimedia-extension-review-queue: Extension review for JADE - https://phabricator.wikimedia.org/T188307#4003278 (10awight) 05Open>03Resolved a:03awight [12:44:54] 10Scoring-platform-team, 10JADE: JADE: Validate endorsement user - https://phabricator.wikimedia.org/T196544#4260730 (10awight) [12:45:11] 10Scoring-platform-team, 10JADE: JADE: Validate endorsement user - https://phabricator.wikimedia.org/T196544#4260740 (10awight) [12:45:13] 10Scoring-platform-team, 10JADE: JADE: Validate endorsement user - https://phabricator.wikimedia.org/T196544#4260730 (10awight) [12:46:20] awight: is there anything I can help with? [12:47:04] 10Scoring-platform-team (Current), 10ORES, 10drafttopic-modeling, 10Patch-For-Review, 10artificial-intelligence: Deploy drafttopic model to production ORES - https://phabricator.wikimedia.org/T176336#4260744 (10awight) ores2002 looks very much like ores2001 and seems to be in a stable garbage-collection... [12:47:52] Amir1: feel like taking on SoS for the next month at least? [12:48:09] Yeah sure! [12:48:15] It's at a bad time for kid meltdown... [12:48:18] Thanks! [12:48:46] 10Scoring-platform-team (Current), 10JADE: Data Justice paper abstract deadline June 11 - https://phabricator.wikimedia.org/T195757#4260746 (10awight) 05Open>03declined No invitation to write a paper... [12:50:16] Amir1: I have a bunch of stuff in its last paces, so nothing else that I can think to hand off at the moment. But maybe you want to discuss: T196475 [12:50:16] T196475: Discuss whether we can have ORES provide explanations for its predictions - https://phabricator.wikimedia.org/T196475 [12:50:26] i.e., LIME integration [12:52:50] that's interesting. I take a look at this [12:53:12] :D [12:53:36] btw. Would you mind if I take a pass on https://github.com/adamwight/ores-reference-ui ? [12:53:51] specially if you move it to wiki-ai [12:53:54] So far, I'm thinking LIME can be provided as a separate service rather than tightly integrated, but I haven't looked at requirements much. [12:54:14] Amir1: awesome, lemme officially move that. [12:54:40] Amir1: We haven't decided how to integrate the new UI yet, either. I'm interested to hear your thoughts. [12:55:18] Sure thing! [12:56:14] Hey folks. I'm running late from a doctor's appointment. Probably 20 minutes late. [12:56:38] Amir1, awight [12:56:44] o/ [12:56:49] halfak_: roger! [13:00:50] Amir1: Can you try making a new PR against the wiki-ai repo, to see if the parent repo is correct now? [13:01:05] oh meeting! [13:18:54] 10Scoring-platform-team (Current), 10JADE: Scalability concerns creating a page per revision - https://phabricator.wikimedia.org/T196547#4260809 (10awight) [13:59:39] 10Scoring-platform-team (Current), 10Services, 10monitoring: ORES changeprop graph is broken - https://phabricator.wikimedia.org/T196543#4261003 (10awight) [14:01:20] halfak_: https://en.wikipedia.beta.wmflabs.org/wiki/JADE:Diff/376901 [14:01:24] new schema :D [14:03:54] 10Scoring-platform-team (Current), 10JADE: Scalability concerns creating a page per revision - https://phabricator.wikimedia.org/T196547#4261015 (10awight) [14:07:01] 10Scoring-platform-team (Current), 10monitoring, 10Services (done): ORES changeprop graph is broken - https://phabricator.wikimedia.org/T196543#4261022 (10Pchelolo) 05Open>03Resolved a:03Pchelolo Not any more [14:09:12] 10Scoring-platform-team (Current), 10monitoring, 10Services (done): ORES changeprop graph is broken - https://phabricator.wikimedia.org/T196543#4261033 (10awight) @Pchelolo Wow, thank you! [14:16:08] Amir1: halfak_: Where are human wp10 actions happening? [14:16:14] *assessments [14:16:22] Talk pages of articles [14:16:26] aha ty [14:17:21] Oooh new schema [14:17:23] * awight notes that our wp10 schema should allow for multiple assessments, each connected to a wikiproject... [14:22:15] Amir1: If you feel like responding, https://phabricator.wikimedia.org/T196547#4261067 [14:22:37] 10Scoring-platform-team (Current), 10JADE: Scalability concerns creating a page per revision - https://phabricator.wikimedia.org/T196547#4261067 (10awight) Estimating impact: select count(*) from logging where log_type = 'patrol' and log_timestamp > 20180101000000; For enwiki, 108,274 patrol actions or 1... [14:23:22] awight: I will answer more ASAP [14:23:54] ty! [14:30:05] 10Scoring-platform-team (Current), 10JADE: Scalability concerns creating a page per revision - https://phabricator.wikimedia.org/T196547#4261092 (10Ladsgroup) The thing about enwiki is that they have NPP but not RCP (new page patrolling but not recent change patrolling) which means this is the number of new pa... [14:30:38] 10Scoring-platform-team (Current), 10ORES, 10drafttopic-modeling, 10Patch-For-Review, 10artificial-intelligence: Deploy drafttopic model to production ORES - https://phabricator.wikimedia.org/T176336#4261093 (10awight) I've run the workaround creating ~deploy-service/.gitconfig on all production hosts. [14:31:37] Amir1: I'm not sure what that means... you're saying that NPP actions aren't logged? [14:31:56] RCP actions are not logged [14:32:11] ah oh dear [14:32:48] (in enwiki, you can check frwiki and get sort of estimation of NPP and RCP ratio) [14:32:53] I can provide one [14:33:13] I can just count new pages to get an upper limit... [14:41:14] 10Scoring-platform-team, 10revscoring, 10User-Zoranzoki21, 10artificial-intelligence: The table does not fit into the page - https://phabricator.wikimedia.org/T195255#4221031 (10Ladsgroup) That was my stupid design, I get the whole thing a little bit more clear today. [14:49:58] Amir1: Where does RCP action get recorded if not in the logging table? [14:50:24] nowhere, people in enwiki can't patrol edits [14:50:53] Which is something I really want to fix (was talking about it with Ryan and Danny in the hackathon) [14:52:11] oho wow [14:57:31] FYI, I'm doing the draft topic deployment now rather that in the crazy window later tonight [15:07:32] * awight keeps lips pursed. but we might have drafttopic in 30 min [15:09:46] cool, new schema works everywhere [15:09:46] https://en.wikipedia.beta.wmflabs.org/wiki/JADE:Page/188553 [15:09:53] https://en.wikipedia.beta.wmflabs.org/wiki/JADE:Revision/376901 [15:13:45] Amir1: I'm not seeing off-hand how frwiki records RCP vs NPP, do you happen to know? [15:14:16] Maybe I'm looking for 'previd";s:1:"0"' inside the log_params? [15:20:03] awight, finally looked at your JADE schema. Why have '{"data": true}' and not just 'true'? [15:20:26] Maybe so we could have "summary" next to "data"? [15:21:05] it was to hold "endorsements" and "preferred" attributed [15:21:07] *s [15:21:12] what would "summary" be? [15:21:21] a rationale comment? [15:21:24] Free text explaining [15:21:26] right [15:21:38] I like "comment" better than "summary" now that you mention it. [15:21:41] ah cool, we could add that if we decide it fits better than using the revision comment [15:22:06] yes. Will certainly be better than the revision comment -- especially in the case of a revert! [15:22:21] Here's an example of endorsements parallel to "data" https://en.wikipedia.beta.wmflabs.org/wiki/JADE:Diff/376901 [15:22:22] "rv: this is clearly not damaging. stop edit warring!" [15:22:32] lol [15:22:57] Nice. [15:24:33] So, I suppose we should have "origin" in the data struct as well [15:25:11] (03PS1) 10Awight: Add comment and origin to judgment schema [extensions/JADE] - 10https://gerrit.wikimedia.org/r/437775 [15:26:11] Ahh yeah. As in "huggle" or "wikilabel" or something like that? [15:26:21] exactly [15:26:21] "on-wiki" [15:26:24] :) [15:26:27] "diff page" [15:26:47] "jo mama" [15:26:55] (03PS2) 10Awight: Add comment and origin to judgment schema [extensions/JADE] - 10https://gerrit.wikimedia.org/r/437775 [15:27:04] hmm? [15:27:51] https://ores.wikimedia.org/v3/scores/enwiki/123456?models=drafttopic [15:27:59] codezeeeee [15:28:31] https://en.wikipedia.org/w/index.php?title=User:EpochFail/DraftTopic.js&diff=844702773&oldid=841989050 [15:28:42] oh snap [15:28:55] "Geography.Countries" [15:28:57] lolwat [15:28:57] 10Scoring-platform-team: Scoring Platform FY18 Q3 - https://phabricator.wikimedia.org/T183198#4261363 (10awight) [15:29:01] I hate that category [15:29:02] hehe ores2001 is on fire [15:29:06] 10Scoring-platform-team (Current): Scoring platform team FY18 Q2 - https://phabricator.wikimedia.org/T176324#4261364 (10awight) [15:29:07] uhoh [15:29:17] 10Scoring-platform-team (Current), 10ORES, 10drafttopic-modeling, 10Patch-For-Review, 10artificial-intelligence: Deploy drafttopic model to production ORES - https://phabricator.wikimedia.org/T176336#4261360 (10awight) 05Open>03Resolved a:03awight [15:30:03] it's a stale deployment dir [15:32:01] savagely workingaround [15:32:11] hahaha [15:32:12] awight@deploy1001:/srv/deployment/ores/deploy$ SSH_AUTH_SOCK=/run/keyholder/proxy.sock ssh -l deploy-service ores2001.codfw.wmnet "cd /srv/deployment/ores/deploy-cache/revs/65e979fc2ee87198a93473a852278b2adf551dc8/submodules/assets; git lfs pull" [15:32:19] arg! [15:32:20] * awight roars like a small cat [15:37:35] brb I need to reboot to fix a weird gnome issue. [15:38:51] 10Scoring-platform-team (Current), 10JADE: Scalability concerns creating a page per revision - https://phabricator.wikimedia.org/T196547#4261386 (10awight) Thanks, so NPP patrolling isn't logged... Here's a reasonable upper bound for enwiki, if every new page were patrolled: select count(*) from revision... [15:46:26] Good news, our response time didn't take much of a hit. 95% did go up by 1s, but median only by 0.03s [15:50:32] Amir1: halfak: my napkin says that our "success" scenario will look like 2.5M new JADE: namespace pages being created in a year. [15:50:38] (that is bad news) [15:51:02] On enwiki, that is a lot of pages, but it's not way out there. [15:51:43] Feel free to comment on the task saying, "hell yeah, let's spamflood with this new curation tool" :p [15:51:53] lol [15:52:18] I wonder who would be good to consult about this. Maybe tgr [15:52:31] Or one of the performance folks who is looking at MCR [15:52:58] I figure that if you're looking at MCR, you're thinking about pages and revisions long-term [15:53:10] halfak: hey, I just got back from "lunch" [15:53:12] good call. I'll ping tgr on the task [15:53:17] Cool :) [15:53:20] o/ Amir1 [15:53:27] I just talked to Daniel and he said they will discuss it with TechCom tonight [15:53:29] lunch-dinner [15:53:30] :) [15:53:32] Oh cool [15:53:53] Hopefully he didn't take it as a "let's make a binding decision right away" kind of request [15:54:19] FYI: 44M pages in enwiki right now [15:54:21] Amir1: This is the JADE page scalability question? [15:54:27] yup [15:54:32] 51M in wikidatawiki [15:54:43] oh awesome! Thanks for thinking of it before deployment, and acting so quickly :-) [15:55:49] awight: regarding the UI, I found out why it's aligning with WikimediaUI style guide. Because the CSS has been updated two years ago: https://github.com/jdlrobson/wikipedia-react-components/blob/master/components/Button/mediawiki-ui-button.css [15:55:58] bahaha [15:56:03] nice one [15:56:04] I want to a make a PR and fix it [15:56:16] awight: but there is no license mentioned in the repo [15:56:22] that needs to be fixed first :D [15:56:34] +1 jdlrobson will be thrilled to see contributions IMO, this is a "20%" project of his [15:57:00] 10Scoring-platform-team (Current), 10JADE, 10TechCom: Deploy JADE extension to production - https://phabricator.wikimedia.org/T183381#4261492 (10daniel) Tagging for internal techcom discussion. Is the documentation on the implementation of JADE somewhere? Note to self: * Some docs at https://www.mediawiki.... [15:57:02] OK, codfw memory just went through one GC cycle and looks healthy. [15:58:41] I pinged him but he is not around. Will talk to him more [15:59:56] PROBLEM - Host ORES-web01.Experimental is DOWN: CRITICAL - Host Unreachable (ores-web-01.ores.eqiad.wmflabs) [16:00:07] PROBLEM - ORES web node labs ores-web-01 on ores.wmflabs.org is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 325 bytes in 3.083 second response time [16:00:30] ? [16:00:33] cloud maintenance? [16:03:03] 10Scoring-platform-team (Current), 10JADE, 10TechCom: Deploy JADE extension to production - https://phabricator.wikimedia.org/T183381#4261526 (10awight) @daniel Thanks for taking a look. The implementation is quite simple at the moment, it's just a namespace "JADE" with validation to enforce a schema and so... [16:06:36] We're definitely online [16:06:45] woohoo! [16:06:47] maybe it's just the one node [16:06:59] oh, staging? [16:07:13] wmflabs [16:07:20] kk [16:07:37] ores-web-01 is fully offline [16:07:44] RECOVERY - Host ORES-web01.Experimental is UP: PING OK - Packet loss = 0%, RTA = 0.81 ms [16:07:51] RECOVERY - check users on ORES-web01.Experimental is OK: USERS OK - 0 users currently logged in [16:07:52] RECOVERY - check disk on ORES-web01.Experimental is OK: DISK OK [16:07:55] -cloud has a tiny bit of chatter about reboots [16:07:56] 04Error: Command “cloud” not recognized. Please review and correct what you’ve written. [16:07:59] RECOVERY - ssh on ORES-web01.Experimental is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u2 (protocol 2.0) [16:08:06] RECOVERY - check load on ORES-web01.Experimental is OK: OK - load average: 0.55, 0.14, 0.05 [16:08:08] /kick AsimovBot into -cloud [16:08:10] aha [16:08:13] That's probably it. [16:08:22] RECOVERY - ping4 on ORES-web01.Experimental is OK: PING OK - Packet loss = 0%, RTA = 0.54 ms [16:08:25] * halfak goes back to regularly scheduled freaking out about deadlines. [16:08:31] hehe [16:08:41] I'm about done for the day. [16:08:58] RECOVERY - ORES web node labs ores-web-01 on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 457 bytes in 0.565 second response time [16:15:08] o/ [16:22:40] o/ [16:32:22] Lunch! [17:34:06] Reboots! [17:34:17] o/ paladox [17:34:35] heh [17:49:50] PROBLEM - ping4 on Experimental ORES Website is CRITICAL: CRITICAL - Host Unreachable (ores.wmflabs.org) [17:50:01] PROBLEM - check http on Experimental ORES Website is CRITICAL: connect to address ores.wmflabs.org and port 443: No route to hostHTTP CRITICAL - Unable to open TCP socket [17:50:47] PROBLEM - Host Experimental ORES Website is DOWN: CRITICAL - Host Unreachable (ores.wmflabs.org) [17:54:44] RECOVERY - Host Experimental ORES Website is UP: PING OK - Packet loss = 0%, RTA = 1.91 ms [18:03:08] (03PS1) 10Ladsgroup: Let scores of wp10 models stay in the database forever [extensions/ORES] - 10https://gerrit.wikimedia.org/r/437797 (https://phabricator.wikimedia.org/T194298) [18:17:30] PROBLEM - ORES web node labs ores-web-02 on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:18:10] PROBLEM - ORES web node labs ores-web-01 on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:18:29] PROBLEM - ORES worker labs on ores.wmflabs.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:25:49] RECOVERY - ORES web node labs ores-web-01 on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 443 bytes in 0.556 second response time [18:26:00] RECOVERY - ORES worker labs on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 443 bytes in 3.637 second response time [18:26:29] PROBLEM - Host ORES-worker06.experimental is DOWN: CRITICAL - Host Unreachable (ores-worker-06.ores.eqiad.wmflabs) PROBLEM - check disk on ORES-worker06.experimental is CRITICAL: connect to address 10.68.21.86 port 5666: No route to hostconnect to host ores-worker-06.ores.eqiad.wmflabs port 5666: No route to host [18:26:32] PROBLEM - ping4 on ORES-worker02.experimental is CRITICAL: CRITICAL - Host Unreachable (ores-worker-02.ores.eqiad.wmflabs) PROBLEM - check load on ORES-worker02.experimental is CRITICAL: connect to address 10.68.22.195 port 5666: No route to hostconnect to host ores-worker-02.ores.eqiad.wmflabs port 5666: No route to host [18:26:32] PROBLEM - puppet on ORES-worker02.experimental is CRITICAL: connect to address 10.68.22.195 port 5666: No route to hostconnect to host ores-worker-02.ores.eqiad.wmflabs port 5666: No route to host [18:26:33] PROBLEM - ssh on ORES-worker02.experimental is CRITICAL: connect to address ores-worker-02.ores.eqiad.wmflabs and port 22: No route to host [18:30:29] RECOVERY - Host ORES-worker03.experimental is UP: PING OK - Packet loss = 0%, RTA = 1.19 ms [18:30:32] RECOVERY - Host ORES-worker01.experimental is UP: PING OK - Packet loss = 0%, RTA = 1.24 ms [18:30:32] RECOVERY - check users on ORES-worker03.experimental is OK: USERS OK - 0 users currently logged in [18:30:34] RECOVERY - ORES web node labs ores-web-02 on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 457 bytes in 0.632 second response time [18:30:38] RECOVERY - Host ORES-worker02.experimental is UP: PING OK - Packet loss = 0%, RTA = 0.54 ms [18:30:38] RECOVERY - check load on ORES-worker01.experimental is OK: OK - load average: 0.39, 0.10, 0.03 [18:30:38] RECOVERY - ssh on ORES-worker01.experimental is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u2 (protocol 2.0) [18:30:41] RECOVERY - Host ORES-web02.Experimental is UP: PING OK - Packet loss = 0%, RTA = 0.72 ms [18:32:23] RECOVERY - Host ORES-worker06.experimental is UP: PING OK - Packet loss = 0%, RTA = 1.02 ms [19:42:07] 10Scoring-platform-team, 10ORES, 10Wikidata, 10Wikidata.org: Sitelink removals on Wikidata caused by page deletion shouldn't have a negative effect - https://phabricator.wikimedia.org/T195040#4262285 (10Ladsgroup) We already have a feature for client actions and it's using it (https://github.com/wiki-ai/ed... [20:05:19] Amir1, let me know when you have something on gerrit. I'll get the tasks organized. [20:05:41] halfak: for deploying new version of ORES? [20:05:46] Right. [20:09:00] Amir1, it is this, right? https://github.com/wiki-ai/ores/pull/250 [20:09:21] and https://github.com/wiki-ai/ores/pull/247 [20:10:01] I'm looking for the task. maybe there wasn't one? [20:10:59] 10Scoring-platform-team (Current), 10editquality-modeling, 10revscoring, 10artificial-intelligence: Catch a specific new badword in English - https://phabricator.wikimedia.org/T196468#4262316 (10Halfak) a:03Halfak [20:11:30] 10Scoring-platform-team (Current), 10ORES, 10WikimediaUI Style Guide, 10User-Ladsgroup: Give a new look to the home page - https://phabricator.wikimedia.org/T196580#4262317 (10Halfak) [20:11:39] 10Scoring-platform-team (Current), 10ORES, 10WikimediaUI Style Guide, 10User-Ladsgroup: Give a new look to the home page - https://phabricator.wikimedia.org/T196580#4262328 (10Halfak) a:03Ladsgroup [20:11:40] can't find anything [20:11:47] https://phabricator.wikimedia.org/T196580 [20:11:51] Amir1, ^ there you go :) [20:12:15] 10Scoring-platform-team (Current), 10ORES, 10WikimediaUI Style Guide, 10User-Ladsgroup: Give a new look to the home page - https://phabricator.wikimedia.org/T196580#4262330 (10Halfak) https://github.com/wiki-ai/ores/pull/247 [20:12:16] I'll be making some updated to editquality and articlequality soon, but let's not worry about them today. [20:13:33] halfak: I'm trying to make the gerrit patch but the ores-deploy repo is even with master [20:13:56] it's not, it's just can't find ores [20:15:01] hmm. [20:15:56] (03PS1) 10Ladsgroup: Bump ORES to HEAD [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/437818 (https://phabricator.wikimedia.org/T196580) [20:15:57] I'm checking now [20:16:28] halfak: ^ I made it finally, I bumped it to HEAD of ores [20:16:31] I hope that's fine [20:17:13] (03CR) 10Halfak: [V: 032 C: 032] Bump ORES to HEAD [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/437818 (https://phabricator.wikimedia.org/T196580) (owner: 10Ladsgroup) [20:17:27] Looks good. Put in on beta quick to make sure we don't burn the house down [20:22:38] * halfak F5's the beta [20:23:26] Amir1, I don't see any IRC chatter for your beta deployment. Still working on it? [20:23:42] not yet [20:23:45] got distracted [20:24:16] halfak: I thought you're doing it TBH :( [20:24:35] oh :P [20:24:45] I can... [20:25:22] I'm already deploying [20:29:31] deploy is finished now [20:30:08] it's not different [20:30:09] I don't see the updated homepage [20:30:51] Should I cherry pick it to STABLE branch [20:30:52] ? [20:31:32] halfak: ^ [20:31:48] I don't know what is going on with the STABLE branch [20:31:54] Is that something awight made? [20:32:38] It can be :/ [20:32:52] restarted uwsgi service, still the same [20:33:05] Looks like deployment-tin is on master [20:33:37] ladsgroup@deployment-ores01:/srv/deployment/ores/deploy/ores$ git log [20:33:47] says last version was on April 16 [20:34:11] wat [20:34:24] did we just merge a changeset to STABLE? [20:34:35] No.... [20:35:15] halfak: I see what's going on [20:35:22] you +2'd the patch but didn't merge it [20:35:32] * halfak feels shame [20:36:11] nope, you need to walk naked in the streets [20:41:39] halfak: try it now [20:41:51] Works! [20:42:37] Do you want to deploy prod? [20:42:43] or we should do it later? [20:43:44] 10Scoring-platform-team (Current), 10JADE, 10Operations, 10TechCom: Deploy JADE extension to production - https://phabricator.wikimedia.org/T183381#4262445 (10Joe) [20:44:33] Let's wait. We're almost outside the window now :| [20:44:46] But we're ready for next time ^_^ [20:44:59] 10Scoring-platform-team (Current), 10JADE, 10Operations, 10User-Joe: Scalability concerns creating a page per revision - https://phabricator.wikimedia.org/T196547#4262449 (10Joe) [20:45:45] Sure [21:25:25] (03CR) 10jenkins-bot: Localisation updates from https://translatewiki.net. [extensions/JADE] - 10https://gerrit.wikimedia.org/r/437838 (owner: 10L10n-bot) [21:32:23] 10Scoring-platform-team (Current), 10Wikilabels, 10User-Ladsgroup, 10User-Zoranzoki21, 10artificial-intelligence: The table does not fit into the page - https://phabricator.wikimedia.org/T195255#4262561 (10Ladsgroup) a:03Ladsgroup https://github.com/wiki-ai/wikilabels/pull/238 [21:34:19] wiki-ai/wikilabels#369 (new_look_all_pages - 736b2a7 : Amir Sarabadani): The build failed. https://travis-ci.org/wiki-ai/wikilabels/builds/388982810 [21:37:13] Made some parts of wikilabels a little bit more responsive with this PR ^ [21:37:16] https://usercontent.irccloud-cdn.com/file/9h98yqCK/image.png [21:37:55] Amir1, looks good! [21:37:59] I'm just about to merge [21:38:00] :) [21:38:25] Seems like we should have that footer transcluded [21:38:27] Hmm [21:39:19] wiki-ai/wikilabels#371 (new_look_all_pages - 3a29442 : Amir Sarabadani): The build was fixed. https://travis-ci.org/wiki-ai/wikilabels/builds/388984827 [21:46:47] already worked nine hours but I still need to finish this review. I get it done and go home [21:48:15] Thank you. Sorry for the trouble. I should have looked at it sooner. [21:48:28] You can do it in the AM if that's easier. [21:48:31] Amir1, ^ [21:48:33] It's really OK [21:48:48] Tomorrow is Wikidata day :D [21:49:04] I don't get to work on ORES until Saturday [21:49:35] This isn't ORES... exactly. [21:49:40] But I'm with you [22:21:28] halfak: I improved the review to something around twice as big [22:21:34] can you take a look?