[05:24:31] (03PS9) 10Mooeypoo: [HACKATHON-WIP] Create an OOUI module for WikiEditor [extensions/WikiEditor] - 10https://gerrit.wikimedia.org/r/224971 [05:25:29] (03CR) 10jenkins-bot: [V: 04-1] [HACKATHON-WIP] Create an OOUI module for WikiEditor [extensions/WikiEditor] - 10https://gerrit.wikimedia.org/r/224971 (owner: 10Mooeypoo) [07:37:11] (03PS1) 10Vikassy: WIP: [BrowserTest] Load i18n messages from MediaWiki to browser tests [extensions/VisualEditor] - 10https://gerrit.wikimedia.org/r/225288 (https://phabricator.wikimedia.org/T105466) [07:38:50] (03PS2) 10Vikassy: WIP: [BrowserTest] Load i18n messages from MediaWiki to browser tests [extensions/VisualEditor] - 10https://gerrit.wikimedia.org/r/225288 (https://phabricator.wikimedia.org/T105466) [07:41:58] (03PS3) 10Vikassy: WIP: [BrowserTest] Load i18n messages from MediaWiki to browser tests [extensions/VisualEditor] - 10https://gerrit.wikimedia.org/r/225288 (https://phabricator.wikimedia.org/T90577) [07:43:09] (03PS4) 10Vikassy: WIP: [BrowserTest] Load i18n messages from MediaWiki to browser tests [extensions/VisualEditor] - 10https://gerrit.wikimedia.org/r/225288 (https://phabricator.wikimedia.org/T90577) [08:12:05] 10Citoid, 6Services, 6operations: Citoid returns 200 for inexistent PMCIDs - https://phabricator.wikimedia.org/T106044#1459883 (10Joe) a:3Joe [08:18:55] 10WikiEditor, 5Patch-For-Review: Toolbar API: Unnecessary cookies are stored when inserting a booklet - https://phabricator.wikimedia.org/T27184#1459886 (10Schnark) That you can't modify things that are marked as deferLoad is a different issue (and by the way, there is also T25479 for this). [08:24:26] 10Citoid, 6Services, 6operations: Citoid returns 200 for inexistent PMCIDs - https://phabricator.wikimedia.org/T106044#1459893 (10Joe) Ok this keeps getting more mysterious then. Requesting this resource using our dedicated proxy seems to DTRT From my computer: ``` ~$ curl http://www.ncbi.nlm.nih.gov/pmc/a... [08:34:43] 10Citoid, 6Services, 6operations: Citoid returns 200 for inexistent PMCIDs - https://phabricator.wikimedia.org/T106044#1459900 (10mobrovac) Debug info from `sca1001`: ``` {"name":"citoid","hostname":"sca1001","pid":5623,"level":20,"from":"PMC9999999","to":"http://www.ncbi.nlm.nih.gov/pmc/articles/PMC9999999... [08:44:03] 10Citoid, 6Services, 6operations: Citoid returns 200 for inexistent PMCIDs - https://phabricator.wikimedia.org/T106044#1459906 (10mobrovac) The Citoid SHA1 hash in the deploy repo (and the deployed version on `sca100x`) matches the source repo SHA1, so we are running the latest version, and the requests from... [08:45:01] 10WikiEditor: Some of the toolbar-API-functions don't work in a $( document ).ready-function - https://phabricator.wikimedia.org/T25479#1459907 (10GOIII) [08:47:02] 10Citoid, 6Services, 6operations: Citoid returns 200 for inexistent PMCIDs - https://phabricator.wikimedia.org/T106044#1459909 (10Joe) So, the difference seem to be in the "successfully scraped resource", which has no reason to be given the response we get from the proxy [09:04:10] 10Citoid, 6Services, 6operations: Citoid returns 200 for inexistent PMCIDs - https://phabricator.wikimedia.org/T106044#1459915 (10Joe) FWIW, I checked the url-downloader access logs and they clearly show the resource returns 404. [09:55:45] (03CR) 10Raimond Spekking: "I wonder if this new en.json should be added to translatewiki.net for translation into other languages, shouldn't it?" [extensions/VisualEditor] - 10https://gerrit.wikimedia.org/r/224965 (https://phabricator.wikimedia.org/T105466) (owner: 10Vikassy) [10:05:40] 10Citoid, 6Services, 6operations: Citoid returns 200 for inexistent PMCIDs - https://phabricator.wikimedia.org/T106044#1459983 (10mobrovac) Ok, I finally managed to track it down - NCBI has blacklisted us apparently: ``` mobrovac@sca1001:~$ curl -v -H'User-Agent: WikimediaBot' -x http://url-downloader.wikim... [10:25:55] (03CR) 10Vikassy: "Raimond: Yup! Amir will add it today :)" [extensions/VisualEditor] - 10https://gerrit.wikimedia.org/r/224965 (https://phabricator.wikimedia.org/T105466) (owner: 10Vikassy) [10:47:11] 10Citoid, 6Services, 6operations: Citoid returns 200 for inexistent PMCIDs - https://phabricator.wikimedia.org/T106044#1460027 (10Joe) From their abuse page: "please have your system administrator contact info@ncbi.nlm.nih.gov". I think we can reach out to them. Any relevant link to explain what we are doi... [10:54:46] 10Citoid, 6Services, 6operations: Citoid returns 200 for inexistent PMCIDs - https://phabricator.wikimedia.org/T106044#1460028 (10mobrovac) >>! In T106044#1460027, @Joe wrote: > From their abuse page: > > "please have your system administrator contact info@ncbi.nlm.nih.gov". > > I think we can reach out to... [10:59:27] 10Citoid, 6Services, 6operations: Citoid returns 200 for inexistent PMCIDs - https://phabricator.wikimedia.org/T106044#1460034 (10Joe) From http://www.ncbi.nlm.nih.gov/robots.txt ``` User-agent: * Crawl-delay: 5 [SNIP] Disallow: /pmc/articles/ ``` Can't say I blame them for blocking us. [11:18:18] 10Citoid, 6Services, 6operations: Citoid is blacklisted from ncbi.nlm.nih.gov - https://phabricator.wikimedia.org/T106044#1460060 (10Joe) p:5High>3Unbreak! [11:28:34] 10VisualEditor, 7I18n: Add a way to correct Romanian diacritics in VE before the page is saved - https://phabricator.wikimedia.org/T106049#1460073 (10Strainu) [12:49:29] 10Citoid, 6Services, 6operations: Citoid is blacklisted from ncbi.nlm.nih.gov - https://phabricator.wikimedia.org/T106044#1460156 (10Mvolz) If they aren't blocking Zotero then this *only* affects our scraping of the page following Zotero failure. In the interim we should completely remove the 'scraping' fal... [12:56:38] 10Citoid, 6Services, 6operations: Citoid is blacklisted from ncbi.nlm.nih.gov - https://phabricator.wikimedia.org/T106044#1460168 (10Joe) @Mvolz I reached out pointing that out. We got a first response but I guess it will take some time to get this addressed. Also, who confirmed that zotero is working indeed? [13:22:00] 10Citoid, 6Services, 6operations: Citoid is blacklisted from ncbi.nlm.nih.gov - https://phabricator.wikimedia.org/T106044#1460203 (10Joe) Update: I can confirm zotero works, I see outgoing requests from our proxy that clearly get the correct responses. I second @Mvolz idea for an "hotfix". I would also allo... [14:21:47] (03PS1) 10Vikassy: WIP: [BrowserTest] Added links based scenarios for taking screenshot [extensions/VisualEditor] - 10https://gerrit.wikimedia.org/r/225320 [14:39:38] 10Citoid, 6Services, 6operations: Citoid is blacklisted from ncbi.nlm.nih.gov - https://phabricator.wikimedia.org/T106044#1460268 (10mobrovac) >>! In T106044#1460203, @Joe wrote: > Update: I can confirm zotero works, I see outgoing requests from our proxy that clearly get the correct responses. Zotero uses... [16:24:54] 10Citoid, 6Services, 6operations: Citoid is blacklisted from ncbi.nlm.nih.gov - https://phabricator.wikimedia.org/T106044#1460583 (10Joe) @mobrovac let's wait to see if someone is able to answer me about the block on the NIH side, but my hopes are not that high at this point. If not, we can hotfix the proble... [16:30:19] 10VisualEditor: One user often can't create new articles in VisualEditor while logged in - https://phabricator.wikimedia.org/T96115#1460595 (10Aklapper) @Whatamidoing-WMF: Could you answer the last comment? [16:33:38] 10VisualEditor, 10MediaWiki-extensions-ContentTranslation: English Wikipedia Greek census11 references cannot be inspected or adapted in ContentTranslation and VisualEditor - https://phabricator.wikimedia.org/T106158#1460626 (10Amire80) 3NEW [16:42:38] 10Citoid, 6Services, 6operations: Citoid is blacklisted from ncbi.nlm.nih.gov - https://phabricator.wikimedia.org/T106044#1460654 (10mobrovac) >>! In T106044#1460583, @Joe wrote: > @mobrovac let's wait to see if someone is able to answer me about the block on the NIH side, but my hopes are not that high at t... [16:44:08] 10Citoid, 10VisualEditor, 6Services, 6operations, 3VisualEditor 2015/16 Q1 blockers: Citoid is blacklisted from ncbi.nlm.nih.gov - https://phabricator.wikimedia.org/T106044#1460659 (10Jdforrester-WMF) [18:02:05] 10VisualEditor, 10VisualEditor-MediaWiki, 10MediaWiki-extensions-SpamBlacklist: Improve support for the spam blacklist in VisualEditor - https://phabricator.wikimedia.org/T99801#1460873 (10Whatamidoing-WMF) @krenair, I don't understand this. If you want it re-opened, then why did you close it? Or why don't... [18:47:57] 10VisualEditor, 10VisualEditor-MediaWiki, 10MediaWiki-extensions-SpamBlacklist: Improve support for the spam blacklist in VisualEditor - https://phabricator.wikimedia.org/T99801#1460946 (10Krenair) Please reopen with specific actionables [20:19:31] 10Citoid: Add support for scraping scopus IDs (how?) - https://phabricator.wikimedia.org/T106179#1461220 (10Jdforrester-WMF) 3NEW [21:06:47] 10VisualEditor, 10VisualEditor-MediaWiki: Trigger spam blacklist upon opening a page in VisualEditor - https://phabricator.wikimedia.org/T99803#1461416 (10Whatamidoing-WMF) I don't think so (and maybe we should), but the effects aren't equivalent in terms of user experience. In the wikitext editor, it's possi... [21:26:14] (03CR) 10Amire80: [C: 04-1] WIP: [BrowserTest] Added links based scenarios for taking screenshot (031 comment) [extensions/VisualEditor] - 10https://gerrit.wikimedia.org/r/225320 (owner: 10Vikassy) [21:30:59] (03CR) 10Krinkle: Improve progress bar (031 comment) [extensions/VisualEditor] - 10https://gerrit.wikimedia.org/r/209869 (https://phabricator.wikimedia.org/T95137) (owner: 10Esanders) [21:35:47] (03PS1) 10Legoktm: Don't set browser-prefixed transition CSS classes [extensions/VisualEditor] - 10https://gerrit.wikimedia.org/r/225488 [21:40:12] 10VisualEditor: Enlarge the "review your changes" window - https://phabricator.wikimedia.org/T106187#1461475 (10Quiddity) 3NEW [22:18:01] Krenair: I'm experiencing the same link issue as mentioned two days ago [22:18:29] ie. can't close the link menu; pressing cancel, remove, done or anything else makes no difference whatsoever [22:18:50] are you at wikimania? [22:18:55] nope [22:21:29] so you tried to add a link [22:22:00] Yes; :mw:Extension:BounceHandler [22:22:15] then changed it to mw:Extension:BounceHandler since VE couldn't find the pagge [22:22:36] can't save it or cancel the addition [22:22:58] and no matter what I click my cursor on, the link menu doesn't want to close [22:23:57] odder, I tried adding a link to that page on testwiki and it didn't do anything weird [22:27:03] can't reproduce myself either right now [22:54:28] Krenair: https://wikitech.wikimedia.org/wiki/Webperf#mw-js-deprecate [22:54:50] Krenair: http://codepen.io/Krinkle/full/cBGCl