[14:52:05] 10Quarry, 10utfnormal: Make downloading wiki-compatible - https://phabricator.wikimedia.org/T171404#3463759 (10IKhitron) [15:07:32] 10Quarry, 10utfnormal: Make downloading wiki-compatible - https://phabricator.wikimedia.org/T171404#3463759 (10zhuyifei1999) > please create one more that is wiki-compatible What do you mean by "wiki-compatible"? [15:08:11] 10Quarry: Make downloading wiki-compatible - https://phabricator.wikimedia.org/T171404#3463778 (10zhuyifei1999) [15:10:08] 10Quarry: Make downloading wiki-compatible - https://phabricator.wikimedia.org/T171404#3463779 (10IKhitron) Hi and thank you for the answer. Exactly as I say. When we get the results, they are unreadable, because of the type of encoding you support, that is not compatible with wiki content. [15:24:50] 10Quarry: Make downloading wiki-compatible - https://phabricator.wikimedia.org/T171404#3463781 (10zhuyifei1999) My test (here `` is a line feed character followed by a carriage return character): # https://quarry.wmflabs.org/query/20457 Download > CSV got a file named `quarry-20457-untitled-run192644... [15:33:22] 10Quarry: Make downloading wiki-compatible - https://phabricator.wikimedia.org/T171404#3463784 (10IKhitron) Sure, @zhuyifei1999, thanks. {F8820303} {F8820304} [15:36:44] 10Quarry: Quarry should remember my login - https://phabricator.wikimedia.org/T164390#3231927 (10zhuyifei1999) Cause: The HTTP response header for cookies on quarry is: ``` Set-Cookie: session=REDACTED; HttpOnly; Path=/ ``` It does not specify an expiry and as a result it expires [[https://stackoverflow.com/q/4... [15:41:57] 10Quarry: Make downloading wiki-compatible - https://phabricator.wikimedia.org/T171404#3463790 (10IKhitron) Btw, two things: * The format you support is "UTF-8 without BOM", the needed format is "UTF-8". * I opened your file in Excel, it's unreadable. {F8820325} [15:50:14] 10Quarry: Make downloading wiki-compatible - https://phabricator.wikimedia.org/T171404#3463791 (10zhuyifei1999) ``` $ diff new-quarry-2157-hewiki-unexisting-templates-run192641.csv quarry-2157-hewiki-unexisting-templates-run192641.csv 1c1 < page_namespace,page_title,tl_title --- > page_namespace,page_title,tl_... [15:51:51] 10Quarry: Make downloading wiki-compatible - https://phabricator.wikimedia.org/T171404#3463792 (10IKhitron) Great. Can you add such a format, pleeeese? [15:52:11] 10Quarry: Make downloading wiki-compatible - https://phabricator.wikimedia.org/T171404#3463793 (10zhuyifei1999) Just making sure before I upload a patch: does the option `Excel (UTF-16 CSV)` work? [15:53:44] 10Quarry: Make UTF-8 downloading excel-compatible - https://phabricator.wikimedia.org/T171404#3463794 (10zhuyifei1999) [15:53:48] 10Quarry: Make UTF-8 downloading excel-compatible - https://phabricator.wikimedia.org/T171404#3463795 (10IKhitron) Thank you! No, it doesn't, it looks the same as in the screenshot I gave you. [16:13:10] 10Quarry: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126#3463806 (10zhuyifei1999) [16:13:12] 10Quarry: Make UTF-8 downloading excel-compatible - https://phabricator.wikimedia.org/T171404#3463808 (10zhuyifei1999) [16:21:54] 10Quarry: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126#3463810 (10zhuyifei1999) a:03zhuyifei1999 I cannot think of a clean way to hack a BOM into the response, or cleanly set the response encoding in the generator. Will add a [[https://github.com/jmcnamara/Xlsx... [16:23:57] 10Quarry: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126#3463812 (10IKhitron) Wierd. There is no way to append three characters string to the file at start? [16:39:56] 10Quarry: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126#3463825 (10zhuyifei1999) >>! In T76126#3463812, @IKhitron wrote: > Wierd. There is no way to append three characters string to the file at start? The response is constructed from a [[https://github.com/wikim... [16:41:46] 10Quarry: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126#3463827 (10IKhitron) And you can't catch the file after the generator? Curiouser and curiouser. [16:46:47] 10Quarry: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126#3463828 (10zhuyifei1999) And regarding why not unconditionally add BOM: >>! In T76126#800971, @yuvipanda wrote: > Hmm, so perhaps we just need to output a BOM. But that makes me feel all kinds of weird for U... [16:49:42] 10Quarry: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126#3463831 (10IKhitron) So this why I asked you to add this format, not replace. For me it always worked, so you don't remove anything, there will be at least the same functionality. But you are he boss. [16:57:38] wikibugs: CALM DOWN [17:28:17] 10Quarry, 10Patch-For-Review: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126#3463879 (10zhuyifei1999) ^ Will test, right now I'm downloading the vagrant box. [18:56:24] 10Quarry, 10Patch-For-Review: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126#3463890 (10zhuyifei1999) Test with `SELECT "首页" AS page_title;` and latest patch I got: {F8821412} [18:59:33] 10Quarry, 10Patch-For-Review: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126#3463891 (10IKhitron) Looks nice. I don't know why, but it is opened by 7-Zip, not Excel. I hope it's phabticator problem, not Quarry's.