[00:15:30] 6Labs, 10wikitech.wikimedia.org: Exclude nova resource pages from *default* wikitech search - https://phabricator.wikimedia.org/T122993#2004579 (10bd808) Looks like `{{InstanceStatus}}` might be the right template to de-boost. [00:20:54] 10Tool-Labs-tools-Other, 6Community-Tech, 7Community-Wishlist-Survey, 7Milestone: Pageview Stats tool - https://phabricator.wikimedia.org/T120497#2004607 (10Pine) >>! In T120497#1995233, @Egedda wrote: >>>! In T120497#1994930, @Pine wrote: >> Per discussion on the Analytics mailing list, would it be possib... [00:22:44] 6Labs, 10Tool-Labs, 10DBA, 6operations: Replicate wikimania2017wiki to labs - https://phabricator.wikimedia.org/T126096#2004612 (10MaxSem) 3NEW [00:33:47] 6Labs, 10wikitech.wikimedia.org: Exclude nova resource pages from *default* wikitech search - https://phabricator.wikimedia.org/T122993#2004708 (10bd808) >>! In T122993#2004579, @bd808 wrote: > Looks like `{{InstanceStatus}}` might be the right template to de-boost. Trying it out here -- Labs admin here? [01:11:00] https://tools.wmflabs.org/?status displays wrong values, it shows the vnem, but the max vnem for the job is always 0 [01:15:48] Cyberpower678: http://tools.wmflabs.org/xtools-ec => 404 [01:16:12] Luke081515, busy right now [01:16:17] ok [01:16:18] Doing college stuff [01:22:59] 6Labs, 10Beta-Cluster-Infrastructure: Disable /data/project for instances in deployment-prep that do not need it - https://phabricator.wikimedia.org/T125624#2004909 (10yuvipanda) Salt is totally lying, because it's totally mounted on more instances than in that list :) from deployment-restbase01: ``` labstore... [01:23:16] 6Labs, 10Beta-Cluster-Infrastructure: Disable /data/project for instances in deployment-prep that do not need it - https://phabricator.wikimedia.org/T125624#2004910 (10yuvipanda) [02:32:38] 6Labs, 10wikitech.wikimedia.org, 15User-bd808: Create Portal namespace on wikitech to give a place for audience specific landing pages - https://phabricator.wikimedia.org/T123427#2004999 (10Billinghurst) >>! In T123427#1937379, @Tgr wrote: > What would such a namespace accomplish? You can always name a page... [03:53:29] any humans still on at this hour? [03:53:51] if so, if I want to have HTTPS enabled on my Labs instance, can I make use of the wildcard *.wmflabs.org certificate, or should I obtain my own? [03:55:30] harej, I think if you're going through the proxy you should be covered? [03:56:03] So it's just a matter of configuring Apache to go through SSL, or something? [03:56:06] nope [03:56:08] it Just Works [03:56:10] https://wpx.wmflabs.org/ [03:56:22] huh, would you look at that [03:56:28] obviously, you'll want to make sure your application behaves appropriately [03:56:49] here's the thing: I do regular http and the page still loads, instead of complaining. [03:57:21] obviously it's not encrypted between the proxy and your web server inside labs [03:57:35] not sure how secure that is on the labs network, might be fine [03:57:44] I mean when accessing it from my desktop computer [03:57:58] so what's the problem exactly harej? [03:58:15] you want to force always-https? [03:58:21] Right. [03:58:33] (I thought HTTPS Everything on my Chrome instance would force it for me at least; appears not) [03:58:46] Nope, HTTPS Everywhere has to be configured per-domain :( [03:58:52] Lame. [03:58:59] The proxy should be setting some HTTP header saying whether it's speaking HTTP or HTTPS to the client, I think [03:59:38] So, https just plain works. And serving as HTTP is technically valid behavior as well. Should I force https? Is it a requirement of OAuth? [04:00:22] I think that header was called X-Forwarded-Proto [04:00:39] that would probably depend on what your application is doing [04:01:12] if you're serving public files, maybe don't bother [04:01:36] if you're doing user authentication etc.... maybe? it's your decision.. [04:01:58] I don't think it's an OAuth requirement [04:02:10] HTTPS is not a requirement for OAuth 1 [04:02:22] I think it is for 2 but we don't support that anyway [04:03:40] Okay. Say I wanted to force HTTPS because I have been inculcated with the belief that websites should always be served under HTTPS. Is that something I should look up in the Apache docs then? [04:04:08] there is an easy way to force HTTPS on labs, but I have no idea what it is [04:04:18] seen it once then forgotten [04:04:32] that's a good belief btw [04:07:12] harej, might not be what tgr has in mind, but: https://phabricator.wikimedia.org/diffusion/OPUP/browse/production/templates/apache/sites/piwik.wikimedia.org.erb;845ffd1c26d3ad01d8f1b1f91a07050b84278807$7 [04:08:14] seven through eleven? [04:14:21] krenair ^ [04:14:57] 11 is not needed [04:15:05] no sure about 10 [04:15:10] definitely need 7-9 [04:15:22] okay, will try [04:30:25] Krenair: doesn't seem to work [04:30:37] what happens instead? [04:30:55] https is not forced [04:31:00] so, status quo ante. [04:34:29] so you edited the apache config... did you make it reload the config [04:34:29] ? [04:34:35] i restarted the server [05:04:10] got it to work; debian Really Loves convoluted apache configurations for some reason [05:51:13] I take it serving CSS/JS from a third-party CDN is not allowed on Labs? [06:00:49] 10Tool-Labs-tools-Other, 7I18n: [[Intuition:X'stools-time ago/ksh]] i18n issue - https://phabricator.wikimedia.org/T125296#2005070 (10Liuxinyu970226) [06:03:45] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Gratus was created, changed by Gratus link https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Gratus edit summary: Created page with "{{Tools Access Request |Justification=Hello, I wan't use Tool Labs for use https://github.com/kaldari/hotarticles on french wikipedia after bot's request. |Completed=false |U..." [06:06:53] harej: use tool labs cdn [06:07:05] does tool labs cdn have bootstrap? [06:07:09] http://tools.wmflabs.org/cdnjs/ [06:07:13] yeah [06:07:17] sweet! [06:11:12] Krenair tgr harej: I think I once configured HSTS on a varnish or nginx on a labs host [06:11:21] * zhuyifei1999_ is checking [06:11:46] I ended up going with the mod_rewrite hack krenair suggested, which should work for me. [06:12:35] mod_rewrite? thats for apache right? [06:12:54] yes, which is what i use because i learned my sysadminery in the early 2000s and i don't like learning new stuff :P [06:13:25] * zhuyifei1999_ is apache noob [06:14:04] nginx is an apache fork isn't it? [06:14:18] sure why not :P [06:14:48] they seem completely different [06:16:14] yep, found the nginx hsts configs: [06:16:34] https://www.irccloud.com/pastebin/vgaDq4dY/ [06:23:40] Pretty sure this is what tgr is referring to: https://gerrit.wikimedia.org/r/#/c/218117/ [06:25:06] PROBLEM - SSH on tools-webgrid-lighttpd-1208 is CRITICAL: Server answer [06:35:04] RECOVERY - SSH on tools-webgrid-lighttpd-1208 is OK: SSH OK - OpenSSH_6.6.1p1 Ubuntu-2ubuntu2~wmfprecise2 (protocol 2.0) [06:38:50] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Gratus was modified, changed by Tim Landscheidt link https://wikitech.wikimedia.org/w/index.php?diff=289887 edit summary: [06:51:05] PROBLEM - SSH on tools-webgrid-lighttpd-1208 is CRITICAL: Server answer [07:06:05] RECOVERY - SSH on tools-webgrid-lighttpd-1208 is OK: SSH OK - OpenSSH_6.6.1p1 Ubuntu-2ubuntu2~wmfprecise2 (protocol 2.0) [07:11:59] is tools-exec-1213 dead? [07:27:43] hello [07:27:54] I need help [07:28:26] i can't login me to tools labs with my cmd [07:47:59] Gratus: What message do you get? [07:48:32] are you on Windows, Mac or Linux? [07:48:44] windows [07:48:55] with putty? [07:49:07] no [07:49:56] ? [07:50:12] I download it [07:50:26] It my first time [07:51:01] I mean with what software are you trying to login to tool labs? [07:51:16] cmd windows [07:51:58] I have Putty Configuration now [07:52:22] hmm. what's your command? So far I never heard of windows native support for ssh [07:52:48] (and what's the error message?) [07:53:36] 'ssh' n'est pas reconnu (it doesn't recognize) [07:54:19] ah, as expected. ssh is not a windows command [07:54:25] try putty [07:54:48] I have download Putty Configuration [07:55:08] ? [07:55:23] can you give me a link? [07:55:25] http://www.chiark.greenend.org.uk/~sgtatham/putty/download.html [07:55:40] For Windows on Intel x86 [07:55:40] PuTTY: putty.exe (or by FTP) (signature) [07:56:08] yep [07:56:29] and use that to login to tool labs [07:56:37] how ? [07:58:03] https://wikitech.wikimedia.org/wiki/Help:Tool_Labs/Access#Generating_a_key_in_Windows <= done this? [07:58:25] I have already a key [07:59:05] ok [07:59:10] https://wikitech.wikimedia.org/wiki/Help:Access_to_ToolLabs_instances_with_PuTTY_and_WinSCP ? [08:06:34] it's ok [08:06:37] thanks [08:07:27] np [08:08:32] zhuyifei1999_, my goal is to run https://github.com/kaldari/hotarticles on wiki-tool for use it on french wp [08:09:23] how can I import, modify and use it ? [08:10:11] you clone a git repo with git clone .... [08:10:22] good luck hacking [08:11:04] for modification you can use any command line editor you wish, like vim or nano [08:11:19] * zhuyifei1999_ prefer nano [08:16:00] as for how to use it, https://wikitech.wikimedia.org/wiki/Help:Tool_Labs/Web <= rtfm [08:18:57] putty is not an command line editor ? [08:20:42] no [08:21:03] putty is a ssh client [08:21:31] (in this case) [08:23:00] nano can work on windows ? [08:23:11] yes, why? [08:23:12] or only on linux ? [08:23:45] I hardly ever hear people using command line editors on windows [08:24:40] you can use nano if you want to edit files on tool labs directly [08:25:01] (not copy to your computer, edit, and copy back) [08:27:31] are you download link ? [08:27:47] ? [08:28:07] Have you download link of nano [08:28:11] ? [08:28:49] huh? seriously, nano is preinstalled on tool labs [08:29:38] ok [08:29:52] type nano in putty and it should just work [08:30:55] yes [08:31:00] thanks [08:31:11] if you actually wish to test it on windows, it's http://nano-editor.org/ [08:39:33] you clone a git repo with git clone .... [08:39:36] ?? [08:40:38] git clone https://github.com/kaldari/hotarticles.git [08:41:39] ok thanks [08:43:06] and after [08:43:25] when I write nano for edit, I have no text [08:43:40] ? [08:43:55] nano /path/to/your/file [08:45:11] I have no text too [08:45:33] ? [08:45:41] I write nano /path/to/gratus/file [08:46:02] replace /path/to/your/file with path to your file [08:46:15] not simply copy it down [08:47:36] And how I know it ? [08:47:52] huh? [08:48:14] just replace it with the path of the file you wish to modify [08:50:52] Cloning into 'hotarticles'... [08:51:07] but nano /hotarticles [08:51:07] don't work [08:51:27] that's because the path to your file isn't /hotarticles [08:51:55] what is it ? [08:52:10] it could be ./hotarticles.sql for instance (notice the leading dot and the extension) [08:53:30] easy way to know is to use the `ls` command in your dir : it lists files in the current working directory [08:58:50] hotarticles replica.my.cnf | hotarticles replica.my.cnf [08:58:51] [client] [08:58:51] password = xxxx = xxx [09:00:14] * zhuyifei1999_ is tired, Alphos good luck [09:00:39] Gratus why not simply ask kaldari to run his own tool himself ? [09:01:32] Alphos, see : https://en.wikipedia.org/wiki/User_talk:Kaldari#Bot [09:02:50] my question still stands [12:11:49] PROBLEM - SSH on tools-worker-1002 is CRITICAL: Server answer [13:32:39] !log jtools initiating setup [13:32:40] jtools is not a valid project. [13:32:58] !log tools.jtools initiating setup [13:33:12] 6Labs, 10Tool-Labs, 10Continuous-Integration-Infrastructure, 7Blocked-on-RelEng: debian-glue tries to fetch obsolete package - https://phabricator.wikimedia.org/T125999#2005264 (10hashar) The puppet class `package_builder` initialize various cowbuilder images. It provides a few hooks used to inject the wik... [13:33:40] (03CR) 10Hashar: "recheck" [labs/toollabs] - 10https://gerrit.wikimedia.org/r/268563 (owner: 10Tim Landscheidt) [13:47:51] 6Labs, 10Tool-Labs, 10Continuous-Integration-Infrastructure, 7Blocked-on-RelEng: debian-glue tries to fetch obsolete package - https://phabricator.wikimedia.org/T125999#2005265 (10hashar) I have created `/var/cache/pbuilder/hooks/unstable` and retriggered a build of https://gerrit.wikimedia.org/r/#/c/26856... [13:54:26] is there a way to get a list of running jobs? [13:54:38] using exec is ugly :/ [14:05:35] Steinsplitter: qstat -xml? [14:19:54] valhallasw`cloud: well, i have to execute it with exec as well. [14:31:02] I don't understand why that's an issue [17:36:04] (03CR) 10Legoktm: [C: 04-1] "Please document #wikimedia-ed on first." [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/268794 (owner: 10Awight) [18:41:47] 10Tool-Labs-tools-Other, 10Possible-Tech-Projects: Fix TreeViews to provide pageviews statistics for all articles of any wikiproject etc. - https://phabricator.wikimedia.org/T56184#2005499 (10unleashkids) Thanks Kelson & All for your work here! We do need this as we build up educational/offline extracts of Wi... [19:12:10] 6Labs, 10Tool-Labs, 10Wikimedia-Site-Requests, 10wikitech.wikimedia.org, and 2 others: Create a wiki documentation page for each tool - https://phabricator.wikimedia.org/T122865#2005531 (10bd808) This comment from {T123427} seems relevant here. >>! In T123427#2004999, @Billinghurst wrote: >>>! In T123427#... [20:32:55] 10Tool-Labs-tools-Other, 10Possible-Tech-Projects: Fix TreeViews to provide pageviews statistics for all articles of any wikiproject etc. - https://phabricator.wikimedia.org/T56184#2005631 (10Bzg) Anything that helps Kiwix helps several education organizations I know. [20:59:41] Steinsplitter: unless you can find/create a binding for the c library of grid, no [21:18:39] 10Tool-Labs-tools-Other, 10Possible-Tech-Projects: Fix TreeViews to provide pageviews statistics for all articles of any wikiproject etc. - https://phabricator.wikimedia.org/T56184#2005648 (10Tim-moody) +1 [21:49:51] How do I use pip? [21:51:34] Help? [21:51:56] tom29739: context? [21:52:59] Like I'm trying to install some dependencies by doing pip install --user yourthirdpartylibrary as it says on https://wikitech.wikimedia.org/wiki/Help:Tool_Labs/Python_application_stub but it says command not found. [21:54:59] tom29739: setup virtualenv [21:55:27] and remove that --user argument [21:56:36] virtualenv? [21:57:32] https://wikitech.wikimedia.org/wiki/Help:Tool_Labs#My_tool_requires_a_package_that_is_not_currently_installed_in_Tool_Labs._How_can_I_add_it.3F <= read the friendly manual :) [21:58:17] tom29739: that page is also horribly out of date [21:58:46] https://merlijn.vandeen.nl/2015/flask-mwoauth-on-tools.html is a more recent version, but I should really add it on wikitech [21:59:01] That's probably why it doesn't work then [22:00:04] valhallasw`cloud: can you confirm if either or both of .bash_profile and .bashrc are executed after $ become ? [22:00:19] .profile is executed, not sure about the other ones [22:00:30] probably .bash_profile as well? [22:01:37] I think .bash_profile and .bash_aliases are, .bashrc didn't work for me last time I tried [22:02:13] (but it's referenced in Help:Tool_Labs) [22:02:38] it's something with login vs non-login shells [22:04:30] yeah, heard of that, but never figured out the difference myself :/ [22:11:40] Also, does ssh auto disconnect after a time? [22:12:12] yes [22:12:28] you can configure your client to send keepalive messages to prevent that [23:22:53] RECOVERY - Puppet failure on tools-webgrid-generic-1405 is OK: OK: Less than 1.00% above the threshold [0.0] [23:36:27] 6Labs, 10Beta-Cluster-Infrastructure: Disable /data/project for instances in deployment-prep that do not need it - https://phabricator.wikimedia.org/T125624#2005762 (10bd808) >>! In T125624#1995318, @demon wrote: > Logging server? I think we write those syslogs to /data/project Logs should be going via rsyslo... [23:48:56] Dispenser, Josve05a wants me to bug you [23:49:04] Cyberpower678: It's not a Labs-tool :p [23:49:16] Josve05a, doesn't matter. [23:49:25] It's still related to a tool. [23:49:31] And he's in here [23:49:49] It could run on tools labs... [23:50:16] Anywaaays.... https://phabricator.wikimedia.org/T124360 ... This damn template is distupting my workflow xD [23:50:27] Dispenser, Josve05a has questions regarding checklinks [23:50:30] Since I have to spend time manually editing now [23:50:43] * Josve05a has already mentioned it,...but I'll keep nagging [23:51:25] Dispenser, btw, I could benefit from your knowledge on the hueristic you use to accurately determine a dead link beyond it's header code. [23:52:22] Dispenser, Could you perhaps provide a flowchart on the algorithm? [23:52:56] Again look at reflinks. v2 will be alot better as it'll download everything then analysis similar pages to find 404s [23:53:21] Oh right I forgot about that. [23:53:31] * Cyberpower678 gets a pizza