[04:53:28] 3Tool Labs tools / 3[other]: Migrate http://toolserver.org/~para/GeoCommons/* to Tool Labs - 10https://bugzilla.wikimedia.org/63304 (10John Mark Vandenberg) 5UNC>3NEW [05:08:27] 3Wikimedia Labs / 3Infrastructure: Inconsistent GID number (500 or 550) - 10https://bugzilla.wikimedia.org/63028 (10John Mark Vandenberg) [05:08:27] 3Wikimedia Labs / 3Infrastructure: List of SVN users who were not migrated - 10https://bugzilla.wikimedia.org/58687 (10John Mark Vandenberg) [07:59:42] 3Wikimedia Labs / 3tools: jsub not installed on the queue machines - 10https://bugzilla.wikimedia.org/64988#c5 (10Marc A. Pelletier) 5ASS>3RES/FIX Originally, it was not intended for jobs to be able to spawn jobs (the potential for a runaway "fork bomb" that would severely impact other users was too grea... [08:08:19] what are the maximum number of jobs that can be queued on the grid? [08:33:07] Hi, all. Sorry dumb question. I have configured my .ssh/config with this: https://wikitech.wikimedia.org/wiki/Help:Access#Accessing_instances_with_ProxyCommand_ssh_option_.28recommended.29 [08:33:14] to access an instance on Labs [08:33:24] but letś say that I have a very long instance name [08:33:30] and I can do [08:33:48] ssh myveryveryveylonginstancename.eqiad.wmflabs [08:34:01] but I would like to shorten it like [08:34:14] ssh labs [08:34:22] I have tried a couple of time [08:36:44] but I could not make it work [08:37:27] 3Wikimedia Labs / 3tools: automatic encouragements to use OGE instead of cronjobs, when appropriate - 10https://bugzilla.wikimedia.org/54720#c4 (10Marc A. Pelletier) 5NEW>3RES/FIX That system is now the default, and running cron jobs locally requires a positive action. [10:02:59] 3Wikimedia Labs / 3tools: Tools proxy should gzip everything by default - 10https://bugzilla.wikimedia.org/65122 (10Yuvi Panda) 3NEW p:3Unprio s:3normal a:3Marc A. Pelletier Faster data transfer! [10:03:27] 3Wikimedia Labs / 3tools: Tools proxy should gzip everything by default - 10https://bugzilla.wikimedia.org/65122 (10Yuvi Panda) [10:36:09] has anyone experience with labs-vagrant and pdfhandler [10:36:30] I was trying to include pdf to my wiki like e.g. http://math2.beta.wmflabs.org/wiki/File:B.Z.S.pdf [10:37:44] 3Wikimedia Labs / 3deployment-prep (beta): Dependencies for @WikiAtlas - 10https://bugzilla.wikimedia.org/65123 (10Yug) 3NEW p:3Unprio s:3trivia a:3None In order to ease the way for the Wikimaps_Atlas (aka WikiAtlas) WMF IEG project, could you install the following general / mapping / GIS dependencie... [10:44:33] Cone: Do you know when the userprefs tables will be replicated? [11:13:27] 3Wikimedia Labs / 3tools: Copy contents of https://svn.toolserver.org/ to Wikimedia git - 10https://bugzilla.wikimedia.org/58801#c7 (10Maarten Dammers) What would you think of this approach: * We create a toolserver_svn_backup repository (let the bike shedding about the name start!). Request at https://www.m... [11:17:21] multichill|hacki: git conversion is not entirely trivial, but should be doable, I guess. [11:17:49] depending on how complicated people made their repos [11:18:28] multichill|hacki: so I'd actually advise to just have a read-only svn server on tool labs, or something like that. [11:18:33] svn borks on redirects, though :/ [11:23:53] ..okay, google, stop being creepy with your search suggestions. After googling for 'read-only svn server', I automatically got 'lighttpd svn server' after typing in 'ligh', and now 'svnserve fcgi' after typing in 'svnse' [11:38:42] 3Wikimedia Labs / 3tools: Copy contents of https://svn.toolserver.org/ to Wikimedia git - 10https://bugzilla.wikimedia.org/58801#c8 (10Merlijn van Deen) svn->git migration is not completely trivial, due to the free-form nature of SVN repos: some of the might be in the typical 'branches/', 'trunk/', 'tags/' f... [11:47:12] 3Wikimedia Labs / 3tools: Copy contents of https://svn.toolserver.org/ to Wikimedia git - 10https://bugzilla.wikimedia.org/58801#c9 (10Merlijn van Deen) The list of used repositories (rev > 0) is here: http://tools.wmflabs.org/jira-bugimport/svn/000_USED_REPOSITORIES/ , including their root directory content... [11:53:57] Hi cmarqu, how is migration going for you? [11:54:15] 3Wikimedia Labs / 3deployment-prep (beta): Setup multiversion on Beta Cluster for nightly build browser testing support - 10https://bugzilla.wikimedia.org/65127 (10Greg Grossmeier) 3NEW p:3Unprio s:3normal a:3None We would like to browser test nightly builds on the Beta Cluster while not interfering... [11:54:27] 3Wikimedia Labs / 3deployment-prep (beta): Setup multiversion on Beta Cluster for nightly build browser testing support - 10https://bugzilla.wikimedia.org/65127 (10Greg Grossmeier) p:5Unprio>3Normal [12:03:27] 3Wikimedia Labs / 3deployment-prep (beta): Setup multiversion on Beta Cluster for nightly build browser testing support - 10https://bugzilla.wikimedia.org/65127 (10Greg Grossmeier) [12:05:30] Coren, this is the error I was just bugging you about: [12:05:31] May 7 06:08:12 kartoffel puppet-agent[25202]: (/Stage[main]/Role::Labs::Instance/Mount[/data/project]) Could not evaluate: Execution of '/bin/mount -o rw,vers=4,bg,hard,intr,sec=sys,proto=tcp,port=0,noatime,nofsc /data/project' returned 32: mount.nfs: mounting labstore.svc.eqiad.wmnet:/project/wikidumpparse/project failed, reason given by server:#012 No such file or directory [12:10:06] valhallasw: Sorry, wasn't paying attention. [12:10:22] Problem with an svn server on labs is that someone has to maintain it [12:11:12] 3Wikimedia Labs: Dependencies for @WikiAtlas - 10https://bugzilla.wikimedia.org/65123#c1 (10Greg Grossmeier) p:5Unprio>3Normal (For those without context, like me: https://meta.wikimedia.org/wiki/Grants:IEG/Wikimaps_Atlas) Hi Yug, Is this to test on the "Beta Cluster", ie: http://en.wikipedia.beta.wmflab... [12:14:25] multichill|hacki: true. [12:15:00] GZip on toollabs for everyone! [12:15:06] hmm, let me enable it for dynamicproxy [12:22:01] Change on 12mediawiki a page Wikimedia Labs was modified, changed by Greg (WMF) link https://www.mediawiki.org/w/index.php?diff=1000549 edit summary: [WMF] [12:27:44] grah! I can't login to wikitech due to two factor failing (I'm guessing weird timezone/authenticator confusion since my phone isn't getting it's time from cell network?) [12:28:33] greg-g: just manually set the time & timezone to SF time? 5:28 AM. [12:29:02] although it should be fine as long as timezone & time make sense together [12:30:03] valhallasw: yeah... lets see [12:30:52] hah [12:31:19] ah, I didn't change timezone, I just changed time before, reset and it worked :) [12:31:19] timezone was set to UTC-7 but your clock was set to 14:30? :-p [12:31:24] ah [12:31:28] right [12:33:06] thanks valhallasw :) [12:35:52] yw! [12:43:27] 3Wikimedia Labs: Dependencies for @WikiAtlas - 10https://bugzilla.wikimedia.org/65123#c2 (10Yug) Hi Greg, thanks for your help. This request is for Wikimedia Labs, it should be quite enough. No Beta Cluster required. [12:48:29] 3Wikimedia Labs / 3wikitech-interface: Add "Nova Resource" to default search namespaces on wikitech.wikimedia.org - 10https://bugzilla.wikimedia.org/65132 (10Maarten Dammers) 3NEW p:3Unprio s:3normal a:3None I just searched for Pywikibot on wikitech and I didn't find https://wikitech.wikimedia.org/wi... [12:48:56] (03PS1) 10QChris: Allow forging identities to import history [labs/tools/heritage] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/132671 [12:49:41] (03CR) 10QChris: [C: 032 V: 032] Allow forging identities to import history [labs/tools/heritage] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/132671 (owner: 10QChris) [12:52:30] (03PS1) 10QChris: Allow forging names to upload history [labs/tools/multichill] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/132673 [12:52:37] (03CR) 10QChris: [C: 032 V: 032] Allow forging names to upload history [labs/tools/multichill] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/132673 (owner: 10QChris) [12:54:03] (03PS1) 10QChris: History imported. Revoking identity forging [labs/tools/heritage] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/132675 [12:54:13] (03CR) 10QChris: [C: 032 V: 032] History imported. Revoking identity forging [labs/tools/heritage] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/132675 (owner: 10QChris) [13:00:28] (03PS1) 10QChris: History imported. Revoke identity forging again [labs/tools/multichill] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/132676 [13:00:38] (03CR) 10QChris: [C: 032 V: 032] History imported. Revoke identity forging again [labs/tools/multichill] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/132676 (owner: 10QChris) [13:10:54] Why does the instnace info page disagree with the instance list info page? eg: https://wikitech.wikimedia.org/wiki/Nova_Resource:I-00000363.eqiad.wmflabs vs https://wikitech.wikimedia.org/wiki/Special:NovaInstance [13:11:00] (rebooting vs active) [13:14:20] 3Wikimedia Labs / 3wikitech-interface: Add "Nova Resource" to default search namespaces on wikitech.wikimedia.org - 10https://bugzilla.wikimedia.org/65132 (10Sam Reed (reedy)) s:5normal>3enhanc [13:14:21] 3Wikimedia Labs / 3tools: Tools proxy should gzip everything by default - 10https://bugzilla.wikimedia.org/65122 (10Sam Reed (reedy)) s:5normal>3enhanc [13:14:23] 3Wikimedia Labs / 3deployment-prep (beta): Setup multiversion on Beta Cluster for nightly build browser testing support - 10https://bugzilla.wikimedia.org/65127 (10Sam Reed (reedy)) s:5normal>3enhanc [13:14:45] Cyberpower678: ping [13:17:11] wrote some lines about the "webservice OOM issue" [13:17:14] https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help/Performance [13:22:26] hi prtksxna [13:22:28] chicken is dead [13:22:31] we are trying to fix the things [13:22:38] hey YuviPanda [13:22:45] I thought it was biryani time :P [13:23:23] greg-g: try ?action=purge [13:23:58] greg-g: or rather... wait until labslogbot passes by? :/ https://wikitech.wikimedia.org/w/index.php?title=Nova_Resource%3AI-00000363.eqiad.wmflabs&diff=112446&oldid=112445 [13:24:44] YuviPanda: anything I can do? [13:35:56] Coren: I'm having a ssh login situation here - are you somewhere nearby? [13:36:14] Silke_WMDE: what's happening for you? I ask because I am as well :/ [13:36:20] I think he's busy [13:36:21] andrewbogott: ^^ [13:36:51] greg-g: Jeph's key is not accepted and I don't know why [13:36:56] Silke_WMDE: where are you? I'll come look over your shoulder :) [13:37:07] andrewbogott: where we sat yesterday [13:37:13] at the tables [13:37:14] OK, be there in a few [13:37:18] thx [13:43:59] 3Wikimedia Labs / 3tools: Support SPDY/3 on the proxy - 10https://bugzilla.wikimedia.org/65134 (10Yuvi Panda) 3NEW p:3Unprio s:3normal a:3Marc A. Pelletier We only support SPDY/2 now. [13:44:30] 3Wikimedia Labs / 3tools: Support SPDY/3 on the proxy - 10https://bugzilla.wikimedia.org/65134 (10Yuvi Panda) [14:30:28] Coren: andrewbogott who wants to help me with a ssh login issue? :( [14:36:11] greg-g: ssh -v -v tools-login.wmflabs.org might yield some info on what is happening [14:45:09] !log proxyproject Upgraded nginx to 1.7.0 to get SPDY/3.1 on dynamicproxy-gateway [14:45:09] proxyproject is not a valid project. [14:45:15] !log proxy-project Upgraded nginx to 1.7.0 to get SPDY/3.1 on dynamicproxy-gatewaya [14:45:16] proxy-project is not a valid project. [14:45:24] !log projectproxy Upgraded nginx to 1.7.0 to get SPDY/3.1 on dynamicproxy-gatewaya [14:45:24] projectproxy is not a valid project. [14:45:31] andrewbogott: ^ what's the name of the project? :| [14:45:52] project-proxy I think [14:49:25] valhallasw: yeah -vvv was my friend, that and the fingerprint of the bastion was different than what my laptop was expecting [14:49:37] !log project-proxy Upgraded nginx to 1.7.0 to get SPDY/3.1 on dynamicproxy-gatewaya [14:49:38] Logged the message, Master [14:49:42] andrewbogott: ah, cool [14:50:28] !log tools upgraded nginx to 1.7.0 on tools-webproxy to get SPDY/3.1 [14:50:31] Logged the message, Master [14:50:33] there we go :D [14:50:41] andrewbogott: Coren nginx upgraded. [14:50:44] brb [15:09:57] 3Wikimedia Labs / 3tools: Support SPDY/3 on the proxy - 10https://bugzilla.wikimedia.org/65134 (10Sam Reed (reedy)) p:5Unprio>3Normal s:5normal>3enhanc [15:41:44] 3Tool Labs tools / 3Quentinv57's tools: SUL info tool fails with unicode usernames - 10https://bugzilla.wikimedia.org/65144 (10Huji) 3NEW p:3Unprio s:3normal a:3None Here is an example: https://tools.wmflabs.org/quentinv57-tools/tools/sulinfo.php?username=محمد The username consists of four Unicode... [15:50:27] 3Wikimedia Labs / 3tools: Puppet is stuck due to openjdk-7-jre-headless - 10https://bugzilla.wikimedia.org/63823#c4 (10Tim Landscheidt) Thanks for tracking this down. Assuming this is that bug, it needs to be fixed upstream. IIRC the reason why we chose -headless is that otherwise X is pulled in, but I may... [16:03:57] 3Wikimedia Labs / 3tools: Move wiki.toolserver.org to WMF - 10https://bugzilla.wikimedia.org/60220#c24 (10Tim Landscheidt) (In reply to Sam Reed (reedy) from comment #20) > [...] > The "most difficult" part of it at would presumably be postgres -> mysql. Of > course, depending on what we want to actually tr... [16:24:43] 3Wikimedia Labs / 3tools: Support SPDY/3 on the proxy - 10https://bugzilla.wikimedia.org/65134#c1 (10Yuvi Panda) 5NEW>3RES/FIX Done [17:04:27] 3Wikimedia Labs / 3tools: Copy contents of https://svn.toolserver.org/ to Wikimedia git - 10https://bugzilla.wikimedia.org/58801#c10 (10Tim Landscheidt) (In reply to Merlijn van Deen from comment #8) > [...] > In that aspect, just providing a read-only svn server would be the easiest > option. Maybe we can... [17:27:28] 3Wikimedia Labs / 3tools: Copy contents of https://svn.toolserver.org/ to Wikimedia git - 10https://bugzilla.wikimedia.org/58801#c11 (10Merlijn van Deen) Three of them have had commits in the last month (not counting nosy); 16 have had commits in the last year: 9984 May 7 2013 magnus.txt 1241 May 11 20... [18:02:18] !log deployment-prep Restarted logstash on deployment-logstash1 [18:02:20] Logged the message, Master [18:04:49] Coren: is there a way to mark outdated/broken/inactive tools on toollabs and wmflabs? [18:06:39] tools/labs instances that have no active maintainer [18:08:58] Coren: around? [19:44:27] 3Wikimedia Labs / 3tools: Missing Toolserver features in Tools (tracking) - 10https://bugzilla.wikimedia.org/58791 (10Maarten Dammers) [19:44:28] 3Wikimedia Labs / 3Infrastructure: filearchive table not available on labs - 10https://bugzilla.wikimedia.org/61813 (10Maarten Dammers) p:5Unprio>3High [19:46:28] 3Wikimedia Labs / 3Infrastructure: filearchive table not available on labs - 10https://bugzilla.wikimedia.org/61813#c8 (10Maarten Dammers) Blocks toolserver migration. [19:59:56] ... things died ??? [20:01:02] You're being awfully specific. [20:01:23] http://tools.wmflabs.org/wikidata-todo/autolist2.php 400 - Bad Request [20:01:42] so, poke Magnus. [20:04:48] GerardM-: OOM, grid killed the webservice [20:09:30] hedonil: web service uses 40% of its memory allotment to just be enabled [20:09:46] Betacommand: yes, I know [20:09:59] thats why I cheated [20:10:16] I have a modified version of webservice.sh [20:10:28] me, too ;) [20:11:53] what did you set as the vmem limit on yours? [20:12:44] I have multiple setups for tests, in catscan2 it's currently 6 GB [20:13:10] with a custom lightttpd setup [20:16:05] as I can see, you went to 7.5 GB ;) [20:20:21] Betacommand: what are you working with in betacommand-dev python, php or something else? [20:20:32] python [20:20:53] then you can optimize much more [20:21:16] * hedonil prepares something [20:21:26] hedonil: the script itself uses less than 200Mb before the server OOM's [20:21:58] Betacommand: yes, but you have multiple processes running, which are total useless [20:22:12] if you use cgi python [20:22:25] hedonil: Ive seen it oom with 1 scirpt [20:22:35] *script [20:30:51] Betacommand: https://tools.wmflabs.org/paste/view/0b806b97 [20:30:54] you have 5 php-fcgi processes running, each consuming ~280 M for the lulz [20:30:54] with python cgi, you'd only need 1 lighttpd process, nothing else [20:30:55] hedonil: what am I looking at? [20:31:13] a paste from tools-webgrid-01 [20:31:18] hedonil: I have zero php scripts on my webserver [20:31:47] Betacommand: but standard setup launches 5 of them [20:32:43] even if you don't need php-fcgi [20:32:57] wtf?? [20:32:57] ;) [20:33:34] /all/ standard web setups run a config like this [20:33:43] this is why I am hating the labs web systems [20:34:22] in general it's ok to have some standards, so that web works out of the box [20:34:33] for this I comply with Coren [20:34:52] but there have to be some changes to the standard [20:35:13] Betacommand: I can provide you a tweak, if you want [20:35:22] hedonil: still, that doesn't explain how a single python script brings the memory usage from 2GB to 4GB [20:35:52] valhallasw Ive traced the script, it only uses 130Mb at max [20:36:02] standard consumes ~1.6 GB [20:36:35] Betacommand: if you invoke python cgi, the binaries also count to your account [20:36:44] Betacommand: traced how? by running it as a grid job or? [20:37:28] valhallasw: On windows Ive run the exact same script and watched the resource usage [20:38:01] hedonil: still it should only be a few more mb [20:38:13] Betacommand: it's easy to test [20:38:37] make a python script with a sleep/wait loop [20:39:08] ssh to tools-webgrid-01, an issue $ top -u tools.betacommand.dev [20:42:42] or any other command that shows your resources lsof,... [23:00:27] 3Tool Labs tools / 3wikibugs IRC bot: pywikibugs should not abbreviate "Assigned" to three characters. - 10https://bugzilla.wikimedia.org/64632#c5 (10Alex Monk) This should really be WONTFIX [23:18:27] 3Wikimedia Labs / 3tools: Missing Toolserver features in Tools (tracking) - 10https://bugzilla.wikimedia.org/58791 (10Maarten Dammers) [23:18:28] 3Wikimedia Labs / 3tools: Missing Toolserver features in Tools (tracking) - 10https://bugzilla.wikimedia.org/58791 (10Maarten Dammers) [23:18:28] 3Wikimedia Labs / 3tools: Provide filearchive table with fa_storage_key or, if it exists and is sufficiently indexed and populated, fa_sha1 for commonswiki - 10https://bugzilla.wikimedia.org/57697 (10Maarten Dammers)