[02:56:54] <wikibugs>	 3Wikimedia Labs / 3tools: Tool Labs: Local webservice should know about HTTPS in original request - 10https://bugzilla.wikimedia.org/53689 (10Liangent)
[02:56:54] <wikibugs>	 3Wikimedia Labs / 3tools: lighttpd redirects URLs of directories without a trailing slash from https to http - 10https://bugzilla.wikimedia.org/64627#c1 (10Liangent) dupe of https://bugzilla.wikimedia.org/show_bug.cgi?id=53689 ?
[02:59:31] <wikibugs>	 3Wikimedia Labs / 3tools: Tool Labs: Local webservice should know about HTTPS in original request - 10https://bugzilla.wikimedia.org/53689#c7 (10Liangent) Seems fixed
[03:00:12] <wikibugs>	 3Wikimedia Labs / 3tools: lighttpd redirects URLs of directories without a trailing slash from https to http - 10https://bugzilla.wikimedia.org/64627#c2 (10Liangent) (In reply to Liangent from comment #1) > dupe of https://bugzilla.wikimedia.org/show_bug.cgi?id=53689 ?  seems this bug was accidentially fixed.
[03:00:43] <wikibugs>	 3Wikimedia Labs / 3tools: Tool Labs: Local webservice should know about HTTPS in original request - 10https://bugzilla.wikimedia.org/53689 (10Liangent) 5REO>3RES/FIX
[06:15:13] <wikibugs>	 3Wikimedia Labs / 3tools: lighttpd redirects URLs of directories without a trailing slash from https to http - 10https://bugzilla.wikimedia.org/64627#c3 (10Tim Landscheidt) (In reply to Liangent from comment #2) > > dupe of https://bugzilla.wikimedia.org/show_bug.cgi?id=53689 ?  > seems this bug was accident...
[06:17:28] <wikibugs>	 3Wikimedia Labs / 3tools: lighttpd redirects URLs of directories without a trailing slash from https to http - 10https://bugzilla.wikimedia.org/64627#c4 (10Liangent) (In reply to Tim Landscheidt from comment #3) > (In reply to Liangent from comment #2) > > > dupe of https://bugzilla.wikimedia.org/show_bug.cg...
[08:44:43] <grrrit-wm>	 (03PS1) 10Giuseppe Lavagetto: Adding missing classes so that manifests compile. [labs/private] - 10https://gerrit.wikimedia.org/r/130574 
[08:59:44] <YuviPanda>	 mutante: do you remember the machine name for wikistats?
[09:01:16] <mutante>	 YuviPanda: wikistats-live since it's in eqiad, was wikistats-01 in pmtpa
[09:01:22] <YuviPanda>	 aha cool
[09:01:54] <mutante>	 why are you asking
[09:02:01] <mutante>	 proxy?
[09:02:15] <mutante>	 YuviPanda: 
[09:02:31] <YuviPanda>	 mutante: yeah.
[09:02:48] <YuviPanda>	 mutante: hitting it from tools doesn't work
[09:05:18] <mutante>	 can tools talk to other labs projects that are not in tools itself?
[09:06:50] <mutante>	 YuviPanda: do you still need the "upld" group thing?
[09:06:56] <YuviPanda>	 mutante: yeah.
[09:07:14] <mutante>	 so it's separated into mw and mobile ..looks
[09:07:17] <YuviPanda>	 mutante: yeah, it can. changing wikistats.wmflabs.org to wikistats-live fixed it
[09:08:11] <mutante>	 YuviPanda: ah! cool.. i switched it via web ui when i moved the VM..somewhere
[09:08:23] <mutante>	 the instance name that is..
[09:08:27] <YuviPanda>	 ah, ok
[09:08:41] <YuviPanda>	 mutante: hashar had a hack somewhere that let wmflabs.org URLs hit the proxy automatically
[09:08:50] <YuviPanda>	 would be nice if we could port that to toools
[09:09:16] <mutante>	 i didnt notice any issue because it worked from me from external
[09:09:25] <mutante>	 after i switched instance name around during migration
[09:09:34] <mutante>	 nods
[09:10:05] <mutante>	 YuviPanda: you have this: 'ypanda': group => 'mobileupld'
[09:10:14] <mutante>	 but you say you want:
[09:10:21] <mutante>	 group => 'mwupld'
[09:10:27] <mutante>	 for mw ?
[09:10:49] <mutante>	 you and brion can upload mobile stuff, csteipp,hashar,mah,mglaser,reedy can upload mw 
[09:11:00] <hashar>	 hi
[09:11:04] <mutante>	 so, the answer is, yea, needs a patch
[09:11:14] <mutante>	 in manifests/role/releases.pp
[09:11:31] <YuviPanda>	 mutante: no, mobileupload.
[09:11:40] <YuviPanda>	 mutante: no, so I logged in and it wouldn't let me do anything
[09:11:43] <mutante>	 hashar: hi, sorry for the ping :p
[09:11:45] <YuviPanda>	 mutante: and groups only returned wikidev
[09:11:50] <hashar>	 if an instance attempt to hit the URL   someentry.wmflabs.org , and someentry is a web proxy
[09:11:58] <hashar>	 the DNS will gives the public IP of the webproxy
[09:12:07] <hashar>	 and the instance can't reach it because that public IP is a NAT to another instance
[09:12:22] <hashar>	 the way I fix it is to use the role::betanatfix class (or something similiar)
[09:12:38] <Steinsplitter>	 @seen dan-
[09:12:38] <wm-bot>	 Steinsplitter: I have never seen dan-
[09:12:40] <mutante>	 aha.. i saw some of those changes to natfix
[09:12:45] <Steinsplitter>	 @seen dan-nl
[09:12:46] <wm-bot>	 Steinsplitter: Last time I saw dan-nl they were quitting the network with reason: Quit: dan-nl N/A at 4/30/2014 8:49:34 AM (23m11s ago)
[09:12:52] <hashar>	 which uses iptables to rewrite the IP destination from the public web proxy IP  to the private web proxy IP
[09:12:58] <Steinsplitter>	 @notify dan-nl
[09:12:58] <wm-bot>	 I'll let you know when I see dan-nl around here
[09:13:02] <mutante>	 YuviPanda: that sounds like there is a general issue with mobile upload class
[09:13:12] <YuviPanda>	 mutante: hmm. but brion was able to.
[09:13:15] <mutante>	 YuviPanda: do you know by chance if it works for Brion?
[09:13:16] <YuviPanda>	 but yeah, that sounds possible
[09:13:17] <hashar>	 modules/beta/manifests/natfix.pp 
[09:13:18] <mutante>	 ah, heh
[09:15:59] <mutante>	 YuviPanda: brb
[09:16:38] <YuviPanda>	 hashar: but it'll fail for all wmflabs domains that do not work via the proxy
[09:16:41] <YuviPanda>	 including betalabs
[09:32:34] <grrrit-wm>	 (03CR) 10Giuseppe Lavagetto: [C: 032 V: 032] Adding missing classes so that manifests compile. [labs/private] - 10https://gerrit.wikimedia.org/r/130574 (owner: 10Giuseppe Lavagetto)
[09:34:17] <mutante>	 YuviPanda: https://gerrit.wikimedia.org/r/#/c/130577/
[09:34:48] <YuviPanda>	 mutante: woo! cool!
[09:35:00] <YuviPanda>	 mutante: ideally we should rename the ypanda thing to yuvipanda
[09:35:04] <YuviPanda>	 I'm ypanda nowhere
[09:35:47] <mutante>	 YuviPanda: i know, second patch :)
[09:35:55] <mutante>	 apergos said the identical thing, heh
[09:36:18] <YuviPanda>	 haha
[09:52:09] <mutante>	 YuviPanda: https://gerrit.wikimedia.org/r/130579 renaming you, ,ok?
[09:52:35] <mutante>	 notes you also have an account in role/analytics
[09:53:13] <YuviPanda>	 mutante: yeah.
[09:53:17] <YuviPanda>	 mutante: +1'd :D
[09:56:03] <mutante>	 /User[yuvipanda]/groups: groups changed '' to 'mobileupld'
[09:56:05] <mutante>	 try now
[09:56:09] <YuviPanda>	 woo!
[09:56:12] <YuviPanda>	 will do now
[10:08:36] <petan>	 mutante: can I get 1 IP for project huggle?
[10:15:14] <mutante>	 petan: what does it do with it? more than just http?
[10:16:08] <mutante>	 if it's just a webserver i'd suggest yuviproxy 
[10:18:29] <YuviPanda>	 which you can set up at https://wikitech.wikimedia.org/wiki/Special:NovaProxy
[10:18:35] <YuviPanda>	 it also gives you https and SPDY for free!
[10:18:51] <mutante>	 yep, very convenient
[10:19:07] <mutante>	 didnt have to deal with SSL setup anymore
[10:19:12] <mutante>	 and could give my IP back
[10:19:44] <mutante>	 all you have to do is map the subdomain to an instance 
[10:20:28] <petan>	 mutante: I need http that see IP of users who access it :/
[10:20:38] <petan>	 proxy doesn't seem to relay it
[10:21:00] <YuviPanda>	 petan: it does. X-Forwarded-For
[10:21:04] <petan>	 oh ok
[10:21:07] <petan>	 mutante: nvm then
[10:21:18] <mutante>	 ok, great
[10:21:27] <YuviPanda>	 :)
[10:21:36] <petan>	 YuviPanda: how I retrieve that (in php script)
[10:21:55] <YuviPanda>	 petan: it is a http header, so however you access the other headers?
[10:22:28] <petan>	 I guess using $_SERVER['HTTP_X_FORWARDED_FOR']
[10:22:42] <YuviPanda>	 should, yeah
[10:22:48] * YuviPanda  hasn't written PHP in a long time

[10:24:34] <petan>	 yes it works
[12:50:36] <petan>	 Damianz: I finished setting up pgsql permissions, you should be now able to access whitelist database directly from any labs instance using host "huggle" user "labs" password "public"
[12:50:54] <petan>	 just run select name from whitelist_public
[13:00:42] <Steinsplitter>	 petan: it is possible to transolate the output of @seen? now?
[13:00:52] <petan>	 not yet..
[13:01:27] <Steinsplitter>	 :'-(
[14:01:30] <rohit-dua>	 I have a project which uses a bot (crawler) for some round checks. Where do I have to put this bot in tool-labs? 
[14:04:19] <rohit-dua>	 note: i do a repo for my tool
[14:04:36] <rohit-dua>	 / do have a repo
[14:05:43] <wikibugs>	 3Wikimedia Labs / 3Infrastructure: !add-labs-user gone, fix or add docs to link SVN users to labs/wikitech - 10https://bugzilla.wikimedia.org/64596#c1 (10Antoine "hashar" Musso) See also Bug 63028 - Inconsistent GID number (500 or 550)  In this case I think jayvdb GID should be changed in LDAP from 550 (prod...
[15:54:43] <wikibugs>	 3Tool Labs tools / 3WMT bots: Fix bot-operator so we can give commands to the bots - 10https://bugzilla.wikimedia.org/60858#c3 (10PiRSquared17) Bump.
[16:38:29] <andrewbogott>	 Coren: there's nothing in our terms of use forbidding a user having two different labs accounts, is there?
[16:38:48] <Coren>	 andrewbogott: Good question.  I don't believe there is; nor would I worry about it.
[16:39:12] <Coren>	 andrewbogott: Although, like everything else, too many would be abusive and I'd start wondering wth.
[16:39:19] <andrewbogott>	 Coren:  for users who have a different prod vs. labs username, I may suggest that they just create a new labs account with their prod username and we rely on that to back production accounts.
[16:39:49] <andrewbogott>	 Messy, but I can't think of any real reason to not do it that way if they're attached to having different uids in prod vs. labs
[16:39:59] <Coren>	 Yeah, sounds sane.
[16:40:05] <andrewbogott>	 'k
[16:40:16] <andrewbogott>	 Just wanted to make sure I'm not endorsing labs sockpuppetry
[16:40:59] <valhallasw>	 andrewbogott: I think it's also considered OK because renaming accounts is messy
[16:41:16] <valhallasw>	 i.e. 'just make a new account instead of trying to get your old one renamed'
[16:41:23] <andrewbogott>	 valhallasw: yes!  I tried to rename a user on Monday and now his account is utterly broken and I will never try that again
[16:50:40] * andrewbogott  emails everyone

[16:54:29] <aude>	 andrewbogott: on my wikidata-test instance, the disk space in "/var" is almost full. (it has ~1.8gb)
[16:54:38] <aude>	 1.1 gb is in /var/lib/puppet/clientbucket
[16:54:59] <wikibugs>	 3Wikimedia Labs / 3Infrastructure: beta: Get SSL certificates for *.{projects}.beta.wmflabs.org - 10https://bugzilla.wikimedia.org/48501#c91 (10Greg Grossmeier) 5NEW>3RES/WON Won't Fix'ing this for now.  A) We have self-signed certs in place on Beta B) Real certs are expensive C) There hasn't been any te...
[16:55:00] <aude>	 is that normal? or is that supposed to be cleaned somehow? (regularly) or needed or what?
[16:55:57] <andrewbogott>	 aude: I don't know!  Let me google a bit.
[16:55:57] <aude>	 i see cleaning done https://wikitech.wikimedia.org/wiki/Server_admin_log/Archive_21
[16:56:04] <andrewbogott>	 Mind if I log in a poke around a bit?
[16:56:06] <aude>	 Tim: on neon: cleaned up /var/lib/puppet/clientbucket/* since it was out of disk space
[16:56:10] <aude>	 sure
[16:56:18] <aude>	 it's self-hosted puppetmaster
[16:57:44] <andrewbogott>	 aude:  https://ask.puppetlabs.com/question/132/does-filebucket-need-periodic-maintenance-cleaning/
[16:57:53] <andrewbogott>	 I don't know why yours has grown so much, but it should be safe to clean
[16:57:54] <aude>	 thanks
[16:58:00] <aude>	 no idea why
[16:58:17] <aude>	 it's looks like "cached" stuff
[16:58:36] <ottomata>	 hiya Coren, I can't create a new instance in the analytics project anymore
[16:58:43] <ottomata>	 are we at our quota or something?
[16:58:53] <aude>	 done :)
[16:59:31] <andrewbogott>	 aude: Apparently there's a way to specify that a particular resource not get backed up there.  I don't see an obvious system-wide default for that though
[16:59:39] <aude>	 hmmm
[16:59:44] <aude>	 not done
[16:59:46] <andrewbogott>	 ottomata: you can view your quota status; there's a link on the manage projects page
[17:00:56] <andrewbogott>	 aude: now what?
[17:02:08] <aude>	 trying puppet now
[17:02:21] <ottomata>	 yeah, thanks andrewbogott
[17:02:23] <ottomata>	 it says 20/20
[17:02:24] <aude>	 seems ok
[17:02:29] <ottomata>	 did our quota decrease when we moved to eqiad?
[17:02:33] <ottomata>	 we used to have much more than that, i'm sure
[17:02:59] <andrewbogott>	 ottomata: I don't remember if I duplicated quotas or not.
[17:03:10] <andrewbogott>	 Anyway I can bump you up if you don't have any instances that can be pruned...
[17:04:03] <ottomata>	 yeah, not really, most are not mine
[17:04:09] <ottomata>	 and we had a lot there because I used it for hadoop cluster testing
[17:04:23] <andrewbogott>	 ok, hang on...
[17:04:23] <ottomata>	 would appreciate a bump
[17:04:33] <andrewbogott>	 how are you doing ram and core-wise?
[17:05:20] <andrewbogott>	 Oh, you're out of cores, not instances
[17:06:07] <andrewbogott>	 ottomata: try now?
[17:07:14] <wikibugs>	 3Wikimedia Labs / 3Infrastructure: beta: Get SSL certificates for *.{projects}.beta.wmflabs.org - 10https://bugzilla.wikimedia.org/48501#c92 (10se4598) 5RES/WON>3REO This bug seems to be drifted away from the initial comment. (In reply to Antoine "hashar" Musso from comment #0) > We need certificates gen...
[17:07:22] <ottomata>	 worked, thanks	 andrewbogott!
[17:45:28] <wikibugs>	 3Wikimedia Labs / 3tools: Killed Mysql queries still running - 10https://bugzilla.wikimedia.org/64140#c8 (10kolossos) After 11 days still running: tools.templatetiger@tools-login: MariaDB [(none)]> show processlist; +----------+--------+-------------------+-------------------------+---------+---------+------...
[18:37:44] <Betacommand>	 Coren: please take a goold look at my cron tab before it gets migrated, I always get hit with labs bugs
[18:51:23] <Steinsplitter>	 @seen dan-nl
[18:51:23] <wm-bot>	 Steinsplitter: Last time I saw dan-nl they were quitting the network with reason: Quit: dan-nl N/A at 4/30/2014 8:49:34 AM (10h1m48s ago)
[20:59:14] <valhallasw>	 !log local-wikibugs Deployed a48a000
[20:59:15] <labs-morebots>	 Logged the message, Master
[21:25:44] <wikibugs>	 3Wikimedia Labs / 3tools: Killed Mysql queries still running - 10https://bugzilla.wikimedia.org/64140#c9 (10Tim Landscheidt) a:5Marc A. Pelletier>3Sean Pringle Tim, just to be clear: On what DB host is this query running/hanging?  Looking at /data/project/templatetiger/public_html/einspielen.sql, this se...
[21:56:58] <wikibugs>	 3Wikimedia Labs / 3tools: Killed Mysql queries still running - 10https://bugzilla.wikimedia.org/64140#c10 (10kolossos) It's running on tools-db. I started it with jsub. I never restarted the query and it has no contact to the official enwiki-db because I import an extract of templates as a text-file into my...
[22:15:14] <wikibugs>	 3Wikimedia Labs / 3tools: /var is full on tools-webgrid-01 due to me spamming /var/log/auth.log with sudo - 10https://bugzilla.wikimedia.org/64683#c1 (10Tim Landscheidt) 5NEW>3ASS p:5Unprio>3Lowest For the time until we fix bug #61102, I have installed a script /home/scfc/bin/cleanup-php-cgis per cro...
[22:16:19] <Coren>	 scfc_de: BTW, the grid now kills webgrid jobs with SIGTERM instead.
[23:13:28] <wikibugs>	 3Wikimedia Labs / 3tools: Tool Labs: Provide anonymized view of the user_properties table - 10https://bugzilla.wikimedia.org/58196#c33 (10Tisza Gergő) Is the order of rows randomized? Being able to correlate other preferences with, say, fancysig based on row number would be bad.  As for timestamp anonimizati...
[23:48:12] <wikibugs>	 3Wikimedia Labs / 3Infrastructure: beta: Get SSL certificates for *.{projects}.beta.wmflabs.org - 10https://bugzilla.wikimedia.org/48501#c93 (10Matthew Flaschen) I can think of three significant problems with self-signed certificates:  1. It trains people to ignore SSL warnings, which means they ignore them...