[11:50:25] <Luke081515>	 ah, petrb restarted it
[11:50:57] <wikibugs>	 6Labs, 10WM-Bot: wm-bot down - https://phabricator.wikimedia.org/T127431#2049358 (10Luke081515) But it is working now, wmbot rejoined the channels.
[11:51:51] <wikibugs>	 6Labs, 10WM-Bot: wm-bot down - https://phabricator.wikimedia.org/T127431#2049359 (10Billinghurst) I finally was able to get my login sorted and restart the beast. :-)
[11:52:36] <sDrewth>	 Luke081515: I finally got in and restarted
[11:53:11] <sDrewth>	 !log labs (re)started wm-bot
[11:53:12] <labs-morebots>	 labs is not a valid project.
[11:54:15] <sDrewth>	 !log bots (re)started wm-bot
[11:54:18] <labs-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Bots/SAL, Master
[11:58:33] <sDrewth>	 hmm, looks as though petrb was on at the same time, so I will give him the credit
[12:09:44] <wikibugs>	 6Labs, 10Tool-Labs: install Morfeusz (morphological analyser) and Python bindings - https://phabricator.wikimedia.org/T127633#2049373 (10Krenair)
[12:14:06] <wikibugs>	 6Labs, 10WM-Bot: wm-bot down - https://phabricator.wikimedia.org/T127431#2049375 (10Billinghurst) 5Open>3Resolved Hmm and @petrb was there at exactly the same time. /me grants the kill to Petan
[12:28:47] <wikibugs>	 6Labs, 10WM-Bot: wm-bot down - https://phabricator.wikimedia.org/T127431#2049384 (10Krenair) >>! In T127431#2049354, @Petrb wrote: > the box was rebooted for some reason need investigation why  https://lists.wikimedia.org/pipermail/labs-l/2016-February/004298.html ?
[13:06:47] <wikibugs>	 6Labs, 10Tool-Labs: https://tools-static.wmflabs.org/video2commons/video2commons.js 403 Forbidden despite normal file permissions - https://phabricator.wikimedia.org/T124773#2049431 (10zhuyifei1999) 5Resolved>3Open Happening again after `git pull`
[13:38:47] <Stigmj>	 bastion-01 is reaaally sluggish now..
[13:41:24] <multichill>	 Looks like a user named "marcmiq" is running python scripts on it that eat all cpu
[13:41:40] <multichill>	 Not sure if there is an admin around to kill his script
[13:42:50] <Krenair>	 yuvipanda?
[13:43:09] <Krenair>	 nope, idle 06:33:48
[13:43:54] <Stigmj>	 hmm.. i did a "time ls -l" and it got "real	0m34.805s", "user	0m0.015s", "sys	0m0.030s"
[13:44:13] <Stigmj>	 but now it's responsive again..
[13:44:28] <multichill>	 https://wikitech.wikimedia.org/wiki/Shell_Request/Marcmiquel
[13:44:30] <multichill>	 That user
[13:47:47] <multichill>	 marcmiq+ 26441  8909 98 11:26 pts/14   02:18:20 python cira_sessions_work_analysis.py cawiki <- hmm, someone should explain him how to schedule stuff on the grid
[13:50:16] <jem>	 Hi, I'm trying to use OAuth for authentication only in my tool and I can't pass the user information by using $_SESSION, can someone help?
[14:15:16] <Luke081515>	 someone can help me with CentralAuth extension? I set up it at an labs instance at grant "globalgrouppermissions" to stewards, but as a steward I'm only able to edit wikisets, not globalgroups
[14:19:00] <Krenair>	 Luke081515, I think that permission is set up in a funny way
[14:19:31] <Luke081515>	 Krenair: What do you mean? Stewards have globalgroupmembership too, but the can't edit it
[14:19:37] <Luke081515>	 at my setup
[14:19:42] <Krenair>	 includes/specials/SpecialGlobalGroupPermissions.php:		return $globalUser->hasGlobalPermission( 'globalgrouppermissions' );
[14:19:58] <Krenair>	 The right has to be granted globally, it won't check their local groups
[14:20:05] <Krenair>	 to be able to edit group permissions
[14:20:24] <Luke081515>	 and how can I enable it globally, if I'm not able to edit global groups?
[14:22:50] <Luke081515>	 Krenair: Do you how I can do that?
[14:22:55] <Luke081515>	 this is strange
[14:23:09] <Krenair>	 Luke081515, I think this is a known issue
[14:23:37] <Luke081515>	 why just change this line?
[14:23:43] <Luke081515>	 *just not
[14:23:58] <Luke081515>	 Or is it a problem, if youc an assign this right locally too?
[14:24:16] <Krenair>	 https://phabricator.wikimedia.org/T31435
[14:25:31] <Luke081515>	 Krenair: Do you know, what if have to fill in the database to create a group at database side?
[14:26:55] <Krenair>	 I think it's like this
[14:27:36] <Krenair>	 insert into global_group_permissions values ('sysadmin', 'globalgrouppermissions');
[14:28:01] <Krenair>	 which should create a sysadmin group with globalgrouppermissions, then you have to add your user:
[14:28:39] <Krenair>	 insert into global_user_groups values ($globalUID, 'sysadmin');
[14:29:02] <Krenair>	 where $globalUID is your global user ID (not local)
[14:29:08] <Luke081515>	 ok, the query for sysadmin wfm, but now I have to search for my ID first ;)
[14:29:54] <Krenair>	 select gu_id from globaluser where gu_name = $globalName;
[14:31:19] <Luke081515>	 at the global user directory I'm now shown as sysadmin
[14:31:24] <Luke081515>	 but not at Special:CentralAuth
[14:31:31] <Luke081515>	 and I'm still not able to change global groups :-/
[14:31:33] <yannf>	 yuvipanda, are you here?
[14:32:26] <Luke081515>	 Krenair: And I added globaluserrights to that group too, this throws permission error too :-/
[14:35:59] <Krenair>	 Luke081515, what?
[14:37:05] <Krenair>	 Luke081515, what is globaluserrights?
[14:37:15] <Luke081515>	 The group is shown and I'm in it, but I still can't edit globalgroupmembership or globalgrouppermissions
[14:37:25] <Luke081515>	 Special:GlobalUserrights => globalgroupmembership
[14:38:18] * Krenair shrugs
[14:38:21] <Krenair>	 log out and in again?
[14:39:15] <Luke081515>	 ah, works now :D
[14:41:38] <Luke081515>	 why has vagrant a CA role, but not a role for globalblock? strange
[15:15:47] <grrrit-wm>	 (03PS2) 10Youni Verciti: Initial Check-in & Html [labs/tools/vocabulary-index] - 10https://gerrit.wikimedia.org/r/271763 
[15:28:24] <wikibugs>	 6Labs, 7Patch-For-Review: Periodic internal labs dns outages - https://phabricator.wikimedia.org/T124680#2049603 (10Andrew) From the openstack mailing list:  "As I understand it, in Kilo and later mdns must be primary and send data to other backends via XFR."
[15:35:41] <grrrit-wm>	 (03PS1) 10Youni Verciti: Del .directory [labs/tools/vocabulary-index] - 10https://gerrit.wikimedia.org/r/272321 
[17:28:09] <SPF|Cloud>	 Is there any labs admin here I can speak in PM now?
[17:34:53] <andrewbogott>	 SPF|Cloud: what’s up?
[17:35:29] <SPF|Cloud>	 andrewbogott: Coren is already handling it
[17:35:46] <Coren>	 andrewbogott: Will pm in  asec
[17:35:59] <andrewbogott>	 thanks Coren!
[17:45:33] <jem>	 Hi, I'm trying to use OAuth for authentication only in my tool and I can't pass the user information by using $_SESSION, can someone help?
[18:12:56] <wikibugs>	 6Labs, 10Tool-Labs, 7Tracking: Useful graphite metrics to be tracked for Tool labs (tracking) - https://phabricator.wikimedia.org/T69879#2049780 (10bd808)
[18:13:31] <wikibugs>	 6Labs, 10Tool-Labs, 7Tracking: [tracking] Tool labs admin guides - https://phabricator.wikimedia.org/T104734#2049781 (10bd808)
[18:32:58] <yannf>	 yuvipanda, are you here?
[18:34:09] <Krenair>	 doesn't look like he is, what do you need yannf?
[18:34:51] <wikibugs>	 6Labs, 10Tool-Labs: Kubernetes Beta Signup List - https://phabricator.wikimedia.org/T112824#1647213 (10bd808) Name of tool: stashbot Language tool is written in: Python2 Webservice or Continuous job: Continuous job Does the tool use the labs replica dbs?: No Does the tool use toolsdb?: No Does the tool use NFS...
[18:36:39] <yannf>	 Krenair, from zhuyifei1999, https://phabricator.wikimedia.org/T124773 is blocking
[18:37:16] <yannf>	 video2commons is down
[18:37:28] <yannf>	 because of that
[18:37:55] <Krenair>	 yannf, is the directory it's in readable?
[18:38:28] <yannf>	 I don't know more that what's in T124773
[18:38:41] <yannf>	 *than
[18:38:59] <Krenair>	 hmm. yes
[18:40:33] <wikibugs>	 6Labs, 10Tool-Labs: install python-ldap dependencies - https://phabricator.wikimedia.org/T114388#1693918 (10bd808) I worked around this for the staashbot tool by creating my venv with support for using system packages (`virtualenv --system-site-packages virtenv`). This led to other random issues with my requir...
[18:43:10] <wikibugs>	 6Labs, 10Tool-Labs, 7Tracking: Initial Deployment of Kubernetes to Tool Labs (Tracking) - https://phabricator.wikimedia.org/T111885#2049814 (10bd808)
[18:52:23] <wikibugs>	 10Tool-Labs-tools-Erwin's-tools: erwin's tools not working for nlwiki - https://phabricator.wikimedia.org/T127659#2049823 (10Akoopal)
[18:59:16] <tgr>	 jem: around?
[19:02:53] <Amir1>	 hey, I was able to do sudo at this instance but right now I can't
[19:02:53] <Amir1>	 https://wikitech.wikimedia.org/wiki/Nova_Resource:Mediawiki.revscoring.eqiad.wmflabs
[19:03:06] <Amir1>	 anything wrong?
[19:05:06] <halfak>	 When I go to here, I don't see Amir1 (Ladsgroup) in the admins: https://wikitech.wikimedia.org/wiki/Nova_Resource:Revscoring
[19:05:25] <halfak>	 But when I managed projects, I do see him in the list of projectadmins: https://wikitech.wikimedia.org/wiki/Special:NovaProject
[19:06:40] <chasemp>	 we are doing some auditing of sudo rights at the moment, we have have culled something too aggressively
[19:06:55] <chasemp>	 if possible try again later and if it's still off then a ticket w/ cc andrew is a good idea
[19:07:05] <chasemp>	 may have^
[19:07:14] <halfak>	 Thanks chasemp 
[19:07:17] <Amir1>	 thanks
[19:08:03] <jem>	 tgr: Yes
[19:08:32] <tgr>	 jem: can you describe your OAuth problem?
[19:09:17] <jem>	 I try
[19:09:30] <jem>	 Basically I copied the oauth-hello-world code
[19:10:36] <jem>	 As I just need authorization and pass the user info to my application, I invoke fetchAccessToken() and doIdentify()
[19:11:06] <jem>	 And in doIdentify() I add $_SESSION['user'] = $payload;
[19:11:29] <jem>	 Then header ("location:...") to my php page
[19:11:49] <jem>	 But after session_start in my php page, $_SESSION is empty
[19:12:36] <jem>	 And I think I'm doing the same as other app in my work where that is enough to work
[19:13:59] <tgr>	 unless you are interested in learning about the OAuth protocol, you are probably better off using a library
[19:15:28] <jem>	 Hm
[19:15:47] <jem>	 Well, the point is I get the information I need
[19:16:10] <jem>	 It's just the way to pass it the problem
[19:16:18] <tgr>	 https://github.com/wikimedia/mediawiki-oauthclient-php is MediaWiki's own client library, or you can find others at http://oauth.net/code/ (the OAuth 1 ones)
[19:17:30] <jem>	 Hummm... then I think it's much faster to pass it by simple POST
[19:17:46] <jem>	 Than to learn a new library just for that
[19:18:03] <jem>	 I just wanted to do it in the most correct way :)
[19:28:21] <jem>	 Ok, I'm giving a try to MW's library, it seems easy
[19:28:59] <jem>	 But I'm afraid I can end up with the same problem when passing the information
[19:36:07] <enterprisey>	 I'm getting very strange problems with my webservice
[19:36:25] <enterprisey>	 When I do `webservice status`, I get "Your webservice is running"
[19:36:39] <enterprisey>	 yet it's not working
[19:36:45] <enterprisey>	 it's http://tools.wmflabs.org/afdstats/
[19:37:50] <enterprisey>	 any help?
[19:45:53] <jem>	 tgr: I give up, the examples don't help much, but I can see that the SESSION update + header-location is need and should work anyway
[19:46:05] <jem>	 Thanks anyway for your help
[19:46:59] <jem>	 is needed*
[19:52:38] <enterprisey>	 tgr: I know you've been helpful with labs stuff before; you there?
[19:53:11] <tgr>	 enterprisey: sec, I'm on a call
[19:53:45] <enterprisey>	 thanks!
[19:53:48] <enterprisey>	 (no problem)
[20:06:20] <tgr>	 enterprisey: bit outside my area of competence, but restart it, try to connect from localhost, check logs?
[20:06:26] <enterprisey>	 restarting it times out
[20:06:35] <tgr>	 yuvipanda can probably give you advice that's actually useful
[20:06:39] <enterprisey>	 sounds good
[20:06:45] <enterprisey>	 also, for the record, logs show nothing
[20:08:07] <tgr>	 jem: oauth-hello-world is not really meant as a framework to build tools with, it's just to check that oauth is working
[20:08:36] <tgr>	 I can help with mw-oauthclient-php if you can explain better what the problem is
[20:10:51] <tgr>	 enterprisey: or Coren, or andrewbogott 
[20:11:08] <enterprisey>	 thanks for the pings
[20:46:22] <wikibugs>	 6Labs, 10Tool-Labs, 15User-bd808: Create template PHP application for use on Tool Labs based on Slim, Twig and Wikimedia libraries - https://phabricator.wikimedia.org/T90092#2049961 (10bd808) >>! In T90092#1654501, @Spage wrote: > (Minor drive-by comment) Why Twig? MediaWiki core [[ https://www.mediawiki.org...
[20:52:05] <wikibugs>	 6Labs, 10Tool-Labs, 15User-bd808: Create template PHP application for use on Tool Labs based on Slim, Twig and Wikimedia libraries - https://phabricator.wikimedia.org/T90092#2049965 (10bd808) 5Open>3Resolved The original goal of this task has been completed in the form of the <https://tools.wmflabs.org/b...
[20:59:42] <wikibugs>	 6Labs, 10Tool-Labs, 10DBA, 7Tracking: Certain tools users create multiple long running queries that take all memory from labsdb hosts, slowing it down and potentially crashing (tracking) - https://phabricator.wikimedia.org/T119601#2050009 (10bd808)
[21:09:27] <wikibugs>	 6Labs, 10Tool-Labs: toolserver.org uses 302 redirects instead of 301 - https://phabricator.wikimedia.org/T123861#1939702 (10bd808) The apache config introduced in 576a3eab specifies 301 redirects. The only 302 redirect I see is the http://toolserver.org to https://toolserver.org redirect:  ``` $ curl -IL http:...
[21:40:47] <wikibugs>	 6Labs, 10Tool-Labs: Allow scfc and valhallasw to ssh in as root - https://phabricator.wikimedia.org/T116156#2050088 (10bd808) 5Open>3Resolved The revert was itself reverted in https://gerrit.wikimedia.org/r/#/c/257808/ and https://wikitech.wikimedia.org/wiki/Hiera:Tools has keys for valhallasw and scfc.
[22:08:52] <doctaxon>	 labs is going down, without announcement?
[22:10:22] <doctaxon>	 how long will labs be down?
[22:10:36] <multichill>	 Huh?
[22:10:50] <multichill>	 andrewbogott: Wtf?
[22:11:02] <andrewbogott>	 doctaxon: not labs, just that one host
[22:11:04] <doctaxon>	 yes, i got The system is going down for maintenance in 3 minutes!
[22:11:08] <andrewbogott>	 I will follow up in an email shortly.
[22:11:27] <andrewbogott>	 if you log out and reconnect to tools-login, you’ll be directed to a different host
[22:11:29] <doctaxon>	 i need to know how long
[22:11:53] <doctaxon>	 ah okay
[22:12:55] <gifti>	 andrewbogott: do you know where i can look up the assignment of db replicas to s1/(s2)/s3?
[22:13:03] <gifti>	 i can't find anythiing
[22:13:23] <andrewbogott>	 it’s in the puppet source
[22:13:34] <andrewbogott>	 I don’t have time to dig it out at the moment, sorry
[22:13:45] <andrewbogott>	 may be able to look in a few minutes
[22:13:51] <multichill>	 andrewbogott: What happened with announcing planned work longer than 5 minutes before it's actually happening?
[22:16:37] <andrewbogott>	 multichill: not planned
[22:19:12] <wikibugs>	 10Tool-Labs-tools-Other, 6Community-Tech, 7Community-Wishlist-Survey, 7Milestone: Pageview Stats tool - https://phabricator.wikimedia.org/T120497#2050120 (10Pine) @Egedda have you uploaded the Project Planning Document to Commons yet?
[22:20:21] <enterprisey>	 andrewbogott: you still there?
[22:20:34] <andrewbogott>	 sort of
[22:20:44] <enterprisey>	 tgr recommended you for a bit of webservice help
[22:20:51] <enterprisey>	 I'm a maintainer on afdstats
[22:21:06] <enterprisey>	 webservice says it's running, but it times out when I try a restart and when I try accessing it from a browser
[22:21:11] <enterprisey>	 logs aren't helpful
[22:21:43] <andrewbogott>	 enterprisey: sorry, I won’t be able to help you now.  I have lots of urgent things I’m in the middle of
[22:21:47] <enterprisey>	 okay, no problem
[22:21:51] <enterprisey>	 anybody I could ping?
[22:22:30] <enterprisey>	 (gonna ping the two other people tgr said I could ask: Coren and yuvipanda)
[22:22:31] <andrewbogott>	 I’m not sure, folks are a bit thin on a Sunday night
[22:22:39] <andrewbogott>	 yuvi is on holiday
[22:23:08] <enterprisey>	 okay, thanks, good to know
[22:23:31] <wikibugs>	 10Tool-Labs-tools-Other, 6Community-Tech, 7Community-Wishlist-Survey, 7Milestone: Pageview Stats tool - https://phabricator.wikimedia.org/T120497#2050123 (10Egedda) >>! In T120497#2050120, @Pine wrote: > @Egedda have you uploaded the Project Planning Document to Commons yet?  We haven't gotten a response y...
[22:32:40] <andrewbogott>	 gifti: I think this patch might indirectly answer your question:  https://gerrit.wikimedia.org/r/#/c/270650/
[22:34:47] <gifti>	 thank you~
[22:35:00] <enterprisey>	 (if anybody has a message for me, try MemoServ - thanks)
[23:02:01] <gifti>	 so sloooow
[23:03:33] <wikibugs>	 6Labs, 10Tool-Labs: https://tools-static.wmflabs.org/video2commons/video2commons.js 403 Forbidden despite normal file permissions - https://phabricator.wikimedia.org/T124773#1965451 (10bd808) Possibly related to {T112388} and {T106170}
[23:07:05] <bd808>	 gifti: the replag tool shows wikidb by shard -- https://tools.wmflabs.org/replag/
[23:07:50] <gifti>	 ya, but i'm interested if it mapped to s[1-3].labsdb
[23:08:08] <gifti>	 not to s[1-7] of the production servers
[23:08:21] <gifti>	 +is
[23:12:31] <bd808>	 gifti: ah. ok. I think you could figure that out using the dns aliases -- for i in 1 2 3 4 5 6 7; do host s$i.labsdb; done
[23:13:45] <bd808>	 looks like s1 & s2 are mapped to labsdb1001.eqiad.wmnet right now and the rest are mapped to labsdb1003.eqiad.wmnet.
[23:14:16] <gifti>	 mhm, i used ping ;)
[23:14:26] <gifti>	 i'm not good at networking
[23:15:04] <gifti>	 also, s[4-7].labsdb don't exist ;)
[23:15:52] * gifti goes to bed … it's 0:15 am here
[23:15:55] <bd808>	 the dns aliases do (at least from tools-bastion-02.tools)
[23:16:26] <gifti>	 huh?
[23:16:43] <gifti>	 i cannot confirm that …
[23:17:25] <bd808>	 s[1-7].labsdb are CNAME aliases to the labsdb100[1-3] hosts
[23:22:20] <gifti>	 but they don't exist, right?
[23:22:26] <gifti>	 *work
[23:23:37] <bd808>	 They should. The `host` checks return the ip of labsdb1003 for them
[23:24:06] <bd808>	 seven things are mapped to 3 (well 2 right now)
[23:24:09] <bd808>	 but that
[23:24:18] <bd808>	 but's that's not a problem
[23:25:25] <bd808>	 the point of those aliases is to abstract away the physical differences between production and the labs replicas
[23:45:38] <bd808>	 !log tools.afdstats Force deleted hung lighttpd job
[23:47:02] <bd808>	 !log tools.afdstats Started webservice
[23:47:04] <labs-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.afdstats/SAL, Master