|
2019-05-30 09:47:23
|
<Wurgl>
|
Is anyone here and can take a look? https://phabricator.wikimedia.org/T224656 ((for me it smells like broken index or a problem with the disc))
|
|
2019-05-30 09:58:16
|
<arturo>
|
!log tools T224558 reboot tools-worker-1029 after puppet changes for sssd/sudo in jessie
|
|
2019-05-30 09:58:19
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
|
|
2019-05-30 09:58:19
|
<stashbot>
|
T224558: sssd: support for Debian Jessie - https://phabricator.wikimedia.org/T224558
|
|
2019-05-30 09:59:37
|
<arturo>
|
Wurgl: I suggest you add the DBAs in that phabricator task loop
|
|
2019-05-30 10:00:30
|
<Wurgl>
|
Which ones?
|
|
2019-05-30 10:00:53
|
<Wurgl>
|
Aha! The group?
|
|
2019-05-30 10:00:57
|
<arturo>
|
perhaps adding the `DBA` phab tag, yes
|
|
2019-05-30 10:01:56
|
<arturo>
|
!log tools T224558 add tools-worker-1029 to the nodes pool of k8s
|
|
2019-05-30 10:01:58
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
|
|
2019-05-30 10:09:43
|
<arturo>
|
!log tools T224558 disable puppet in all tools-worker- nodes
|
|
2019-05-30 10:09:47
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
|
|
2019-05-30 10:09:47
|
<stashbot>
|
T224558: sssd: support for Debian Jessie - https://phabricator.wikimedia.org/T224558
|
|
2019-05-30 10:27:19
|
<arturo>
|
!log tools T224558 switch tools-worker-1001 to sssd/sudo. Includes drain/depool/reboot/repool
|
|
2019-05-30 10:27:22
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
|
|
2019-05-30 10:27:22
|
<stashbot>
|
T224558: sssd: support for Debian Jessie - https://phabricator.wikimedia.org/T224558
|
|
2019-05-30 10:28:27
|
<arturo>
|
!log tools T224558 use hiera config in prefix tools-worker for sssd/sudo
|
|
2019-05-30 10:28:30
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
|
|
2019-05-30 10:33:24
|
<arturo>
|
!log tools T224558 switch tools-worker-1002 to sssd/sudo. Includes drain/depool/reboot/repool
|
|
2019-05-30 10:33:27
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
|
|
2019-05-30 10:33:27
|
<stashbot>
|
T224558: sssd: support for Debian Jessie - https://phabricator.wikimedia.org/T224558
|
|
2019-05-30 10:48:21
|
<arturo>
|
!log tools T224558 drop/build a VM for tools-worker-1002. It didn't like the sssd/sudo change :-(
|
|
2019-05-30 10:48:24
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
|
|
2019-05-30 10:48:24
|
<stashbot>
|
T224558: sssd: support for Debian Jessie - https://phabricator.wikimedia.org/T224558
|
|
2019-05-30 10:59:03
|
<wm-bot>
|
!log tools.integraality <jeanfred> Service stop, mv logs, service start for T224651
|
|
2019-05-30 10:59:05
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.integraality/SAL
|
|
2019-05-30 11:23:19
|
<arturo>
|
!log tools T224558 depool tools-worker-1003
|
|
2019-05-30 11:23:22
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
|
|
2019-05-30 11:23:24
|
<stashbot>
|
T224558: sssd: support for Debian Jessie - https://phabricator.wikimedia.org/T224558
|
|
2019-05-30 11:58:31
|
<ireas>
|
Hi! I’m using this query in one of my tools to get the first edit of a user (example for dewiki): `SELECT rev_timestamp FROM revision_userindex WHERE rev_user=336793 ORDER BY rev_timestamp ASC LIMIT 1;` This used to be really fast, but currently it takes > 10 seconds, up to several minutes. Any ideas what causes the long execution time and how to speed it up?
|
|
2019-05-30 11:59:05
|
<arturo>
|
hi ireas I would suggest you open a phabricator task and add the `DBA` tag to it :-)
|
|
2019-05-30 11:59:35
|
<arturo>
|
!log tools T224558 repool tools-worker-1003 (using sssd/sudo now!)
|
|
2019-05-30 11:59:38
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
|
|
2019-05-30 11:59:39
|
<stashbot>
|
T224558: sssd: support for Debian Jessie - https://phabricator.wikimedia.org/T224558
|
|
2019-05-30 11:59:53
|
<ireas>
|
arturo: okay, thanks!
|
|
2019-05-30 12:08:06
|
<wm-bot>
|
!log tools.integraality <jeanfred> Nuked the virtualenv and reinstalled all deps from scratch, in desperation for T224651
|
|
2019-05-30 12:08:09
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.integraality/SAL
|
|
2019-05-30 12:20:28
|
<arturo>
|
!log tools cordon/drain tools-worker-1003 because T224651 and T224651
|
|
2019-05-30 12:20:32
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
|
|
2019-05-30 12:20:33
|
<stashbot>
|
T224651: Manual update - stale file handle - https://phabricator.wikimedia.org/T224651
|
|
2019-05-30 12:22:52
|
<arturo>
|
!log tools cordon/drain tools-worker-1029 because T224651 and T224651
|
|
2019-05-30 12:22:55
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
|
|
2019-05-30 12:23:46
|
<arturo>
|
!log tools cordon/drain tools-worker-1001 because T224651 and T224651
|
|
2019-05-30 12:23:50
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
|
|
2019-05-30 12:25:11
|
<arturo>
|
!log tools cordon/drain tools-worker-1002 because T224651 and T224651
|
|
2019-05-30 12:25:15
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
|
|
2019-05-30 12:29:29
|
<arturo>
|
!log tools switch hiera setting back to classic/sudoldap for tools-worker because T224651 (T224558)
|
|
2019-05-30 12:29:33
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
|
|
2019-05-30 12:29:33
|
<stashbot>
|
T224558: sssd: support for Debian Jessie - https://phabricator.wikimedia.org/T224558
|
|
2019-05-30 12:29:34
|
<stashbot>
|
T224651: Manual update - stale file handle - https://phabricator.wikimedia.org/T224651
|
|
2019-05-30 12:35:18
|
<arturo>
|
!log tools enable puppet in tools-worker nodes
|
|
2019-05-30 12:35:20
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
|
|
2019-05-30 12:42:19
|
<arturo>
|
!log tools reboot tools-woker-1001 to cleanup sssd config and let nslcd/nscd start freshly
|
|
2019-05-30 12:42:21
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
|
|
2019-05-30 12:47:17
|
<arturo>
|
!log tools reboot tools-woker-1002 to cleanup sssd config and let nslcd/nscd start freshly
|
|
2019-05-30 12:47:19
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
|
|
2019-05-30 13:01:03
|
<arturo>
|
!log tools reboot tools-woker-1003 to cleanup sssd config and let nslcd/nscd start freshly
|
|
2019-05-30 13:01:05
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
|
|
2019-05-30 13:01:36
|
<arturo>
|
!log tools uncordon/repool tools-worker-1001/2/3. They should be fine now. I'm only leaving 1029 cordoned for testing purposes
|
|
2019-05-30 13:01:38
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
|
|
2019-05-30 15:15:56
|
<lucaswerkmeister>
|
!help I’m getting a scary error when trying to `git fetch` from Phabricator:
|
|
2019-05-30 15:15:56
|
<wm-bot>
|
lucaswerkmeister: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team
|
|
2019-05-30 15:16:00
|
<lucaswerkmeister>
|
https://paste.gnome.org/pvds38ghq
|
|
2019-05-30 15:16:34
|
<bstorm_>
|
I'm not familiar with git-ssh.wikimedia.org?
|
|
2019-05-30 15:17:00
|
<bstorm_>
|
Ah, it's phabricator
|
|
2019-05-30 15:17:07
|
<lucaswerkmeister>
|
yeah
|
|
2019-05-30 15:17:11
|
<lucaswerkmeister>
|
Diffusion or Differential, whichever one
|
|
2019-05-30 15:18:19
|
<lucaswerkmeister>
|
https://wikitech.wikimedia.org/wiki/Help:SSH_Fingerprints/git-ssh.wikimedia.org was last edited 2017
|
|
2019-05-30 15:19:01
|
<bstorm_>
|
https://wikitech.wikimedia.org/wiki/Help:SSH_Fingerprints/phab1003.eqiad.wmnet
|
|
2019-05-30 15:19:06
|
<paladox>
|
lucaswerkmeister i think that's expected.
|
|
2019-05-30 15:19:15
|
<paladox>
|
we recently migrated phabricator to a new server.
|
|
2019-05-30 15:19:21
|
<paladox>
|
phab1001 -> phab1003
|
|
2019-05-30 15:19:23
|
<bstorm_>
|
Yeah that matches phab1003
|
|
2019-05-30 15:19:42
|
<lucaswerkmeister>
|
then I guess https://wikitech.wikimedia.org/wiki/Help:SSH_Fingerprints/git-ssh.wikimedia.org should be updated
|
|
2019-05-30 15:19:52
|
<lucaswerkmeister>
|
(I can’t do it, it’s protected)
|
|
2019-05-30 15:19:55
|
<bstorm_>
|
Seems like it.
|
|
2019-05-30 15:20:09
|
<bstorm_>
|
or should just be a redirect to phab1003 :)
|
|
2019-05-30 15:20:21
|
<lucaswerkmeister>
|
or transclude it
|
|
2019-05-30 15:20:49
|
<lucaswerkmeister>
|
anything that doesn’t require me to know about this internal server move ^^
|
|
2019-05-30 15:21:37
|
<bstorm_>
|
mutante: You seem to be listed on commits about this
|
|
2019-05-30 15:22:20
|
<bstorm_>
|
Do you have access to update that, and/or an opinion on the way to update it?
|
|
2019-05-30 15:23:08
|
<bstorm_>
|
I can update it, so I'm sure mutante can :) Let me see what other aliases, etc. are handled like in there...
|
|
2019-05-30 15:23:35
|
<bstorm_>
|
Looks like just kinda copied https://wikitech.wikimedia.org/wiki/Help:SSH_Fingerprints/login-stretch.tools.wmflabs.org
|
|
2019-05-30 15:28:02
|
<bstorm_>
|
https://wikitech.wikimedia.org/wiki/Help:SSH_Fingerprints/git-ssh.wikimedia.org <--- I think I did that right
|
|
2019-05-30 15:28:03
|
<lucaswerkmeister>
|
also, apparently my ssh client first tries to connect via IPv6, and I have to wait for that to time out before a connection via IPv4 succeeds
|
|
2019-05-30 15:28:10
|
<bstorm_>
|
Just doing it like the cool kids do
|
|
2019-05-30 15:33:12
|
<mutante>
|
hello, i can confirm this service recently switched from phab1001 to phab1003, so the fingerprint change is expected
|
|
2019-05-30 15:33:16
|
<mutante>
|
thanks for already updating it
|
|
2019-05-30 15:33:18
|
<mutante>
|
https://wikitech.wikimedia.org/wiki/Phab1003 is here
|
|
2019-05-30 15:33:58
|
<mutante>
|
setup related to IPv6 should have no changes to before
|
|
2019-05-30 15:34:15
|
<lucaswerkmeister>
|
wait, apparently I’m not actually able to connect either
|
|
2019-05-30 15:34:18
|
<lucaswerkmeister>
|
I missed it before in the debug output
|
|
2019-05-30 15:34:29
|
<lucaswerkmeister>
|
but I’m just getting “permission denied (publickey,keyboard-interactive)”
|
|
2019-05-30 15:35:29
|
<mutante>
|
this sounds like an issue with the key not being loaded locally
|
|
2019-05-30 15:35:44
|
<lucaswerkmeister>
|
it’s at least offering the key according to debug1
|
|
2019-05-30 15:35:55
|
<lucaswerkmeister>
|
currently running ssh with -vvv but need to wait for the IPv6 timeout before I see results :)
|
|
2019-05-30 15:36:32
|
<mutante>
|
i don't think this part is related to the server switch
|
|
2019-05-30 15:37:05
|
<mutante>
|
that was literally just changing the backend IP
|
|
2019-05-30 15:37:57
|
<mutante>
|
btw, which project are you trying to use?
|
|
2019-05-30 15:38:13
|
<mutante>
|
since there is a ticket about moving everything off of this service, afaik
|
|
2019-05-30 15:38:14
|
<lucaswerkmeister>
|
tool-quickcategories.git
|
|
2019-05-30 15:38:29
|
<lucaswerkmeister>
|
and once Striker can automatically create Gerrit repositories, yes I’ll gladly migrate
|
|
2019-05-30 15:39:39
|
<lucaswerkmeister>
|
ssh debug output:
|
|
2019-05-30 15:39:42
|
<lucaswerkmeister>
|
https://paste.gnome.org/pqpqg6mto
|
|
2019-05-30 15:40:25
|
<paladox>
|
It shouldn't be hard to convert striker to create gerrit repos.
|
|
2019-05-30 15:42:12
|
<mutante>
|
paladox: are you familiar with using it this way? does it work for you?
|
|
2019-05-30 15:43:39
|
<paladox>
|
mutante cloning over ssh for phab?
|
|
2019-05-30 15:43:50
|
<mutante>
|
ye
|
|
2019-05-30 15:44:00
|
<mutante>
|
also trying to find that ticket..
|
|
2019-05-30 15:44:13
|
<paladox>
|
ok
|
|
2019-05-30 15:46:33
|
<lucaswerkmeister>
|
mutante: which one? the general “stop using Differential” is https://phabricator.wikimedia.org/T191182
|
|
2019-05-30 15:47:37
|
<mutante>
|
yes, that. thanks
|
|
2019-05-30 15:48:37
|
<mutante>
|
i remember doing that database query a couple months ago
|
|
2019-05-30 15:49:00
|
<mutante>
|
the one you mentioned doesn't seem to be in that though..hmm
|
|
2019-05-30 15:49:41
|
<lucaswerkmeister>
|
well tool-quickcategories didn’t exist yet in Dec 2018
|
|
2019-05-30 15:49:55
|
<mutante>
|
..we have been adding new things to it? :(
|
|
2019-05-30 15:50:25
|
<lucaswerkmeister>
|
well as long as Striker offers one-click repository creation I’ll continue to use it
|
|
2019-05-30 15:50:29
|
<lucaswerkmeister>
|
as I’ve said on that task already
|
|
2019-05-30 15:50:39
|
<mutante>
|
i was under the impression there is only one subtask left
|
|
2019-05-30 15:51:25
|
<mutante>
|
that's unfortunate if different people go in opposite directions
|
|
2019-05-30 15:52:08
|
<lucaswerkmeister>
|
I’ll create a Phabricator task for adding Gerrit support to Striker
|
|
2019-05-30 15:52:12
|
<mutante>
|
unrelated.. paladox seems to have a patch about the IPv6 part but i need to double check that. i will in a little while
|
|
2019-05-30 15:52:27
|
<mutante>
|
that sounds good,thx
|
|
2019-05-30 15:52:35
|
<lucaswerkmeister>
|
and CC the two people (so far) who said it shouldn’t be too much work :P
|
|
2019-05-30 15:53:25
|
<paladox>
|
it's a simple post to gerrit's rest api to create an repository.
|
|
2019-05-30 15:56:18
|
<mutante>
|
paladox: oh.. you might be right after all. that "unmapped" IP is git-ssh and the other one is phab1003-vcs
|
|
2019-05-30 15:56:28
|
<paladox>
|
yup
|
|
2019-05-30 15:56:29
|
<mutante>
|
lucaswerkmeister: hold on.. we might know the rason
|
|
2019-05-30 15:56:49
|
<lucaswerkmeister>
|
hold on with what? I assume this isn’t related to Striker
|
|
2019-05-30 15:57:13
|
<mutante>
|
it is not. i just mean "we are working on it. might be fixed in a few min"
|
|
2019-05-30 15:57:19
|
<lucaswerkmeister>
|
ok thanks :)
|
|
2019-05-30 16:00:38
|
<paladox>
|
that fixed ipv6 now, but still get "vcs@git-ssh.wikimedia.org: Permission denied (publickey,keyboard-interactive)."
|
|
2019-05-30 16:02:19
|
<lucaswerkmeister>
|
yup, IPv6 working, at least the permission denied happens a lot faster now
|
|
2019-05-30 16:02:36
|
<lucaswerkmeister>
|
I filed https://phabricator.wikimedia.org/T224676 for Striker+Gerrit btw
|
|
2019-05-30 16:04:59
|
<mutante>
|
paladox: phab1001 also had IPs on eth0 that were not in DNS.. unrelated comment.. and removed
|
|
2019-05-30 16:05:11
|
<paladox>
|
thanks.
|
|
2019-05-30 16:06:05
|
<mutante>
|
also i had removed the phab role from the old server yesterday so that puppet could be enabled again without adding/starting phab stuff there
|
|
2019-05-30 16:09:19
|
<mutante>
|
permissions on /srv/repos are the same, i see the sshd is running. twentyafterfour had tested it. maybe he would know more
|
|
2019-05-30 16:09:24
|
<mutante>
|
trying to find logs
|
|
2019-05-30 16:18:35
|
<mutante>
|
yea, so the IPv6 thing is fixed indeed and that was a mistake we made. thanks for pointing it out
|
|
2019-05-30 16:19:14
|
<mutante>
|
the permission denied issue though.. i don't know. i don't see logs for it and since everybody uses vcs@ there must be something in the phab db to map users to keyus
|
|
2019-05-30 16:19:19
|
<mutante>
|
not familiar with that part
|
|
2019-05-30 16:19:29
|
<lucaswerkmeister>
|
hm, okay
|
|
2019-05-30 16:19:29
|
<mutante>
|
would like to add twentyafterfour to a ticket
|
|
2019-05-30 16:19:33
|
<lucaswerkmeister>
|
should I create the ticket?
|
|
2019-05-30 16:19:51
|
<mutante>
|
yes please. so i can add Mukund and refer to it later today
|
|
2019-05-30 16:22:03
|
<lucaswerkmeister>
|
https://phabricator.wikimedia.org/T224677
|
|
2019-05-30 16:25:20
|
<paladox>
|
is going to try and support repo creation in gerrit from striker.
|
|
2019-05-30 16:25:37
|
<lucaswerkmeister>
|
\o/
|
|
2019-05-30 16:26:10
|
<bd808>
|
paladox: step 1 for that would be adding a gerrit deploy to the striker role in MediaWiki-Vagrant so that things can be tested. :)
|
|
2019-05-30 16:26:23
|
<paladox>
|
ah
|
|
2019-05-30 16:28:05
|
<paladox>
|
with gerrit we use a git fat deployment.
|
|
2019-05-30 16:28:57
|
<paladox>
|
i guess nows the time to add a gerrit class to MediaWiki-Vagrant :)
|
|
2019-05-30 17:00:18
|
<twentyafterfour>
|
checks T224677
|
|
2019-05-30 17:06:16
|
<paladox>
|
bd808 does vagrant use wikimedia's apt repo (ie stretch?)
|
|
2019-05-30 17:09:50
|
<paladox>
|
ah, it does!
|
|
2019-05-30 17:16:56
|
<paladox>
|
the good thing is gerrit does not require a db making an install easy.
|
|
2019-05-30 17:17:38
|
<paladox>
|
well technically it does from 2.16 (but we can use a h2 db which requires nothing from our side, gerrit setups that).
|
|
2019-05-30 17:29:42
|
<mutante>
|
turns out the vcs user account is locked.. i hear
|
|
2019-05-30 18:34:28
|
<lucaswerkmeister>
|
now I’m getting “connection closed” from the IPv6 address
|
|
2019-05-30 18:38:31
|
<Reedy>
|
stop using that new fancy pants internets
|
|
2019-05-30 18:49:33
|
<lucaswerkmeister>
|
it waits for 2 minutes before closing the connection btw
|
|
2019-05-30 18:53:30
|
<lucaswerkmeister>
|
and it happens with `ssh -4` as well, not the new fancy pants internets’ fault :P
|
|
2019-05-30 18:53:41
|
<lucaswerkmeister>
|
hangs after the “offering publilc key” step
|
|
2019-05-30 19:00:44
|
<paladox>
|
lucaswerkmeister yup, he's debugging *i think*
|
|
2019-05-30 19:01:42
|
<paladox>
|
apparently someone called a repo THMBREXT (brexit).
|
|
2019-05-30 19:03:13
|
<lucaswerkmeister>
|
ok lol
|
|
2019-05-30 19:03:41
|
<lucaswerkmeister>
|
(needed a few second to realise what the THM stood for ^^)
|
|
2019-05-30 19:04:07
|
<lucaswerkmeister>
|
(better than abbreviating it after Boris Johnson I suppose)
|
|
2019-05-30 19:04:54
|
<paladox>
|
lol
|
|
2019-05-30 19:07:00
|
<cscott>
|
lucaswerkmeister: i might be seeing that too
|
|
2019-05-30 19:09:34
|
<paladox>
|
cscott i think your issue is a gerrit one, where as lucaswerkmeister is a phab one.
|
|
2019-05-30 19:10:26
|
<cscott>
|
paladox: but maybe root cause is similar (ipv6 config, IIUC)
|
|
2019-05-30 19:10:31
|
<paladox>
|
hmm
|
|
2019-05-30 19:10:37
|
<lucaswerkmeister>
|
no no my problem is IPv4 too
|
|
2019-05-30 19:12:55
|
<paladox>
|
cscott what does ssh cscott@gerrit.wikimedia.org -p 29418 -vvv show?
|
|
2019-05-30 19:18:35
|
<mutante>
|
the user is not locked anymore, it's like on phab1001 now
|
|
2019-05-30 19:18:53
|
<mutante>
|
it's like we solved 3 issues and now it's the 4th :P
|
|
2019-05-30 19:19:24
|
<lucaswerkmeister>
|
like the opposite of yak shaving
|
|
2019-05-30 19:19:32
|
<paladox>
|
heh
|
|
2019-05-30 19:19:37
|
<paladox>
|
what's yak shaving?
|
|
2019-05-30 19:19:49
|
<mutante>
|
paladox: https://en.wiktionary.org/wiki/yak_shaving
|
|
2019-05-30 19:20:07
|
<lucaswerkmeister>
|
I think I might have used the term incorrectly, actually
|
|
2019-05-30 19:20:07
|
<mutante>
|
Ren and Stimpy :P
|
|
2019-05-30 19:20:11
|
<paladox>
|
lol
|
|
2019-05-30 19:20:26
|
<mutante>
|
https://en.wiktionary.org/wiki/when_you%27re_up_to_your_neck_in_alligators,_it%27s_hard_to_remember_that_your_initial_objective_was_to_drain_the_swamp#English
|
|
2019-05-30 19:20:48
|
<lucaswerkmeister>
|
but googling “yak shaving gif” did bring me to the one I was thinking of, https://i.imgur.com/t0XHtgJ.gifv
|
|
2019-05-30 19:21:58
|
<mutante>
|
so.. i unlocked the user and then also did " ./bin/config set diffusion.ssh-user vcs"
|
|
2019-05-30 19:22:38
|
<mutante>
|
i also verified the sudo rules are there and the same as before
|
|
2019-05-30 19:23:08
|
<mutante>
|
twentyafterfour: ^
|
|
2019-05-30 19:23:33
|
<mutante>
|
the vcs user is allowed to run these:
|
|
2019-05-30 19:23:38
|
<mutante>
|
vcs ALL=(phd) SETENV: NOPASSWD: /usr/bin/git-upload-pack, /usr/bin/git-receive-pack, /usr/bin/svnserve
|
|
2019-05-30 19:23:41
|
<mutante>
|
as phd
|
|
2019-05-30 19:23:47
|
<mutante>
|
this is the same as on old server too
|
|
2019-05-30 19:23:50
|
<paladox>
|
mutante what does /srv/deployment/phabricator/deploymentbin/ssh-auth paladox show?
|
|
2019-05-30 19:24:57
|
<mutante>
|
paladox: no such file or directory
|
|
2019-05-30 19:25:03
|
<paladox>
|
oh
|
|
2019-05-30 19:25:03
|
<twentyafterfour>
|
hmm
|
|
2019-05-30 19:25:04
|
<mutante>
|
on BOTH servers
|
|
2019-05-30 19:25:04
|
<paladox>
|
misplet
|
|
2019-05-30 19:25:13
|
<paladox>
|
/srv/deployment/phabricator/deployment/bin/ssh-auth paladox
|
|
2019-05-30 19:25:17
|
<paladox>
|
ohh
|
|
2019-05-30 19:25:18
|
<twentyafterfour>
|
/srv/phab/phabricator/bin/ssh-auth
|
|
2019-05-30 19:25:22
|
<paladox>
|
that one ^^
|
|
2019-05-30 19:25:49
|
<mutante>
|
that shows a lot of keys
|
|
2019-05-30 19:25:51
|
<mutante>
|
also on BOTH
|
|
2019-05-30 19:26:32
|
<paladox>
|
hmm
|
|
2019-05-30 19:26:40
|
<mutante>
|
it does not make a difference if i add "paladox" or not
|
|
2019-05-30 19:29:26
|
<mutante>
|
"paladox" does not show up in the output of it either way
|
|
2019-05-30 19:29:47
|
<paladox>
|
"debug2: we sent a publickey packet, wait for reply"
|
|
2019-05-30 19:30:00
|
<paladox>
|
so it's sent a pub key, but nothing is returned.
|
|
2019-05-30 19:33:05
|
<cscott>
|
turns out my problem was https://apple.stackexchange.com/questions/277479/openssh-hangs-at-rekey-after-134217728-blocks
|
|
2019-05-30 19:33:37
|
<lucaswerkmeister>
|
oh okay
|
|
2019-05-30 19:33:53
|
<lucaswerkmeister>
|
wait, you can have multiple processes listen on a socket?
|
|
2019-05-30 19:34:08
|
<cscott>
|
yup
|
|
2019-05-30 19:34:28
|
<cscott>
|
well, if you set the socket options correctly IIRC
|
|
2019-05-30 19:35:31
|
<mutante>
|
paladox: command="'/srv/deployment/phabricator/deployment/phabricator/bin/ssh-exec' '--phabricator-ssh-user' 'Paladox' '--phabricator-ssh-key' '274'",no-port-forwarding,no-X11-forwarding,no-agent-forwarding,no-pty ssh-rsa ...
|
|
2019-05-30 19:35:35
|
<mutante>
|
followed by your keys
|
|
2019-05-30 19:35:44
|
<mutante>
|
if i use the right capitalization of your user name :p
|
|
2019-05-30 19:35:48
|
<paladox>
|
heh
|
|
2019-05-30 19:36:02
|
<paladox>
|
so if that works, something else must be wrong?
|
|
2019-05-30 19:37:42
|
<mutante>
|
i want more logs directly from the sshd that phab starts...
|
|
2019-05-30 19:37:57
|
<mutante>
|
auth.log isnt helpful anymore since we fixed the user locked issue
|
|
2019-05-30 19:38:33
|
<paladox>
|
sudo service ssh-phab status
|
|
2019-05-30 19:38:51
|
<cscott>
|
SO_REUSEPORT (since Linux 3.9)
|
|
2019-05-30 19:38:52
|
<cscott>
|
Permits multiple AF_INET or AF_INET6 sockets to be bound to an
|
|
2019-05-30 19:38:52
|
<cscott>
|
identical socket address. This option must be set on each
|
|
2019-05-30 19:38:52
|
<cscott>
|
socket (including the first socket) prior to calling bind(2) on
|
|
2019-05-30 19:38:54
|
<cscott>
|
the socket. To prevent port hijacking, all of the processes
|
|
2019-05-30 19:38:54
|
<cscott>
|
binding to the same address must have the same effective UID.
|
|
2019-05-30 19:38:57
|
<cscott>
|
This option can be employed with both TCP and UDP sockets.
|
|
2019-05-30 19:38:57
|
<cscott>
|
For TCP sockets, this option allows accept(2) load distribution
|
|
2019-05-30 19:38:59
|
<cscott>
|
in a multi-threaded server to be improved by using a distinct
|
|
2019-05-30 19:39:01
|
<cscott>
|
listener socket for each thread. This provides improved load
|
|
2019-05-30 19:39:04
|
<cscott>
|
distribution as compared to traditional techniques such using a
|
|
2019-05-30 19:39:06
|
<cscott>
|
single accept(2)ing thread that distributes connections, or hav‐
|
|
2019-05-30 19:39:08
|
<cscott>
|
ing multiple threads that compete to accept(2) from the same
|
|
2019-05-30 19:39:10
|
<cscott>
|
socket.
|
|
2019-05-30 19:39:12
|
<cscott>
|
For UDP sockets, the use of this option can provide better dis‐
|
|
2019-05-30 19:39:15
|
<James_F>
|
cscott: Tsk, over-paste.
|
|
2019-05-30 19:39:17
|
<cscott>
|
tribution of incoming datagrams to multiple processes (or
|
|
2019-05-30 19:39:19
|
<cscott>
|
threads) as compared to the traditional technique of having mul‐
|
|
2019-05-30 19:39:21
|
<cscott>
|
tiple processes compete to receive datagrams on the same socket.
|
|
2019-05-30 19:39:26
|
<cscott>
|
(man 7 socket)
|
|
2019-05-30 19:40:34
|
<cscott>
|
James_F: man 7 socket | sed -e 's/^/James_F /' | irc
|
|
2019-05-30 19:40:37
|
<cscott>
|
;)
|
|
2019-05-30 19:40:49
|
<mutante>
|
phabricator-ssh-exec: Welcome to Phabricator.You are logged in as Paladox.
|
|
2019-05-30 19:40:58
|
<mutante>
|
i can do this without even having a key
|
|
2019-05-30 19:41:02
|
<mutante>
|
from localhost
|
|
2019-05-30 19:41:16
|
<paladox>
|
heh
|
|
2019-05-30 19:43:10
|
<mutante>
|
paladox: systemctl status ssh-phab just shows me some "Invalid user" lines but nothing about "vcs" at all :p
|
|
2019-05-30 19:43:18
|
<paladox>
|
oh
|
|
2019-05-30 19:43:31
|
<paladox>
|
cat /var/log/syslog ? :P
|
|
2019-05-30 19:44:32
|
<mutante>
|
just one thing about "vcs" and that is how it was set:
|
|
2019-05-30 19:44:38
|
<mutante>
|
(/Stage[main]/Phabricator/File[/srv/phab/phabricator/conf/local/local.json]/content) - "diffusion.ssh-user": "vcs",
|
|
2019-05-30 19:58:39
|
<paladox>
|
bd808 should we auto provision gerrit through puppet or let the user run the java -jar init command?
|
|
2019-05-30 20:19:53
|
<mutante>
|
can't we just add the striker role on a cloud VPS and configure it to use the existing gerrit test server
|
|
2019-05-30 20:20:18
|
<mutante>
|
without having to add new code in vagrant
|
|
2019-05-30 20:20:47
|
<mutante>
|
we already have a gerrit made for testing and also already have the puppet role to setup striker::web.. no?
|
|
2019-05-30 20:21:33
|
<mutante>
|
i kind of fail to understand how vagrant actually makes it easier
|
|
2019-05-30 20:29:35
|
<mutante>
|
twentyafterfour: oops.. that puppet change failed
|
|
2019-05-30 20:29:51
|
<mutante>
|
found unexpected end of stream while scanning a quoted scalar at line 325 column 15 at /etc/puppet/modules/phabricator/manifests/init.pp:87:23
|
|
2019-05-30 20:30:41
|
<twentyafterfour>
|
mutante: amended
|
|
2019-05-30 20:30:54
|
<mutante>
|
missing '
|
|
2019-05-30 20:31:16
|
<mutante>
|
already merged though :P
|
|
2019-05-30 20:31:40
|
<twentyafterfour>
|
https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/513407
|
|
2019-05-30 20:32:08
|
<mutante>
|
ok, reusing it
|
|
2019-05-30 20:44:42
|
<bd808>
|
mutante: mediawiki-vagrant makes developing on my laptop much easier than trying to integrate with some other random networked service. The mwvagrant stuff is also how I run the striker test server in cloud vps
|
|
2019-05-30 20:45:43
|
<bd808>
|
paladox: Ideally the puppet role would set everything up, but if that's hard for various reasons we can add an instructions page to the role that tell you the manual things that need to be done
|
|
2019-05-30 20:46:13
|
<bd808>
|
the existing striker role has one of those because there were a few things that I couldn't figure out how to automate reliably
|
|
2019-05-30 20:46:21
|
<paladox>
|
ok, it can be done, but getting it to not do it on each puppet run would be hard.
|
|
2019-05-30 20:47:05
|
<paladox>
|
oh
|
|
2019-05-30 20:47:12
|
<bd808>
|
paladox: is there any file that is created when it runs the first time?
|
|
2019-05-30 20:47:19
|
<paladox>
|
i guess we could do "creates => /var/lib/gerrit/touch"
|
|
2019-05-30 20:47:31
|
<paladox>
|
it creates an index folder
|
|
2019-05-30 20:47:59
|
<paladox>
|
and also a bunch of other folders (but we would need to configure a default etc/gerrit.config though)
|
|
2019-05-30 20:48:35
|
<bd808>
|
the role should make a fully functional service if possible, so it probably should include a config file
|
|
2019-05-30 20:49:41
|
<paladox>
|
ok. yup that will be easy to do.
|
|
2019-05-30 20:49:52
|
<paladox>
|
at least mostly a copy and paste from prods gerrit role.
|
|
2019-05-30 22:12:23
|
<wm-bot>
|
!log tools.quickcategories <lucaswerkmeister> git remote add github https://github.com/lucaswerkmeister/tool-quickcategories.git # work around T224677
|
|
2019-05-30 22:12:27
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.quickcategories/SAL
|
|
2019-05-30 22:17:45
|
<wm-bot>
|
!log tools.quickcategories <lucaswerkmeister> deployed e3cd2871eb (sort key support and minor UI fix)
|
|
2019-05-30 22:17:47
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.quickcategories/SAL
|
|
2019-05-30 22:30:15
|
<wm-bot>
|
!log tools.quickcategories <lucaswerkmeister> deployed ff3e7b2931 (add sort key hint to placeholder)
|
|
2019-05-30 22:30:17
|
<stashbot>
|
Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.quickcategories/SAL
|
|
2019-05-30 23:33:02
|
<paladox>
|
bd808 i think https://gerrit.wikimedia.org/r/#/c/mediawiki/vagrant/+/513314/ may work
|