[03:58:30] Change on 12mediawiki a page Wikimedia Labs was modified, changed by S Page (WMF) link https://www.mediawiki.org/w/index.php?diff=864572 edit summary: [WMF] /* Roadmap */ avoid redirect [04:01:54] Change on 12mediawiki a page Wikimedia Labs was modified, changed by S Page (WMF) link https://www.mediawiki.org/w/index.php?diff=864574 edit summary: [WMF] change links from labsconsole [09:24:07] thanks spagewmf, looks better now :) [11:18:26] !log tools Emptied /{data/project,home}/.snaplist as the snapshots themselves are not available [11:18:45] Logged the message, Master [11:20:07] (03CR) 10Tim Landscheidt: "Apparently, I fixed the man pages already in patchset #3. Now to cater for the case where .snaplist is empty or not existing ..." [labs/toollabs] - 10https://gerrit.wikimedia.org/r/76313 (owner: 10Platonides) [11:27:27] !log tools tools-webserver-01, tools-webserver-01: rm -f /var/log/exim4/paniclog; out of memory errors [11:27:49] Logged the message, Master [13:24:27] !log tools tools-exec-02, tools-master, tools-shadow, tools-webserver-01: Commented out duplicate MariaDB entries in /etc/apt/sources.list and re-ran apt-get update [13:24:47] Logged the message, Master [13:34:05] a hpn :) - tools.wmflabs.org seems to have problems? [13:36:17] katpatuka: Actually, only tools-webserver-03. Let's see ... [13:44:13] The (defunct) bookmarkmanagerv2 wiki seems to getting lots of hits. [13:46:50] seems to be ok now [15:37:44] bookmanagerv2 was an open wiki; the spam bots found it. Hilarity ensued. [17:21:00] My attempt to jsub a PHP task errors out with "libgcc_s.so.1 must be installed for pthread_cancel to work" :( [17:36:04] ...whereas manual invocation generates some nice output then terminates normally [17:37:35] specifically jsub -N wikicup php /data/project/wikicup/public_html/script.php [17:39:16] jarry1250: This is in the FAQ, and in a couple of other places. You're out of memory; php needs about 350M of vmem to fire up properly. [17:41:05] Coren: Ah yes. Thank you. [18:01:19] Coren: I'm having a permissions problem with a tool account (zbot) I created recently. My user account is in the local-zbot group, and the directory is set to 775, but I can't write to it from my user account [18:01:26] alexz@tools-login:~$ touch /data/project/zbot/public_html/ [18:01:26] touch: setting times of `/data/project/zbot/public_html/': Permission denied [18:01:46] Hm. [18:02:14] Ah; the lgwatcher died. [18:02:19] * Coren restarts it. [18:03:05] Try now? [18:03:33] Coren, was it murdered? [18:03:39] working now, thanks [18:04:02] (lgwatcher is an evil hack to work around a problem with service group names not being unique; this is fixed for eqiad but fixing it in labs would be more disruptive than is worth it for a few weeks) [18:04:42] Coren, as long as my bots remain functional, I don't care. :p [18:05:02] You can go ahead and fix it. At least it'll then be done. [18:05:52] They may or may not be. Changing usernames has sometimes obscure side effects that are hard to track down. eqiad will already have the projectname.groupname scheme in place. [18:06:26] Coren: Any news on extending proper group permissions to service users? [18:06:58] Coren, but if you think about, wouldn't fixing something and making sure it works in the long run be better than leaving an evil hack in place? [18:06:59] jarry1250: Related; it's the same issue biting. [18:07:11] Cyberpower678: The hack dies with pmtpa. [18:08:07] Coren, just my opinion. You have my permission to disrupt labs to fix an evil hack. [18:08:22] Yeah, no. [18:08:30] :p [18:08:57] im trying to setup MySQL on my local machine to use the replica wikipedia database. I'm getting a "could not onenct the ssh tunnel" error message saying "bad authentication type" [18:09:16] I'm using the same private key I have for winscp which works [18:09:40] FutureTense, I thought replication had no external access. [18:09:45] the error message tells me the allowed types are publicjkey and hostbased [18:10:05] https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help#Configuring_MySQL_Workbench [18:11:01] I want to test some queries, but I don't want to do it in the dumb mysql terminal [18:11:04] * Cyberpower678 needs to keep up with labs [18:20:29] FutureTense: That message is too vague to be useful. [18:20:48] nvm, I'll use the terminal for now [18:21:16] in which table is the actual text of a "diff" stored? [18:23:24] FutureTense, I just tried it with mine too. I'm getting the same error. [18:25:46] Coren, Authentication error. Please check that your username and password are correct and try again. Details (Original exception message): Bad authentication type (allowed_types=['publickey', 'hostbased']) [18:26:56] the wmf schema image shows a "text" table, but that doesnt appear to be part of the actual database [18:27:25] at least not part of enwiki_p [18:27:57] FutureTense: you have to use the api for that [18:28:08] why? [18:28:39] FutureTense: the text table doesn't exist (here) [18:29:04] just wondering why it doesnt. Performance reasons? [18:29:30] hedonil, do you have any idea regarding the workbench issue. [18:30:01] FutureTense: Cyberpower678: right now I'm connected with MySQL workbench [18:30:20] hedonil, what do yu have as your connection settings. [18:30:39] I followed the instructions and I can't even ssh into labs from workbench. [18:30:42] Cyberpower678: https://tools.wmflabs.org/wikiviewstats/screenshots/MySQL_Workbench.png [18:32:53] hedonil, what do you do for the SSH password? Is it supposed to be the password to the key file? [18:34:17] Cyberpower678: afair It will be prompted with "test connection" [18:34:26] didnt work for me [18:34:35] btw, where is a primer on the API? [18:34:36] Same herer. [18:34:44] im using windows btw [18:35:37] FutureTense: https://en.wikipedia.org/wiki/Special:ApiSandbox [18:36:09] hedonil, doesn't work [18:36:33] Cyberpower678: I reconnected a few minutes ago [18:37:29] Just to check, if i want extra python packages in my labs account, like mwparserfromhell, i use a virtual env? [18:37:55] or can i point my python interpreter to a common library [18:38:12] Cyberpower678: what does your logfile say Help->show logfiles [18:39:36] so given a specifc diff (like this from recent changes) https://en.wikipedia.org/w/index.php?title=Dominican_Republic&diff=588692379&oldid=588626840 [18:39:59] How can I use the API to get the text of added/removed changes? [18:40:20] I see the "query" action [18:41:22] FutureTense: you may try this https://en.wikipedia.org/wiki/Special:ApiSandbox#action=query&prop=revisions&format=json&rvlimit=10 [18:42:30] ?? [18:42:34] hedonil, 13:41:46 [INF][ SSH tunnel]: Existing SSH tunnel not found, opening new one [18:42:34] 13:41:46 [INF][ SSH tunnel]: Opening SSH tunnel to tools-login.wmflabs.org [18:42:38] That doesnt address that specfic article [18:42:40] nor diff [18:43:49] FutureTense: you have to enter your specific values, then scroll down >make request< gives you the output and the query-url [18:45:44] hedonil, [18:45:56] ^^^^ [18:45:57] Cyberpower678: so you have an ssh-tunnel [18:46:20] Actually, it won't SSH [18:46:58] * hedonil tries this again [18:48:34] Cyberpower678: do you have everything configured as shown in the screenshot? including tools useraccount and password ? [18:49:07] what's the tools password. I thought it was username and SSK Key File [18:49:09] Cyberpower678: then what does >test connection< tell you? [18:49:45] hedonil, http://pastebin.com/cmUeP11B [18:50:21] Is there a test wiki, where we can develop things like userscripts? [18:51:05] Cyberpower678: the field at the bottom holds your tools account password from replica.my.cnf [18:52:39] hedonil: I'm able to grab the comment from a diff like so: https://en.wikipedia.org//w/api.php?action=query&prop=revisions&format=php&rvprop=comment&revids=588683046 [18:52:48] but I dont see any option to get the changed text [18:54:12] FutureTense: I have actually never worked with diff-texts. So this is all I can tell you at the moment ;) [18:56:28] Cyberpower678: what's the world? (remember: the lower and are from replica.my.cnf) [18:57:10] That's for the SQL connection. [18:57:23] Cyberpower678: rrrright [18:57:32] I'm not getting past the SSH part. [18:58:18] Cyberpower678: you have a /dash/ in hostname not a /dot/ [18:58:54] hedonil, still no good. [18:59:14] It's not SSHing into tool labs. [19:00:36] Cyberpower678: Linux or Windows? [19:00:44] Windows [19:01:50] FutureTense: https://www.mediawiki.org/wiki/API:Properties#Revisions:_Parameters see rvdiffto [19:03:13] also action=compare (which I can't find docs for on mw.org, but is documented on https://en.wikipedia.org/w/api.php ) [19:03:51] MrZ-man: which action would I find that under? [19:04:03] action=query [19:04:19] yes, thats whay I have. I have prop=revisions as well [19:04:36] but im not seeing rvdiffto (at least in the sandbox) [19:10:04] hedonil, ^^^^^^^ [19:10:39] Cyberpower678: Seems to be a windows thing ;) [19:10:53] :p [19:11:12] Cyberpower678: Give FREE Software a try ... :P [19:11:33] Umm. Workbench is free [19:11:45] * hedonil smiles [19:12:21] Cyberpower678: but you can ssh via console? [19:12:37] yes [19:12:42] Gotta go now. [19:12:56] Cyberpower678: think about linux ... ;) [19:25:24] FutureTense: I found a setup for your diff https://en.wikipedia.org/wiki/Special:ApiSandbox#action=query&prop=revisions&format=json&rvprop=comment&rvlimit=1&rvstartid=588626840%20&rvtoken=rollback&rvdiffto=588692379&rvcontentformat=text%2Fplain&titles=Dominican%20Republic [19:26:08] thanks! [19:26:15] though I think the rdiffto is what I need [19:26:23] And I will have to code what I want to do anyways :( [19:26:36] FutureTense: :) [19:38:22] the api might be a better way to go entireily [19:38:35] Given revision X, how can I find the previous revision for the same article? [19:52:26] FutureTense: You have to play a little with API sandbox. In this case: rvlimit=1 rvstartid=588626840 rvdir=older titles=Dominican Republic [19:52:36] FutureTense: so it's revision 588626469 [19:52:44] sorry, I fugred that out [19:52:47] should ahve told you [19:53:10] only one last piece of the puzzle... given revision X, how can I find out the page ID Y it is associated too? [19:54:15] FutureTense: with rvprop select [19:54:37] yeah, thats what I've been trying [19:55:00] where do I put the revid? [19:55:31] if i put it in the parameter "revids" it tells me its a bad revid [19:56:00] FutureTense: so it's pageid: 8060 . rvstartid [19:57:07] action:query, prop:revisions [19:57:12] rvprop:ids [19:57:56] FutureTense: don't omit titles with revstartid [19:58:38] i dont even see that opton [19:59:03] can you paste your requesturl that it generates? [20:00:45] FutureTense: https://en.wikipedia.org/wiki/Special:ApiSandbox#action=query&prop=revisions&format=json&rvprop=ids&rvlimit=1&rvstartid=588626840&rvdir=older&rvcontentformat=text%2Fplain&titles=Dominican%20Republic [20:01:31] but that requires you to know the title [20:01:42] What I'm asking is if all you have is the revision id, how can you get the page id? [20:02:06] * hedonil tries [20:02:16] SELECT rev_page FROM revision WHERE rev_id=%s; [20:02:44] Dispenser: currently we are at API level ;) [20:03:10] What was the web 2.0 expression, "Use another API" :-) [20:04:18] FutureTense: got it: https://en.wikipedia.org/wiki/Special:ApiSandbox#action=query&prop=revisions&format=json&rvprop=ids&rvcontentformat=text%2Fplain&revids=588626840 [20:04:55] FutureTense: all parameters (incl: rvlimit) have to be removed [20:05:32] perfect! [20:07:04] Anyone know how to refresh page table entry? http://as.wikipedia.org/wiki/?curid=32604 Isn't a redirect; select page_is_redirect from page where page_id=32604\G claims it is [20:08:43] Cyberpower678: indeed some windows related ssh issues with MySQL workbench. Some hacks are on de webs. eg http://mysqlworkbench.org/2011/07/mysql-workbench-windows-and-ssh-public-key-auth/ [20:08:44] Dispenser: I thought cur_id is a revision id, not a page id, but I might be wrong [20:08:56] that's oldid [20:10:39] Cyberpower678: but as mentioned before - with linux it works like a charm. [21:34:30] Cyberpower678: hey CP. Just reanimated an old Win-XP VM, installed MySQL Workbench 6.0 CE, works out f the box [21:55:47] hedonil, okay.... [21:56:34] Cyberpower678: come on, make it work [21:56:54] Well, I don't know what's wrong. [21:58:03] Cyberpower678: what do you enter in the first password field? [21:58:46] SSH Password? [21:58:55] or SQL Password? [21:58:55] Cyberpower678: yes [21:59:03] Nothing [21:59:24] Cyberpower678: do you have a password/passphrase on your key? [21:59:29] Yes. [21:59:41] Cyberpower678: so you have to enter it there [22:00:29] Still no good. [22:01:10] Cyberpower678: log say the same? cleared all passwords before? [22:02:35] Yes and yas [22:02:48] Cyberpower678: hmmm [22:04:03] hedonil, any more ideas? [22:04:30] Cyberpower678: the key itself? Firewall? [22:05:00] The key is fine. [22:05:13] It's working with my FTP client I use. [22:06:08] Cyberpower678: MS Security Center? Firewall? Did you try to disable that? [22:08:03] No; Firewall has been granting full access to the web; no need to disable. [22:18:35] Cyberpower678: just to be sure. try create a whole new connection. only specify SSH hostname, SSH username and SSH key file, nothing else (esp no passwords) - then hit test connection. [22:21:09] Doing [22:22:28] Same error [22:22:33] Cyberpower678: ok [22:22:52] next insert enwiki.labsdb in mysql hostname [22:22:57] hedonil, can't you scramble through the internet and materialize on my end? [22:23:16] done [22:23:17] Cyberpower678: is not yet invented [22:23:29] Cyberpower678: now test connection agagin [22:23:43] * Cyberpower678 's goal for the future is to invent the hover car. [22:23:43] Cyberpower678: dialog should pop up [22:23:57] same error [22:25:40] hedonil, ^ [22:25:50] Cyberpower678: trying something [22:26:48] Cyberpower678: just found out, that clearing the ssh password from only one profile doesn't really clear it [22:30:43] ok [22:34:57] hedonil, how can I look at files from the terminal? [22:35:10] I keep forgetting the stupid command. [22:35:23] Cyberpower678: which files [22:35:33] replica.my.cnf [22:35:37] Cyberpower678: cat [22:36:04] Cyberpower678: or ls -l for just listing [22:36:54] Stupid program won't connect [22:42:58] hedonil, I can't figure it out. Microsoft as usual creates a program that just doesn't work. [22:45:07] Cyberpower678: I'm out of ideas. Your log says /exception/, not denied or refused. So if the path to key is ok, the passphrase matches the key and no firewall is blocking the ports - ??? [22:45:39] An issue with the way labs communicates with Workbench. [22:45:41] ? [22:46:10] Cyberpower678: I don't think so, because my out-of-the box setup worked [22:46:34] Does your PPK h need a passkey to unlock? [22:47:06] Cyberpower678: yes [22:47:35] * Cyberpower678 whines and sobs. [22:47:41] Cyberpower678: Mysql WB tries to establish an initial connection to 127.0.0.1 - maybe the error is located there [22:48:33] Cyberpower678: this is localhost and may be blocked by something or listens to the wrong port [22:50:04] Cyberpower678: maybe the version? do you use 6.0 CE? [22:50:25] 5.3 [22:50:27] Ugh [22:50:33] I'm way out of date [22:50:39] Cyberpower678: give it a try [22:50:59] Installing [22:52:05] Done [22:52:16] Getting another test ready [22:54:22] ... [22:54:31] It's froen [22:54:37] -.- [22:56:04] hedonil, no good [22:56:20] Cyberpower678: sad, sad [22:57:40] Cyberpower678: turn off and on again? ;) ;) [22:57:59] WHYWHYWHYWHYWHYWHYWHYWHYWHYWHYWHYWHYWHYWHYWHYWHYWHYWHYWHYWHYWHYWHY WHHHHHHHHHHHHHHHHHHHHHHHHHHHHYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYY [22:58:13] * Cyberpower678 hates Microsoft [22:59:27] * Cyberpower678 pulls hedonil through the internet. [22:59:35] Cyberpower678: for sure a bittiness in the dark, some bit not willing to move [23:06:06] Cyberpower678: there was hack mentioned earlier. 1) shut down MySQL WB. 2) make ssh-connection to labs with putty /as administrator/ 3) start MySQL WB again, maybe it uses the established connection [23:06:46] * Cyberpower678 downloads putty [23:11:06] hedonil, nope [23:11:21] Cyberpower678: darn [23:13:22] MYSQL WB: Why do you hate me so much? [23:16:39] Does anybody know how to get the stupid Workbench to work? [23:20:22] theopolisme, hedonil and I have been trying to figure this out. I can't seem to get MySQL workbench working with labs. [23:21:26] What's it doing? [23:21:35] (I assume https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help#Configuring_MySQL_Workbench wasn't helpful :p ) [23:22:07] It wasn't. :( [23:22:19] It's not connecting. [23:23:43] theopolisme, Authentication error. Please check that your username and password are correct and try again. Details (Original exception message): Bad authentication type (allowed_types=['publickey', 'hostbased']) [23:23:58] I've never used MySQL workbench or anything like that actually... *i use paper and pencil* :D [23:24:21] You connect to labs with paper and pencil? [23:24:26] :p [23:25:15] Cyberpower678: another idea? what program did you generate your key with? [23:25:32] I don't remember. [23:25:44] PuttyGen probably. [23:26:59] * hedonil asking the webs [23:27:05] putty [23:31:27] hedonil, what about it? [23:31:42] Cyberpower678: trying something [23:31:48] ok [23:32:02] * Cyberpower678 goes to sleep. [23:32:37] theopolisme, are you good with PHP? [23:33:41] Cyberpower678: sorta. I've done stuff for mediawiki core and various extensions, yeah [23:33:47] by no means an expert [23:34:12] I'm looking for additional potential maintainers for xtools. [23:34:33] The code is located at cyberpower678/xtools on GitHub. [23:35:05] Cyberpower678: getting closer [23:35:29] hedonil, Yes, I can slowly feel your presence. :p [23:35:39] theopolisme, ^^^ [23:35:43] Cyberpower678: gernerated a rsa-key with putty - bad authentication [23:36:07] so WB can't use Putty generated keys? [23:36:11] Cyberpower678, i'm not really in a position to add new projects to my plate, sadly [23:36:33] Although a long-term goal of mine has been a ui rewrite for xtools [23:36:39] I think i actually started soemthing sometime [23:36:44] theopolisme, it's actually minor things for the time, simple bug fixes, whenever you find some. [23:37:13] theopolisme, you and I have the same goals. [23:37:21] Heh [23:37:34] We could work togethor. [23:37:44] provided you become a maintainer. [23:37:44] Cyberpower678: wohooo [23:37:53] hedonil, ? [23:38:13] Cyberpower678: it's the key - I assume [23:38:19] Cyberpower678: http://www.chiark.greenend.org.uk/~sgtatham/putty/download.html [23:38:22] Great. -.- [23:38:31] Cyberpower678: download Pageant [23:38:41] So I have to reconfigure all of my connections? [23:38:47] Cyberpower678: no [23:39:08] Cyberpower678: download Pageant.exe - an agent for private kyes [23:39:31] Cyberpower678: start it [23:39:32] all I'm getting are bars and pubs. [23:39:57] Now I'm getting PuTTy again [23:40:03] Cyberpower678: http://the.earth.li/~sgtatham/putty/latest/x86/pageant.exe [23:40:22] * Cyberpower678 is tired. [23:40:31] Cyberpower678: try this [23:40:39] Cyberpower678: last attempt [23:41:32] Won't start [23:41:39] Urgh. [23:41:44] Cyberpower678: start pageant.exe ( a putty feature), it shows up in task bar [23:42:08] Cyberpower678: just an icon in task bar [23:42:34] Cyberpower678: got it? [23:42:49] yes [23:43:05] Cyberpower678: enter your putty key [23:43:35] done [23:43:49] Cyberpower678: when key is loaded start Mysql WB [23:44:27] Opened [23:44:57] Cyberpower678: ? [23:45:09] I opened the program [23:46:31] hedonil, ^ [23:46:42] Cyberpower678: what? [23:46:51] I opened WB [23:47:04] Cyberpower678: and ...? [23:47:10] Now what? [23:47:29] Cyberpower678: it worked, didn't it? [23:48:22] hedonil, Authentication erro, unhandled exception caught in tunnel manager, please refer to logs for details [23:49:00] Cyberpower678: did you enter database & stuff as normal? [23:50:48] hedonil, yep. At least it's a different error. [23:55:12] Cyberpower678: well, let's proceed if you are fresh & rested again.