Fork me on GitHub

Wikimedia IRC logs browser - #wikimedia-tech

Filter:
Start date
End date

Displaying 131 items:

2018-08-29 14:00:08 <wm-bot> Technical Advice IRC meeting starting in 60 minutes in channel #wikimedia-tech, hosts: - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting
2018-08-29 14:50:06 <wm-bot> Technical Advice IRC meeting starting in 10 minutes in channel #wikimedia-tech, hosts: @tgr & @Tonina_WMDE - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting
2018-08-29 15:00:43 <Tonina_WMDE> Hey everyone \o Me and @tgr are here to answer your questions in this week's Technical Advice IRC Meeting
2018-08-29 15:01:00 <tgr> hi all!
2018-08-29 15:01:49 <ato_01> Hi there!
2018-08-29 15:03:21 <ato_01> Is it possible to ask a question with toolforge too?
2018-08-29 15:03:54 <ato_01> I mean running bots and processes.
2018-08-29 15:04:15 <Tonina_WMDE> ato_01: all questions are welcome
2018-08-29 15:04:16 <tgr> ato_01: anything is possible! the worst that can happen is that we can't answer
2018-08-29 15:04:30 <ato_01> Super.
2018-08-29 15:06:07 <ato_01> In the near past I could run python scripts through shell scripts through php post,
2018-08-29 15:06:26 <andre__> o/
2018-08-29 15:06:47 <ato_01> And now I can only let run shell scripts to delete my logs
2018-08-29 15:07:16 <ato_01> I do not receive any error
2018-08-29 15:08:13 <ato_01> but my post request does not work. Do you know, why?
2018-08-29 15:08:44 <d3r1ck> o/
2018-08-29 15:08:57 <tgr> ato_01: so you are saying you have a PHP web application, you send a POST request to it, and the application executes a Python script via a shell command? And that has stopped working recently?
2018-08-29 15:09:18 <ato_01> yes, exactly
2018-08-29 15:09:58 <tgr> do you have logging in the PHP code? such as return status from shell_exec or whatever you use?
2018-08-29 15:10:35 <Tonina_WMDE> ato_01: can you paste the post request you send
2018-08-29 15:10:39 <ato_01> No, I can not log in php.
2018-08-29 15:10:58 <ato_01> All I can do, only send a post request
2018-08-29 15:11:17 <ato_01> maybe you can help in it
2018-08-29 15:11:39 <ato_01> just a sec
2018-08-29 15:11:50 <tgr> cannot meaning that the application has logging code but it does not actually write anything to the logs? or that you are not sure how to set it up?
2018-08-29 15:14:59 <tgr> in the meantime, if anyone else has questions, feel free to ask, IRC works well for multiple parallel discussions
2018-08-29 15:15:19 <ato_01> I just sent a post request, like this
2018-08-29 15:15:24 <ato_01> <form action="./test-1.php"> <input type="submit" value="Force"> </form>
2018-08-29 15:15:47 <ato_01> It has run a shell script
2018-08-29 15:17:13 <ato_01> which started a jsub command with a python script, which has a -o (log output) parameter
2018-08-29 15:18:11 <ato_01> and it was working befor this year for sure
2018-08-29 15:18:44 <Tonina_WMDE> ato_01: ok so what is the expected result in the end? logs being deleted?
2018-08-29 15:18:50 <ato_01> now all I can do with a shell script is to clear all my log files
2018-08-29 15:19:45 <ato_01> I still would like to let run or stop in case of emergency
2018-08-29 15:20:13 <ato_01> through web browser, without putty
2018-08-29 15:20:48 <Tonina_WMDE> ato_01: can you somehow show us the contents of test-1.php
2018-08-29 15:21:10 <ato_01> <?PHP shell_exec("./scripts/test-1.sh"); header('Location: https://tools.wmflabs.org/ato/index-secret.html?success=true';); ?>
2018-08-29 15:22:04 <ato_01> And it is almost the same where I clear my log files.
2018-08-29 15:28:45 <Tonina_WMDE> ato_01: but clearing the log files works, right? The problem is in the python script or more precisely that it's not executed?
2018-08-29 15:29:02 <ato_01> clearing still works
2018-08-29 15:30:12 <ato_01> only python scripts (or jsub commands) what I can not any more
2018-08-29 15:30:37 <Tonina_WMDE> hmmm
2018-08-29 15:31:05 <ato_01> clearing is not more. Only the following:
2018-08-29 15:31:16 <ato_01> #!/bin/bash echo "" > /data/project/ato/public_html/log/test-1.txt
2018-08-29 15:32:30 <tgr> ato_01: probably the first step is to check the job grid error logs
2018-08-29 15:33:18 <ato_01> yes, but I can not find anithing like this
2018-08-29 15:33:32 <tgr> probably with qstat, I'm not really familiar with the grid system though
2018-08-29 15:34:17 <tgr> so maybe its better to hop over to #wikimedia-cloud and ask there
2018-08-29 15:34:52 <ato_01> ok
2018-08-29 15:34:58 <ato_01> I will do that
2018-08-29 15:36:05 <ato_01> I am just seeing my error.log
2018-08-29 15:36:11 <ato_01> ./scripts/test-1.sh: line 2: jsub: command not found
2018-08-29 15:36:47 <ato_01> But the same shell script through putty works
2018-08-29 15:38:14 <tgr> the web app might be using a different user or different shell
2018-08-29 15:38:37 <tgr> you can try using the full path to jsub
2018-08-29 15:39:07 <ato_01> do you know the full path of it?
2018-08-29 15:40:41 <tgr> /usr/bin/jsub
2018-08-29 15:41:08 <ato_01> Thank you! I will try it
2018-08-29 15:45:20 <Tonina_WMDE> anyone else? :)
2018-08-29 15:45:56 <tgr> ato_01: triggering pywikibot jobs from a web interface seems like a common enough use case so it might be worth asking about that on the Cloud IRC or mailing list, they might suggest best practices or sample code
2018-08-29 15:46:03 <ato_01> ./scripts/test-1.sh: line 2: /usr/bin/jsub: No such file or directory
2018-08-29 15:46:35 <tgr> for example, sending the output of jsub to devnull might also set you up for trouble in the long run
2018-08-29 15:47:56 <tgr> maybe the web user has limited access?
2018-08-29 15:49:15 <tgr> if the task is not time-sensitive you could rearrange it so that the PHP script just pushes into some simple queue (a DB or text file) and a periodically scheduled grid job takes the tasks from there
2018-08-29 15:49:48 <tgr> but I'm just guessing, you should ask people more familiar with toolforge
2018-08-29 15:52:24 <ato_01> It should be some security update in the near past. I will ask somebody on the toolforge channel. Thank you anyway!
2018-08-29 15:59:53 <tgr> sorry we couldn't be of more help
2018-08-29 16:00:04 <Tonina_WMDE> :/
2018-08-29 16:00:34 <ato_01> no problem. you tried it. :)
2018-08-29 16:00:44 <ato_01> have a nice evening!
2018-08-29 16:04:42 <tgr> this concludes the tech advice hour, there will be one the same time next week
2018-08-29 16:05:57 <tgr> also since next Wednesday is first of the month, there will be an Americas-friendly second meeting at 11 PM UTC
2018-08-29 16:06:11 <tgr> o/
2018-08-29 16:56:18 <[1997kB]> Hello, why there's no join date on these user pages https://en.m.wikipedia.org/w/index.php?title=User:Shoy https://meta.m.wikimedia.org/wiki/User:FloNight in mobile view like this one https://en.m.wikipedia.org/wiki/User:1997kB below username?
2018-08-29 16:59:03 <Krenair> MariaDB [enwiki_p]> select user_name, user_registration from user where user_name in ('Shoy', 'FloNight', '1997kB');
2018-08-29 16:59:03 <Krenair> +-----------+-------------------+
2018-08-29 16:59:04 <Krenair> | user_name | user_registration |
2018-08-29 16:59:04 <Krenair> +-----------+-------------------+
2018-08-29 16:59:04 <Krenair> | 1997kB | 20170802154554 |
2018-08-29 16:59:05 <Krenair> | FloNight | 20051011002941 |
2018-08-29 16:59:07 <Krenair> | Shoy | NULL |
2018-08-29 16:59:09 <Krenair> +-----------+-------------------+
2018-08-29 16:59:11 <Krenair> 3 rows in set (0.00 sec)
2018-08-29 17:00:17 <Krenair> oh, FloNight's link is metawiki, not enwiki
2018-08-29 17:00:41 <Krenair> MariaDB [metawiki_p]> select user_registration from user where user_name = 'FloNight';
2018-08-29 17:00:42 <Krenair> +-------------------+
2018-08-29 17:00:42 <Krenair> | user_registration |
2018-08-29 17:00:42 <Krenair> +-------------------+
2018-08-29 17:00:46 <Krenair> | NULL |
2018-08-29 17:00:48 <Krenair> +-------------------+
2018-08-29 17:00:50 <Krenair> 1 row in set (0.00 sec)
2018-08-29 17:00:57 <Krenair> [1997kB], yeah basically if there is no user_registration timestamp it won't show that line
2018-08-29 17:01:07 <[1997kB]> and why is that?
2018-08-29 17:01:17 <Krenair> why might user_registration be NULL?
2018-08-29 17:01:28 <Krenair> Well the field hasn't always existed
2018-08-29 17:02:49 <[1997kB]> oh so when these accounts were created there was no user registration field?
2018-08-29 17:02:51 <Krenair> it was added in MW 1.6
2018-08-29 17:02:54 <Krenair> yeah
2018-08-29 17:03:00 <Krenair> the docs for that table literally say
2018-08-29 17:03:05 <Krenair> "For old users, they may have a value of NULL for this field."
2018-08-29 17:03:24 <[1997kB]> but it doesn't happen with old users?
2018-08-29 17:03:29 <[1997kB]> all old*
2018-08-29 17:03:31 <Krenair> https://www.mediawiki.org/wiki/Manual:User_table#user_registration
2018-08-29 17:03:42 <Krenair> [1997kB], some are older than others
2018-08-29 17:07:48 <[1997kB]> aha. got it.. Thanks Krenair :)
2018-08-29 17:10:51 <Krenair> http://mediawiki.org/wiki/Special:Code/MediaWiki/12207
2018-08-29 17:13:31 <Krenair> [1997kB], actually enwiki does appear to have had some back-filled
2018-08-29 17:13:38 <Krenair> MariaDB [enwiki_p]> select min(user_registration) from user;
2018-08-29 17:13:39 <Krenair> +------------------------+
2018-08-29 17:13:39 <Krenair> | min(user_registration) |
2018-08-29 17:13:39 <Krenair> +------------------------+
2018-08-29 17:13:39 <Krenair> | 20010121021221 |
2018-08-29 17:13:40 <Krenair> +------------------------+
2018-08-29 17:13:41 <Krenair> 1 row in set (51.06 sec)
2018-08-29 17:13:48 <Krenair> just not all
2018-08-29 17:13:51 <Krenair> shrugs
2018-08-29 17:14:44 <Krenair> Bugzilla was a thing by this point so you may be able to find a ticket for it
2018-08-29 18:02:11 <legoktm> [1997kB]: enwp had user_registration backfilled, but I don't think any other wiki had
2018-08-29 18:08:11 <[1997kB]> legoktm: but it still doesn't show in some enwiki accounts, one is above.
2018-08-29 18:09:23 <James_F> The back-fill was just a lie, right? We put in the date of first edit.
2018-08-29 18:09:36 <James_F> has vague memories.
2018-08-29 18:10:51 <legoktm> correct
2018-08-29 19:17:17 <Krenair> James_F, legoktm: so maybe it missed those who registered before registration started getting recorded but had not edited before the backfill?
2018-08-29 19:18:10 <James_F> Yeah, and accounts registered in ~2003 which were never used to edit are still `null`.
2018-08-29 19:18:38 <James_F> Also the script whoever wrote might have died due to a hiccough.
2018-08-29 19:24:36 <Krenair> James_F, hm?
2018-08-29 19:24:40 <Krenair> the script whoever wrote?
2018-08-29 19:24:53 <Krenair> I think Tim Starling wrote the backfill script
2018-08-29 19:25:17 <James_F> OK.
2018-08-29 19:57:46 <legoktm> there's a task somewhere about running it for the rest of the wikis
2018-08-29 19:58:08 <legoktm> I remember looking into this during SULF

This page is generated from SQL logs, you can also download static txt files from here