[01:16:19] 6Labs, 10Labs-Infrastructure, 10wikitech.wikimedia.org: Update Semantic Forms - https://phabricator.wikimedia.org/T63104#1727178 (10Yaron_Koren) @Aklapper - Semantic Forms was not removed, you can see it here: https://wikitech.wikimedia.org/wiki/Special:Version [01:17:49] 6Labs, 10Labs-Infrastructure, 10wikitech.wikimedia.org: Update Semantic Forms - https://phabricator.wikimedia.org/T63104#1727179 (10Yaron_Koren) I also don't think the name change for this bug is correct - SF is at its latest version, 3.4. Unless that was just done. [05:07:50] 6Labs, 10Labs-Infrastructure, 6operations, 5Patch-For-Review: acct (process and login accounting) fill up instances /var/ partition - https://phabricator.wikimedia.org/T71604#1727302 (10bd808) /var is still filling up on deployment-bastion on a fairly regular basis because of these logs with the current re... [06:50:22] PROBLEM - Puppet failure on tools-exec-cyberbot is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [07:30:24] RECOVERY - Puppet failure on tools-exec-cyberbot is OK: OK: Less than 1.00% above the threshold [0.0] [11:52:47] PROBLEM - Puppet failure on tools-webgrid-lighttpd-1410 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [12:27:46] RECOVERY - Puppet failure on tools-webgrid-lighttpd-1410 is OK: OK: Less than 1.00% above the threshold [0.0] [12:56:33] 6Labs: Two small instances: for WikiToLearn development - https://phabricator.wikimedia.org/T115282#1727969 (10yuvipanda) Why do you need a public IP? If you want to expose http webserver to the web you can set it up already with 'manage proxies' on the left hand sidebar in wikitech. [13:21:20] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Chrisbo86 was created, changed by Chrisbo86 link https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Chrisbo86 edit summary: Created page with "{{Tools Access Request |Justification=I want to use the zoomviewer for a big panoramapicture fo our local page and wikipedia |Completed=false |User Name=Chrisbo86 }}" [14:15:52] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Chrisbo86 was modified, changed by Tim Landscheidt link https://wikitech.wikimedia.org/w/index.php?diff=193263 edit summary: [15:47:45] 6Labs: Two small instances: for WikiToLearn development - https://phabricator.wikimedia.org/T115282#1728353 (10CristianCantoro) Hi yuvipanda, the devs (User:Ruphy and User:Toma.luca95) told me that they "need a public IP to test the interaction with cloudflare [which they use on the production server that are c... [15:49:22] 6Labs, 10MediaWiki-Vagrant, 5Patch-For-Review: MediaWiki-Vagrant fails due to dpkg post-installation script of hhvm - https://phabricator.wikimedia.org/T115450#1728355 (10bd808) 5Open>3Resolved [16:13:33] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Storkk was created, changed by Storkk link https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Storkk edit summary: Created page with "{{Tools Access Request |Justification=various commons-related projects |Completed=false |User Name=Storkk }}" [17:40:02] hi - does anyone here have advice about an open alternative to DropBox, for a project ? [17:40:52] Owncloud was just mentioned elsewhere -- I have no context on this.... [18:02:26] Hi, I'm having a crack at running some python in Tool Labs but I'm having difficulties making it work. It needs python3 and I'm running it from a virtualenv which uses python3. I am using a shell script to source the virtualenv and then run the python code; this runs fine from my ssh session but when I try to run it on the grid it errors with [18:02:26] "/data/project/tarrow-dev/env/bin/python3: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.17' not found (required by /data/project/tarrow-dev/env/bin/python3)" I'm sure people have probably hit this before but I couldn't find a solution on google. Any ideas? [18:03:36] tarrow: add -m release=trusty to the qsub invocation [18:03:47] ah, thanks! [18:04:12] otherwise it runs on a precise host, which has an older libc, which means python3.4 doesn't run [18:06:52] Perfect; off it goes! I was using jsub which takes -l rather than -m but it seems to work. Cheers! [18:08:29] sorry, it's -l indeed! [18:15:24] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Storkk was modified, changed by Tim Landscheidt link https://wikitech.wikimedia.org/w/index.php?diff=193294 edit summary: [18:47:33] What is Wikimedia Labs? [18:48:12] NewComputerGeek: a virtualized hosting environment for wikimedia-related development [18:48:21] https://wikitech.wikimedia.org/wiki/Help:FAQ [18:48:38] Thanks! Bye [20:21:28] How much should my jobs stall in the grid? Even though they are marked as r by qstat the cpu time seems to be substantially less than the time they've been running. I realise this is sort of the point but also it seems much slower than I expected. For example I have a job that has been running and marked as r for 10m but has only had 6s of execution time and [20:21:28] doesn't show any sign of advancing. Furthermore, if I qdel and restart the job is seems to stick at the same point (s). If I just run the job in my ssh session and immediately ctrl-c it then it proceeds much further than it gets in the grid in many minutes. [20:25:11] tarrow, have you checked the output in "jobname.out" and "jobname.err" in your tools home directory? [20:27:06] yeah, I have no errors and the .out shows it advancing at this very slow pace [20:27:10] or rather, not slow [20:27:25] but it basically has two rushes of processing time [20:27:47] and then seems to stop completely but without error [20:29:26] This is pretty much the first job I've submitted so I might be doing something silly. Not sure what though. [20:29:33] 10Tool-Labs-tools-Other: Create an authoritative and well promoted catalog of Wikimedia tools - https://phabricator.wikimedia.org/T115650#1729232 (10Ricordisamoa) 3NEW [20:29:55] 10Tool-Labs-tools-Other, 6Developer-Relations: Create an authoritative and well promoted catalog of Wikimedia tools - https://phabricator.wikimedia.org/T115650#1729240 (10Ricordisamoa) [20:30:12] have you allocated aditional memory, regarding to https://wikitech.wikimedia.org/wiki/Help:Tool_Labs/Grid#Allocating_additional_memory [20:31:14] if there's a lack of memory, the job should crash, not hang. Which job is this? [20:31:21] Yep; I have. I did find initially I was hitting the limit but it acted as though I sent it SIGINT [20:31:51] yeah, if you use too much memory, you first get SIGINT then after a while (10s or so) SIGKILL [20:32:43] tarrow: which user/tool and which job? [20:33:00] tarrow-dev and 591027 [20:33:50] 10Tool-Labs-tools-Other, 6Community-Tech: How can we improve Magnus' tools? - https://phabricator.wikimedia.org/T115537#1729247 (10Ricordisamoa) [20:34:31] I'm trying to run some analytics that I didn't write. Just wanted to have a go. It might be the code that is a problem but I think that since it runs successfully just in the shell it is probably something I'm missing in running it on the grid. [20:34:46] tarrow: so you're running two times /data/project/tarrow-dev/env/bin/python3 /data/project/tarrow-dev/env/bin/mwcites extract /public/dumps/public/enwiki/20150901/enwiki-20150901-pages-meta-current.xml.bz2. Lemme check what they are doing [20:35:18] ah, it should only be running once [20:35:30] it might be doing multiprocessing stuff? [20:35:48] ah, it might well be [20:36:01] in which case do I need to force it to run sequentially? [20:36:08] not sure. The first is stuck in wait4(6604 (6604 is the pid of the second job) [20:36:19] the second one in futex(0x2b252e271000, FUTEX_WAIT, 0, NULL) [20:37:41] I'm not sure what that means... [20:37:51] tarrow: eh, also, there's error output in /data/project/tarrow-dev/runscript2.err [20:38:38] yeah, its from where I last ran the job and killed it with qdel [20:39:07] because it got stuck at, in term of the line it outputted, the same point [20:40:40] tarrow: from what that error log looks like, the code initially crashes because it doesn't handle unicode correctly, then hangs in waiting for a child process to return, which it never does [20:40:40] Thank you very much for taking a look! I've not had much success trying to google my problem... [20:41:33] so the code just 'print's unicode, which /sometimes/ works, but not always. You could try setting PYTHONIOENCODING=utf-8 in your bash script [20:41:48] (03PS4) 10Ricordisamoa: Added a Wikidata-based "chart of the nuclides" under /nuclides [labs/tools/ptable] - 10https://gerrit.wikimedia.org/r/245591 (owner: 10ArthurPSmith) [20:42:28] 10Tool-Labs-tools-Other, 6Developer-Relations: Create an authoritative and well promoted catalog of Wikimedia tools - https://phabricator.wikimedia.org/T115650#1729273 (10Tgr) Are we talking about Tool Labs tools specifically, or anything that can be considered a tool (gadgets, desktop applications etc)? [20:42:28] valhallasw`cloud: I think the .err is not from this run. The timestamp is from when I killed the last time it ran. I assume it just didn't exit cleanly [20:44:35] (03CR) 10Ricordisamoa: "PS4 only has clearer copyright headers and shorter summary; will do the cleanup soon." [labs/tools/ptable] - 10https://gerrit.wikimedia.org/r/245591 (owner: 10ArthurPSmith) [20:48:00] tarrow: I'm not entirely convinced it's not the same issue again, because it's stuck in that wait4() [20:48:05] also, the .err is empty now? [20:48:28] Yeah, I've killed the job and added in the env var [20:48:51] ah, ok :-) [20:48:55] and cleaned up all the old output [20:49:26] and fingers crossed the execution time has got a lot longer! [20:50:27] although oddly it didn't seem to write any errors until I killed the job each time. I just assumed it was me killing it that caused them [20:51:18] I think it's because the error handler was essentially overruled to wait for the other process to return, so it couldn't print the error until either that happened or it received SIGINT [20:51:44] valhallasw`cloud: In any case; adding that has made it work. At least for now! [20:52:02] Thanks again! [20:52:30] you're welcome [20:58:58] (03PS5) 10Ricordisamoa: Added a Wikidata-based "chart of the nuclides" under /nuclides [labs/tools/ptable] - 10https://gerrit.wikimedia.org/r/245591 (owner: 10ArthurPSmith) [20:59:11] 6Labs, 10Tool-Labs: jsub and utf8 - https://phabricator.wikimedia.org/T60784#1729354 (10valhallasw) 5declined>3Open Reopening this. A simple example is the following: ``` valhallasw@tools-bastion-01:~$ cat unitest.py #!/usr/bin/env python3 print('\u1234') ``` ``` valhallasw@tools-bastion-01:~$ jsub -l r... [21:01:07] 10Tool-Labs-tools-Other, 6Developer-Relations: Create an authoritative and well promoted catalog of Wikimedia tools - https://phabricator.wikimedia.org/T115650#1729365 (10Quiddity) [21:01:23] 10Tool-Labs-tools-Other, 6Developer-Relations: Create an authoritative and well promoted catalog of Wikimedia tools - https://phabricator.wikimedia.org/T115650#1729369 (10Ricordisamoa) >>! In T115650#1729273, @Tgr wrote: > Are we talking about Tool Labs tools specifically No. > or anything that can be consid... [21:03:00] not that bug again :|| [21:07:14] 10Tool-Labs-tools-Other, 6Developer-Relations: Create an authoritative and well promoted catalog of Wikimedia tools - https://phabricator.wikimedia.org/T115650#1729392 (10Quiddity) >>! In T115650#1729273, @Tgr wrote: > Are we talking about Tool Labs tools specifically, or anything that can be considered a tool... [21:09:16] 10Tool-Labs-tools-Other, 6Developer-Relations: Create an authoritative and well promoted catalog of Wikimedia tools - https://phabricator.wikimedia.org/T115650#1729412 (10Ricordisamoa) https://tools.wmflabs.org/ uses the toolinfo.json 'standard', but doesn't work for tools that serve it from other directories... [21:23:50] (03PS6) 10Ricordisamoa: Added a Wikidata-based "chart of the nuclides" under /nuclides [labs/tools/ptable] - 10https://gerrit.wikimedia.org/r/245591 (owner: 10ArthurPSmith) [21:38:40] (03PS7) 10Ricordisamoa: Added a Wikidata-based "chart of the nuclides" under /nuclides [labs/tools/ptable] - 10https://gerrit.wikimedia.org/r/245591 (owner: 10ArthurPSmith) [22:02:52] (03PS8) 10Ricordisamoa: Added a Wikidata-based "chart of the nuclides" under /nuclides [labs/tools/ptable] - 10https://gerrit.wikimedia.org/r/245591 (owner: 10ArthurPSmith) [22:21:58] (03CR) 10Ricordisamoa: [C: 04-1] "* Cleanup in progress" [labs/tools/ptable] - 10https://gerrit.wikimedia.org/r/245591 (owner: 10ArthurPSmith)