[00:04:56] 3Tool-Labs-tools-Other: [tracking] toolserver.org tools that have not been migrated - https://phabricator.wikimedia.org/T60865#795738 (10TTO) [00:04:58] 3Tool-Labs-tools-Other: Migrate to Tool Labs: https://toolserver.org/~vvv/adminstats.php - https://phabricator.wikimedia.org/T63030#795735 (10TTO) 5Open>3Resolved a:3TTO There is currently a redirect in place from [[//toolserver.org/~vvv/adminstats.php]] to [[//tools.wmflabs.org/xtools/adminstats]], which... [00:08:14] 3Tool-Labs-tools-Other: Migrate http://toolserver.org/~Emijrp to Tool Labs - https://phabricator.wikimedia.org/T62887#795741 (10TTO) Is this complete, or were there any other tools to migrate? I note that http://toolserver.org/~Emijrp/ gives a blank directory index... [00:12:53] 3Tool-Labs-tools-Other: Migrate http://toolserver.org/~slakr/* to Tool Labs - https://phabricator.wikimedia.org/T60887#795743 (10Liuxinyu970226) [00:17:04] 3Tool-Labs-tools-Other: Migrate http://toolserver.org/~purodha/sample/dbswithuser.php to Tool Labs - https://phabricator.wikimedia.org/T63028#795747 (10TTO) Asked Purodha: https://en.wikipedia.org/wiki/User_talk:Purodha#Toolserver_2 [00:18:56] 3Tool-Labs-tools-Other: Move catbot from toolserver to toollabs - https://phabricator.wikimedia.org/T63825#795754 (10TTO) [01:22:28] 3Tool-Labs-tools-Database-Queries: DBQ-196 one side categories on en.wiki - https://phabricator.wikimedia.org/T61479#795771 (10Dalba) [04:03:34] Any tools lab admins on? [04:09:53] YuviPanda: Ping [06:36:14] Any tools project admins on? [07:15:45] (03PS1) 10Legoktm: Use git clean -ffd to reset repos after switching branches [labs/tools/extdist] - 10https://gerrit.wikimedia.org/r/176632 [07:15:47] (03PS1) 10Legoktm: Bundle composer-specified dependencies in tarballs [labs/tools/extdist] - 10https://gerrit.wikimedia.org/r/176633 [07:18:13] (03CR) 10Legoktm: "This needs Ibb5b6c8649d747e42ee9fb4f9aeaec269500a66c in operations/puppet first." [labs/tools/extdist] - 10https://gerrit.wikimedia.org/r/176633 (owner: 10Legoktm) [07:18:29] (03CR) 10Legoktm: [C: 032] Use git clean -ffd to reset repos after switching branches [labs/tools/extdist] - 10https://gerrit.wikimedia.org/r/176632 (owner: 10Legoktm) [07:19:32] (03CR) 10Jeroen De Dauw: [C: 031] "Neat" [labs/tools/extdist] - 10https://gerrit.wikimedia.org/r/176633 (owner: 10Legoktm) [08:05:10] TParis: hey [08:05:24] I just woke up but wassup [08:39:13] There seems to be a problem with https://tiles.wmflabs.org/osm/. Maps are not displaying on Wikivoyage. [08:57:10] 3Tool-Labs-tools-Commons-Delinker: new version - https://phabricator.wikimedia.org/T70274#795947 (10Liuxinyu970226) [12:21:17] shinken-wm: hi? [13:26:21] Hi Coren, howdy!? What's the status of WMF's redirect webserver for toolserver.org? https://phabricator.wikimedia.org/T62238 [13:26:47] Silke_WMDE: I'm hoping to get to it this morning. [13:27:58] Coren: ok. Good old TS is not going to live for very much longer. I'll ping Manuel Schneider the moment I know you are ready. [14:31:49] !log tools.wikibugs killed irc bot for now [14:31:55] Logged the message, Master [15:08:14] PROBLEM - Free space - all mounts on tools-webproxy is CRITICAL: CRITICAL: tools.tools-webproxy.diskspace._var.byte_percentfree.value (<44.44%) [15:08:33] baaaah [15:08:37] stupid df [15:10:16] :o [15:11:01] petan: ? [15:11:10] what's wrong on df [15:11:18] <3 df [15:11:22] if a file is deleted but still has an open handle [15:11:30] that is not problem of df :P [15:11:31] it reports its full size as part of the filesystem as 'used' [15:11:41] well, because it technically is still used [15:11:52] not to that size. [15:11:59] if another program wants to use that space [15:12:00] it can [15:12:02] and it will [15:12:14] the space used by the hard link which points these data can't be used for any other data [15:12:18] no it can't [15:12:29] it does, because nginx is using it again :) [15:12:32] if it "can" it's a bug in fs driver [15:12:35] anyway, I'll just fix that soon. [15:12:41] it shouldn't be able to do that [15:17:54] YuviPanda: http://unix.stackexchange.com/questions/68523/find-and-remove-large-files-that-are-open-but-have-been-deleted [15:19:09] heh, in this case it's probably just an nginx issue [15:43:10] RECOVERY - Free space - all mounts on tools-webproxy is OK: OK: All targets OK [16:04:11] PROBLEM - Free space - all mounts on tools-webproxy is CRITICAL: CRITICAL: tools.tools-webproxy.diskspace._var.byte_percentfree.value (<66.67%) [16:15:06] YuviPanda: tools web server from within tools started throwing 403 [16:15:33] http://tools-webproxy [16:22:17] petan: did you set user agent? [17:25:41] PROBLEM - Puppet failure on tools-webproxy is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [17:29:09] PROBLEM - Free space - all mounts on tools-webproxy is CRITICAL: CRITICAL: tools.tools-webproxy.diskspace._var.byte_percentfree.value (<22.22%) [18:18:14] Betacommand: You'll probably be please to know that happy fun hardware has reached the DC. :-) [18:19:13] RECOVERY - Free space - all mounts on tools-webproxy is OK: OK: All targets OK [18:20:30] Coren: Good to hear, Doesnt make that big of a deal for me, Im just curious [18:35:21] Coren: are you intersted in working on vmbuilder/debian a bit? I've been plugging away since Thursday, ready for another pair of eyes. [18:35:26] (not urgent, obv.) [18:41:29] andrewbogott: I wouldn't mind it, this week, but my TODO has two higher priority thingies first (labstore2001 and the toolserver redirects) [18:41:47] Coren: ok. I'll set aside for now and bug you next week if i'm still stumped by then [18:42:02] The vmbuilder tools haven't been updated for Debian since 2009 so there's lots to do [18:42:43] Drop me an email with pointers to where you're at; I'm sure I'll have some time to take a look during the week. [18:42:49] ok [18:42:50] thanks [18:43:30] python-vmbuilder uses bzr so my changes are in limbo until I decide what to do about /that/ :( [19:40:41] how long does it usually take for new project request to be processed? https://wikitech.wikimedia.org/wiki/New_Project_Request/ttmserver [19:41:44] Nikerabbit: I think we all simultaneously forget to patrol that page, so nagging here is good. I'll try to review shortly [19:41:48] (In a meeting just now) [19:42:07] ok no hurry [19:42:19] andrewbogott: I think we should move that to phabricator. [19:42:32] andrewbogott: that and new package requests. mind if I set up a process? [19:42:33] Coren: ^ [19:42:39] Works for me [19:42:57] YuviPanda: Is sane. [19:43:11] cool, let me set something up and email labs-l [19:43:17] New package requests? Haven't they always been there [19:43:49] yeah [19:43:59] but only documented on mailing ists [19:44:00] *lists [19:44:16] Not true, it's documented on wiki. [19:44:29] oh? [19:44:32] well, that's good then :) [19:44:33] nevermind me [19:45:05] https://wikitech.wikimedia.org/wiki/Help:Tool_Labs#My_tool_requires_a_package_that_is_not_currently_installed_in_Tool_Labs._How_can_I_add_it.3F [19:45:25] Unless I mistunderstood what you're talking about [19:45:49] Ah, maybe you meant creation of deb packages not available in standard repos [19:49:17] YuviPanda: are you going to migrate the open project requests to phab as well? (I don't need you to, just wondering where to look in the short run) [19:49:32] andrewbogott: I think we should just clean that out in wikitech. [19:49:34] andrewbogott: https://phabricator.wikimedia.org/T76375 [19:49:40] yep, ok [19:50:04] andrewbogott: I can take care of that as well. [19:50:32] YuviPanda: that'd be great, thank you! [19:50:37] yw! [19:50:38] That means I can eat some lunch :) [19:50:41] andrewbogott: :D [19:56:37] andrewbogott: Coren https://phabricator.wikimedia.org/T76375 for requesting labs projects. [20:00:19] !log created project ttmserver, Nikerabbit as projectadmin [20:00:20] created is not a valid project. [20:00:31] !log ttmserver created project ttmserver, Nikerabbit as projectadmin [20:00:32] Logged the message, Master [20:02:30] thanks YuviPanda [20:02:41] Nikerabbit: yw! should be faster with phab [21:03:29] Coren: andrewbogott emailed! no more wikitech for project admin requests! I'll need to fix the sidebar tho [21:03:33] andrewbogott: do you remember how? [21:04:00] mediawiki:sidebar or something like that [21:04:15] ah [21:04:44] andrewbogott: can you grant me admin on wikitech? [21:04:50] normal mw admin, that is. not cloudadmin [21:05:20] yep, done [21:05:26] cool [21:28:23] !log mwoffliner created project with Kelson as projectadmin [21:28:24] Logged the message, Master [21:44:19] !log wikidata-quality created project with Tamslo as projectadmin [21:44:21] Logged the message, Master [21:47:41] YuviPanda: creative solution to the space :p [21:48:06] JohnFLewis: heh, inorite ;) [21:50:07] !log deployment-prep updated OCG to version a06e7c186796a6ee5d5af81e93688520abdf2596 [21:50:10] Logged the message, Master [22:05:42] (03CR) 10Legoktm: [C: 032] Bundle composer-specified dependencies in tarballs [labs/tools/extdist] - 10https://gerrit.wikimedia.org/r/176633 (owner: 10Legoktm) [22:06:44] andrewbogott: any luck on poking people about wikitech-test? [22:11:35] YuviPanda: no change as far as I know [22:11:53] andrewbogott: hmm, ok. I"ll poke _joe_ when he's back tomorrow. [22:44:18] @uptime [22:44:30] !ping [22:44:30] !pong [22:44:33] :o [22:49:52] andrewbogott: I can't alocate an IP for video project in labs [22:50:15] are you over quota? [22:50:45] matanya: if you need just HTTP(S) access, you can just use the proxy :) need IPs for video chat testing tho [22:50:45] maybe, what is quota? 1? [22:51:02] you can view the quota from wikitech. [22:51:04] But, I'll check [22:51:07] YuviPanda: dowloading 1.5 TB from prod [22:51:25] we want IP to scp files onto it from external [22:51:33] aaaah :) [22:51:44] they are on terbium [22:52:05] matanya: I raised your quota from 0 to 1 :) [22:52:07] * matanya wants to steal en.wiki from prod :D [22:52:11] dowloading via http from terbium doesnt work, because files are large [22:52:15] thanks andrewbogott [22:52:17] mutante: matanya would be interesting to write up on wikitech how this was accomplished later on :) 1.5T is a lot of data for labs storage. [22:52:38] YuviPanda: yea, we asked Coren if 1.5T is ok [22:52:43] 208.80.155.196 [22:52:57] mutante: yeah, but where's the data being allocated? NFS? [22:53:18] mutante: if it's NFS, wouldn't that be on the labs machines and you can copy it directly there? [22:53:19] YuviPanda: "avoid NFS for the copy. You should place it directly in /srv/project/tools/project/" [22:53:55] mutante: labs instances don't have more than 60GB there (or something like that) I think [22:54:00] mutante: I think he meant don't use NFS to *write* [22:54:16] matanya: how much space do you have on the instance? [22:54:16] or something along those lines. there's definitely no way to fit 1.5T in a labs instance /srv :) [22:54:32] /dev/vda1 9.3G 1.2G 7.7G 13% / [22:54:33] none 4.0K 0 4.0K 0% /sys/fs/cgroup [22:54:33] udev 7.9G 12K 7.9G 1% /dev [22:54:33] tmpfs 1.6G 400K 1.6G 1% /run [22:54:33] none 5.0M 0 5.0M 0% /run/lock [22:54:33] even with other intsance type? [22:54:34] none 7.9G 0 7.9G 0% /run/shm [22:54:35] none 100M 0 100M 0% /run/user [22:54:35] I mean /srv *on labstore* [22:54:37] /dev/mapper/vd-var 2.0G 310M 1.5G 17% /var [22:54:40] /dev/mapper/vd-log 2.0G 52M 1.8G 3% /var/log [22:54:41] labstore.svc.eqiad.wmnet:/keys 960M 43M 917M 5% /public/keys [22:54:44] labstore.svc.eqiad.wmnet:/scratch 7.3T 872G 6.4T 12% /data/scratch [22:54:46] labstore1003.eqiad.wmnet:/dumps 44T 9.9T 34T 23% /public/dumps [22:54:48] labstore.svc.eqiad.wmnet:/backups 20T 1.8T 19T 9% /public/backups [22:54:50] labstore.svc.eqiad.wmnet:/project/video/home 30T 25T 5.6T 82% /home [22:55:16] Sorry if I wasn't clear. [22:55:16] so you can apply the srv role on wikitech, and that should give you some more space, but not that much more [22:55:20] can i copy files from terbium in prod to labstore? [22:55:33] mutante: Labstore is in prod. [22:55:48] Specifically, you want labstore1001 [22:55:50] so no need for this IP [22:55:52] it also shouldn't go to /srv/project/tools/project tho. [22:56:00] should be whatever the name of project is, I think [22:56:18] Well, if it was to be accessible to tools (which I thought was the idea). Otherwise yeah, /srv/project/$whatever/project [22:56:31] it should be accesible to project "video" [22:56:31] not tools [22:56:48] yeah [22:58:45] wouldn't it be easier just to upload from youtube? [22:59:10] matanya: from youtube to labstore? [22:59:15] to commons [22:59:23] aha, probably :) [22:59:23] i have a python script for that [22:59:31] * Coren grumbles. [22:59:43] Yeah, so /srv/project/video/project on labstore1001 [22:59:46] the only question is if the quality is the same [23:00:34] ah, no. it seems to be a DASH video, i don't want that. i want the source [23:01:02] i am copying 1 file right now [23:01:25] thanks [23:02:10] Free Culture III - Heritage.mp4 0% 86MB 802.2KB/s 4:02:44 ETA [23:02:48] uhm.. you know what [23:03:04] from terbium to labstore? [23:03:05] why did we not have this harddisk connected to labstore instead of terbium [23:03:16] yea [23:03:26] 1% 175MB 1.1MB/s 2:58:01 ETA [23:03:31] hmm, I had forgotten ssh can be that slow. [23:03:44] rsync over ssh better than scp? [23:03:54] scp is also over ssh, no? [23:03:57] yes [23:04:08] so not going to be very different :) [23:04:12] mutante: Should be pretty much the same; you're paying most of that in overhead. [23:04:16] yeah, re-connecting to labstore might be needed. [23:04:24] or letting it copy forever :) [23:04:54] * matanya goes to sleep [23:05:02] anyone in DC today ? [23:05:08] matanya: :p i should run it in screen at least :p [23:05:15] good idea [23:05:43] oh yea, rsync better at resuming [23:05:49] and progress bar [23:17:41] matanya: mutante btw, there might be faster ways to get it on to commons than terbium -> labs -> commons :) ask Reedy_? [23:17:49] terbium -> commons should be possible. [23:18:06] um [23:18:08] yes it is [23:18:10] !screen [23:18:10] script /dev/null [23:18:27] matanya: we have a script to upload from terbium --> commons [23:18:49] but no one is doing it [23:19:06] and since i don't have access to terbium, i asked to move it to labs [23:19:41] oh [23:19:42] do what? [23:19:47] I can help out with uploads. [23:19:54] They're badly named [23:20:06] ://// [23:20:11] Some are too large for swift [23:20:11] And we don't take MP4 iirc? [23:20:47] we don't [23:20:52] it has to be converted to ogv [23:21:00] sigh [23:21:06] webm [23:21:12] that would also work [23:21:29] so i vulenteered to take on this [23:21:46] unless you want to give me terbium access :D [23:22:35] is there a bug for this? [23:23:04] legoktm: https://rt.wikimedia.org/Ticket/Display.html?id=8334 [23:23:17] ffmpeg/avconv isn't installed on terbium [23:23:51] even if it is, I don't think you should do encoding on terbium [23:24:07] well, you maybe could with nice and limits. [23:24:28] ugh [23:24:37] thanks for volunteering matanya :) [23:24:47] +1 matanya is awesome [23:25:05] :) [23:25:39] my video project already has all the encoding tools and i use it mainly for youtube transfers [23:25:55] so wikimania definitly will work there [23:26:37] there are .mp4 and .mov files [23:26:40] YuviPanda: since terbium is mw depoly host i don't think doing encoding there is a good idea [23:26:44] yeah [23:26:45] agree [23:27:07] it seems a bit random like "1" is mp4 "2" is mov.. and so on [23:27:13] awww man [23:27:17] that's going to be painful :( [23:27:32] all i tried was to resolve "how to get these files on labs" [23:27:46] so the conversion can run there [23:27:54] i did not even think yet about the commons upload [23:28:16] i just added on that ticket that personally i used fireogg for conversion [23:28:23] on my local computer [23:28:46] i have a script to encode and one to split [23:28:55] then pywikibot to upload [23:29:24] all in one python script. screen ./upload.py file [23:29:37] sleep, come after 3 days, the file is on commons [23:31:33] i wonder if there was a way to use hardware that produces the right format in the first place [23:31:48] we shipped video hardware from SF to London.. [23:31:54] then we shipped a harddisk to dc [23:32:05] now we copy between hosts :p [23:32:16] only to convert it to decent format [23:32:31] mutante: sadly, not much hardware produces the 'right' format out of the box. Hardware encoders for ogv/webm are very, very rare. [23:32:50] most hardware decoders put out h264, and almost all video equipment uses those. [23:33:07] not much or none though [23:33:17] new modules come with webm due to youtube [23:33:17] none, I think. [23:33:28] i see.. yea :p [23:33:28] not in hardware, I think. [23:47:50] 3Tool-Labs-tools-Other: Fatal error trying to see Commons contributions on tools.wmflabs.org/supercount - https://phabricator.wikimedia.org/T76335#799833 (10Aklapper) [23:53:49] 3Tool-Labs-tools-Other: Fatal error trying to see Commons contributions on tools.wmflabs.org/supercount - https://phabricator.wikimedia.org/T76335#799881 (10Cyberpower678) I really want to rip my hair out right now, but that would bald me even quicker. So instead, I have taken to banging my head on to the table... [23:55:08] 3Tool-Labs-tools-Other: Fatal error trying to see Commons contributions on tools.wmflabs.org/supercount - https://phabricator.wikimedia.org/T76335#799895 (10Cyberpower678) p:5Low>3Normal a:3Cyberpower678 [23:56:06] (03PS1) 10Yuvipanda: webservice2: Fix crash for tools with custom memory limits [labs/toollabs] - 10https://gerrit.wikimedia.org/r/176836 [23:56:55] (03CR) 10Legoktm: [C: 031] webservice2: Fix crash for tools with custom memory limits [labs/toollabs] - 10https://gerrit.wikimedia.org/r/176836 (owner: 10Yuvipanda) [23:58:12] (03CR) 10Yuvipanda: [C: 032 V: 032] webservice2: Fix crash for tools with custom memory limits [labs/toollabs] - 10https://gerrit.wikimedia.org/r/176836 (owner: 10Yuvipanda)