[03:43:06] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Safety cap was created, changed by Safety cap link https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Safety_cap edit summary: Created page with "{{Tools Access Request |Justification=Automating articles' reference maintenance tasks, such as identifying and correcting incomplete references. |Completed=false |User Name=S..." [04:01:52] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Safety cap was modified, changed by Tim Landscheidt link https://wikitech.wikimedia.org/w/index.php?diff=161177 edit summary: [06:14:55] 10Tool-Labs: Everything wrong with ToolLabs - https://phabricator.wikimedia.org/T100160#1324874 (10Qgil) 5Open>3Resolved a:3Qgil [06:24:43] 10Tool-Labs: Create a set of 'template' tools in various languages with deploy scripts for toollabs - https://phabricator.wikimedia.org/T91059#1324904 (10Qgil) [06:25:23] 10Tool-Labs, 7Documentation: Re-organize Tool Labs documentation - https://phabricator.wikimedia.org/T91509#1324906 (10Qgil) [08:29:19] 6Labs, 6operations, 7database: Santitize recent wikis: wikimania 2016 and cn.wikimedia.org at labs dbs - https://phabricator.wikimedia.org/T100441#1325049 (10jcrespo) Thank you, @scfc, I will wait for @core to see how to proceed (either me or him does it). He may want to chime in due to related bug T96638. H... [11:01:54] 10Tool-Labs-tools-Other, 6Commons: Flickr2Commons throttle needed - https://phabricator.wikimedia.org/T100973#1325281 (10Aklapper) [11:03:32] 10Tool-Labs-tools-Other, 6Commons: Flickr2Commons throttle needed - https://phabricator.wikimedia.org/T100973#1325284 (10Fae) >>! In T100973#1325279, @Aklapper wrote: > @Fae: Is this a request about implementing such a throttle generically somewhere in the Commons uploading infrastructure, or about implementin... [11:32:01] 10Tool-Labs: Install "internetarchive" python module - https://phabricator.wikimedia.org/T100977#1325330 (10Nemo_bis) 3NEW [11:40:40] 10Tool-Labs-tools-Other, 6Commons: Flickr2Commons throttle needed - https://phabricator.wikimedia.org/T100973#1325352 (10Magnus) Hacked in a limiter, concurrent upload limit now 2. https://bitbucket.org/magnusmanske/flickr2commons/diff/public_html/main.js?diff2=fc622532fa64&at=master [12:13:10] 10Tool-Labs: Install "internetarchive" python module - https://phabricator.wikimedia.org/T100977#1325397 (10yuvipanda) I think we should reduce the amount of self-built python packages installed on toollabs (see T91874). Using a virtualenv should be the preferred solution. [12:51:28] 6Labs, 10Datasets-General-or-Unknown, 10Labs-Infrastructure, 10Wikidata: Add Wikidata json dumps to labs - https://phabricator.wikimedia.org/T100885#1325483 (10Lydia_Pintscher) [13:18:12] 10Quarry: Add list of query executions to the query page side-bar - https://phabricator.wikimedia.org/T100982#1325563 (10Halfak) 3NEW [13:20:40] 10Quarry: Add list of query executions to the query page side-bar - https://phabricator.wikimedia.org/T100982#1325577 (10Halfak) [13:56:46] 10Tool-Labs: Install "internetarchive" python module - https://phabricator.wikimedia.org/T100977#1325735 (10Nemo_bis) Well I trust whatever is your recommendation on the process to follow, I just filed this task as suggested by https://wikitech.wikimedia.org/wiki/Help:Tool_Labs . Please update docs with whatever... [14:01:55] 10Tool-Labs: Install "internetarchive" python module - https://phabricator.wikimedia.org/T100977#1325762 (10yuvipanda) 5Open>3Resolved a:3yuvipanda Fixed https://wikitech.wikimedia.org/w/index.php?title=Help%3ATool_Labs&type=revision&diff=161218&oldid=161141 [14:13:49] legoktm: wondering whether you managed to chat to Yuvi about toollabs:checker [14:25:56] hi guys [14:26:08] i'm finding the database a bit slow today. is it me or is there really something? [14:37:22] 10Tool-Labs-tools-Other, 10Phragile, 6TCB-Team: Deploy Phragile on tool-labs - https://phabricator.wikimedia.org/T100192#1325856 (10Tobi_WMDE_SW) [15:26:41] 6Labs, 10Labs-Infrastructure: Automate generation of floating/private dns aliases in the labs recursor - https://phabricator.wikimedia.org/T100990#1326037 (10Andrew) 3NEW [15:27:28] 6Labs, 6operations: New server for labs dns recursor - https://phabricator.wikimedia.org/T99133#1326044 (10Andrew) 5Open>3Resolved Done in place, no problems. [15:27:29] 6Labs, 10Continuous-Integration-Infrastructure: Designate should support split horizon resolution to yield private IP of instances behind a public DNS entry - https://phabricator.wikimedia.org/T95288#1326046 (10Andrew) [15:28:32] 6Labs, 10Labs-Infrastructure, 3ToolLabs-Goals-Q4: Move LabsDB aliases to DNS - https://phabricator.wikimedia.org/T63897#1326055 (10Andrew) [15:28:33] 6Labs, 10Tool-Labs: Move tools to designate - https://phabricator.wikimedia.org/T96641#1326056 (10Andrew) [15:28:35] 10Tool-Labs: Move toollabs to designate - https://phabricator.wikimedia.org/T100023#1326057 (10Andrew) [15:28:37] 6Labs: Switch all of labs to the pdns server, remove the use_dnsmasq flag. - https://phabricator.wikimedia.org/T97170#1326058 (10Andrew) [15:28:39] 6Labs, 5Patch-For-Review: Investigate replacing our custom DNS code with Designate - https://phabricator.wikimedia.org/T87280#1326059 (10Andrew) [15:34:24] andrewbogott: I don't see anything else blocking https://phabricator.wikimedia.org/T100023#1326057. do you think any other task should be a blocking task for that? [15:34:35] YuviPanda: nope, just a bit of testing. [15:34:39] Well, and the patch that I’m about to submit [15:34:51] :D [15:35:06] I could turn it on for the bastions now [15:35:11] and see what happens [15:35:56] YuviPanda: should be safe on the bastions. I want an ‘all clear’ from hashar_ about the split horizon before making this default for new instances. [15:36:44] andrewbogott: ok. let me turn them on now \o/ [15:36:51] wait wait wait [15:36:53] ok :P [15:37:04] first we need https://gerrit.wikimedia.org/r/#/c/215044/ [16:02:11] andrewbogott: I am going to leave soonish [16:02:32] hashar: sure. I’ll make you a bug to test split horizon. [16:02:34] gotta look at some various beta domain names :/ [16:02:38] I have another issue I need to fix first anyway. [16:02:47] you can poke #wikimedia-releng about it though! US folks should be awake now [16:03:04] ok [16:28:33] o/ [16:28:51] Back to UTC-4. Also, no water in the basement. [16:29:33] 6Labs, 10Labs-Infrastructure: Duplicate entries in pdns/mysql for labs instances - https://phabricator.wikimedia.org/T101000#1326250 (10Andrew) 3NEW [16:34:52] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Rmarshasatx was created, changed by Rmarshasatx link https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Rmarshasatx edit summary: Created page with "{{Tools Access Request |Justification=create a tool to gather statistics and data to support the building of a visualization showing edit frequency and geographic location and..." [16:35:24] 6Labs, 10Labs-Infrastructure: Duplicate entries in pdns/mysql for labs instances - https://phabricator.wikimedia.org/T101000#1326278 (10Andrew) 2015-06-01 16:31:57.150 7015 INFO designate.openstack.common.rpc.common [-] Connected to AMQP server on virt1000.wikimedia.org:5672 2015-06-01 16:32:21.008 7015 INFO d... [16:54:55] Hi. My prompt is: tools.botomatik@tools-bastion-01: [16:55:27] Is it the good one? https://wikitech.wikimedia.org/wiki/Help:Tool_Labs#Using_Tool_Labs_and_managing_your_files gives tools.toolaccount@tools-login: [16:55:51] Is it normal I mean? [16:56:17] Yes. 'toolaccount' is just the name of the tool account, which would differ in each case and tools-login is whichever bastion host you happen to be on. [16:56:53] ok, thanks (because the labs server is very slow) [17:01:14] 10Tool-Labs: Move toollabs to designate - https://phabricator.wikimedia.org/T100023#1326340 (10yuvipanda) Needs a bunch more testing, and then we can move this forward step by step: # Move bastions, announce on labs-announce # Move webproxies # Move gridengine master / slave (these run crappy software) # Move e... [17:05:42] 6Labs, 10Labs-Infrastructure: Duplicate entries in pdns/mysql for labs instances - https://phabricator.wikimedia.org/T101000#1326351 (10Andrew) That paramiko crash seems to have been the problem. It happened because paramiko uses an older ssh implementation than the one we were requiring on virt1000. That is... [17:12:48] 6Labs, 10Beta-Cluster, 10Labs-Infrastructure, 6operations, 6WMF-NDA: On Beta Cluster, add warning text + labs Term of Uses link to the motd files - https://phabricator.wikimedia.org/T100837#1326373 (10greg) [17:14:47] 6Labs, 10Beta-Cluster, 10Labs-Infrastructure, 6operations, 6WMF-NDA: On deployment-prep, add warning text + labs Term of Uses link to the motd files - https://phabricator.wikimedia.org/T100837#1326378 (10ori) [17:19:48] 6Labs, 10Beta-Cluster, 10Labs-Infrastructure, 6operations, 6WMF-NDA: On deployment-prep, add warning text + labs Term of Uses link to the motd files - https://phabricator.wikimedia.org/T100837#1326392 (10Joe) Proposal: ``` oo... [17:21:49] 6Labs, 10Beta-Cluster, 10Labs-Infrastructure, 6operations, 6WMF-NDA: On deployment-prep, add warning text + labs Term of Uses link to the motd files - https://phabricator.wikimedia.org/T100837#1326400 (10yuvipanda) Yes, and everytime someone breaks beta we can factually say they clubbed a baby seal to de... [17:24:28] 6Labs, 10Tool-Labs: Setup a machine readable, single-source-of-truth for Labs downtime / maintenance announcements - https://phabricator.wikimedia.org/T101005#1326411 (10yuvipanda) 3NEW [17:25:46] 6Labs, 10Tool-Labs: Setup a documentation sprint for Tool Labs / Labs - https://phabricator.wikimedia.org/T101006#1326421 (10yuvipanda) 3NEW [17:37:12] 6Labs, 10Labs-Infrastructure, 3Labs-Sprint-100: Duplicate entries in pdns/mysql for labs instances - https://phabricator.wikimedia.org/T101000#1326446 (10Andrew) [17:37:42] 6Labs, 3Labs-Sprint-100: Switch all of labs to the pdns server, remove the use_dnsmasq flag. - https://phabricator.wikimedia.org/T97170#1326448 (10Andrew) [17:37:55] 10Tool-Labs, 3Labs-Sprint-100: setup host-based auth for tools hosts properly - https://phabricator.wikimedia.org/T98714#1326449 (10yuvipanda) [17:38:23] 10Tool-Labs, 3Labs-Sprint-100, 5Patch-For-Review: Unify / simplify webservice code - https://phabricator.wikimedia.org/T98440#1326452 (10yuvipanda) [17:38:25] 6Labs, 3Labs-Sprint-100, 3ToolLabs-Goals-Q4: virt1000 SPOF - https://phabricator.wikimedia.org/T90625#1326453 (10Andrew) [17:38:42] 6Labs, 10Tool-Labs, 3Labs-Sprint-100: Move tools to designate - https://phabricator.wikimedia.org/T96641#1326454 (10yuvipanda) [17:39:13] 6Labs, 3Labs-Sprint-100, 3ToolLabs-Goals-Q4: virt1000 SPOF - https://phabricator.wikimedia.org/T90625#1063560 (10Andrew) [17:40:12] 6Labs, 10Tool-Labs, 3Labs-Sprint-100, 3ToolLabs-Goals-Q4: Move toollabs instances around to minimize damage from a single downed virt* host - https://phabricator.wikimedia.org/T91072#1326459 (10yuvipanda) [17:40:32] 10Tool-Labs, 3Labs-Sprint-100, 3ToolLabs-Goals-Q4: Support for truly 'generic' webservices via service manifests - https://phabricator.wikimedia.org/T97230#1326460 (10yuvipanda) [17:40:49] 10Tool-Labs, 3Labs-Sprint-100, 5Patch-For-Review, 3ToolLabs-Goals-Q4: Clean up local crontabs - https://phabricator.wikimedia.org/T96472#1326463 (10yuvipanda) [17:41:34] 6Labs, 3Labs-Sprint-100: Upgrade labs controller to Trusty - https://phabricator.wikimedia.org/T90824#1326473 (10Andrew) [17:41:41] 10Tool-Labs, 3Labs-Sprint-100, 5Patch-For-Review, 3ToolLabs-Goals-Q4: Clean up local crontabs - https://phabricator.wikimedia.org/T96472#1217896 (10yuvipanda) Should just check on tools-trusty and deprecate that. [17:41:46] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Rmarshasatx was modified, changed by Tim Landscheidt link https://wikitech.wikimedia.org/w/index.php?diff=161271 edit summary: [17:41:51] 6Labs, 10Labs-Infrastructure, 6operations, 3Labs-Sprint-100: Migrate Labs NFS storage from RAID6 to RAID10 - https://phabricator.wikimedia.org/T96063#1326475 (10coren) [17:42:09] 6Labs, 3ToolLabs-Goals-Q4: virt1000 SPOF - https://phabricator.wikimedia.org/T90625#1326477 (10Andrew) [17:42:51] 6Labs, 10Tool-Labs, 3Labs-Q4-Sprint-1, 3Labs-Q4-Sprint-2, and 2 others: Make sure tools-db is replicated somewhere - https://phabricator.wikimedia.org/T88718#1326479 (10coren) [17:44:45] 6Labs, 10Tool-Labs, 3Labs-Sprint-100: Test and verify that OGE master/shadow failover works as expected - https://phabricator.wikimedia.org/T90546#1326481 (10coren) [17:45:28] 6Labs, 3Labs-Q4-Sprint-2, 3Labs-Sprint-100, 5Patch-For-Review, 3ToolLabs-Goals-Q4: Disable LDAP and enable admin puppet module on labstore100[12] - https://phabricator.wikimedia.org/T95559#1326486 (10coren) [17:49:59] 10Tool-Labs, 3Labs-Sprint-100: Clean up huge logs on toollabs - https://phabricator.wikimedia.org/T98652#1326511 (10yuvipanda) [17:59:25] 6Labs, 10Labs-Infrastructure, 6operations, 3Labs-Sprint-100: Make a block-level copy of the codfw mirror of labstore1001 to eqiad - https://phabricator.wikimedia.org/T101010#1326544 (10coren) 3NEW [17:59:53] 6Labs, 10Labs-Infrastructure, 6operations, 3Labs-Sprint-100: Make a block-level copy of the codfw mirror of labstore1001 to eqiad - https://phabricator.wikimedia.org/T101010#1326544 (10coren) a:3coren First part is having the destination ready, doing that. [18:00:20] 6Labs, 10Labs-Infrastructure, 6operations, 3Labs-Sprint-100: Rsync live labstore filesystem to local eqiad copy - https://phabricator.wikimedia.org/T101011#1326556 (10coren) 3NEW [18:00:41] 6Labs, 10Labs-Infrastructure, 6operations, 3Labs-Sprint-100: Make a block-level copy of the codfw mirror of labstore1001 to eqiad - https://phabricator.wikimedia.org/T101010#1326566 (10coren) [18:00:43] 6Labs, 10Labs-Infrastructure, 6operations, 3Labs-Sprint-100: Rsync live labstore filesystem to local eqiad copy - https://phabricator.wikimedia.org/T101011#1326556 (10coren) [18:30:31] Change on 12www.mediawiki.org a page OAuth/For Developers was modified, changed by Salwati6 link https://www.mediawiki.org/w/index.php?diff=1663121 edit summary: /* OAuth Security Provisions */ [18:56:32] 6Labs, 10Labs-Infrastructure, 6operations, 3Labs-Sprint-100: Make a block-level copy of the codfw mirror of labstore1001 to eqiad - https://phabricator.wikimedia.org/T101010#1326763 (10coren) Destination volume on labstore1002 is set up `backup/backup` aka `/dev/mapper/backup-backup` It has 40T virtual s... [18:58:37] Change on 12www.mediawiki.org a page OAuth/For Developers was modified, changed by Sitic link https://www.mediawiki.org/w/index.php?diff=1663128 edit summary: +python example [18:58:37] 6Labs, 10Labs-Infrastructure, 6operations, 3Labs-Sprint-100: Make a block-level copy of the codfw mirror of labstore1001 to eqiad - https://phabricator.wikimedia.org/T101010#1326772 (10coren) a:5coren>3mark [19:00:47] afk for lunch [19:04:18] 10Quarry: Add list of query executions to the query page side-bar - https://phabricator.wikimedia.org/T100982#1326793 (10Capt_Swing) What if the query is changed between executions? Do we save the version the query that produced each result set? [19:10:45] 10Quarry: Add list of query executions to the query page side-bar - https://phabricator.wikimedia.org/T100982#1326827 (10yuvipanda) Yes we already do have revisions - they are saved each time the query is executed :) We do need to expose them. [19:19:30] 6Labs, 10Beta-Cluster: Make it possible to run public queries against databases on beta cluster - https://phabricator.wikimedia.org/T99456#1326869 (10mmodell) p:5Triage>3Normal [19:19:56] 6Labs, 10Beta-Cluster: Make it possible to run public queries against databases on beta cluster - https://phabricator.wikimedia.org/T99456#1326873 (10yuvipanda) What's the use case? [19:29:06] legoktm: do you need any crons for extreg-wos? [19:56:11] YuviPanda: uhh, yes? I need both of them :P [20:01:39] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Diyiy was created, changed by Diyiy link https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Diyiy edit summary: Created page with "{{Tools Access Request |Justification=Access to Wiki table, and work on for research purpose. |Completed=false |User Name=Diyiy }}" [21:05:48] !log tool.jouncebot Restarted job to get proper nick [21:05:48] tool.jouncebot is not a valid project. [21:05:56] !log tools.jouncebot Restarted job to get proper nick [21:05:58] Logged the message, Master [21:29:20] ugh, created a precise instance but it looks dead on arrival [21:29:23] Jun 1 21:26:46 necropackages puppet-agent[1243]: Did not receive certificate [21:29:51] Jun 1 21:27:38 necropackages nslcd[1061]: [efd79f] ldap_start_tls_s() failed: Connect error: No such file or directory (uri="ldap://ldap-eqiad.wikimedia.org:389") [21:30:17] andrewbogott, Coren ^^ [21:30:50] MaxSem: what project and instance name? [21:33:26] andrewbogott, maps-team:necropackages [21:41:21] MaxSem: any reason to think this is precise-specific? [21:41:35] dunno:P [21:41:48] I just needed precise, and here it is.... [21:49:16] MaxSem: should be fixed in a minute or two, if not already [21:49:23] thanks:) [21:49:55] 6Labs, 10Labs-Infrastructure: Clean up old OSM cruft in puppetsigner - https://phabricator.wikimedia.org/T101037#1327250 (10Andrew) 3NEW a:3Andrew [21:54:16] MaxSem: working now? [21:54:48] andrewbogott, nope -still "puppet-agent[1243]: Did not receive certificate" [21:55:04] hm [21:55:06] * andrewbogott looks again [22:02:27] MaxSem: now? [22:02:56] andrewbogott, whee [22:03:09] sorry for the holdup. The puppetsigner was failing in a variety of interesting ways. [22:03:17] Well, two interesting ways, one dumb one [22:03:20] andrewbogott: you may delete the video project, i gave upon labs [22:03:28] matanya: not enough performance? [22:03:29] *gave up on [22:03:52] that, and dependency hell every time i need newer packages [22:04:43] dependency hell isn’t labs-specific is it? [22:05:10] doen't happen to me on my arch based machines, or debian testing [22:05:23] 6Labs: Clean up, delete 'video' project - https://phabricator.wikimedia.org/T101039#1327280 (10Andrew) 3NEW [22:05:36] matanya: but it does on jessie? [22:05:47] 6Labs: Clean up, delete 'video' project - https://phabricator.wikimedia.org/T101039#1327288 (10Matanya) indeed not. [22:06:06] I can't even luanch jessie as an image on labs [22:06:21] it fails with unknown error which i don't have time or will to debug [22:07:07] huh [22:07:08] * andrewbogott tries it [22:10:26] matanya, is it ^^ that was just resolved? [22:10:26] what ? [22:10:26] DOA instances [22:10:27] andrewbogott: to ease the check it only fails with gigantic [22:10:27] PROBLEM - ToolLabs Home Page on toollabs is CRITICAL - Socket timeout after 10 seconds [22:10:28] oh! That means something interesting is happening :( [22:10:37] MaxSem: not resolve from my POV [22:11:48] anyhow, i'll free up the resources i use, and give them back to the pool [22:15:19] RECOVERY - ToolLabs Home Page on toollabs is OK: HTTP OK: HTTP/1.1 200 OK - 791481 bytes in 2.282 second response time [22:15:26] * andrewbogott tests gigantic w/jessie [22:17:26] 6Labs, 10Labs-Infrastructure, 3Labs-Sprint-100: Duplicate entries in pdns/mysql for labs instances - https://phabricator.wikimedia.org/T101000#1327305 (10Andrew) 5Open>3Resolved a:3Andrew Fixed, albeit tediously. I ran a mysql report of all instance ids associated with designate entries, checked for i... [22:17:47] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Diyiy was modified, changed by Tim Landscheidt link https://wikitech.wikimedia.org/w/index.php?diff=161327 edit summary: [22:18:41] andrewbogott: openmeettings can go as well [22:19:23] 6Labs: Clean up, delete 'video' project - https://phabricator.wikimedia.org/T101039#1327311 (10Andrew) Also openmeetings [22:23:30] matanya: can you tell me what error you were seeing w/gigantic instances? See for example video-test-jessie [22:23:41] sec [22:23:45] no rush :) [22:24:46] Failed to create instance. [22:24:52] very verbose :) [22:27:11] 6Labs, 10Beta-Cluster: Make it possible to run public queries against databases on beta cluster - https://phabricator.wikimedia.org/T99456#1327335 (10hashar) 5Open>3declined a:3hashar Beta contains private data such as users IP addresses and emails. That is covered by the https://wikitech.wikimedia.org/w... [22:30:30] matanya: that sounds like an over-quota error [22:30:42] maybe [22:30:49] no clue [22:32:08] You can view your project quota and how much of it is used on wikitech or horizon. But, I agree that that failure message is pretty useless. [22:32:36] ooh can we get to horizon now? [22:33:01] nice, hadn't seen this [22:33:12] did not require MFA :/ [22:34:03] docs to show quota say: [22:34:08] nova quota-show --tenant nginx [22:34:13] but i get: [22:34:17] ERROR: You must provide a username via either --os-username or env[OS_USERNAME] [22:34:25] changed syntax? [22:34:33] it changed once before [22:36:55] andrewbogott: makes sense: Used 16.0GB of 50.0GB [22:37:06] and that is after i deleted my instances [22:37:19] but now i should be able to, and still can't [22:38:42] mutante: you have to source novaenv.sh [22:38:47] before running any nova commands [22:38:58] matanya: try deleting my test instance and then try again? [22:39:16] ok [22:39:41] andrewbogott: oh, that's new? thanks! where is that file please [22:39:59] mutante: it’s not new at all [22:40:16] as far as I know you’ve always had to source something or else add 1000 args to the commandline [22:40:19] for auth [22:40:32] https://wikitech.wikimedia.org/wiki/OpenStack#novaenv.sh [22:40:44] not last time i checked project quotas, but it's been quite a while [22:40:51] andrewbogott: yes, now i worked [22:40:52] ok, will read that [22:40:59] need a better error mssage [22:41:19] was on https://wikitech.wikimedia.org/wiki/Help:Nova-manage#Manage_project_quotas [22:41:33] matanya: 16/30 cores. So two is one too many [22:41:43] I can raise your quota if you think you’ll have another go at some point. [22:41:46] yup [22:42:07] andrewbogott: i don't like to be a resorce hog [22:42:17] :) [22:42:27] the best use case for this instance for me was the upload times [22:42:42] andrewbogott: that works, cool [22:43:00] since labs is there, i didn't need to download from youtube to my pc, reencode and upload back to wmf [22:43:04] now i do need [22:43:07] mutante: yeah, I guess ever doc page that refers to the nova cmdline needs to refer to that entry [22:43:15] if you have a solution for that, you made my day [22:43:57] + for some reason my pc encodes faster than those mighty beasts, and i can't explain how or why [22:44:08] andrewbogott: maybe it is because i used root and that sourced it automatically and it was all before we even had sudo [22:44:11] Probably ‘cause it has a gpu [22:44:26] no, it doesn't [22:44:30] oh, weird [22:44:40] i thought that was the case at first [22:44:53] but no gpu other than the onboard poor intel one [22:45:35] 6Labs, 10Labs-Infrastructure: ganglia for virt cluster shows all the wrong things - https://phabricator.wikimedia.org/T101043#1327386 (10Andrew) 3NEW [22:46:08] matanya: so it’s not just that you need a download path from youtube to the cluster, you need cycles to re-encode as well, right? [22:46:28] yes, but that is less fo a concern [22:46:42] i don't mind waiting, as long as it happens at last [22:47:35] andrewbogott: I wonder, is there a way to get an arch machine in labs ? [22:48:06] (outside of puppet/apt and so on of course) [22:48:22] matanya: it is theoretically possible, but building new image types is usually a bit of a pain. [22:48:41] Openstack supports my letting project admins upload custom images. I’m just worried that our image storage would fill up in half an hour if I allowed that [22:48:49] not an image, a one shot install from a "dvd" [22:49:27] Oh, hm. I don’t think that’s any different from an ‘image’ from openstack’s perspective. [22:50:03] I did this at my $day_job for one debian machine needed for testing our app build as a deb, but the rest of the cluster is rhel based [22:50:35] but, as said, no plans to add you extra work [22:51:15] Yeah, there’s definitely not a trivial way to do it. [22:56:31] matanya: maybe there is something like "archtakeover" that is like http://freecode.com/projects/debtakeover but for arch ? [22:57:11] it's made to run on existing install and replace the OS [22:57:41] no chance, and i don't need arch for it being arch, just for the fact the packages are always the latest, thanks for the suggestiong though [22:58:02] i am more concerned over the networking issue [22:58:27] matanya: you can use existing image and edit sources list to "sid" then? [22:58:40] that brakes the machine [22:58:46] and still too old :) [22:58:48] or if Ubuntu, do dist-upgrade -p [22:59:13] for some reason, distro follow wikimedia in neglecting the multimedia part [23:00:31] suprisingly sid now has latest ffmepg [23:00:43] thanks mutante was worth for this bit alone [23:01:15] matanya: omg, "pacman" for packaging? [23:01:29] what can you do [23:01:43] try if "alien" can convert the packages to deb ? /me hides [23:01:52] ok, sid is better then [23:01:58] i honstly stopped caring once i stopped distrohoppeing [23:02:12] about 3 years ago [23:02:25] so your personal laptop is arch? [23:02:31] yes [23:02:33] gotcha [23:03:28] i mainly hated the idea of re-installing ("dist upgrade, system brakes") evry half a year, or every two years [23:03:57] and i like the fact the packages are just always up to date [23:09:49] matanya: my experience is that upgrading broke on Ubuntu but worked fine on Debian [23:10:05] i usually upgrade in place and get away with it [23:10:17] but that is not the Ubuntu upgrade script [23:12:31] yes, that makes sense [23:21:59] 6Labs, 10Labs-Infrastructure, 3Labs-Sprint-100: Duplicate entries in pdns/mysql for labs instances - https://phabricator.wikimedia.org/T101000#1327515 (10Andrew) 5Resolved>3Open Re-opening -- I need to purge duplicate reverse entries as well.