[14:09:48] halfak: fyi labsdb1004/1005 are reaching EOL and we are looking at replacing them. We've settled on buying some beefy servers that we can create these as virtual isntances on so that'll be coming but it's 90d away at least I imagine [14:09:51] just a heads up [14:10:37] chasemp, gotcha. Sounds reasonable. [14:10:47] Do you think that we could talk about a backup strategy around the same time? [14:11:06] halfak: sure, we are working on getting some scratch space for users to self serve backups [14:11:14] something like enough for 100G of space for 100 projects [14:11:42] I'll dig up the tasks for both and ping you on them [14:12:14] Interesting. I'm thinking of something that'd be specific to any common DB servers in labs. But maybe you're talking about something like that. [14:12:23] Either way, 100GB would be plenty for wikilabels and ORES. [14:12:30] there really aren't common db servers so to speak [14:12:47] we explicitly try not to do "DB as a service" though toolsdb comes close [14:13:16] as in, we do a few instances of managed services for databases but its' a stretch as is and I don't think we have the ability to manage backups even for existing cases [14:13:26] so the thought is a more generic mechanism to allow folks to manage their own process [14:13:38] but we give them the safe space to store the data [14:13:50] labsdb1004/1005 are an HA pair and that's intended to continue fyi [14:15:01] chasemp, that's how this postgres server has been explained to me. :/ [14:15:08] what do you mean by "HA pair"? [14:15:45] an active and passive to do online operations with minimal downtime [14:15:49] For wikilabels, we used to manage our own postgres and Yuvipanda recommended strongly that we move to the common postgres DB instead. [14:16:04] Oh I see. So a single machine failure wouldn't kill our data. [14:16:17] no intentions of throwing that off, what I'm saying is it's not really a service we do if someone asked [14:16:22] it's just a thing we've ended up doing here [14:16:29] Oh I gotcha. That makes sense. [14:18:05] I'm not sure what the future of some of this is but I'm not saying we are pulling any plugs just generally a backup strategy for this wouldn't be made to fit more than this case whereas an rsync.net type store to stash random user backup up things would be [14:18:24] anyhoo, just a ping this is all yet to come [14:20:17] It's nice to have you personally let me know ^_^