[06:42:19] 10DBA, 06Labs, 13Patch-For-Review: Add and sanitize s2, s4, s5, s6 and s7 to sanitarium2 and new labsdb hosts - https://phabricator.wikimedia.org/T153743#3149784 (10Marostegui) I am not going to import anything this week most likely, but I am advancing on the task to import s5, by starting the compression on... [06:47:29] 10DBA, 13Patch-For-Review: Remove partitions from metawiki.pagelinks in s7 - https://phabricator.wikimedia.org/T153300#3149788 (10Marostegui) Cleaning up codfw master now, so once the DC switchover is done, we can clean up eqiad and close this ticket. [07:19:30] 10DBA: Unify revision table on s7 - https://phabricator.wikimedia.org/T160390#3149813 (10Marostegui) a:03Marostegui [07:57:59] 10DBA, 10MediaWiki-Database: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3125897 (10jcrespo) > Although there aren't a huge amount of new features The largest change on MySQL in the last 15 years took place on 5.1 (plugin edition) or 5.5, supporting modern InnoD... [08:20:59] 10DBA: Unify revision table on s7 - https://phabricator.wikimedia.org/T160390#3149900 (10Marostegui) This shard is on a very bad shape regarding the definition of the revision table across the slaves (and master) So I am going to change one eqiad slave (one normal and one special slave) and leave them running wi... [09:36:24] dbstore1002 is lagging- not sure if the pt-t-c, the large create or a combination of both [09:36:35] see -operations :) [09:36:45] ah, I see now [09:36:47] I am contacting the owner :) [10:47:47] 10DBA, 07Epic, 05codfw-rollout: Database maintenance scheduled while eqiad datacenter is non primary (after the DC switchover) - https://phabricator.wikimedia.org/T155099#3150234 (10jcrespo) [11:27:02] 10DBA, 07Epic, 05codfw-rollout: Database maintenance scheduled while eqiad datacenter is non primary (after the DC switchover) - https://phabricator.wikimedia.org/T155099#3150281 (10jcrespo) [11:27:04] 10DBA, 10MediaWiki-API: Database query error (internal_api_error_DBQueryError) while getting list=allrevisions - https://phabricator.wikimedia.org/T123557#3150282 (10jcrespo) [11:27:06] 10DBA, 13Patch-For-Review: Rampant differences in indexes on enwiki.revision across the DB cluster - https://phabricator.wikimedia.org/T132416#3150280 (10jcrespo) 05stalled>03Open [11:39:18] 10DBA, 13Patch-For-Review: Rampant differences in indexes on enwiki.revision across the DB cluster - https://phabricator.wikimedia.org/T132416#3150325 (10jcrespo) This can continue, now that the largest blockers on T159319 are gone- in fact, with the new changes, this is needed for a full resolution of that one. [11:40:39] 10DBA, 13Patch-For-Review: Rampant differences in indexes on enwiki.revision across the DB cluster - https://phabricator.wikimedia.org/T132416#3150328 (10Marostegui) >>! In T132416#3150325, @jcrespo wrote: > This can continue, now that the largest blockers on T159319 are gone- in fact, with the new changes, th... [12:09:17] 10DBA, 10MediaWiki-Database: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150414 (10Reedy) We do need to pay some amount of attention as to what distro versions have what version of MySQL. Unfortunately, we can't make installing mariadb, or a backported mysql a r... [12:14:27] 10DBA, 10MediaWiki-Database: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3125897 (10MoritzMuehlenhoff) Debian testing doesn't have mysql any longer, it switched to mariadb 10.1, mysql is only in Debian unstable. [13:20:30] 10DBA, 10MediaWiki-Database: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150538 (10jcrespo) > Not looked at redhat based ones All major distributions except RedHat 6 and CentOS 6 (because of the 10 years of support)- are at least on 5.5, if only because of secu... [13:22:29] 10DBA, 13Patch-For-Review: Unify revision table on s7 - https://phabricator.wikimedia.org/T160390#3150540 (10Marostegui) db1086 is done: ``` root@neodymium:/home/marostegui# for i in `cat s7_T160390`; do echo $i; mysql --skip-ssl -hdb1086 $i -e "show create table revision\G" | egrep "KEY";done arwiki PRIMARY... [13:23:09] 10DBA, 10MediaWiki-Database: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3125897 (10Paladox) 5.7 is really new. We should support like 5.5+ Not limit to 5.7. [13:24:07] 10DBA, 13Patch-For-Review: Unify revision table on s7 - https://phabricator.wikimedia.org/T160390#3150543 (10jcrespo) Can I ask you to prioritize next the server on s7 that was complaining on the security issue (I think it was db1066)? [13:24:47] 10DBA, 10MediaWiki-Database: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150544 (10Reedy) >>! In T161232#3150541, @Paladox wrote: > 5.7 is really new. We should support like 5.5+ Not limit to 5.7. Are you kidding? https://dev.mysql.com/doc/relnotes/mysql/5.7/e... [13:26:04] 10DBA, 10MediaWiki-Database: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150546 (10Paladox) My host doesn't use 5.7. And it uses new technology. we can use mysql version detection to aim code at mysql 5.7+ only. Its better then going from 5.0.3 all the way to 5.7. [13:26:19] 10DBA, 10MediaWiki-Database: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150547 (10jcrespo) 5.7 stable (aka GA) is from 2015: https://dev.mysql.com/doc/relnotes/mysql/5.7/en/news-5-7-9.html The versions before are developer releases and RCs. [13:28:49] 10DBA, 10MediaWiki-Database: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150567 (10Marostegui) >>! In T161232#3150544, @Reedy wrote: >>>! In T161232#3150541, @Paladox wrote: >> 5.7 is really new. We should support like 5.5+ Not limit to 5.7. > > Are you kidding... [13:29:17] 10DBA, 10MediaWiki-Database: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150571 (10Reedy) >>! In T161232#3150538, @jcrespo wrote: >> Not looked at redhat based ones > > https://distrowatch.com/ > > All major not E-O-L distributions except RedHat 6 and CentOS 6... [13:31:25] 10DBA, 10MediaWiki-Database: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150572 (10Reedy) >>! In T161232#3150567, @Marostegui wrote: > If we do not mind for 5.5 to be not supported in one year time, we would need to go for either 5.5 or 5.6 Based on past behavi... [13:32:04] 10DBA, 10MediaWiki-Database: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150573 (10Reedy) >>! In T161232#3150546, @Paladox wrote: > My host doesn't use 5.7. And it uses new technology. we can use mysql version detection to aim code at mysql 5.7+ only. Its better... [13:34:53] 10DBA, 10MediaWiki-Database: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150577 (10jcrespo) > I don't see any reason to just bump to 5.1, 5.5 seems nicely in the middle. Or at least 5.5 I am not saying we should do only 5.1 or 5.5 -I am saying that is absolutel... [13:36:06] 10DBA, 13Patch-For-Review: Unify revision table on s7 - https://phabricator.wikimedia.org/T160390#3150578 (10Marostegui) >>! In T160390#3150543, @jcrespo wrote: > Can I ask you to prioritize next the server on s7 that was complaining on the security issue (I think it was db1066)? > > **Edit:** no, it was db10... [13:38:07] 10DBA, 10MediaWiki-Database: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150580 (10Marostegui) >>! In T161232#3150577, @jcrespo wrote: >> I don't see any reason to just bump to 5.1, 5.5 seems nicely in the middle. Or at least 5.5 > > I am not saying we should d... [13:41:47] 10DBA, 10MediaWiki-Database: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150612 (10Reedy) Current MW code would barf and fall over at least at the installer point ```lang=php $version = $conn->getServerVersion(); if ( version_compare( $version, $this->minim... [13:44:46] 10DBA, 10MediaWiki-Database: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150633 (10Paladox) When we should we bump mysql to 5.5? Before the next lts release or after it. There should also be an advanced notice for users to know that the mysql version they use sh... [13:45:04] 10DBA, 10MediaWiki-Database: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150637 (10Reedy) I also don't think expecting MySQL 5.5 is a stretch. Release date 2010-12-03 PHP 5.5.9 is 06 Feb 2014 Though, it does seem distros are a bit more lagging on MySQL version... [13:48:37] 10DBA, 10MediaWiki-Database: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3125897 (10Zppix) I say maybe change min requirement but don't completely cut support for the current requirement, and then slowly start forcing the new requirement as we go on? [13:50:09] 10DBA, 10ArchCom-RfC, 10MediaWiki-Database, 07RfC: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150649 (10Reedy) >>! In T161232#3150633, @Paladox wrote: > When we should we bump mysql to 5.5? Before the next lts release or after it. There should also be an ad... [13:54:23] 10DBA, 10ArchCom-RfC, 10MediaWiki-Database, 07RfC: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3125897 (10Reedy) >>! In T161232#3150646, @Zppix wrote: > I say maybe change min requirement but don't completely cut support for the current requirement, and then... [13:56:22] 10DBA, 10ArchCom-RfC, 10MediaWiki-Database, 07RfC: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150729 (10Zppix) >>! In T161232#3150708, @Reedy wrote: >>>! In T161232#3150646, @Zppix wrote: >> I say maybe change min requirement but don't completely cut suppor... [13:57:41] 10DBA, 10ArchCom-RfC, 10MediaWiki-Database, 07RfC: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150734 (10Reedy) No, we're not bumping versions in point releases unless we found a show stopping bug. And even then, that could just prevent people upgrading due... [13:58:57] 10DBA, 10ArchCom-RfC, 10MediaWiki-Database, 07RfC: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150738 (10Paladox) I would support bumping to 5.5 but not all the way to 5.7. [13:59:44] 10DBA, 10ArchCom-RfC, 10MediaWiki-Database, 07RfC: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150739 (10Zppix) @Reedy then maybe we start work and bump it for 1.29, so we can instantly start using it when 1.30 starts cycle. [14:00:19] 10DBA, 10ArchCom-RfC, 10MediaWiki-Database, 07RfC: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150740 (10Reedy) We could start using it in the few weeks left of 1.29 if we wanted [14:02:55] 10DBA, 10ArchCom-RfC, 10MediaWiki-Database, 07RfC: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150750 (10Zppix) It couldn't hurt @reedy,@hashar would this affect CI? [14:04:08] 10DBA, 10ArchCom-RfC, 10MediaWiki-Database, 07RfC: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150754 (10Paladox) Also wikimedia uses mariadb 10.0 which says it uses mysql 5.6 features https://mariadb.com/kb/en/mariadb/what-is-mariadb-100/ no mention of 5.7. [14:04:32] 10DBA, 10ArchCom-RfC, 10MediaWiki-Database, 07RfC: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150755 (10Paladox) >>! In T161232#3150750, @Zppix wrote: > It couldn't hurt @reedy,@hashar would this affect CI? This should not affect ci if we do it with 5.5. [14:05:23] 10DBA, 10ArchCom-RfC, 10MediaWiki-Database, 07RfC: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150756 (10Paladox) >>! In T161232#3150740, @Reedy wrote: > We could start using it in the few weeks left of 1.29 if we wanted Which version are you talking about... [14:13:30] 10DBA, 10ArchCom-RfC, 10MediaWiki-Database, 07RfC: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150792 (10Reedy) >>! In T161232#3150755, @Paladox wrote: >>>! In T161232#3150750, @Zppix wrote: >> It couldn't hurt @reedy,@hashar would this affect CI? > > This... [14:14:07] 10DBA, 10ArchCom-RfC, 10MediaWiki-Database, 07RfC: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150799 (10jcrespo) > So your opinion has some weight, you'll have some domain knowledge, have a better understanding (without reading around too much like others w... [14:25:24] 10DBA, 10ArchCom-RfC, 10MediaWiki-Database, 07RfC: Should we bump minimum supported MySQL Version? - https://phabricator.wikimedia.org/T161232#3150817 (10Reedy) Thanks Jaime I think one of the few downsides of 5.5 is the EOL being not so far away, but with our past support of MySQL, this isn't so much of... [14:37:29] 10DBA, 10Wikidata, 13Patch-For-Review, 03Wikidata-Sprint: Wikibase\Repo\Store\Sql\SqlEntitiesWithoutTermFinder::getEntitiesWithoutTerm can take 19 hours to execute and it is run by the web requests user - https://phabricator.wikimedia.org/T160887#3150837 (10hoo) So are we fine with removing the all option... [16:38:03] 10DBA, 06Analytics-Kanban, 13Patch-For-Review: Change length of userAgent column on EL tables - https://phabricator.wikimedia.org/T160454#3151366 (10Nuria) 05Open>03Resolved [16:38:15] 10DBA, 10Analytics-EventLogging, 06Analytics-Kanban, 06Operations, 13Patch-For-Review: Improve eventlogging replication procedure - https://phabricator.wikimedia.org/T124307#3151383 (10Nuria) [16:38:22] 10DBA, 10Analytics-EventLogging, 06Analytics-Kanban, 13Patch-For-Review: Add autoincrement id to EventLogging MySQL tables. {oryx} - https://phabricator.wikimedia.org/T125135#3151382 (10Nuria) 05Open>03Resolved [16:56:32] jynus: hey [16:56:40] paravoid, here [16:56:44] minor thing [16:56:51] tell me [16:56:56] you fixed modules/mariadb/manifests/packages.pp [16:57:02] but there's still modules/mysql/manifests/server/package.pp [16:57:11] which looks like an exact duplicate, btw [16:57:19] mysql module? [16:57:37] I never realized it existed before [16:57:51] I will look into it [16:57:59] haha [16:58:06] as I said, I need to do more work on that- see how is used , etc [16:58:12] I know it existed [16:58:15] if you hadn't realized it exists, then dropping the whole thing is also an option :P [16:58:18] but I supposed [16:58:32] it was just an import to the general puppet package [16:58:47] I will look into it because I know production modules using it as a dependency [16:58:55] but not core dbs [16:59:11] probably not in use, but I will have a second look [17:00:44] used by modules/mediawiki_singlenode, modules/quarry, modules/statistics [17:00:58] and modules/role/manifests/requesttracker/labs.pp, modules/role/manifests/simplelamp.pp, modules/role/manifests/statistics/private.pp and modules/role/manifests/wikimetrics/staging.pp [17:01:12] want me to file a task? [17:01:59] the module yes, not sure about the specific class [17:02:17] and of those roles, not sure how many are applied [17:02:48] paravoid, please just create a task and copy that there, it will be much better [17:03:05] my goal is also to get rid of packages <-> packages_wmf [17:04:05] it has a version paramter, and that can be used in the future [17:04:46] I just need research because there are some non-dedicated mysql installs for small services I do not know about [17:07:23] https://phabricator.wikimedia.org/T162070 [17:07:23] 10DBA, 06Operations: Cleanup or remove mysql puppet module; repurpose mariadb module to cover misc use cases - https://phabricator.wikimedia.org/T162070#3151523 (10faidon) [17:07:29] thanks [17:07:35] feel free to adjust, amend, rewrite or do whatever you want with this task :) [17:07:45] I definitely win [17:07:53] increase the scope for general maintenance [17:07:56] *will [17:08:27] ok :) [17:08:29] thank you! [17:08:45] thanks you for reporting and taking the time to writing the task [17:09:41] no worries [18:16:55] ping jynus marostegui FYI, we are going to do some maintenance on EL , stopping replication [18:18:59] should we stop the backfilling, too? [18:20:40] I have stopped it, will not put it backup up until told otherwise [18:23:22] thanks jynus ya [18:24:04] it can be down for extended time-technically is only a backfil [18:24:46] ok jynus, we done, thanks [18:24:53] you can start the backfill back up [18:25:00] ok, thanks [23:43:33] 10DBA, 06Labs: Prepare and check storage layer for khw.wikipedia - https://phabricator.wikimedia.org/T160870#3152669 (10Dereckson) 05Open>03stalled We aren't currently sure this wiki will be created soon per [[ https://lists.wikimedia.org/pipermail/langcom/2017-April/001207.html | this langcom announcement... [23:45:25] 10DBA, 06Labs: Prepare and check storage layer for kbp.wikipedia.org - https://phabricator.wikimedia.org/T160869#3152675 (10Dereckson) 05Open>03stalled Language engineering wants more translations before this wiki's language is added to MediaWiki, and we don't want to create a wiki before the language is a... [23:47:16] 10DBA, 06Labs: Prepare and check storage layer for dty.wikipedia.org - https://phabricator.wikimedia.org/T162102#3152679 (10Dereckson)