[00:42:04] 10DBA, 10MediaWiki-extensions-Scribunto, 10MediaWiki-extensions-WikibaseClient, 10Wikidata, 10Performance: Strong reduction of computing time at Wikivoyage needed - https://phabricator.wikimedia.org/T189409#4041526 (10Reedy) It sounds more like a DB issue... page existence and `getEntity()` are going to... [01:57:14] 10DBA, 10MediaWiki-extensions-Scribunto, 10MediaWiki-extensions-WikibaseClient, 10Wikidata, 10Performance: Strong reduction of computing time at Wikivoyage needed - https://phabricator.wikimedia.org/T189409#4040993 (10Anomie) >>! In T189409#4041526, @Reedy wrote: > And as Max said, there's no difference... [06:25:22] 10DBA, 10MediaWiki-extensions-Scribunto, 10MediaWiki-extensions-WikibaseClient, 10Wikidata, 10Performance: Strong reduction of computing time at Wikivoyage needed - https://phabricator.wikimedia.org/T189409#4041675 (10RolandUnger) Thanks very much for your answers. As I told now parsing takes now betwee... [06:30:07] 10DBA, 10Patch-For-Review: Decommission db1009 - https://phabricator.wikimedia.org/T189216#4041689 (10Marostegui) Due to: T189403 I have started mysql on db1009 and connected it to db1073 temporarly. It is only listening on 127.0.0.1 so nothing can actually connect to it, but I wanted to have it replicating fr... [06:36:05] 10DBA, 10MediaWiki-extensions-Scribunto, 10MediaWiki-extensions-WikibaseClient, 10Wikidata, 10Performance: Strong reduction of computing time at Wikivoyage needed - https://phabricator.wikimedia.org/T189409#4040993 (10Marostegui) The DB servers serving wikivoyage databases and wikidata have the same HW.... [06:41:23] 10DBA: Faster backups by stating mydumper execution of different sections in parallel when they are about to finish and are running on a limited number of threads - https://phabricator.wikimedia.org/T189384#4040491 (10Marostegui) I'd prefer the solution of allowing next backups to start when there are less dumps... [07:14:18] 10DBA, 10Patch-For-Review: Productionize 2 new eqiad database servers - https://phabricator.wikimedia.org/T184161#4041728 (10Marostegui) [07:14:40] 10DBA, 10Operations, 10ops-eqiad, 10Patch-For-Review: Rack and setup db1113 and db1114 - https://phabricator.wikimedia.org/T182896#4041731 (10Marostegui) [07:14:42] 10DBA, 10Patch-For-Review: Productionize 2 new eqiad database servers - https://phabricator.wikimedia.org/T184161#3874417 (10Marostegui) 05Open>03Resolved db1113:3315 and db1113:3316 are now serving traffic. [07:33:03] 10DBA, 10Gerrit, 10Operations, 10Patch-For-Review, 10Release-Engineering-Team (Next): Gerrit is failing to connect to db on gerrit2001 thus preventing systemd from working - https://phabricator.wikimedia.org/T176532#3628916 (10Joe) Is anyone working on this issue? @Dzahn @jcrespo if neither of you is wo... [07:34:45] 10DBA, 10Gerrit, 10Operations, 10Patch-For-Review, 10Release-Engineering-Team (Next): Gerrit is failing to connect to db on gerrit2001 thus preventing systemd from working - https://phabricator.wikimedia.org/T176532#4041753 (10Marostegui) The proxies for codfw have been budget but not yet ordered, so rig... [09:52:47] 10DBA: Check data consistency across production shards - https://phabricator.wikimedia.org/T183735#4042116 (10Marostegui) I am pretty close to finish s1 (T162807), once that is done I will do a quick check for all the shards, specially those that were done long ago, before considering this ticket closed. [09:56:24] 10DBA: Faster backups by stating mydumper execution of different sections in parallel when they are about to finish and are running on a limited number of threads - https://phabricator.wikimedia.org/T189384#4042127 (10jcrespo) > I'd prefer the solution of Sorry, I am confused, but that is in opposition to ...?... [09:59:12] 10DBA: Faster backups by stating mydumper execution of different sections in parallel when they are about to finish and are running on a limited number of threads - https://phabricator.wikimedia.org/T189384#4042137 (10Marostegui) I took this sentence as two different ideas: ``` Either avoid that by being smarter... [10:03:00] 10DBA: Faster backups by stating mydumper execution of different sections in parallel when they are about to finish and are running on a limited number of threads - https://phabricator.wikimedia.org/T189384#4042174 (10jcrespo) Well, in that case, if "being smarter" means mydumper doesn't get stuck at the end, th... [10:04:16] 10DBA: Faster backups by stating mydumper execution of different sections in parallel when they are about to finish and are running on a limited number of threads - https://phabricator.wikimedia.org/T189384#4042175 (10Marostegui) >>! In T189384#4042174, @jcrespo wrote: > Well, in that case, if "being smarter" me... [10:07:37] 10DBA: Faster backups by stating mydumper execution of different sections in parallel when they are about to finish and are running on a limited number of threads - https://phabricator.wikimedia.org/T189384#4042179 (10jcrespo) Handling concurrency is never easy :-) [10:08:18] 10DBA: Faster backups by starting mydumper execution of different sections in parallel when they are about to finish and are running on a limited number of threads - https://phabricator.wikimedia.org/T189384#4042180 (10jcrespo) [10:24:34] 10DBA: Faster backups by starting mydumper execution of different sections in parallel when they are about to finish and are running on a limited number of threads - https://phabricator.wikimedia.org/T189384#4042274 (10jcrespo) BTW, OTRS backups take almost [[ T138915 | as much space ]] as all others combined:... [10:28:35] 10DBA, 10Patch-For-Review: Decommission db1009 - https://phabricator.wikimedia.org/T189216#4042335 (10jcrespo) I don't see it replicating on tendril (I didn't touch it there), is that expected? [10:46:19] I've merged all wmfmariadbpy scripts to head despite not beeing in a great state [10:46:32] so that volunteers know better where to start from [10:48:08] strange, I don't see them on https://phabricator.wikimedia.org/diffusion/OSMD/repository/master/ yet [10:55:37] 10DBA, 10Patch-For-Review: Decommission db1009 - https://phabricator.wikimedia.org/T189216#4042395 (10Marostegui) Yep! [11:18:23] I can see them now [11:38:24] 10DBA, 10Cloud-Services: Prepare storage layer for euwikisource - https://phabricator.wikimedia.org/T189466#4042582 (10Jayprakash12345) [11:39:00] 10DBA, 10Cloud-Services: Prepare storage layer for euwikisource - https://phabricator.wikimedia.org/T189466#4042582 (10Jayprakash12345) [11:39:24] 10DBA, 10Cloud-Services: Prepare storage layer for euwikisource - https://phabricator.wikimedia.org/T189466#4042582 (10Jayprakash12345) 05Open>03stalled [12:25:10] 10DBA, 10Cloud-Services: Prepare storage layer for euwikisource - https://phabricator.wikimedia.org/T189466#4042582 (10Marostegui) Let us know when the wiki is created to filter it on labs and apply (or check if we need to apply): T187089 T185128 T153182 [13:25:44] 10DBA, 10MediaWiki-extensions-Scribunto, 10MediaWiki-extensions-WikibaseClient, 10Wikidata, and 2 others: Strong reduction of computing time at Wikivoyage needed - https://phabricator.wikimedia.org/T189409#4043019 (10thiemowmde) Thanks a lot for the incredibly helpful investigation, @Anomie! The addStateme... [13:32:20] 10DBA, 10MediaWiki-extensions-Scribunto, 10MediaWiki-extensions-WikibaseClient, 10Wikidata, and 2 others: Strong reduction of computing time at Wikivoyage needed - https://phabricator.wikimedia.org/T189409#4043058 (10Lucas_Werkmeister_WMDE) dewikivoyage is in group1, so as far as I understand it will only... [14:05:23] 10DBA, 10MediaWiki-extensions-Scribunto, 10MediaWiki-extensions-WikibaseClient, 10Wikidata, and 4 others: Strong reduction of computing time at Wikivoyage needed - https://phabricator.wikimedia.org/T189409#4043139 (10Reedy) [15:03:35] 10DBA, 10MediaWiki-extensions-Scribunto, 10MediaWiki-extensions-WikibaseClient, 10Wikidata, and 4 others: Strong reduction of computing time at Wikivoyage needed - https://phabricator.wikimedia.org/T189409#4043427 (10RolandUnger) @thiemowmde Of course I can wait until Wednesday/Thursday to test it again. T... [15:59:07] I am going to add the need to sync with clound on several fronts [15:59:13] marostegui ^ [15:59:17] oki [16:00:35] normally it is you who copy things and know I don't know what I edited :-) [16:01:40] xDDDDD [16:18:41] marostegui: if there is something to say about decom, maybe you can do it? [16:18:53] yep [16:18:57] I was planning to do so [16:19:04] as I have worked on that last week [16:20:56] you do the database part? [16:21:00] or should I? [16:21:56] jynus: ^ [16:34:18] marostegui: you can do the goal planning instead? [16:34:22] I have talked too much [16:34:41] yep [17:06:22] 10DBA, 10Gerrit, 10Operations, 10Patch-For-Review, 10Release-Engineering-Team (Next): Gerrit is failing to connect to db on gerrit2001 thus preventing systemd from working - https://phabricator.wikimedia.org/T176532#4043863 (10Dzahn) Let's not set it to role::spare::system please. That would mean activel... [18:23:28] 10DBA, 10MediaWiki-Platform-Team (MWPT-Q3-Jan-Mar-2018), 10Patch-For-Review, 10Schema-change: Fix WMF schemas to not break when comment store goes WRITE_NEW - https://phabricator.wikimedia.org/T187089#4044288 (10Marostegui) @Anomie during our SRE initial quarterly goal discussion there have been some chats... [19:12:54] 10DBA, 10MediaWiki-Platform-Team (MWPT-Q3-Jan-Mar-2018), 10Patch-For-Review, 10Schema-change: Fix WMF schemas to not break when comment store goes WRITE_NEW - https://phabricator.wikimedia.org/T187089#4044515 (10Anomie) I have no deadlines on this so it's not a serious issue, but I'd prefer not to have thi... [23:52:27] 10DBA, 10Gerrit, 10Operations, 10Patch-For-Review, 10Release-Engineering-Team (Next): Gerrit is failing to connect to db on gerrit2001 thus preventing systemd from working - https://phabricator.wikimedia.org/T176532#4045167 (10Dzahn) p:05Low>03Normal We still want this just as before. We were just as...