[00:53:32] 10DBA, 10MediaWiki-Database, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata, and 3 others: excessive "lock wait timeout exceeded " error rate after deploying 1.33.0-wmf.1 to group1 - https://phabricator.wikimedia.org/T207881 (10mmodell) p:05Unbreak!>03High [01:00:13] 10DBA, 10MediaWiki-Database, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata, and 3 others: excessive "lock wait timeout exceeded " error rate after deploying 1.33.0-wmf.1 to group1 - https://phabricator.wikimedia.org/T207881 (10Addshore) This shouldn't be a blocker for the train, we gets spikes of t... [01:05:10] 10DBA, 10MediaWiki-Database, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata, and 3 others: excessive "lock wait timeout exceeded " error rate after deploying 1.33.0-wmf.1 to group1 - https://phabricator.wikimedia.org/T207881 (10mmodell) [13:07:40] 10DBA, 10Research, 10Patch-For-Review: Request to create database and account for recommendation API - https://phabricator.wikimedia.org/T205294 (10bmansurov) @jcrespo can you share the password for the 'recommendationapi' user so that I can load some data into the database (I don't have access to the privat... [17:06:52] 10DBA, 10MediaWiki-Database, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata, and 3 others: excessive "lock wait timeout exceeded " error rate after deploying 1.33.0-wmf.1 to group1 - https://phabricator.wikimedia.org/T207881 (10Addshore) It does look like this is occurring more recently. https://log... [17:11:16] 10DBA, 10MediaWiki-Database, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata, and 4 others: excessive "lock wait timeout exceeded " error rate after deploying 1.33.0-wmf.1 to group1 - https://phabricator.wikimedia.org/T207881 (10Addshore) [20:00:37] 10DBA, 10MediaWiki-API, 10MediaWiki-Database: prop=revisions API timing out for a specific user and pages they edited - https://phabricator.wikimedia.org/T197486 (10MusikAnimal) Not sure if we're on the new MariaDB that was meant to fix the issue, but the issue apparently still stands: https://en.wikipedia.... [20:02:24] 10DBA, 10MediaWiki-API, 10MediaWiki-Database: prop=revisions API timing out for a specific user and pages they edited - https://phabricator.wikimedia.org/T197486 (10Anomie) I'm pretty sure we're not on 10.1.37 yet. [21:35:06] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review, 10Schema-change: Dropping rc_cur_time on wmf databases - https://phabricator.wikimedia.org/T67448 (10Pppery) [21:48:56] 10DBA, 10Patch-For-Review, 10User-Banyek, 10Wikimedia-Incident: Compare a few tables per section between hosts and DC - https://phabricator.wikimedia.org/T207253 (10Banyek) This is a WIP open discussion doucument which should be merged here at the end: https://docs.google.com/document/d/1Y9h3z50YPiLaV5-HbT...