[00:57:16] 10DBA, 10Performance-Team, 10WMF-JobQueue, 10Wikimedia-Rdbms, and 2 others: read only on mediawiki generates "LoadBalancer.php: Cannot access the database: Unknown error" - https://phabricator.wikimedia.org/T218692 (10Krinkle) 05Open→03Stalled [00:58:18] 10DBA, 10Performance-Team, 10WMF-JobQueue, 10Wikimedia-Rdbms, and 2 others: read only on mediawiki generates "LoadBalancer.php: Cannot access the database: Unknown error" - https://phabricator.wikimedia.org/T218692 (10Krinkle) >>! In T218692#5290071, @Krinkle wrote: > Maybe we can do it in codfw and then t... [06:59:18] 10DBA, 10Data-Services, 10Quarry: Quarry: Lost connection to MySQL server during query - https://phabricator.wikimedia.org/T246970 (10Mike_Peel) >>! In T246970#5949573, @Stashbot wrote: > {nav icon=file, name=Mentioned in SAL (#wikimedia-cloud), href=https://tools.wmflabs.org/sal/log/AXCxVVNNvrJzePItJ1ya} [2... [08:03:16] 10DBA, 10Data-Services, 10Quarry: Quarry: Lost connection to MySQL server during query - https://phabricator.wikimedia.org/T246970 (10Marostegui) >>! In T246970#5950734, @Mike_Peel wrote: >>>! In T246970#5949573, @Stashbot wrote: >> {nav icon=file, name=Mentioned in SAL (#wikimedia-cloud), href=https://tools... [08:09:08] 10DBA, 10Data-Services, 10Quarry: Quarry: Lost connection to MySQL server during query - https://phabricator.wikimedia.org/T246970 (10Marostegui) >>! In T246970#5950734, @Mike_Peel wrote: >>>! In T246970#5949573, @Stashbot wrote: >> {nav icon=file, name=Mentioned in SAL (#wikimedia-cloud), href=https://tools... [08:11:58] 10DBA, 10Data-Services, 10Quarry: Quarry: Lost connection to MySQL server during query - https://phabricator.wikimedia.org/T246970 (10Mike_Peel) > It is likely that the query is running for more than 4h then. I am executing it on an idle labs replica under root user, to see how long it takes to actually fini... [08:13:46] 10DBA, 10Data-Services, 10Quarry: Quarry: Lost connection to MySQL server during query - https://phabricator.wikimedia.org/T246970 (10Marostegui) >>! In T246970#5950772, @Mike_Peel wrote: >> It is likely that the query is running for more than 4h then. I am executing it on an idle labs replica under root use... [13:05:30] 10DBA, 10Data-Services, 10Quarry: Quarry: Lost connection to MySQL server during query - https://phabricator.wikimedia.org/T246970 (10Mike_Peel) >>! In T246970#5950773, @Marostegui wrote: >>>! In T246970#5950772, @Mike_Peel wrote: >>> It is likely that the query is running for more than 4h then. I am executi... [14:36:17] 10DBA, 10Data-Services, 10Quarry: Quarry: Lost connection to MySQL server during query - https://phabricator.wikimedia.org/T246970 (10Marostegui) It took 22 minutes, so it is entirely possible than on a normal host it might take more than 30 minutes. As I said, I haven't found that query being killed on the... [14:54:03] 10DBA: $wgDBservers does not always equally distribute load - https://phabricator.wikimedia.org/T247167 (10charitwo) [20:19:49] 10DBA, 10Data-Services, 10Quarry: Quarry: Lost connection to MySQL server during query - https://phabricator.wikimedia.org/T246970 (10zhuyifei1999) I don't see quarry's killer doing anything. The last command at T246970#5946798 still yields nothing [21:24:54] 10DBA, 10Data-Services, 10Quarry: Quarry: Lost connection to MySQL server during query - https://phabricator.wikimedia.org/T246970 (10zhuyifei1999) >>! In T246970#5951410, @zhuyifei1999 wrote: > I don't see quarry's killer doing anything. The last command at T246970#5946798 still yields nothing I found that...