[01:11:32] 10DBA, 10Commons, 10Contributors-Team, 10MediaWiki-Watchlist, and 7 others: "2062 Read timeout is reached" DBQueryError when trying to load specific users' watchlists (with +1000 articles) on several wikis - https://phabricator.wikimedia.org/T171027#3628943 (10Mattflaschen-WMF) > Adding rc_type or rc_sourc... [01:35:59] 10DBA, 10Commons, 10Contributors-Team, 10MediaWiki-Watchlist, and 7 others: "2062 Read timeout is reached" DBQueryError when trying to load specific users' watchlists (with +1000 articles) on several wikis - https://phabricator.wikimedia.org/T171027#3628964 (10Bawolff) > They're not fully redundant, since... [16:32:52] 10DBA, 10Operations, 10ops-eqiad: db1100 crashed - https://phabricator.wikimedia.org/T175973#3629465 (10jcrespo) 05Open>03Resolved [17:19:47] 10DBA, 10Toolforge: Hight replag on s1, s3, s5 - https://phabricator.wikimedia.org/T176557#3629533 (10Framawiki) [17:29:50] 10DBA, 10Toolforge: Hight replag on s1, s3, s5 - https://phabricator.wikimedia.org/T176557#3629533 (10jcrespo) I see them 0 on other hosts, have you tried those? ``` wikireplica-analytics.eqiad.wmnet Shard Lag (seconds) Lag (time) s1 0.0000 00:00:00 s2 0.0000 00:00:00 s3 0.0000 00:00:00 s4 0.0000 00:00:00 s5... [17:44:02] 10DBA, 10Toolforge: Hight replag on s1, s3, s5 - https://phabricator.wikimedia.org/T176557#3629566 (10jcrespo) @MahmoudHashemi @Slaporte s52467 / s52467__hashtags seem to be overloading labs hosts with multiple heavy querying connections, generating lang and other user complains, I have throttled the account t... [17:50:23] 10DBA, 10Toolforge: Hight replag on s1, s3, s5 - https://phabricator.wikimedia.org/T176557#3629533 (10mahmoud) It's hard to say what can be done about this without more information. There's user-generated load from visits to http://tools.wmflabs.org/hashtags but there's also batch traffic as well. Both are nec... [17:58:01] 10DBA, 10Toolforge: Hight replag on s1, s3, s5 - https://phabricator.wikimedia.org/T176557#3629585 (10jcrespo) Please create separate accounts for separate tools- if users overload a tool, and it starts to make bad/lots of queries, the full account will get affected. Folks will not get their data if the replic... [18:03:02] 10DBA, 10Toolforge: Hight replag on s1, s3, s5 - https://phabricator.wikimedia.org/T176557#3629589 (10mahmoud) That's an interesting idea. It would really help to have answers to my questions if we are forced to register an account per language. For convenience: * What is the limit on connections per account... [19:19:37] 10DBA, 10Toolforge: High replag on s1, s3, s5 - https://phabricator.wikimedia.org/T176557#3629653 (10Reedy)