[08:09:43] 10DBA, 10Analytics, 10Analytics-EventLogging, 10ImageMetrics: Drop EventLogging tables for ImageMetricsLoadingTime and ImageMetricsCorsSupport - https://phabricator.wikimedia.org/T141407#3113686 (10Tgr) Probably some Labs box or personal vagrant install still has ImageMetrics installed. I guess this is a m... [08:49:20] 10DBA, 10Wikidata: Wikibase\Repo\Store\Sql\SqlEntitiesWithoutTermFinder::getEntitiesWithoutTerm can take 19 hours to execute and it is run by the web requests user - https://phabricator.wikimedia.org/T160887#3113697 (10jcrespo) [09:44:37] 10DBA, 06Operations, 10ops-eqiad: db1094 crash - https://phabricator.wikimedia.org/T160832#3113761 (10jcrespo) [11:23:32] 10DBA, 06Labs, 10Labs-Infrastructure, 06Operations, 13Patch-For-Review: labsdb1006/1007 (postgresql) maintenance - https://phabricator.wikimedia.org/T157359#3114061 (10ops-monitoring-bot) Script wmf_auto_reimage was launched by jynus on neodymium.eqiad.wmnet for hosts: ``` ['labsdb1006.eqiad.wmnet'] ```... [12:30:42] 10DBA, 10Expiring-Watchlist-Items, 10MediaWiki-Watchlist, 06TCB-Team, and 2 others: Allow setting the watchlist table to read-only on a per-wiki basis - https://phabricator.wikimedia.org/T160062#3087424 (10Addshore) a:03Addshore [12:34:21] 10DBA, 06Labs, 10Labs-Infrastructure, 06Operations, 13Patch-For-Review: labsdb1006/1007 (postgresql) maintenance - https://phabricator.wikimedia.org/T157359#3114181 (10ops-monitoring-bot) Completed auto-reimage of hosts: ``` ['labsdb1006.eqiad.wmnet'] ``` Of which those **FAILED**: ``` set(['labsdb1006.... [15:00:38] 10DBA, 10Analytics, 10Analytics-EventLogging, 10ImageMetrics: Drop EventLogging tables for ImageMetricsLoadingTime and ImageMetricsCorsSupport - https://phabricator.wikimedia.org/T141407#3114522 (10Nuria) >Probably some Labs box or personal vagrant install still has ImageMetrics installed. ' Neither would... [15:52:10] 10DBA, 06Labs, 10Labs-Infrastructure, 06Operations, 13Patch-For-Review: Migrate labsdb1005/1006/1007 to jessie - https://phabricator.wikimedia.org/T123731#3114714 (10Dzahn) I see that labs1005/1006/1007 are all either re-installed or down. They don't show up as precise anymore when checking with salt.... [15:54:37] 10DBA, 06Labs, 10Labs-Infrastructure, 06Operations, 13Patch-For-Review: Migrate labsdb1005/1006/1007 to jessie - https://phabricator.wikimedia.org/T123731#3114717 (10jcrespo) Dzhan- the "reinstall as jessie" part is done, but the setup of the passive replica is not 100% complete. It will take one commit... [15:57:59] 10DBA, 06Labs, 10Labs-Infrastructure, 06Operations, 13Patch-For-Review: Migrate labsdb1005/1006/1007 to jessie - https://phabricator.wikimedia.org/T123731#3114742 (10Dzahn) Got it, and thank you very much. [16:53:00] 10DBA, 06Analytics-Kanban, 13Patch-For-Review: Change length of userAgent column on EL tables - https://phabricator.wikimedia.org/T160454#3114957 (10Nuria) @Marostegui I think @otto can run script in our end, let us know if that is OK with you and we will take a small outage and run script tomorrow [16:55:23] 10DBA, 06Analytics-Kanban, 13Patch-For-Review: Change length of userAgent column on EL tables - https://phabricator.wikimedia.org/T160454#3114962 (10jcrespo) @Marostegui is out today- if you can wait, I would wait one extra day to be sure he can make it. [17:36:06] 10DBA, 06Operations, 10Wikimedia-General-or-Unknown: Spurious completely empty `image` table row on commonswiki - https://phabricator.wikimedia.org/T155769#3115113 (10matmarex) I ran this query: P5085 to find out if any other wikis are affected – and yes, enwiki has the same problem. https://en.wikipedia.org... [18:19:49] 10DBA, 06Analytics-Kanban, 13Patch-For-Review: Change length of userAgent column on EL tables - https://phabricator.wikimedia.org/T160454#3099166 (10Tbayer) Sorry folks, am I reading this correctly: All active EL tables will be renamed and replaced by the new version (with the parsed UAs)? That would be a pr... [18:25:50] 10DBA, 06Analytics-Kanban, 13Patch-For-Review: Change length of userAgent column on EL tables - https://phabricator.wikimedia.org/T160454#3115312 (10Nuria) >That would be a pretty disruptive change, which at the very least should be announced beforehand to minimize confusion about unexpected results and give... [18:38:33] 10DBA, 06Analytics-Kanban, 13Patch-For-Review: Change length of userAgent column on EL tables - https://phabricator.wikimedia.org/T160454#3115371 (10Tbayer) >>! In T160454#3115312, @Nuria wrote: >>That would be a pretty disruptive change, which at the very least should be announced beforehand to minimize con... [22:45:47] 10DBA, 10Analytics, 10Analytics-EventLogging, 10ImageMetrics: Drop EventLogging tables for ImageMetricsLoadingTime and ImageMetricsCorsSupport - https://phabricator.wikimedia.org/T141407#3116413 (10Tgr) Some broken spider then, which has cached some old JS for infinity. All requests are from the same clien...