[04:47:13] 10DBA: Drop "trackbacks" table on all wikis that have it - https://phabricator.wikimedia.org/T175051#3638425 (10Marostegui) [04:47:41] 10DBA, 10Epic, 10Tracking: Database tables to be dropped on Wikimedia wikis and other WMF databases (tracking) - https://phabricator.wikimedia.org/T54921#3638429 (10Marostegui) [04:47:44] 10DBA: Drop "trackbacks" table on all wikis that have it - https://phabricator.wikimedia.org/T175051#3581131 (10Marostegui) 05Open>03Resolved a:03Marostegui All done in s3 [06:40:44] 10DBA, 10Operations, 10ops-codfw: db2044 HW RAID failure - https://phabricator.wikimedia.org/T174764#3638520 (10Marostegui) a:05Marostegui>03Papaul I have rebooted the server via ILO as there were not much I could debug in this status: ``` [06:28:34] root@db2044:~# df -hT -bash: /bin/df: Input/output err... [06:46:26] 10DBA: Convert unique keys into primary keys for some wiki tables on s6-eqiad and codfw - https://phabricator.wikimedia.org/T163979#3638526 (10Marostegui) codfw is finished [06:46:34] 10DBA: Convert unique keys into primary keys for some wiki tables on s6-eqiad and codfw - https://phabricator.wikimedia.org/T163979#3638527 (10Marostegui) [06:46:42] 10DBA, 10Epic, 10Patch-For-Review, 10codfw-rollout: Database maintenance scheduled while eqiad datacenter is non primary (after the DC switchover) - https://phabricator.wikimedia.org/T155099#3638529 (10Marostegui) [06:46:45] 10DBA, 10MediaWiki-Database, 10Patch-For-Review, 10PostgreSQL, 10Schema-change: Some tables lack unique or primary keys, may allow confusing duplicate data - https://phabricator.wikimedia.org/T17441#3638530 (10Marostegui) [06:56:11] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review: Drop now redundant indexes from pagelinks and templatelinks - https://phabricator.wikimedia.org/T174509#3638543 (10Marostegui) [07:13:38] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review: Drop now redundant indexes from pagelinks and templatelinks - https://phabricator.wikimedia.org/T174509#3564203 (10Marostegui) [07:18:31] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review: Drop now redundant indexes from pagelinks and templatelinks - https://phabricator.wikimedia.org/T174509#3638567 (10Marostegui) [07:39:32] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review: Drop now redundant indexes from pagelinks and templatelinks - https://phabricator.wikimedia.org/T174509#3638623 (10Marostegui) >>! In T174509#3635209, @Marostegui wrote: > s6 has been done in eqiad. > I just realised that s6 in codfw, for templatelinks a... [07:40:05] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review: Drop now redundant indexes from pagelinks and templatelinks - https://phabricator.wikimedia.org/T174509#3638624 (10Marostegui) [07:40:46] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review: Drop now redundant indexes from pagelinks and templatelinks - https://phabricator.wikimedia.org/T174509#3564203 (10Marostegui) a:03Marostegui [07:41:54] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review: Drop now redundant indexes from pagelinks and templatelinks - https://phabricator.wikimedia.org/T174509#3564203 (10Marostegui) [08:08:15] 10DBA, 10Patch-For-Review: Productionize 11 new eqiad database servers - https://phabricator.wikimedia.org/T172679#3638670 (10Marostegui) >>! In T172679#3635468, @jcrespo wrote: > Yes, although we may need still an extra host for vlow/dumps, separate from the other services, and smaller in size. Any ideas abou... [08:52:17] 10DBA: Larger Wikidata entity dump queries - https://phabricator.wikimedia.org/T176760#3638733 (10Marostegui) 05Open>03Resolved p:05Triage>03Normal a:03Marostegui So, those two queries are pretty fast (0.01 sec) in the slowest slave of wikdata, if you even mention there will be even less queries. That... [08:52:56] 10DBA: Larger Wikidata entity dump queries - https://phabricator.wikimedia.org/T176760#3638742 (10hoo) Great, thanks for checking! [08:55:54] 10DBA: Larger Wikidata entity dump queries - https://phabricator.wikimedia.org/T176760#3638751 (10Marostegui) >>! In T176760#3638742, @hoo wrote: > Great, thanks for checking! Let's keep an eye on the first iterations to check that they are indeed fine. Otherwise, let's revisit them [09:21:55] 10DBA, 10Patch-For-Review: Productionize 11 new eqiad database servers - https://phabricator.wikimedia.org/T172679#3638819 (10Marostegui) >>! In T172679#3634595, @Marostegui wrote: > I would like to decommission db1035 from s3, it is low on disk space. > According to https://gerrit.wikimedia.org/r/#/c/338996/1... [09:22:24] 10DBA, 10Patch-For-Review: Productionize 11 new eqiad database servers - https://phabricator.wikimedia.org/T172679#3638820 (10Marostegui) [13:19:52] 10DBA: Larger Wikidata entity dump queries - https://phabricator.wikimedia.org/T176760#3639505 (10ArielGlenn) Changeset merged and deployed, I guess we'll see the impact next Monday, let's have it in mind then. [13:20:38] 10DBA: Larger Wikidata entity dump queries - https://phabricator.wikimedia.org/T176760#3639513 (10Marostegui) >>! In T176760#3639505, @ArielGlenn wrote: > Changeset merged and deployed, I guess we'll see the impact next Monday, let's have it in mind then. Thanks for the heads up! [14:48:04] 10DBA, 10Operations, 10ops-codfw: db2044 HW RAID failure - https://phabricator.wikimedia.org/T174764#3639885 (10Papaul) Dear Mr Papaul Tshibamba, Thank you for contacting Hewlett Packard Enterprise for your service request. This email confirms your request for service and the details are below. Your reques... [15:33:40] 10Blocked-on-schema-change, 10DBA, 10Community-Liaisons (Oct-Dec 2017): Help communicate read-only time for Commons for schema change required by adding 3D filetype - https://phabricator.wikimedia.org/T176883#3640012 (10CKoerner_WMF) [15:33:52] 10Blocked-on-schema-change, 10DBA, 10Community-Liaisons (Oct-Dec 2017): Help communicate read-only time for Commons for schema change required by adding 3D filetype - https://phabricator.wikimedia.org/T176883#3640028 (10CKoerner_WMF) a:05MarkTraceur>03CKoerner_WMF [15:34:26] 10DBA, 10Operations, 10ops-codfw: db2044 HW RAID failure - https://phabricator.wikimedia.org/T174764#3640031 (10Marostegui) Thank you! [15:41:33] 10Blocked-on-schema-change, 10DBA, 10Community-Liaisons (Oct-Dec 2017): Help communicate read-only time for Commons for schema change required by adding 3D filetype - https://phabricator.wikimedia.org/T176883#3640048 (10Marostegui) Thank you @CKoerner_WMF for managing this! How much do we need: 30 minutes Wh... [15:47:54] 10DBA, 10Dumps-Generation, 10MediaWiki-Database, 10Utilities-mwdumper: Wikipedia requires a patch to load its data from the dumps with mwdumper - https://phabricator.wikimedia.org/T147148#3640063 (10brion) a:03brion Going to land a couple maintenance patches this weekend, adding this to my queue. [15:53:30] 10DBA, 10Patch-For-Review: Productionize 11 new eqiad database servers - https://phabricator.wikimedia.org/T172679#3640075 (10Marostegui) [16:42:33] 10DBA, 10Data-Services, 10Goal, 10cloud-services-team (FY2017-18): Decommission labsdb1001 and labsdb1003 - https://phabricator.wikimedia.org/T142807#3640266 (10bd808)