[00:52:38] 10DBA, 10Analytics, 10Operations, 10User-Elukey: Prep to decommission old dbstore hosts (db1046, db1047) - https://phabricator.wikimedia.org/T156844#3746363 (10Tgr) Checking how much different user cohorts (bucketed by editcount) click on a button, for example. If it can be done in Hadoop, that sounds gre... [06:42:39] 10DBA, 10Operations, 10hardware-requests, 10ops-eqiad, 10Patch-For-Review: Decommission db1015 - https://phabricator.wikimedia.org/T173570#3746654 (10Marostegui) >>! In T173570#3745891, @Cmjohnson wrote: > @marostegui during my decom checks I found db1015 in this file. Should a replacement be identified... [14:02:57] 10DBA, 10Analytics, 10Operations, 10User-Elukey: Prep to decommission old dbstore hosts (db1046, db1047) - https://phabricator.wikimedia.org/T156844#3747806 (10Ottomata) > Would there be a separate webrequest hadoop access and EL-only Hadoop access? It doesn't work 100% as it should, but for Hadoop access... [14:19:42] marostegui: o/ [14:19:57] would you have time next week to migrate db1046 to db1107 ? [14:45:01] elukey: sure! (day off today here,sorry!) [14:49:43] argh sorryyyyyyy [14:49:47] :( :( [15:13:56] 10DBA, 10Data-Services, 10Quarry: Raise concurrent mysql connection limit for Quarry (or throttle application concurrency) - https://phabricator.wikimedia.org/T180141#3748147 (10bd808) [15:29:14] 10DBA, 10Data-Services, 10Quarry: Raise concurrent mysql connection limit for Quarry (or throttle application concurrency) - https://phabricator.wikimedia.org/T180141#3748196 (10zhuyifei1999) There may be as many as 48 celery workers: {P6298} [16:23:08] 10DBA, 10Cloud-Services, 10User-Jayprakash12345, 10cloud-services-team (Kanban): Prepare and check storage layer for hif.wiktionary - https://phabricator.wikimedia.org/T173647#3748337 (10aborrero) a:03aborrero [16:23:57] 10DBA, 10Cloud-Services, 10User-Jayprakash12345, 10cloud-services-team (Kanban): Prepare and check storage layer for hif.wiktionary - https://phabricator.wikimedia.org/T173647#3535715 (10bd808) @aborrero the instructions for what to do next are at: https://wikitech.wikimedia.org/wiki/Add_a_wiki#Cloud_Servi... [16:27:26] 10DBA, 10Cloud-Services, 10User-Jayprakash12345, 10cloud-services-team (Kanban): Prepare and check storage layer for hif.wiktionary - https://phabricator.wikimedia.org/T173647#3748342 (10bd808) `$ sql hifwiktionary`: actually this one will not work until a patch for `hieradata/common/profile/openstack/base... [16:29:25] 10DBA, 10Cloud-Services, 10User-Jayprakash12345, 10cloud-services-team (Kanban): Prepare and check storage layer for hif.wiktionary - https://phabricator.wikimedia.org/T173647#3748348 (10Reedy) >>! In T173647#3748342, @bd808 wrote: > `$ sql hifwiktionary`: actually this one will not work until a patch for... [16:41:12] 10DBA, 10Cloud-Services, 10User-Jayprakash12345, 10cloud-services-team (Kanban): Prepare and check storage layer for hif.wiktionary - https://phabricator.wikimedia.org/T173647#3748361 (10aborrero) As this is my first time doing this, I will paste here the results for the record: > aborrero@labsdb1003:~$... [16:42:03] 10DBA, 10Cloud-Services, 10User-Jayprakash12345, 10cloud-services-team (Kanban): Prepare and check storage layer for hif.wiktionary - https://phabricator.wikimedia.org/T173647#3748363 (10aborrero) More: > aborrero@labsdb1003:~$ /usr/local/sbin/maintain-meta_p --mysql-socket /tmp/mysql.sock --databases hif... [16:44:35] 10DBA, 10Cloud-Services, 10User-Jayprakash12345, 10cloud-services-team (Kanban): Prepare and check storage layer for hif.wiktionary - https://phabricator.wikimedia.org/T173647#3748364 (10aborrero) next: > aborrero@labsdb1009:~$ /usr/local/sbin/maintain-views --databases hifwiktionary --debug > 2017-11-09... [16:45:52] 10DBA, 10Cloud-Services, 10User-Jayprakash12345, 10cloud-services-team (Kanban): Prepare and check storage layer for hif.wiktionary - https://phabricator.wikimedia.org/T173647#3748368 (10aborrero) next: > aborrero@labsdb1009:~$ /usr/local/sbin/maintain-meta_p --databases hifwiktionary > /usr/lib/python2... [16:48:01] 10DBA, 10Cloud-Services, 10User-Jayprakash12345, 10cloud-services-team (Kanban): Prepare and check storage layer for hif.wiktionary - https://phabricator.wikimedia.org/T173647#3748376 (10aborrero) This one seems to fail: aborrero@labsdb1011:~$ /usr/local/sbin/maintain-views --databases hifwiktionary --deb... [17:57:01] 10DBA, 10Analytics, 10Operations, 10User-Elukey: Prep to decommission old dbstore hosts (db1046, db1047) - https://phabricator.wikimedia.org/T156844#3748567 (10Nuria) @Tgr : i think your use case would work in hadoop as edit data related information is available since the beginning of time, now, it is true... [18:00:30] 10DBA, 10Cloud-Services, 10User-Jayprakash12345, 10cloud-services-team (Kanban): Prepare and check storage layer for hif.wiktionary - https://phabricator.wikimedia.org/T173647#3535715 (10madhuvishy) Also running directly on labsdb1011, ``` madhuvishy@labsdb1011:~$ sudo mysql --skip-ssl -u maintainviews -p... [18:34:15] 10DBA, 10Cloud-Services, 10User-Jayprakash12345, 10cloud-services-team (Kanban): Prepare and check storage layer for hif.wiktionary - https://phabricator.wikimedia.org/T173647#3748644 (10Marostegui) @madhuvishy can you try again on labsdb1011? [18:36:00] 10DBA, 10Data-Services, 10Quarry: Raise concurrent mysql connection limit for Quarry (or throttle application concurrency) - https://phabricator.wikimedia.org/T180141#3748147 (10Marostegui) This user has no limits on the old replicas, how many would be a decent limit on the new ones? I'd rather set some high... [18:47:55] 10DBA, 10Cloud-Services, 10User-Jayprakash12345, 10cloud-services-team (Kanban): Prepare and check storage layer for hif.wiktionary - https://phabricator.wikimedia.org/T173647#3748739 (10madhuvishy) @Marostegui Worked now! what did you have to do? [18:50:52] 10DBA, 10Cloud-Services, 10User-Jayprakash12345, 10cloud-services-team (Kanban): Prepare and check storage layer for hif.wiktionary - https://phabricator.wikimedia.org/T173647#3748750 (10madhuvishy) @aborrero FYI, after Manuel's magic, I've run ``` maintain-views --databases hifwiktionary --debug /usr/loc... [18:52:53] 10DBA, 10Cloud-Services, 10User-Jayprakash12345, 10cloud-services-team (Kanban): Prepare and check storage layer for hif.wiktionary - https://phabricator.wikimedia.org/T173647#3748766 (10Marostegui) >>! In T173647#3748739, @madhuvishy wrote: > @Marostegui Worked now! what did you have to do? Manually gave... [18:54:47] 10DBA, 10Data-Services, 10Quarry: Raise concurrent mysql connection limit for Quarry (or throttle application concurrency) - https://phabricator.wikimedia.org/T180141#3748774 (10bd808) @Marostegui can we set it to 48? That appears to match the current parallel worker queue size. [18:55:59] 10DBA, 10Cloud-Services, 10User-Jayprakash12345, 10cloud-services-team (Kanban): Prepare and check storage layer for hif.wiktionary - https://phabricator.wikimedia.org/T173647#3748775 (10madhuvishy) @Marostegui right, okay. Thanks! Do we have a ticket for this issue? [19:17:24] 10DBA, 10Cloud-Services, 10User-Jayprakash12345, 10cloud-services-team (Kanban): Prepare and check storage layer for hif.wiktionary - https://phabricator.wikimedia.org/T173647#3748834 (10Marostegui) Multiples, it has been commented many times when it arises but we are not actively troubleshooting it as it... [19:49:12] 10DBA: Investigate using macbre/index-digest over WMF MW sql query workload - https://phabricator.wikimedia.org/T180158#3748941 (10Reedy) [20:20:01] 10DBA, 10Schema-change: Drop thread.thread_root_2 indexes - https://phabricator.wikimedia.org/T180164#3749062 (10Reedy) [20:20:05] 10DBA, 10Schema-change: Drop thread.thread_root_2 indexes - https://phabricator.wikimedia.org/T180164#3749076 (10Reedy) p:05Triage>03Lowest [20:24:48] 10DBA, 10Schema-change: Drop ca_repo_author index from mediawikiwiki.code_authors - https://phabricator.wikimedia.org/T180165#3749080 (10Reedy) [20:24:53] 10DBA, 10Schema-change: Drop ca_repo_author index from mediawikiwiki.code_authors - https://phabricator.wikimedia.org/T180165#3749094 (10Reedy) p:05Triage>03Lowest [20:25:45] 10DBA, 10Schema-change: Drop ep_articles_course_id index - https://phabricator.wikimedia.org/T180166#3749095 (10Reedy) [20:28:08] 10DBA, 10Schema-change: Drop ca_repo_author index from mediawikiwiki.code_authors - https://phabricator.wikimedia.org/T180165#3749080 (10Marostegui) Does this require a patch to tables.sql? [20:28:51] 10DBA, 10Schema-change: Drop ep_articles_course_id index - https://phabricator.wikimedia.org/T180166#3749095 (10Marostegui) Do you have a list of wiki? Cheers! [20:30:03] 10DBA, 10Schema-change: Drop ep_articles_course_id index - https://phabricator.wikimedia.org/T180166#3749118 (10Reedy) [20:30:15] 10DBA, 10Schema-change: Drop ep_articles_course_id index - https://phabricator.wikimedia.org/T180166#3749095 (10demon) As a start: ``` 'wmgUseEducationProgram' => [ 'default' => false, 'arwiki' => true, // T59729 'cawiki' => true, // T73381 'cswiki' => true, // T56223 'd... [20:31:11] 10DBA, 10Schema-change: Drop thread.thread_root_2 indexes - https://phabricator.wikimedia.org/T180164#3749124 (10Reedy) Wikis that have it enabled in some way or another ```lang=php 'wmgUseLiquidThreads' => [ // // !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! /... [20:33:42] marostegui: Sorry for making more work :P [20:34:57] 10DBA, 10Schema-change: Drop ca_repo_author index from mediawikiwiki.code_authors - https://phabricator.wikimedia.org/T180165#3749128 (10Reedy) It's not a core MW table, just in the CodeReview extension I will be making patches for the extensions too [21:47:51] 10DBA, 10Schema-change: Drop ep_articles_course_id index - https://phabricator.wikimedia.org/T180166#3749328 (10Reedy) p:05Triage>03Low [22:03:45] 10DBA: Remove duplicate comment_temp indexes - https://phabricator.wikimedia.org/T180162#3749354 (10Anomie) You guess correctly. Technically we could probably just make those unique indexes be the primary keys, but according to T153333#3283613 the PK should cover both columns for associative tables like these (p... [22:30:51] 10DBA: Remove duplicate comment_temp indexes - https://phabricator.wikimedia.org/T180162#3749433 (10Reedy) Obviously they're only temporary tables, so it doesn't matter too much if they're "not perfect" longer term.... >>! In T153333#3283613, @jcrespo wrote: >With an optional unique index on the opposite direc...