[06:58:56] 10DBA, 10Patch-For-Review: wmfmariadbpy/CuminExecution must capture Exception cumin.transports.WorkerError - https://phabricator.wikimedia.org/T218189 (10jcrespo) a:03Guozr.im [07:43:11] 10DBA, 10Data-Services, 10Quarry: Quarry: Lost connection to MySQL server during query - https://phabricator.wikimedia.org/T246970 (10Jdx) @zhuyifei1999: The issue does not seem to be solved. For the last four days I have been continuously getting `Query status: failed Error Sort aborted: Query execution wa... [08:27:12] marostegui: will come to the end of the write migration today [08:27:32] he won't be around these days [08:27:46] aaaaah :) [08:27:53] you can talk to me for big milestones until next week [08:28:27] In that case, jynus: will come to the end of the write migration today :D [08:28:33] :-) [08:29:00] just expect big latencies happening as when one of the 2 is not around [08:29:01] Then we will just need to do a load of cache warming and swithcing on of reads for 25 -> 88 million [09:28:36] finally the Databases old volumes started being recycled [09:28:44] and new ones are being created now [09:29:45] 36 volumes listed vs 24/25 yesterday [09:30:14] maybe the old ones were marked for recycling some time ago [09:32:08] production pool, with a 3 month rentention (without databases) only takes 19TB [09:32:33] with the added snapshots, databases may take a bit more than that [12:53:30] 10DBA, 10Discovery-Search, 10GeoData, 10User-TheDJ: Removal of {{#coordinates:}} leaves DB entries behind - https://phabricator.wikimedia.org/T143366 (10TheDJ) [13:08:30] 10DBA, 10Discovery-Search, 10GeoData, 10User-TheDJ: Removal of {{#coordinates:}} leaves DB entries behind - https://phabricator.wikimedia.org/T143366 (10jcrespo) Any update on when could someone at #Discovery-search could triage this issue? As per T188434#4128506. This issue makes incorrect information sho... [14:03:08] 10DBA, 10OTRS, 10Operations, 10Recommendation-API, 10Research: Upgrade and restart m2 primary database master (db1132) - https://phabricator.wikimedia.org/T246098 (10Marostegui) In the end, this will happen Thursday 19th March 09:00 AM UTC [14:03:19] 10DBA, 10OTRS, 10Operations, 10Recommendation-API, 10Research: Upgrade and restart m2 primary database master (db1132) - https://phabricator.wikimedia.org/T246098 (10Marostegui) [15:35:06] 10DBA, 10Discovery-Search, 10GeoData, 10User-TheDJ: Removal of {{#coordinates:}} leaves DB entries behind - https://phabricator.wikimedia.org/T143366 (10EBernhardson) Do we have any working examples? The linked page has coordinates embedded into the file itself, and these are coordinates reported by the ap... [15:43:43] 10DBA, 10Discovery-Search, 10GeoData, 10User-TheDJ: Removal of {{#coordinates:}} leaves DB entries behind - https://phabricator.wikimedia.org/T143366 (10jcrespo) Not the original reported, and do not know how the extension works. I added the template to a test page: https://commons.wikimedia.org/wiki/User... [15:47:13] 10DBA, 10Discovery-Search, 10GeoData, 10User-TheDJ: Removal of {{#coordinates:}} leaves DB entries behind - https://phabricator.wikimedia.org/T143366 (10jcrespo) >>! In T143366#5964305, @jcrespo wrote: > @MaxSem Do you know if it only supposed to work on File ns? I answer myself, it works on a file ns: h... [15:55:04] 10DBA, 10Discovery-Search, 10GeoData, 10User-TheDJ: Removal of {{#coordinates:}} leaves DB entries behind - https://phabricator.wikimedia.org/T143366 (10jcrespo) Removed them: https://commons.wikimedia.org/w/index.php?title=File:Test_T198177.png&diff=prev&oldid=403649969 The coords are gone from the API:... [16:00:09] 10DBA, 10Discovery-Search, 10GeoData, 10User-TheDJ: Removal of {{#coordinates:}} leaves DB entries behind - https://phabricator.wikimedia.org/T143366 (10EBernhardson) 05Open→03Invalid Sounds reasonable. Based on what I see in GeoData code, if a LinksUpdate job is lost the coordinates will remain in the... [17:09:46] 10DBA, 10Operations, 10Goal, 10Patch-For-Review: Implement logic to be able to perform full and incremental backups of ES hosts - https://phabricator.wikimedia.org/T244884 (10jcrespo) Strategy for analyzing backups changed a bit, I now export the PK used on ranges to verify it is the same as on the live db... [18:15:08] 10DBA, 10Operations, 10Goal, 10Patch-For-Review: Implement logic to be able to perform full and incremental backups of ES hosts - https://phabricator.wikimedia.org/T244884 (10jcrespo) And this is an example of running on the above dump (although I had to remove certain tables that of course, are not append...