[00:02:53] 6Labs, 10Labs-Infrastructure, 10labs-sprint-117, 10labs-sprint-118, and 3 others: Move project membership/assignment from ldap to keystone mysql - https://phabricator.wikimedia.org/T115029#2026035 (10Andrew) This migration is done, and was followed by half a dozen OSM patches to mop up bugs and improve per... [01:02:16] !log tools.stashbot Post `restart` test {T126419} [01:02:20] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stashbot/SAL, Master [01:06:26] !log tools.stashbot bd808/tools-stashbot#1 (master - 22f54c4 Bryan Davis): The build passed. - https://travis-ci.org/bd808/tools-stashbot/builds/109092935 [01:06:31] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stashbot/SAL, Master [01:44:12] 6Labs, 10Gerrit: Review privacy policy re: email, labs, gerrit, ldap, etc. - https://phabricator.wikimedia.org/T126896#2026202 (10Andrew) 3NEW [02:31:11] 6Labs, 10Labs-Infrastructure, 10wikitech.wikimedia.org: Shell Access Request form does not have a watch button - https://phabricator.wikimedia.org/T63104#2026237 (10Krenair) [02:34:17] 6Labs, 10Labs-Infrastructure, 10wikitech.wikimedia.org: Shell Access Request form does not have a watch button - https://phabricator.wikimedia.org/T63104#2026244 (10Krenair) 5Open>3Resolved a:3Krenair Sorry for all the confusion. https://wikitech.wikimedia.org/w/index.php?title=Form:Shell_Access_Reques... [02:56:07] 6Labs, 10Beta-Cluster-Infrastructure, 5Patch-For-Review: New labs instance fails running `block-for-project-export` before running mount - https://phabricator.wikimedia.org/T126568#2026257 (10scfc) This happens for `toolsbeta-puppetmaster4.toolsbeta.eqiad.wmflabs` as well: ``` scfc@toolsbeta-puppetmaster4:~... [03:01:25] 6Labs, 10Beta-Cluster-Infrastructure, 5Patch-For-Review: New labs instance fails running `block-for-project-export` before running mount - https://phabricator.wikimedia.org/T126568#2026263 (10scfc) Cf. also T122250 where @chasemp increased the timeout for `nfs-exports-daemon` to five seconds. If I try to qu... [05:12:08] !log tools.stashbot bd808/tools-stashbot#2 (master - 7f51fbf Bryan Davis): The build passed. - https://travis-ci.org/bd808/tools-stashbot/builds/109112611 [05:12:11] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stashbot/SAL, Master [05:21:25] !log tools.stashbot bd808/tools-stashbot#3 (master - cb95bea Bryan Davis): The build passed. - https://travis-ci.org/bd808/tools-stashbot/builds/109113152 [05:21:27] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stashbot/SAL, Master [05:31:34] !log tools.stashbot bd808/tools-stashbot#4 (master - b349296 Bryan Davis): The build passed. - https://travis-ci.org/bd808/tools-stashbot/builds/109113976 [05:31:37] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stashbot/SAL, Master [05:37:15] Hey stashbot, what is T2001? [05:37:15] T2001: Documentation is out of date, incomplete (tracking) - https://phabricator.wikimedia.org/T2001 [05:37:19] :) [06:22:41] What is the password for a tools.? I don't think I provided a password when created the project.. [07:22:36] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Tulsi Bhagat was created, changed by Tulsi Bhagat link https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Tulsi_Bhagat edit summary: Created page with "{{Tools Access Request |Justification=I'm planing to use the tools project for nepali wiki & maithili wiki. Nepali wiki has on-going Women Edit-a-thon programme and maithili w..." [07:23:17] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Tulsi Bhagat was modified, changed by Tulsi Bhagat link https://wikitech.wikimedia.org/w/index.php?diff=305194 edit summary: [07:25:21] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Tulsi Bhagat was modified, changed by Tulsi Bhagat link https://wikitech.wikimedia.org/w/index.php?diff=305195 edit summary: link added [08:08:40] bd808: that's awesome [10:07:33] 10Tool-Labs-tools-Other, 7Accessibility: WIWOSM: Options cannot go away - https://phabricator.wikimedia.org/T126673#2026403 (10Vriullop) Original source is https://meta.wikimedia.org/wiki/MediaWiki:OSM.js. On fr.wiki it is https://fr.wikipedia.org/wiki/MediaWiki:Gadget-osm.js. Original documentation is at http... [13:56:25] !log tools.stashbot bd808/tools-stashbot#5 (master - 186f4aa Bryan Davis): The build passed. - https://travis-ci.org/bd808/tools-stashbot/builds/109161172 [13:56:30] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stashbot/SAL, Master [14:16:06] !log tools.stashbot Updated to 186f4aa; commands and phab task mentions now ignored for a large number of known bots [14:16:10] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stashbot/SAL, Master [14:51:27] 6Labs: Create a Labs project for video2commons - https://phabricator.wikimedia.org/T124387#2026670 (10Danny_B) [14:52:17] 6Labs: Create a labs project for Wikimedia Venezuela' Engineering Technology Committee - https://phabricator.wikimedia.org/T119661#2026672 (10Danny_B) [14:52:53] 6Labs: create labs project for better support of ContentTranslation for Korea - https://phabricator.wikimedia.org/T119063#2026674 (10Danny_B) [15:03:10] 6Labs, 5Patch-For-Review, 7Tracking: Make OpenStack Horizon useful for production labs - https://phabricator.wikimedia.org/T87279#2026687 (10Danny_B) NOTE: This [[ https://www.mediawiki.org/wiki/Phabricator/Project_management/Tracking_tasks | tracking task ]] should be converted to [[ https://www.mediawiki.o... [15:16:21] 6Labs, 5Patch-For-Review: Create web-proxy editing panel in Horizon - https://phabricator.wikimedia.org/T124183#2026722 (10Danny_B) [15:22:28] 6Labs: Create QueryrAPI project - https://phabricator.wikimedia.org/T119311#2026742 (10Danny_B) [15:23:31] 6Labs: New Labs Project ArticlePlaceholderWiki - https://phabricator.wikimedia.org/T116771#2026748 (10Danny_B) [15:24:45] 6Labs, 6Increasing content coverage: Create labs project for art-recs - https://phabricator.wikimedia.org/T115723#2026770 (10Danny_B) [15:26:09] Jyothis: Can you add an answer to https://phabricator.wikimedia.org/T125934#2000978? I'm trying to clean up the project creators backlog, so this would help ;) [15:27:55] btw, if you need help with this, you can ask me [15:30:04] 6Labs: Create k8s-eval project - https://phabricator.wikimedia.org/T107994#2026804 (10Danny_B) [15:30:49] 6Labs, 15User-bd808: Create stashbot project - https://phabricator.wikimedia.org/T107047#2026806 (10Danny_B) [15:31:00] 6Labs: New project: ORES - https://phabricator.wikimedia.org/T105908#2026809 (10Danny_B) [15:31:16] 6Labs: Instance for running OpenOCR (OCR as a service) in a Docker container - https://phabricator.wikimedia.org/T105584#2026813 (10Danny_B) [15:31:35] 6Labs: New project: WikidataLDF - https://phabricator.wikimedia.org/T105457#2026815 (10Danny_B) [15:33:36] 6Labs, 7Tracking: New Labs project requests (tracking) - https://phabricator.wikimedia.org/T76375#2026836 (10Danny_B) [15:34:06] 6Labs: Elee Labs Project - https://phabricator.wikimedia.org/T104170#2026837 (10Danny_B) [15:34:17] 6Labs: Create labs project for analysis of recent changes and user contributions - https://phabricator.wikimedia.org/T104144#2026839 (10Danny_B) [15:35:32] 6Labs: Labs Project for Phragile - https://phabricator.wikimedia.org/T99672#2026842 (10Danny_B) [15:35:43] 6Labs: create "Furutani-bot" project (drop) - https://phabricator.wikimedia.org/T98732#2026854 (10Danny_B) [15:35:53] 6Labs: Create Labs Project for WikidataPageBanner extension - https://phabricator.wikimedia.org/T98537#2026856 (10Danny_B) [15:36:03] 6Labs, 10Web-APIs-Hub: Create Labs project for "Data and developer hub" prototype - https://phabricator.wikimedia.org/T98275#2026858 (10Danny_B) [15:36:19] 6Labs: Create spam honeypot Labs project for extension to identify and delete spam pages - https://phabricator.wikimedia.org/T98174#2026863 (10Danny_B) [15:37:19] 6Labs, 10MediaWiki-extensions-Newsletter: Create Labs project for Newsletter Extension - https://phabricator.wikimedia.org/T97523#2026868 (10Danny_B) [15:37:29] 6Labs: WikiBrain - https://phabricator.wikimedia.org/T96950#2026870 (10Danny_B) [15:39:44] 6Labs: Project for WMT - https://phabricator.wikimedia.org/T93629#2026886 (10Danny_B) [15:41:43] 6Labs: Shutdown Gather labs Project - https://phabricator.wikimedia.org/T105038#2026893 (10Danny_B) [15:41:55] 6Labs: Request to create Gather labs project - https://phabricator.wikimedia.org/T89185#2026896 (10Danny_B) [15:42:06] 6Labs, 10Staging: Create staging project - https://phabricator.wikimedia.org/T88439#2026897 (10Danny_B) [15:42:16] 6Labs: Create butterfly project for testing - https://phabricator.wikimedia.org/T88235#2026902 (10Danny_B) [15:42:30] 6Labs, 10Wikimedia-Fundraising, 10Wikimedia-Fundraising-CiviCRM: Create new labs project: fundraising-integration - https://phabricator.wikimedia.org/T88599#2026904 (10Danny_B) [15:42:42] 6Labs: create ORES project in Labs - https://phabricator.wikimedia.org/T87494#2026905 (10Danny_B) [15:42:57] 6Labs: irc bouncer project - https://phabricator.wikimedia.org/T87442#2026908 (10Danny_B) [16:23:46] 6Labs: Request new project - https://phabricator.wikimedia.org/T122678#2027049 (10Danny_B) [16:23:59] 6Labs, 10Tool-Labs: Request for mono-complete package on wmflabs - https://phabricator.wikimedia.org/T122551#2027058 (10Danny_B) [16:54:03] Luke081515: will check in a bit. [16:54:10] ok, thanks [16:54:23] Luke081515: sorry, firefighting at work :) [16:54:28] np [16:57:37] Why in the world does /usr/bin/job return an exit status of 1 (failure) if the job is found to be running? [16:57:53] * bd808 grumbles and hacks up his scripts to deal with it [17:02:12] 6Labs, 10Tool-Labs, 6Project-Creators: Create a project to bring Jyothis' old toolserver tools back to life - https://phabricator.wikimedia.org/T125934#2027184 (10Jyothis) Made the project jtools under tools. thanks for the pointer. [17:02:24] Luke081515: good enuf? [17:03:34] Jyothis: Yeah, thanks. I will close the task now ;) [17:03:45] 6Labs, 10Tool-Labs, 6Project-Creators: Create a project to bring Jyothis' old toolserver tools back to life - https://phabricator.wikimedia.org/T125934#2027185 (10Luke081515) 5Open>3Resolved [17:03:47] Thanks. [18:02:03] Labs admin here? [18:02:11] I need help for one of my instnaces [18:02:14] *instances [18:14:03] 10Labs-Other-Projects: Succesful pilot of Discourse on https://discourse.wmflabs.org/ as an alternative to wikimedia-l mailinglist - https://phabricator.wikimedia.org/T124690#2027320 (10AdHuikeshoven) >>! In T124690#2025074, @Steko wrote: > Re: Multi lingual interface. Discourse has an internationalised interfac... [18:20:42] problem solved [18:31:06] 6Labs: Unable to change projects in horizon - https://phabricator.wikimedia.org/T123310#2027326 (10Luke081515) p:5Triage>3High Going to triage this as high, because this prevents user to work with horizon, and it is very anoying. [19:12:49] 6Labs, 10Tool-Labs, 7Tracking: Install inkscape - https://phabricator.wikimedia.org/T126933#2027357 (10Rschen7754) 3NEW [20:43:39] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Tulsi Bhagat was modified, changed by Tim Landscheidt link https://wikitech.wikimedia.org/w/index.php?diff=305462 edit summary: [20:44:03] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Tulsi Bhagat was modified, changed by Tim Landscheidt link https://wikitech.wikimedia.org/w/index.php?diff=305463 edit summary: Reverted edits by [[Special:Contributions/Tim Landscheidt|Tim Landscheidt]] ([[User talk:Tim Landscheidt|talk]]) to last revision by [[User:Tulsi Bhagat|Tulsi Bhagat]] [20:47:56] 6Labs, 10Labs-Infrastructure, 10Tool-Labs, 10wikitech.wikimedia.org: @scfc cannot add a user to the Tools project: "You must be a member of the projectadmin role in project to perform this action." - https://phabricator.wikimedia.org/T126937#2027424 (10scfc) 3NEW [20:54:25] 6Labs, 10Labs-Infrastructure, 10MediaWiki-extensions-OpenStackManager, 10Tool-Labs, 10wikitech.wikimedia.org: @scfc cannot add a user to the Tools project: "You must be a member of the projectadmin role in project to perform this action." - https://phabricator.wikimedia.org/T126937#2027439 (10Krenair) [21:04:17] !log tools.stashbot bd808/tools-stashbot#6 (master - be7c3e9 Bryan Davis): The build passed. - https://travis-ci.org/bd808/tools-stashbot/builds/109221117 [21:04:21] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stashbot/SAL, Master [21:16:23] 6Labs, 10Labs-Infrastructure, 10MediaWiki-extensions-OpenStackManager, 10Tool-Labs, 10wikitech.wikimedia.org: @scfc cannot add a user to the Tools project: "You must be a member of the projectadmin role in project to perform this action." - https://phabricator.wikimedia.org/T126937#2027458 (10valhallasw)... [21:24:10] !log tools.stashbot bd808/tools-stashbot#7 (master - 870f446 Bryan Davis): The build passed. - https://travis-ci.org/bd808/tools-stashbot/builds/109224523 [21:24:13] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stashbot/SAL, Master [21:29:50] valhallasw`cloud, am looking into the projectadmin issue [21:32:45] Krenair: ah, ok. I won't touch, then ;-) [21:33:12] ty [21:33:38] > $osnu = new OpenStackNovaUser( 'scfc' ); [21:33:39] > var_dump( $osnu->inRole( 'projectadmin', 'tools' ) ); [21:33:39] bool(false) [21:33:39] > $osnu = new OpenStackNovaUser( 'Tim Landscheidt' ); [21:33:39] > var_dump( $osnu->inRole( 'projectadmin', 'tools' ) ); [21:33:40] bool(true) [21:33:55] I think this is fixed by a commit we have pending against OSM [21:34:34] 6Labs, 10Tool-Labs, 5Patch-For-Review: Install inkscape - https://phabricator.wikimedia.org/T126933#2027476 (10Luke081515) [21:35:13] will change it a little and try it on wikitech [21:35:30] Krenair: why would it use 'scfc' as user, though? [21:35:39] UID [21:36:19] yet it seems to work for me ('valhallasw' vs 'Merlijn van Deen') [21:36:33] but maybe that's because I'm also a cloudadmin on wikitech [21:36:44] yes, cloudadmin lets you bypass the check [21:39:12] 6Labs, 10Labs-Infrastructure, 10MediaWiki-extensions-OpenStackManager, 10Tool-Labs, 10wikitech.wikimedia.org: @scfc cannot add a user to the Tools project: "You must be a member of the projectadmin role in project to perform this action." - https://phabricator.wikimedia.org/T126937#2027478 (10scfc) No; I... [21:41:11] 6Labs, 10Labs-Infrastructure, 10MediaWiki-extensions-OpenStackManager, 10Tool-Labs, and 2 others: @scfc cannot add a user to the Tools project: "You must be a member of the projectadmin role in project to perform this action." - https://phabricator.wikimedia.org/T126937#2027483 (10Krenair) I put the above... [21:42:22] 6Labs, 10Labs-Infrastructure, 10MediaWiki-extensions-OpenStackManager, 10Tool-Labs, and 2 others: @scfc cannot add a user to the Tools project: "You must be a member of the projectadmin role in project to perform this action." - https://phabricator.wikimedia.org/T126937#2027484 (10scfc) No, the error messa... [21:43:26] 6Labs, 10Labs-Infrastructure, 10MediaWiki-extensions-OpenStackManager, 10Tool-Labs, and 2 others: @scfc cannot add a user to the Tools project: "You must be a member of the projectadmin role in project to perform this action." - https://phabricator.wikimedia.org/T126937#2027485 (10scfc) The error message s... [21:48:44] 6Labs, 10Labs-Infrastructure, 10MediaWiki-extensions-OpenStackManager, 10Tool-Labs, and 2 others: @scfc cannot add a user to the Tools project: "You must be a member of the projectadmin role in project to perform this action." - https://phabricator.wikimedia.org/T126937#2027493 (10Krenair) @scfc, can you h... [22:05:13] Krenair: Hi! [22:05:46] hi [22:06:01] so do you see a string printed at the top of the page now? [22:06:49] Krenair: string(15) "Tim Landscheidt" [22:11:58] hm [22:12:24] > $osnu = new OpenStackNovaUser( 'Tim Landscheidt' ); [22:12:25] > var_dump( $osnu->inRole( 'projectadmin', 'tools' ) ); [22:12:26] bool(true) [22:13:07] Is that the expression that is also queried for the actual page in question? [22:13:31] (I do remember some talk about caching?) [22:13:59] I think so, yes [22:14:57] oh, hang on [22:15:08] I see a problem with this [22:17:10] scfc_de, try changing the "projectname" in the URL to "projectid" [22:19:05] Krenair: Works nicely, thanks. So indeed the project variable was not set, and we have to update the links to that page? [22:19:31] or change it to use names instead [22:19:57] What would be the name for projectid=tools? [22:20:16] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Tulsi Bhagat was modified, changed by Tim Landscheidt link https://wikitech.wikimedia.org/w/index.php?diff=305562 edit summary: [22:21:37] scfc_de, tools [22:21:43] ID and name is identical for tools [22:23:00] So we do have to change the parameter name from "projectname" to "projectid" because "projectname" is ignored? [22:24:53] at the moment, yes [22:25:13] Krenair: Okay, thanks. [22:30:29] andrewbogott, ^ [22:32:13] Krenair: I think I must have missed some backscroll. What’s happening? [22:32:46] andrewbogott, there's an ID vs. name issue with Special:NovaProject [22:33:10] ok — I may be seeing that as well. Or something like. [22:33:23] what’s the symptom? [22:33:28] labsdb1002 is also seemingly borked [22:35:27] andrewbogott, project admins (non-cloudadmins) can't add people to projects [22:35:31] to their project* [22:35:55] does it report failure, or does the change just not take effect? [22:36:32] chasemp: /srv$ ls [22:36:32] ls: cannot open directory .: Input/output error [22:36:38] are you looking at that? any ideas? [22:36:51] andrewbogott, reports failure, it tries to get the projectid from the URL but only projectname is set [22:36:53] [21554975.965750] XFS (dm-1): Log I/O Error Detected. Shutting down filesystem [22:37:34] it can wait until after labsdb1002 is fixed :) [22:40:00] Krenair, works for me. I’m seeing another bug but it’s confined to ‘testlabs' [22:40:24] are you logged in as a cloudadmin? [22:40:29] chasemp: so I’m scared to touch anything. Reboot, call mark, call jynus? [22:40:34] Krenair: no, ‘andrew bogott mortal' [22:40:40] no special rights [22:40:53] andrewbogott: I don't understand what's up here either, is this a box we have an duplicate or is there real service loss? [22:41:41] some *.labsdb aliases point to labsdb1002 right? [22:41:56] sure seems like disk failure [22:41:57] Feb 14 22:24:55 labsdb1002 kernel: [21554975.965750] XFS (dm-1): Log I/O Error Detected. Shutting down filesystem [22:41:58] Feb 14 22:24:55 labsdb1002 kernel: [21554975.965752] XFS (dm-1): Please umount the filesystem and rectify the problem(s) [22:41:58] Feb 14 22:24:55 labsdb1002 kernel: [21554975.965754] XFS (dm-1): metadata I/O error: block 0xc00f2fb0 ("xlog_iodone") error 5 numblks 64 [22:42:00] Feb 14 22:24:55 labsdb1002 kernel: [21554975.965757] XFS (dm-1): xfs_do_force_shutdown(0x2) called from line 1170 of file /build/buildd/linux-3.13.0/fs/xfs/xfs_log.c. Return address = 0xffffffffa02db801 [22:42:02] Feb 14 22:24:55 labsdb1002 kernel: [21554975.965760] XFS (dm-1): metadata I/O error: block 0xc00f2fc0 ("xlog_iodone") error 5 numblks 64 [22:42:04] Feb 14 22:24:55 labsdb1002 kernel: [21554975.965762] XFS (dm-1): xfs_do_force_shutdown(0x2) called from line 1170 of file /build/buildd/linux-3.13.0/fs/xfs/xfs_log.c. Return address = 0xffffffffa02db801 [22:42:06] Feb 14 22:24:55 labsdb1002 kernel: [21554976.013269] XFS (dm-1): xfs_log_force: error 5 returned. [22:42:11] would the other boxes be able to take the load of these being pointed towards them? [22:42:17] see -operations [22:42:52] heh, yeah :) [22:55:46] I need help [22:56:56] I get error messages on https://tools.wmflabs.org/quentinv57-tools/tools/sulinfo.php?showinactivity=1&showblocks=1&username=USERNAMEHERE (can't reveal the username, due to ACC-rules...but need it so I can process teh ACC request)... [22:57:22] The SQL server ss2.labsdb is down or having issues. an issue on Tool Labs' s7 databases server... [22:57:24] 6Labs, 10Labs-Infrastructure, 10DBA, 6operations: labs -Database is offline - https://phabricator.wikimedia.org/T126942#2027582 (10Krenair) known, being worked on. one of the DB server's drives has failed [22:57:33] ah ^ [22:57:52] 6Labs, 10Labs-Infrastructure, 10DBA, 6operations: labs -Database is offline - https://phabricator.wikimedia.org/T126942#2027585 (10ArielGlenn) labsdb1002 has a broken disk which resulted in the partition with the db being off line. Folks will be redirecting queries to other servers shortly. [23:06:28] 10Tool-Labs-tools-Database-Queries: ERROR 2003 (HY000): Can't connect to MySQL server - https://phabricator.wikimedia.org/T126943#2027594 (10Fae) 3NEW [23:07:20] 10Tool-Labs-tools-Database-Queries: ERROR 2003 (HY000): Can't connect to MySQL server - https://phabricator.wikimedia.org/T126943#2027603 (10Josve05a) Dupe of T126942? [23:07:22] 6Labs, 10Labs-Infrastructure, 10DBA, 6operations, 5Patch-For-Review: labs -Database is offline - https://phabricator.wikimedia.org/T126942#2027606 (10Krenair) [23:07:24] 10Tool-Labs-tools-Database-Queries: ERROR 2003 (HY000): Can't connect to MySQL server - https://phabricator.wikimedia.org/T126943#2027605 (10Krenair) [23:08:15] 10Tool-Labs-tools-Database-Queries: ERROR 2003 (HY000): Can't connect to MySQL server - https://phabricator.wikimedia.org/T126943#2027594 (10Krenair) IIRC, Quarry is hardcoded to use one of the currently-working DB servers [23:15:34] 6Labs, 6operations, 10ops-eqiad: disk failure on labsdb1002 - https://phabricator.wikimedia.org/T126946#2027631 (10chasemp) 3NEW a:3Cmjohnson [23:17:50] 6Labs, 10Labs-Infrastructure, 10DBA, 6operations, 5Patch-For-Review: labs -Database is offline - https://phabricator.wikimedia.org/T126942#2027645 (10chasemp) 5Open>3Resolved a:3chasemp this should be worked around now with https://gerrit.wikimedia.org/r/#/c/270650/ replag and templatecount have... [23:23:28] there is low QPS right now [23:23:44] which for load purposes is good