[01:20:45] 10Phabricator: Phabricator work cards unreadable for closed tasks - https://phabricator.wikimedia.org/T163967#3216492 (10Krinkle) [03:57:35] 10Phabricator, 06Operations, 10ops-eqiad: phab1001 hdd port a failure - https://phabricator.wikimedia.org/T163960#3216603 (10Dzahn) [11:43:15] 06Project-Admins: Create a tag for Wikidata primary sources tool - https://phabricator.wikimedia.org/T163231#3217204 (10Lydia_Pintscher) Ah I didn't even think about sub-projects. Yeah probably works for this. [11:59:05] 06Project-Admins: Create "User-Zppix" project - https://phabricator.wikimedia.org/T163987#3217219 (10Zppix) [12:00:05] 06Project-Admins: Create "User-Zppix" project - https://phabricator.wikimedia.org/T163987#3217246 (10Zppix) [14:45:37] 06Project-Admins, 06Wikimedia-Venezuela: Create a subproject for Wikimedia Venezuela's Executive Director - https://phabricator.wikimedia.org/T163999#3217724 (10White-Master) a:05Ybsen_lucero>03None [14:48:19] 06Project-Admins, 06Wikimedia-Venezuela: Create a subproject for Wikimedia Venezuela's Executive Director - https://phabricator.wikimedia.org/T163999#3217741 (10Ybsen_lucero) [14:49:01] 06Project-Admins, 06Wikimedia-Venezuela: Create a subproject for Wikimedia Venezuela's Executive Director - https://phabricator.wikimedia.org/T163999#3217751 (10Aklapper) Please see https://www.mediawiki.org/wiki/Phabricator/Creating_and_renaming_projects#Creating_new_projects for required information. [14:58:37] 06Project-Admins, 06Wikimedia-Venezuela: Create a subproject for Wikimedia Venezuela's Executive Director - https://phabricator.wikimedia.org/T163999#3217836 (10Ybsen_lucero) [15:08:24] 06Project-Admins, 06Wikimedia-Venezuela: Create a subproject for Wikimedia Venezuela's Executive Director - https://phabricator.wikimedia.org/T163999#3217886 (10White-Master) [15:09:49] 06Project-Admins, 06Wikimedia-Venezuela: Create a subproject for Wikimedia Venezuela's Executive Director - https://phabricator.wikimedia.org/T163999#3217700 (10White-Master) I edited this task, a request of our Executive Director. [15:12:33] 06Project-Admins, 06Wikimedia-Venezuela: Create a subproject for Wikimedia Venezuela's Executive Director - https://phabricator.wikimedia.org/T163999#3217918 (10White-Master) @Aklapper is possible give @Ybsen_lucero and me create projects permissions? Is very useful :) [15:25:33] 10Phabricator: Maniphest search seems to be broken - https://phabricator.wikimedia.org/T164005#3217978 (10Anomie) [15:53:14] 10Phabricator, 10DBA, 06Operations, 10ops-eqiad: db1048 BBU Faulty - slave lagging - https://phabricator.wikimedia.org/T160731#3218132 (10Marostegui) This has happened again: `˜/icinga-wm 17:47> PROBLEM - MariaDB Slave Lag: m3 on db1048 is CRITICAL: CRITICAL slave_sql_lag Replication lag: 328.00 seconds`... [15:56:28] 10Phabricator, 10DBA, 06Operations, 10ops-eqiad: db1048 BBU Faulty - slave lagging - https://phabricator.wikimedia.org/T160731#3218173 (10Marostegui) And it recovered: ``` root@db1048:~# megacli -AdpBbuCmd -a0 BBU status for Adapter: 0 BatteryType: BBU Voltage: 4058 mV Current: 152 mA Temperature: 33 C... [16:47:47] 06Project-Admins: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706#2364612 (10White-Master) Hi! Can you give me permissions to create projects and milestones for #Wikimedia-Venezuela? Many thanks! [17:00:07] heh, Ops are doing network maintenance on a couple racks, named D5 and D3, making noise on some differentials eg: https://phabricator.wikimedia.org/D3 [17:00:08] D5: Ok so I hacked up ssh.py to use mozprocess - https://phabricator.wikimedia.org/D5 [17:00:08] D3: test - ignore - https://phabricator.wikimedia.org/D3 [17:49:12] 06Project-Admins: Create a tag for Wikidata primary sources tool - https://phabricator.wikimedia.org/T163231#3218603 (10Hjfocs) [17:49:21] 06Project-Admins: Create a sub-project for Wikidata primary sources tool - https://phabricator.wikimedia.org/T163231#3190687 (10Hjfocs) [17:51:24] 06Project-Admins: Create a sub-project for Wikidata primary sources tool - https://phabricator.wikimedia.org/T163231#3218605 (10Hjfocs) [17:54:30] 06Project-Admins: Create a sub-project for Wikidata primary sources tool - https://phabricator.wikimedia.org/T163231#3218616 (10Hjfocs) All right, thanks @Lydia_Pintscher. @Aklapper: I have rephrased the task description to fit a sub-project. >> Project type: #Wikidata-Gadgets tag; > I guess that means a "defa... [18:48:18] 10Phabricator, 10DBA, 06Operations, 10ops-eqiad: db1048 BBU Faulty - slave lagging - https://phabricator.wikimedia.org/T160731#3218833 (10Cmjohnson) is there anything I need to be doing for this? [18:49:09] 10Phabricator, 10DBA, 06Operations, 10ops-eqiad: db1048 BBU Faulty - slave lagging - https://phabricator.wikimedia.org/T160731#3218835 (10Marostegui) Do you have any spare BBU available? [19:06:09] 10Phabricator, 10DBA, 06Operations, 10ops-eqiad: db1048 BBU Faulty - slave lagging - https://phabricator.wikimedia.org/T160731#3218890 (10Cmjohnson) @Marostegui yes, I can use one from a decommissioned server. [19:45:32] 10Phabricator, 06Operations, 10ops-eqiad: phab1001 hdd port a failure - https://phabricator.wikimedia.org/T163960#3218977 (10Cmjohnson) I verified in bios that port A and port B do see the 2 disk drives, I did power off and back again. @robh: can you please paste log or output from install so I can provide p... [19:46:13] 10Phabricator, 06Operations, 06Release-Engineering-Team, 10ops-eqiad, 13Patch-For-Review: setup/install phab1001.eqiad.wmnet - https://phabricator.wikimedia.org/T163938#3218982 (10Cmjohnson) [19:52:04] 10Phabricator, 06Operations, 10ops-eqiad: phab1001 hdd port a failure - https://phabricator.wikimedia.org/T163960#3219012 (10RobH) Yep, attached the screen shot, it shows sata port failure A on every boot. {F7796566} [20:22:02] greg-g: magic linking has always been a dislike of mine [20:22:17] comes up in the hardware specs as well [21:10:04] 06Project-Admins, 06Wikimedia-Venezuela: Create a subproject for Wikimedia Venezuela's Executive Director - https://phabricator.wikimedia.org/T163999#3219407 (10White-Master) [21:11:37] 10Phabricator, 06Operations, 10ops-eqiad: phab1001 hdd port a failure - https://phabricator.wikimedia.org/T163960#3219408 (10Cmjohnson) A new service request has been placed with Dell. I will update once the order has been executed. Create Service Request: Service Tag 4LF7FB2 Confirmed: Request 947622575... [21:15:34] p858snake|L: yeah