[00:14:41] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [00:29:22] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 68380 [00:32:41] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 596201 [00:35:22] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 468578 MB (8% inode=42%): [00:35:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:37:41] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [00:40:40] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:41:37] [[Special:Log/delete]] delete 10 * MZMcBride * (deleted "[[02File talk:Wikimedia Community Logo-Toolserver.png10]]": nonsense) [00:45:30] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 68564.000000 [00:50:30] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 596819.000000 [00:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [01:14:41] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [01:29:22] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 68515 [01:33:40] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 597827 [01:35:22] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 471016 MB (8% inode=43%): [01:35:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:37:41] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [01:40:40] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:46:29] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 68379.000000 [01:50:30] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 598142.000000 [01:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [02:14:41] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [02:19:22] /sql on thyme is WARNING: DISK WARNING - free space: /sql 126551 MB (13% inode=99%): [02:29:23] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 67538 [02:31:00] @replag s1 [02:31:00] Matthew_: s1-rr-a: 18h 44m 59s [-0.01 s/s]; s1-user: 6d 22h 28m 4s [+0.43 s/s]; s6-rr-a: 15s [+0.00 s/s]; s6-user: 16s [+0.00 s/s] [02:33:40] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 599357 [02:35:22] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 469355 MB (8% inode=43%): [02:36:23] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:37:41] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [02:40:40] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:46:30] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 67387.000000 [02:50:40] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 599783.000000 [02:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [03:15:29] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [03:15:42] Load avg. on willow is WARNING: WARNING - load average: 20.93, 17.48, 15.16 [03:29:42] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 66979 [03:30:42] Load avg. on willow is CRITICAL: CRITICAL - load average: 35.21, 22.39, 18.48 [03:31:42] Load avg. on willow is WARNING: WARNING - load average: 21.70, 20.86, 18.18 [03:34:21] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 600636 [03:36:02] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 469092 MB (8% inode=43%): [03:37:01] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [03:38:21] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [03:41:12] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [03:44:42] Load avg. on willow is CRITICAL: CRITICAL - load average: 30.46, 18.73, 17.15 [03:47:02] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 67225.000000 [03:50:42] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 601323.000000 [03:57:01] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [04:04:42] Load avg. on willow is WARNING: WARNING - load average: 14.71, 15.34, 15.67 [04:15:32] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [04:29:42] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 67259 [04:34:21] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 602419 [04:36:01] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 469014 MB (8% inode=43%): [04:37:02] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [04:38:21] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [04:41:12] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [04:47:21] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 67507.000000 [04:50:42] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 602793.000000 [04:57:01] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [05:04:42] Load avg. on willow is WARNING: WARNING - load average: 15.30, 16.00, 16.29 [05:15:32] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [05:26:12] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:27:01] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:27:51] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 99297 MB (10% inode=98%): [05:27:51] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 99297 MB (10% inode=98%): [05:29:32] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 44523 MB (3% inode=98%): [05:29:42] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 67678 [05:34:21] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 603873 [05:37:02] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 468822 MB (8% inode=42%): [05:37:02] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [05:38:20] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [05:38:42] Load avg. on willow is CRITICAL: CRITICAL - load average: 31.87, 23.67, 19.79 [05:39:42] Load avg. on willow is WARNING: WARNING - load average: 18.54, 21.48, 19.27 [05:41:11] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [05:43:43] Load avg. on willow is CRITICAL: CRITICAL - load average: 24.49, 22.44, 20.04 [05:47:20] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 67786.000000 [05:50:42] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 604370.000000 [05:57:02] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [06:09:02] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 39634 MB (9% inode=99%): [06:15:31] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [06:30:43] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 67905 [06:32:02] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24078 MB (5% inode=99%): [06:34:21] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 605384 [06:37:01] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 468565 MB (8% inode=42%): [06:37:02] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:38:21] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [06:41:02] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 50089 MB (12% inode=99%): [06:41:12] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [06:43:41] Load avg. on willow is CRITICAL: CRITICAL - load average: 13.79, 23.23, 23.16 [06:47:21] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 68252.000000 [06:50:42] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 605703.000000 [06:57:01] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [07:13:41] Load avg. on willow is WARNING: WARNING - load average: 13.14, 17.62, 19.67 [07:16:31] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [07:20:42] Load avg. on willow is CRITICAL: CRITICAL - load average: 47.00, 24.01, 20.98 [07:29:42] Load avg. on willow is WARNING: WARNING - load average: 14.06, 18.04, 19.53 [07:31:41] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 68804 [07:34:21] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 606390 [07:37:01] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 468599 MB (8% inode=42%): [07:37:01] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [07:38:21] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [07:42:11] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:47:21] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 68865.000000 [07:50:41] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 606700.000000 [07:53:42] Load avg. on willow is WARNING: WARNING - load average: 15.13, 14.37, 16.86 [07:57:02] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [07:58:12] [[Special:Log/newusers]] create 10 * MelZP * (New user account) [08:01:42] Load avg. on willow is CRITICAL: CRITICAL - load average: 33.07, 20.86, 18.17 [08:02:42] Load avg. on willow is WARNING: WARNING - load average: 21.25, 19.73, 17.95 [08:16:32] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [08:25:42] Load avg. on willow is OK: OK - load average: 12.30, 13.10, 14.90 [08:31:41] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 68687 [08:34:21] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 608083 [08:37:02] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 468346 MB (8% inode=42%): [08:37:02] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:38:21] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [08:42:11] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:47:20] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 68704.000000 [08:50:42] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 608967.000000 [08:57:02] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [09:16:32] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [09:31:42] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 68417 [09:34:21] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 609835 [09:38:02] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 468235 MB (8% inode=42%): [09:38:02] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:38:20] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [09:42:03] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:42:12] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:42:12] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:43:02] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 100265 MB (10% inode=98%): [09:43:31] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 100160 MB (10% inode=98%): [09:47:20] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 68356.000000 [09:51:42] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 610222.000000 [09:57:01] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [10:16:31] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [10:17:42] Load avg. on willow is WARNING: WARNING - load average: 8.30, 18.74, 17.50 [10:23:02] Load avg. on adenia is WARNING: WARNING - load average: 15.92, 14.45, 9.94 [10:23:42] Load avg. on willow is OK: OK - load average: 8.65, 11.72, 14.58 [10:26:02] Load avg. on adenia is OK: OK - load average: 15.00, 14.76, 10.88 [10:31:43] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 68626 [10:34:21] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 611017 [10:38:02] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 468174 MB (8% inode=42%): [10:38:02] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:38:20] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [10:41:01] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:41:11] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:42:43] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 97674 MB (10% inode=98%): [10:42:43] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 97674 MB (10% inode=98%): [10:43:11] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:47:22] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 68810.000000 [10:51:42] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 611433.000000 [10:58:02] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [11:04:01] Load avg. on adenia is WARNING: WARNING - load average: 15.37, 15.73, 14.59 [11:16:32] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [11:21:02] Load avg. on adenia is OK: OK - load average: 12.11, 14.34, 14.97 [11:31:43] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 68936 [11:34:21] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 612620 [11:38:02] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 468102 MB (8% inode=42%): [11:38:02] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:38:21] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [11:43:11] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:47:31] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 69094.000000 [11:52:02] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 612992.000000 [11:59:01] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [12:16:02] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 39823 MB (9% inode=99%): [12:17:31] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [12:32:41] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 69636 [12:34:20] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 613692 [12:38:01] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 23650 MB (5% inode=99%): [12:38:02] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 468054 MB (8% inode=42%): [12:38:02] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:38:21] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [12:44:11] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:45:01] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:46:01] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 53155 MB (13% inode=99%): [12:47:32] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 69809.000000 [12:52:02] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 613843.000000 [12:54:42] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [12:59:01] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [13:17:32] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [13:32:42] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 69833 [13:34:21] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 614399 [13:38:01] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 467909 MB (8% inode=42%): [13:38:02] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:38:20] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [13:44:12] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:47:31] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 69767.000000 [13:53:01] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 614885.000000 [13:59:02] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [14:17:31] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [14:19:42] /sql on thyme is WARNING: DISK WARNING - free space: /sql 124454 MB (12% inode=99%): [14:32:42] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 69297 [14:34:21] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 615833 [14:34:43] Hi. As a project administrator: Is it possible for me to see all users of a MMP? [14:36:47] DaB said on https://jira.toolserver.org/browse/ACCAPP-424 he added lulu-ann to the lalm mmp, but in the project administration there's no second account listed. Do I have to add it myself? [14:38:02] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 467774 MB (8% inode=42%): [14:38:02] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:38:21] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [14:44:11] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:47:31] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 69117.000000 [14:54:01] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 616304.000000 [14:59:01] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [15:17:32] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [15:17:43] Load avg. on willow is WARNING: WARNING - load average: 14.66, 17.66, 16.01 [15:20:42] Load avg. on willow is OK: OK - load average: 9.26, 13.61, 14.67 [15:32:42] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 68674 [15:34:21] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 617281 [15:38:01] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 467359 MB (8% inode=42%): [15:38:02] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:38:21] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [15:44:12] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:47:31] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 68709.000000 [15:54:01] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 617742.000000 [15:59:02] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [16:17:32] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [16:29:39] Hello all. Any admin that could take a look into this? Thanks! https://jira.toolserver.org/browse/TS-1456 [16:32:42] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 68151 [16:34:21] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 618741 [16:38:02] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 464921 MB (8% inode=42%): [16:38:02] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:38:21] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [16:44:12] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:48:31] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 68050.000000 [16:54:02] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 619203.000000 [17:00:01] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [17:03:46] multichill: hello! i just responded to your notes on the admin_tree api bug https://bugzilla.wikimedia.org/show_bug.cgi?id=38313 [17:17:31] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [17:17:55] [[Special:Log/newusers]] create 10 * TMelodee * (New user account) [17:29:31] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 46491 MB (3% inode=98%): [17:33:42] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 67370 [17:34:21] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 620229 [17:38:02] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 462164 MB (8% inode=42%): [17:38:02] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:38:21] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [17:45:11] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:48:50] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 67372.000000 [17:54:01] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 620797.000000 [18:01:01] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [18:18:32] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [18:33:42] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 66801 [18:34:10] Hello all. Any admin that could take a look into this? Thanks! https://jira.toolserver.org/browse/TS-1456 [18:34:21] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 621944 [18:38:21] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [18:39:02] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 456488 MB (8% inode=42%): [18:39:02] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:45:11] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:48:51] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 66964.000000 [18:54:02] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 622474.000000 [19:02:03] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [19:02:06] Carl (CBM) * [Toolserver-l] Tweetmeme web crawler [19:03:20] I noticed that tweetmeme user agent because it was crawling so fast it would use up all of my tool's database connections [19:09:50] [[Начална страница]] ! 10https://wiki.toolserver.org/w/index.php?diff=7461&oldid=5302&rcid=10157 * 84.114.193.174 * (+8) () [19:19:31] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [19:33:42] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 66570 [19:34:21] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 623978 [19:38:21] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [19:39:01] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 456396 MB (8% inode=42%): [19:39:01] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:45:12] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:48:51] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 66537.000000 [19:55:01] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 624982.000000 [20:02:01] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [20:20:32] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [20:33:42] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 66039 [20:34:20] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 626243 [20:38:21] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [20:39:01] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 455300 MB (8% inode=42%): [20:39:02] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:46:11] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:48:50] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 66037.000000 [20:53:17] [[Talk:MySQL queries]] !N 10https://wiki.toolserver.org/w/index.php?oldid=7462&rcid=10158 * Nickanc * (+112) (question) [20:55:01] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 626892.000000 [21:02:01] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [21:19:00] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 40303 MB (9% inode=99%): [21:20:31] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [21:33:43] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 65763 [21:34:21] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 628161 [21:36:02] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24020 MB (5% inode=99%): [21:38:21] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [21:39:01] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 455141 MB (8% inode=42%): [21:39:02] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:46:11] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:48:51] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 65717.000000 [21:55:10] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 628755.000000 [22:02:01] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [22:09:01] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 36298 MB (8% inode=99%): [22:21:01] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24098 MB (5% inode=99%): [22:21:32] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [22:34:21] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 629797 [22:34:42] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 64982 [22:38:21] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [22:39:02] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 455037 MB (8% inode=42%): [22:39:02] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:42:02] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 34480 MB (8% inode=99%): [22:43:32] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 101819 MB (10% inode=98%): [22:43:43] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 101819 MB (10% inode=98%): [22:46:11] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:48:51] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 64825.000000 [22:49:01] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 23772 MB (5% inode=99%): [22:55:10] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 630359.000000 [23:02:01] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [23:14:02] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 37595 MB (9% inode=99%): [23:21:02] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24074 MB (5% inode=99%): [23:21:31] ethernet 0/1/14 [willow.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/14:UP: 1 int NOK : CRITICAL [23:28:22] [[Special:Log/newusers]] create 10 * Roslyn6 * (New user account) [23:31:02] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 59167 MB (14% inode=99%): [23:34:21] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 631384 [23:34:42] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 64111 [23:38:21] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [23:39:01] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 453706 MB (8% inode=42%): [23:39:01] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:46:11] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:48:51] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 64034.000000 [23:50:02] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 35891 MB (8% inode=99%): [23:55:32] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 632114.000000 [23:59:02] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24069 MB (5% inode=99%):