[00:06:57] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 19259 [00:08:47] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 19289.000000 [00:16:57] /sql on thyme is CRITICAL: DISK CRITICAL - free space: /sql 97777 MB (10% inode=99%): [00:29:56] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:30:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [00:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [00:53:36] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [00:54:27] /sql on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:54:27] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:54:27] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1147028 [00:55:07] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 37895 MB (9% inode=99%): [00:55:07] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 87663 MB (9% inode=98%): [00:55:07] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 87663 MB (9% inode=98%): [00:58:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1146921.000000 [01:06:57] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 20251 [01:08:29] @replag [01:09:07] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 20309.000000 [01:15:05] DeltaQuad * Re: [Toolserver-l] Please approve [01:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:30:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [01:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [01:53:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [01:54:36] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1140086 [01:55:56] @replag [01:58:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1139726.000000 [02:06:27] /sql on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:06:27] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:06:27] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:06:56] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 21998 [02:07:57] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 87650 MB (9% inode=98%): [02:07:57] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 87649 MB (9% inode=98%): [02:07:57] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 37864 MB (9% inode=99%): [02:09:47] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 22105.000000 [02:21:26] /sql on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:21:26] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:21:26] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:26:32] @replag [02:26:44] ... [02:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [02:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:40:56] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 37859 MB (9% inode=99%): [02:40:57] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 86941 MB (8% inode=98%): [02:40:57] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 86941 MB (8% inode=98%): [02:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [02:53:36] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [02:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1132831 [02:58:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1132412.000000 [03:06:57] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 23055 [03:09:46] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 23163.000000 [03:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [03:30:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [03:30:56] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [03:31:39] @replag [03:48:56] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 126500 MB (20% inode=99%): [03:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [03:53:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [03:54:36] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1125662 [03:58:26] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1125373.000000 [04:06:57] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 24713 [04:10:36] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 24782.000000 [04:10:56] Free Memory on damiana is WARNING: WARNING - 6.1% (511816 kB) free! [04:16:57] Free Memory on damiana is OK: OK - 9.7% (816356 kB) free. [04:17:47] Hello; how I can delete my toolserver account [04:20:27] why? [04:23:08] jeremyb: for more reason; I dont use it; Iast login 2 years ago; I lost the password of account and the password of email of account [04:23:41] :S so can I delete the account! [04:26:53] you should have been expired by now anyway [04:27:02] what's your account name? [04:27:05] SeH[SSH] [04:28:00] jeremyb: orango [04:28:32] yes, it's expired [04:28:40] i think there's nothing else you need to do? [04:29:14] * jeremyb sleeps [04:29:46] jeremyb: yes; but I can request another account! [04:29:56] in the future [04:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [04:30:04] SeH[SSH]: i don't understand [04:30:10] and i have to sleep [04:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [04:30:27] you may have more luck asking here during the daytime CEST [04:30:30] so UTC+2 [04:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [04:31:04] SeH[SSH]: when you want to come back just let the roots know and they can take appropriate steps [04:32:22] Betacommand: can you actually understand what he's saying though? [04:32:32] i think that's a prerequisite! [04:32:33] jeremyb: yes [04:32:45] huh. i can't [04:33:03] * jeremyb detaches [04:33:09] jeremyb: -_- [04:35:08] Betacommand: so if I lost the password and the rsa I can retrieval the account! [04:35:24] SeH[SSH]: depends [04:35:53] Betacommand: how [04:38:50] SeH[SSH]: you need to provide some kind of proof to the roots that you are the original account holder. that is normally done via the email associated with the ts account, but if you have a wiki account that was previously linked that would also work [04:41:47] Betacommand: yes thanks; so I want to restore the account how I can make request [04:42:08] in the jira.toolserver.org؟!! [04:42:12] yeah [04:43:09] Ok I ll try thanx [04:48:58] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 121399 MB (20% inode=99%): [04:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [04:53:36] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [04:54:27] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:54:27] /sql on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:54:27] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1120640 [04:57:57] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 87203 MB (8% inode=98%): [04:57:57] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 87202 MB (8% inode=98%): [04:57:57] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 37806 MB (9% inode=99%): [04:58:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1120299.000000 [05:06:57] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 26179 [05:11:07] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 26263.000000 [05:29:16] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [05:30:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [05:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [05:34:17] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [05:46:07] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 18015 MB (1% inode=96%): [05:48:56] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 112234 MB (18% inode=99%): [05:53:16] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [05:53:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [05:54:36] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1115931 [05:58:26] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1115723.000000 [06:06:57] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 27671 [06:11:16] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 27748.000000 [06:25:16] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 137869 MB (14% inode=99%): [06:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [06:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [06:30:56] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:48:57] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 114442 MB (18% inode=99%): [06:53:16] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [06:53:47] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [06:54:36] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1111777 [06:58:26] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1111403.000000 [07:06:57] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 28145 [07:11:16] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 28223.000000 [07:17:57] Free Memory on damiana is WARNING: WARNING - 6.7% (560096 kB) free! [07:18:57] Free Memory on damiana is OK: OK - 7.2% (599488 kB) free. [07:29:56] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:30:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [07:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [07:48:57] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24339 MB (5% inode=99%): [07:48:57] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 110008 MB (18% inode=99%): [07:51:57] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 30790 MB (7% inode=99%): [07:53:16] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [07:54:27] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:54:27] /sql on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:54:36] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1104050 [07:54:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [07:56:56] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 87679 MB (9% inode=98%): [07:58:26] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1103455.000000 [08:06:57] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 28762 [08:11:37] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 28919.000000 [08:13:58] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 37692 MB (9% inode=99%): [08:29:56] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:30:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [08:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:42:57] Free Memory on damiana is WARNING: WARNING - 6.0% (501088 kB) free! [08:48:57] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 109940 MB (18% inode=99%): [08:51:27] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:51:27] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:51:27] /sql on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:52:07] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 86460 MB (8% inode=98%): [08:52:07] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 30824 MB (7% inode=99%): [08:52:07] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 86460 MB (8% inode=98%): [08:53:16] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [08:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1092857 [08:54:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [08:54:56] Free Memory on damiana is OK: OK - 7.4% (621932 kB) free. [08:57:27] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:58:26] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1092207.000000 [09:06:57] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 29181 [09:11:37] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 29241.000000 [09:16:57] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 86158 MB (8% inode=98%): [09:25:57] Free Memory on damiana is WARNING: WARNING - 6.4% (534544 kB) free! [09:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:30:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [09:30:56] Free Memory on damiana is OK: OK - 7.5% (630760 kB) free. [09:30:56] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:42:27] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:42:27] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:42:27] /sql on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:43:07] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 37684 MB (9% inode=99%): [09:43:07] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 86019 MB (8% inode=98%): [09:43:07] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 86019 MB (8% inode=98%): [09:48:57] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 109834 MB (18% inode=99%): [09:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [09:54:36] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1082337 [09:54:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [09:55:57] MySQL slave on z-dat-s3-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2172 [09:58:26] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1081457.000000 [10:06:57] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 29763 [10:07:57] Free Memory on damiana is WARNING: WARNING - 5.5% (463956 kB) free! [10:11:37] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 29898.000000 [10:13:37] MySQL slave on z-dat-s7-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2121 [10:17:56] Free Memory on damiana is OK: OK - 7.1% (591356 kB) free. [10:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:30:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [10:30:46] MySQL slave on z-dat-s3-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3646 [10:30:56] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:35:37] MySQL slave on z-dat-s7-a is CRITICAL: (Service Check Timed Out) [10:35:57] MySQL slave on z-dat-s7-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3018 [10:36:05] DaB. * Re: [Toolserver-l] Please approve [10:42:57] Free Memory on damiana is WARNING: WARNING - 6.6% (555676 kB) free! [10:46:56] Free Memory on damiana is OK: OK - 7.2% (604592 kB) free. [10:48:56] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 110201 MB (18% inode=99%): [10:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [10:54:27] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:54:27] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:54:27] /sql on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1070659 [10:54:47] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [10:54:47] MySQL slave on z-dat-s7-a is CRITICAL: (Service Check Timed Out) [10:55:17] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 37573 MB (9% inode=99%): [10:55:17] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 85951 MB (8% inode=98%): [10:55:17] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 85951 MB (8% inode=98%): [10:55:17] MySQL slave on z-dat-s7-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3488 [10:58:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1069776.000000 [10:59:57] Free Memory on damiana is WARNING: WARNING - 6.8% (569508 kB) free! [11:05:26] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:05:27] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:05:27] /sql on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:05:57] MySQL slave on z-dat-s7-a is CRITICAL: (Service Check Timed Out) [11:06:56] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 30089 [11:11:37] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 30185.000000 [11:24:56] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 85853 MB (8% inode=98%): [11:24:57] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 85853 MB (8% inode=98%): [11:24:57] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 37551 MB (9% inode=99%): [11:27:57] Free Memory on damiana is WARNING: WARNING - 6.9% (578604 kB) free! [11:29:57] Free Memory on damiana is OK: OK - 7.5% (624412 kB) free. [11:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [11:30:47] MySQL slave on z-dat-s3-a is CRITICAL: Cant connect to MySQL server on z-dat-s3-a (146) [11:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:35:26] MySQL on z-dat-s3-a is CRITICAL: Cant connect to MySQL server on z-dat-s3-a (146) [11:48:57] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 109444 MB (18% inode=99%): [11:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [11:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1056356 [11:55:36] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [11:56:27] MySQL on z-dat-s3-a is OK: Uptime: 1665 Threads: 21 Questions: 190 Slow queries: 5 Opens: 109 Flush tables: 1 Open tables: 98 Queries per second avg: 0.114 [11:58:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1055546.000000 [12:06:56] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 28901 [12:11:56] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 28939.000000 [12:16:57] /sql on thyme is CRITICAL: DISK CRITICAL - free space: /sql 99159 MB (10% inode=99%): [12:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [12:30:47] MySQL slave on z-dat-s3-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 6986 [12:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:48:57] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 109211 MB (17% inode=99%): [12:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [12:53:46] MySQL slave on z-dat-s3-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3439 [12:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1042904 [12:55:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [12:58:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1042043.000000 [13:03:47] MySQL slave on z-dat-s3-a is OK: Uptime: 5706 Threads: 15 Questions: 3355934 Slow queries: 197 Opens: 21706 Flush tables: 1 Open tables: 13923 Queries per second avg: 588.141 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1752 [13:03:57] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24242 MB (5% inode=99%): [13:06:56] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 27120 [13:11:57] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 27053.000000 [13:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [13:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:33:56] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 37447 MB (9% inode=99%): [13:48:57] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 108964 MB (17% inode=99%): [13:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [13:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1032995 [13:55:36] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [13:58:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1032362.000000 [14:00:20] hello all [14:06:57] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 25683 [14:11:56] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 25718.000000 [14:18:00] Maybe mmoving sql-s1-user wasn't a good idea at the end… [14:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [14:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:41:57] Free Memory on damiana is WARNING: WARNING - 5.9% (496172 kB) free! [14:46:56] Free Memory on damiana is OK: OK - 7.1% (591128 kB) free. [14:48:57] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 108702 MB (17% inode=99%): [14:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [14:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1023500 [14:55:36] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [14:57:56] Free Memory on damiana is WARNING: WARNING - 6.5% (543968 kB) free! [14:58:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1022889.000000 [15:06:57] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 24009 [15:11:57] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 23958.000000 [15:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [15:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:48:57] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 106262 MB (17% inode=99%): [15:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [15:54:36] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1013573 [15:55:06] @replag [15:55:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [15:58:25] at least it's going in the right direction, but just barely [15:58:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1013521.000000 [16:06:56] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 22079 [16:09:26] @replag [16:11:57] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 22154.000000 [16:14:47] MySQL slave on z-dat-s3-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2164 [16:18:37] MySQL slave on z-dat-s6-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2164 [16:20:27] MySQL slave on z-dat-s7-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2153 [16:20:52] @replag [16:21:06] Mohamed ElGedawy * Re: [Toolserver-l] Please approve [16:24:04] Jeremy Baron * Re: [Toolserver-l] Please approve [16:24:49] russblau: it was going the wrong way for a while. (on rosemary) [16:25:00] thyme seems much more consistent [16:25:31] http://munin.toolserver.org/Database/rosemary/mysql_replication.html [16:25:34] http://munin.toolserver.org/Database/thyme/mysql_replication.html [16:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [16:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:31:56] Free Memory on damiana is WARNING: WARNING - 6.8% (571176 kB) free! [16:32:39] jeremyb, thyme has no user load on it at all, so that's no surprise; I guess at the moment I'd be more worried about what's happening to s3, s6, and s7! [16:32:57] Free Memory on damiana is OK: OK - 7.3% (611648 kB) free. [16:39:47] MySQL slave on z-dat-s3-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3647 [16:42:10] russblau: and s1? [16:42:37] there's a lot of mystery in how things are set up here. IME [16:42:46] MySQL slave on z-dat-s4-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2022 [16:42:47] s4 replag on z-dat-s4-a is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2026.000000 [16:42:56] e.g. how many mysqlds are there? >1 / box ? [16:43:37] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3632 [16:45:42] jeremyb, https://wiki.toolserver.org/view/Servers exists, but possibly is out of date [16:45:53] hrm [16:48:57] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 106333 MB (17% inode=99%): [16:49:27] MySQL slave on z-dat-s7-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3614 [16:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [16:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1005467 [16:55:17] jeremyb: I don't understand a lot about how this works, either. The whole replag thing is a mystery: if the server is overloaded, why doesn't commons-s1 show the same replag as enwiki? But it doesn't, so something else must be causing enwiki to lag and not commons. I don't know what that would be. [16:55:36] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [16:56:09] russblau: but how did we get to 6 hrs? [16:56:55] yeah, that's the part I don't understand [16:57:12] ;/ [16:58:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1004745.000000 [17:01:52] @replag [17:06:56] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 20962 [17:11:56] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 21028.000000 [17:25:47] MySQL slave on z-dat-s4-a is OK: Uptime: 7327853 Threads: 6 Questions: 473237504 Slow queries: 93543 Opens: 163484 Flush tables: 1 Open tables: 1123 Queries per second avg: 64.580 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1541 [17:25:47] s4 replag on z-dat-s4-a is OK: QUERY OK: SELECT ts_rc_age() returned 1540.000000 [17:28:57] Free Memory on damiana is WARNING: WARNING - 6.0% (498752 kB) free! [17:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [17:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:34:57] Free Memory on damiana is OK: OK - 7.1% (594676 kB) free. [17:39:47] MySQL slave on z-dat-s3-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 7188 [17:41:57] Free Memory on damiana is WARNING: WARNING - 5.8% (489416 kB) free! [17:43:37] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 7015 [17:46:07] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 17196 MB (1% inode=96%): [17:48:57] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 107854 MB (17% inode=99%): [17:49:27] MySQL slave on z-dat-s7-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 6529 [17:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [17:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 996287 [17:55:36] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [17:55:56] Free Memory on damiana is CRITICAL: CRITICAL - 5.0% (416528 kB) free! [17:58:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 995661.000000 [18:06:57] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 19915 [18:11:56] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 19923.000000 [18:25:17] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 137586 MB (14% inode=99%): [18:29:56] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [18:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:36:57] Free Memory on damiana is WARNING: WARNING - 5.6% (469508 kB) free! [18:39:46] MySQL slave on z-dat-s3-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 9364 [18:41:57] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 23957 MB (5% inode=99%): [18:43:37] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 8618 [18:48:56] Free Memory on damiana is OK: OK - 7.5% (628680 kB) free. [18:48:57] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 107450 MB (17% inode=99%): [18:49:27] MySQL slave on z-dat-s7-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 8323 [18:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [18:54:36] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 987555 [18:55:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [18:58:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 987170.000000 [19:06:56] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 20171 [19:10:36] MySQL slave on z-dat-s6-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3379 [19:11:57] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 20239.000000 [19:14:57] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 42534 MB (10% inode=99%): [19:15:26] MySQL slave on z-dat-s7-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3239 [19:15:36] MySQL slave on z-dat-s6-a is OK: Uptime: 5355504 Threads: 7 Questions: 1182456209 Slow queries: 369412 Opens: 11045499 Flush tables: 1 Open tables: 3226 Queries per second avg: 220.792 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1549 [19:16:57] Free Memory on damiana is WARNING: WARNING - 6.8% (567408 kB) free! [19:19:46] MySQL slave on z-dat-s3-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3591 [19:20:27] MySQL slave on z-dat-s7-a is OK: Uptime: 7313101 Threads: 7 Questions: 1996796684 Slow queries: 256027 Opens: 17150587 Flush tables: 1 Open tables: 7100 Queries per second avg: 273.43 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1440 [19:20:57] Free Memory on damiana is CRITICAL: CRITICAL - 4.9% (410000 kB) free! [19:21:57] Free Memory on damiana is WARNING: WARNING - 5.2% (431800 kB) free! [19:25:47] MySQL slave on z-dat-s3-a is OK: Uptime: 28626 Threads: 16 Questions: 17532687 Slow queries: 12614 Opens: 135097 Flush tables: 1 Open tables: 16384 Queries per second avg: 612.474 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1769 [19:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [19:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:48:57] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 107188 MB (17% inode=99%): [19:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [19:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 977418 [19:55:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [19:55:56] Free Memory on damiana is WARNING: WARNING - 5.6% (472064 kB) free! [19:58:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 977019.000000 [20:04:57] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24422 MB (5% inode=99%): [20:06:57] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 19611 [20:11:57] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 19699.000000 [20:21:56] Free Memory on damiana is OK: OK - 7.5% (625048 kB) free. [20:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [20:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:45:56] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 41050 MB (10% inode=99%): [20:46:17] Load avg. on ortelius is WARNING: WARNING - load average: 8.57, 17.38, 13.39 [20:48:17] Load avg. on ortelius is OK: OK - load average: 5.87, 13.43, 12.39 [20:48:56] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 105609 MB (17% inode=99%): [20:53:16] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [20:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 964494 [20:55:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [20:58:26] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 963810.000000 [21:01:56] Free Memory on damiana is WARNING: WARNING - 6.1% (512240 kB) free! [21:06:57] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 19709 [21:12:07] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 19763.000000 [21:12:56] Free Memory on damiana is CRITICAL: CRITICAL - 5.0% (419452 kB) free! [21:14:56] Free Memory on damiana is WARNING: WARNING - 5.2% (436492 kB) free! [21:29:56] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [21:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:31:14] @replag [21:33:57] Free Memory on damiana is OK: OK - 7.7% (646128 kB) free. [21:48:57] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 106389 MB (17% inode=99%): [21:49:56] Free Memory on damiana is WARNING: WARNING - 5.8% (483460 kB) free! [21:53:16] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [21:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 956426 [21:55:36] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [21:58:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 956046.000000 [22:06:57] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 19125 [22:08:57] Free Memory on damiana is OK: OK - 7.3% (613972 kB) free. [22:12:06] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 19085.000000 [22:21:05] @replag [22:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [22:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:36:22] hey [22:36:26] could I request a query? [22:43:34] I want to fill in info for http://meta.wikimedia.org/wiki/Requests_for_comment/Sysop_abuse_on_the_Turkish_Wikipedia/Voters [22:44:05] for people who has a signature on http://meta.wikimedia.org/wiki/Requests_for_comment/Sysop_abuse_on_the_Turkish_Wikipedia [22:44:09] or edited the page [22:48:57] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 106114 MB (17% inode=99%): [22:51:56] Free Memory on damiana is CRITICAL: CRITICAL - 4.6% (385612 kB) free! [22:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [22:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 947267 [22:55:36] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [22:58:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 946670.000000 [23:06:57] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 18386 [23:06:57] Free Memory on damiana is WARNING: WARNING - 5.1% (427256 kB) free! [23:11:36] anyone around? :/ [23:12:17] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 18370.000000 [23:14:33] I imagine everyone is simply ignoring you. [23:14:57] Free Memory on damiana is OK: OK - 7.1% (593888 kB) free. [23:15:28] Yep, pretty much what Brooke said. [23:18:54] Brooke why would they? [23:23:57] Free Memory on damiana is WARNING: WARNING - 6.1% (512760 kB) free! [23:24:57] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 85669 MB (8% inode=98%): [23:24:57] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 85669 MB (8% inode=98%): [23:29:56] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [23:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:48:57] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 105490 MB (17% inode=99%): [23:53:16] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [23:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 936905 [23:55:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [23:58:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 935819.000000 [23:59:17] Load avg. on ortelius is WARNING: WARNING - load average: 9.48, 20.23, 14.26