[15:43:31] Quarry: Quarry stuck on "queued" state - https://phabricator.wikimedia.org/T131024#2153885 (Huji) [18:33:25] Analytics, Operations: nf_conntrack warnings for kafka hosts - https://phabricator.wikimedia.org/T131028#2153998 (elukey) [18:34:15] ----^ ottomata (happy easter to all!) [18:56:45] Analytics, Operations: nf_conntrack warnings for kafka hosts - https://phabricator.wikimedia.org/T131028#2153998 (Muehlenhoff) We can easily bump that to 512k, we had the same workaround for the recent job runner problems. We can than properly analyse the root cause on Tuesday. Am 27.03.2016 20:33 schrieb... [19:48:34] Quarry: Quarry stuck on "queued" state - https://phabricator.wikimedia.org/T131024#2154047 (yuvipanda) I restarted the workers, which has fixed this for now. Long term, I should migrate quarry to tools / kubernetes for added stability. Apologies for the disruption, and thank you for filing the bug! Some q... [19:48:38] Quarry: Quarry stuck on "queued" state - https://phabricator.wikimedia.org/T131024#2154048 (yuvipanda) Open>Resolved a:yuvipanda