[15:23:02] Seeing a bunch of these in Logstash: [15:23:04] "Could not enqueue jobs: Unable to deliver all events: 400: 0 out of 1 events were accepted." [15:23:23] Suggests either Ciruss is sending bad jobs, or EventBus is not accepting them correctly? [15:24:20] <_joe_> Krinkle: I guess erik or david are your best bet [15:24:25] <_joe_> but they're not here [15:24:38] mobrovac: ^ [15:25:11] sample at https://logstash.wikimedia.org/app/kibana#/doc/logstash-*/logstash-2019.08.20/mediawiki?id=AWyvnjn-ZKA7Rpirr5FN&_g=h@44136fa [15:29:22] it does seem like cirrus jobs failing to be sent [15:29:49] Pchelolo: ^ [15:30:22] one sec [15:30:42] the wave has passed though [15:30:50] mobrovac: MessageSizeTooLargeError: MESSAGE_SIZE_TOO_LARGE [15:30:58] ah message too large [15:30:59] the jobs are over 15 megs [15:31:00] yup, just seen it [15:32:23] we can file a ticket, I know erik is looking at partitioning the cirrys jobs per cluster, maybe he can try again to finally make them smaller as well.. [15:32:39] but bumbing up the message size even more is definitely not a solution [15:32:57] no no, agreed, we shouldn't do that