[00:43:07] 10netops, 10Operations, 10monitoring, 10Patch-For-Review: Icinga check for VRRP - https://phabricator.wikimedia.org/T150264 (10ayounsi) 05Open→03Resolved a:05faidon→03ayounsi Confirmed working: https://icinga.wikimedia.org/cgi-bin/icinga/status.cgi?search_string=vrrp [02:44:40] 10netops, 10Operations, 10ops-esams: set up cr3-esams - https://phabricator.wikimedia.org/T174616 (10ayounsi) [06:22:25] 10Traffic, 10Cloud-VPS, 10Operations, 10Toolforge, 10Patch-For-Review: Wikimedia varnish rules no longer exempt all Cloud VPS/Toolforge IPs from rate limits (HTTP 429 response) - https://phabricator.wikimedia.org/T213475 (10Kelson) @akosiaris Problem seems to be fixed from our end. Thank you very much. [11:22:21] 10Traffic, 10ExternalGuidance, 10Operations, 10MW-1.33-notes (1.33.0-wmf.18; 2019-02-19), 10Patch-For-Review: Deliver mobile-based version for automatic translations - https://phabricator.wikimedia.org/T212197 (10dr0ptp4kt) Thanks, @santhosh ! [11:23:50] 10Traffic, 10Wikimedia-Apache-configuration, 10Operations, 10VisualEditor: Visual Editor gets stuck opening article (net::ERR_SPDY_PROTOCOL_ERROR 200) - https://phabricator.wikimedia.org/T213214 (10matmarex) [11:25:21] 10Traffic, 10Wikimedia-Apache-configuration, 10Operations, 10VisualEditor: Visual Editor gets stuck opening article (net::ERR_SPDY_PROTOCOL_ERROR 200) - https://phabricator.wikimedia.org/T213214 (10matmarex) >>! In T214534#4950440, @Schnark wrote: > https://stackoverflow.com/questions/33867014/what-does-er... [13:03:40] 10Traffic, 10ExternalGuidance, 10Operations, 10MW-1.33-notes (1.33.0-wmf.18; 2019-02-19), 10Patch-For-Review: Deliver mobile-based version for automatic translations - https://phabricator.wikimedia.org/T212197 (10dr0ptp4kt) For those following along, I ran a query to get a sense of global usage of Google... [15:51:45] let's try to get a new certificate for pinkunicorn from our brand new acme-chief servers... [15:57:15] working on the first attempt... not bad :) [17:57:02] 10Traffic, 10Cloud-VPS, 10Operations, 10Toolforge, 10Patch-For-Review: Wikimedia varnish rules no longer exempt all Cloud VPS/Toolforge IPs from rate limits (HTTP 429 response) - https://phabricator.wikimedia.org/T213475 (10bd808) 05Open→03Resolved a:03akosiaris [20:45:39] 10Traffic, 10Operations: cp3032 ethernet link down (bnx2x dump in the dmesg) - https://phabricator.wikimedia.org/T166758 (10Dzahn) This issue happened today on ms-be2021 {P8082}. 15:40 <+icinga-wm> PROBLEM - Host ms-be2021 is DOWN: PING CRITICAL - Packet loss = 100% 15:43 < mutante> !log ms-be2021 - powercy...