[00:00:48] <wikibugs>	 10Release-Engineering-Team (Next), 10Scap, 10Wikimedia-log-errors: Add jobrunners to Scap canary process - https://phabricator.wikimedia.org/T172480 (10Krinkle)
[00:00:49] <wikibugs>	 10Release-Engineering-Team (Next), 10Scap, 10Wikimedia-log-errors: Add jobrunners to Scap canary process - https://phabricator.wikimedia.org/T172480 (10Krinkle)
[00:00:53] <wikibugs>	 10Release-Engineering-Team (Next), 10Scap, 10Wikimedia-Incident: Add jobrunners to Scap canary process - https://phabricator.wikimedia.org/T172480 (10Krinkle)
[00:00:57] <wikibugs>	 10Release-Engineering-Team (Next), 10Scap, 10Wikimedia-Incident: Add jobrunners to Scap canary process - https://phabricator.wikimedia.org/T172480 (10Krinkle)
[00:05:12] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Growth-Team (Current Sprint): Set up test environment for PageTriage drafts in beta labs - https://phabricator.wikimedia.org/T198898 (10Catrope)
[00:05:14] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Growth-Team (Current Sprint): Set up test environment for PageTriage drafts in beta labs - https://phabricator.wikimedia.org/T198898 (10Catrope)
[00:42:24] <wikibugs>	 10Phabricator, 10Wikibugs: Exclude wiki bugs from phabricator rate limit - https://phabricator.wikimedia.org/T198915 (10mmodell) p:05Unbreak!>03Normal Indeed, I don't think we can whitelist labs IPs. The best we can do is somehow whitelist the API key that wikibugs uses. That's tricky to do, however, witho...
[00:42:29] <wikibugs>	 10Phabricator, 10Wikibugs: Exclude wiki bugs from phabricator rate limit - https://phabricator.wikimedia.org/T198915 (10mmodell) p:05Unbreak!>03Normal Indeed, I don't think we can whitelist labs IPs. The best we can do is somehow whitelist the API key that wikibugs uses. That's tricky to do, however, witho...
[00:42:54] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Growth-Team (Current Sprint): Set up test environment for PageTriage drafts in beta labs - https://phabricator.wikimedia.org/T198898 (10Catrope) @MusikAnimal: I heard from @Mooeypoo that this isn't as easy as just enabling the config var on beta, and that you would know why. Do...
[00:43:01] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Growth-Team (Current Sprint): Set up test environment for PageTriage drafts in beta labs - https://phabricator.wikimedia.org/T198898 (10Catrope) @MusikAnimal: I heard from @Mooeypoo that this isn't as easy as just enabling the config var on beta, and that you would know why. Do...
[00:43:56] <wikibugs>	 10Phabricator, 10Patch-For-Review: Exclude WMDE IP from rate limiting / throttling - https://phabricator.wikimedia.org/T198612 (10mmodell)
[00:44:03] <wikibugs>	 10Phabricator, 10Patch-For-Review: Exclude WMDE IP from rate limiting / throttling - https://phabricator.wikimedia.org/T198612 (10mmodell)
[00:49:11] <wikibugs>	 10Phabricator, 10Patch-For-Review: Exclude WMDE IP from rate limiting / throttling - https://phabricator.wikimedia.org/T198612 (10mmodell) 05Open>03Resolved a:03mmodell  {49ad8413aec884bb4619ce2a39b16841e528a463}
[00:49:14] <wikibugs>	 10Phabricator, 10Patch-For-Review: Exclude WMDE IP from rate limiting / throttling - https://phabricator.wikimedia.org/T198612 (10mmodell) 05Open>03Resolved a:03mmodell  {49ad8413aec884bb4619ce2a39b16841e528a463}
[01:33:29] <wikibugs>	 10Phabricator, 10Security, 10User-MarcoAurelio: Trusted contributors cannot escalate tasks as security issues - https://phabricator.wikimedia.org/T198831 (10JJMC89) 05Open>03Resolved a:03MarcoAurelio {D1075} / {rPHEX9ac7eb2ccef0}
[01:33:34] <wikibugs>	 10Phabricator, 10Security, 10User-MarcoAurelio: Trusted contributors cannot escalate tasks as security issues - https://phabricator.wikimedia.org/T198831 (10JJMC89) 05Open>03Resolved a:03MarcoAurelio {D1075} / {rPHEX9ac7eb2ccef0}
[01:35:46] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Growth-Team (Current Sprint): Set up test environment for PageTriage drafts in beta labs - https://phabricator.wikimedia.org/T198898 (10MusikAnimal) >>! In T198898#4402066, @Catrope wrote: > @MusikAnimal: I heard from @Mooeypoo that this isn't as easy as just enabling the confi...
[01:35:51] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Growth-Team (Current Sprint): Set up test environment for PageTriage drafts in beta labs - https://phabricator.wikimedia.org/T198898 (10MusikAnimal) >>! In T198898#4402066, @Catrope wrote: > @MusikAnimal: I heard from @Mooeypoo that this isn't as easy as just enabling the confi...
[02:33:11] <subbu>	 anyone know what is up with these jenkins failures? https://integration.wikimedia.org/ci/job/parsoidsvc-hhvm-parsertests-jessie/4906/console
[02:33:38] <subbu>	 01:31:34 [dfb9df9e2f76d0a1eec0b008] [no req]   MWException from line 1934 of /home/jenkins/workspace/parsoidsvc-hhvm-parsertests-jessie/src/mediawiki/core/includes/Storage/RevisionStore.php: RevisionStore for jenkins_u0_mw cannot be used with a DB connection for jenkins_u0_mw-parsertest_
[03:53:26] <kart_>	 !log Updated cxserver to bfc9c84
[03:53:31] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[04:51:37] <wikibugs>	 10Release-Engineering-Team (Kanban), 10DBA, 10Wikimedia-Apache-configuration, 10Patch-For-Review: Cleanup remaining WikipediaMobileFirefoxOS references - https://phabricator.wikimedia.org/T187850 (10Marostegui)
[04:51:44] <wikibugs>	 10Release-Engineering-Team (Kanban), 10DBA, 10Wikimedia-Apache-configuration, 10Patch-For-Review: Cleanup remaining WikipediaMobileFirefoxOS references - https://phabricator.wikimedia.org/T187850 (10Marostegui)
[04:52:48] <wikibugs>	 10Release-Engineering-Team (Kanban), 10DBA, 10Wikimedia-Apache-configuration, 10Patch-For-Review: Cleanup remaining WikipediaMobileFirefoxOS references - https://phabricator.wikimedia.org/T187850 (10Marostegui) 05Open>03Resolved a:03chasemp If the only hosts pending were db1095 and db1102 this can be...
[04:52:52] <wikibugs>	 10Release-Engineering-Team (Kanban), 10DBA, 10Wikimedia-Apache-configuration, 10Patch-For-Review: Cleanup remaining WikipediaMobileFirefoxOS references - https://phabricator.wikimedia.org/T187850 (10Marostegui) 05Open>03Resolved a:03chasemp If the only hosts pending were db1095 and db1102 this can be...
[07:02:54] <wikibugs>	 10Release-Engineering-Team (Kanban), 10DBA, 10Wikimedia-Apache-configuration, 10Patch-For-Review: Cleanup remaining WikipediaMobileFirefoxOS references - https://phabricator.wikimedia.org/T187850 (10jcrespo) As I said, I fixed this at https://phabricator.wikimedia.org/T187850#4078495
[07:03:03] <wikibugs>	 10Release-Engineering-Team (Kanban), 10DBA, 10Wikimedia-Apache-configuration, 10Patch-For-Review: Cleanup remaining WikipediaMobileFirefoxOS references - https://phabricator.wikimedia.org/T187850 (10jcrespo) As I said, I fixed this at https://phabricator.wikimedia.org/T187850#4078495
[08:49:26] <wikibugs>	 10Phabricator, 10Wikibugs: Exclude wiki bugs from phabricator rate limit - https://phabricator.wikimedia.org/T198915 (10Aklapper)
[08:49:32] <wikibugs>	 10Phabricator, 10Wikibugs: Exclude wiki bugs from phabricator rate limit - https://phabricator.wikimedia.org/T198915 (10Aklapper)
[08:51:09] <wikibugs>	 10Phabricator, 10Wikibugs: Exclude wiki bugs from phabricator rate limit - https://phabricator.wikimedia.org/T198915 (10Aklapper) I don't know how wikibugs works exactly but https://www.mediawiki.org/wiki/Wikibugs#Functions states that it polls. Could it simply poll less often?
[08:51:16] <wikibugs>	 10Phabricator, 10Wikibugs: Exclude wiki bugs from phabricator rate limit - https://phabricator.wikimedia.org/T198915 (10Aklapper) I don't know how wikibugs works exactly but https://www.mediawiki.org/wiki/Wikibugs#Functions states that it polls. Could it simply poll less often?
[08:52:22] <wikibugs>	 10Phabricator, 10Wikibugs: Exclude wiki bugs from phabricator rate limit - https://phabricator.wikimedia.org/T198915 (10Aklapper) I am renaming this task as it asks for a specific solution (that might not be the best way at all) instead of describing a problem (which tasks should do).
[08:52:27] <wikibugs>	 10Phabricator, 10Wikibugs: Exclude wiki bugs from phabricator rate limit - https://phabricator.wikimedia.org/T198915 (10Aklapper) I am renaming this task as it asks for a specific solution (that might not be the best way at all) instead of describing a problem (which tasks should do).
[08:52:54] <wikibugs>	 10Phabricator, 10Wikibugs: wikibugs hits Phabricator's rate limiting and hence is unreliable - https://phabricator.wikimedia.org/T198915 (10Aklapper)
[08:52:58] <wikibugs>	 10Phabricator, 10Wikibugs: wikibugs hits Phabricator's rate limiting and hence is unreliable - https://phabricator.wikimedia.org/T198915 (10Aklapper)
[08:54:59] <wikibugs>	 10Phabricator, 10Trusted-Contributors: Whitelist the Trusted-Contributors group from rate limit - https://phabricator.wikimedia.org/T198614 (10Aklapper) p:05High>03Low
[08:55:01] <wikibugs>	 10Phabricator, 10Trusted-Contributors: Whitelist the Trusted-Contributors group from rate limit - https://phabricator.wikimedia.org/T198614 (10Aklapper) p:05High>03Low
[09:01:19] <wikibugs>	 (03CR) 10Hashar: [C: 032] "\O/" [integration/config] - 10https://gerrit.wikimedia.org/r/442002 (owner: 10Arlolra)
[09:05:09] <wikibugs>	 (03Merged) 10jenkins-bot: Test Parsoid's version of Poem extension's parserTests against MediaWiki [integration/config] - 10https://gerrit.wikimedia.org/r/442002 (owner: 10Arlolra)
[09:09:54] <wikibugs>	 (03PS1) 10Fomafix: Edit Project Config [extensions/WikiLexicalData] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/444176
[09:10:52] <wikibugs>	 (03Abandoned) 10Fomafix: Edit Project Config [extensions/WikiLexicalData] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/444176 (owner: 10Fomafix)
[09:27:36] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Services (later): Something is wrong with deployment-restbase02.deployment-prep.eqiad.wmflabs - https://phabricator.wikimedia.org/T195709 (10mobrovac) p:05Triage>03Normal
[09:27:39] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Services (later): Something is wrong with deployment-restbase02.deployment-prep.eqiad.wmflabs - https://phabricator.wikimedia.org/T195709 (10mobrovac) p:05Triage>03Normal
[09:31:50] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Cassandra, 10RESTBase-Cassandra, 10Services (done): Puppet failure on deployment-cassandra3-0[12] - https://phabricator.wikimedia.org/T196830 (10mobrovac) p:05Triage>03Normal
[09:37:01] <wikibugs>	 10Project-Admins, 10User-Cirdan: Create project for Toolforge tool "Mitmachen" - https://phabricator.wikimedia.org/T198873 (10Aklapper) 05Open>03Resolved Requested public project #Mitmachen has been created: https://phabricator.wikimedia.org/project/view/3458/  Please encourage interested people to visit t...
[09:37:09] <wikibugs>	 10Project-Admins, 10User-Cirdan: Create project for Toolforge tool "Mitmachen" - https://phabricator.wikimedia.org/T198873 (10Aklapper) 05Open>03Resolved Requested public project #Mitmachen has been created: https://phabricator.wikimedia.org/project/view/3458/  Please encourage interested people to visit t...
[09:46:10] <wikibugs>	 10Release-Engineering-Team (Kanban), 10Operations, 10Release Pipeline, 10Services (watching): Migrate production services to kubernetes using the pipeline - https://phabricator.wikimedia.org/T198901 (10mobrovac)
[09:46:14] <wikibugs>	 10Release-Engineering-Team (Kanban), 10Operations, 10Release Pipeline, 10Services (watching): Migrate production services to kubernetes using the pipeline - https://phabricator.wikimedia.org/T198901 (10mobrovac)
[10:06:27] <wikibugs>	 (03CR) 10Hashar: [C: 032] jjb: add support to pass arguments to quibble [integration/config] - 10https://gerrit.wikimedia.org/r/444024 (https://phabricator.wikimedia.org/T196960) (owner: 10Hashar)
[10:08:19] <wikibugs>	 (03Merged) 10jenkins-bot: jjb: add support to pass arguments to quibble [integration/config] - 10https://gerrit.wikimedia.org/r/444024 (https://phabricator.wikimedia.org/T196960) (owner: 10Hashar)
[10:08:59] <wikibugs>	 (03CR) 10Hashar: [C: 032] Quibble jobs that skip selenium entirely [integration/config] - 10https://gerrit.wikimedia.org/r/444028 (https://phabricator.wikimedia.org/T196960) (owner: 10Hashar)
[10:10:54] <wikibugs>	 (03Merged) 10jenkins-bot: Quibble jobs that skip selenium entirely [integration/config] - 10https://gerrit.wikimedia.org/r/444028 (https://phabricator.wikimedia.org/T196960) (owner: 10Hashar)
[11:00:53] <wikibugs>	 (03PS1) 10Hashar: Migrate some extensions to Quibble without Selenium [integration/config] - 10https://gerrit.wikimedia.org/r/444195 (https://phabricator.wikimedia.org/T196960)
[11:11:34] <wikibugs>	 (03PS1) 10Hashar: Archive Premoderation extension [integration/config] - 10https://gerrit.wikimedia.org/r/444199 (https://phabricator.wikimedia.org/T198952)
[11:11:48] <wikibugs>	 (03CR) 10Hashar: [C: 032] Archive Premoderation extension [integration/config] - 10https://gerrit.wikimedia.org/r/444199 (https://phabricator.wikimedia.org/T198952) (owner: 10Hashar)
[11:13:37] <wikibugs>	 (03CR) 10Hashar: [C: 032] Migrate some extensions to Quibble without Selenium [integration/config] - 10https://gerrit.wikimedia.org/r/444195 (https://phabricator.wikimedia.org/T196960) (owner: 10Hashar)
[11:15:17] <wikibugs>	 (03Merged) 10jenkins-bot: Migrate some extensions to Quibble without Selenium [integration/config] - 10https://gerrit.wikimedia.org/r/444195 (https://phabricator.wikimedia.org/T196960) (owner: 10Hashar)
[11:15:19] <wikibugs>	 (03Merged) 10jenkins-bot: Archive Premoderation extension [integration/config] - 10https://gerrit.wikimedia.org/r/444199 (https://phabricator.wikimedia.org/T198952) (owner: 10Hashar)
[11:27:55] <wikibugs>	 (03CR) 10Zfilipin: "PS3 adds phab task to the commit message." [integration/config] - 10https://gerrit.wikimedia.org/r/443931 (https://phabricator.wikimedia.org/T188742) (owner: 10Hashar)
[11:28:48] <wikibugs>	 (03CR) 10Zfilipin: "PS4 changes triggers and npm script." [integration/config] - 10https://gerrit.wikimedia.org/r/443931 (https://phabricator.wikimedia.org/T188742) (owner: 10Hashar)
[11:29:41] <wikibugs>	 (03PS1) 10Hashar: Archive VisualChat extension [integration/config] - 10https://gerrit.wikimedia.org/r/444203 (https://phabricator.wikimedia.org/T198955)
[11:30:14] <wikibugs>	 (03CR) 10Hashar: [C: 032] Archive VisualChat extension [integration/config] - 10https://gerrit.wikimedia.org/r/444203 (https://phabricator.wikimedia.org/T198955) (owner: 10Hashar)
[11:32:00] <wikibugs>	 (03Merged) 10jenkins-bot: Archive VisualChat extension [integration/config] - 10https://gerrit.wikimedia.org/r/444203 (https://phabricator.wikimedia.org/T198955) (owner: 10Hashar)
[11:38:11] <wikibugs>	 (03PS1) 10Hashar: Archive SwarmExport extension [integration/config] - 10https://gerrit.wikimedia.org/r/444205 (https://phabricator.wikimedia.org/T198957)
[11:38:35] <wikibugs>	 (03CR) 10Hashar: [C: 032] Archive SwarmExport extension [integration/config] - 10https://gerrit.wikimedia.org/r/444205 (https://phabricator.wikimedia.org/T198957) (owner: 10Hashar)
[11:39:01] <wikibugs>	 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512 (10hashar)
[11:39:11] <wikibugs>	 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512 (10hashar)
[11:40:20] <wikibugs>	 (03Merged) 10jenkins-bot: Archive SwarmExport extension [integration/config] - 10https://gerrit.wikimedia.org/r/444205 (https://phabricator.wikimedia.org/T198957) (owner: 10Hashar)
[11:46:20] <wikibugs>	 (03PS1) 10Hashar: Update QA report for noselenium jobs [integration/config] - 10https://gerrit.wikimedia.org/r/444207 (https://phabricator.wikimedia.org/T196960)
[11:48:21] <wikibugs>	 (03CR) 10Hashar: [C: 032] Update QA report for noselenium jobs [integration/config] - 10https://gerrit.wikimedia.org/r/444207 (https://phabricator.wikimedia.org/T196960) (owner: 10Hashar)
[11:50:10] <wikibugs>	 (03Merged) 10jenkins-bot: Update QA report for noselenium jobs [integration/config] - 10https://gerrit.wikimedia.org/r/444207 (https://phabricator.wikimedia.org/T196960) (owner: 10Hashar)
[12:01:22] <wikibugs>	 (03PS5) 10Zfilipin: (WIP) job to run wdio tests for a single repo [integration/config] - 10https://gerrit.wikimedia.org/r/443931 (https://phabricator.wikimedia.org/T188742) (owner: 10Hashar)
[12:02:26] <wikibugs>	 (03CR) 10Zfilipin: "PS5 updates commit message with the correct job name and adds missing parameters." [integration/config] - 10https://gerrit.wikimedia.org/r/443931 (https://phabricator.wikimedia.org/T188742) (owner: 10Hashar)
[12:07:19] <wikibugs>	 10Release-Engineering-Team, 10Scap, 10Services (watching): Allow deploying services from a branch - https://phabricator.wikimedia.org/T198958 (10Pchelolo)
[12:07:22] <wikibugs>	 10Release-Engineering-Team, 10Scap, 10Services (watching): Allow deploying services from a branch - https://phabricator.wikimedia.org/T198958 (10Pchelolo)
[12:16:10] <wikibugs>	 (03PS6) 10Zfilipin: (WIP) job to run wdio tests for a single repo [integration/config] - 10https://gerrit.wikimedia.org/r/443931 (https://phabricator.wikimedia.org/T188742) (owner: 10Hashar)
[12:16:44] <wikibugs>	 (03CR) 10Zfilipin: "PS6 updates npm script in the commit message." [integration/config] - 10https://gerrit.wikimedia.org/r/443931 (https://phabricator.wikimedia.org/T188742) (owner: 10Hashar)
[13:08:23] <shinken-wm>	 PROBLEM - Puppet errors on deployment-memc06 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0]
[13:12:56] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Gerrit, 10Zuul: Zuul get confused when querying a change that yields two entries - https://phabricator.wikimedia.org/T198968 (10hashar)
[13:12:59] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Gerrit, 10Zuul: Zuul get confused when querying a change that yields two entries - https://phabricator.wikimedia.org/T198968 (10hashar)
[13:17:31] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Gerrit, 10Zuul: Zuul get confused when querying a change that yields two entries - https://phabricator.wikimedia.org/T198968 (10hashar) Zuul does:     gerrit query --all-approvals --comments --commit-message --current-patch-set --dependencies --files --patch-sets --...
[13:17:39] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Gerrit, 10Zuul: Zuul get confused when querying a change that yields two entries - https://phabricator.wikimedia.org/T198968 (10hashar) Zuul does:     gerrit query --all-approvals --comments --commit-message --current-patch-set --dependencies --files --patch-sets --...
[13:21:30] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Gerrit, 10Zuul: Zuul get confused when querying a change that yields two entries - https://phabricator.wikimedia.org/T198968 (10hashar)
[13:21:31] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Gerrit, 10Zuul: Zuul get confused when querying a change that yields two entries - https://phabricator.wikimedia.org/T198968 (10hashar)
[13:48:24] <shinken-wm>	 RECOVERY - Puppet errors on deployment-memc06 is OK: OK: Less than 1.00% above the threshold [0.0]
[14:19:35] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Patch-For-Review, 10User-zeljkofilipin: Run selenium-EXTENSION-jessie for all repositores with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilipin)
[14:19:39] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Patch-For-Review, 10User-zeljkofilipin: Run selenium-EXTENSION-jessie for all repositores with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilipin)
[14:20:21] <wikibugs>	 (03PS1) 10Hashar: Migrate MediaWikiFarm to Quibble with composer [integration/config] - 10https://gerrit.wikimedia.org/r/444231 (https://phabricator.wikimedia.org/T183512)
[14:21:41] <wikibugs>	 (03CR) 10Hashar: [C: 032] Migrate MediaWikiFarm to Quibble with composer [integration/config] - 10https://gerrit.wikimedia.org/r/444231 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar)
[14:22:18] <wikibugs>	 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512 (10hashar)
[14:22:19] <wikibugs>	 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512 (10hashar)
[14:23:09] <wikibugs>	 (03Merged) 10jenkins-bot: Migrate MediaWikiFarm to Quibble with composer [integration/config] - 10https://gerrit.wikimedia.org/r/444231 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar)
[14:23:20] <shinken-wm>	 PROBLEM - Puppet errors on deployment-apertium02 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0]
[14:24:06] <shinken-wm>	 PROBLEM - Puppet errors on integration-cumin is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0]
[14:24:26] <shinken-wm>	 PROBLEM - Puppet errors on deployment-mediawiki-09 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0]
[14:25:35] <shinken-wm>	 PROBLEM - Puppet errors on deployment-sca04 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0]
[14:26:56] <shinken-wm>	 PROBLEM - Puppet errors on deployment-jobrunner03 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0]
[14:27:02] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-docker-1016 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0]
[14:29:37] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Patch-For-Review, 10User-zeljkofilipin: Run selenium-EXTENSION-jessie for all repositores with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilipin)
[14:29:39] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Patch-For-Review, 10User-zeljkofilipin: Run selenium-EXTENSION-jessie for all repositores with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilipin)
[14:33:05] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Patch-For-Review, 10User-zeljkofilipin: Run selenium-EXTENSION-jessie for all repositores with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilipin)
[14:33:08] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Patch-For-Review, 10User-zeljkofilipin: Run selenium-EXTENSION-jessie for all repositores with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilipin)
[14:33:20] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Patch-For-Review, 10User-zeljkofilipin: Run selenium-EXTENSION-jessie for all repositores with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilipin)
[14:33:26] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Patch-For-Review, 10User-zeljkofilipin: Run selenium-EXTENSION-jessie for all repositores with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilipin)
[14:37:22] <wikibugs>	 10Continuous-Integration-Config, 10MathSearch, 10Patch-For-Review: mwext-testextension-zend should load extension mathsearch after math - https://phabricator.wikimedia.org/T117659 (10hashar) The load order might not matter anymore.  MathSearch currently fails to find `Wikibase\Lib\SnakFormatter::FORMAT_HTML_...
[14:37:24] <wikibugs>	 10Continuous-Integration-Config, 10MathSearch, 10Patch-For-Review: mwext-testextension-zend should load extension mathsearch after math - https://phabricator.wikimedia.org/T117659 (10hashar) The load order might not matter anymore.  MathSearch currently fails to find `Wikibase\Lib\SnakFormatter::FORMAT_HTML_...
[14:42:32] <wikibugs>	 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512 (10hashar)
[14:42:33] <wikibugs>	 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512 (10hashar)
[14:47:47] <wikibugs>	 (03PS7) 10Zfilipin: (WIP) job to run wdio tests for a single repo [integration/config] - 10https://gerrit.wikimedia.org/r/443931 (https://phabricator.wikimedia.org/T188742) (owner: 10Hashar)
[14:52:42] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-jessie-1002 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:52:56] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-docker-1006 is CRITICAL: CRITICAL: 80.00% of data above the critical threshold [0.0]
[14:53:19] <shinken-wm>	 PROBLEM - Puppet errors on integration-puppetmaster01 is CRITICAL: CRITICAL: 88.89% of data above the critical threshold [0.0]
[14:53:35] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-docker-1016 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0]
[14:53:41] <shinken-wm>	 PROBLEM - Puppet errors on deployment-changeprop is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:54:04] <shinken-wm>	 PROBLEM - Puppet errors on deployment-memc06 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:54:06] <shinken-wm>	 PROBLEM - Puppet errors on jenkinstest is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:54:08] <shinken-wm>	 PROBLEM - Puppet errors on deployment-mira is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:54:09] <shinken-wm>	 PROBLEM - Puppet errors on deployment-eventlog05 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:54:09] <shinken-wm>	 PROBLEM - Puppet errors on saucelabs-03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:54:11] <shinken-wm>	 PROBLEM - Puppet errors on deployment-webperf12 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:54:16] <shinken-wm>	 PROBLEM - Puppet errors on deployment-mediawiki-07 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:54:24] <shinken-wm>	 PROBLEM - Puppet errors on deployment-elastic05 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:54:26] <shinken-wm>	 PROBLEM - Puppet errors on deployment-cpjobqueue is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:54:28] <shinken-wm>	 PROBLEM - Puppet errors on deployment-etcd-01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:54:28] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-docker-1012 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:54:34] <shinken-wm>	 PROBLEM - Puppet errors on deployment-ores01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:54:34] <shinken-wm>	 PROBLEM - Puppet errors on deployment-cache-upload04 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:54:48] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-k8s-1018 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:55:01] <shinken-wm>	 PROBLEM - Puppet errors on deployment-kafka-jumbo-2 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:55:01] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-docker-1015 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:55:05] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-jessie-android is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:55:06] <shinken-wm>	 PROBLEM - Puppet errors on deployment-cumin is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:55:14] <shinken-wm>	 PROBLEM - Puppet errors on deployment-kafka-main-1 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:55:14] <shinken-wm>	 PROBLEM - Puppet errors on deployment-zotero01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:55:22] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-jessie-1003 is CRITICAL: CRITICAL: 88.89% of data above the critical threshold [0.0]
[14:55:22] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-docker-1020 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:55:22] <shinken-wm>	 PROBLEM - Puppet errors on deployment-kafka-main-2 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:55:25] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-docker-1005 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:55:25] <shinken-wm>	 PROBLEM - Puppet errors on deployment-redis05 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:55:27] <shinken-wm>	 PROBLEM - Puppet errors on deployment-mx02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:55:34] <shinken-wm>	 PROBLEM - Puppet errors on deployment-pdfrender02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:55:42] <shinken-wm>	 PROBLEM - Puppet errors on deployment-memc04 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:55:44] <shinken-wm>	 PROBLEM - Puppet errors on deployment-aqs03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:55:44] <shinken-wm>	 PROBLEM - Puppet errors on deployment-cassandra3-01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:55:48] <shinken-wm>	 PROBLEM - Puppet errors on deployment-memc07 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:55:48] <shinken-wm>	 PROBLEM - Puppet errors on deployment-ms-fe02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:55:52] <shinken-wm>	 PROBLEM - Puppet errors on deployment-mcs01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:56:03] <shinken-wm>	 PROBLEM - Puppet errors on deployment-conf03 is CRITICAL: CRITICAL: 90.00% of data above the critical threshold [0.0]
[14:56:03] <shinken-wm>	 PROBLEM - Puppet errors on integration-r-lang-01 is CRITICAL: CRITICAL: 90.00% of data above the critical threshold [0.0]
[14:56:03] <shinken-wm>	 PROBLEM - Puppet errors on deployment-logstash2 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:56:07] <shinken-wm>	 PROBLEM - Puppet errors on deployment-webperf11 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:56:07] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-docker-1008 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:56:19] <shinken-wm>	 PROBLEM - Puppet errors on deployment-poolcounter04 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:56:25] <shinken-wm>	 PROBLEM - Puppet errors on deployment-elastic07 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:56:28] <shinken-wm>	 PROBLEM - Puppet errors on deployment-imagescaler02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:56:39] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-docker-1004 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:56:43] <shinken-wm>	 PROBLEM - Puppet errors on deployment-restbase01 is CRITICAL: CRITICAL: 77.78% of data above the critical threshold [0.0]
[14:56:49] <shinken-wm>	 PROBLEM - Puppet errors on castor02 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0]
[14:56:50] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-docker-1010 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:57:01] <shinken-wm>	 PROBLEM - Puppet errors on deployment-db04 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[15:01:59] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Wikibase-DataModel-JavaScript, 10Wikidata: Wikibase tests are failing CI on unrelated changes - https://phabricator.wikimedia.org/T198973 (10Anomie)
[15:02:40] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Wikibase-DataModel-JavaScript, 10Wikidata: Wikibase tests are failing CI on unrelated changes - https://phabricator.wikimedia.org/T198973 (10Anomie) p:05Triage>03Unbreak!
[15:04:22] <shinken-wm>	 PROBLEM - Puppet errors on deployment-deploy01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[15:04:27] <shinken-wm>	 PROBLEM - Puppet errors on deployment-parsoid09 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0]
[15:04:39] <shinken-wm>	 PROBLEM - Puppet errors on deployment-fluorine02 is CRITICAL: CRITICAL: 10.00% of data above the critical threshold [0.0]
[15:04:39] <shinken-wm>	 PROBLEM - Puppet errors on saucelabs-01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[15:04:45] <shinken-wm>	 RECOVERY - Puppet errors on deployment-mediawiki-09 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:04:53] <shinken-wm>	 PROBLEM - Puppet errors on deployment-redis06 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0]
[15:04:54] <shinken-wm>	 PROBLEM - Puppet errors on deployment-db03 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0]
[15:05:00] <shinken-wm>	 PROBLEM - Puppet errors on deployment-prometheus01 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0]
[15:05:04] <shinken-wm>	 PROBLEM - Puppet errors on deployment-ms-be04 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[15:05:15] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-docker-1007 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0]
[15:05:15] <shinken-wm>	 PROBLEM - Puppet errors on deployment-sca01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[15:05:15] <shinken-wm>	 PROBLEM - Puppet errors on integration-publishing is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0]
[15:05:16] <shinken-wm>	 RECOVERY - Puppet errors on deployment-zotero01 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:05:20] <shinken-wm>	 PROBLEM - Puppet errors on deployment-sca02 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0]
[15:05:20] <shinken-wm>	 RECOVERY - Puppet errors on integration-slave-docker-1016 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:05:20] <shinken-wm>	 RECOVERY - Puppet errors on integration-slave-jessie-1003 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:05:25] <wikibugs>	 (03CR) 10Zfilipin: (WIP) job to run wdio tests for a single repo (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/443931 (https://phabricator.wikimedia.org/T188742) (owner: 10Hashar)
[15:05:36] <shinken-wm>	 RECOVERY - Puppet errors on deployment-pdfrender02 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:05:54] <shinken-wm>	 RECOVERY - Puppet errors on deployment-mcs01 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:06:01] <shinken-wm>	 RECOVERY - Puppet errors on integration-r-lang-01 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:06:03] <shinken-wm>	 RECOVERY - Puppet errors on deployment-conf03 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:06:20] <shinken-wm>	 RECOVERY - Puppet errors on deployment-poolcounter04 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:06:20] <shinken-wm>	 PROBLEM - Puppet errors on deployment-aqs01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[15:06:24] <shinken-wm>	 RECOVERY - Puppet errors on deployment-apertium02 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:06:45] <shinken-wm>	 RECOVERY - Puppet errors on deployment-restbase01 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:06:47] <shinken-wm>	 RECOVERY - Puppet errors on castor02 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:07:37] <shinken-wm>	 RECOVERY - Puppet errors on integration-slave-jessie-1002 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:07:46] <wikibugs>	 10Continuous-Integration-Config, 10MathSearch, 10Patch-For-Review: mwext-testextension-zend should load extension mathsearch after math - https://phabricator.wikimedia.org/T117659 (10hashar) Now MathSearch fails because it lacks support for `SnakFormatter::FORMAT_HTML_VERBOSE`.
[15:08:17] <shinken-wm>	 RECOVERY - Puppet errors on deployment-jobrunner03 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:08:29] <shinken-wm>	 RECOVERY - Puppet errors on deployment-sca04 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:08:29] <shinken-wm>	 RECOVERY - Puppet errors on integration-slave-docker-1006 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:08:40] <shinken-wm>	 RECOVERY - Puppet errors on integration-puppetmaster01 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:08:52] <shinken-wm>	 RECOVERY - Puppet errors on integration-cumin is OK: OK: Less than 1.00% above the threshold [0.0]
[15:09:02] <shinken-wm>	 RECOVERY - Puppet errors on deployment-mediawiki-07 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:09:27] <shinken-wm>	 RECOVERY - Puppet errors on integration-slave-docker-1012 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:09:34] <shinken-wm>	 RECOVERY - Puppet errors on deployment-ores01 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:09:36] <shinken-wm>	 RECOVERY - Puppet errors on deployment-cache-upload04 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:09:38] <shinken-wm>	 RECOVERY - Puppet errors on deployment-fluorine02 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:09:56] <shinken-wm>	 RECOVERY - Puppet errors on deployment-db03 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:10:00] <shinken-wm>	 RECOVERY - Puppet errors on deployment-prometheus01 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:10:02] <shinken-wm>	 RECOVERY - Puppet errors on integration-slave-docker-1015 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:10:15] <shinken-wm>	 RECOVERY - Puppet errors on deployment-kafka-main-1 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:10:15] <shinken-wm>	 RECOVERY - Puppet errors on jenkinstest is OK: OK: Less than 1.00% above the threshold [0.0]
[15:10:17] <shinken-wm>	 RECOVERY - Puppet errors on integration-slave-docker-1007 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:10:17] <shinken-wm>	 RECOVERY - Puppet errors on integration-publishing is OK: OK: Less than 1.00% above the threshold [0.0]
[15:10:21] <shinken-wm>	 RECOVERY - Puppet errors on integration-slave-docker-1020 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:10:23] <shinken-wm>	 RECOVERY - Puppet errors on deployment-kafka-main-2 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:10:25] <shinken-wm>	 RECOVERY - Puppet errors on deployment-mx02 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:10:42] <shinken-wm>	 RECOVERY - Puppet errors on deployment-memc04 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:10:44] <shinken-wm>	 RECOVERY - Puppet errors on deployment-aqs03 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:10:48] <shinken-wm>	 RECOVERY - Puppet errors on deployment-memc07 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:10:50] <shinken-wm>	 RECOVERY - Puppet errors on deployment-ms-fe02 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:11:05] <shinken-wm>	 RECOVERY - Puppet errors on deployment-logstash2 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:11:25] <shinken-wm>	 RECOVERY - Puppet errors on deployment-elastic07 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:11:39] <shinken-wm>	 RECOVERY - Puppet errors on integration-slave-docker-1004 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:12:24] <shinken-wm>	 RECOVERY - Puppet errors on deployment-deploy01 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:14:21] <shinken-wm>	 RECOVERY - Puppet errors on deployment-eventlog05 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:14:28] <shinken-wm>	 RECOVERY - Puppet errors on deployment-parsoid09 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:14:28] <shinken-wm>	 RECOVERY - Puppet errors on deployment-etcd-01 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:14:28] <shinken-wm>	 RECOVERY - Puppet errors on deployment-cpjobqueue is OK: OK: Less than 1.00% above the threshold [0.0]
[15:14:50] <shinken-wm>	 RECOVERY - Puppet errors on integration-slave-k8s-1018 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:14:53] <shinken-wm>	 RECOVERY - Puppet errors on deployment-redis06 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:15:06] <shinken-wm>	 RECOVERY - Puppet errors on deployment-cumin is OK: OK: Less than 1.00% above the threshold [0.0]
[15:15:06] <shinken-wm>	 RECOVERY - Puppet errors on deployment-ms-be04 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:15:21] <shinken-wm>	 RECOVERY - Puppet errors on deployment-sca02 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:15:25] <shinken-wm>	 RECOVERY - Puppet errors on integration-slave-docker-1005 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:15:46] <shinken-wm>	 RECOVERY - Puppet errors on deployment-cassandra3-01 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:15:54] <shinken-wm>	 RECOVERY - Puppet errors on saucelabs-03 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:16:04] <shinken-wm>	 RECOVERY - Puppet errors on deployment-webperf11 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:16:06] <shinken-wm>	 RECOVERY - Puppet errors on deployment-changeprop is OK: OK: Less than 1.00% above the threshold [0.0]
[15:16:20] <shinken-wm>	 RECOVERY - Puppet errors on deployment-aqs01 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:16:34] <shinken-wm>	 RECOVERY - Puppet errors on deployment-memc06 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:16:51] <shinken-wm>	 RECOVERY - Puppet errors on integration-slave-docker-1010 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:19:24] <shinken-wm>	 RECOVERY - Puppet errors on deployment-elastic05 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:19:38] <shinken-wm>	 RECOVERY - Puppet errors on saucelabs-01 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:20:02] <shinken-wm>	 RECOVERY - Puppet errors on deployment-kafka-jumbo-2 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:20:04] <shinken-wm>	 RECOVERY - Puppet errors on integration-slave-jessie-android is OK: OK: Less than 1.00% above the threshold [0.0]
[15:20:14] <shinken-wm>	 RECOVERY - Puppet errors on deployment-sca01 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:21:02] <shinken-wm>	 RECOVERY - Puppet errors on deployment-webperf12 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:21:08] <shinken-wm>	 RECOVERY - Puppet errors on integration-slave-docker-1008 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:21:26] <shinken-wm>	 RECOVERY - Puppet errors on deployment-imagescaler02 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:22:01] <shinken-wm>	 RECOVERY - Puppet errors on deployment-db04 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:23:59] <shinken-wm>	 RECOVERY - Puppet errors on deployment-mira is OK: OK: Less than 1.00% above the threshold [0.0]
[15:25:07] <wikibugs>	 (03PS8) 10Zfilipin: (WIP) job to run wdio tests for a single repo [integration/config] - 10https://gerrit.wikimedia.org/r/443931 (https://phabricator.wikimedia.org/T188742) (owner: 10Hashar)
[15:26:02] <wikibugs>	 (03CR) 10Zfilipin: "PS8 fixes logdir in an ugly way :/" [integration/config] - 10https://gerrit.wikimedia.org/r/443931 (https://phabricator.wikimedia.org/T188742) (owner: 10Hashar)
[15:26:25] <wikibugs>	 (03PS9) 10Zfilipin: (WIP) job to run wdio tests for a single repo [integration/config] - 10https://gerrit.wikimedia.org/r/443931 (https://phabricator.wikimedia.org/T188742) (owner: 10Hashar)
[15:27:03] <wikibugs>	 (03CR) 10Zfilipin: "PS9 is a rebase" [integration/config] - 10https://gerrit.wikimedia.org/r/443931 (https://phabricator.wikimedia.org/T188742) (owner: 10Hashar)
[15:27:53] <hashar>	 zeljkof: bah :/   Iwill try to have a look at it over the week-end. Else lets pair on that on monday and finish it up!
[15:27:58] <hashar>	 I gotta escape 
[15:28:11] <zeljkof>	 hashar: great! :D
[15:39:10] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Patch-For-Review, 10User-zeljkofilipin: Run selenium-EXTENSION-jessie for all repositores with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilipin)
[15:40:00] <wikibugs>	 10Phabricator: Rate-limit is too harsh - https://phabricator.wikimedia.org/T198974 (10Jc86035)
[15:40:24] <shinken-wm>	 RECOVERY - Puppet errors on deployment-redis05 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:45:31] <wikibugs>	 (03CR) 10Zfilipin: (WIP) job to run wdio tests for a single repo (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/443931 (https://phabricator.wikimedia.org/T188742) (owner: 10Hashar)
[15:49:38] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Easy, 10Patch-For-Review: en-rtl listed under other projects on beta.wmflabs.org - https://phabricator.wikimedia.org/T195675 (10cscott) 05Open>03Resolved a:03cscott
[15:56:17] <wikibugs>	 10Release-Engineering-Team, 10Scap, 10Services (watching): Allow deploying services from a branch - https://phabricator.wikimedia.org/T198958 (10thcipriani) This should work already.  It works in the scap test setup:  ```lang=shell-session vagrant@stretch:/srv/deployment/mockbase/deploy$ ssh scap-target-01 -...
[15:59:39] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Wikibase-DataModel-JavaScript, 10Wikidata: Wikibase tests are failing CI on unrelated changes - https://phabricator.wikimedia.org/T198973 (10Daimona)
[16:01:33] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Wikibase-DataModel-JavaScript, 10Wikidata, 10Wikidata-Campsite: Wikibase tests are failing CI on unrelated changes - https://phabricator.wikimedia.org/T198973 (10Reedy)
[16:20:57] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10JavaScript, 10MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), and 2 others: Run Selenium Cucumber tests in CI - https://phabricator.wikimedia.org/T179190 (10zeljkofilipin) >>! In T179190#4173431, @Krinkle wrote: > @zeljkofilipin I...
[16:23:15] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10JavaScript, 10MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), and 2 others: Run Selenium Cucumber tests in CI - https://phabricator.wikimedia.org/T179190 (10zeljkofilipin)
[16:26:54] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10JavaScript, 10MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), and 2 others: Run Selenium Cucumber tests in CI - https://phabricator.wikimedia.org/T179190 (10zeljkofilipin)
[16:27:20] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10JavaScript, 10MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), and 2 others: Run Selenium Cucumber tests in CI - https://phabricator.wikimedia.org/T179190 (10zeljkofilipin)
[16:29:07] <tarrow>	 Can someone click 'update now' on this for me? https://phabricator.wikimedia.org/diffusion/WBDM/manage/ It doesn't seem to be updating by itself
[16:31:04] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10JavaScript, 10MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), and 2 others: Run Selenium Cucumber tests in CI - https://phabricator.wikimedia.org/T179190 (10zeljkofilipin)
[16:34:39] <thcipriani>	 tarrow: done
[16:35:32] <tarrow>	 thcipriani: any idea why there is a failure on initalising?
[16:36:11] <thcipriani>	 I was about to ask you that as well. I'm unsure about what that means.
[16:36:26] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10JavaScript, 10MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), and 2 others: Run Selenium Cucumber tests in CI - https://phabricator.wikimedia.org/T179190 (10zeljkofilipin)
[16:37:03] <tarrow>	 It causing problems I think: https://phabricator.wikimedia.org/T198975
[16:37:29] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10JavaScript, 10MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), and 2 others: Run Selenium Cucumber tests in CI - https://phabricator.wikimedia.org/T179190 (10zeljkofilipin)
[16:37:55] <tarrow>	 thcipriani: ooh, looks like it has been changed to point at gerrit not github
[16:38:13] <thcipriani>	 https://gist.github.com/thcipriani/cc65a1e7885a87d0af67cc0c4938e22a
[16:38:15] <thcipriani>	 yeah
[16:38:24] <thcipriani>	 the remote doesn't exist
[16:38:26] <tarrow>	 https://phabricator.wikimedia.org/diffusion/WBDM/manage/uris/ should be observing github
[16:38:49] <tarrow>	 https://github.com/wmde/WikibaseDataModelJavaScript is the repo
[16:39:35] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10JavaScript, 10MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), and 2 others: Run Selenium Cucumber tests in CI - https://phabricator.wikimedia.org/T179190 (10zeljkofilipin)
[16:40:36] <tarrow>	 thcipriani: could you change it back to the right one?
[16:41:15] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10JavaScript, 10MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), 10User-zeljkofilipin: Run Selenium Cucumber tests in CI - https://phabricator.wikimedia.org/T179190 (10zeljkofilipin)
[16:41:18] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10JavaScript, 10MW-1.32-release-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)), 10User-zeljkofilipin: Run Selenium Cucumber tests in CI - https://phabricator.wikimedia.org/T179190 (10zeljkofilipin) a:03zeljkofilipin
[16:42:08] <thcipriani>	 tarrow: looking at the history of that repo it doesn't look like it was ever set to github afaict. Last time that config for that repo was modified on disk was 2016-10-07.
[16:43:17] <tarrow>	 thcipriani: oh! I swear it was pointed at github
[16:43:25] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MinervaNeue, 10Readers-Web-Backlog, and 3 others: Minerva Ruby and Node.js browser tests running side by side - https://phabricator.wikimedia.org/T190710 (10zeljkofilipin) a:03zeljkofilipin
[16:43:40] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MinervaNeue, 10Readers-Web-Backlog, and 3 others: Minerva Ruby and Node.js browser tests running side by side - https://phabricator.wikimedia.org/T190710 (10zeljkofilipin) 05stalled>03Open
[16:44:39] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MinervaNeue, 10Readers-Web-Backlog, and 3 others: Minerva Ruby and Node.js browser tests running side by side - https://phabricator.wikimedia.org/T190710 (10zeljkofilipin)
[16:45:18] <tarrow>	 I'm around 98% certain. because I had to drop by here a week or so ago to get someone to click "update now" since it had run to 6 hours between attempts
[16:46:31] <thcipriani>	 tarrow: if this isn't desperately broken, could you file a task and I'll add this info and ping twentyafterfou.r? I'm not 100% about how all this is setup and working/what the policies are, and twentyafterfou.r is out today.
[16:47:46] <tarrow>	 thcipriani: I'm not at all 100% but I think it is pretty badly breaking lots of other peoples tests. Reedy pinged me about it because it was causing problems
[16:48:07] <thcipriani>	 ah, this is related to that task
[16:48:11] <Reedy>	 Unfortunately it's causing a lot of unrelated test failures
[16:48:13] <Reedy>	 Yeah :(
[16:48:18] <tarrow>	 yep; I think it is the cause :/
[16:48:43] <thcipriani>	 ok, /me digs
[16:49:26] <tarrow>	 I believe the rest of the Wikidata people are out on an offsite now too :/
[16:52:41] <tarrow>	 thanks for digging for me :)
[16:52:53] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MinervaNeue, 10Readers-Web-Backlog, and 3 others: Minerva Ruby and Node.js browser tests running side by side - https://phabricator.wikimedia.org/T190710 (10zeljkofilipin)
[16:58:42] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MinervaNeue, 10Readers-Web-Backlog, and 3 others: Minerva Ruby and Node.js browser tests running side by side - https://phabricator.wikimedia.org/T190710 (10zeljkofilipin)
[17:00:34] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MinervaNeue, 10Readers-Web-Backlog, and 3 others: Minerva Ruby and Node.js browser tests running side by side - https://phabricator.wikimedia.org/T190710 (10zeljkofilipin)
[17:01:28] <thcipriani>	 tarrow: ahhh, I think it's https://phabricator.wikimedia.org/source/wikibase-data-model/manage/basics/ diffusion repo
[17:01:42] <thcipriani>	 I scheduled an update there
[17:01:55] <thcipriani>	 WBDMJS vs WBDM
[17:02:05] <tarrow>	 ooh!
[17:02:07] <tarrow>	 probably
[17:02:22] <tarrow>	 my bad
[17:02:53] <thcipriani>	 no worries, happy to have figured it out
[17:05:53] <hasharAway>	 thcipriani: and of course I cannot reproduce it locally bah :(
[17:09:08] <hasharAway>	 thcipriani: ah Wikibase points at  https://phabricator.wikimedia.org/source/wikibase-data-model.git
[17:09:13] <hasharAway>	 so I guess you fixed https://phabricator.wikimedia.org/T198973  :]
[17:09:57] <thcipriani>	 I do see at least 1 success for mwcore since the update https://integration.wikimedia.org/ci/job/mediawiki-extensions-hhvm-jessie/51250/ 
[17:10:33] <tarrow>	 fingers crossed
[17:12:24] <hasharAway>	 if it works, feel free to add more details to https://phabricator.wikimedia.org/T198973  and close it
[17:12:43] <hasharAway>	 and probably as a follow up Wikibase git modules should be made to point to Gerrit instead of Phabricator diffusion
[17:12:54] <hasharAway>	 though, that is a edge case really
[17:19:58] <tarrow>	 Yeah, although it wasn't just down to bad syncing we (me) also made a mistake; it referenced a commit that ended up not making it to master and so disappeared when somebody tidied up the old branches. 
[17:20:25] <tarrow>	 I then added it back in but it didn't appear immediately because of the delay in syncing
[17:42:14] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Wikibase-DataModel-JavaScript, 10Wikidata, 10Wikidata-Campsite: Wikibase tests are failing CI on unrelated changes - https://phabricator.wikimedia.org/T198973 (10thcipriani) 05Open>03Resolved a:05thcipriani>03Tarrow T...
[18:03:02] <wikibugs>	 10Release-Engineering-Team: Work on "Docker environment generator" - https://phabricator.wikimedia.org/T192789 (10greg) 05Open>03Resolved Being bold and closing this hackathon activity proposal.
[18:06:20] <wikibugs>	 10Release-Engineering-Team (Watching / External), 10Scoring-platform-team: Another round of discussion about wiki-ai's GitHub->gerrit mirroring - https://phabricator.wikimedia.org/T194212 (10greg) >>! In T194212#4302092, @awight wrote: > Hehe, I see you've upped the ante. >  > Well, we can't get a much lower v...
[18:11:03] <wikibugs>	 10Gerrit, 10Release-Engineering-Team: Gerrit plugin "zuul" failed to load - https://phabricator.wikimedia.org/T195176 (10greg) 05Open>03Resolved We haven't seen any more instances of this, have we?  Closing as resolved (via magic/space demons cleansing) unless someone else see another instance of this.
[18:12:04] <wikibugs>	 10Release-Engineering-Team (Watching / External), 10Scap, 10Services (watching): Allow deploying services from a branch - https://phabricator.wikimedia.org/T198958 (10greg)
[18:14:15] <greg-g>	 oh, that's a new task...
[18:14:19] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-07-10 (1.32.0-wmf.12)), 10Patch-For-Review, 10User-zeljkofilipin: Run selenium-EXTENSION-jessie for all repositores with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilipin)
[18:20:37] <wikibugs>	 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team: search-mjolnir-tox-docker job in status ABORT somewhat regularly - https://phabricator.wikimedia.org/T190963 (10greg) And because our jenkins history is time limited I can now only see the last 2 runs of this job, one success and o...
[18:25:57] <wikibugs>	 10Release-Engineering-Team: jenkins-bot LDAP entry contains pmtpa references - https://phabricator.wikimedia.org/T198271 (10greg) p:05Triage>03Lowest
[18:26:10] <wikibugs>	 10Release-Engineering-Team (Someday): jenkins-bot LDAP entry contains pmtpa references - https://phabricator.wikimedia.org/T198271 (10greg)
[18:39:24] <apergos>	 pmtpa? really? lol
[18:39:40] <Reedy>	 gone but not dead
[18:45:11] <apergos>	 someone stab it through the heart already
[18:50:33] <wikibugs>	 10Release-Engineering-Team (Next), 10ORES, 10Scoring-platform-team, 10Performance: Try to increase ORES deployment parallelism - https://phabricator.wikimedia.org/T197180 (10greg)
[19:06:29] <Krinkle>	 I'm having some issues loading VE on a page in Beta Cluster. Seems like Restbase/Parsoid might be down or having issues.
[19:06:40] <Krinkle>	 This request is timing out for me
[19:06:41] <Krinkle>	 https://en.wikipedia.beta.wmflabs.org/api/rest_v1/page/html/User%3AKrinkle%2FGenerated_rows?redirect=false
[19:10:09] <Reedy>	 Notice: /Stage[main]/Cassandra/Cassandra::Instance[default]/Systemd::Service[cassandra]/Service[cassandra]/ensure: ensure changed 'stopped' to 'running'
[19:10:09] <Reedy>	 Info: /Stage[main]/Cassandra/Cassandra::Instance[default]/Systemd::Service[cassandra]/Service[cassandra]: Unscheduling refresh on Service[cassandra]
[19:10:37] <Reedy>	 It's broken
[19:10:37] <Reedy>	 Jul 06 19:10:00 deployment-restbase02 cassandra[28636]: Error opening zip file or JAR manifest missing : /usr/share/java/prometheus/jmx_prometheus_javaagent.jar
[19:15:24] <wikibugs>	 10Release-Engineering-Team, 10Performance-Team, 10MW-1.32-release-notes (WMF-deploy-2018-06-26 (1.32.0-wmf.10)), 10Patch-For-Review: Saving timings up 50% since 2018-06-28 20:53 - https://phabricator.wikimedia.org/T198483 (10aaron) >>! In T198483#4393585, @aaron wrote: > Judging from https://performance.wi...
[19:17:34] <Reedy>	 Krinkle: ^ I'm guessing it's related to cassandra being fscked
[19:18:27] <Krinkle>	 Hm.. I guess.
[19:19:32] <wikibugs>	 10Deployments, 10Release-Engineering-Team, 10Performance-Team (Radar): mwscript emits warning "grep: GREP_OPTIONS is deprecated; please use an alias or script" - https://phabricator.wikimedia.org/T198775 (10greg) I can't see where $GREP_OPTIONS is set, though....
[19:27:41] <wikibugs>	 10Deployments, 10Release-Engineering-Team, 10Performance-Team (Radar): mwscript emits warning "grep: GREP_OPTIONS is deprecated; please use an alias or script" - https://phabricator.wikimedia.org/T198775 (10Krinkle) 05Open>03Invalid @greg Excellent point. I assumed it was triggered by just `grep -Pqw '(w...
[19:33:00] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10Release Pipeline, 10Jenkins: Enable MFA on Jenkins - https://phabricator.wikimedia.org/T198814 (10greg) Looks like that linked article actually says that Jenkins doesn't do MFA itself and users of Jenkins should instead integrate Jenkin...
[19:36:15] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Someday): Remove deployment.wikimedia.beta.wmflabs.org wiki (deploymentwiki) - https://phabricator.wikimedia.org/T198673 (10greg) p:05Triage>03Normal
[19:38:33] <wikibugs>	 10Release-Engineering-Team (Watching / External), 10GitHub-Mirrors, 10Security-Team: Enforce 2FA for GitHub members - https://phabricator.wikimedia.org/T198810 (10greg) Supportive of this, we'll be looking into the wmfgerrit/wmfphab accounts soon.
[19:54:44] <wikibugs>	 10Release-Engineering-Team (Watching / External), 10GitHub-Mirrors, 10Security-Team: Enforce 2FA for GitHub members - https://phabricator.wikimedia.org/T198810 (10Krenair) >>! In T198810#4400355, @Reedy wrote: >>>! In T198810#4400287, @Bawolff wrote: >> It'd be kind of nice if people who are members solely s...
[19:55:34] <wikibugs>	 10Release-Engineering-Team (Watching / External), 10GitHub-Mirrors, 10Security-Team: Enforce 2FA for GitHub members - https://phabricator.wikimedia.org/T198810 (10Jdforrester-WMF) Will this also affect "outside collaborators"? If not, perhaps we could shift all non-2FA people over to that status for now?
[19:56:12] <wikibugs>	 10Release-Engineering-Team (Watching / External), 10GitHub-Mirrors, 10Security-Team: Enforce 2FA for GitHub members - https://phabricator.wikimedia.org/T198810 (10Krenair) According to the screenshot at the top of this task yes.
[19:57:29] <wikibugs>	 10Continuous-Integration-Infrastructure, 10VisualEditor, 10User-Ryasmeen: Browser disconnects when running QUnit tests with local browsers - https://phabricator.wikimedia.org/T89075 (10Krinkle)
[19:57:32] <wikibugs>	 10Continuous-Integration-Infrastructure, 10VisualEditor, 10User-Ryasmeen: Concurrent builds using local Chromium/Firefox browsers on Linux host fail - https://phabricator.wikimedia.org/T90673 (10Krinkle) 05Open>03Resolved a:03Krinkle Fixed. And also, for Chromium we no longer need Xvfb, given `--headle...
[19:57:35] <wikibugs>	 10Continuous-Integration-Infrastructure, 10VisualEditor, 10User-Ryasmeen: Jenkins: Convert mediawiki qunit from grunt-contrib-qunit (PhantomJS) to grunt-karma (Chromium) - https://phabricator.wikimedia.org/T74063 (10Krinkle)
[20:03:36] <wikibugs>	 10Phabricator, 10Release-Engineering-Team (Watching / External), 10Mail, 10Operations, and 3 others: Phabricator outbound email seems to have a SPOF of mx1001 - https://phabricator.wikimedia.org/T196916 (10greg) (thanks @herron )
[20:03:51] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Someday), 10Technical-Debt: Remove deployment.wikimedia.beta.wmflabs.org wiki (deploymentwiki) - https://phabricator.wikimedia.org/T198673 (10Krinkle)
[20:04:06] <wikibugs>	 10Continuous-Integration-Config, 10Release-Engineering-Team (Next), 10Quibble: Skip Quibble "composer" and "sqlite" jobs on  wmf branches - https://phabricator.wikimedia.org/T192702 (10greg)
[20:06:47] <wikibugs>	 10MediaWiki-Releasing, 10Release-Engineering-Team, 10MW-1.31-release: Upgrade patches for tarball releases don't apply cleanly to tarball installation - https://phabricator.wikimedia.org/T73379 (10greg) >>! In T73379#4277349, @demon wrote: > Was this a problem for the rc's?  ....
[20:09:27] <wikibugs>	 10Release-Engineering-Team, 10Scap, 10Operations, 10Scoring-platform-team: Deployment git server can't supply ORES hosts in parallel - https://phabricator.wikimedia.org/T191842 (10greg) I think to do much on this we'll need some performance numbers.  Also, if this isn't 100% addressed by git-lfs reducing t...
[20:10:24] <wikibugs>	 10Release-Engineering-Team (Someday), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-05-15 (1.32.0-wmf.4)), 10Patch-For-Review, and 2 others: Avoid importing core's selenium/pageobjects files using relative paths - https://phabricator.wikimedia.org/T193088 (10greg)
[20:10:37] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Someday), 10Technical-Debt: Remove deployment.wikimedia.beta.wmflabs.org wiki (deploymentwiki) - https://phabricator.wikimedia.org/T198673 (10Krenair) >>! In T198673#4399005, @MarcoAurelio wrote: > Can we also consider deleting all of those not neede...
[20:14:17] <wikibugs>	 10Release-Engineering-Team, 10Performance-Team, 10MW-1.32-release-notes (WMF-deploy-2018-06-26 (1.32.0-wmf.10)), 10Patch-For-Review: Saving timings up 50% since 2018-06-28 20:53 - https://phabricator.wikimedia.org/T198483 (10greg)
[20:14:31] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Services: Cassandra broken in beta - https://phabricator.wikimedia.org/T198995 (10Reedy)
[20:14:33] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Services: Cassandra broken in beta - https://phabricator.wikimedia.org/T198995 (10Reedy) p:05Triage>03High
[20:20:04] <wikibugs>	 10Release-Engineering-Team, 10Performance-Team, 10MW-1.32-release-notes (WMF-deploy-2018-06-26 (1.32.0-wmf.10)), 10Patch-For-Review: Save Timing increased 50% since 2018-06-28 20:53 - https://phabricator.wikimedia.org/T198483 (10Krinkle)
[20:31:20] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Cassandra, 10Services: Cassandra broken in beta - https://phabricator.wikimedia.org/T198995 (10Krenair) Something's wrong with that host per T195709 What about 01? See also T186750 and T186994
[20:34:18] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Cassandra, 10Services: Cassandra broken in beta - https://phabricator.wikimedia.org/T198995 (10Reedy) 01 has the same error trying to start cassandra
[20:54:13] <wikibugs>	 10Release-Engineering-Team (Watching / External), 10MediaWiki-Parser, 10MediaWiki-Platform-Team, 10Operations, and 2 others: Servers using tidy-html5 are rendering pages differently, especially with <bdi> - https://phabricator.wikimedia.org/T193414 (10Jdforrester-WMF) 05Open>03declined Now that we've s...
[20:54:17] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MinervaNeue, 10Patch-For-Review, and 3 others: Minerva Ruby and Node.js browser tests running side by side - https://phabricator.wikimedia.org/T190710 (10Jdlrobson)
[21:43:33] <wikibugs>	 (03PS1) 10Umherirrender: Run phan for Cite [integration/config] - 10https://gerrit.wikimedia.org/r/444320
[21:45:03] <wikibugs>	 (03CR) 10Umherirrender: "phan was added Dec 2017 to Cite, I would assume this was lost in some refactoring, see I4cc1fab386c09f7068ab417ce50b52c3371e52cf" [integration/config] - 10https://gerrit.wikimedia.org/r/444320 (owner: 10Umherirrender)
[22:27:14] <wikibugs>	 10Release-Engineering-Team, 10Performance-Team, 10MW-1.32-release-notes (WMF-deploy-2018-06-26 (1.32.0-wmf.10)), 10Patch-For-Review: Save Timing increased 50% since 2018-06-28 20:53 - https://phabricator.wikimedia.org/T198483 (10Krinkle) >>! In T198483#4404330, @aaron wrote: > Looking at this more, it seem...
[22:39:02] <Krenair>	 https://gerrit.wikimedia.org/r/#/admin/groups/119,members - what's up with Kaldari's entries?
[22:39:26] <Reedy>	 Didn't he have login problems re that gerrit bug?
[22:39:49] <paladox>	 yep
[22:39:54] <paladox>	 we are still trying to fix that
[22:39:54] <greg-g>	 https://phabricator.wikimedia.org/T197083
[22:40:44] <Krenair>	 Valerie = rkaldari@ ?
[22:40:55] <paladox>	 yep
[22:41:04] <Krenair>	 ok
[22:41:06] <paladox>	 it's a work around for now
[22:50:15] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Growth-Team (Current Sprint): Set up test environment for PageTriage drafts in beta labs - https://phabricator.wikimedia.org/T198898 (10Catrope) Right, I guess we won't have the Article Wizard set up to create drafts in the expected form, but we probably don't really need that...
[22:54:33] <wikibugs>	 10Release-Engineering-Team (Someday), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-05-15 (1.32.0-wmf.4)), 10Patch-For-Review, and 2 others: Avoid importing core's selenium/pageobjects files using relative paths - https://phabricator.wikimedia.org/T193088 (10Krinkle) Left to migrate, bas...
[22:54:46] <wikibugs>	 10Release-Engineering-Team (Someday), 10MediaWiki-Core-Tests, 10Technical-Debt, 10User-zeljkofilipin: Avoid importing core's selenium/pageobjects files using relative paths - https://phabricator.wikimedia.org/T193088 (10Krinkle)
[22:54:49] <wikibugs>	 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10User-zeljkofilipin: Q1 Selenium framework improvements - https://phabricator.wikimedia.org/T198389 (10Krinkle)
[22:55:02] <wikibugs>	 10Release-Engineering-Team (Someday), 10MediaWiki-Core-Tests, 10Technical-Debt, 10User-zeljkofilipin: Avoid importing core's selenium/pageobjects files using relative paths - https://phabricator.wikimedia.org/T193088 (10Krinkle) 05Open>03Resolved a:03Krinkle
[23:30:43] <wikibugs>	 (03CR) 10Krinkle: [C: 031] "Worth a try?" [integration/jenkins] - 10https://gerrit.wikimedia.org/r/394907 (https://phabricator.wikimedia.org/T181940) (owner: 10Reedy)
[23:32:09] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Performance-Team, 10Patch-For-Review: Set up webperf-1 node in Beta Cluster - https://phabricator.wikimedia.org/T195314 (10Krinkle)
[23:32:37] <wikibugs>	 (03CR) 10Reedy: "https://getcomposer.org/doc/articles/autoloader-optimization.md#optimization-level-1-class-map-generation" [integration/jenkins] - 10https://gerrit.wikimedia.org/r/394907 (https://phabricator.wikimedia.org/T181940) (owner: 10Reedy)
[23:38:41] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10Operations, 10Patch-For-Review: Upgrade deployment-prep deployment servers to stretch - https://phabricator.wikimedia.org/T192561 (10Krinkle) Are there known unresolved issues with the new host? It seems `deployment-tin` is still used as primary...
[23:47:05] <wikibugs>	 10Beta-Cluster-Infrastructure: deployment-tin: scripts taking a whole lot more of time to complete - https://phabricator.wikimedia.org/T189631 (10Krinkle) 05Open>03Resolved a:03Krinkle This is most likely due to the switching of `mwscript` from PHP5 to HHVM.  While HHVM tends to be significantly faster tha...