[00:16:52] Project selenium-Flow » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #110: 04FAILURE in 51 sec: https://integration.wikimedia.org/ci/job/selenium-Flow/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/110/ [00:27:06] 10Beta-Cluster-Infrastructure, 05Goal: Consolidate, remove, and/or downsize Beta Cluster instances to help with [[wikitech:Purge_2016]] - https://phabricator.wikimedia.org/T142288#2551433 (10Krenair) [01:10:38] (03CR) 10Chad: use gerrit command over ssh to vote code-review +2 on the wikiversion bump (031 comment) [tools/release] - 10https://gerrit.wikimedia.org/r/304604 (owner: 1020after4) [01:11:32] 10Beta-Cluster-Infrastructure, 10Shinken, 13Patch-For-Review, 07Wikimedia-Incident: Shinken alert for beta error rate - https://phabricator.wikimedia.org/T141785#2551434 (10demon) Actually there's an "Improvements" column in #logspam for exactly this sort of thing :) [01:46:09] PROBLEM - Host deployment-parsoid05 is DOWN: CRITICAL - Host Unreachable (10.68.16.120) [02:29:28] 10Beta-Cluster-Infrastructure, 10Shinken, 13Patch-For-Review, 07Wikimedia-Incident, 07Wikimedia-log-errors: Shinken alert for beta error rate - https://phabricator.wikimedia.org/T141785#2551468 (10greg) Mea culpa :) [04:04:46] Project selenium-MultimediaViewer » safari,beta,OS X 10.9,contintLabsSlave && UbuntuTrusty build #108: 04FAILURE in 8 min 46 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,label=contintLabsSlave%20&&%20UbuntuTrusty/108/ [04:19:20] Project selenium-MultimediaViewer » chrome,beta,OS X 10.9,contintLabsSlave && UbuntuTrusty build #108: 04STILL FAILING in 23 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,label=contintLabsSlave%20&&%20UbuntuTrusty/108/ [08:05:09] PROBLEM - English Wikipedia Main page on beta-cluster is CRITICAL: HTTP CRITICAL: HTTP/1.1 301 TLS Redirect - string 'Wikipedia' not found on 'http://en.wikipedia.beta.wmflabs.org:80/wiki/Main_Page?debug=true' - 588 bytes in 0.002 second response time [08:06:17] PROBLEM - English Wikipedia Mobile Main page on beta-cluster is CRITICAL: HTTP CRITICAL: HTTP/1.1 301 TLS Redirect - string 'Wikipedia' not found on 'http://en.m.wikipedia.beta.wmflabs.org:80/wiki/Main_Page?debug=true' - 590 bytes in 0.005 second response time [12:25:17] PROBLEM - SSH on deployment-kafka03 is CRITICAL: Server answer [12:59:06] 06Release-Engineering-Team, 06Labs, 06Operations, 10wikitech.wikimedia.org: Rename specific account in LDAP, Wikitech and Gerrit - https://phabricator.wikimedia.org/T133968#2551726 (10lfschenone) [13:00:23] 06Release-Engineering-Team, 06Labs, 06Operations, 10wikitech.wikimedia.org: Rename specific account in LDAP, Wikitech and Gerrit - https://phabricator.wikimedia.org/T133968#2250492 (10lfschenone) I modified my rename request. The requested username change would now be: - At Gerrit, from lfs to Sophivorus -... [13:20:16] RECOVERY - SSH on deployment-kafka03 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u3 (protocol 2.0) [13:26:17] PROBLEM - SSH on deployment-kafka03 is CRITICAL: Server answer [13:46:16] RECOVERY - SSH on deployment-kafka03 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u3 (protocol 2.0) [13:48:02] Yippee, build fixed! [13:48:02] Project selenium-VisualEditor » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #111: 09FIXED in 4 min 1 sec: https://integration.wikimedia.org/ci/job/selenium-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/111/ [13:52:15] PROBLEM - SSH on deployment-kafka03 is CRITICAL: Server answer [13:53:10] 05Gitblit-Deprecate, 10Diffusion, 07Regression: Lines of files such as InitialiseSettings.php are not linkable - https://phabricator.wikimedia.org/T142934#2551739 (10Nemo_bis) [13:56:42] 05Gitblit-Deprecate, 10Diffusion, 07Regression: Lines of files such as InitialiseSettings.php are not linkable - https://phabricator.wikimedia.org/T142934#2551739 (10valhallasw) https://phabricator.wikimedia.org/diffusion/OMWC/browse/master/wmf-config/InitialiseSettings.php$4488 seems to work for me? The col... [14:11:44] 05Gitblit-Deprecate, 10Diffusion, 07Regression: Lines of files such as InitialiseSettings.php are not linkable - https://phabricator.wikimedia.org/T142934#2551739 (10Paladox) It works for me too, just sytax highlighting is disabled pass a certain file size. We could potentially up the limit. But you should s... [16:21:48] PROBLEM - Puppet run on deployment-changeprop is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:22:18] RECOVERY - SSH on deployment-kafka03 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u3 (protocol 2.0) [16:28:17] PROBLEM - SSH on deployment-kafka03 is CRITICAL: Server answer [16:52:17] PROBLEM - SSH on deployment-redis02 is CRITICAL: Server answer [17:08:16] RECOVERY - SSH on deployment-kafka03 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u3 (protocol 2.0) [17:14:17] PROBLEM - SSH on deployment-kafka03 is CRITICAL: Server answer [17:39:17] RECOVERY - SSH on deployment-kafka03 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u3 (protocol 2.0) [18:48:23] (03Draft1) 10Paladox: Test [integration/jenkins-job-builder] - 10https://gerrit.wikimedia.org/r/304699 [18:49:14] (03Abandoned) 10Paladox: Test [integration/jenkins-job-builder] - 10https://gerrit.wikimedia.org/r/304699 (owner: 10Paladox) [18:55:22] 05Gitblit-Deprecate, 10Diffusion, 07Regression: Lines of files such as InitialiseSettings.php are not linkable - https://phabricator.wikimedia.org/T142934#2552077 (10Danny_B) 05Open>03Invalid Both line highlighting (even multiple) and linking works as intended //if highlighting is enabled// (default sett... [19:00:50] 10Beta-Cluster-Infrastructure, 06Commons, 06Multimedia: Setup deployment-imagescaler host(s) in Beta Cluster - https://phabricator.wikimedia.org/T142289#2552083 (10AlexMonk-WMF) @greg, any thoughts on whether we want to keep using MW imagescaling for the time being, or start testing thumbor before it gets to... [20:42:01] Yippee, build fixed! [20:42:01] Project selenium-Echo » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #116: 09FIXED in 1 min 0 sec: https://integration.wikimedia.org/ci/job/selenium-Echo/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/116/ [21:21:34] 10Beta-Cluster-Infrastructure, 06Operations: Check status of under_NDA group - https://phabricator.wikimedia.org/T142822#2547328 (10hashar) The `under_NDA` group was meant to maintain yet another list of people under NDA. It has been created ages ago with the idea of using real SSL/TLS certificates on the beta... [21:21:43] 10Beta-Cluster-Infrastructure, 06Operations: Check status of under_NDA group - https://phabricator.wikimedia.org/T142822#2552159 (10hashar) p:05Triage>03Normal [21:29:01] 10Beta-Cluster-Infrastructure, 06Operations: Check status of under_NDA group - https://phabricator.wikimedia.org/T142822#2552172 (10AlexMonk-WMF) >>! In T142822#2552157, @hashar wrote: > One will want to review whether the sudo policy in wikitech is still of any use. I have seen mails notifications stating th... [21:31:55] 10Continuous-Integration-Infrastructure, 06Labs: Request increased quota for contintcloud labs project - https://phabricator.wikimedia.org/T142877#2549610 (10hashar) The DNS leak is tracked by T115194 there are good indications that is an old issue and the 32K leftover entries are artifacts of an unknown issue... [21:35:30] 05Continuous-Integration-Scaling, 13Patch-For-Review, 07WorkType-NewFunctionality: Migrate mediawiki-core-phpcs job to Nodepool - https://phabricator.wikimedia.org/T133976#2552188 (10hashar) [21:35:31] 10Continuous-Integration-Config, 05Continuous-Integration-Scaling, 10releng-201516-q3, 07WorkType-NewFunctionality: [keyresult] Migrate php (Zend and HHVM) CI jobs to Nodepool - https://phabricator.wikimedia.org/T119139#2552189 (10hashar) [21:35:34] 05Continuous-Integration-Scaling, 06Labs, 10Labs-Infrastructure, 13Patch-For-Review: Bump quota of Nodepool instances (contintcloud tenant) - https://phabricator.wikimedia.org/T133911#2552183 (10hashar) 05Resolved>03Open Quota has been lowered from 20 to 10 instances in an emergency on July 4th since t... [21:39:00] (03PS1) 10Hashar: Update Adrian Heine email [integration/config] - 10https://gerrit.wikimedia.org/r/304740 (https://phabricator.wikimedia.org/T85913) [21:39:55] 10Continuous-Integration-Infrastructure, 07Nodepool: Investigate nodepool, why is it unreliable and how can we get it to be reliable - https://phabricator.wikimedia.org/T142952#2552198 (10Paladox) [21:41:05] (03CR) 10Hashar: "Zeljkof, can you take care of updating the jobs? I dont want to screw them up :-} Danke!" [integration/config] - 10https://gerrit.wikimedia.org/r/304740 (https://phabricator.wikimedia.org/T85913) (owner: 10Hashar) [21:48:30] PROBLEM - Puppet run on deployment-cache-text04 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [21:58:38] Project selenium-PageTriage » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #114: 04FAILURE in 38 sec: https://integration.wikimedia.org/ci/job/selenium-PageTriage/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/114/ [22:22:01] Yippee, build fixed! [22:22:01] Project selenium-CentralAuth » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #115: 09FIXED in 2 min 0 sec: https://integration.wikimedia.org/ci/job/selenium-CentralAuth/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/115/