[00:24:24] PROBLEM - Puppet failure on integration-slave1004 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [00:54:24] RECOVERY - Puppet failure on integration-slave1004 is OK: OK: Less than 1.00% above the threshold [0.0] [01:07:49] 10Beta-Cluster, 10Wikidata.org: mwscript failing on Beta Cluster with Wikibase.php error - https://phabricator.wikimedia.org/T95793#1200559 (10Mattflaschen) 3NEW [02:31:00] 10Beta-Cluster, 10Wikidata, 10Wikidata.org: mwscript failing on Beta Cluster with Wikibase.php error - https://phabricator.wikimedia.org/T95793#1200601 (10greg) p:5Triage>3Unbreak! [02:38:27] 10Beta-Cluster, 10Wikidata, 10Wikidata.org: DB update and mwscript failing on Beta Cluster with Wikibase.php error - https://phabricator.wikimedia.org/T95793#1200604 (10greg) [02:40:00] 10Beta-Cluster, 10Wikidata, 10Wikidata.org: DB update and mwscript failing on Beta Cluster with Wikibase.php error - https://phabricator.wikimedia.org/T95793#1200559 (10greg) I don't see anything obvious in the commit log for mw-config: https://phabricator.wikimedia.org/diffusion/OMWC/history/master/ [04:40:14] 10Beta-Cluster, 10Wikidata, 10Wikidata.org: DB update and mwscript failing on Beta Cluster with Wikibase.php error - https://phabricator.wikimedia.org/T95793#1200701 (10aude) i am looking at this now. [05:15:26] Yippee, build fixed! [05:15:26] Project beta-scap-eqiad build #48560: FIXED in 1 min 30 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/48560/ [05:19:06] (03PS1) 10Legoktm: Convert extensions to use generic phpunit job (H-I) [integration/config] - 10https://gerrit.wikimedia.org/r/203516 [05:21:30] PROBLEM - English Wikipedia Mobile Main page on beta-cluster is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:21:30] PROBLEM - App Server Main HTTP Response on deployment-mediawiki02 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:24:22] Yippee, build fixed! [05:24:23] Project beta-update-databases-eqiad build #8833: FIXED in 4 min 22 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/8833/ [05:25:49] (03PS1) 10Legoktm: Convert extensions to use generic phpunit job (J-L) [integration/config] - 10https://gerrit.wikimedia.org/r/203518 [05:26:25] RECOVERY - English Wikipedia Mobile Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 27735 bytes in 0.728 second response time [05:26:25] RECOVERY - App Server Main HTTP Response on deployment-mediawiki02 is OK: HTTP OK: HTTP/1.1 200 OK - 46948 bytes in 0.586 second response time [05:26:38] (03CR) 10Legoktm: [C: 032] Convert extensions to use generic phpunit job (H-I) [integration/config] - 10https://gerrit.wikimedia.org/r/203516 (owner: 10Legoktm) [05:26:47] (03CR) 10Legoktm: [C: 032] Convert extensions to use generic phpunit job (J-L) [integration/config] - 10https://gerrit.wikimedia.org/r/203518 (owner: 10Legoktm) [05:27:02] 10Beta-Cluster, 10Wikidata, 10Wikidata.org, 5Patch-For-Review: DB update and mwscript failing on Beta Cluster with Wikibase.php error - https://phabricator.wikimedia.org/T95793#1200725 (10aude) for now, I am trying https://gerrit.wikimedia.org/r/#/c/203517/ - revert of our latest build. shall investigate... [05:30:02] Project beta-scap-eqiad build #48562: FAILURE in 8.4 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/48562/ [05:33:39] (03CR) 10jenkins-bot: [V: 04-1] Convert extensions to use generic phpunit job (H-I) [integration/config] - 10https://gerrit.wikimedia.org/r/203516 (owner: 10Legoktm) [05:33:41] (03CR) 10jenkins-bot: [V: 04-1] Convert extensions to use generic phpunit job (J-L) [integration/config] - 10https://gerrit.wikimedia.org/r/203518 (owner: 10Legoktm) [05:39:49] (03PS1) 10Legoktm: Update zuul config for analytics generic jobs [integration/config] - 10https://gerrit.wikimedia.org/r/203519 [05:42:19] (03PS2) 10Legoktm: Convert extensions to use generic phpunit job (H-I) [integration/config] - 10https://gerrit.wikimedia.org/r/203516 [05:42:21] (03PS2) 10Legoktm: Convert extensions to use generic phpunit job (J-L) [integration/config] - 10https://gerrit.wikimedia.org/r/203518 [05:42:33] (03CR) 10Legoktm: [C: 032] Update zuul config for analytics generic jobs [integration/config] - 10https://gerrit.wikimedia.org/r/203519 (owner: 10Legoktm) [05:44:17] (03PS3) 10Legoktm: Convert extensions to use generic phpunit job (H-I) [integration/config] - 10https://gerrit.wikimedia.org/r/203516 [05:44:19] (03PS3) 10Legoktm: Convert extensions to use generic phpunit job (J-L) [integration/config] - 10https://gerrit.wikimedia.org/r/203518 [05:44:21] (03PS2) 10Legoktm: Update zuul config for analytics generic jobs [integration/config] - 10https://gerrit.wikimedia.org/r/203519 [05:44:38] (03CR) 10Legoktm: [C: 032] Update zuul config for analytics generic jobs [integration/config] - 10https://gerrit.wikimedia.org/r/203519 (owner: 10Legoktm) [05:45:07] (03CR) 10Legoktm: [C: 032] Convert extensions to use generic phpunit job (H-I) [integration/config] - 10https://gerrit.wikimedia.org/r/203516 (owner: 10Legoktm) [05:45:24] (03CR) 10Legoktm: [C: 032] Convert extensions to use generic phpunit job (J-L) [integration/config] - 10https://gerrit.wikimedia.org/r/203518 (owner: 10Legoktm) [05:45:37] Yippee, build fixed! [05:45:37] Project beta-scap-eqiad build #48564: FIXED in 1 min 39 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/48564/ [05:46:55] (03Merged) 10jenkins-bot: Update zuul config for analytics generic jobs [integration/config] - 10https://gerrit.wikimedia.org/r/203519 (owner: 10Legoktm) [05:48:17] (03Merged) 10jenkins-bot: Convert extensions to use generic phpunit job (H-I) [integration/config] - 10https://gerrit.wikimedia.org/r/203516 (owner: 10Legoktm) [05:48:29] (03Merged) 10jenkins-bot: Convert extensions to use generic phpunit job (J-L) [integration/config] - 10https://gerrit.wikimedia.org/r/203518 (owner: 10Legoktm) [05:49:34] !log deploying https://gerrit.wikimedia.org/r/203519 https://gerrit.wikimedia.org/r/203516 https://gerrit.wikimedia.org/r/203518 [05:49:40] Logged the message, Master [05:56:48] 10Beta-Cluster, 10Wikidata, 10Wikidata.org, 5Patch-For-Review: DB update and mwscript failing on Beta Cluster with Wikibase.php error - https://phabricator.wikimedia.org/T95793#1200738 (10aude) I have reverted our latest build and appears fixe now. We shall investigate further and test this locally more b... [05:57:04] 10Beta-Cluster, 10Wikidata, 10Wikidata.org, 5Patch-For-Review: DB update and mwscript failing on Beta Cluster with Wikibase.php error - https://phabricator.wikimedia.org/T95793#1200739 (10aude) 5Open>3Resolved [06:03:02] (03PS1) 10Legoktm: Convert extensions to use generic phpunit job (M-N) [integration/config] - 10https://gerrit.wikimedia.org/r/203520 [06:06:50] (03PS2) 10Legoktm: Convert extensions to use generic phpunit job (M-O) [integration/config] - 10https://gerrit.wikimedia.org/r/203520 [06:09:33] (03CR) 10Legoktm: [C: 032] Convert extensions to use generic phpunit job (M-O) [integration/config] - 10https://gerrit.wikimedia.org/r/203520 (owner: 10Legoktm) [06:12:39] (03Merged) 10jenkins-bot: Convert extensions to use generic phpunit job (M-O) [integration/config] - 10https://gerrit.wikimedia.org/r/203520 (owner: 10Legoktm) [06:13:21] !log deployed https://gerrit.wikimedia.org/r/203520 [06:13:23] Logged the message, Master [09:00:33] PROBLEM - English Wikipedia Mobile Main page on beta-cluster is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:00:33] PROBLEM - App Server Main HTTP Response on deployment-mediawiki02 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:00:33] PROBLEM - English Wikipedia Main page on beta-cluster is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:27:40] (03CR) 10Zfilipin: "Will deploy on Monday, just in case. ;)" [integration/config] - 10https://gerrit.wikimedia.org/r/203309 (https://phabricator.wikimedia.org/T89343) (owner: 10Zfilipin) [09:30:30] 10Continuous-Integration: the first time a Jenkins language screenshots job runs, it checks out an old VisualEditor revision - https://phabricator.wikimedia.org/T95668#1200865 (10zeljkofilipin) @hashar, @krinkle: have you noticed this problem before? I remember seeing the problem a while ago on another Jenkins job. [09:58:34] 6Release-Engineering, 10Wikimedia-Git-or-Gerrit, 7Documentation: Document how to tag extensions in git - https://phabricator.wikimedia.org/T94412#1200869 (10Ciencia_Al_Poder) [16:50:42] 10Continuous-Integration, 10Wikipedia-Android-App: Android app build: Gradle checkstyle + app build - https://phabricator.wikimedia.org/T88494#1201110 (10bearND) [16:51:21] 10Continuous-Integration, 10Wikipedia-Android-App: Android app build: Gradle checkstyle + app build - https://phabricator.wikimedia.org/T88494#1201114 (10bearND) p:5Triage>3High [18:01:17] 10Continuous-Integration, 10Wikipedia-Android-App, 10Wikipedia-iOS-App: Jenkins should run tests for the Wikipedia app before merge - https://phabricator.wikimedia.org/T62720#1201144 (10bearND) p:5High>3Normal We're not using Maven anymore. We've switched to Gradle instead. So, T88494 is a prerequisite t... [18:41:32] 10Beta-Cluster, 10Wikidata, 10Wikidata.org, 5Patch-For-Review: DB update and mwscript failing on Beta Cluster with Wikibase.php error - https://phabricator.wikimedia.org/T95793#1201153 (10greg) Thanks a ton for your quick response, @aude! [19:35:05] PROBLEM - Puppet failure on integration-slave-jessie-1001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [20:07:44] 10Continuous-Integration, 10Wikipedia-Android-App, 10Wikipedia-iOS-App: Jenkins should run tests for the Wikipedia app before merge - https://phabricator.wikimedia.org/T62720#1201186 (10Legoktm) [20:07:46] 10Continuous-Integration, 10Wikipedia-Android-App: Android app build: Gradle checkstyle + app build - https://phabricator.wikimedia.org/T88494#1201187 (10Legoktm) [20:10:54] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer--sauce build #1: FAILURE in 4.3 sec: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer--sauce/1/ [20:11:59] (03PS4) 10Zfilipin: Fix failed Internet Explorer browser test jobs [integration/config] - 10https://gerrit.wikimedia.org/r/203063 (https://phabricator.wikimedia.org/T95398) [20:12:29] (03CR) 10Zfilipin: "Patch set 4 is a minor update to the commit message." [integration/config] - 10https://gerrit.wikimedia.org/r/203063 (https://phabricator.wikimedia.org/T95398) (owner: 10Zfilipin) [20:14:10] (03CR) 10Zfilipin: "I think this commit is ready to get merged. I have tested it with[0] and without[1] version set for IE." [integration/config] - 10https://gerrit.wikimedia.org/r/203063 (https://phabricator.wikimedia.org/T95398) (owner: 10Zfilipin) [20:15:43] (03CR) 10Zfilipin: "Please delete this job when you are done with the review:" [integration/config] - 10https://gerrit.wikimedia.org/r/203063 (https://phabricator.wikimedia.org/T95398) (owner: 10Zfilipin) [20:18:38] 10Browser-Tests, 5Patch-For-Review: IE Browser tests job have no test being run due to a mistake in cucumber tag - https://phabricator.wikimedia.org/T95398#1201192 (10zeljkofilipin) I think this is done. Please merge [[ https://gerrit.wikimedia.org/r/#/c/203063/ | 203063 ]]. When it is merged, this jobs should... [20:22:42] (03PS2) 10Zfilipin: Move WB_REPO_PASSWORD environment variable to Jenkins Credentials plugin store [integration/config] - 10https://gerrit.wikimedia.org/r/203309 (https://phabricator.wikimedia.org/T89343) [20:29:57] (03PS1) 10Legoktm: Convert extensions to use generic phpunit job (P-R) [integration/config] - 10https://gerrit.wikimedia.org/r/203619 [20:41:12] (03PS1) 10Zfilipin: WIP testing T89343 [integration/config] - 10https://gerrit.wikimedia.org/r/203620 (https://phabricator.wikimedia.org/T89343) [20:45:26] Project browsertests-Wikidata-WikidataTests-linux-chrome-sauce build #2: ABORTED in 1 min 34 sec: https://integration.wikimedia.org/ci/job/browsertests-Wikidata-WikidataTests-linux-chrome-sauce/2/ [20:45:47] (03Abandoned) 10Zfilipin: WIP testing T89343 [integration/config] - 10https://gerrit.wikimedia.org/r/203620 (https://phabricator.wikimedia.org/T89343) (owner: 10Zfilipin) [20:49:29] (03PS1) 10Zfilipin: WIP testing T89343 [integration/config] - 10https://gerrit.wikimedia.org/r/203621 (https://phabricator.wikimedia.org/T89343) [20:52:42] Project browsertests-Wikidata-WikidataTests-linux-chrome-sauce build #1: SUCCESS in 47 sec: https://integration.wikimedia.org/ci/job/browsertests-Wikidata-WikidataTests-linux-chrome-sauce/1/ [21:13:41] (03PS3) 10Zfilipin: Move WB_REPO_PASSWORD environment variable to Jenkins Credentials plugin store [integration/config] - 10https://gerrit.wikimedia.org/r/203309 (https://phabricator.wikimedia.org/T89343) [21:17:27] (03Abandoned) 10Zfilipin: WIP testing T89343 [integration/config] - 10https://gerrit.wikimedia.org/r/203621 (https://phabricator.wikimedia.org/T89343) (owner: 10Zfilipin) [21:26:13] 10Continuous-Integration, 3Continuous-Integration-Isolation, 10hardware-requests, 6operations: eqiad: (1) allocate server to migrate Zuul server to - https://phabricator.wikimedia.org/T95760#1201229 (10Andrew) p:5Triage>3High [21:29:50] 3Continuous-Integration-Isolation, 6Scrum-of-Scrums, 6operations: Review Jenkins isolation architecture with Antoine - https://phabricator.wikimedia.org/T92324#1201246 (10Andrew) p:5High>3Normal [22:50:08] (03PS1) 10Legoktm: Convert extensions to use generic phpunit job (S-T) [integration/config] - 10https://gerrit.wikimedia.org/r/203626 [22:52:04] (03CR) 10Legoktm: [C: 032] Convert extensions to use generic phpunit job (S-T) [integration/config] - 10https://gerrit.wikimedia.org/r/203626 (owner: 10Legoktm) [22:52:14] (03CR) 10Legoktm: [C: 032] Convert extensions to use generic phpunit job (P-R) [integration/config] - 10https://gerrit.wikimedia.org/r/203619 (owner: 10Legoktm) [22:56:19] (03Merged) 10jenkins-bot: Convert extensions to use generic phpunit job (P-R) [integration/config] - 10https://gerrit.wikimedia.org/r/203619 (owner: 10Legoktm) [22:56:56] (03Merged) 10jenkins-bot: Convert extensions to use generic phpunit job (S-T) [integration/config] - 10https://gerrit.wikimedia.org/r/203626 (owner: 10Legoktm) [22:58:14] !log deploying https://gerrit.wikimedia.org/r/203619 & https://gerrit.wikimedia.org/r/203626 [22:58:20] Logged the message, Master [23:10:06] (03PS1) 10Legoktm: Convert extensions to use generic phpunit job (U-Z) [integration/config] - 10https://gerrit.wikimedia.org/r/203628 [23:10:33] (03CR) 10Legoktm: [C: 032] Convert extensions to use generic phpunit job (U-Z) [integration/config] - 10https://gerrit.wikimedia.org/r/203628 (owner: 10Legoktm) [23:12:29] 1062 jobs in jjb! [23:12:45] (03Merged) 10jenkins-bot: Convert extensions to use generic phpunit job (U-Z) [integration/config] - 10https://gerrit.wikimedia.org/r/203628 (owner: 10Legoktm) [23:13:17] !log deploying https://gerrit.wikimedia.org/r/203628 [23:13:20] Logged the message, Master [23:20:14] 10Continuous-Integration: Replace project-specific "{name}-thing" jobs with generic "thing" ones - https://phabricator.wikimedia.org/T91997#1201322 (10Legoktm) [23:20:15] 10Continuous-Integration, 5Patch-For-Review: Create generic phpunit job for MediaWiki extensions - https://phabricator.wikimedia.org/T94327#1201319 (10Legoktm) 5Open>3Resolved a:3Legoktm All extensions that don't have any dependencies and have voting phpunit jobs now use the generic job. [23:20:17] 10Continuous-Integration, 6translatewiki.net, 5Patch-For-Review: l10n-bot self-force-merging sometimes breaks mediawiki/core master - https://phabricator.wikimedia.org/T91707#1201323 (10Legoktm) [23:54:38] 10Continuous-Integration: Get rid of zend tests for wmf branches - https://phabricator.wikimedia.org/T94149#1201326 (10Legoktm) [23:57:09] 10Continuous-Integration, 10MediaWiki-extensions-Babel, 10MediaWiki-extensions-CLDR, 10MediaWiki-extensions-Translate, and 2 others: Add i18n related extensions to mediawiki-extensions-(zend|hhvm) - https://phabricator.wikimedia.org/T86930#1201328 (10Legoktm)