[00:21:24] Yippee, build fixed! [00:21:24] Yippee, build fixed! [00:21:25] Project beta-update-databases-eqiad build #29959: 09FIXED in 1 min 24 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/29959/ [00:21:25] Project beta-update-databases-eqiad build #29959: 09FIXED in 1 min 24 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/29959/ [00:23:45] 10Beta-Cluster-Infrastructure, 10ConfirmEdit (CAPTCHA extension): UnderflowException when creating an account, FancyCaptcha.php: Ran out of captcha images - https://phabricator.wikimedia.org/T210092 (10Krenair) 05Open>03Resolved This problem is gone now, some work here was part of {T208101} [00:23:45] 10Beta-Cluster-Infrastructure, 10ConfirmEdit (CAPTCHA extension): UnderflowException when creating an account, FancyCaptcha.php: Ran out of captcha images - https://phabricator.wikimedia.org/T210092 (10Krenair) 05Open>03Resolved This problem is gone now, some work here was part of {T208101} [00:50:44] 10Beta-Cluster-Infrastructure: deployment-cache-text04 decomissioning - https://phabricator.wikimedia.org/T210214 (10Krenair) p:05Triage>03Normal [00:50:44] 10Beta-Cluster-Infrastructure: deployment-cache-text04 decomissioning - https://phabricator.wikimedia.org/T210214 (10Krenair) p:05Triage>03Normal [00:51:26] 10Beta-Cluster-Infrastructure: deployment-cache-text04 decomissioning - https://phabricator.wikimedia.org/T210214 (10Krenair) I've set up a screen piping results from that command to /home/krenair/varnishlog-drain [00:51:27] 10Beta-Cluster-Infrastructure: deployment-cache-text04 decomissioning - https://phabricator.wikimedia.org/T210214 (10Krenair) I've set up a screen piping results from that command to /home/krenair/varnishlog-drain [00:53:10] 10Beta-Cluster-Infrastructure: deployment-cache-text04 decomissioning - https://phabricator.wikimedia.org/T210214 (10Krenair) [00:53:10] 10Beta-Cluster-Infrastructure: deployment-cache-text04 decomissioning - https://phabricator.wikimedia.org/T210214 (10Krenair) [01:07:24] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [10.0] [01:07:24] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [10.0] [01:17:24] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [01:17:24] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [06:08:07] "Mediawiki Error Rate on graphite-labs i" [06:08:07] "Mediawiki Error Rate on graphite-labs i" [06:08:15] Nice, I didn't know we monitored that on beta. Cool! [06:08:15] Nice, I didn't know we monitored that on beta. Cool! [06:08:24] Krenair: your work? [06:08:24] Krenair: your work? [06:19:12] 10Continuous-Integration-Infrastructure (shipyard), 10Operations, 10Kubernetes: set up a test node with new version, Redis as cache, a new Swift container and export metrics over Fraphana - https://phabricator.wikimedia.org/T210076 (10Joe) As far as redis goes - do we need to replicate cross-dc? if not, we c... [06:19:12] 10Continuous-Integration-Infrastructure (shipyard), 10Operations, 10Kubernetes: set up a test node with new version, Redis as cache, a new Swift container and export metrics over Fraphana - https://phabricator.wikimedia.org/T210076 (10Joe) As far as redis goes - do we need to replicate cross-dc? if not, we c... [08:40:59] (03PS1) 10Hashar: Add Mediawiki extension BlueSpiceCustomMenu [integration/config] - 10https://gerrit.wikimedia.org/r/475443 [08:40:59] (03PS1) 10Hashar: Add Mediawiki extension BlueSpiceCustomMenu [integration/config] - 10https://gerrit.wikimedia.org/r/475443 [08:43:57] (03PS1) 10Hashar: Add LDAP* MediaWiki extensions [integration/config] - 10https://gerrit.wikimedia.org/r/475445 [08:43:57] (03PS1) 10Hashar: Add LDAP* MediaWiki extensions [integration/config] - 10https://gerrit.wikimedia.org/r/475445 [08:44:16] (03CR) 10Hashar: [C: 032] Add Mediawiki extension BlueSpiceCustomMenu [integration/config] - 10https://gerrit.wikimedia.org/r/475443 (owner: 10Hashar) [08:44:16] (03CR) 10Hashar: [C: 032] Add Mediawiki extension BlueSpiceCustomMenu [integration/config] - 10https://gerrit.wikimedia.org/r/475443 (owner: 10Hashar) [08:44:31] (03CR) 10Hashar: [C: 032] Add LDAP* MediaWiki extensions [integration/config] - 10https://gerrit.wikimedia.org/r/475445 (owner: 10Hashar) [08:44:32] (03CR) 10Hashar: [C: 032] Add LDAP* MediaWiki extensions [integration/config] - 10https://gerrit.wikimedia.org/r/475445 (owner: 10Hashar) [08:46:18] (03PS1) 10Hashar: Add operations/debs/wmf-pt-kill (non voting) [integration/config] - 10https://gerrit.wikimedia.org/r/475446 [08:46:18] (03PS1) 10Hashar: Add operations/debs/wmf-pt-kill (non voting) [integration/config] - 10https://gerrit.wikimedia.org/r/475446 [08:46:29] (03CR) 10Hashar: [C: 032] Add operations/debs/wmf-pt-kill (non voting) [integration/config] - 10https://gerrit.wikimedia.org/r/475446 (owner: 10Hashar) [08:46:29] (03CR) 10Hashar: [C: 032] Add operations/debs/wmf-pt-kill (non voting) [integration/config] - 10https://gerrit.wikimedia.org/r/475446 (owner: 10Hashar) [08:47:35] (03Merged) 10jenkins-bot: Add Mediawiki extension BlueSpiceCustomMenu [integration/config] - 10https://gerrit.wikimedia.org/r/475443 (owner: 10Hashar) [08:47:36] (03Merged) 10jenkins-bot: Add Mediawiki extension BlueSpiceCustomMenu [integration/config] - 10https://gerrit.wikimedia.org/r/475443 (owner: 10Hashar) [08:47:44] (03Merged) 10jenkins-bot: Add LDAP* MediaWiki extensions [integration/config] - 10https://gerrit.wikimedia.org/r/475445 (owner: 10Hashar) [08:47:44] (03Merged) 10jenkins-bot: Add LDAP* MediaWiki extensions [integration/config] - 10https://gerrit.wikimedia.org/r/475445 (owner: 10Hashar) [08:48:16] (03Merged) 10jenkins-bot: Add operations/debs/wmf-pt-kill (non voting) [integration/config] - 10https://gerrit.wikimedia.org/r/475446 (owner: 10Hashar) [08:48:16] (03Merged) 10jenkins-bot: Add operations/debs/wmf-pt-kill (non voting) [integration/config] - 10https://gerrit.wikimedia.org/r/475446 (owner: 10Hashar) [08:50:51] (03PS1) 10Hashar: Add react.i18n [integration/config] - 10https://gerrit.wikimedia.org/r/475447 [08:50:51] (03PS1) 10Hashar: Add react.i18n [integration/config] - 10https://gerrit.wikimedia.org/r/475447 [08:51:24] (03CR) 10Hashar: [C: 032] Add react.i18n [integration/config] - 10https://gerrit.wikimedia.org/r/475447 (owner: 10Hashar) [08:51:24] (03CR) 10Hashar: [C: 032] Add react.i18n [integration/config] - 10https://gerrit.wikimedia.org/r/475447 (owner: 10Hashar) [08:53:07] (03Merged) 10jenkins-bot: Add react.i18n [integration/config] - 10https://gerrit.wikimedia.org/r/475447 (owner: 10Hashar) [08:53:07] (03Merged) 10jenkins-bot: Add react.i18n [integration/config] - 10https://gerrit.wikimedia.org/r/475447 (owner: 10Hashar) [08:54:46] (03PS1) 10Hashar: Add some more operations/debs repositories [integration/config] - 10https://gerrit.wikimedia.org/r/475448 [08:54:46] (03PS1) 10Hashar: Add some more operations/debs repositories [integration/config] - 10https://gerrit.wikimedia.org/r/475448 [08:54:55] (03CR) 10Hashar: [C: 032] Add some more operations/debs repositories [integration/config] - 10https://gerrit.wikimedia.org/r/475448 (owner: 10Hashar) [08:54:56] (03CR) 10Hashar: [C: 032] Add some more operations/debs repositories [integration/config] - 10https://gerrit.wikimedia.org/r/475448 (owner: 10Hashar) [08:56:41] (03Merged) 10jenkins-bot: Add some more operations/debs repositories [integration/config] - 10https://gerrit.wikimedia.org/r/475448 (owner: 10Hashar) [08:56:41] (03Merged) 10jenkins-bot: Add some more operations/debs repositories [integration/config] - 10https://gerrit.wikimedia.org/r/475448 (owner: 10Hashar) [09:03:14] Krinkle, don't think so no [09:03:14] Krinkle, don't think so no [10:19:52] (03CR) 10Hashar: [C: 032] docker: puppeteer tweaks for java8-wikidata-query-rdf (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/475428 (https://phabricator.wikimedia.org/T209776) (owner: 10Hashar) [10:19:52] (03CR) 10Hashar: [C: 032] docker: puppeteer tweaks for java8-wikidata-query-rdf (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/475428 (https://phabricator.wikimedia.org/T209776) (owner: 10Hashar) [10:21:37] (03Merged) 10jenkins-bot: docker: puppeteer tweaks for java8-wikidata-query-rdf [integration/config] - 10https://gerrit.wikimedia.org/r/475428 (https://phabricator.wikimedia.org/T209776) (owner: 10Hashar) [10:21:37] (03Merged) 10jenkins-bot: docker: puppeteer tweaks for java8-wikidata-query-rdf [integration/config] - 10https://gerrit.wikimedia.org/r/475428 (https://phabricator.wikimedia.org/T209776) (owner: 10Hashar) [10:29:04] !log Building releng/java8-wikidata-query-rdf:0.2.1 container for https://gerrit.wikimedia.org/r/#/c/integration/config/+/475428/ T209776 [10:29:04] !log Building releng/java8-wikidata-query-rdf:0.2.1 container for https://gerrit.wikimedia.org/r/#/c/integration/config/+/475428/ T209776 [10:29:07] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:29:07] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:29:07] T209776: WDQS GUI build fails on CI - https://phabricator.wikimedia.org/T209776 [10:29:07] T209776: WDQS GUI build fails on CI - https://phabricator.wikimedia.org/T209776 [10:47:38] (03PS1) 10Hashar: Switch Jenkins job to releng/java8-wikidata-query-rdf:0.2.1 [integration/config] - 10https://gerrit.wikimedia.org/r/475452 (https://phabricator.wikimedia.org/T209776) [10:47:38] (03PS1) 10Hashar: Switch Jenkins job to releng/java8-wikidata-query-rdf:0.2.1 [integration/config] - 10https://gerrit.wikimedia.org/r/475452 (https://phabricator.wikimedia.org/T209776) [11:01:15] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10Wikidata, 10Wikidata Query UI, 10Patch-For-Review: WDQS GUI build fails on CI - https://phabricator.wikimedia.org/T209776 (10hashar) 05Open>03Resolved Fixed on https://gerrit.wikimedia.org/r/#/c/wikidata/query/... [11:01:15] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10Wikidata, 10Wikidata Query UI, 10Patch-For-Review: WDQS GUI build fails on CI - https://phabricator.wikimedia.org/T209776 (10hashar) 05Open>03Resolved Fixed on https://gerrit.wikimedia.org/r/#/c/wikidata/query/... [11:04:40] (03CR) 10Hashar: [C: 032] "Deployed and it works :)" [integration/config] - 10https://gerrit.wikimedia.org/r/475452 (https://phabricator.wikimedia.org/T209776) (owner: 10Hashar) [11:04:40] (03CR) 10Hashar: [C: 032] "Deployed and it works :)" [integration/config] - 10https://gerrit.wikimedia.org/r/475452 (https://phabricator.wikimedia.org/T209776) (owner: 10Hashar) [11:07:11] (03Merged) 10jenkins-bot: Switch Jenkins job to releng/java8-wikidata-query-rdf:0.2.1 [integration/config] - 10https://gerrit.wikimedia.org/r/475452 (https://phabricator.wikimedia.org/T209776) (owner: 10Hashar) [11:07:11] (03Merged) 10jenkins-bot: Switch Jenkins job to releng/java8-wikidata-query-rdf:0.2.1 [integration/config] - 10https://gerrit.wikimedia.org/r/475452 (https://phabricator.wikimedia.org/T209776) (owner: 10Hashar) [11:09:22] !log Jenkins: removing plugins "Single Use Slave" and "Event Publisher (via ZMQ PUB SUB)". Were used for Nodepool | T209361 [11:09:22] !log Jenkins: removing plugins "Single Use Slave" and "Event Publisher (via ZMQ PUB SUB)". Were used for Nodepool | T209361 [11:09:25] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [11:09:25] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [11:09:25] T209361: Phase out Nodepool from production - https://phabricator.wikimedia.org/T209361 [11:09:26] T209361: Phase out Nodepool from production - https://phabricator.wikimedia.org/T209361 [11:10:10] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10Operations, 10Patch-For-Review, 10cloud-services-team (Kanban): Phase out Nodepool from production - https://phabricator.wikimedia.org/T209361 (10hashar) [11:10:10] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10Operations, 10Patch-For-Review, 10cloud-services-team (Kanban): Phase out Nodepool from production - https://phabricator.wikimedia.org/T209361 (10hashar) [11:17:49] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Kanban), 10Cloud-Services, 10Epic, 10Patch-For-Review: Migrate deployment-prep to eqiad1 - https://phabricator.wikimedia.org/T208101 (10PerfektesChaos) I do confirm that dewiki@BETA works properly now. [11:17:49] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Kanban), 10Cloud-Services, 10Epic, 10Patch-For-Review: Migrate deployment-prep to eqiad1 - https://phabricator.wikimedia.org/T208101 (10PerfektesChaos) I do confirm that dewiki@BETA works properly now. [11:17:51] 10Project-Admins: Replace tracking bug T30486 by new project tag "Wikimedia-Incubator" - https://phabricator.wikimedia.org/T102506 (10Aklapper) @Hydriz: Here you go, handed [them](https://www.mediawiki.org/wiki/Phabricator/Help#Batch_edits) out to you :) [11:17:51] 10Project-Admins: Replace tracking bug T30486 by new project tag "Wikimedia-Incubator" - https://phabricator.wikimedia.org/T102506 (10Aklapper) @Hydriz: Here you go, handed [them](https://www.mediawiki.org/wiki/Phabricator/Help#Batch_edits) out to you :) [11:21:45] 10Project-Admins: Create project: TWLCon-2019India - https://phabricator.wikimedia.org/T210150 (10Aklapper) 05Open>03Resolved a:03Aklapper Requested public project #twlcon-2019-india has been created: https://phabricator.wikimedia.org/project/view/3751/ Please encourage interested people to visit the proj... [11:21:46] 10Project-Admins: Create project: TWLCon-2019India - https://phabricator.wikimedia.org/T210150 (10Aklapper) 05Open>03Resolved a:03Aklapper Requested public project #twlcon-2019-india has been created: https://phabricator.wikimedia.org/project/view/3751/ Please encourage interested people to visit the proj... [11:22:47] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team: Remove the "check" pipeline and Zuul's user-filter - https://phabricator.wikimedia.org/T192217 (10hashar) We still have some jobs running on permanent slaves, they will be moved to Docker containers and I have created a subproject for that mi... [11:22:47] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team: Remove the "check" pipeline and Zuul's user-filter - https://phabricator.wikimedia.org/T192217 (10hashar) We still have some jobs running on permanent slaves, they will be moved to Docker containers and I have created a subproject for that mi... [11:58:04] 10Project-Admins: Create project: TWLCon-2019India - https://phabricator.wikimedia.org/T210150 (10Krishna_Chaitanya_Velaga) Thank You [11:58:04] 10Project-Admins: Create project: TWLCon-2019India - https://phabricator.wikimedia.org/T210150 (10Krishna_Chaitanya_Velaga) Thank You [12:28:48] 10Project-Admins: Rename Wikimedia project tags in Phab (#Wikisource; #Wiktionary) to clarify that they are not about language specific instances? - https://phabricator.wikimedia.org/T196740 (10Liuxinyu970226) #Wikisource-general-or-unknown? #Wiktionary-general-or-unknown? [12:28:48] 10Project-Admins: Rename Wikimedia project tags in Phab (#Wikisource; #Wiktionary) to clarify that they are not about language specific instances? - https://phabricator.wikimedia.org/T196740 (10Liuxinyu970226) #Wikisource-general-or-unknown? #Wiktionary-general-or-unknown? [13:05:33] 10Project-Admins: Rename Wikimedia project tags in Phab (#Wikisource; #Wiktionary) to clarify that they are not about language specific instances? - https://phabricator.wikimedia.org/T196740 (10Aklapper) Please no `unknown` suffixes when there is nothing that is unknown. [13:05:33] 10Project-Admins: Rename Wikimedia project tags in Phab (#Wikisource; #Wiktionary) to clarify that they are not about language specific instances? - https://phabricator.wikimedia.org/T196740 (10Aklapper) Please no `unknown` suffixes when there is nothing that is unknown. [13:14:49] 10Continuous-Integration-Infrastructure (Slipway), 10Analytics, 10Analytics-Cluster: Migrate analytics/refinery/source release jobs to Docker - https://phabricator.wikimedia.org/T210271 (10hashar) [13:14:49] 10Continuous-Integration-Infrastructure (Slipway), 10Analytics, 10Analytics-Cluster: Migrate analytics/refinery/source release jobs to Docker - https://phabricator.wikimedia.org/T210271 (10hashar) [13:17:08] 10Continuous-Integration-Infrastructure (Slipway): Migrate analytics/wikistats CI jobs to Docker - https://phabricator.wikimedia.org/T210272 (10hashar) [13:17:08] 10Continuous-Integration-Infrastructure (Slipway): Migrate analytics/wikistats CI jobs to Docker - https://phabricator.wikimedia.org/T210272 (10hashar) [13:29:00] 10Continuous-Integration-Infrastructure (Slipway), 10Wikipedia-Android-App-Backlog: Migrate apps/android/wikipedia CI jobs to Docker containers - https://phabricator.wikimedia.org/T210277 (10hashar) [13:29:00] 10Continuous-Integration-Infrastructure (Slipway), 10Wikipedia-Android-App-Backlog: Migrate apps/android/wikipedia CI jobs to Docker containers - https://phabricator.wikimedia.org/T210277 (10hashar) [13:30:19] 10Continuous-Integration-Infrastructure (Slipway), 10commit-message-validator: Migrate CI job commit-message-validator to a Docker container - https://phabricator.wikimedia.org/T210278 (10hashar) [13:30:19] 10Continuous-Integration-Infrastructure (Slipway), 10commit-message-validator: Migrate CI job commit-message-validator to a Docker container - https://phabricator.wikimedia.org/T210278 (10hashar) [13:31:46] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure (Slipway): Migrate integration-zuul-layoutdiff and integration-zuul-layoutvalidation-gate jobs to Docker containers - https://phabricator.wikimedia.org/T210279 (10hashar) [13:31:46] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure (Slipway): Migrate integration-zuul-layoutdiff and integration-zuul-layoutvalidation-gate jobs to Docker containers - https://phabricator.wikimedia.org/T210279 (10hashar) [13:34:45] 10Continuous-Integration-Infrastructure (Slipway), 10Wikibugs: Migrate CI job labs-tools-wikibugs2-autopull to use a Docker container - https://phabricator.wikimedia.org/T210280 (10hashar) [13:34:45] 10Continuous-Integration-Infrastructure (Slipway), 10Wikibugs: Migrate CI job labs-tools-wikibugs2-autopull to use a Docker container - https://phabricator.wikimedia.org/T210280 (10hashar) [13:35:15] 10Continuous-Integration-Infrastructure (Slipway), 10Wikibugs: Migrate CI job labs-tools-wikibugs2-autopull to use a Docker container or phase it out - https://phabricator.wikimedia.org/T210280 (10hashar) [13:35:15] 10Continuous-Integration-Infrastructure (Slipway), 10Wikibugs: Migrate CI job labs-tools-wikibugs2-autopull to use a Docker container or phase it out - https://phabricator.wikimedia.org/T210280 (10hashar) [13:37:12] 10Continuous-Integration-Infrastructure (Slipway), 10CirrusSearch, 10Discovery-Search: mwext-CirrusSearch-whitespaces - https://phabricator.wikimedia.org/T210282 (10hashar) [13:37:12] 10Continuous-Integration-Infrastructure (Slipway), 10CirrusSearch, 10Discovery-Search: mwext-CirrusSearch-whitespaces - https://phabricator.wikimedia.org/T210282 (10hashar) [13:38:19] 10Continuous-Integration-Infrastructure (Slipway), 10Operations, 10Traffic: CI jobs for authdns linting need to run on Stretch - https://phabricator.wikimedia.org/T205439 (10hashar) Part of the project to migrate all CI jobs to Docker containers (#ci-slipway ) [13:38:19] 10Continuous-Integration-Infrastructure (Slipway), 10Operations, 10Traffic: CI jobs for authdns linting need to run on Stretch - https://phabricator.wikimedia.org/T205439 (10hashar) Part of the project to migrate all CI jobs to Docker containers (#ci-slipway ) [13:40:41] 10Continuous-Integration-Infrastructure (Slipway): Migrate operations-dns-tabs to a Docker container - https://phabricator.wikimedia.org/T210283 (10hashar) [13:40:41] 10Continuous-Integration-Infrastructure (Slipway): Migrate operations-dns-tabs to a Docker container - https://phabricator.wikimedia.org/T210283 (10hashar) [13:46:41] 10Continuous-Integration-Infrastructure (Slipway): operations-mw-config-typos - https://phabricator.wikimedia.org/T210284 (10hashar) [13:46:41] 10Continuous-Integration-Infrastructure (Slipway): operations-mw-config-typos - https://phabricator.wikimedia.org/T210284 (10hashar) [13:50:57] 10Continuous-Integration-Infrastructure (Slipway), 10Browser-Tests: Migrate selenium-Wikibase-chrome selenium-WikibaseLexeme-chrome to Docker containers - https://phabricator.wikimedia.org/T210285 (10hashar) [13:50:57] 10Continuous-Integration-Infrastructure (Slipway), 10Browser-Tests: Migrate selenium-Wikibase-chrome selenium-WikibaseLexeme-chrome to Docker containers - https://phabricator.wikimedia.org/T210285 (10hashar) [13:53:07] 10Continuous-Integration-Infrastructure (Slipway), 10Wikidata, 10Wikidata Query UI, 10Wikimedia-Portals: Migrate wikidata-query-gui-build and wikimedia-portals-build to Docker containers - https://phabricator.wikimedia.org/T210286 (10hashar) [13:53:07] 10Continuous-Integration-Infrastructure (Slipway), 10Wikidata, 10Wikidata Query UI, 10Wikimedia-Portals: Migrate wikidata-query-gui-build and wikimedia-portals-build to Docker containers - https://phabricator.wikimedia.org/T210286 (10hashar) [13:54:01] 10Continuous-Integration-Infrastructure (Slipway), 10Wikimedia-Fundraising-CiviCRM: Migrate wikimedia-fundraising-civicrm to a Docker container - https://phabricator.wikimedia.org/T210287 (10hashar) [13:54:01] 10Continuous-Integration-Infrastructure (Slipway), 10Wikimedia-Fundraising-CiviCRM: Migrate wikimedia-fundraising-civicrm to a Docker container - https://phabricator.wikimedia.org/T210287 (10hashar) [14:00:45] 10Release-Engineering-Team, 10Patch-For-Review: Database busted for CiviCRM tests? - https://phabricator.wikimedia.org/T205950 (10hashar) [14:00:45] 10Release-Engineering-Team, 10Patch-For-Review: Database busted for CiviCRM tests? - https://phabricator.wikimedia.org/T205950 (10hashar) [14:17:23] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [14:17:23] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [14:17:55] hashar: are you around? We're having a few questions about CI with kostajh [14:17:55] hashar: are you around? We're having a few questions about CI with kostajh [14:18:07] hashar: if you have a few minutes to jump in a hangout with us? [14:18:07] hashar: if you have a few minutes to jump in a hangout with us? [14:27:24] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [14:27:24] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [14:33:54] (03PS1) 10Kosta Harlan: Add configuration for running PHP code analysis on SonarQube [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) [14:33:54] (03PS1) 10Kosta Harlan: Add configuration for running PHP code analysis on SonarQube [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) [14:34:04] gehel ^ [14:34:04] gehel ^ [14:34:16] thanks! [14:34:16] thanks! [14:35:00] (03CR) 10jerkins-bot: [V: 04-1] Add configuration for running PHP code analysis on SonarQube [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) (owner: 10Kosta Harlan) [14:35:00] (03CR) 10jerkins-bot: [V: 04-1] Add configuration for running PHP code analysis on SonarQube [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) (owner: 10Kosta Harlan) [14:35:16] https://gerrit-review.googlesource.com/c/plugins/replication/+/204912 [14:35:16] https://gerrit-review.googlesource.com/c/plugins/replication/+/204912 [14:38:57] (03PS2) 10Kosta Harlan: Add configuration for running PHP code analysis on SonarQube [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) [14:38:57] (03PS2) 10Kosta Harlan: Add configuration for running PHP code analysis on SonarQube [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) [14:40:05] (03CR) 10jerkins-bot: [V: 04-1] Add configuration for running PHP code analysis on SonarQube [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) (owner: 10Kosta Harlan) [14:40:05] (03CR) 10jerkins-bot: [V: 04-1] Add configuration for running PHP code analysis on SonarQube [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) (owner: 10Kosta Harlan) [14:42:12] 10Continuous-Integration-Infrastructure (Slipway): operations-mw-config-typos - https://phabricator.wikimedia.org/T210284 (10hashar) Equivalent git command: ` git grep -E -I -f typos -- . ':(exclude)typos' ` [14:42:12] 10Continuous-Integration-Infrastructure (Slipway): operations-mw-config-typos - https://phabricator.wikimedia.org/T210284 (10hashar) Equivalent git command: ` git grep -E -I -f typos -- . ':(exclude)typos' ` [14:47:54] (03PS3) 10Kosta Harlan: Add configuration for running PHP code analysis on SonarQube [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) [14:47:54] (03PS3) 10Kosta Harlan: Add configuration for running PHP code analysis on SonarQube [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) [14:52:39] (03PS1) 10Hashar: docker: git grep to find typos [integration/config] - 10https://gerrit.wikimedia.org/r/475475 (https://phabricator.wikimedia.org/T210284) [14:52:39] (03PS1) 10Hashar: docker: git grep to find typos [integration/config] - 10https://gerrit.wikimedia.org/r/475475 (https://phabricator.wikimedia.org/T210284) [14:54:06] (03PS2) 10Hashar: docker: git grep to find typos [integration/config] - 10https://gerrit.wikimedia.org/r/475475 (https://phabricator.wikimedia.org/T210284) [14:54:06] (03PS2) 10Hashar: docker: git grep to find typos [integration/config] - 10https://gerrit.wikimedia.org/r/475475 (https://phabricator.wikimedia.org/T210284) [15:11:45] (03PS4) 10Kosta Harlan: Add configuration for running PHP code analysis on SonarQube [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) [15:11:45] (03PS4) 10Kosta Harlan: Add configuration for running PHP code analysis on SonarQube [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) [15:18:12] 10Beta-Cluster-Infrastructure, 10ConfirmEdit (CAPTCHA extension): UnderflowException when creating an account, FancyCaptcha.php: Ran out of captcha images - https://phabricator.wikimedia.org/T210092 (10kostajh) @Krenair thank you for sorting this out quickly! [15:18:12] 10Beta-Cluster-Infrastructure, 10ConfirmEdit (CAPTCHA extension): UnderflowException when creating an account, FancyCaptcha.php: Ran out of captcha images - https://phabricator.wikimedia.org/T210092 (10kostajh) @Krenair thank you for sorting this out quickly! [15:19:35] gehel: kostajh sorry I have missed the IRC ping :(((( [15:19:35] gehel: kostajh sorry I have missed the IRC ping :(((( [15:20:04] hashar: no problem. kostajh already has some CR which looks reasonable to me [15:20:04] hashar: no problem. kostajh already has some CR which looks reasonable to me [15:20:12] but we'll need your magic touch! [15:20:12] but we'll need your magic touch! [15:20:41] ;) [15:20:41] ;) [15:22:02] PROBLEM - Host integration-slave-jessie-android is DOWN: CRITICAL - Host Unreachable (10.68.19.239) [15:22:02] PROBLEM - Host integration-slave-jessie-android is DOWN: CRITICAL - Host Unreachable (10.68.19.239) [15:22:06] hashar: https://gerrit.wikimedia.org/r/c/integration/config/+/474729 would need to get merged/built first, but after that, could we test out https://gerrit.wikimedia.org/r/c/integration/config/+/475470 without merging it? what would we need to do next? [15:22:07] hashar: https://gerrit.wikimedia.org/r/c/integration/config/+/474729 would need to get merged/built first, but after that, could we test out https://gerrit.wikimedia.org/r/c/integration/config/+/475470 without merging it? what would we need to do next? [15:24:26] 10Beta-Cluster-Infrastructure: Unable to create account due to IP restriction - https://phabricator.wikimedia.org/T210296 (10kostajh) [15:24:26] 10Beta-Cluster-Infrastructure: Unable to create account due to IP restriction - https://phabricator.wikimedia.org/T210296 (10kostajh) [15:24:44] 10Beta-Cluster-Infrastructure: Unable to create account due to IP restriction - https://phabricator.wikimedia.org/T210296 (10Krenair) Might be a trust problem due to MediaWiki not really knowing about the new cache, https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/475363/ ? [15:24:44] 10Beta-Cluster-Infrastructure: Unable to create account due to IP restriction - https://phabricator.wikimedia.org/T210296 (10Krenair) Might be a trust problem due to MediaWiki not really knowing about the new cache, https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/475363/ ? [15:26:10] 10Beta-Cluster-Infrastructure: Unable to create account due to IP restriction - https://phabricator.wikimedia.org/T210296 (10Krenair) Yeah I went to https://en.wikipedia.beta.wmflabs.org/wiki/Special:MyContributions while logged out and it redirected me to the contribs for the new varnish private IP :| [15:26:10] 10Beta-Cluster-Infrastructure: Unable to create account due to IP restriction - https://phabricator.wikimedia.org/T210296 (10Krenair) Yeah I went to https://en.wikipedia.beta.wmflabs.org/wiki/Special:MyContributions while logged out and it redirected me to the contribs for the new varnish private IP :| [15:26:22] hashar, ^ mind doing https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/475363/ ? [15:26:22] hashar, ^ mind doing https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/475363/ ? [15:26:30] PROBLEM - Host integration-slave-docker-1043 is DOWN: CRITICAL - Host Unreachable (10.68.22.120) [15:26:30] PROBLEM - Host integration-slave-docker-1043 is DOWN: CRITICAL - Host Unreachable (10.68.22.120) [15:26:34] it should also fix purging on edits [15:26:34] it should also fix purging on edits [15:29:09] (03CR) 10Hashar: [C: 032] "Looks all fine to me. We will see whether it builds on contint1001 :)" [integration/config] - 10https://gerrit.wikimedia.org/r/474729 (https://phabricator.wikimedia.org/T209849) (owner: 10Gehel) [15:29:09] (03CR) 10Hashar: [C: 032] "Looks all fine to me. We will see whether it builds on contint1001 :)" [integration/config] - 10https://gerrit.wikimedia.org/r/474729 (https://phabricator.wikimedia.org/T209849) (owner: 10Gehel) [15:29:28] kostajh: gehel: I will build the docker image. Then I can deploy the CI job, run it manually and see what happens :) [15:29:28] kostajh: gehel: I will build the docker image. Then I can deploy the CI job, run it manually and see what happens :) [15:29:42] hashar: yeah! thansk! [15:29:42] hashar: yeah! thansk! [15:32:34] (03Merged) 10jenkins-bot: Add a docker image for sonar-scanner. [integration/config] - 10https://gerrit.wikimedia.org/r/474729 (https://phabricator.wikimedia.org/T209849) (owner: 10Gehel) [15:32:34] (03Merged) 10jenkins-bot: Add a docker image for sonar-scanner. [integration/config] - 10https://gerrit.wikimedia.org/r/474729 (https://phabricator.wikimedia.org/T209849) (owner: 10Gehel) [15:33:49] 10Release-Engineering-Team (Backlog), 10Operations: Keyholder phab repo duplicate work - https://phabricator.wikimedia.org/T203003 (10faidon) >>! In T203003#4768791, @hashar wrote: > I guess we can close rKEYHOLDER. Seems to me keyholder code will be moved out of operations/puppet to `operations/software/keyho... [15:33:49] 10Release-Engineering-Team (Backlog), 10Operations: Keyholder phab repo duplicate work - https://phabricator.wikimedia.org/T203003 (10faidon) >>! In T203003#4768791, @hashar wrote: > I guess we can close rKEYHOLDER. Seems to me keyholder code will be moved out of operations/puppet to `operations/software/keyho... [15:37:11] kostajh: gehel and I am building it :) [15:37:11] kostajh: gehel and I am building it :) [15:37:30] hashar: cool! I'm making a few tweaks to my PHP config patch [15:37:31] hashar: cool! I'm making a few tweaks to my PHP config patch [15:37:33] for the jjb job, I think it is better to have a different job rather than adding a step in the phpunit coverage job [15:37:33] for the jjb job, I think it is better to have a different job rather than adding a step in the phpunit coverage job [15:38:01] not sure where the sonar scanner writes by default though [15:38:01] not sure where the sonar scanner writes by default though [15:38:09] we have the same issue as with the maven jobs: sonar needs the results of the coverage test [15:38:09] we have the same issue as with the maven jobs: sonar needs the results of the coverage test [15:38:20] but the content it generates can then get published on doc.wikimedia.org/ to some subdir like /sonar/ [15:38:20] but the content it generates can then get published on doc.wikimedia.org/ to some subdir like /sonar/ [15:38:26] I am not sure :) [15:38:26] I am not sure :) [15:38:35] so we need to share some state between the steps [15:38:36] so we need to share some state between the steps [15:38:41] ahhhh [15:38:41] ahhhh [15:39:57] we're having other issues atm, so coverage doesn't work anyway, but the goal is to fix that at some point [15:39:57] we're having other issues atm, so coverage doesn't work anyway, but the goal is to fix that at some point [15:39:58] (03PS5) 10Kosta Harlan: Add configuration for running PHP code analysis on SonarQube [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) [15:39:58] (03PS5) 10Kosta Harlan: Add configuration for running PHP code analysis on SonarQube [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) [15:40:37] (03CR) 10Gehel: Add configuration for running PHP code analysis on SonarQube (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) (owner: 10Kosta Harlan) [15:40:37] (03CR) 10Gehel: Add configuration for running PHP code analysis on SonarQube (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) (owner: 10Kosta Harlan) [15:44:05] (03CR) 10Kosta Harlan: Add configuration for running PHP code analysis on SonarQube (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) (owner: 10Kosta Harlan) [15:44:05] (03CR) 10Kosta Harlan: Add configuration for running PHP code analysis on SonarQube (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) (owner: 10Kosta Harlan) [15:59:02] gehel: ok :) lets catchup on monday, I have to go eventually :/ [15:59:02] gehel: ok :) lets catchup on monday, I have to go eventually :/ [15:59:21] hashar: we'll be there! [15:59:21] hashar: we'll be there! [15:59:34] I am sure :) [15:59:34] I am sure :) [16:01:36] gehel: kostajh I have lost track of things, but the image should be available in the docker registry [16:01:36] gehel: kostajh I have lost track of things, but the image should be available in the docker registry [16:02:17] mhmm [16:02:17] mhmm [16:02:18] no [16:02:18] no [16:03:10] or maybe it failed to build :(( [16:03:10] or maybe it failed to build :(( [16:03:24] [contint1001.wikimedia.org] out: ERROR: image docker-registry.discovery.wmnet/releng/java8-sonar-scanner failed to build, see logs for details [16:03:24] [contint1001.wikimedia.org] out: ERROR: image docker-registry.discovery.wmnet/releng/java8-sonar-scanner failed to build, see logs for details [16:03:48] docker-pkg is a pity when it comes to find out build failures :( [16:03:48] docker-pkg is a pity when it comes to find out build failures :( [16:10:47] (03CR) 10Hashar: Add configuration for running PHP code analysis on SonarQube (034 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) (owner: 10Kosta Harlan) [16:10:47] (03CR) 10Hashar: Add configuration for running PHP code analysis on SonarQube (034 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) (owner: 10Kosta Harlan) [16:15:25] (03PS3) 10Hashar: docker: git grep to find typos [integration/config] - 10https://gerrit.wikimedia.org/r/475475 (https://phabricator.wikimedia.org/T210284) [16:15:25] (03PS3) 10Hashar: docker: git grep to find typos [integration/config] - 10https://gerrit.wikimedia.org/r/475475 (https://phabricator.wikimedia.org/T210284) [16:17:07] gehel: did you try building the image in 474729 locally? [16:17:07] gehel: did you try building the image in 474729 locally? [16:17:24] nope, I did not even try :( [16:17:24] nope, I did not even try :( [16:17:35] * gehel is lazy [16:17:35] ACTION is lazy [16:17:46] lol. i'll try now [16:17:46] lol. i'll try now [16:20:48] (03PS1) 10Hashar: typos job on Docker [integration/config] - 10https://gerrit.wikimedia.org/r/475488 (https://phabricator.wikimedia.org/T210284) [16:20:48] (03PS1) 10Hashar: typos job on Docker [integration/config] - 10https://gerrit.wikimedia.org/r/475488 (https://phabricator.wikimedia.org/T210284) [16:21:03] (03CR) 10Hashar: [C: 032] docker: git grep to find typos [integration/config] - 10https://gerrit.wikimedia.org/r/475475 (https://phabricator.wikimedia.org/T210284) (owner: 10Hashar) [16:21:03] (03CR) 10Hashar: [C: 032] docker: git grep to find typos [integration/config] - 10https://gerrit.wikimedia.org/r/475475 (https://phabricator.wikimedia.org/T210284) (owner: 10Hashar) [16:22:46] (03Merged) 10jenkins-bot: docker: git grep to find typos [integration/config] - 10https://gerrit.wikimedia.org/r/475475 (https://phabricator.wikimedia.org/T210284) (owner: 10Hashar) [16:22:46] (03Merged) 10jenkins-bot: docker: git grep to find typos [integration/config] - 10https://gerrit.wikimedia.org/r/475475 (https://phabricator.wikimedia.org/T210284) (owner: 10Hashar) [16:23:22] kostajh: gehel I had an issue with gpg this week [16:23:22] kostajh: gehel I had an issue with gpg this week [16:23:40] https://www.irccloud.com/pastebin/XESqag1e/ [16:23:40] https://www.irccloud.com/pastebin/XESqag1e/ [16:23:53] for `RUN {{ "gnupg wget" | apt_install }}` [16:23:54] for `RUN {{ "gnupg wget" | apt_install }}` [16:24:11] some madness at https://gerrit.wikimedia.org/r/#/c/integration/config/+/474270/ [16:24:11] some madness at https://gerrit.wikimedia.org/r/#/c/integration/config/+/474270/ [16:24:35] kostajh: I just copy pasted from the java image, honestly I have no idea what I was doing [16:24:35] kostajh: I just copy pasted from the java image, honestly I have no idea what I was doing [16:24:37] kostajh: that is because we use an utility named "docker-pkg" [16:24:37] kostajh: that is because we use an utility named "docker-pkg" [16:24:44] which process the Dockerfile.template as a Jinja2 template [16:24:44] which process the Dockerfile.template as a Jinja2 template [16:24:52] (a templating DSL for python) [16:24:52] (a templating DSL for python) [16:24:56] ah [16:24:56] ah [16:25:32] written by SRE. The repo is : ssh://gerrit.wikimedia.org:29418/operations/docker-images/docker-pkg.git [16:25:32] written by SRE. The repo is : ssh://gerrit.wikimedia.org:29418/operations/docker-images/docker-pkg.git [16:25:34] do we need to set `USER root` here? https://gerrit.wikimedia.org/r/c/integration/config/+/474729/3/dockerfiles/java8-sonar-scanner/Dockerfile.template#2 [16:25:34] do we need to set `USER root` here? https://gerrit.wikimedia.org/r/c/integration/config/+/474729/3/dockerfiles/java8-sonar-scanner/Dockerfile.template#2 [16:25:42] then assuming you have python: pip3 install --user -e . [16:25:42] then assuming you have python: pip3 install --user -e . [16:25:46] usER root [16:25:46] usER root [16:25:54] that means that following commands will be executed as root user [16:25:54] that means that following commands will be executed as root user [16:26:07] containers usually have USER nobody [16:26:07] containers usually have USER nobody [16:26:14] so when you inherit from another container with eg: FROM foobar [16:26:14] so when you inherit from another container with eg: FROM foobar [16:26:20] since foobar uses nobody [16:26:20] since foobar uses nobody [16:26:32] you then have to swtich to the root user to be able to run apt update && apt install [16:26:32] you then have to swtich to the root user to be able to run apt update && apt install [16:26:33] so: [16:26:33] so: [16:26:35] FROM foobar [16:26:35] FROM foobar [16:26:38] USER root [16:26:38] USER root [16:26:43] RUN apt update && apt install foo [16:26:43] RUN apt update && apt install foo [16:26:45] USER nobody [16:26:45] USER nobody [16:26:53] ENTRYPOINT ["mycommand.sh"] [16:26:53] ENTRYPOINT ["mycommand.sh"] [16:26:54] yeah [16:26:54] yeah [16:26:59] Ok, I'll push a patch shortly [16:26:59] Ok, I'll push a patch shortly [16:27:00] docker is a sin [16:27:00] docker is a sin [16:27:23] and [16:27:23] and [16:27:29] is a sin? :) [16:27:29] is a sin? :) [16:27:31] when some command fails during the build [16:27:32] when some command fails during the build [16:27:40] docker-pkg just spurts some backtrace [16:27:40] docker-pkg just spurts some backtrace [16:27:49] and no output from the actual container being build :/ [16:27:49] and no output from the actual container being build :/ [16:28:36] 10Beta-Cluster-Infrastructure, 10DNS, 10Operations, 10Traffic, and 4 others: Ferm's upstream Net::DNS Perl library questionable handling of NOERROR responses without records causing puppet errors when we try to @resolve AAAA in labs - https://phabricator.wikimedia.org/T153468 (10MoritzMuehlenhoff) Status u... [16:28:36] 10Beta-Cluster-Infrastructure, 10DNS, 10Operations, 10Traffic, and 4 others: Ferm's upstream Net::DNS Perl library questionable handling of NOERROR responses without records causing puppet errors when we try to @resolve AAAA in labs - https://phabricator.wikimedia.org/T153468 (10MoritzMuehlenhoff) Status u... [16:28:37] <_joe_> hashar: the error is in the build.log though [16:28:37] <_joe_> hashar: the error is in the build.log though [16:28:49] (03CR) 10Hashar: "I have build the container. Gotta deploy the job on Jenkins and the zuul config then test it out live :)" [integration/config] - 10https://gerrit.wikimedia.org/r/475488 (https://phabricator.wikimedia.org/T210284) (owner: 10Hashar) [16:28:49] (03CR) 10Hashar: "I have build the container. Gotta deploy the job on Jenkins and the zuul config then test it out live :)" [integration/config] - 10https://gerrit.wikimedia.org/r/475488 (https://phabricator.wikimedia.org/T210284) (owner: 10Hashar) [16:29:03] 10Continuous-Integration-Infrastructure (Slipway), 10Release-Engineering-Team (Kanban), 10Patch-For-Review: operations-mw-config-typos - https://phabricator.wikimedia.org/T210284 (10hashar) a:03hashar [16:29:03] 10Continuous-Integration-Infrastructure (Slipway), 10Release-Engineering-Team (Kanban), 10Patch-For-Review: operations-mw-config-typos - https://phabricator.wikimedia.org/T210284 (10hashar) a:03hashar [16:29:23] locally, it looks like the issues are 1) root needs to be set for install, 2) unzip doesn't take `-d` as a param, 3) unzip needs to be installed, 4) sonar-scanner needs to be `mv`'ed to `/opt`. patch coming soon [16:29:23] locally, it looks like the issues are 1) root needs to be set for install, 2) unzip doesn't take `-d` as a param, 3) unzip needs to be installed, 4) sonar-scanner needs to be `mv`'ed to `/opt`. patch coming soon [16:29:24] _joe_: not really, there is no stdout/stderr from the actual commands :( [16:29:24] _joe_: not really, there is no stdout/stderr from the actual commands :( [16:29:46] _joe_: just that some RUN foo && bar && god know whatelse && foo eventually failed with exit 1 / 255 etc :D [16:29:46] _joe_: just that some RUN foo && bar && god know whatelse && foo eventually failed with exit 1 / 255 etc :D [16:29:50] <_joe_> hashar: uh I thought I fixed it [16:29:50] <_joe_> hashar: uh I thought I fixed it [16:30:04] Krenair: https://en.wikipedia.org/wiki/Sin ) [16:30:04] Krenair: https://en.wikipedia.org/wiki/Sin ) [16:30:09] Krenair: but yeah docker is crazy [16:30:09] Krenair: but yeah docker is crazy [16:30:15] yes I know what it is [16:30:15] yes I know what it is [16:30:26] BUT we have the whole dockerfile generated, so I usually copy pasted and rebuild manually [16:30:26] BUT we have the whole dockerfile generated, so I usually copy pasted and rebuild manually [16:30:30] anyway [16:30:30] anyway [16:30:38] I am late. Got a meeting that started 30 secs ago [16:30:38] I am late. Got a meeting that started 30 secs ago [16:31:34] _joe_: beside that. docker-pkg works well :) I hope to have some time to allocate to polish it up though [16:31:34] _joe_: beside that. docker-pkg works well :) I hope to have some time to allocate to polish it up though [16:31:44] _joe_: but in short kudos :) I am off, have a good week-end [16:31:44] _joe_: but in short kudos :) I am off, have a good week-end [16:31:56] kostajh: gehel lets follow up on monday morning [16:31:56] kostajh: gehel lets follow up on monday morning [16:32:04] yep [16:32:04] yep [16:32:31] 10Beta-Cluster-Infrastructure, 10DNS, 10Operations, 10Traffic, and 4 others: Ferm's upstream Net::DNS Perl library questionable handling of NOERROR responses without records causing puppet errors when we try to @resolve AAAA in labs - https://phabricator.wikimedia.org/T153468 (10Krenair) This was already a... [16:32:31] 10Beta-Cluster-Infrastructure, 10DNS, 10Operations, 10Traffic, and 4 others: Ferm's upstream Net::DNS Perl library questionable handling of NOERROR responses without records causing puppet errors when we try to @resolve AAAA in labs - https://phabricator.wikimedia.org/T153468 (10Krenair) This was already a... [16:37:37] (03PS1) 10Kosta Harlan: Fix Dockerfile.template for sonar-scanner [integration/config] - 10https://gerrit.wikimedia.org/r/475496 (https://phabricator.wikimedia.org/T209849) [16:37:37] (03PS1) 10Kosta Harlan: Fix Dockerfile.template for sonar-scanner [integration/config] - 10https://gerrit.wikimedia.org/r/475496 (https://phabricator.wikimedia.org/T209849) [16:40:55] the output from docker-pkg is `ERROR - Unexpected error building image docker-registry.wikimedia.org/releng/java8-sonar-scanner:0.1.0: Image docker-registry.wikimedia.org/releng/java8 not found (image.py:231)` [16:40:55] the output from docker-pkg is `ERROR - Unexpected error building image docker-registry.wikimedia.org/releng/java8-sonar-scanner:0.1.0: Image docker-registry.wikimedia.org/releng/java8 not found (image.py:231)` [16:41:08] I'm building with `docker-pkg ~/src/integration/config/dockerfiles/java8-sonar-scanner -c ~/src/integration/config/dockerfiles/config.yaml` [16:41:09] I'm building with `docker-pkg ~/src/integration/config/dockerfiles/java8-sonar-scanner -c ~/src/integration/config/dockerfiles/config.yaml` [16:43:02] but `docker pull docker-registry.wikimedia.org/releng/java8` works fine [16:43:02] but `docker pull docker-registry.wikimedia.org/releng/java8` works fine [16:49:15] (03PS2) 10Kosta Harlan: Fix Dockerfile.template for sonar-scanner [integration/config] - 10https://gerrit.wikimedia.org/r/475496 (https://phabricator.wikimedia.org/T209849) [16:49:15] (03PS2) 10Kosta Harlan: Fix Dockerfile.template for sonar-scanner [integration/config] - 10https://gerrit.wikimedia.org/r/475496 (https://phabricator.wikimedia.org/T209849) [17:35:48] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Kanban), 10Cloud-Services, 10Epic, 10Patch-For-Review: Migrate deployment-prep to eqiad1 - https://phabricator.wikimedia.org/T208101 (10Krenair) @fgiunchedi: Why is puppet disabled on deployment-mediawiki-07? The reason given is just `filippo` [17:35:48] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Kanban), 10Cloud-Services, 10Epic, 10Patch-For-Review: Migrate deployment-prep to eqiad1 - https://phabricator.wikimedia.org/T208101 (10Krenair) @fgiunchedi: Why is puppet disabled on deployment-mediawiki-07? The reason given is just `filippo` [17:41:33] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Kanban): Status of deployment-redis0[56]? - https://phabricator.wikimedia.org/T210301 (10Krenair) p:05Triage>03Normal [17:41:33] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Kanban): Status of deployment-redis0[56]? - https://phabricator.wikimedia.org/T210301 (10Krenair) p:05Triage>03Normal [22:01:35] 10Continuous-Integration-Infrastructure (Slipway), 10Wikidata, 10Wikidata Query UI, 10Wikimedia-Portals: Migrate wikidata-query-gui-build and wikimedia-portals-build to Docker containers - https://phabricator.wikimedia.org/T210286 (10Addshore) For the wdqs UI we were going to try to switch the build to use... [22:01:35] 10Continuous-Integration-Infrastructure (Slipway), 10Wikidata, 10Wikidata Query UI, 10Wikimedia-Portals: Migrate wikidata-query-gui-build and wikimedia-portals-build to Docker containers - https://phabricator.wikimedia.org/T210286 (10Addshore) For the wdqs UI we were going to try to switch the build to use...