[00:20:01] mutante: i know you meant dib it was a joke [00:22:03] 06Release-Engineering-Team, 13Patch-For-Review, 05WMF-deploy-2016-11-01_(1.29.0-wmf.1): Remove .gitreview from MediaWiki and Extensions - https://phabricator.wikimedia.org/T146293#2770597 (10thcipriani) >>! In T146293#2768233, @Jonas wrote: > Not sure if this is related but with cognate extension i get this... [01:11:53] grrrit-wm: restart [04:42:27] (03PS2) 10Samwilson: Add sniff for cast operator spacing [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/318880 (https://phabricator.wikimedia.org/T149544) [04:43:21] (03CR) 10Samwilson: Thanks Legoktm. I've removed those tests, and it can instead rely on the existing test for casting in 'generic_pass.php'. [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/318880 (https://phabricator.wikimedia.org/T149544) (owner: 10Samwilson) [04:52:57] (03CR) 10Legoktm: [C: 032] [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/318880 (https://phabricator.wikimedia.org/T149544) (owner: 10Samwilson) [04:53:53] (03Merged) 10jenkins-bot: Add sniff for cast operator spacing [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/318880 (https://phabricator.wikimedia.org/T149544) (owner: 10Samwilson) [05:07:30] 10Gerrit: Alter full name on Gerrit - https://phabricator.wikimedia.org/T149976#2770792 (10Gryllida) [06:47:29] Yippee, build fixed! [06:47:30] Project selenium-Wikibase » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #164: 09FIXED in 2 hr 7 min: https://integration.wikimedia.org/ci/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/164/ [07:52:15] 03Scap3, 15User-mobrovac: Smart-merge checks for different environments - https://phabricator.wikimedia.org/T149668#2770902 (10mobrovac) p:05Normal>03High Raising the priority because this hinders us from depooling and repooling service target hosts during deploys and restarts. [08:09:55] 06Release-Engineering-Team, 13Patch-For-Review, 05WMF-deploy-2016-11-01_(1.29.0-wmf.1): Remove .gitreview from MediaWiki and Extensions - https://phabricator.wikimedia.org/T146293#2770908 (10Jonas) >What is the value of `git remote get-url gerrit` inside the cognate extension directory? ``` /extensions/Cogn... [08:29:55] (03PS2) 10Hashar: dib: install Doxygen on Jessie images [integration/config] - 10https://gerrit.wikimedia.org/r/318279 [08:30:47] (03Abandoned) 10Hashar: dib: install Doxygen on Jessie images [integration/config] - 10https://gerrit.wikimedia.org/r/318279 (owner: 10Hashar) [08:59:00] 05Continuous-Integration-Scaling, 07Jenkins, 07Nodepool: Postmortem: Nodepool can't add slaves to Jenkins due to config plugin directory reaching 32k inodes - https://phabricator.wikimedia.org/T127131#2770960 (10hashar) 05Open>03Resolved a:03hashar That is solved, the workaround is to garbage collect t... [08:59:59] 05Continuous-Integration-Scaling: Provision CI:admins ssh public key in Nodepool instances - https://phabricator.wikimedia.org/T128364#2770965 (10hashar) [09:00:01] 10Continuous-Integration-Infrastructure, 15User-mobrovac: Give @mobrovac access to CI instances - https://phabricator.wikimedia.org/T129880#2770967 (10hashar) [09:00:36] 10Continuous-Integration-Infrastructure, 15User-mobrovac: Give @mobrovac access to CI instances - https://phabricator.wikimedia.org/T129880#2118616 (10hashar) Will be made possible as part of T128364 which I have no idea how to implement :( [09:00:49] 10Continuous-Integration-Infrastructure: Create some instances with php5.6 on them - https://phabricator.wikimedia.org/T135666#2770971 (10hashar) [09:00:59] 10Continuous-Integration-Config, 07WorkType-NewFunctionality: Jobs should checkout source in a subdirectory of the workspace to avoid polluting it with CI related files - https://phabricator.wikimedia.org/T130208#2770972 (10hashar) [09:02:42] 10Continuous-Integration-Infrastructure, 05Continuous-Integration-Scaling, 13Patch-For-Review: MediaWiki gate takes 20 minutes for extensions tests and 1.5 hour for at least a patch - https://phabricator.wikimedia.org/T126274#2770974 (10hashar) 05Open>03Resolved a:03hashar A lot of the issue is fixed b... [09:04:26] 10Gerrit, 06Operations, 10grrrit-wm, 13Patch-For-Review: Support restarting grrrit-wm automatically when we restart production gerrit - https://phabricator.wikimedia.org/T149609#2770979 (10Paladox) The bot should now automatically try and reconnect to ssh. We will see if this works with prod gerrit when it... [09:04:58] 05Continuous-Integration-Scaling, 07Nodepool, 13Patch-For-Review: Add monitoring and capacity planning for Nodepool - https://phabricator.wikimedia.org/T113806#2770993 (10hashar) [09:05:23] 10Continuous-Integration-Infrastructure, 07Nodepool: Add monitoring and capacity planning for Nodepool - https://phabricator.wikimedia.org/T113806#1676584 (10hashar) [09:05:26] (03CR) 10WMDE-Fisch: [C: 031] [selenium] - 10https://gerrit.wikimedia.org/r/318305 (https://phabricator.wikimedia.org/T149311) (owner: 10Tobias Gritschacher) [09:06:01] 05Continuous-Integration-Scaling: Speed up the time to get a Nodepool instances to achieve READY state - https://phabricator.wikimedia.org/T113342#2770995 (10hashar) [09:13:33] 05Continuous-Integration-Scaling, 06Labs, 10Labs-Infrastructure: Support dedicating a specific virt node to a specific nova project - https://phabricator.wikimedia.org/T84989#2771041 (10hashar) @chasemp @Andrew should we look at running the CI instances on dedicated compute node or is that an idea that shoul... [09:15:15] 10Browser-Tests-Infrastructure, 06Collaboration-Team-Triage, 10Flow, 10MobileFrontend, 10VisualEditor: Create Jenkins builds for Editing across repositories (MobileFrontend, VisualEditor etc) - https://phabricator.wikimedia.org/T90647#2771054 (10hashar) [09:15:18] 10Continuous-Integration-Infrastructure, 07Wikimedia-Incident: Write and implement tests for Wikimedia's Apache configuration (redirects.conf, etc.) - https://phabricator.wikimedia.org/T45266#2771055 (10hashar) [09:15:20] 10Continuous-Integration-Infrastructure, 05Continuous-Integration-Scaling, 10releng-201415-Q3, 10releng-201415-Q4, and 2 others: [EPIC] Run CI jobs in disposable VMs - https://phabricator.wikimedia.org/T47499#2771052 (10hashar) 05Open>03Resolved I am closing this task, it is no more used and the progre... [09:24:03] !log Delete integration-slave-trusty-1016 not pooled in Jenkins anymore T148183 [09:24:06] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [09:25:27] !log Delete integration-slave-trusty-1012 one less permanent slave since some load has been moved to Nodepool T148183 [09:25:32] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [09:26:44] PROBLEM - Host integration-slave-trusty-1016 is DOWN: CRITICAL - Host Unreachable (10.68.18.34) [09:26:55] !log Delete zuul-dev-jessie.integration.eqiad.wmflabs was for testing Zuul on Jessie and it works just fine on contint1001 :] T148183 [09:26:59] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [09:27:15] PROBLEM - Host zuul-dev-jessie is DOWN: CRITICAL - Host Unreachable (10.68.20.133) [09:28:13] PROBLEM - Host integration-slave-trusty-1012 is DOWN: CRITICAL - Host Unreachable (10.68.18.2) [09:28:20] !log Delete integration-slave-jessie-1003 , only have a few jobs running on permanent Jessie slaves - T148183 [09:28:23] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [09:29:01] PROBLEM - Host integration-slave-jessie-1003 is DOWN: CRITICAL - Host Unreachable (10.68.21.145) [09:36:20] 05Continuous-Integration-Scaling: Provision CI:admins ssh public key in Nodepool instances - https://phabricator.wikimedia.org/T128364#2771149 (10Krenair) > I think the LDAP access also need a password, and I am not that confortable in having it in the CI instances. But maybe anonymous auth is possible. The LDA... [09:40:41] (03CR) 10Hashar: postmerge builds above/below are me testing the migration of the job to Nodepool [ruby/api] - 10https://gerrit.wikimedia.org/r/302846 (owner: 10Dduvall) [09:40:45] (03CR) 10Hashar: postmerge builds above/below are me testing the migration of the job to Nodepool [selenium] - 10https://gerrit.wikimedia.org/r/302850 (owner: 10Dduvall) [10:08:17] (03CR) 10Hashar: recheck [selenium] - 10https://gerrit.wikimedia.org/r/302850 (owner: 10Dduvall) [10:47:37] hi, is deployment-mediawiki05 being reimaged or reinstalled? [10:48:18] I can't seem to find the certificate to connect https://deployment-elastic0x/ [10:53:40] 10Gerrit, 06Repository-Admins, 10Wikidata: Deactivate/archive WikibaseQueryEngine - https://phabricator.wikimedia.org/T141858#2771242 (10Aklapper) Thanks! Removing #Project-Admins as remaining work is unrelated to #Project-Admins scope. [10:53:41] looks like the hash of /etc/ssl/certs/Puppet_Internal_CA.pem does not match [10:54:17] 10Gerrit, 06Repository-Admins, 10Wikidata: Deactivate/archive WikibaseDatabase - https://phabricator.wikimedia.org/T141865#2514917 (10Aklapper) Archived #WikibaseDatabase in Phabricator. Removing #Project-Admins as remaining work is unrelated to #Project-Admins scope. [10:58:54] (03PS1) 10Hashar: Migrate yard-publish jobs to Nodepool/Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/319822 [10:59:40] (03PS2) 10Hashar: Migrate yard-publish jobs to Nodepool/Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/319822 [11:01:04] (03CR) 10Hashar: [C: 032] [integration/config] - 10https://gerrit.wikimedia.org/r/319822 (owner: 10Hashar) [11:01:52] (03Merged) 10jenkins-bot: Migrate yard-publish jobs to Nodepool/Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/319822 (owner: 10Hashar) [11:03:32] (03PS2) 10Hashar: Migrate erblint-HEAD from Precise to DebianJessie [integration/config] - 10https://gerrit.wikimedia.org/r/309278 (owner: 10Paladox) [11:03:37] (03CR) 10Hashar: [C: 032] [integration/config] - 10https://gerrit.wikimedia.org/r/309278 (owner: 10Paladox) [11:04:40] (03Merged) 10jenkins-bot: Migrate erblint-HEAD from Precise to DebianJessie [integration/config] - 10https://gerrit.wikimedia.org/r/309278 (owner: 10Paladox) [11:25:12] 10Gerrit, 06Operations, 10grrrit-wm, 13Patch-For-Review: Support restarting grrrit-wm automatically when we restart production gerrit - https://phabricator.wikimedia.org/T149609#2771256 (10MoritzMuehlenhoff) p:05Triage>03Normal [11:51:28] (03PS1) 10Hashar: castor: add maven local repo [integration/config] - 10https://gerrit.wikimedia.org/r/319825 [11:54:01] hashar: Can you create gerrit repos [12:02:15] (03PS1) 10Hashar: wikidata-query-rdf to Nodepool/Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/319832 [12:43:32] (03CR) 10Hashar: [C: 032] [integration/config] - 10https://gerrit.wikimedia.org/r/319825 (owner: 10Hashar) [12:44:33] Reedy: yup as well as https://gerrit.wikimedia.org/r/#/admin/groups/119 and https://gerrit.wikimedia.org/r/#/admin/groups/1,members :D [12:45:03] (03Merged) 10jenkins-bot: castor: add maven local repo [integration/config] - 10https://gerrit.wikimedia.org/r/319825 (owner: 10Hashar) [12:45:15] (03PS1) 10Hashar: dib: add java packages to Jessie images [integration/config] - 10https://gerrit.wikimedia.org/r/319837 [12:45:31] (03CR) 10Hashar: [C: 032] [integration/config] - 10https://gerrit.wikimedia.org/r/319837 (owner: 10Hashar) [12:47:14] (03Merged) 10jenkins-bot: dib: add java packages to Jessie images [integration/config] - 10https://gerrit.wikimedia.org/r/319837 (owner: 10Hashar) [12:49:52] !log deployment-prep reloading nginx on deployment-elastic0[5-7] to fix ssl cert issue [12:49:55] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [12:54:36] Yippee, build fixed! [12:54:36] Project selenium-CirrusSearch » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #209: 09FIXED in 44 sec: https://integration.wikimedia.org/ci/job/selenium-CirrusSearch/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/209/ [12:57:41] !log Image ci-jessie-wikimedia-1478263647 in wmflabs-eqiad is ready (bring in java for maven projects) [12:57:44] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [12:59:21] hashar: Could you create a PageViewInfo extension in gerrit for https://phabricator.wikimedia.org/T148775 please? [13:12:20] 10Continuous-Integration-Infrastructure: selenium-CirrusSearch: Groovy Template file [wikimedia.template] was not found in $JENKINS_HOME/email-templates. - https://phabricator.wikimedia.org/T149996#2771362 (10dcausse) [13:20:03] !log gerrit: created mediawiki/extensions/PageViewInfo.git and renamed user group extension-WikimediaPageViewInfo to extension-PageViewInfo T148775 [13:20:07] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [13:20:16] Reedy: done! [13:35:33] (03PS2) 10Hashar: wikidata-query-rdf to Nodepool/Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/319832 [13:35:38] (03CR) 10Hashar: [C: 032] [integration/config] - 10https://gerrit.wikimedia.org/r/319832 (owner: 10Hashar) [13:36:27] (03Merged) 10jenkins-bot: wikidata-query-rdf to Nodepool/Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/319832 (owner: 10Hashar) [13:40:18] hashar: Thanks! Is direct push enabled (for now) for import? [13:43:41] Reedy: maybe? [13:44:27] Reedy: I made you an owner of https://gerrit.wikimedia.org/r/#/admin/projects/mediawiki/extensions/PageViewInfo,access [13:44:31] ! [remote rejected] master -> master (prohibited by Gerrit) [13:44:31] so you should get push [13:44:35] or at least be able to add push [13:44:46] heh, thanks [13:45:58] I think I need to enable forging too... [13:46:55] Project selenium-VisualEditor » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #201: 04FAILURE in 2 min 55 sec: https://integration.wikimedia.org/ci/job/selenium-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/201/ [13:47:36] Does github replication happen automagically? [13:47:37] (03PS1) 10Hashar: Migrate maven jobs to Jessie/Nodepool [integration/config] - 10https://gerrit.wikimedia.org/r/319844 (https://phabricator.wikimedia.org/T119140) [13:47:49] (03CR) 10Hashar: [C: 032] [integration/config] - 10https://gerrit.wikimedia.org/r/319844 (https://phabricator.wikimedia.org/T119140) (owner: 10Hashar) [13:49:14] Reedy: na the repo has to be created manually in github [13:49:27] (03Merged) 10jenkins-bot: Migrate maven jobs to Jessie/Nodepool [integration/config] - 10https://gerrit.wikimedia.org/r/319844 (https://phabricator.wikimedia.org/T119140) (owner: 10Hashar) [13:49:38] Just an empty one? [13:49:43] yes [13:49:48] and gerrit catch up from there [13:50:28] :) [13:50:32] What about phab/diffusion? [13:50:38] no clue [13:50:45] but I guess it is synced manualyl from time to time [13:51:22] https://github.com/wikimedia/mediawiki-extensions-PageViewInfo [13:51:24] That was quick :D [14:02:02] 10Continuous-Integration-Config, 05Continuous-Integration-Scaling, 10releng-201516-q3, 13Patch-For-Review, 07WorkType-NewFunctionality: [keyresult] Migrate as many misc CI jobs as possible to Nodepool - https://phabricator.wikimedia.org/T119140#2771627 (10hashar) [14:05:57] (03PS8) 10Hashar: Test mediawiki gate queue only has mw projects [integration/config] - 10https://gerrit.wikimedia.org/r/241660 (https://phabricator.wikimedia.org/T107529) [14:06:40] (03CR) 10jenkins-bot: [V: 04-1] Test mediawiki gate queue only has mw projects [integration/config] - 10https://gerrit.wikimedia.org/r/241660 (https://phabricator.wikimedia.org/T107529) (owner: 10Hashar) [14:20:09] (03PS1) 10Hashar: composer-validate is not needed on extensions [integration/config] - 10https://gerrit.wikimedia.org/r/319855 [14:22:50] (03CR) 10Hashar: [C: 032] [integration/config] - 10https://gerrit.wikimedia.org/r/319855 (owner: 10Hashar) [14:23:29] (03Merged) 10jenkins-bot: composer-validate is not needed on extensions [integration/config] - 10https://gerrit.wikimedia.org/r/319855 (owner: 10Hashar) [14:51:22] (03PS1) 10Hashar: debian-glue: skip piuparts [integration/config] - 10https://gerrit.wikimedia.org/r/319862 (https://phabricator.wikimedia.org/T141454) [14:51:53] 10Continuous-Integration-Infrastructure, 13Patch-For-Review: debian-glue-non-voting jobs seem to be failing consistently and cause is not clear - https://phabricator.wikimedia.org/T148664#2771776 (10hashar) I have disabled piuparts entirely for now. [14:56:45] (03CR) 10Hashar: [C: 032] [integration/config] - 10https://gerrit.wikimedia.org/r/319862 (https://phabricator.wikimedia.org/T141454) (owner: 10Hashar) [14:58:00] (03Merged) 10jenkins-bot: debian-glue: skip piuparts [integration/config] - 10https://gerrit.wikimedia.org/r/319862 (https://phabricator.wikimedia.org/T141454) (owner: 10Hashar) [14:58:33] 05Continuous-Integration-Scaling, 06Labs, 10Labs-Infrastructure: Support dedicating a specific virt node to a specific nova project - https://phabricator.wikimedia.org/T84989#2771798 (10Andrew) I'm not sure what it would help. In general when there are resource issues it's not with virt capacity but with ot... [15:18:22] zeljkof: around ? [15:18:30] hashar: sure [15:18:32] wondering why the email notification uses a custom template [15:18:38] https://phabricator.wikimedia.org/T149996 [15:18:41] Groovy Template file [wikimedia.template] was not found in $JENKINS_HOME/email-templates. [15:18:56] that wikimedia.template is on the CI master disk [15:19:02] and hasnt been copied around for some reason [15:19:15] the default e-mail template was really bad [15:19:26] so one of the interns created the one we use now [15:19:31] ohhh [15:19:38] gotta puppetize it i guess [15:19:58] as an experiment I removed the use of a template for selenium-VisualEditor [15:20:01] running it on https://integration.wikimedia.org/ci/view/Selenium/job/selenium-VisualEditor/202/console [15:20:04] will see what it generates [15:20:11] then I guess I will pupptize the template [15:20:26] brb [15:21:37] Yippee, build fixed! [15:21:38] Project selenium-VisualEditor » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #202: 09FIXED in 2 min 23 sec: https://integration.wikimedia.org/ci/job/selenium-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/202/ [15:26:06] bah [15:28:28] OHHH [15:28:35] file { '/var/lib/jenkins/email-templates': [15:28:35] ensure => link, [15:28:35] target => '/srv/deployment/integration/slave-scripts/tools/email-templates', [15:33:39] (03PS1) 10Hashar: Migrate Jenkins email template to puppet [integration/jenkins] - 10https://gerrit.wikimedia.org/r/319873 (https://phabricator.wikimedia.org/T149996) [15:34:54] zeljkof: will just migrate it to puppet [15:35:07] zeljkof: https://gerrit.wikimedia.org/r/#/c/319873/ removes it from integration/jenkins [15:35:17] https://gerrit.wikimedia.org/r/319874 is for puppet [15:36:04] hashar: progress! :D [15:38:03] 10Continuous-Integration-Infrastructure, 13Patch-For-Review: selenium-CirrusSearch: Groovy Template file [wikimedia.template] was not found in $JENKINS_HOME/email-templates. - https://phabricator.wikimedia.org/T149996#2771972 (10hashar) a:03hashar The reason is the template is in integration/jenkins.git whic... [15:38:42] compiles compiles https://integration.wikimedia.org/ci/job/operations-puppet-catalog-compiler/4548/console [15:40:03] PROBLEM - puppet last run on contint1001 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/var/lib/jenkins/email-templates] [15:42:33] 10Continuous-Integration-Infrastructure, 13Patch-For-Review: selenium-CirrusSearch: Groovy Template file [wikimedia.template] was not found in $JENKINS_HOME/email-templates. - https://phabricator.wikimedia.org/T149996#2771992 (10hashar) p:05Triage>03Unbreak! [15:48:15] (03CR) 10Hashar: [C: 032] [integration/jenkins] - 10https://gerrit.wikimedia.org/r/319873 (https://phabricator.wikimedia.org/T149996) (owner: 10Hashar) [15:49:12] (03Merged) 10jenkins-bot: Migrate Jenkins email template to puppet [integration/jenkins] - 10https://gerrit.wikimedia.org/r/319873 (https://phabricator.wikimedia.org/T149996) (owner: 10Hashar) [15:50:03] RECOVERY - puppet last run on contint1001 is OK: OK: Puppet is currently enabled, last run 54 seconds ago with 0 failures [15:50:34] (03PS1) 10BryanDavis: stewardbots: make tox-jessie voting [integration/config] - 10https://gerrit.wikimedia.org/r/319882 [15:53:21] zeljkof: should be fixed [15:54:23] 10Continuous-Integration-Infrastructure, 13Patch-For-Review: selenium-CirrusSearch: Groovy Template file [wikimedia.template] was not found in $JENKINS_HOME/email-templates. - https://phabricator.wikimedia.org/T149996#2772032 (10hashar) 05Open>03Resolved Should be fixed now ! contint1001:~$ ls -l /var/lib... [15:56:42] hashar: great! [15:56:49] in other news [15:56:59] I have deleted 4 instances from the 'integration' labs project :D [16:01:55] (03CR) 10Hashar: [C: 032] stewardbots: make tox-jessie voting [integration/config] - 10https://gerrit.wikimedia.org/r/319882 (owner: 10BryanDavis) [16:02:31] (03Merged) 10jenkins-bot: stewardbots: make tox-jessie voting [integration/config] - 10https://gerrit.wikimedia.org/r/319882 (owner: 10BryanDavis) [16:02:41] ^^ i fixed grrrit-wm to properly report the commit message name when c+2 https://gerrit.wikimedia.org/r/#/c/319883/ [16:03:13] It will also now work correctly when you do git push origin "HEAD:refs/for/master/${VERSION}%l=Code-Review+2" [16:03:39] Instead of crashing it will split the reporting part into two parts, patch uploaded and then reports c+2 [16:03:43] which stops it crashing [16:03:58] https://gerrit.wikimedia.org/r/#/c/319883/ and https://gerrit.wikimedia.org/r/#/c/319883/ [16:04:06] thcipriani twentyafterfour ^^ [16:37:11] 06Release-Engineering-Team, 13Patch-For-Review, 05WMF-deploy-2016-11-01_(1.29.0-wmf.1): Remove .gitreview from MediaWiki and Extensions - https://phabricator.wikimedia.org/T146293#2772103 (10thcipriani) >>! In T146293#2770908, @Jonas wrote: >>What is the value of `git remote get-url gerrit` inside the cognat... [16:37:42] 10Gerrit, 06Labs, 10wikitech.wikimedia.org, 07LDAP: Alter full name on Gerrit - https://phabricator.wikimedia.org/T149976#2772105 (10Krenair) assuming this require some serious messing with LDAP and various other misc systems, probably also wikitech [16:45:43] 10Gerrit, 06Labs, 10wikitech.wikimedia.org, 07LDAP: Alter full name on Gerrit - https://phabricator.wikimedia.org/T149976#2772138 (10demon) a:03demon That would be [[ https://wikitech.wikimedia.org/wiki/Renaming_users | these steps ]]. I'll get to it shortly (hopefully today). [16:52:57] 06Release-Engineering-Team, 13Patch-For-Review, 05WMF-deploy-2016-11-01_(1.29.0-wmf.1): Remove .gitreview from MediaWiki and Extensions - https://phabricator.wikimedia.org/T146293#2772149 (10hashar) Also paste the output of `git remote -v` AND `git-review -n --verbose` that will show the underlying commands... [16:55:27] (03PS1) 10Florianschmidtwelzow: Clone MobileFrontend for CookieWarning tests [integration/config] - 10https://gerrit.wikimedia.org/r/319891 [17:06:33] 10Gerrit, 06Repository-Admins, 13Patch-For-Review, 05WMF-deploy-2016-11-01_(1.29.0-wmf.1): Rename the Semantic Forms extension to "Page Forms" - https://phabricator.wikimedia.org/T147582#2772174 (10Yaron_Koren) I see one remaining issue with the move - the top link here: https://phabricator.wikimedia.org/... [17:21:21] 10Continuous-Integration-Infrastructure, 10Monitoring: Alert when Zuul/Gearman queue is stalled - https://phabricator.wikimedia.org/T70113#2772275 (10greg) @hashar / @thcipriani: All the blockers are closed, do we have the needed data to alert on now? [17:49:55] PROBLEM - Puppet run on deployment-pdfrender is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [17:53:19] 10Continuous-Integration-Infrastructure, 10Monitoring: Alert when Zuul/Gearman queue is stalled - https://phabricator.wikimedia.org/T70113#2772415 (10hashar) 05stalled>03Open An alarm against `sumSeries(zuul.pipeline.*.resident_time.median)` might work, though the metric is reported once the change is unbl... [17:54:51] (03CR) 10Hashar: [C: 032] Clone MobileFrontend for CookieWarning tests [integration/config] - 10https://gerrit.wikimedia.org/r/319891 (owner: 10Florianschmidtwelzow) [17:55:33] (03Merged) 10jenkins-bot: Clone MobileFrontend for CookieWarning tests [integration/config] - 10https://gerrit.wikimedia.org/r/319891 (owner: 10Florianschmidtwelzow) [18:24:21] PROBLEM - Host integration-puppetmaster is DOWN: CRITICAL - Host Unreachable (10.68.16.42) [18:39:22] grrrit-wm: force-restart [18:40:06] yay it worked [18:40:08] mutante ^^ [18:48:50] grrrit-wm: restart [18:48:50] re-connecting to gerrit [18:48:51] reconnected to gerrit [18:48:53] re-connecting to gerrit [18:48:53] reconnected to gerrit [18:51:22] paladox: nice, so let me clarify [18:51:42] ok [18:51:48] force-restart = reconnect to IRC restart = reconnect to Gerrit [18:51:53] yep [18:51:56] it does both [18:52:05] restart = just reconnect to gerrit [18:52:24] and normally we will not need force-restart but maybe we want it during netsplits or something [18:52:27] nice, thanks paladox [18:52:34] Your weclome [18:52:35] :) [18:52:56] yep [20:14:45] thanks hasharAway for merging the MobileFrontend/CookieWarning change in Jenkins config :P [20:19:21] grrrit-wm: nick [20:19:36] grrrit-wm: force-restart [20:19:38] re-connecting to irc and gerrit [20:28:32] FlorianSW: you are welcome :) [20:29:10] hashar the bot now restarts automatically for ssh [20:29:21] but just in case there are commands to restart it :) [20:35:22] paladox: ah good [20:35:34] Yep [20:37:50] hashar also the bot should crash less since twentyafterfour fixed it last night, crash was unrelated to any of my changes and has been like that for a while until yesturday :) [20:38:07] should no longer crash on when you upload the patch to upgrade the wiki's to a new mw version [20:38:08] :) [20:48:47] PROBLEM - Puppet run on deployment-fluorine02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [21:35:13] (03PS1) 10Niedzielski: Android: version CI scripts in app repo [integration/config] - 10https://gerrit.wikimedia.org/r/319925 [21:42:53] (03CR) 10Niedzielski: [C: 032 V: 032] "deployed and tested" [integration/config] - 10https://gerrit.wikimedia.org/r/319925 (owner: 10Niedzielski) [21:43:42] (03Merged) 10jenkins-bot: Android: version CI scripts in app repo [integration/config] - 10https://gerrit.wikimedia.org/r/319925 (owner: 10Niedzielski) [21:51:13] Hmm, did we break something in Gerrit, or did something break in git-review? [21:51:20] git review -d with an https remote no longer works [21:51:28] $ git remote -v [21:51:28] origin https://gerrit.wikimedia.org/r/p/mediawiki/extensions/PageImages.git (fetch) [21:51:28] origin https://gerrit.wikimedia.org/r/p/mediawiki/extensions/PageImages.git (push) [21:51:46] Sorry lemme pastebin that [21:51:50] https://www.irccloud.com/pastebin/XH6pabVk/ [21:52:57] RoanKattouw: probably fallout from https://phabricator.wikimedia.org/T146293 [21:54:32] Oh I see, https://phabricator.wikimedia.org/T146293#2768233 [21:58:26] 06Release-Engineering-Team, 13Patch-For-Review, 05WMF-deploy-2016-11-01_(1.29.0-wmf.1): Remove .gitreview from MediaWiki and Extensions - https://phabricator.wikimedia.org/T146293#2740759 (10Catrope) `git review -d` is broken for me too, but only for https remotes. If I manually rewrite the remote to be ssh,... [22:39:32] (03PS1) 10Hashar: Revert "[mediawiki/extensions] Add noop jenkins test" [integration/config] - 10https://gerrit.wikimedia.org/r/319960 [22:39:42] (03CR) 10jenkins-bot: [V: 04-1] Revert "[mediawiki/extensions] Add noop jenkins test" [integration/config] - 10https://gerrit.wikimedia.org/r/319960 (owner: 10Hashar) [22:40:45] (03PS2) 10Hashar: Revert "[mediawiki/extensions] Add noop jenkins test" [integration/config] - 10https://gerrit.wikimedia.org/r/319960 [22:41:33] (03CR) 10jenkins-bot: [V: 04-1] Revert "[mediawiki/extensions] Add noop jenkins test" [integration/config] - 10https://gerrit.wikimedia.org/r/319960 (owner: 10Hashar) [22:42:32] hashar_ should we migrate mwext-testextension-* in one patch or mutiples? [22:42:35] to nodepol [22:42:37] nodepool [22:42:38] ? [22:42:45] paladox: dont bother [22:42:48] Oh [22:43:00] there is no capacity to run them now [22:43:03] Oh [22:43:08] and I am pretty sure there are patches somewhere :] [22:43:17] anyway that is not the difficult part [22:43:22] Oh [22:43:49] the not so fun part is to trigger the jobs on each repos that are using them [22:43:58] and make sure they are all fine on the new instances [22:44:28] (03PS1) 10Niedzielski: Android: fix emulator booting [integration/config] - 10https://gerrit.wikimedia.org/r/319961 [22:44:29] Oh [22:44:35] yeh that could take some time [22:45:57] (03CR) 10jenkins-bot: [V: 04-1] Android: fix emulator booting [integration/config] - 10https://gerrit.wikimedia.org/r/319961 (owner: 10Niedzielski) [22:47:20] (03PS3) 10Hashar: Revert "[mediawiki/extensions] Add noop jenkins test" [integration/config] - 10https://gerrit.wikimedia.org/r/319960 [22:47:22] (03PS1) 10Hashar: Remove unused Wikibase repositories [integration/config] - 10https://gerrit.wikimedia.org/r/319962 [22:48:26] (03CR) 10Niedzielski: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/319961 (owner: 10Niedzielski) [22:50:44] (03PS2) 10Hashar: Remove unused Wikibase repositories [integration/config] - 10https://gerrit.wikimedia.org/r/319962 [22:50:57] (03PS4) 10Hashar: Revert "[mediawiki/extensions] Add noop jenkins test" [integration/config] - 10https://gerrit.wikimedia.org/r/319960 [22:51:46] (03CR) 10Hashar: [C: 032] Remove unused Wikibase repositories [integration/config] - 10https://gerrit.wikimedia.org/r/319962 (owner: 10Hashar) [22:52:15] (03CR) 10Hashar: [C: 032] Revert "[mediawiki/extensions] Add noop jenkins test" [integration/config] - 10https://gerrit.wikimedia.org/r/319960 (owner: 10Hashar) [22:52:21] (03Merged) 10jenkins-bot: Remove unused Wikibase repositories [integration/config] - 10https://gerrit.wikimedia.org/r/319962 (owner: 10Hashar) [22:52:37] (03CR) 10Hashar: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/319961 (owner: 10Niedzielski) [22:52:49] (03Merged) 10jenkins-bot: Revert "[mediawiki/extensions] Add noop jenkins test" [integration/config] - 10https://gerrit.wikimedia.org/r/319960 (owner: 10Hashar) [22:52:50] niedzielski: one of the job depend on the state of repos in gerrit :/ [22:53:05] fixed by https://gerrit.wikimedia.org/r/319962 [22:53:20] (03CR) 10Niedzielski: "This is deployed. There's some ongoing changes in the releng channel for Wikibase stuff that I think are conflicting. I'll try again later" [integration/config] - 10https://gerrit.wikimedia.org/r/319961 (owner: 10Niedzielski) [22:54:23] (03CR) 10Hashar: [C: 031] "One job relies on a list of repo from Gerrit, whenever a repository is deleted the job fails indicating some cleanup has to be done in zuu" [integration/config] - 10https://gerrit.wikimedia.org/r/319961 (owner: 10Niedzielski) [22:54:49] hashar_: ah, thanks for the fast fix. hopefully nothing i contributed to negatively [22:55:11] nothing :] [22:55:38] maybe I will try to get the jobs to magically update after a change is merged [22:58:16] hashar_: hm, alternatively maybe there could be a gating job that would fail before the change would merge? ah, i don't really know anything about it :] [22:58:53] (03PS2) 10Niedzielski: Android: fix emulator booting [integration/config] - 10https://gerrit.wikimedia.org/r/319961 [23:01:48] (03CR) 10Niedzielski: [C: 032 V: 032] Android: fix emulator booting [integration/config] - 10https://gerrit.wikimedia.org/r/319961 (owner: 10Niedzielski) [23:02:38] (03Merged) 10jenkins-bot: Android: fix emulator booting [integration/config] - 10https://gerrit.wikimedia.org/r/319961 (owner: 10Niedzielski) [23:05:21] niedzielski: there is a test job that grab the list of repositories from Gerrit and compare it with the list of repos in Zuul [23:05:30] if a repo is not in Gerrit but is defined in Zuul, the job fails [23:05:47] so if one delete a repo... any change made to integration/config will magically fail [23:13:21] sleep sleep