[00:33:32] PROBLEM - Puppet errors on deployment-memc05 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [00:42:12] !log legoktm@contint1001:/srv/zuul/git/mediawiki/libs$ sudo -u zuul rm -rf XMPReader [00:42:16] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [01:08:31] RECOVERY - Puppet errors on deployment-memc05 is OK: OK: Less than 1.00% above the threshold [0.0] [05:37:49] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [05:45:58] (03PS1) 10Legoktm: Add sniff to find and replace deprecated constants [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/375723 [05:47:49] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [10.0] [06:30:43] 10MediaWiki-Codesniffer: Check @covers against autoloader with codesniffer - https://phabricator.wikimedia.org/T171899#3576426 (10Legoktm) We could add https://github.com/oradwell/covers-validator/tree/0.5 to our CI process? [07:32:02] (03Abandoned) 10Hashar: dib: allow tmpfs [integration/config] - 10https://gerrit.wikimedia.org/r/375054 (owner: 10Hashar) [07:32:36] (03CR) 10Hashar: [C: 032] Use composer unit tests for some extensions [integration/config] - 10https://gerrit.wikimedia.org/r/375527 (owner: 10Umherirrender) [07:33:39] (03Merged) 10jenkins-bot: Use composer unit tests for some extensions [integration/config] - 10https://gerrit.wikimedia.org/r/375527 (owner: 10Umherirrender) [08:39:04] (03PS1) 10Addshore: Create experimental mwext-php70-phan-jessie-docker job [integration/config] - 10https://gerrit.wikimedia.org/r/375751 [08:39:59] (03PS2) 10Addshore: Create experimental mwext-php70-phan-jessie-docker job [integration/config] - 10https://gerrit.wikimedia.org/r/375751 [08:40:26] * addshore doesnt believe that hasharAway is actually away [08:40:27] 10Deployment-Systems, 10Scap, 10Patch-For-Review: Update Debian Package for Scap3 - https://phabricator.wikimedia.org/T127762#3576518 (10fgiunchedi) 05Open>03Resolved @thcipriani all done! [08:42:58] addshore: indeed :) [08:43:07] I have forgot to unaway! [08:43:12] :D [08:43:25] What are your thoughts on me trying to deploy mwext-php70-phan-jessie-docker then? as an experimental job? :) [08:43:47] lets do it ? :D [08:43:55] :D [08:43:55] I think our docker hosts point to Dockerhub.io [08:44:22] * addshore doesnt know thcipriani did the publishing of the images [08:44:24] *image [08:45:00] addshore: https://hub.docker.com/u/wmfreleng/ [08:45:18] yup yup [08:45:20] * addshore updates his jjb [08:45:46] so in theory it should just work [08:46:32] :D [08:47:44] well, jjb still works after your upgrade the other day [08:48:04] so, I'll merge, then I have to do JJB config update, then update the zuul config? [08:49:21] although, I guess I can do the JJB before I even merge it [08:49:28] (03CR) 10Hashar: "Not anymore. And I have to rebase the operations/puppet patch https://gerrit.wikimedia.org/r/#/c/331856/ which would generate the JUnit fi" [integration/config] - 10https://gerrit.wikimedia.org/r/331861 (https://phabricator.wikimedia.org/T78342) (owner: 10Hashar) [08:50:03] addshore: I usually do the jjb update first [08:50:14] but most of the time the order does not matter [08:50:17] bonus [08:50:23] err [08:50:25] Do you bother !loging these things? [08:50:29] nop [08:50:42] ack [08:50:47] I deploy the Zuul change right after it got merged [08:50:56] https://integration.wikimedia.org/ci/view/Extensions/job/mwext-php70-phan-jessie-docker/ :) [08:51:03] (03CR) 10Addshore: [C: 032] Create experimental mwext-php70-phan-jessie-docker job [integration/config] - 10https://gerrit.wikimedia.org/r/375751 (owner: 10Addshore) [08:51:04] though if I ever end up doing a huge change, I might use !log :] [08:52:10] (03Merged) 10jenkins-bot: Create experimental mwext-php70-phan-jessie-docker job [integration/config] - 10https://gerrit.wikimedia.org/r/375751 (owner: 10Addshore) [08:52:47] right how do i reload zuul config? [08:52:48] :D [08:52:50] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [08:52:55] hehe [08:53:07] kunal added a fabric file at the root of integration/config [08:53:12] https://www.mediawiki.org/wiki/Continuous_integration/Zuul#Deploy_configuration !!!! [08:53:25] pip install --user Fabric [08:53:31] ~/local/bin/fab zuul_deploy [08:53:35] oooooh [08:53:40] which would ssh to contint1001 and run the magic commands for yah [08:53:42] okay, give me 2 secs, and lets see how that goes [08:54:03] the details are in fabfile.py [08:54:09] and eventually I guess we would migrate that to scap [08:56:27] mhhhm, stupid fab [09:02:12] well, fab didnt install, so I guess I will just ssh in for now... [09:02:23] :( [09:02:44] maybe you can install fab using your OS package manager [09:03:04] debian has it as "fabric" [09:05:26] ImportError: cannot import name 'isMappingType' [09:05:39] so, fab is now installed, but not working [09:05:58] eek [09:06:11] maybe python2 vs python3. I have no clue :D [09:06:22] BAH, yeh, its python2 >.> [09:06:38] fuckit :P [09:09:45] 10Gerrit, 10Cleanup, 10utfnormal: Archive php-normal which is unused - https://phabricator.wikimedia.org/T174583#3576613 (10Aklapper) [09:32:48] 10Beta-Cluster-Infrastructure, 10Analytics: deployment-kafka01 - disk is full - https://phabricator.wikimedia.org/T174742#3576622 (10elukey) I would set log_retention_bytes via puppet (maximum size of the topic partitions) to limit the size of /var/spool/kafka. [09:48:18] (03PS1) 10Hashar: dockerfiles: export LOG_DIR [integration/config] - 10https://gerrit.wikimedia.org/r/375760 [09:49:55] (03CR) 10Hashar: "That is for https://gerrit.wikimedia.org/r/331856 "Jenkins integration of rspec"" [integration/config] - 10https://gerrit.wikimedia.org/r/375760 (owner: 10Hashar) [09:51:53] fuck this shit, wmwhrekjqnhlk\jfa [09:55:15] 10Beta-Cluster-Infrastructure, 10Analytics: deployment-kafka01 - disk is full - https://phabricator.wikimedia.org/T174742#3576663 (10elukey) ``` du -hsc /var/spool/kafka [..] 47M webrequest_text-1 47M webrequest_text-10 47M webrequest_text-12 47M webrequest_text-13 47M webrequest_text-14 47M webrequest_text-... [10:01:46] 10Beta-Cluster-Infrastructure, 10Analytics: deployment-kafka01 - disk is full - https://phabricator.wikimedia.org/T174742#3576670 (10elukey) Added a puppet prefix `deployment-kafka` in Horizon and added `confluent::kafka::broker::log_retention_bytes: 200000000`, let's see how it goes when applied. [10:03:08] !log Reloading Zuul to deploy mwext-php70-phan-jessie-docker experimental job [10:03:10] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:03:21] hashar: woo! [10:03:33] I ended up writing a docker command I can use to run fab :D [10:03:51] turns out using an SSH key from windows in a docker image is actually rather annoying.... [10:04:36] as you can't chmod the files in the volumes, so the key is accesible by all users in the container and thus ssh refuses to use it... [10:05:41] something like this..... [10:05:50] https://www.irccloud.com/pastebin/BfD2KghY/ [10:17:59] (03PS1) 10Addshore: Bind EXT_DEPENDENCIES in mwext-php70-phan-jessie-docker [integration/config] - 10https://gerrit.wikimedia.org/r/375764 [10:18:16] (03CR) 10Addshore: [C: 032] "Already deployed:" [integration/config] - 10https://gerrit.wikimedia.org/r/375764 (owner: 10Addshore) [10:18:25] hashar: https://integration.wikimedia.org/ci/job/mwext-php70-phan-jessie-docker/2/console :) [10:19:23] (03Merged) 10jenkins-bot: Bind EXT_DEPENDENCIES in mwext-php70-phan-jessie-docker [integration/config] - 10https://gerrit.wikimedia.org/r/375764 (owner: 10Addshore) [10:19:39] 26 seconds for the docker one, 70 seconds for the regular one [10:19:54] its still not perfect / right yet though [10:20:12] (03PS1) 10MarcoAurelio: Whitelist Dvorapa on Zuul CI [integration/config] - 10https://gerrit.wikimedia.org/r/375765 [10:21:02] (03PS2) 10MarcoAurelio: Whitelist Dvorapa on Zuul CI [integration/config] - 10https://gerrit.wikimedia.org/r/375765 [10:21:54] (03CR) 10Addshore: "So, this is now deployed (with whatever version is build on docker hub)" [integration/config] - 10https://gerrit.wikimedia.org/r/371708 (owner: 10Addshore) [10:30:05] hashar: do you have the details to push things to https://hub.docker.com/r/wmfreleng ? [10:31:50] (03PS1) 10Hashar: dib: add php5.5 packages to jessie [integration/config] - 10https://gerrit.wikimedia.org/r/375767 (https://phabricator.wikimedia.org/T161882) [10:32:01] addshore: nop :( [10:33:06] oh [10:33:10] there is a secret repo :] [10:39:50] 10Beta-Cluster-Infrastructure: deployment-imagescaler0[12] puppet broken due to missing nginx lua support - https://phabricator.wikimedia.org/T174746#3576815 (10Gilles) I think the issue is simply that beta hasn't been configured to use the "extras" variant of nginx, like we did for prod: https://gerrit.wikimedi... [10:40:10] 10Beta-Cluster-Infrastructure, 10Performance-Team, 10Thumbor: deployment-imagescaler0[12] puppet broken due to missing nginx lua support - https://phabricator.wikimedia.org/T174746#3576816 (10Gilles) p:05Triage>03High a:03Gilles [10:46:03] RECOVERY - Free space - all mounts on deployment-kafka01 is OK: OK: All targets OK [10:46:30] addshore: and I think I forgot my gpg password [10:46:43] 10Release-Engineering-Team, 10Wikidata, 10Epic, 10User-Addshore: [Epic] Kill the Wikidata build step - https://phabricator.wikimedia.org/T173818#3576864 (10daniel) p:05Triage>03High Triaging as "high" to reflect the outcome of the post-mortem with @VColeman, @demon and @greg re :D [10:48:23] it was surely a bad idea to generate one just before vacations [10:54:27] addshore: so in short. To get access to the Docker credentials, I need gpg [10:54:34] and I forgot the gpg passkey [10:54:36] ack [10:54:40] so gotta hmm ... wait :D [10:55:07] I'm pretty sure it is "ILoveTomatossssss" [10:55:32] yeah I tried that one [10:55:33] fails [10:55:34] :] [11:07:37] 10Beta-Cluster-Infrastructure, 10Analytics: deployment-kafka01 - disk is full - https://phabricator.wikimedia.org/T174742#3576977 (10elukey) Another interesting thing is that the following keeps getting logged: ``` [2017-09-04 11:06:03,425] ERROR Processor got uncaught exception. (kafka.network.Processor) jav... [11:23:43] 10Beta-Cluster-Infrastructure, 10Multimedia, 10Thumbor, 10Patch-For-Review: On beta commons, thumbnailing of 3D files is broken still - https://phabricator.wikimedia.org/T170444#3576993 (10Gilles) I'm happy to report that it works now: https://commons.wikimedia.beta.wmflabs.org/wiki/File:Crystal-NEW.stl B... [11:37:47] !log nodepool: refreshing jessie snapshot [11:37:51] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [11:38:29] 10Beta-Cluster-Infrastructure, 10Analytics: deployment-kafka01 - disk is full - https://phabricator.wikimedia.org/T174742#3577006 (10elukey) The responsible is deployment-eventlog02.deployment-prep.eqiad.wmflabs, I stopped/started eventlogging on it (via eventlogctl) and I saw the error msg stopped/started acc... [11:38:42] (03CR) 10Hashar: [C: 032] dib: add php5.5 packages to jessie [integration/config] - 10https://gerrit.wikimedia.org/r/375767 (https://phabricator.wikimedia.org/T161882) (owner: 10Hashar) [11:38:44] 10Beta-Cluster-Infrastructure, 10Performance-Team, 10Thumbor, 10Patch-For-Review: deployment-imagescaler0[12] puppet broken due to missing nginx lua support - https://phabricator.wikimedia.org/T174746#3577019 (10Gilles) Tried to set nginx::extras in https://horizon.wikimedia.org/project/prefixpuppet/?tab=p... [11:39:40] (03Merged) 10jenkins-bot: dib: add php5.5 packages to jessie [integration/config] - 10https://gerrit.wikimedia.org/r/375767 (https://phabricator.wikimedia.org/T161882) (owner: 10Hashar) [11:40:05] 10Beta-Cluster-Infrastructure, 10Performance-Team, 10Thumbor, 10Patch-For-Review: deployment-imagescaler0[12] puppet broken due to missing nginx lua support - https://phabricator.wikimedia.org/T174746#3577021 (10Gilles) Ah, my bad, I had written it as an array. [11:40:33] PROBLEM - Puppet errors on deployment-imagescaler02 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [11:47:17] (03PS1) 10Hashar: dib: fix puppet typo packages -> package [integration/config] - 10https://gerrit.wikimedia.org/r/375778 [11:47:20] 10Beta-Cluster-Infrastructure, 10Performance-Team, 10Thumbor, 10Patch-For-Review: deployment-imagescaler0[12] puppet broken due to missing nginx lua support - https://phabricator.wikimedia.org/T174746#3577077 (10Gilles) 05Open>03Resolved [11:47:25] (03CR) 10jerkins-bot: [V: 04-1] dib: fix puppet typo packages -> package [integration/config] - 10https://gerrit.wikimedia.org/r/375778 (owner: 10Hashar) [11:47:37] (03PS2) 10Hashar: dib: fix puppet typo packages -> package [integration/config] - 10https://gerrit.wikimedia.org/r/375778 [11:50:30] RECOVERY - Puppet errors on deployment-imagescaler02 is OK: OK: Less than 1.00% above the threshold [0.0] [11:51:52] 10Release-Engineering-Team, 10Wikidata: Decide what to do with Wikibase JS-only libraries regarding the build/deployment of Wikidata code - https://phabricator.wikimedia.org/T174922#3577093 (10WMDE-leszek) [11:52:51] (03PS1) 10Hashar: dib: set puppet dependency [integration/config] - 10https://gerrit.wikimedia.org/r/375780 [12:10:29] pff [12:10:34] I am tired of puppet somehow [12:11:43] (03PS1) 10Hashar: dib: require apt-get update [integration/config] - 10https://gerrit.wikimedia.org/r/375787 [12:12:09] (03PS2) 10Hashar: dib: require apt-get update [integration/config] - 10https://gerrit.wikimedia.org/r/375787 [12:21:36] !log Image snapshot-ci-jessie-1504527142 in wmflabs-eqiad is ready [12:21:40] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [12:22:15] 10Release-Engineering-Team, 10Page-Previews, 10Performance-Team, 10Readers-Web-Backlog, and 4 others: Provide a reliable test environment that mimics production for running integration tests - https://phabricator.wikimedia.org/T174786#3577250 (10zeljkofilipin) [12:22:40] Project selenium-GettingStarted » firefox,beta,Linux,BrowserTests build #515: 04FAILURE in 40 sec: https://integration.wikimedia.org/ci/job/selenium-GettingStarted/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/515/ [12:28:43] 10Release-Engineering-Team, 10Wikidata, 10Epic, 10User-Addshore: [Epic] Kill the Wikidata build step - https://phabricator.wikimedia.org/T173818#3577264 (10WMDE-leszek) [12:29:18] 10Release-Engineering-Team, 10Wikidata: Decide what to do with Wikibase JS-only libraries regarding the build/deployment of Wikidata code - https://phabricator.wikimedia.org/T174922#3577093 (10WMDE-leszek) p:05High>03Normal [12:34:53] 10Release-Engineering-Team, 10Wikidata: Decide what to do with Wikibase JS-only libraries regarding the build/deployment of Wikidata code - https://phabricator.wikimedia.org/T174922#3577290 (10daniel) [13:14:06] (03PS1) 10Hashar: Create some php5.5 jobs on Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/375794 (https://phabricator.wikimedia.org/T161882) [13:19:19] (03CR) 10Hashar: [C: 032] Create some php5.5 jobs on Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/375794 (https://phabricator.wikimedia.org/T161882) (owner: 10Hashar) [13:20:20] (03CR) 10jerkins-bot: [V: 04-1] Create some php5.5 jobs on Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/375794 (https://phabricator.wikimedia.org/T161882) (owner: 10Hashar) [13:20:33] (03CR) 10Hashar: [C: 032] Create some php5.5 jobs on Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/375794 (https://phabricator.wikimedia.org/T161882) (owner: 10Hashar) [13:21:42] (03CR) 10jerkins-bot: [V: 04-1] Create some php5.5 jobs on Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/375794 (https://phabricator.wikimedia.org/T161882) (owner: 10Hashar) [13:22:43] (03CR) 10Hashar: [C: 032] Create some php5.5 jobs on Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/375794 (https://phabricator.wikimedia.org/T161882) (owner: 10Hashar) [13:23:49] (03Merged) 10jenkins-bot: Create some php5.5 jobs on Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/375794 (https://phabricator.wikimedia.org/T161882) (owner: 10Hashar) [13:24:33] (03CR) 10Addshore: Create some php5.5 jobs on Jessie (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/375794 (https://phabricator.wikimedia.org/T161882) (owner: 10Hashar) [13:25:41] (03CR) 10Hashar: Create some php5.5 jobs on Jessie (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/375794 (https://phabricator.wikimedia.org/T161882) (owner: 10Hashar) [13:34:56] (03PS1) 10Hashar: On Jessie use PHP_BIN=php5.5 [integration/config] - 10https://gerrit.wikimedia.org/r/375803 (https://phabricator.wikimedia.org/T161882) [13:46:18] Project selenium-VisualEditor » firefox,beta,Linux,BrowserTests build #512: 04FAILURE in 2 min 16 sec: https://integration.wikimedia.org/ci/job/selenium-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/512/ [13:48:57] will polish the rest tonight [14:01:18] (03CR) 10Thiemo Mättig (WMDE): "Looks good so far, but I'm afraid the test cases are insufficient." (034 comments) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/375547 (https://phabricator.wikimedia.org/T167694) (owner: 10Legoktm) [14:16:45] thcipriani: Had a chance to review the 2 docker patches I have up (not the phan one)? :) [14:16:48] *look at [14:33:35] Project selenium-WikiLove » firefox,beta,Linux,BrowserTests build #506: 04FAILURE in 1 min 35 sec: https://integration.wikimedia.org/ci/job/selenium-WikiLove/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/506/ [15:50:19] (03PS1) 10Zfilipin: Run mwext-ruby-jessie template for Echo [integration/config] - 10https://gerrit.wikimedia.org/r/375824 (https://phabricator.wikimedia.org/T164479) [15:55:58] (03CR) 10Zfilipin: [C: 032] Run mwext-ruby-jessie template for Echo [integration/config] - 10https://gerrit.wikimedia.org/r/375824 (https://phabricator.wikimedia.org/T164479) (owner: 10Zfilipin) [15:56:54] (03Merged) 10jenkins-bot: Run mwext-ruby-jessie template for Echo [integration/config] - 10https://gerrit.wikimedia.org/r/375824 (https://phabricator.wikimedia.org/T164479) (owner: 10Zfilipin) [15:59:35] !log Reloading Zuul to deploy ca1c6ec05122e6f50a5a52fecbbd2bd8e882ad87 [15:59:39] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:09:46] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 10Operations, 10Patch-For-Review, 10Zuul: Zuul has started failing on some repo's in gerrit.wikimedia.org - https://phabricator.wikimedia.org/T153877#2893745 (10Addshore) Just ran into this again while trying to do "apt-get install... [16:37:30] 10MediaWiki-Codesniffer: Adopt semver for MediaWiki-CodeSniffer future releases - https://phabricator.wikimedia.org/T174963#3578108 (10Legoktm) [16:47:06] (03CR) 10Legoktm: "Thanks for the review, I'll work on improving the test cases. It's a little disappointing to see that you were also working on this and th" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/375547 (https://phabricator.wikimedia.org/T167694) (owner: 10Legoktm) [17:04:22] (03PS1) 10Addshore: DNM WIP idea contint-zuul-cloner [integration/config] - 10https://gerrit.wikimedia.org/r/375834 [17:04:37] (03CR) 10Krinkle: [C: 04-1] Make zuul semver compatible with pbr 1.10.0 (031 comment) [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/328554 (https://phabricator.wikimedia.org/T153877) (owner: 10Paladox) [17:04:44] thcipriani: also that as an idea ^^ [17:05:07] (03CR) 10Krinkle: [C: 04-1] "This commit doesn't seem to be making any changes besides the changelog?" [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/328554 (https://phabricator.wikimedia.org/T153877) (owner: 10Paladox) [17:21:41] (03CR) 10Paladox: "> This commit doesn't seem to be making any changes besides the" [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/328554 (https://phabricator.wikimedia.org/T153877) (owner: 10Paladox) [17:31:20] (03Draft1) 10Paladox: Fix version for zuul in setup.py for pbr [integration/zuul] (upstream) - 10https://gerrit.wikimedia.org/r/375835 [17:31:22] (03PS2) 10Paladox: Fix version for zuul in setup.py for pbr [integration/zuul] (upstream) - 10https://gerrit.wikimedia.org/r/375835 [17:31:43] (03CR) 10Legoktm: Make zuul semver compatible with pbr 1.10.0 (031 comment) [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/328554 (https://phabricator.wikimedia.org/T153877) (owner: 10Paladox) [17:32:16] (03PS5) 10Paladox: Make zuul semver compatible with pbr 1.10.0 [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/328554 (https://phabricator.wikimedia.org/T153877) [17:33:08] (03Abandoned) 10Paladox: Fix version for zuul in setup.py for pbr [integration/zuul] (upstream) - 10https://gerrit.wikimedia.org/r/375835 (owner: 10Paladox) [17:33:23] (03Draft1) 10Paladox: test: do not merge [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/375836 [17:33:27] (03Draft2) 10Paladox: test: do not merge [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/375836 [17:34:25] (03CR) 10Paladox: "Hmm, fails the test." [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/328554 (https://phabricator.wikimedia.org/T153877) (owner: 10Paladox) [17:36:48] (03CR) 10Paladox: "recheck" [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/315429 (owner: 10Hashar) [17:37:33] (03PS2) 10Legoktm: Add sniff to find unused "use" statements [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/375547 (https://phabricator.wikimedia.org/T167694) [17:37:38] (03CR) 10Legoktm: Add sniff to find unused "use" statements (034 comments) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/375547 (https://phabricator.wikimedia.org/T167694) (owner: 10Legoktm) [17:44:15] (03PS6) 10Paladox: Make zuul semver compatible with pbr 1.10.0 [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/328554 (https://phabricator.wikimedia.org/T153877) [17:44:56] (03PS7) 10Paladox: Make zuul semver compatible with pbr 1.10.0 [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/328554 (https://phabricator.wikimedia.org/T153877) [17:45:24] (03CR) 10Legoktm: [C: 04-1] "I'm running this against MediaWiki core right now, found a few more cases this doesn't handle yet like @var ClassName|null." [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/375547 (https://phabricator.wikimedia.org/T167694) (owner: 10Legoktm) [17:56:14] (03PS3) 10Legoktm: Add sniff to find unused "use" statements [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/375547 (https://phabricator.wikimedia.org/T167694) [17:57:17] (03CR) 10Legoktm: "PS3: Supports multiple class names separate by pipes, and also ClassName[] for arrays." [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/375547 (https://phabricator.wikimedia.org/T167694) (owner: 10Legoktm) [17:58:35] (03PS3) 10Paladox: test: do not merge [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/375836 [18:01:28] (03PS4) 10Paladox: test: do not merge [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/375836 [18:02:05] (03PS5) 10Paladox: test: do not merge [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/375836 [18:02:33] (03PS6) 10Paladox: test: do not merge [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/375836 [18:14:17] (03PS7) 10Paladox: test: do not merge [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/375836 [18:16:17] (03PS8) 10Paladox: test: do not merge [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/375836 [18:19:05] (03PS9) 10Paladox: test: do not merge [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/375836 [18:22:48] (03PS10) 10Paladox: test: do not merge [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/375836 [18:23:01] (03CR) 10Hashar: "check experimental" [integration/docroot] - 10https://gerrit.wikimedia.org/r/374371 (https://phabricator.wikimedia.org/T174058) (owner: 10Krinkle) [18:23:29] (03CR) 10jenkins-bot: Use local copy of jQuery (instead of loading from mediawiki.org) [integration/docroot] - 10https://gerrit.wikimedia.org/r/374371 (https://phabricator.wikimedia.org/T174058) (owner: 10Krinkle) [18:26:06] (03PS1) 10Hashar: Switch some php5.5 jobs to jessie [integration/config] - 10https://gerrit.wikimedia.org/r/375838 (https://phabricator.wikimedia.org/T161882) [18:30:11] (03CR) 10jerkins-bot: [V: 04-1] Switch some php5.5 jobs to jessie [integration/config] - 10https://gerrit.wikimedia.org/r/375838 (https://phabricator.wikimedia.org/T161882) (owner: 10Hashar) [18:33:08] (03PS11) 10Paladox: test: do not merge [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/375836 [18:36:46] hasharAway hi, i am thinking we should just remove pbr from zuul. It seems to be really complicated to fix the version. Since it is getting the version from the changelog in debian, but then the tests are failing to build it. [18:37:06] It will be easier to migrate to do something like scap does https://github.com/wikimedia/scap/commit/af2aa5f99998d06f2a838143565e06deb5daa75a [18:39:35] 10Release-Engineering-Team, 10Wikidata: Decide what to do with Wikibase JS-only libraries regarding the build/deployment of Wikidata code - https://phabricator.wikimedia.org/T174922#3578222 (10demon) Option #3 seems easiest to me from my armchair. Submodules do //not// cause problems with CI or deployments--we... [18:40:44] 10Release-Engineering-Team, 10Zuul: Remove pbr from zuul - https://phabricator.wikimedia.org/T174965#3578224 (10Paladox) [18:41:59] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 10Operations, 10Patch-For-Review, 10Zuul: Zuul has started failing on some repo's in gerrit.wikimedia.org - https://phabricator.wikimedia.org/T153877#3578239 (10Paladox) @Addshore hi, i've created T162787 as it is just easier to re... [18:50:35] (03Draft1) 10Paladox: Remove pbr from zuul [integration/zuul] (upstream) - 10https://gerrit.wikimedia.org/r/375839 (https://phabricator.wikimedia.org/T162787) [18:50:37] (03PS2) 10Paladox: Remove pbr from zuul [integration/zuul] (upstream) - 10https://gerrit.wikimedia.org/r/375839 (https://phabricator.wikimedia.org/T162787) [18:51:21] paladox: the "upstream" branch is supposed to be a copy of upstream code :D [18:51:27] Oh [18:51:35] and we need it for zuul --version ! [18:51:35] hasharAway where do i do it? [18:51:47] hashar we can do what we do for scap :) [18:51:47] the integration/zuul repo is a mess right now [18:51:55] generate the version.py file [18:52:09] I am hopefully gonna phase out trusty hosts this week/next week [18:52:19] and then I guess I will recraft the package for jessie [18:52:35] though yeah scap would be nice [18:52:55] hashar i meant the version :) [18:53:02] (follow how scap does it) [18:53:05] without needing pbr [18:53:15] well that code is from upstream and relies on pbr [18:53:20] and we can keep pbr around :) [18:53:22] the code we run is in the branch patch-queue/debian/precise-wikimedia [18:53:27] ah i see [18:53:32] patch-queue :) [18:53:49] which is used by an utility named "gbp" (for git buildpackage) [18:53:55] yep [18:54:03] which then lets one exports the patchsets from that branch to debian/precise-wikimedia [18:54:13] though the patches are not in git, but in debian/patches [18:54:23] gbp takes care of refreshing the patch files and updating debian/series [18:54:33] yep [18:54:34] hmm there's not one for jessie [18:54:40] yup [18:54:50] the package for jessie is in debian/jessie-wikimedia [18:54:56] it probably has some hack [18:54:57] s [18:55:01] ah i see [18:55:10] and I merge debian/precise-wikimedia into debian/jessie-wikimedia [18:55:14] the whole thing is a mess right now [18:55:24] yep [18:55:30] i guess soon, we can remove precise [18:55:33] and trusty [18:55:40] and have jessie and then soon to be stretch :) [18:55:54] my aim is to ultimately only have upstream debian/jessie-wikimedia and a new patch-queue/debian/jessie-wikimedia [18:56:00] yeah exactly [18:56:12] :) [18:56:15] but first: lets get rid of ubuntu [18:56:36] yep [18:56:45] carn't we remove precise? [18:56:52] it's been gone since march [18:56:57] and you can skip running the tests when building the package [18:57:23] DEB_BUILD_OPTIONS=nocheck [18:57:36] DEB_BUILD_OPTIONS=nocheck [whatever command you use to build the package] [18:57:50] and you also need python-pbr installed on the build host iirc [18:58:00] yep [18:58:46] hashar http://gerrit-jenkins.wmflabs.org/job/debian-glue-non-voting/32/console that builds it for me :) [19:00:30] (03CR) 10Hashar: "check experimental" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/183013 (owner: 10Hashar) [19:01:05] (03CR) 10jenkins-bot: Jenkins job validation (DO NOT SUBMIT) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/183013 (owner: 10Hashar) [19:02:12] paladox: !!!! :) [19:02:31] :) [19:02:38] paladox: na it says it failed :( [19:02:45] it says it failed to build [19:02:48] but it built the deb [19:02:54] it says the same thing on prod [19:03:03] http://gerrit-jenkins.wmflabs.org/job/debian-glue-non-voting/32/ [19:03:06] only the tarball! [19:03:10] oh [19:03:11] i see [19:03:37] oh you got blue ocean [19:04:02] yep [19:04:15] hashar also allows me to use edcsa and hmac 256 :) [19:05:26] yeah that is also why I need to phase out ubuntu [19:05:30] so we can upgrade jenkins [19:06:06] yep [19:07:17] (03PS2) 10Hashar: Switch some php5.5 jobs to jessie [integration/config] - 10https://gerrit.wikimedia.org/r/375838 (https://phabricator.wikimedia.org/T161882) [19:07:42] Yippee, build fixed! [19:07:42] Project selenium-MinervaNeue » chrome,beta,Linux,BrowserTests build #107: 09FIXED in 18 min: https://integration.wikimedia.org/ci/job/selenium-MinervaNeue/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/107/ [19:12:27] (03CR) 10Paladox: [C: 031] ":)" [integration/config] - 10https://gerrit.wikimedia.org/r/375838 (https://phabricator.wikimedia.org/T161882) (owner: 10Hashar) [19:14:18] 10Release-Engineering-Team, 10Wikidata: Decide what to do with Wikibase JS-only libraries regarding the build/deployment of Wikidata code - https://phabricator.wikimedia.org/T174922#3578286 (10Krinkle) > > 1. Move all those libraries to Wikibase git repository > - pro: dependency problem goes away > - con:... [19:14:21] (03CR) 10Hashar: [C: 032] Switch some php5.5 jobs to jessie [integration/config] - 10https://gerrit.wikimedia.org/r/375838 (https://phabricator.wikimedia.org/T161882) (owner: 10Hashar) [19:16:11] (03Merged) 10jenkins-bot: Switch some php5.5 jobs to jessie [integration/config] - 10https://gerrit.wikimedia.org/r/375838 (https://phabricator.wikimedia.org/T161882) (owner: 10Hashar) [19:16:23] 10MediaWiki-Codesniffer, 10MediaWiki-Platform-Team: Sniff that the class name matches the file name - https://phabricator.wikimedia.org/T174244#3578289 (10Volker_E) [19:21:21] (03Restored) 10Hashar: Jenkins job validation (DO NOT SUBMIT) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/183013 (owner: 10Hashar) [19:22:51] (03PS2) 10Hashar: Jenkins job validation (DO NOT SUBMIT) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/183013 [19:23:17] (03CR) 10Hashar: "check experimental" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/183013 (owner: 10Hashar) [19:24:07] (03Abandoned) 10Hashar: Jenkins job validation (DO NOT SUBMIT) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/183013 (owner: 10Hashar) [19:38:52] (03PS1) 10Hashar: Switch composer-test-package jobs to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/375863 (https://phabricator.wikimedia.org/T161882) [19:44:50] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Performance-Team, 10Jenkins, 10Upstream: WebPageTest job fails intermittently with "java.io.IOException: Unexpected termination of the channel" - https://phabricator.wikimedia.org/T166557#3578341 (10Krinkle) 05Open>03Resol... [20:00:43] (03CR) 10Hashar: [C: 032] Switch composer-test-package jobs to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/375863 (https://phabricator.wikimedia.org/T161882) (owner: 10Hashar) [20:01:47] (03Merged) 10jenkins-bot: Switch composer-test-package jobs to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/375863 (https://phabricator.wikimedia.org/T161882) (owner: 10Hashar) [20:02:57] 10Continuous-Integration-Infrastructure (phase-out-trusty), 10Release-Engineering-Team (Kanban), 10Patch-For-Review: Migrate PHP5.5 jobs from Trusty to Jessie - https://phabricator.wikimedia.org/T161882#3578378 (10hashar) [20:03:32] hashar: mind doing a quick ci whitelist change review if you have a moment? [20:03:57] Zppix: sure [20:04:01] Ok one sec [20:04:20] hashar: https://gerrit.wikimedia.org/r/#/c/375428/3 [20:05:35] (03CR) 10Hashar: [C: 032] "Aced. Thank you everyone" [integration/config] - 10https://gerrit.wikimedia.org/r/375428 (owner: 10Zppix) [20:05:50] Ty hashar [20:06:34] (03Merged) 10jenkins-bot: add samtar to ci whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/375428 (owner: 10Zppix) [20:06:57] 10Beta-Cluster-Infrastructure, 10MediaWiki-Authentication-and-authorization, 10MediaWiki-extensions-CentralAuth, 10MW-1.30-release-notes (WMF-deploy-2017-08-08_(1.30.0-wmf.13)), 10Patch-For-Review: "Loss of session data" on Beta Cluster - https://phabricator.wikimedia.org/T172560#3502076 (10Ryasmeen) I a... [20:08:40] Zppix: done! thank you :] [20:08:49] Np [20:19:36] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Cleanup, 10utfnormal: Archive php-normal which is unused - https://phabricator.wikimedia.org/T174583#3578395 (10Krinkle) 05Open>03Resolved p:05Triage>03Normal a:03demon Thanks! [20:27:15] 10MediaWiki-Codesniffer: Provide Codesniffer rules to enforce primitive types in lowercase in documentation - https://phabricator.wikimedia.org/T172836#3578407 (10Krinkle) [20:40:01] 10Beta-Cluster-Infrastructure, 10MediaWiki-Authentication-and-authorization, 10MediaWiki-extensions-CentralAuth, 10MW-1.30-release-notes (WMF-deploy-2017-08-08_(1.30.0-wmf.13)), 10Patch-For-Review: "Loss of session data" on Beta Cluster - https://phabricator.wikimedia.org/T172560#3578450 (10Krinkle) From... [20:43:10] 10Continuous-Integration-Infrastructure (phase-out-trusty), 10Release-Engineering-Team (Kanban): Package php-redis Zend 5.5 for Jessie - https://phabricator.wikimedia.org/T174972#3578458 (10hashar) [21:35:30] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 10Operations, 10Patch-For-Review, 10Zuul: Zuul has started failing on some repo's in gerrit.wikimedia.org - https://phabricator.wikimedia.org/T153877#3578497 (10hashar) Yup you need python-pbr 0.8 until I manage to find the time to...