[00:22:03] RECOVERY - Puppet run on deployment-upload is OK: OK: Less than 1.00% above the threshold [0.0] [00:37:29] Project selenium-Flow » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #1: 09SUCCESS in 21 min: https://integration.wikimedia.org/ci/job/selenium-Flow/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/1/ [00:38:14] Project selenium-Flow » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #1: 04FAILURE in 22 min: https://integration.wikimedia.org/ci/job/selenium-Flow/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/1/ [00:46:43] 10Continuous-Integration-Config, 06Analytics-Kanban, 13Patch-For-Review: Add JJB support for Jenkins Maven Release Plugin {hawk} - https://phabricator.wikimedia.org/T132175#2268962 (10madhuvishy) https://review.openstack.org/#/c/313196/ Proposed! Thanks @hashar :) [00:55:11] 10Beta-Cluster-Infrastructure, 10Deployment-Systems, 03Scap3, 06Operations, 13Patch-For-Review: Automate the generation deployment keys (keyholder-managed ssh keys) - https://phabricator.wikimedia.org/T133211#2268982 (10mmodell) Even if @faidon isn't comfortable with running ssh_keygen on production pupp... [01:05:39] PROBLEM - Puppet run on deployment-tmh01 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [02:19:09] Project selenium-QuickSurveys » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #12: 04FAILURE in 6 min 8 sec: https://integration.wikimedia.org/ci/job/selenium-QuickSurveys/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/12/ [02:59:12] 06Release-Engineering-Team, 06Labs, 06Operations, 10wikitech.wikimedia.org: Rename specific account in LDAP, Wikitech, Gerrit and Phabricator - https://phabricator.wikimedia.org/T133968#2269087 (10lfschenone) [03:08:13] Yippee, build fixed! [03:08:14] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #1066: 09FIXED in 26 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/1066/ [04:10:06] ostriches: greg-g: Reedy: thcipriani: twentyafterfour: we need to roll back wmf.23 from Wikipedias; it introduced a substantial regression to page performance [04:10:40] see the second graph from the top here: https://performance.wikimedia.org/#!/week [04:11:03] Ok [04:11:47] I'm looking to see if there are security patches that need to be backported to wmf22 [04:12:01] https://gerrit.wikimedia.org/r/#/c/287132/ should be the revert [04:12:10] Er, reverting that, at least [04:12:24] ori: should be the diff between /srv/patches/ for those two versions, FWIW. [04:13:18] I don't know the workflow for security patches very well. How should I backport the ones that wmf.22 is missing? [04:13:47] Copy them to wmf.22 so they don't get lost, then just `git am --3way < /srv/patches.....` [04:14:14] (we use am and not apply so they'll become commits automatically) [04:14:34] https://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys#Apply_security_patches covers it [04:14:34] ^ yup. documented https://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys#Apply_security_patches [04:14:44] yeah, I just saw that, kudos. [04:14:45] (and thanks!) [04:15:38] are the two of you OK with me going ahead with this? it is a pretty substantial regression, and I don't even have a guess as to what change caused it [04:16:51] That's fine. We can roll back and reassess tomorrow [04:17:05] thanks, that sounds right to me [04:28:21] done w/patches, reverting now [04:38:04] done. I'll watch the graphs for a bit to confirm that it was indeed a change in wmf.23, and then send an e-mail to engineering [04:39:02] thanks for walking me through the security patch backport and for thinking over the revert [04:44:39] RECOVERY - Puppet run on deployment-memc03 is OK: OK: Less than 1.00% above the threshold [0.0] [04:46:41] thank you for catching the regression :) [04:48:07] (and also handling the security patches/rollback) [04:50:49] this graph shows it pretty clearly: https://graphite.wikimedia.org/render/?width=586&height=308&_salt=1462510184.572&target=timeShift(coal.firstPaint%2C%221d%22)&target=coal.firstPaint [04:51:00] blue is same time yesterday [04:54:37] yarp. spike seems to correlate well with 19:xx wikiversion sync. [05:26:39] RECOVERY - Puppet run on deployment-tmh01 is OK: OK: Less than 1.00% above the threshold [0.0] [05:46:20] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-chrome-sauce build #433: 04FAILURE in 30 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-chrome-sauce/433/ [06:31:45] 06Release-Engineering-Team, 10Phabricator: Too many choices in "Create Task" drop-down menu - https://phabricator.wikimedia.org/T134552#2269213 (10ori) [06:32:08] 06Release-Engineering-Team, 06Design-Research, 10Phabricator: Too many choices in "Create Task" drop-down menu - https://phabricator.wikimedia.org/T134552#2269226 (10ori) [06:32:35] PROBLEM - Puppet run on deployment-memc03 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [06:35:23] 06Release-Engineering-Team, 07Performance: First paint time regression on Wikimedia page views - https://phabricator.wikimedia.org/T134553#2269227 (10ori) [06:35:41] 06Release-Engineering-Team, 07Performance: First paint time regression on Wikimedia page views - https://phabricator.wikimedia.org/T134553#2269239 (10ori) p:05Triage>03High [06:44:56] 06Release-Engineering-Team, 06Design-Research, 10Phabricator: Too many choices in "Create Task" drop-down menu - https://phabricator.wikimedia.org/T134552#2269241 (10TerraCodes) This is what I see: {F3972463} [06:47:01] 06Release-Engineering-Team, 06Design-Research, 10Phabricator: Too many choices in "Create Task" drop-down menu - https://phabricator.wikimedia.org/T134552#2269242 (10ori) >>! In T134552#2269241, @TerraCodes wrote: > This is what I see: {F3972463} Still confusing. "Simple" in comparison to what? [06:47:21] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-monobook-sauce build #810: 04FAILURE in 22 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-monobook-sauce/810/ [06:50:46] 06Release-Engineering-Team, 07Performance: First paint time regression on Wikimedia page views with wmf.23 roll-out - https://phabricator.wikimedia.org/T134553#2269245 (10Legoktm) [07:11:26] 06Release-Engineering-Team, 06Design-Research, 10Phabricator: Too many choices in "Create Task" drop-down menu - https://phabricator.wikimedia.org/T134552#2269213 (10mmodell) @ori: the menu is dynamic, based on which projects you have joined. The (triage) option is because you are a member of #triagers proj... [07:17:26] 05Gerrit-Migration, 10Differential: Find way to use Differential with plain git (i.e.: without requiring arc) - https://phabricator.wikimedia.org/T127#2269262 (10Paladox) With https://phabricator.wikimedia.org/D225 it should now be supported, not fully but you can push to make a diff like git push origin HEAD... [07:21:32] 10Beta-Cluster-Infrastructure, 10Phabricator: puppet failure on deployment-phab due to missing packages php5-mailparse and python-phabricator - https://phabricator.wikimedia.org/T134277#2269264 (10mmodell) I need to fix the phabricator module in puppet so that it will work with jessie.. [07:21:42] 10Beta-Cluster-Infrastructure, 10Phabricator: puppet failure on deployment-phab due to missing packages php5-mailparse and python-phabricator - https://phabricator.wikimedia.org/T134277#2269267 (10mmodell) a:03mmodell [07:21:54] 10Beta-Cluster-Infrastructure, 10Phabricator: puppet failure on deployment-phab due to missing packages php5-mailparse and python-phabricator - https://phabricator.wikimedia.org/T134277#2260577 (10mmodell) p:05Triage>03Normal [08:06:47] 05Gerrit-Migration, 10Differential: Set up arcyd to create differential revisions with `git push` (code review without arcanist) - https://phabricator.wikimedia.org/T132863#2269313 (10Paladox) @mmodell do you know when we can start using this please. [08:49:04] 10Browser-Tests-Infrastructure, 15User-zeljkofilipin: Allow specifying required permissions for a new user - https://phabricator.wikimedia.org/T134529#2269396 (10zeljkofilipin) [09:43:03] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-monobook-sauce build #803: 04FAILURE in 22 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-monobook-sauce/803/ [10:33:51] Yippee, build fixed! [10:33:52] Project selenium-QuickSurveys » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #13: 09FIXED in 4 min 55 sec: https://integration.wikimedia.org/ci/job/selenium-QuickSurveys/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/13/ [10:34:53] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 15User-zeljkofilipin: Ownership of Selenium tests - https://phabricator.wikimedia.org/T134492#2269508 (10zeljkofilipin) [10:35:51] Project beta-scap-eqiad build #101450: 04FAILURE in 1 min 9 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/101450/ [10:38:30] (03PS1) 10Zfilipin: Stephane Bisson is owner of PageTriage and WikiLove Selenium tests [integration/config] - 10https://gerrit.wikimedia.org/r/287188 (https://phabricator.wikimedia.org/T134492) [10:41:40] Project selenium-MobileFrontend-279364 » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #14: 15ABORTED in 2.3 sec: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend-279364/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/14/ [10:41:40] Project selenium-MobileFrontend-279364 » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #14: 15ABORTED in 2.3 sec: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend-279364/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/14/ [10:46:02] Project beta-scap-eqiad build #101451: 04STILL FAILING in 1 min 13 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/101451/ [10:47:13] (03CR) 10Sbisson: [C: 031] Stephane Bisson is owner of PageTriage and WikiLove Selenium tests [integration/config] - 10https://gerrit.wikimedia.org/r/287188 (https://phabricator.wikimedia.org/T134492) (owner: 10Zfilipin) [10:49:30] (03CR) 10Zfilipin: [C: 032] Stephane Bisson is owner of PageTriage and WikiLove Selenium tests [integration/config] - 10https://gerrit.wikimedia.org/r/287188 (https://phabricator.wikimedia.org/T134492) (owner: 10Zfilipin) [10:50:14] (03CR) 10Zfilipin: "I have updated Jenkins jobs." [integration/config] - 10https://gerrit.wikimedia.org/r/287188 (https://phabricator.wikimedia.org/T134492) (owner: 10Zfilipin) [10:50:28] (03Merged) 10jenkins-bot: Stephane Bisson is owner of PageTriage and WikiLove Selenium tests [integration/config] - 10https://gerrit.wikimedia.org/r/287188 (https://phabricator.wikimedia.org/T134492) (owner: 10Zfilipin) [10:50:43] RECOVERY - Puppet run on deployment-memc03 is OK: OK: Less than 1.00% above the threshold [0.0] [10:55:54] Project beta-scap-eqiad build #101452: 04STILL FAILING in 1 min 11 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/101452/ [11:05:56] Yippee, build fixed! [11:05:56] Project beta-scap-eqiad build #101453: 09FIXED in 1 min 14 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/101453/ [11:16:34] (03PS1) 10Zfilipin: Jon Robson is owner of MobileFrontend, MultimediaViewer, QuickSurveys and RelatedArticles Selenium tests [integration/config] - 10https://gerrit.wikimedia.org/r/287195 (https://phabricator.wikimedia.org/T134492) [11:18:32] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 15User-zeljkofilipin: Ownership of Selenium tests - https://phabricator.wikimedia.org/T134492#2269569 (10zeljkofilipin) [11:20:07] Project selenium-MultimediaViewer » firefox,mediawiki,Linux,contintLabsSlave && UbuntuTrusty build #1: 09SUCCESS in 2 min 14 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/1/ [11:22:06] (03PS2) 10Zfilipin: MobileFrontend and MultimediaViewer are moved from browsertests* to selenium* jobs. [integration/config] - 10https://gerrit.wikimedia.org/r/287195 (https://phabricator.wikimedia.org/T128190) [11:23:05] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 15User-zeljkofilipin, 05WMF-deploy-2016-05-01_(1.27.0-wmf.23): Migration of browsertests* Jenkins jobs to selenium* jobs - https://phabricator.wikimedia.org/T128190#2269575 (10zeljkofilipin) [11:28:16] Project selenium-MultimediaViewer » safari,beta,OS X 10.9,contintLabsSlave && UbuntuTrusty build #1: 09SUCCESS in 10 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,label=contintLabsSlave%20&&%20UbuntuTrusty/1/ [11:35:33] Project selenium-MobileFrontend » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #1: 09SUCCESS in 17 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/1/ [11:40:12] Project selenium-MultimediaViewer » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #1: 09SUCCESS in 22 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/1/ [11:42:39] Project selenium-MobileFrontend » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #1: 09SUCCESS in 24 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/1/ [11:43:33] Project selenium-MultimediaViewer » chrome,beta,OS X 10.9,contintLabsSlave && UbuntuTrusty build #1: 09SUCCESS in 25 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,label=contintLabsSlave%20&&%20UbuntuTrusty/1/ [12:16:41] 05Gerrit-Migration, 10Differential: Set up arcyd to create differential revisions with `git push` (code review without arcanist) - https://phabricator.wikimedia.org/T132863#2269682 (10Paladox) This would also allow us to land straight after approving maybe we want them to implant a button that only authorised... [12:33:58] PROBLEM - Puppet run on deployment-salt is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [12:43:35] 10Deployment-Systems, 06Release-Engineering-Team, 06Operations, 06Services: Streamline our service development and deployment process - https://phabricator.wikimedia.org/T93428#2269737 (10akosiaris) Seems like we have different meanings for #Blocked-on-operations. For me the tag means "somehow operations i... [12:54:46] stephanebisson: if you have a few minutes, take a look at https://gerrit.wikimedia.org/r/#/c/285658/ [12:55:01] sure [12:56:41] zeljkof: what's up with "@internet_explorer_10.0"? [12:58:01] is it used for anything? [12:58:46] there used to be ie10 tests [12:58:53] is there still some left? [12:58:56] let me check [12:59:38] stephanebisson: I see now [12:59:53] some scenarios were running with ie10 [13:00:06] if you no longer care about it at all, I can completely remove it [13:00:38] it looks like you changed "@internet_explorer_10" to "@internet_explorer_10.0" [13:01:08] stephanebisson: yes, that is needed because of the new framework [13:01:21] it can be either just the browser name, @internet_explorer [13:01:35] or the version used by sauce labs, @internet_explorer_10.0 [13:01:38] oh, I see [13:01:40] I've never seen those test those tests work in IE [13:02:06] take a look at the old code, ie tags were there [13:02:23] I can remove them completely, should I do that? [13:02:37] since @firefox and @chrome seem to indicate that tests should work with those browsers, maybe we should remove IE completely [13:02:45] stephanebisson: will do [13:02:54] will ping you in a few minutes when the patch is ready [13:03:06] until someone wants to make them work in IE... [13:03:32] the thing is, https://integration.wikimedia.org/ci/view/Selenium/job/selenium-Flow/ will fail until https://gerrit.wikimedia.org/r/#/c/285658 is merged [13:03:41] so I would like to get it merged/green soon [13:03:44] PROBLEM - Puppet run on deployment-memc03 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [13:04:16] related, https://phabricator.wikimedia.org/T134492 is progressing nicely [13:04:32] I will ping a few people next week after the reviews are done [13:04:47] I guess everybody is busy with reviews today [13:08:01] stephanebisson: https://gerrit.wikimedia.org/r/#/c/285658/ [13:08:38] zeljkof: I've seen that you filled the table for Cirrus, do you need anything from us? [13:09:24] dcausse: this table? https://phabricator.wikimedia.org/T128190 [13:09:34] I need to fill this one :) https://phabricator.wikimedia.org/T134492 [13:09:34] yes [13:09:45] do you want to be the owner for cirrus? [13:09:53] zeljkof: sure [13:10:11] I think it's my duty :) [13:10:20] dcausse: great, will push the patch in a minute [13:11:07] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 15User-zeljkofilipin: Ownership of Selenium tests - https://phabricator.wikimedia.org/T134492#2269798 (10zeljkofilipin) [13:11:22] dcausse: do you want to own any other repos? ;) [13:11:36] hmm not sure... ;) [13:12:48] well... even I'd like to I'm not sure it'll be very useful, I would be pretty incompetent :) [13:13:26] dcausse: "fixing" a job might be deciding to delete it, since nobody cares [13:13:40] I am trying to figure out who cares about which jobs [13:13:48] somehow that got lost [13:14:12] what's your deadline? [13:15:44] if you are struggling finding owners I could maybe reevaluate my position, but honestly I don't think I'm the right person to own anything other than cirrus [13:16:04] (03PS1) 10Zfilipin: David Causse is owner of CirrusSearch Selenium tests [integration/config] - 10https://gerrit.wikimedia.org/r/287207 (https://phabricator.wikimedia.org/T134492) [13:16:10] \o/ [13:16:39] dcausse: https://gerrit.wikimedia.org/r/#/c/287207/ [13:16:54] please +1/+2 and I will deploy [13:17:01] (03CR) 10DCausse: [C: 031] David Causse is owner of CirrusSearch Selenium tests [integration/config] - 10https://gerrit.wikimedia.org/r/287207 (https://phabricator.wikimedia.org/T134492) (owner: 10Zfilipin) [13:17:08] dcausse: there is no deadline [13:17:14] other than "soon" :) [13:17:16] :) [13:17:45] (03CR) 10Zfilipin: [C: 032] David Causse is owner of CirrusSearch Selenium tests [integration/config] - 10https://gerrit.wikimedia.org/r/287207 (https://phabricator.wikimedia.org/T134492) (owner: 10Zfilipin) [13:18:42] dcausse: you will now receive e-mail if the cirrus job fails https://integration.wikimedia.org/ci/view/Selenium/job/selenium-CirrusSearch/jobConfigHistory/showDiffFiles?timestamp1=2016-05-05_15-25-55×tamp2=2016-05-06_13-18-05 [13:19:02] it is pretty stable, and even if it fails, it is usually fixed by just rerunning it [13:19:17] our jobs never fail ;) [13:20:06] I hit "build now" if it happens right? [13:20:13] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 15User-zeljkofilipin, 05WMF-deploy-2016-05-01_(1.27.0-wmf.23): Migration of browsertests* Jenkins jobs to selenium* jobs - https://phabricator.wikimedia.org/T128190#2269830 (10zeljkofilipin) [13:20:29] dcausse: yes [13:20:47] (03Merged) 10jenkins-bot: David Causse is owner of CirrusSearch Selenium tests [integration/config] - 10https://gerrit.wikimedia.org/r/287207 (https://phabricator.wikimedia.org/T134492) (owner: 10Zfilipin) [13:21:15] (03CR) 10Zfilipin: "I have deployed selenium-CirrusSearch job." [integration/config] - 10https://gerrit.wikimedia.org/r/287207 (https://phabricator.wikimedia.org/T134492) (owner: 10Zfilipin) [13:28:51] if this https://integration.wikimedia.org/ci/view/Selenium/job/selenium-Flow/2/console finishes green, that will probably be the first time in years that all selenium daily jobs are green https://integration.wikimedia.org/ci/view/Selenium/ [13:29:03] * zeljkof is about to cry [13:42:39] sorry about that [13:48:08] ottomata: around? [13:48:50] hiya yup! [13:48:53] hi! [13:49:19] I think mediawiki monolog is already properly setup on beta [13:49:48] oo [13:49:51] ja? [13:49:53] but looking at deployment-kafka02 I see kafka 0.8 installed so I'm confused [13:50:13] it hasn't been upgraded yet [13:50:16] ah [13:50:22] i wanted to wait til it had the data coming in [13:50:28] actually, i might add a second broker to the cluster there [13:50:35] so we can practice a rolling upgrade [13:51:13] what do I have to do to get mediawiki monolog to produce something? [13:51:19] so in the end the only thing we need is to deploy the patch you made yesterday [13:51:29] ah ok [13:51:31] huh [13:52:18] I'm not very familiar with deploys, I guess I can cherry pick and sync-file on deployment-tin? [13:52:24] ha, i am not either [13:52:39] but i bet someone in this room is! [13:52:46] I hope so :) [13:52:51] lemme start up another broker real quick and amend that to include it [13:52:59] ok [14:04:38] grrrr rebase conflicts [14:05:59] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 15User-zeljkofilipin, 05WMF-deploy-2016-05-01_(1.27.0-wmf.23): Migration of browsertests* Jenkins jobs to selenium* jobs - https://phabricator.wikimedia.org/T128190#2269986 (10zeljkofilipin) [14:06:35] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 15User-zeljkofilipin: Ownership of Selenium tests - https://phabricator.wikimedia.org/T134492#2269987 (10zeljkofilipin) [14:06:57] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 15User-zeljkofilipin: Ownership of Selenium tests - https://phabricator.wikimedia.org/T134492#2267217 (10zeljkofilipin) [14:07:12] PROBLEM - Puppet run on deployment-kafka03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [14:09:07] 10Browser-Tests-Infrastructure, 10Wikidata, 13Patch-For-Review, 15User-zeljkofilipin: Merge tests/browser/environments.yml and tests/browser/config/config.yml in WikidataBrowserTests - https://phabricator.wikimedia.org/T128097#2269990 (10zeljkofilipin) a:03zeljkofilipin [14:10:29] 10Browser-Tests-Infrastructure, 10Wikidata, 13Patch-For-Review, 15User-zeljkofilipin: Merge tests/browser/environments.yml and tests/browser/config/config.yml in WikidataBrowserTests - https://phabricator.wikimedia.org/T128097#2063809 (10zeljkofilipin) [14:10:36] 10Browser-Tests-Infrastructure, 10Wikidata, 13Patch-For-Review, 15User-zeljkofilipin: Merge tests/browser/environments.yml and tests/browser/config/config.yml in WikidataBrowserTests - https://phabricator.wikimedia.org/T128097#2063809 (10zeljkofilipin) [14:12:33] 10Continuous-Integration-Config, 10Wikidata, 13Patch-For-Review, 03Wikidata-Sprint-2016-04-26: Set up Jenkins for Purtle repository - https://phabricator.wikimedia.org/T134162#2270000 (10JanZerebecki) [14:12:52] 10Continuous-Integration-Config, 10Wikidata, 13Patch-For-Review, 03Wikidata-Sprint-2016-04-26: Set up Jenkins for Purtle repository - https://phabricator.wikimedia.org/T134162#2256271 (10JanZerebecki) [14:28:59] stephanebisson: there is still somehow one scenario failing for flow :( https://integration.wikimedia.org/ci/view/Selenium/job/selenium-Flow/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/3/testReport/ [14:29:11] will disable it now, so we are finally back to green [14:29:32] sure, go ahead [14:32:37] ok dcausse amended [14:32:40] https://gerrit.wikimedia.org/r/#/c/287106/ we good to go [14:39:10] ottomata: will try to deploy [14:39:24] k thanks, let me knowif you figure out how to do it :p [14:40:10] If I want to deploy a wmf-config change on beta: I use deployement-tin, cherry pick in /srv/mediawiki-staging/wmf-config and then sync-file, is that right? [14:40:52] stephanebisson: https://gerrit.wikimedia.org/r/#/c/287222/ [14:40:56] if it beta-only, you can get someone to just +2 it dcausse [14:41:14] mobrovac: and it'll be deployed automagically? [14:41:25] to beta, yes [14:41:32] they'll still need to merge it in production but it won't change much there [14:41:59] ah so the patch needs to be merged otherwize the repo won't be upto date [14:42:12] ok [14:42:22] dcausse, did you just change these deployment-kafka servers? [14:42:44] or create, I guess [14:42:54] Krenair: yes only wmf-config/LabsServices.php is affected [14:42:59] https://gerrit.wikimedia.org/r/#/c/287106/ [14:43:03] no, I mean the servers themselveas [14:43:06] themselves* [14:43:07] Krenair: i just added one [14:43:08] I just got an alert saying puppet is broken on kafka03, and it shows the typical exim-before-upgrading error [14:43:18] yeah i just created that one [14:43:19] dcausse: You'll also want to sync it in prod otherwise icinga will start complaining about unmerged changes. [14:43:24] ^ This is probably not ideal. [14:43:24] okay [14:43:25] * Krenair fixes [14:43:56] ostriches: so basically I need to do like a prod deploy? [14:44:11] except that I don't have to sync-file [14:44:21] you do have to sync-file [14:44:26] Yeah, beta will deploy automatically, but prod will complain if you don't deploy. [14:44:42] ok even for wmf-config/LabsServices.php [14:44:45] yes [14:44:48] got it [14:44:55] Yes, it just checks if there's unmerged stuff, it doesn't care which files. [14:45:03] it is due to the git state being different, it doesn't care about different files [14:45:24] you can have uncommitted changes in the working directory and it won't notice [14:46:40] is it ok to do this on frydays? [14:46:48] 10Browser-Tests-Infrastructure, 10Wikidata, 13Patch-For-Review, 15User-zeljkofilipin: Merge tests/browser/environments.yml and tests/browser/config/config.yml in WikidataBrowserTests - https://phabricator.wikimedia.org/T128097#2270108 (10zeljkofilipin) [14:46:48] for labs-only changes, I think so yes [14:46:50] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 15User-zeljkofilipin, 05WMF-deploy-2016-05-01_(1.27.0-wmf.23): Migration of browsertests* Jenkins jobs to selenium* jobs - https://phabricator.wikimedia.org/T128190#2270107 (10zeljkofilipin) [14:46:53] ok [14:47:02] ottomata, puppet is fixed on kafka03 [14:49:22] thanks [14:49:27] ottomata: do you have +2 perms on wmf-config because I don't :/ [14:49:32] prob? [14:49:53] ja merged dcausse [14:50:11] you're in the deployment group on the servers but don't have deployment access in gerrit? [14:50:24] Krenair: I'm afraid no :/ [14:50:36] what's the point of having deployment access if you can't use it properly? [14:50:52] last time I deployed I asked erik to +2 :/ [14:52:28] I don't deploy frequently btw [14:52:54] 06Release-Engineering-Team, 07Performance, 07user-notice: First paint time regression on Wikimedia page views with wmf.23 roll-out - https://phabricator.wikimedia.org/T134553#2270128 (10Trizek-WMF) [14:53:06] 06Release-Engineering-Team, 07Performance, 07user-notice: First paint time regression on Wikimedia page views with wmf.23 roll-out - https://phabricator.wikimedia.org/T134553#2269227 (10Trizek-WMF) [14:57:09] RECOVERY - Puppet run on deployment-kafka03 is OK: OK: Less than 1.00% above the threshold [0.0] [14:59:41] ottomata: done, I see mediawiki_ApiAction mediawiki_CirrusSearchRequestSet topics now [15:01:26] but I don't have kafkacat on these machines so I don't know how to read these topics to double check [15:02:11] checking! [15:02:21] dcausse: on the brokers, you can also use [15:02:24] kafka console-consumer --topic <> [15:02:39] ottomata: will try, thanks! [15:02:50] Project selenium-Flow » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #4: 04FAILURE in 10 min: https://integration.wikimedia.org/ci/job/selenium-Flow/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/4/ [15:03:37] hm dcausse i tmight output in a slightly different format than kafkacat, dunno, might be troublesoem with avro [15:03:39] Yippee, build fixed! [15:03:39] Project selenium-Flow » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #4: 09FIXED in 11 min: https://integration.wikimedia.org/ci/job/selenium-Flow/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/4/ [15:03:46] ottomata: I see data, I did try to decode avro but data is coming [15:03:54] *I didn't* [15:03:55] ok perfect [15:04:19] nice perfect [15:04:23] thatis good enough [15:04:25] thank you dcausse! [15:04:29] yw! :) [15:10:16] 05Gerrit-Migration, 10Differential: Find way to use Differential with plain git (i.e.: without requiring arc) - https://phabricator.wikimedia.org/T127#2270181 (10Paladox) [15:13:38] 06Release-Engineering-Team, 07Performance, 07user-notice: First paint time regression on Wikimedia page views with wmf.23 roll-out - https://phabricator.wikimedia.org/T134553#2270194 (10greg) [15:13:40] 06Release-Engineering-Team, 13Patch-For-Review, 05Release: MW-1.27.0-wmf.23 deployment blockers - https://phabricator.wikimedia.org/T131557#2270193 (10greg) [15:20:44] Yippee, build fixed! [15:20:45] Project selenium-Flow » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #5: 09FIXED in 10 min: https://integration.wikimedia.org/ci/job/selenium-Flow/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/5/ [15:50:11] 10Continuous-Integration-Config, 10Wikidata, 13Patch-For-Review, 03Wikidata-Sprint-2016-04-26: Set up Jenkins for Purtle repository - https://phabricator.wikimedia.org/T134162#2270279 (10JanZerebecki) 05Open>03Resolved Docs now work as of https://gerrit.wikimedia.org/r/#/c/287219/ . I moved the github... [17:45:03] login to deployment-tin seems broken [17:45:05] only works as root [17:45:26] Krenair: let me check.. [17:45:46] Krenair: worksforme [17:46:27] alex@alex-laptop:~/Development/Wikimedia/Operations-MediaWiki-Config (review/alex_monk/T98625)$ ssh deployment-tin [17:46:27] Connection closed by UNKNOWN [17:46:28] alex@alex-laptop:~/Development/Wikimedia/Operations-MediaWiki-Config (review/alex_monk/T98625)$ ssh root@deployment-tin [17:46:28] Linux deployment-tin 3.13.0-85-generic #129-Ubuntu SMP Thu Mar 17 20:50:15 UTC 2016 x86_64 [18:01:53] Krenair: I can'T connect too, but I get: Connection closed by 10.68.17.240 [18:32:09] Luke081515, Krenair: can you try with ssh -v and see if there are any clues? I can't reproduce and I don't see anything strange in the logs [18:40:56] it seems ldap is failing to return 'project-deployment-prep' for some users, based on what's in auth.log on deployment-tin [18:42:25] (03PS8) 10Legoktm: Make SpaceyParenthesisSniff can fix multiple white spaces between parentheses [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/275796 (owner: 10Lethexie) [18:42:48] (03CR) 10Legoktm: [C: 032] Make SpaceyParenthesisSniff can fix multiple white spaces between parentheses [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/275796 (owner: 10Lethexie) [18:46:42] (03Merged) 10jenkins-bot: Make SpaceyParenthesisSniff can fix multiple white spaces between parentheses [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/275796 (owner: 10Lethexie) [18:47:06] (03PS10) 10Legoktm: Add the SpaceBeforeControlStructureBraceSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/275747 (https://phabricator.wikimedia.org/T130004) (owner: 10Lethexie) [18:49:19] (03CR) 10jenkins-bot: [V: 04-1] Add the SpaceBeforeControlStructureBraceSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/275747 (https://phabricator.wikimedia.org/T130004) (owner: 10Lethexie) [18:56:10] (03CR) 10Legoktm: [C: 04-1] "See inline comments, sorry about the delay in reviewing :(" (032 comments) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/275747 (https://phabricator.wikimedia.org/T130004) (owner: 10Lethexie) [18:59:29] PROBLEM - Host deployment-phab is DOWN: CRITICAL - Host Unreachable (10.68.17.137) [19:00:12] (03PS4) 10Legoktm: Make IfElseStructureSniff can detect and fix multiple white spaces after else [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/277227 (https://phabricator.wikimedia.org/T129840) (owner: 10Lethexie) [19:06:43] (03CR) 10Legoktm: [C: 032] Make IfElseStructureSniff can detect and fix multiple white spaces after else [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/277227 (https://phabricator.wikimedia.org/T129840) (owner: 10Lethexie) [19:08:11] (03Merged) 10jenkins-bot: Make IfElseStructureSniff can detect and fix multiple white spaces after else [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/277227 (https://phabricator.wikimedia.org/T129840) (owner: 10Lethexie) [19:09:24] (03PS4) 10Legoktm: Also check for space after elseif in SpaceAfterControlStructureSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/276110 (https://phabricator.wikimedia.org/T89682) (owner: 10Lethexie) [19:13:40] (03PS5) 10Legoktm: Also check for space after elseif in SpaceAfterControlStructureSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/276110 (owner: 10Lethexie) [19:13:51] (03CR) 10Legoktm: [C: 032] "Nice :)" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/276110 (owner: 10Lethexie) [19:29:16] 10MediaWiki-Codesniffer, 10MediaWiki-extensions-PageCuration, 07Easy: Switch PageTriage extension to use phpcs.xml - https://phabricator.wikimedia.org/T134602#2270781 (10Legoktm) [19:30:06] 10MediaWiki-Codesniffer, 10MediaWiki-extensions-Git2Pages, 07Easy: Switch Git2Pages extension to use phpcs.xml - https://phabricator.wikimedia.org/T134603#2270796 (10Legoktm) [19:34:21] (03PS1) 10Legoktm: Release 0.7.0 [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/287270 [19:34:48] addshore: ^ +2 plz [19:35:40] (03CR) 10Addshore: [C: 032] Release 0.7.0 [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/287270 (owner: 10Legoktm) [19:35:43] woo! [19:36:44] (03Merged) 10jenkins-bot: Release 0.7.0 [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/287270 (owner: 10Legoktm) [19:38:04] tag pushed [19:41:07] w [19:41:09] meh [19:41:48] !log Rebasing 02ae1757 on deployment-puppetmaster : T126629 [19:41:49] T126629: Cassandra 2.1.13 and/or 2.2.6 - https://phabricator.wikimedia.org/T126629 [19:41:53] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [19:45:46] !log Restart cassandra-metrics-collector on deployment-restbase0[1-2] [19:45:51] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [19:48:25] legoktm: Hi, will there be an email to say that codesniffer 0.7.0 has been released. [19:48:34] paladox: I'm writing it right now :) [19:48:35] Is there a changelog please. [19:48:40] Oh ok, thanks legoktm [19:50:27] legoktm: Im going to do https://phabricator.wikimedia.org/T134603 and https://phabricator.wikimedia.org/T134602 would you be able to review and merge the patches when i upload them please. [19:51:46] (03PS1) 10Addshore: Fix typo in IfElseStructureSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/287273 [19:51:50] legoktm: ^^ [19:51:58] paladox: sure [19:52:03] Thanks [19:52:07] (03CR) 10Legoktm: [C: 032] Fix typo in IfElseStructureSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/287273 (owner: 10Addshore) [19:53:47] (03PS1) 10Legoktm: Release 0.7.1 [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/287274 [19:54:11] addshore: anything else you see before ^ -.- [19:54:20] just giving it a quikc scan through :p [19:54:31] but no, I don't think so ;) [19:55:11] legoktm: Hi it looks like mediawiki/extensions/Thanks has been running for 4hrs at https://integration.wikimedia.org/zuul/ [19:55:28] hahahaaaa [19:55:42] paladox: huh. [19:55:46] (03Merged) 10jenkins-bot: Fix typo in IfElseStructureSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/287273 (owner: 10Addshore) [19:56:06] legoktm: Seems to have gone now. [19:56:11] paladox: I think i just killed it for you [19:56:20] (03CR) 10Legoktm: [C: 032] Release 0.7.1 [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/287274 (owner: 10Legoktm) [19:56:21] addshore thanks. [19:56:58] It wasen't affecting anyone i think, but thought i would tell since someone might be wondering why it hasen't been tested yet, but thanks. [19:57:53] (03Merged) 10jenkins-bot: Release 0.7.1 [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/287274 (owner: 10Legoktm) [19:58:41] tag pushed [19:59:22] cool! [20:00:16] legoktm Im going to bum codesniffer to 0.5.0 in PageTriage [20:00:25] 0.6.0 would bring up too many errors. [20:00:28] About array. [20:00:41] paladox: ok [20:01:42] legoktm: Is there a way for codesniffer to not error out on this kind of code please [20:01:43] // if ( self::shouldShowNoIndex( $article ) ) { [20:01:43] // $wgOut->setRobotPolicy( 'noindex,nofollow' ); [20:01:43] // } [20:01:52] $wgOut->setRobotPolicy( 'noindex,nofollow' ); [20:01:58] paladox: why don't you use the same version? [20:02:04] Space after the if it should be. [20:02:05] and just convert the phpcs.xml part [20:02:08] You mean 0.7.1 [20:02:17] Oh, 0.5.0 [20:02:21] woops 0.3.0 [20:02:31] legoktm ^^ [20:02:42] just keep it on 0.3.0 for now yeah [20:03:01] Ok [20:03:38] legoktm: im not sure if it is just me but loading https://integration.wikimedia.org/ci/job/composer-php55-trusty/780/console is not loading [20:03:47] just has the loading icon on the browser. [20:03:51] works for me [20:03:52] Works now [20:05:25] legoktm: https://gerrit.wikimedia.org/r/#/c/287275/ please. [20:08:14] legoktm: this https://gerrit.wikimedia.org/r/#/c/287275/ passes now, and ive converted it to a phpcs file. [20:20:48] legoktm: Hi ive just uploaded this one https://gerrit.wikimedia.org/r/#/c/287278/ please could you review and merge. [20:21:04] https://gerrit.wikimedia.org/r/#/c/287278 = https://phabricator.wikimedia.org/T134603 [20:21:14] https://gerrit.wikimedia.org/r/#/c/287275/ = https://phabricator.wikimedia.org/T134602 [20:26:20] twentyafterfour, I just tried again and it was fine [20:26:34] Krenair: ok weird [20:27:13] paladox: I will look after lunch :) [20:27:22] legoktm: Ok thanks [20:27:46] legoktm: Ive also updated mw core https://gerrit.wikimedia.org/r/#/c/287280/ with a note to say addshore improved the performance. [20:32:32] twentyafterfour, it did this before yesterday as well :/ [20:38:06] PROBLEM - Puppet run on phab-beta is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [20:39:09] (03PS1) 10Addshore: Add another pass test file with a namespace [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/287281 [20:41:32] (03PS2) 10Addshore: Add another pass test file with a namespace [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/287281 [20:43:12] RECOVERY - Puppet run on phab-beta is OK: OK: Less than 1.00% above the threshold [0.0] [21:13:42] 05Gerrit-Migration, 10Diffusion: Linkify gerrit change-id in diffusion - https://phabricator.wikimedia.org/T89939#1049126 (10mmodell) [21:14:37] 10Beta-Cluster-Infrastructure, 10Phabricator: puppet failure on deployment-phab due to missing packages php5-mailparse and python-phabricator - https://phabricator.wikimedia.org/T134277#2271123 (10mmodell) 05Open>03Invalid I ended up deleting the instance. [21:14:39] 10Beta-Cluster-Infrastructure, 07Puppet, 07Tracking: Deployment-prep hosts with puppet errors (tracking) - https://phabricator.wikimedia.org/T132259#2271125 (10mmodell) [21:25:07] PROBLEM - Puppet run on phab-beta is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [21:32:56] 10MediaWiki-Codesniffer, 10MediaWiki-extensions-Git2Pages, 07Easy, 13Patch-For-Review: Switch Git2Pages extension to use phpcs.xml - https://phabricator.wikimedia.org/T134603#2271138 (10Legoktm) 05Open>03Resolved a:03Paladox [21:33:30] legoktm thanks [21:33:33] 10MediaWiki-Codesniffer, 10MediaWiki-extensions-PageCuration, 07Easy, 13Patch-For-Review: Switch PageTriage extension to use phpcs.xml - https://phabricator.wikimedia.org/T134602#2271140 (10Legoktm) 05Open>03Resolved a:03Paladox [21:33:47] paladox: thank you! [21:34:00] Your welcome. [21:34:01] :) [21:35:12] legoktm: Is there anyway we can increase the nodepool trusty slaves [21:35:26] Since there are two avilable but currently it is slow having two. [21:35:27] Please [21:40:34] paladox: that's a question for hashar, I'm not sure how to do that [21:40:49] legoktm: Oh ok. [21:52:07] 06Release-Engineering-Team, 07Performance, 07User-notice: First paint time regression on Wikimedia page views with wmf.23 roll-out - https://phabricator.wikimedia.org/T134553#2269227 (10Jdlrobson) Was this mobile and desktop or just desktop? [21:56:42] legoktm: It seems https://integration.wikimedia.org/ci/job/mediawiki-core-qunit/64208/console that is running along time [21:56:46] and mysql terminated [21:56:53] 21:55:25 /srv/deployment/integration/slave-scripts/bin/mw-install-mysql.sh: line 9: 17976 Terminated [21:57:21] Could you abort that please, and re merge https://gerrit.wikimedia.org/r/#/c/287280/ please. [22:20:48] 05Gerrit-Migration, 10Differential, 07Documentation: Document use of Owners in Phabricator and advertise it - https://phabricator.wikimedia.org/T128372#2271229 (10Danny_B) [22:23:46] Does anyone know about the uncommitted change to deployment-tin:/srv/mediawiki-staging/extensions/.gitignore ? [22:24:10] Or the deployment-tin:/srv/mediawiki-staging/wmf-config/event-schemas submodule update that hasn't been done? [22:24:43] Project beta-scap-eqiad build #101523: 04FAILURE in 0.23 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/101523/ [22:25:53] it lives [22:25:55] [[Test]] http://en.wikipedia.beta.wmflabs.org/w/index.php?diff=340417&oldid=340416 * Krenair * (+1) [22:35:50] Yippee, build fixed! [22:35:51] Project beta-scap-eqiad build #101524: 09FIXED in 1 min 9 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/101524/ [22:40:06] legoktm: Hi mysql seems to not be working on https://integration.wikimedia.org/ci/job/mediawiki-phpunit-hhvm-composer/3990/ [22:41:10] twentyafterfour: for ssh -v deployment-tin, I pasted the output here: https://phabricator.wikimedia.org/P3011 [22:41:33] (it was the output some time ago, currently the login works) [22:57:35] Luke081515: thanks [23:01:03] hey, Do you have an ETA for the next release of scap? It seems the timeout issues is happening again [23:02:06] 10Beta-Cluster-Infrastructure: setup IRC server - https://phabricator.wikimedia.org/T55593#2271320 (10Krenair) 05declined>03Resolved The ircd.conf was released by operations recently in https://gerrit.wikimedia.org/r/286783 and so I completed this today. Documented on our wikitech overview page. [23:04:03] PROBLEM - Puppet run on deployment-salt is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [23:06:28] Krenair: Where I can find the IRC channel for deploymentwiki (beta) at IRC feed? #deployment.wikimedia.beta.wmflabs doesn't exists... [23:06:55] #deployment.wikimedia.beta.wmflabs [23:07:47] 01:04 [wikimedia] -!- #deployment.wikimedia.beta.wmflabs: No such channel [23:07:54] maybe I should try to make a change first [23:07:59] no, I'm in the channel [23:08:06] what is the hostname/IP of the IRC server you connected to? [23:09:11] I connected me to irc.wikimedia.org, and the client says: [23:09:12] 01:03 [wikimedia] -!- Your host is irc.pmtpa.wikimedia.org[irc.pmtpa.wikimedia.org/6667], running version ircd-ratbox-2.2.9 [23:09:19] Let me search for the IP [23:09:57] you didn't connect to the correct host [23:10:06] irc.wikimedia.org != irc.beta.wmflabs.org [23:10:18] ah, there is a difference, ok [23:11:05] * Luke (~Luke08151@anonymous.user) has joined #deployment.wikimedia.beta.wmflabs [23:11:09] yep [23:11:14] works now :D [23:11:15] thanks [23:11:18] np [23:11:47] let me see if there is any spambot to block, so I can test if that works :D [23:13:43] yay, works [23:38:57] 05Gitblit-Deprecate, 10Diffusion, 13Patch-For-Review: Replicate open patchsets to diffusion - https://phabricator.wikimedia.org/T89940#2271368 (10mmodell) >>! In T89940#2262839, @Ricordisamoa wrote: >>>! In T89940#2249117, @mmodell wrote: >>>>! In T89940#2249071, @Ricordisamoa wrote: >>> Also when I list my...