[02:28:51] 10Gerrit, 10Upstream: Change Gerrit's default indentation to tabs - https://phabricator.wikimedia.org/T168590#3399433 (10Huji) Neat! Never have I ever submitted a task that ended up being an upstream request, and seen it fixed upstream in such short period of time! [03:17:21] PROBLEM - Puppet errors on deployment-pdfrender02 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [03:52:22] RECOVERY - Puppet errors on deployment-pdfrender02 is OK: OK: Less than 1.00% above the threshold [0.0] [04:12:07] PROBLEM - Puppet errors on deployment-mathoid is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [04:52:08] RECOVERY - Puppet errors on deployment-mathoid is OK: OK: Less than 1.00% above the threshold [0.0] [05:48:21] PROBLEM - Puppet errors on deployment-pdfrender02 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [06:22:47] Yippee, build fixed! [06:22:48] Project selenium-Wikibase » chrome,test,Linux,BrowserTests build #410: 09FIXED in 1 hr 42 min: https://integration.wikimedia.org/ci/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=test,PLATFORM=Linux,label=BrowserTests/410/ [06:23:21] RECOVERY - Puppet errors on deployment-pdfrender02 is OK: OK: Less than 1.00% above the threshold [0.0] [06:35:39] PROBLEM - Free space - all mounts on deployment-fluorine02 is CRITICAL: CRITICAL: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<11.11%) [07:00:42] RECOVERY - Free space - all mounts on deployment-fluorine02 is OK: OK: All targets OK [07:24:38] PROBLEM - Puppet errors on castor is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [07:26:21] (03CR) 10Thiemo Mättig (WMDE): Fix exclude of common folders (031 comment) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/362611 (owner: 10Umherirrender) [07:59:41] RECOVERY - Puppet errors on castor is OK: OK: Less than 1.00% above the threshold [0.0] [08:03:17] PROBLEM - Puppet errors on integration-r-lang-01 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [08:05:48] PROBLEM - Puppet errors on integration-slave-docker-1000 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [08:40:45] RECOVERY - Puppet errors on integration-slave-docker-1000 is OK: OK: Less than 1.00% above the threshold [0.0] [08:43:17] RECOVERY - Puppet errors on integration-r-lang-01 is OK: OK: Less than 1.00% above the threshold [0.0] [08:45:21] (03CR) 10Hashar: [C: 032] [ShowMe] Add npm job [integration/config] - 10https://gerrit.wikimedia.org/r/362811 (owner: 10Umherirrender) [08:46:36] (03Merged) 10jenkins-bot: [ShowMe] Add npm job [integration/config] - 10https://gerrit.wikimedia.org/r/362811 (owner: 10Umherirrender) [08:53:39] 10MediaWiki-Codesniffer, 10Upstream: PHP_CodeSniffer 3.x breaks when prepend-autoloader: false is set (like it is in MediaWiki core) - https://phabricator.wikimedia.org/T167168#3399930 (10hashar) MediaWiki core example change https://gerrit.wikimedia.org/r/#/c/362795/ [09:10:11] (03CR) 10Hashar: [C: 032] Whitelist yashasvi [integration/config] - 10https://gerrit.wikimedia.org/r/362238 (owner: 10Mholloway) [09:11:11] (03Merged) 10jenkins-bot: Whitelist yashasvi [integration/config] - 10https://gerrit.wikimedia.org/r/362238 (owner: 10Mholloway) [09:36:41] (03PS2) 10Hashar: castor: use JJB include statements [integration/config] - 10https://gerrit.wikimedia.org/r/361839 [09:40:51] (03CR) 10Hashar: [C: 032] "Change is a noop. If !include-raw statements turn out to be a bad idea, we can always revert." [integration/config] - 10https://gerrit.wikimedia.org/r/361839 (owner: 10Hashar) [09:42:36] (03Merged) 10jenkins-bot: castor: use JJB include statements [integration/config] - 10https://gerrit.wikimedia.org/r/361839 (owner: 10Hashar) [10:39:05] (03PS2) 10Hashar: castor: get rid of intermediate env file [integration/config] - 10https://gerrit.wikimedia.org/r/361843 [10:59:33] PROBLEM - Puppet errors on deployment-pdf01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [11:14:36] 10Continuous-Integration-Config, 10Gerrit, 10MediaWiki-extensions-Nonlinear, 10Project-Admins: Archive the NonLinear extension - https://phabricator.wikimedia.org/T169519#3400422 (10Aklapper) [11:29:58] 10Continuous-Integration-Config, 10Gerrit, 10MediaWiki-extensions-Nonlinear, 10Project-Admins: Archive the NonLinear extension - https://phabricator.wikimedia.org/T169519#3400422 (10MarcoAurelio) I have closed as declined the remaining open tasks. Next steps I guess is to mark the gerrit repo as archived? [11:32:52] (03PS1) 10Phedenskog: Run WebPageTest tests from Asia to verify the new cache pop. [integration/config] - 10https://gerrit.wikimedia.org/r/362972 (https://phabricator.wikimedia.org/T168416) [11:33:16] (03PS3) 10Hashar: castor: get rid of intermediate env file [integration/config] - 10https://gerrit.wikimedia.org/r/361843 [11:33:24] (03CR) 10Phedenskog: [C: 04-1] "We need to push https://gerrit.wikimedia.org/r/#/c/362971/ before we add this one to Jenkins." [integration/config] - 10https://gerrit.wikimedia.org/r/362972 (https://phabricator.wikimedia.org/T168416) (owner: 10Phedenskog) [11:34:14] !log jenkins: refreshing all jobs and updating the castor-save bit ( https://gerrit.wikimedia.org/r/#/c/361843/ ) [11:34:18] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [11:34:29] (03CR) 10Hashar: [C: 032] "Jobs updated" [integration/config] - 10https://gerrit.wikimedia.org/r/361843 (owner: 10Hashar) [11:35:39] (03Merged) 10jenkins-bot: castor: get rid of intermediate env file [integration/config] - 10https://gerrit.wikimedia.org/r/361843 (owner: 10Hashar) [11:53:22] (03Draft2) 10MarcoAurelio: Archive Nonlinear [integration/config] - 10https://gerrit.wikimedia.org/r/362973 (https://phabricator.wikimedia.org/T169519) [11:53:26] (03Draft1) 10MarcoAurelio: Archive Nonlinear [integration/config] - 10https://gerrit.wikimedia.org/r/362973 (https://phabricator.wikimedia.org/T169519) [12:22:59] PROBLEM - Puppet errors on deployment-urldownloader is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [12:44:44] PROBLEM - Puppet errors on deployment-etcd-01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [13:02:58] RECOVERY - Puppet errors on deployment-urldownloader is OK: OK: Less than 1.00% above the threshold [0.0] [13:04:47] PROBLEM - Puppet errors on deployment-conf03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [13:15:55] PROBLEM - Puppet errors on integration-puppetmaster01 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [13:26:55] PROBLEM - Puppet staleness on deployment-prometheus01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0] [13:49:20] Yippee, build fixed! [13:49:20] Project selenium-VisualEditor » firefox,beta,Linux,BrowserTests build #448: 09FIXED in 5 min 18 sec: https://integration.wikimedia.org/ci/job/selenium-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/448/ [13:50:56] RECOVERY - Puppet errors on integration-puppetmaster01 is OK: OK: Less than 1.00% above the threshold [0.0] [15:01:35] 10Release-Engineering-Team, 10Page-Previews, 10Reading-Web-Backlog, 10Epic: [EPIC] Generate compiled assets from continuous integration - https://phabricator.wikimedia.org/T158980#3401153 (10Jhernandez) Sent an email to discuss. [15:24:43] (03CR) 10Umherirrender: "Only for files with that name in the root." [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/362611 (owner: 10Umherirrender) [15:27:31] PROBLEM - Puppet errors on deployment-eventlogging03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [15:52:45] PROBLEM - Puppet errors on deployment-mira is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [15:55:25] Yippee, build fixed! [15:55:26] Project selenium-MobileFrontend » firefox,beta,Linux,BrowserTests build #475: 09FIXED in 33 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/475/ [16:05:37] 10Continuous-Integration-Config, 10Gerrit, 10MediaWiki-extensions-Nonlinear, 10Project-Admins, 10Patch-For-Review: Archive the NonLinear extension - https://phabricator.wikimedia.org/T169519#3401406 (10MarcoAurelio) Things done: * #MediaWiki-extensions-nonlinear has been edited to note that the extension... [16:24:02] (03PS13) 10Paladox: Create operations-puppet-catalog-compiler job in jjb [integration/config] - 10https://gerrit.wikimedia.org/r/325064 (https://phabricator.wikimedia.org/T97513) [16:24:05] (03PS14) 10Paladox: Create operations-puppet-catalog-compiler job in jjb [integration/config] - 10https://gerrit.wikimedia.org/r/325064 (https://phabricator.wikimedia.org/T97513) [16:24:24] (03PS15) 10Paladox: Create operations-puppet-catalog-compiler job in jjb [integration/config] - 10https://gerrit.wikimedia.org/r/325064 (https://phabricator.wikimedia.org/T97513) [16:25:11] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Operations, 10Patch-For-Review: CI for operations/puppet is taking too long - https://phabricator.wikimedia.org/T166888#3401535 (10akosiaris) [16:28:22] (03PS5) 10Paladox: [operations-puppet-catalog-compiler] Adding it to jenkins job builder [integration/config] - 10https://gerrit.wikimedia.org/r/315994 (https://phabricator.wikimedia.org/T97513) [16:32:43] RECOVERY - Puppet errors on deployment-mira is OK: OK: Less than 1.00% above the threshold [0.0] [16:59:34] hmmm, my jobs seems to be failing D: [16:59:40] https://integration.wikimedia.org/ci/job/mwext-testextension-hhvm-jessie/9940/console [16:59:53] oh wait, no, my bad, the erorr is just not super visible [17:13:53] 10Deployment-Systems, 10Scap (Scap3-Adoption-Phase1), 10scap2, 10Wikimedia-Stream: Deploy rcstream with scap3 - https://phabricator.wikimedia.org/T129153#2096650 (10fgiunchedi) Might not be needed after all, see deprecation of rcstream in {T156919} [17:16:24] PROBLEM - Puppet errors on integration-puppetmaster01 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [17:51:23] RECOVERY - Puppet errors on integration-puppetmaster01 is OK: OK: Less than 1.00% above the threshold [0.0] [18:03:53] (03Draft2) 10Zppix: Add revi due to a trusted user meeting merge commit requirements. [integration/config] - 10https://gerrit.wikimedia.org/r/363041 [18:04:52] please yell at me if the above commit isnt correct [18:05:30] 10Scap (Scap3-Adoption-Phase1), 10releng-201516-q4, 10releng-201718-q1, 10Trebuchet: [keyresult] Migrate remaining trebuchet deployed services - https://phabricator.wikimedia.org/T129290#3402075 (10demon) [18:05:32] 10Deployment-Systems, 10Scap (Scap3-Adoption-Phase1), 10scap2, 10Wikimedia-Stream: Deploy rcstream with scap3 - https://phabricator.wikimedia.org/T129153#3402073 (10demon) 05Open>03declined Indeed. [18:12:29] (03CR) 10MarcoAurelio: [C: 04-1] Add revi due to a trusted user meeting merge commit requirements. (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/363041 (owner: 10Zppix) [18:13:45] (03PS3) 10Zppix: Add revi to whitelist due to a trusted user meeting merge commit requirements. [integration/config] - 10https://gerrit.wikimedia.org/r/363041 [18:16:23] (03CR) 10MarcoAurelio: "Looks okay now. Wondering if we need to add him too to the list starting in Line 44 et seq. as well." [integration/config] - 10https://gerrit.wikimedia.org/r/363041 (owner: 10Zppix) [18:17:12] (03CR) 10Zppix: "> Looks okay now. Wondering if we need to add him too to the list" [integration/config] - 10https://gerrit.wikimedia.org/r/363041 (owner: 10Zppix) [18:18:15] paladox: you would know do i need to add the user i added to the test pipeline list to the whitelist on line 44? [18:18:59] you need to have two lines [18:19:20] containing what and where? [18:19:20] and yes you need to also on line 44 [18:19:24] the meail [18:19:26] email [18:19:54] (03CR) 10MarcoAurelio: "> Looks okay now. Wondering if we need to add him too to the list" [integration/config] - 10https://gerrit.wikimedia.org/r/363041 (owner: 10Zppix) [18:20:26] (03CR) 10Paladox: [C: 04-1] Add revi to whitelist due to a trusted user meeting merge commit requirements. (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/363041 (owner: 10Zppix) [18:20:37] so 1 on the test pipline list and line 44 paladox? [18:20:54] yep [18:21:55] and shorten the commit message title [18:21:59] (imho) [18:22:02] TabbyCat: ok [18:22:06] ^ paladox too [18:22:18] Zppix not sure what you mean? [18:22:44] (03PS4) 10Zppix: Add revi to whitelist. [integration/config] - 10https://gerrit.wikimedia.org/r/363041 [18:23:03] meh [18:23:22] dat pingz [18:23:32] sorry revi im trying [18:23:33] lol [18:23:39] no problem lol [18:23:41] paladox: i meant to cc you on that ok msg :P [18:23:45] I have do not disturb anyway [18:23:46] oh ok [18:23:51] lol [18:28:14] nini anyway! [18:31:25] I see some @users.mediawiki.org mail domains in .mailmap... where those addresses come from? [18:32:00] mediawiki [18:32:18] as thats the email format that is sent to users. [18:32:53] I don't understand. So if I send an email to marcoaurelio@users.mediawiki.org it'll arrive to me? [18:35:16] I think it was from svn? [18:35:30] no idea, first time I see that [18:35:36] svn commit account is my guess [18:35:57] Um, try it :) [18:36:28] 10Continuous-Integration-Infrastructure: Jenkins: install tox on Precise labs instances - https://phabricator.wikimedia.org/T46443#489822 (10Volans) @hashar is there still any reason to keep tox pinned to this old version? Any chance we could upgrade it to a newer one? Jessie backports has 2.5.0 and latest from... [18:36:50] maurelio@users would be nice [18:36:54] but, well [18:37:09] if it would work, where would it send to? [18:37:46] huh? https://usercontent.irccloud-cdn.com/file/EcIMedCn/IMG_1436.PNG [18:37:46] registered email in preferences on mediawiki? [18:37:50] no MX [18:38:34] omg 3 am go sleep :P :D [18:38:59] lol [18:39:07] I usualy sleep at 4am [18:39:19] kind of bad habit became life [18:39:21] :-p [18:39:24] maybe the address is not working [18:39:27] old stuff [18:39:29] etc [18:39:43] maybe the old ones know better [18:39:50] fails [18:40:20] yeah, no MX [18:40:26] today @tools.wmflabs.org redirects to your registered email in wikitech [18:40:44] Tho I'd like such concept of users.mw.o [18:41:05] I guess bd808 would like to migrate that to wmcloud.org sometime I guess... [18:41:12] That was a bogus domain I made up during conversion from svn -> git [18:41:14] though mediawiki emails from wiki@wikimedia.org [18:41:16] It was a bad idea, in retrospect [18:41:29] oh [18:41:41] we can remove that from zuul? [18:41:56] wm.o is usuallt for wmf employees [18:41:59] usually* [18:42:36] wm.o is employee/board/other-official-stuff [18:42:40] yeah [18:42:55] * TabbyCat wants w.o [18:43:14] TabbyCat: we are often hiring :) [18:43:30] bd808: I'm not sure wmf needs more lawyers [18:43:36] does it? [18:43:45] I meant the mediawiki user address not wm.org :) [18:43:45] I almost once got wm.o but anyway [18:44:01] TabbyCat: apparently not today -- https://wikimediafoundation.org/wiki/Work_with_us [18:44:06] (except I didn't get teh offer heh) [18:44:42] back to email... are we going to use wmcloud? [18:44:56] (I'm blind to wikimedia cloud news) [18:45:02] We do have several lawyers but no vacancy at the moment. [18:45:09] we own the domain. some things will probably move to it over the next 9-12 months [18:45:13] oh. [18:45:15] kk [18:45:36] who wants them harej? we only appear when there are problems, and we don't want dramah :) [18:45:54] I'll keep trying to fix little-annoying-bugs [18:46:11] improves my cardiovascular endurance :) [18:46:42] They're also good for protecting your hide and occasionally litigating against the federal government. [18:47:04] I only need lawyer when I see someone threatening to sue me [18:47:11] for not deleting some wiki page [18:47:16] so :-p [19:31:55] PROBLEM - Puppet errors on deployment-imagescaler01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [19:34:40] Project beta-scap-eqiad build #162403: 04STILL FAILING in 58 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/162403/ [19:44:18] (03PS2) 10Chad: Add basic scap.cfg [tools/release] - 10https://gerrit.wikimedia.org/r/356430 [19:44:40] Project beta-scap-eqiad build #162404: 04STILL FAILING in 1 min 2 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/162404/ [19:46:41] PROBLEM - Puppet errors on deployment-mathoid is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [19:47:33] PROBLEM - Puppet errors on deployment-pdfrender02 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [19:49:04] (03PS1) 10Hashar: publishing: drop postbuildscript [integration/config] - 10https://gerrit.wikimedia.org/r/363047 [19:50:40] 10Release-Engineering-Team (Kanban), 10Scap, 10Services (watching): Scap3 considers service restarts to be deploys - https://phabricator.wikimedia.org/T169141#3402308 (10thcipriani) 05Open>03Resolved [19:54:34] Project beta-scap-eqiad build #162405: 04STILL FAILING in 54 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/162405/ [19:55:38] PROBLEM - Puppet errors on deployment-sca01 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [19:58:48] PROBLEM - Puppet errors on deployment-sca03 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [20:13:35] RECOVERY - Free space - all mounts on deployment-tin is OK: OK: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found) [20:15:16] Yippee, build fixed! [20:15:17] Project beta-scap-eqiad build #162406: 09FIXED in 14 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/162406/ [20:17:56] ^ should be fixed now [20:18:19] well, it *is* fixed now, but there is a reason, too. I am that reason. [20:20:42] PROBLEM - Puppet errors on deployment-sca04 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [20:21:23] lol thcipriani [20:21:41] RECOVERY - Puppet errors on deployment-mathoid is OK: OK: Less than 1.00% above the threshold [0.0] [20:22:17] :D [20:22:33] RECOVERY - Puppet errors on deployment-pdfrender02 is OK: OK: Less than 1.00% above the threshold [0.0] [20:25:39] RECOVERY - Puppet errors on deployment-sca01 is OK: OK: Less than 1.00% above the threshold [0.0] [20:33:01] Yippee, build fixed! [20:33:01] Project beta-update-databases-eqiad build #18196: 09FIXED in 13 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/18196/ [20:33:49] RECOVERY - Puppet errors on deployment-sca03 is OK: OK: Less than 1.00% above the threshold [0.0] [20:35:41] RECOVERY - Puppet errors on deployment-sca04 is OK: OK: Less than 1.00% above the threshold [0.0] [20:49:52] 10Release-Engineering-Team (Kanban), 10Diffusion, 10Patch-For-Review, 10Regression: Unable to browse refs/meta/config in Diffusion - https://phabricator.wikimedia.org/T137354#3402517 (10mmodell) p:05High>03Normal a:03mmodell I'll deploy it this week [20:56:44] I see my dir /data/scratch/wdqs was wiped clean. Anybody knows why? [20:59:01] bd808, thcipriani ^? [21:00:01] SMalyshev: hmmm... maybe by the NFS master failover we did last week? I don't know if scratch is mirrored between the NFS servers [21:00:55] bd808: not sure. It was ok on Friday iirc [21:01:20] bd808: when the switch happened? Also, the dir /data/scratch/wdqs still exists, but the files in there are gone [21:01:26] hmmm.. yeah we stopped changing things there late Thursday [21:01:36] bd808: so probably not it [21:02:03] bd808: the dir shows modification time of Jul 3 01:58 . [21:03:23] hrm I hadn't seen anyone mention anything about cleaning out space. We were having some space issues on deployment-tin earlier related to mediawiki got stuff tho. [21:03:36] er git stuff [21:03:43] the first error message about the files gone is from Jul 03 02:03:15 [21:04:20] so looks like around 2am today UTC something just wiped the whole dataset [21:05:05] which is kind of annoying because it takes whole day to build it and several days to load it... and now I need to redo it all from scratch [21:05:40] hrm. I wiped out /srv/mediawiki/.git around that time. that shouldn't be related afaik. [21:05:58] not likely, it's not /data/scratch right? [21:06:01] SMalyshev: madhuvishy says we don't have anything that purposefully cleans /data/scratch [21:06:08] right. [21:06:24] hmmm spooky [21:09:31] ok I'll start rebuilding it but would appreciate any advice about finding out how it could happen... 10G of data just vanishing into thin air shouldn't really happen... [21:25:26] PROBLEM - Puppet errors on castor is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [22:00:25] RECOVERY - Puppet errors on castor is OK: OK: Less than 1.00% above the threshold [0.0] [22:11:58] 10Browser-Tests-Infrastructure, 10Release-Engineering-Team, 10MediaWiki-General-or-Unknown, 10Epic, and 6 others: Port Selenium tests from Ruby to Node.js - https://phabricator.wikimedia.org/T139740#3402695 (10Jdlrobson) [22:55:49] 10Gerrit, 10Release-Engineering-Team (Backlog), 10Scap, 10Patch-For-Review: Deploy gerrit with scap3 - https://phabricator.wikimedia.org/T157414#3402741 (10Paladox) What about having a script on the client that moves the file into place after scapping. Ie like we do with services? [22:57:04] RainbowSprinkles or twentyafterfour hi, could you add operations/softwear/gerrit to phabs rewrites so that https://phabricator.wikimedia.org/r/revision/operations/software/gerrit;4740cc298d0188ebe47843d1502d54e60f4e7b11 works please? [22:58:52] RainbowSprinkles: Is there any other step involved when archiving a repo on Gerrit? Besides the dropdown toggle in the General settings for the repo? [22:59:00] Something in CI or elsewhere.. [22:59:50] Krinkle we add the template archived in ci to repos that are archived [23:00:18] SMalyshev: we didn't touch the server that serves /data/scratch at all that day. [23:01:53] madhuvishy: weird, so how the files disappeared I wonder... I'm the only one who even touches those and I didn't delete them [23:02:09] SMalyshev: yeah it's weird to me too [23:02:24] i'm seeing some files there now but I assume that's you rebuilding the data there [23:05:46] Krinkle: just removing from CI config [23:05:55] And branching configuration if it was deployed [23:17:14] RainbowSprinkles: no ci config, not deployed. [23:26:08] RainbowSprinkles: it's too bad freenode does not allow valid unicode characters such as 😂 for nicks [23:47:23] I know 🤣😂