[01:59:59] <wikibugs>	 10GitLab, 06collaboration-services: gitlab/devtools: send logs to a new disk - https://phabricator.wikimedia.org/T371066#10034301 (10Dzahn) I made T371573 and if that gets resolved we could also puppetize the mounting of the cinder volume and avoid running the script / mount commands manually.
[15:31:14] <wikibugs>	 10GitLab (CI & Job Runners), 06collaboration-services: (some) Gitlab builds hanging - https://phabricator.wikimedia.org/T371620 (10MatthewVernon) 03NEW
[15:31:23] <wikibugs>	 10GitLab (CI & Job Runners), 06collaboration-services: (some) Gitlab builds hanging - https://phabricator.wikimedia.org/T371620#10035845 (10MatthewVernon) p:05Triage→03High
[18:52:50] <wikibugs>	 10GitLab, 06collaboration-services: gitlab/devtools: send logs to a new disk - https://phabricator.wikimedia.org/T371066#10036549 (10Dzahn)
[19:26:42] <wikibugs>	 10GitLab, 06collaboration-services: gitlab/devtools: send logs to a new disk - https://phabricator.wikimedia.org/T371066#10036625 (10Dzahn) Alright:  - created new 20 GB cinder volume (Horizon) - attached new volume to instance (Horizon) - moved existing contents of /var/log/gitlab temp. to /root/ - ran wmcs-p...
[19:28:01] <wikibugs>	 10GitLab, 06collaboration-services: gitlab/devtools: send logs to a new disk - https://phabricator.wikimedia.org/T371066#10036626 (10Dzahn) This way we don't even need a config change about where logs are going.  All services are running per `gitlab-ctl status`.   Except I am still waiting for https://gitlab.d...
[19:31:01] <wikibugs>	 10GitLab, 06collaboration-services: gitlab/devtools: send logs to a new disk - https://phabricator.wikimedia.org/T371066#10036629 (10Dzahn) 05Open→03In progress
[22:23:53] <wikibugs>	 10GitLab, 06collaboration-services: gitlab/devtools: send logs to a new disk - https://phabricator.wikimedia.org/T371066#10037026 (10Dzahn) Had quite the trouble getting gitlab to start up again and debugged for a while.  Turned out to be permission issues after all (though I had only used "mv" to move thi...
[22:23:56] <wikibugs>	 10GitLab, 06collaboration-services: gitlab/devtools: send logs to a new disk - https://phabricator.wikimedia.org/T371066#10037027 (10Dzahn) 05In progress→03Resolved