[07:46:08] !log tools T196137 more rootspam today, restarting again `prometheus-node-exporter` and force rotating exim4 paniclog in 12 nodes [07:46:10] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [07:46:11] T196137: toolforge: prometheus issue is filling up email queue - https://phabricator.wikimedia.org/T196137 [08:30:57] !log wikibase-registry query service or something seems down [08:30:58] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikibase-registry/SAL [08:31:09] !log wikibase-registry docker-compose restart wdqs-proxy [08:31:09] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikibase-registry/SAL [08:31:12] !log wikibase-registry docker-compose restart wdqs-frontend [08:31:13] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikibase-registry/SAL [08:31:30] !log wikibase-registry All fixed [08:31:31] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikibase-registry/SAL [08:38:27] (03PS1) 10Arturo Borrero Gonzalez: hieradata: openstack: add new placeholder password [labs/private] - 10https://gerrit.wikimedia.org/r/438208 (https://phabricator.wikimedia.org/T196633) [08:39:01] (03CR) 10Arturo Borrero Gonzalez: [V: 032 C: 032] hieradata: openstack: add new placeholder password [labs/private] - 10https://gerrit.wikimedia.org/r/438208 (https://phabricator.wikimedia.org/T196633) (owner: 10Arturo Borrero Gonzalez) [09:01:00] (03PS1) 10Arturo Borrero Gonzalez: openstack: eqiad1: add even more passwords placeholders [labs/private] - 10https://gerrit.wikimedia.org/r/438214 (https://phabricator.wikimedia.org/T196633) [09:07:32] (03PS2) 10Arturo Borrero Gonzalez: openstack: eqiad1: more placeholders fixes [labs/private] - 10https://gerrit.wikimedia.org/r/438214 (https://phabricator.wikimedia.org/T196633) [09:07:43] (03CR) 10Arturo Borrero Gonzalez: [V: 032 C: 032] openstack: eqiad1: more placeholders fixes [labs/private] - 10https://gerrit.wikimedia.org/r/438214 (https://phabricator.wikimedia.org/T196633) (owner: 10Arturo Borrero Gonzalez) [11:09:24] (03PS1) 10Arturo Borrero Gonzalez: openstack: eqiad1: add placeholders required for keystone [labs/private] - 10https://gerrit.wikimedia.org/r/438226 (https://phabricator.wikimedia.org/T196633) [11:09:53] (03CR) 10Arturo Borrero Gonzalez: [V: 032 C: 032] openstack: eqiad1: add placeholders required for keystone [labs/private] - 10https://gerrit.wikimedia.org/r/438226 (https://phabricator.wikimedia.org/T196633) (owner: 10Arturo Borrero Gonzalez) [19:02:51] !log tools.totoazero "qstat" says that job 3838834 maj_articles_recents is live still 04/13/2018 (?) but logs indicate that it's currently stuck, so "qdel 3838834", cron has restarted it and it's editing again [19:02:52] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.totoazero/SAL [20:18:27] !log tools.stewardbots Updated stewardbots to 5ec794e [20:18:28] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stewardbots/SAL