[00:01:54] 10Tool-Labs: make https://dumps.wikimedia.org/other/wikidata/ available on tool labs - https://phabricator.wikimedia.org/T98655#1273900 (10Legoktm) 3NEW [01:08:09] Coren: yuvipanda: everything holding together OK today? [01:08:19] 6Labs, 10Beta-Cluster, 5Patch-For-Review: Move logs off NFS on beta - https://phabricator.wikimedia.org/T98289#1274035 (10bd808) a:3bd808 I might as well take this at this point. :) [01:08:37] andrewbogott: I'm not seeing anything amiss. Do you notice something odd? [01:09:00] Nope, just worried that I left a few virt nodes with too little swap space when I went to bed last night. [01:09:14] andrewbogott: so far, yeah [01:09:18] Right now a few of them have a bunch of stuff in swap but also a lot of free RAM, which… I guess I don’t understand how swap works :) [01:09:41] Is tools a lot bigger than it was a month ago? In terms of CPU/ram footprint? [05:48:07] !log bots restarted wm-bot [05:48:12] Logged the message, Master [06:30:53] PROBLEM - Puppet failure on tools-exec-1406 is CRITICAL 44.44% of data above the critical threshold [0.0] [06:50:09] PROBLEM - Puppet failure on tools-exec-1403 is CRITICAL 62.50% of data above the critical threshold [0.0] [06:53:29] PROBLEM - Puppet failure on tools-master is CRITICAL 66.67% of data above the critical threshold [0.0] [06:55:54] RECOVERY - Puppet failure on tools-exec-1406 is OK Less than 1.00% above the threshold [0.0] [07:18:31] RECOVERY - Puppet failure on tools-master is OK Less than 1.00% above the threshold [0.0] [07:20:09] RECOVERY - Puppet failure on tools-exec-1403 is OK Less than 1.00% above the threshold [0.0] [08:38:14] PROBLEM - Puppet staleness on tools-shadow is CRITICAL 100.00% of data above the critical threshold [43200.0] [10:14:03] [13intuition] 15zhaofengli opened pull request #42: Remove reflinks (06master...06master) 02https://github.com/Krinkle/intuition/pull/42 [10:20:30] PROBLEM - Puppet staleness on tools-exec-catscan is CRITICAL 100.00% of data above the critical threshold [43200.0] [10:24:14] PROBLEM - Puppet staleness on tools-exec-cyberbot is CRITICAL 100.00% of data above the critical threshold [43200.0] [10:31:53] PROBLEM - Puppet staleness on tools-exec-15 is CRITICAL 100.00% of data above the critical threshold [43200.0] [10:32:15] PROBLEM - Puppet staleness on tools-exec-gift is CRITICAL 100.00% of data above the critical threshold [43200.0] [10:33:12] PROBLEM - Puppet staleness on tools-exec-wmt is CRITICAL 100.00% of data above the critical threshold [43200.0] [10:34:37] PROBLEM - Puppet staleness on tools-exec-13 is CRITICAL 100.00% of data above the critical threshold [43200.0] [10:36:09] PROBLEM - Puppet staleness on tools-exec-08 is CRITICAL 100.00% of data above the critical threshold [43200.0] [10:36:49] PROBLEM - Puppet staleness on tools-exec-14 is CRITICAL 100.00% of data above the critical threshold [43200.0] [10:37:03] PROBLEM - Puppet staleness on tools-exec-07 is CRITICAL 100.00% of data above the critical threshold [43200.0] [10:40:25] PROBLEM - Puppet staleness on tools-exec-02 is CRITICAL 100.00% of data above the critical threshold [43200.0] [14:41:43] andrewbogott_afk: yuvipanda: Any of you know what happened to the rsync? It was chugging along happily without issues up to ~3h ago, then I see it being aborted for some reason just before someone starts hammering on the dumps... [15:51:31] 6Labs, 6operations, 10wikitech.wikimedia.org: labswiki DB does not appear to be accessible in labs replicas - https://phabricator.wikimedia.org/T98683#1274454 (10Krenair) 3NEW [16:03:15] Hm. Is what I type visible to others? [16:04:29] Coren: that was [16:05:38] yep.. [16:31:11] 6Labs, 10Tool-Labs, 10Wikimedia-Labs-General: labswiki isn't replicated on Labs - https://phabricator.wikimedia.org/T89548#1274513 (10scfc) [16:31:13] 6Labs, 6operations, 10wikitech.wikimedia.org: labswiki DB does not appear to be accessible in labs replicas - https://phabricator.wikimedia.org/T98683#1274512 (10scfc) [16:33:52] 6Labs, 10Tool-Labs, 10wikitech.wikimedia.org: labswiki isn't replicated on Labs - https://phabricator.wikimedia.org/T89548#1274517 (10Krenair) [16:38:08] Coren, does ^ sound easy to resolve? [18:40:00] 10Quarry: Seeing all of created queries in one page - https://phabricator.wikimedia.org/T98688#1274554 (10Edgars2007) 3NEW [18:44:48] Krenair: Probably, but Sean would tell you for sure. [18:46:06] ok, thanks [19:16:38] Coren: once puppet installs a ssl cert with install_certificate{ 'my.cert.here': } how do I get it to configure apache to use it? [19:17:47] Negative24: I don't think I've done that with puppet yet; I'm used to old school /etc/apache2/sites-available config. I'm sure there's a parameter with the apache::site resource to specify sslisms. [19:33:03] yuvipanda: the stdeb instructions are horrible :P [19:33:07] must be an open source project [19:37:37] Would it be a good idea to move all erb files from operations-puppet/templates into the operations-puppet/modules//templates directories? That's the new way puppet seems to be doing things now. [19:59:59] yuvipanda: eh, should I duplicate stuff between Build-Depends and Depends: ??? [20:01:14] or maybe just not put it in build-depens [20:09:33] is .bigbrotherrc supports comment (#comment?) [20:12:05] yuvipanda: and of course I can't actually do anything with it on gerrit because I need to push the entire repo :P [20:15:12] yuvipanda: but something like https://github.com/valhallasw/redis-rdb-tools