[07:17:50] (03PS1) 10Ricordisamoa: Access Wikipedia API via HTTPS [labs/tools/translatemplate] - 10https://gerrit.wikimedia.org/r/312195 [07:19:42] (03CR) 10Ricordisamoa: [C: 032] Access Wikipedia API via HTTPS [labs/tools/translatemplate] - 10https://gerrit.wikimedia.org/r/312195 (owner: 10Ricordisamoa) [07:20:40] 06Labs, 06Operations: cronspam from labscontrol1001, labstore1001, labnet1002.eqiad.wmnet, labsdb1003.eqiad.wmnet - https://phabricator.wikimedia.org/T132422#2658263 (10elukey) About the `gzip: stdin: file size changed while zipping` email: it should be related to the upstart logrotate config. I logged onto `l... [07:23:04] (03CR) 10Ricordisamoa: [V: 032] Access Wikipedia API via HTTPS [labs/tools/translatemplate] - 10https://gerrit.wikimedia.org/r/312195 (owner: 10Ricordisamoa) [07:45:52] PROBLEM - Puppet staleness on tools-k8s-master-01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0] [07:56:54] 10Tool-Labs-tools-Wikidata-Periodic-Table, 10Wikidata: ptable app is broken again! - https://phabricator.wikimedia.org/T142432#2658315 (10Ricordisamoa) Whooooouuuups! I haven't been reading notifications recently... thank you @ArthurPSmith! [07:57:25] (03PS1) 10Ricordisamoa: Access Wikidata API via HTTPS [labs/tools/ptable] - 10https://gerrit.wikimedia.org/r/312200 (https://phabricator.wikimedia.org/T142432) [07:58:22] (03CR) 10Ricordisamoa: [C: 032] Access Wikidata API via HTTPS [labs/tools/ptable] - 10https://gerrit.wikimedia.org/r/312200 (https://phabricator.wikimedia.org/T142432) (owner: 10Ricordisamoa) [07:58:37] (03Merged) 10jenkins-bot: Access Wikidata API via HTTPS [labs/tools/ptable] - 10https://gerrit.wikimedia.org/r/312200 (https://phabricator.wikimedia.org/T142432) (owner: 10Ricordisamoa) [08:00:55] !log tools.heritage Deployed latest from Git, f439ac4, fab9a23, ff37691, 241a27a, 0a45ad0, 1a526a5, 23ce89e (T144772) [08:00:57] T144772: Add Georgia to Monuments database - https://phabricator.wikimedia.org/T144772 [08:01:00] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.heritage/SAL, Master [08:14:16] 10Tool-Labs-tools-Wikidata-Periodic-Table, 10Wikidata: ptable app is broken again! - https://phabricator.wikimedia.org/T142432#2658339 (10Ricordisamoa) 05Open>03Resolved I've added you to https://tools.wmflabs.org/?tool=ptable but someone should also add you to https://gerrit.wikimedia.org/r/#/admin/groups... [08:25:33] 06Labs, 10Tool-Labs: BUB 503: AttributeError: 'module' object has no attribute 'python_2_unicode_compatible' - https://phabricator.wikimedia.org/T144554#2658358 (10Nemo_bis) BUB has been down for almost one month now due to this Labs bug. [09:21:18] (03PS1) 10Lokal Profil: Shell script for extracting the last full log [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/312207 [09:32:00] (03CR) 10Lokal Profil: "I finally collected the commands I used to investigate the logs into a cleaner shell script and figured it could be of use also for others" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/312207 (owner: 10Lokal Profil) [09:42:47] (03CR) 10Lokal Profil: "I took a look at my comments and other than what we call commonscat and updating the Commons page to reflect the used logic my other comme" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/309325 (https://phabricator.wikimedia.org/T114166) (owner: 10Jean-Frédéric) [09:44:17] (03CR) 10Lokal Profil: "Closing two of the comments" (032 comments) [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/309325 (https://phabricator.wikimedia.org/T114166) (owner: 10Jean-Frédéric) [09:50:36] (03CR) 10Lokal Profil: "Closed one more comment" (031 comment) [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/309325 (https://phabricator.wikimedia.org/T114166) (owner: 10Jean-Frédéric) [11:34:43] 06Labs, 10Labs-Infrastructure, 10DBA, 07Upstream: db1069: convert user_groups table to InnoDB across all the wikis - https://phabricator.wikimedia.org/T146121#2658645 (10jcrespo) Yes, ideally everything would be on InnoDB, we probably can only do it on a subset of tables for now. These should be ok in size... [12:44:42] 06Labs: Increase quota for tools project - https://phabricator.wikimedia.org/T146322#2658701 (10Peachey88) [13:23:25] 06Labs, 10Labs-Infrastructure, 10DBA, 07Upstream: db1069: convert user_groups table to InnoDB across all the wikis - https://phabricator.wikimedia.org/T146121#2658770 (10Marostegui) So far I have only converted: `S1: enwiki/user_groups` It all looked fine but I do not want to do more tables at the same t... [13:32:51] (03PS1) 10Lokal Profil: Fix TypeError in call to get_categories_from_upper_categories() [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/312249 [13:34:13] (03CR) 10Jean-Frédéric: [C: 032] Fix TypeError in call to get_categories_from_upper_categories() [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/312249 (owner: 10Lokal Profil) [13:34:55] (03Merged) 10jenkins-bot: Fix TypeError in call to get_categories_from_upper_categories() [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/312249 (owner: 10Lokal Profil) [13:35:36] (03CR) 10Lokal Profil: "Introduced in https://gerrit.wikimedia.org/r/#/c/309324/" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/312249 (owner: 10Lokal Profil) [13:42:48] (03PS4) 10Lokal Profil: Audit-trail of categorization method [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/309325 (https://phabricator.wikimedia.org/T114166) (owner: 10Jean-Frédéric) [13:43:25] (03CR) 10Lokal Profil: "Patch 4 is a manual rebase due to https://gerrit.wikimedia.org/r/312249" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/309325 (https://phabricator.wikimedia.org/T114166) (owner: 10Jean-Frédéric) [13:46:39] (03CR) 10Aklapper: initialisation du fichier gallegre [labs/tools/WikiConvFR-training-2016] - 10https://gerrit.wikimedia.org/r/305864 (owner: 10GAllegre) [13:57:30] (03Abandoned) 10Hashar: Introduce tox as an entry point [labs/tools/crosswatch] - 10https://gerrit.wikimedia.org/r/265735 (owner: 10Hashar) [13:59:40] (03PS1) 10Ricordisamoa: Update Bootstrap from 3.3.6 to 3.3.7, jQuery from 2.1.4 to 3.1.0 [labs/tools/translatemplate] - 10https://gerrit.wikimedia.org/r/312250 [14:01:50] (03CR) 10Ricordisamoa: [C: 032] Update Bootstrap from 3.3.6 to 3.3.7, jQuery from 2.1.4 to 3.1.0 [labs/tools/translatemplate] - 10https://gerrit.wikimedia.org/r/312250 (owner: 10Ricordisamoa) [14:02:06] (03CR) 10Ricordisamoa: [V: 032] Update Bootstrap from 3.3.6 to 3.3.7, jQuery from 2.1.4 to 3.1.0 [labs/tools/translatemplate] - 10https://gerrit.wikimedia.org/r/312250 (owner: 10Ricordisamoa) [14:14:27] (03Abandoned) 10Dzahn: initialisation du fichier gallegre [labs/tools/WikiConvFR-training-2016] - 10https://gerrit.wikimedia.org/r/305864 (owner: 10GAllegre) [14:19:38] (03CR) 10Lokal Profil: [C: 032] "OK. So after splitting of some issues to T146357 the only remaining question is "Is it CommonsCat or Commonscat?"" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/309325 (https://phabricator.wikimedia.org/T114166) (owner: 10Jean-Frédéric) [14:20:16] (03CR) 10jenkins-bot: [V: 04-1] Audit-trail of categorization method [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/309325 (https://phabricator.wikimedia.org/T114166) (owner: 10Jean-Frédéric) [14:24:25] (03CR) 10Jean-Frédéric: [C: 032] Audit-trail of categorization method (032 comments) [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/309325 (https://phabricator.wikimedia.org/T114166) (owner: 10Jean-Frédéric) [14:25:30] (03Merged) 10jenkins-bot: Audit-trail of categorization method [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/309325 (https://phabricator.wikimedia.org/T114166) (owner: 10Jean-Frédéric) [15:09:46] (03CR) 10Lokal Profil: Audit-trail of categorization method (031 comment) [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/309325 (https://phabricator.wikimedia.org/T114166) (owner: 10Jean-Frédéric) [15:39:54] 06Labs, 10Horizon: Figure out type coercion rules for puppet parameter config in horizon UI - https://phabricator.wikimedia.org/T137835#2659288 (10Andrew) I keep looking at this task, and I'm still not sure if there's anything the gui needs to actually do. At the moment, I preserve quote marks that the user e... [15:50:58] 06Labs: certcleaner.py uses ldap instance records. Should instead talk to keystone and nova - https://phabricator.wikimedia.org/T146303#2659313 (10Andrew) that's right. There aren't any tricky permission issues here, just a bit of coding. [15:59:08] hi [15:59:21] is creating a db supposed to take ages or something is wrong? [15:59:36] CREATE DATABASE s123456__wlx_p [15:59:43] is the command correct? [16:00:22] (obviously 123456 is not the number I have in my login) [16:05:24] Base, no, it should be immediate [16:05:36] maybe you got disconnected? [16:05:45] -> [16:05:49] and blinking cursor [16:05:51] is all I see [16:05:53] oh [16:05:58] you lack an ending ; [16:06:00] write that [16:06:19] al sql commands need a final delimiter [16:06:23] Query OK, 1 row affected (0.03 sec) [16:06:24] default one is : [16:06:24] yay [16:06:26] ; [16:06:28] :-) [16:06:28] thanks! [16:06:42] have a look at the mysql guide on wikitech [16:06:49] there are lots of tips [16:07:04] well they don't when in quarry/phpmyadmin :) [16:07:39] I was following that one, but indeed it looks it has the semicolon in it, my bad [16:29:04] !log tools.heritage Deployed latest from Git, 2969082, cb1b318 (T114166) [16:29:05] T114166: ErfgoedBot categorisation edit summaries could be more explicit - https://phabricator.wikimedia.org/T114166 [16:29:07] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.heritage/SAL, Master [16:49:04] 06Labs, 10Tool-Labs: BUB 503: AttributeError: 'module' object has no attribute 'python_2_unicode_compatible' - https://phabricator.wikimedia.org/T144554#2603370 (10yuvipanda) This is because the user seems to have modified their PYTHONPATH in their bashrc to something else: ``` tools.bub@tools-bastion-03:~$ e... [17:33:34] 10Labs-Kubernetes, 06Community-Tech, 06Wikisource: Make Google OCR API on Tool Labs work under Kubernetes - https://phabricator.wikimedia.org/T146311#2659611 (10bd808) I'm not 100% sure this is isolated to the kubernetes runtime: ``` tools.ws-google-ocr@tools-bastion-02:~$ tail -50 error.log 2016-09-22 06:50... [18:03:04] 06Labs: Update or remove certcleaner.py - https://phabricator.wikimedia.org/T146303#2659748 (10Andrew) [18:03:37] 06Labs: Update or remove certcleaner.py - https://phabricator.wikimedia.org/T146303#2656822 (10Andrew) Proposed: modify the certcleaner so it logs or emails when it deletes things. Then see if it's actually deleting anything. [18:52:21] hi all, am I right in guessing that with the creation of a user db could mean a bit of a delay before something like MySQL Workbench sees the schema? [18:52:57] I can use dbname; when ssh'd in though [18:53:32] I don't know about MySQL Workbench specifically [18:53:56] If you create your own DB, I'd expect mysql to start showing it immediately [18:55:25] I'll create a table in it, might prompt Workbench into finding it [20:47:19] Does Labs have some kind of backup place that I can scp to? I need a place to store private config files for my labs project and it would be a pain to have to recreate them if all my project's labs instances got deleted accidentally, or became unrecoverable, etc. [21:03:21] 06Labs, 10Continuous-Integration-Infrastructure, 06Operations, 07Nodepool: Upgrade Nodepool to 0.1.1-wmf5 to reduce requests made to OpenStack API - https://phabricator.wikimedia.org/T145142#2621216 (10Dzahn) ``` root@carbon:~/nodepool# diff -ru 4/ 5/ diff -ru 4/usr/lib/python2.7/dist-packages/nodepool/pro... [21:10:07] 06Labs, 10Continuous-Integration-Infrastructure, 06Operations, 07Nodepool: Upgrade Nodepool to 0.1.1-wmf5 to reduce requests made to OpenStack API - https://phabricator.wikimedia.org/T145142#2660496 (10hashar) 05Open>03Resolved a:05hashar>03Dzahn I stopped Nodepool. Daniel apt-get installed. Done... [21:22:50] 06Labs, 06Operations, 13Patch-For-Review: Phase out the 'puppet' module with fire, make self hosted puppetmasters use the puppetmaster module - https://phabricator.wikimedia.org/T120159#2660522 (10yuvipanda) So, https://wikitech.wikimedia.org/wiki/Standalone_puppetmaster exists now. It is based off the puppe... [21:34:13] 10Labs-Kubernetes, 06Wikisource, 03Community-Tech-Sprint: Make Google OCR API on Tool Labs work under Kubernetes - https://phabricator.wikimedia.org/T146311#2660579 (10kaldari) [21:42:05] 10Quarry: it would be useful to run the same Quarry query conveniently in several database - https://phabricator.wikimedia.org/T95582#1195035 (10Quiddity) This feature would be incredibly helpful, IIUC. I have two tasks that require checking things across all our projects, and I don't know how else to do it, oth... [22:47:23] RECOVERY - Host tools-secgroup-test-103 is UP: PING OK - Packet loss = 0%, RTA = 0.62 ms [22:48:43] PROBLEM - Host tools-secgroup-test-103 is DOWN: CRITICAL - Host Unreachable (10.68.21.22) [23:02:28] RECOVERY - Host tools-secgroup-test-102 is UP: PING OK - Packet loss = 0%, RTA = 0.62 ms [23:10:29] PROBLEM - Host tools-secgroup-test-102 is DOWN: CRITICAL - Host Unreachable (10.68.21.170) [23:12:01] RECOVERY - Host secgroup-lag-102 is UP: PING OK - Packet loss = 0%, RTA = 1.01 ms [23:16:11] PROBLEM - Host secgroup-lag-102 is DOWN: CRITICAL - Host Unreachable (10.68.17.218) [23:43:27] 10Quarry: it would be useful to run the same Quarry query conveniently in several database - https://phabricator.wikimedia.org/T95582#1195035 (10yuvipanda) @Quiddity having some form of official resources dedicated to it might be helpful. I unfortunately don't think I'll have any bandwidth to be able to look at... [23:47:50] PROBLEM - Puppet run on tools-services-01 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0]