[02:44:17] !log deployment-prep Restarted logstash on deployment-logstash1; last even logged at 2014-06-06T22:11:04 [02:44:21] Logged the message, Master [05:33:36] YuviPanda|zzz: I need to debug another :/ https://tools.wmflabs.org/liangent-php/index.php/zhwiki?title=Special:%E5%85%A8%E5%9F%9F%E5%B0%81%E7%A6%81%E5%88%97%E8%A1%A8 [05:55:16] 3Wikimedia Labs / 3tools: Create views for global_block_whitelist table - 10https://bugzilla.wikimedia.org/66309 (10Liangent) 3NEW p:3Unprio s:3normal a:3Marc A. Pelletier This table only contains publicly available data (on [[Special:GlobalBlockList]]), ex: 2014-06-06T15:41:43: Tegel (meta.wikimedia... [06:03:13] 3Wikimedia Labs / 3tools: Create views for global_block_whitelist table - 10https://bugzilla.wikimedia.org/66309#c1 (10Liangent) 5NEW>3RESO/INV My fault. Didn't add it to my own table list in tools. [06:33:44] 3Wikimedia Labs / 3tools: Add some of the missing tables in wikidatawiki_f_p - 10https://bugzilla.wikimedia.org/59682#c5 (10merl) 5RESO/FIX>3REOP Still some tables missing: $mysql -hs2.labsdb -e "show tables from wikidatawiki_f_p like 'wb\_%'" +------------------------------------+ | Tables_in_wikidataw... [10:44:03] is it okay to put large data (GB or more) into tools-redis? [10:44:55] whym: why would you want to store that much info? [10:46:41] Betacommand: I wanted to maintain a simple key-value database to hold an external dataset (periodically updated) [10:47:04] whym: then use a database [10:48:00] Betacommand: is redis more for temporary use? [10:48:09] yeah [10:48:10] in a smaller scale [10:48:40] all right, thanks, Betacommand [10:48:43] or for moving data/queues between scripts [10:49:34] and a db would provide better stability and more options [11:12:49] whym: tools-redis is not persistent, your data could disappear at any time [11:17:16] who runs wikistream-wmflabs ? [11:17:51] and who runs wikichanges-aed12128-c392-418e-8d9d-d0eda42a22fb ? [11:18:20] both of these heavily clutter rc channels with repetitive reconnecting and disconnecting due to excessive flood [11:19:13] you could just ignore that [11:26:32] gifti: can't ignore it when it rolls out the real messages [11:41:39] legoktm: ok, I'll try tools-db or soem file-based db [11:41:51] ^some [11:42:07] Danny_B: no, i mean technically [12:22:14] 3Wikimedia Labs / 3tools: Add some of the missing tables in wikidatawiki_f_p - 10https://bugzilla.wikimedia.org/59682#c6 (10Marc A. Pelletier) Oh yeah, oops; when I added those to replication I have forgotten to also add them to federation. [14:49:36] !log local-heritage Fixed populate_adm_tree.php and populated the table. Still need to commit it [14:49:40] Logged the message, Master [15:04:53] !log local-heritage Symlinked ~/public_html/maintenance and create tables statistics and statisticsct. jsubbed build_stats_test to test it [15:04:55] Logged the message, Master [15:11:34] Alchimista_: Done bouncing around? [15:12:18] multichill: yap, i was having a week net conection [15:35:40] !log local-heritage Had to increase memory for statitics to 512M. Still need to commit that. jsubbed build_stats_test again and it finished with Memory usage: 396588928 [15:35:42] Logged the message, Master [15:52:28] !log local-heritage symlinked ~/prox_search, fixed path (need to commit that), create_table_prox_search.sql , doing manual run [15:52:30] Logged the message, Master [16:06:43] !log local-heritage prox_search completed without problems. update_monuments.sh should now run without failures. [16:06:44] Logged the message, Master [16:12:54] !log local-heritage http://toolserver.org/~erfgoed/ now redirects to http://tools.wmflabs.org/heritage/ . Didn't move everything so that might give some 404's [16:12:56] Logged the message, Master [16:32:02] legoktm: whym_away tools-redis *is* persistent, but you shouldn't put valuble data in it. If in the future we delete all of it and bring it back again it shouldn't cause data loss [16:36:31] 3Tool Labs tools / 3Commons Delinker: Bot leaves empty {{vector version available|}} templates - 10https://bugzilla.wikimedia.org/66327 (10Brian MacIntosh) 3UNCO p:3Unprio s:3normal a:3None I was just checking [[Category:Vector version available/error]] and I noticed that most of the errors there are... [16:57:52] !log local-heritage While updating documentation I found https://git.wikimedia.org/summary/wikimedia%2Fwlm-api . Should probably be dropped, everything is in http://git.wikimedia.org/log/labs%2Ftools%2Fheritage.git [16:57:54] Logged the message, Master [19:09:46] hi. which is the best module for python interprocess locks ? [19:22:27] rohit-dua: multiprocessing should have something to do that [19:22:49] https://docs.python.org/2/library/multiprocessing.html#synchronization-between-processes [19:24:28] valhallasw: well they are if we start processes from 1 parent processes. but my 2 processes are independent from each other.. [19:59:02] rohit-dua: there might be some primitives in the library you can use? [19:59:21] you can also do simple file locking, I guess, but then both processes still hav eto be on the same machine [19:59:43] valhallasw: well I'm using redis based lock (key value based) :) [20:00:04] maybe use redis? http://redis.io/commands/setnx [20:00:06] ah [20:05:15] valhallasw: you run the gerrit patch uploader correct? [21:54:06] how can we send html email using exim from tools. [21:54:17] Betacommand: yes [21:54:51] rohit-dua: I think you'll have to do multipart mime manually (or using python, for example). [21:55:11] but html email is notoriously hard :-p [21:55:34] valhallasw: i just want to add links to my text [21:55:37] valhallasw: One minor tweak, can you have it remember the product/branch that you last committed to and have it as the default for the next patch? [21:56:28] it remembers the product already [21:56:55] valhallasw: and in patch set #1 of https://gerrit.wikimedia.org/r/#/c/138209/ it uploaded a .orig file and Im not sure why [21:56:55] and last time I checked it was not possible to select a branch at all [21:57:15] valhallasw: IE pywikibot vs pywikibot/core [21:57:42] Betacommand: probably a broken patch you uploaded? [21:58:02] the patch uploader just runs patch -p0 < file [21:58:16] and I'm not sure what you mean with pywikibot vs pywikibot/core [21:58:23] !paste [21:58:24] http://tools.wmflabs.org/paste/ [21:58:47] valhallasw: https://tools.wmflabs.org/paste/view/ef3f3040 was the patch I uploaded [21:59:38] pywikibot vs pywikibot/core see your "projects" dropdown [22:00:58] I still have no clue what you mean. [22:02:45] I guess its more of just remembering the "product" value [22:03:03] I don't get the problem - it's already remembering it! [22:03:51] if it doesn't, that's a bug [22:04:42] oh, wait. [22:04:47] it just remembers the username, not the project [22:05:32] Yeah [22:06:41] ok, https://github.com/valhallasw/gerrit-patch-uploader/issues/18 [22:07:09] time for bed now [22:07:12] valhallasw: thanks [22:20:23] YuviPanda|zzz: won't tools-redis evict keys once it runs out of space? [22:25:44] i have a job stuck in error state because argument list is too long whereas when i execute it manually it just runs fine, is there any trick with which i can circumvent that? [23:26:14] 3Tool Labs tools / 3Commons Delinker: Bot leaves empty {{vector version available|}} templates - 10https://bugzilla.wikimedia.org/66327 (10Steinsplitter) 5UNCO>3NEW s:5normal>3enhanc