[01:54:08] specific tools aren't working, is there something that needs to be done for those? [01:54:49] I can see the general tools home page, but not the tools [01:55:45] * sDrewth walks around pushing over the cardboard cutouts that represent people [01:57:04] hmm, seems to be specific tools, has there been problems [01:57:26] https://tools.wmflabs.org/supercount/index.php gives nothing, same with commonshelper [02:00:23] sDrewth: supercount doesnt give any errors [02:00:45] you can get it http? [02:01:34] I just get a spinning 9waiting) icon [02:01:48] Both HTTPS and HTTP work [02:03:18] weird [02:03:58] nothing has been working for certain links for 20+ minutes, and some for others [02:04:17] I will just walk away and bang my head on a door [02:04:22] thx for looking [06:26:19] tools.checker@tools-login:~$ mysql -henwikisource.labsdb enwikisource_p [06:26:20] ERROR 1045 (28000): Access denied for user 'mzmcbride'@'10.68.16.7' (using password: NO) [06:26:27] Why does that fail? [06:27:25] Gloria: cp ~/replica.my.cnf ~/.my.cnf [06:27:56] Gloria: why not just use $ sql enwikisource_p anyways? [06:28:16] legoktm: I'm trying to figure out this fucking checker bug. [06:28:22] It's not getting the page status for some reason. [06:28:44] What's the query? [06:29:50] select cl_to from page join categorylinks on cl_from = page_id where page_id = cl_from and page_namespace = 104 and page_title = 'Dictionary_of_National_Biography._Sup._Vol_I_(1901).djvu/499'; [06:30:42] It's returning data from the MySQL shell... [06:31:57] Does oursql have fetchone()? [06:32:44] yeah, https://pythonhosted.org/oursql/api.html#oursql.Cursor.fetchone [06:33:46] I don't think it likes multiple calls to fetchone(). [06:33:51] That seems to be the issue... [06:34:28] just fetchall() and work over that? [06:34:58] [('Without_text',)] [06:35:07] AttributeError: 'tuple' object has no attribute 'lower' [06:35:33] I guess I need another [0]. [06:51:42] legoktm: I hit a Unicode issue. [06:51:50] traceback? [06:52:08] http://localhost:5000/?db=bnwikisource_p&title=%E0%A6%A8%E0%A6%BF%E0%A6%B0%E0%A7%8D%E0%A6%98%E0%A6%A3%E0%A7%8D%E0%A6%9F%3A%E0%A6%9A%E0%A6%BE%E0%A6%81%E0%A6%A6%E0%A7%87%E0%A6%B0+%E0%A6%AA%E0%A6%BE%E0%A6%B9%E0%A6%BE%E0%A6%A1%E0%A6%BC.djvu is the URL. [06:52:30] http://p.defau.lt/?y5y07WpEb78FGnqm_0KsjQ [06:53:36] * legoktm looks [06:55:09] Gloria: line 116, change page_namespace to page_namespace.decode('utf-8') and possibly the same for `page` or the other way around [07:25:33] Gloria: did it work? [07:32:48] legoktm: Mostly, kinda. [07:33:18] legoktm: https://github.com/legoktm/checker/commit/25e5fc8aba425bf2c3f384d77781f53a1cc8d7bb [07:33:37] And then https://github.com/legoktm/checker/commit/35e4bc2178f4f5fdce8a7abcff8e10189afe61a4 [07:33:40] Now it seems to be working. [07:33:59] I've rekindled my hate for Unicode. [07:34:28] :D [07:34:33] #python2problems [07:35:09] http://tools.wmflabs.org/checker/?db=bnwikisource_p&title=%E0%A6%A8%E0%A6%BF%E0%A6%B0%E0%A7%8D%E0%A6%98%E0%A6%A3%E0%A7%8D%E0%A6%9F%3A%E0%A6%9A%E0%A6%BE%E0%A6%81%E0%A6%A6%E0%A7%87%E0%A6%B0+%E0%A6%AA%E0%A6%BE%E0%A6%B9%E0%A6%BE%E0%A6%A1%E0%A6%BC.djvu \o/ [07:43:45] Yeah. [07:43:52] And I added some sanity checking. [07:43:57] So an invalid DB no longer explodes. [08:35:29] 3Wikimedia Labs / 3tools: Random 503 Service Temporarily Unavailable errors from tools-webproxy - 10https://bugzilla.wikimedia.org/65179 (10metatron) 3UNC p:3Unprio s:3normal a:3Marc A. Pelletier Since yesterday, some new errors randomly occur: 503 Service Temporarily Unavailable followed by The con... [08:37:42] 3Wikimedia Labs / 3tools: Random 503 Service Temporarily Unavailable errors from tools-webproxy - 10https://bugzilla.wikimedia.org/65179#c1 (10MZMcBride) 5UNC>3NEW I think I'm hitting the same issue: $ curl -I "http://tools.wmflabs.org/mzmcbride/" curl: (52) Empty reply from server $ curl -I "http://t... [08:47:43] 3Wikimedia Labs / 3tools: Random 503 Service Temporarily Unavailable errors from tools-webproxy - 10https://bugzilla.wikimedia.org/65179 (10metatron) s:5normal>3major [09:14:41] Coren: can you repro https://bugzilla.wikimedia.org/show_bug.cgi?id=65179? [09:14:44] I can't [09:15:18] YuviPanda: I can easily [09:15:39] well, now it's not doing that :/ [09:15:44] yeaaah [09:15:45] when I said that originally I just got 2 in a row [09:17:48] YuviPanda: right now https://tools.wmflabs.org/wikiviewstats/?locale=de&type=daystats [09:17:57] 503 Service Temporarily Unavailable [09:18:16] I am getting the page [09:18:24] this is super weird [09:18:37] I *did* upgrade nginx yesterday [09:18:39] YuviPanda: that's the joke, after reloading, it's ok [09:18:52] so that might be causing issues [09:19:02] YuviPanda: da logs? [09:23:53] YuviPanda: and now again http://tools.wmflabs.org/catscan2/server-status [09:23:56] (03PS1) 10Alexandros Kosiaris: Add various missing password classes [labs/private] - 10https://gerrit.wikimedia.org/r/132782 [09:24:01] The connection to the server was reset while the page was loading. [09:25:39] and again: http://tools.wmflabs.org/catscan2/catscan2.php -> 503 [09:25:47] (03CR) 10Alexandros Kosiaris: [C: 032] Add various missing password classes [labs/private] - 10https://gerrit.wikimedia.org/r/132782 (owner: 10Alexandros Kosiaris) [09:25:58] (03CR) 10Alexandros Kosiaris: [V: 032] Add various missing password classes [labs/private] - 10https://gerrit.wikimedia.org/r/132782 (owner: 10Alexandros Kosiaris) [09:29:03] bah [09:31:30] YuviPanda: what's the proxy setting for keep alive request ? [11:57:12] 3Wikimedia Labs: Dependencies for @WikiAtlas - 10https://bugzilla.wikimedia.org/65123#c3 (10Peter Bena) Hi, I am on hackaton we are now discussing this together. They don't want to integrate anything into the production cluster, so they don't really need to test this on a beta cluster. What they need is just... [12:09:27] 3Wikimedia Labs: Dependencies for @WikiAtlas - 10https://bugzilla.wikimedia.org/65123#c4 (10Andrew Bogott) Yug -- so, I'm happy to create a new project for you. At that point you'll be able to create and administrate your own virtual servers. As long as you're up for that (it can be a hassle) then that's cle... [12:23:44] andrewbogott: ping [12:23:48] andrewbogott: can I haz new project? [12:23:55] andrewbogott: wait, let me just come find you [12:24:16] I'm in the lobby w/Coren and Silke [13:05:42] 3Wikimedia Labs / 3tools: Set up a tileserver for OSM in Labs - 10https://bugzilla.wikimedia.org/60819 (10Sam Reed (reedy)) p:5Unprio>3Normal s:5normal>3enhanc [13:16:14] 3Wikimedia Labs / 3tools: Provide filearchive table with fa_storage_key or, if it exists and is sufficiently indexed and populated, fa_sha1 for commonswiki - 10https://bugzilla.wikimedia.org/57697 (10Sam Reed (reedy)) s:5normal>3enhanc [13:16:32] 3Wikimedia Labs / 3tools: Copy contents of https://svn.toolserver.org/ to Wikimedia git - 10https://bugzilla.wikimedia.org/58801 (10Sam Reed (reedy)) s:5normal>3enhanc [13:41:42] 3Wikimedia Labs / 3tools: Random 503 Service Temporarily Unavailable errors from tools-webproxy - 10https://bugzilla.wikimedia.org/65179#c2 (10metatron) + a new one Error code: ERR_SSL_PROTOCOL_ERROR also disappears after some reloadings. [14:03:58] 3Wikimedia Labs / 3tools: Random 503 Service Temporarily Unavailable errors from tools-webproxy - 10https://bugzilla.wikimedia.org/65179#c3 (10metatron) Since there's a coincidence with the gzip modification yesterday, how about removing that patch? [15:12:27] 3Wikimedia Labs / 3tools: Random 503 Service Temporarily Unavailable errors from tools-webproxy - 10https://bugzilla.wikimedia.org/65179#c4 (10Yuvi Panda) We also upgraded nginx yesterday, so that might also be the reason. [15:14:42] 3Wikimedia Labs / 3tools: Create postgreqsl user databases on request - 10https://bugzilla.wikimedia.org/63382#c17 (10Arun Ganesh) We require a new postgres database to load public domain shapefiles as part of the Wikimaps Atlas IEG : https://meta.wikimedia.org/wiki/Grants:IEG/Wikimaps_Atlas dbname: wikimap... [15:21:57] 3Wikimedia Labs / 3tools: Create postgresql user databases on request - 10https://bugzilla.wikimedia.org/63382 (10MZMcBride) [15:25:10] YuviPanda: It looks to be a minimally modified version of this: https://ircd-ratbox-ircnet.googlecode.com/svn-history/r2/trunk/doc/example.efnet.conf [15:25:12] …if tha thelps [15:36:30] 3Wikimedia Labs / 3tools: create a node for dexbot service group which runs the user:dexbot - 10https://bugzilla.wikimedia.org/65199 (10Amir Ladsgroup) 3NEW p:3Unprio s:3normal a:3Marc A. Pelletier the bot needs lots of resources to work on this scale and it going to run out of the number of jsub gri... [15:46:02] I keep getting random 500 Internal Server Error from the web proxy :( [15:51:27] me too stwalker|ZRH [15:51:35] actually I'm getting it from the web side [16:04:08] stwalker|ZRH, Magog_the_Ogre, we're going to roll back the nginx version; stay tuned... [16:04:26] kk, thanks [16:10:10] stwalker|ZRH: rolling back now [16:11:18] I am a programmer by occupation, not a sys admin [16:11:24] but I know enough that what you do is scary to me [16:11:33] I could never do it :) [16:12:50] Magog_the_Ogre: stwalker|ZRH can you try now? [16:13:56] it's working now [16:15:02] looks to be working at the moment, yeah :) [16:15:06] thanks YuviPanda [17:37:14] 3Wikimedia Labs / 3tools: Dependencies for @WikiAtlas - 10https://bugzilla.wikimedia.org/65123#c7 (10Tim Landscheidt) 5PAT>3RES/FIX a:3Yuvi Panda I assume WikiAtlas is now going to live (at least for the moment) at http://tools.wmflabs.org/wikiatlas2014/ and this bug can be closed. Welcome! [19:41:34] Are tools and labs proxies treating everyone OK now? [19:48:46] Internal error [19:48:46] The URI you have requested, /geohack/geohack.php?language=pl&pagename=Ziemomy%C5%9Bl_(przystanek_kolejowy)¶ms=53_10_01_N_15_18_09_E_type:city, appears to be non-functional at this time. [19:48:58] Can't see nothing in the topic, so assuming that's news. [19:49:09] Been getting those for a while now... [20:03:34] twkozlowski: It's a 503? Is there reason to think it's a general labs problem vs. an issue with that particular tool? [20:16:46] andrewbogott_afk: No, it returns an error message, but nothing more [20:17:14] quite intermittently, and I can't reproduce it right now [21:00:13] 3Wikimedia Labs / 3tools: Move wiki.toolserver.org to WMF - 10https://bugzilla.wikimedia.org/60220#c25 (10nosy) Is here anything I can help with? [21:04:49] Does anyone know why http://tools.wmflabs.org/enwp10/cgi-bin/list2.fcgi doesn't work? [21:05:10] Looking around the files, /data/project/enwp10/cgi-bin/list2.fcgi exists... [21:06:05] i think any files accessible via http must reside in ~/public_html tree [21:07:42] 3Wikimedia Labs / 3tools: Copy contents of https://svn.toolserver.org/ to Wikimedia git - 10https://bugzilla.wikimedia.org/58801#c12 (10nosy) Tried to copy the svn to /public/backups/toolserver - the mount is read-only. [21:16:13] 3Wikimedia Labs / 3tools: Dependencies for @WikiAtlas - 10https://bugzilla.wikimedia.org/65123#c8 (10Yug) gdal is installed, node v0.8.2 available, should be good for us. Note: node v0.10.25 is now available online, so nodejs may need an update. [21:25:09] Krenair: Don't you need to config lighttp for fcgi? [21:35:37] If it resides outside ~/public_html, yes (AFAIR). [21:37:26] scfc_de: Even inside for fcgi, no? [21:37:55] Uh ... [21:39:53] If it's FCGI, it probably needs to be configured à la https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help#Example_configurations [23:42:33] Just noticed: On April 16th the job #1897 got scheduled, just now () job #821540. That's one job every two seconds if I calculated correctly. Impressive.