[01:25:22] PROBLEM - Puppet errors on tools-exec-1430 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [01:55:23] RECOVERY - Puppet errors on tools-exec-1430 is OK: OK: Less than 1.00% above the threshold [0.0] [02:34:32] PROBLEM - Puppet errors on tools-exec-1436 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [03:09:31] RECOVERY - Puppet errors on tools-exec-1436 is OK: OK: Less than 1.00% above the threshold [0.0] [03:30:32] PROBLEM - Puppet errors on tools-exec-1436 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [04:10:31] RECOVERY - Puppet errors on tools-exec-1436 is OK: OK: Less than 1.00% above the threshold [0.0] [06:32:32] PROBLEM - Puppet errors on tools-exec-1436 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [06:40:54] PROBLEM - Puppet errors on tools-exec-1435 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [06:46:55] (03CR) 10Lokal Profil: "note to self: just need to change the country label for the three Canada files" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/342198 (https://phabricator.wikimedia.org/T165759) (owner: 10Lokal Profil) [06:55:16] (03PS11) 10Lokal Profil: Build fill_table_monuments_all.sql from the json configs [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/342198 (https://phabricator.wikimedia.org/T165759) [07:07:29] RECOVERY - Puppet errors on tools-exec-1436 is OK: OK: Less than 1.00% above the threshold [0.0] [07:20:53] RECOVERY - Puppet errors on tools-exec-1435 is OK: OK: Less than 1.00% above the threshold [0.0] [07:34:32] (03CR) 10Lokal Profil: "note to self:" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/342198 (https://phabricator.wikimedia.org/T165759) (owner: 10Lokal Profil) [08:26:18] bd808: madhuvishy: It seems the sql access on tools for 'denisa' isn't working. [08:26:24] replica.my.cnf exists and looks fine [08:26:35] (although contrary to mine there are spaces around '=' and values not quoted) [08:26:41] but 'sql enwiki' returns "Denied" [08:26:55] From tools-bastion-03 [08:27:55] Krinkle: I'm looking, when was the user created? [08:28:06] Yesterday, approved by bd808 [08:28:24] aah, okay investigating [08:31:55] madhuvishy: Also tried having her create tool (tools.denisa) and trying from within there, but getting a similar error. [08:32:10] Krinkle: yeah the service is erroring out, I'm fixing [08:32:15] "Access denied for user .... using password: YES" [08:32:20] madhuvishy: okay, thanks [08:41:05] Krinkle: should be fixed now, can you check? [08:41:16] Okay [08:41:20] both users should work [08:45:00] (03PS12) 10Lokal Profil: Build fill_table_monuments_all.sql from the json configs [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/342198 (https://phabricator.wikimedia.org/T165759) [09:08:44] 06Labs: Tool videoconvert is using 1.034TB/8TB of tools NFS storage - https://phabricator.wikimedia.org/T165806#3278321 (10madhuvishy) @Lokal_Profil @Prolineserver Can you take a look at this asap? [09:13:45] !log wikilabels staging wikilabels-wmflabs-deploy:4516de3 [09:13:47] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikilabels/SAL [09:17:53] !log wikilabels staging wikilabels-wmflabs-deploy:bd9f7f0 [09:17:55] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikilabels/SAL [09:26:55] !log videoconvert Truncating jerr.log since it's 967GB [09:26:55] madhuvishy: Unknown project "videoconvert" [09:26:56] madhuvishy: Did you mean to say "tools.videoconvert" instead? [09:27:11] !log tools Truncating jerr.log for tool videoconvert since it's 967GB [09:27:11] !log wikilabels deployed wikilabels-wmflabs-deploy:bd9f7f0 [09:27:14] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [09:27:16] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikilabels/SAL [09:32:49] 06Labs: Tool videoconvert is using 1.034TB/8TB of tools NFS storage - https://phabricator.wikimedia.org/T165806#3278430 (10madhuvishy) I truncated jerr.log (https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL) since it was 967 GB, and since I did that it has grown to 700 MB, it seems like this file is gr... [09:38:37] 06Labs: Tool videoconvert is using 1.034TB/8TB of tools NFS storage - https://phabricator.wikimedia.org/T165806#3278446 (10madhuvishy) It's now at 2G. I've owned the file to root:root, and will revert when this is fixed. [09:43:00] 06Labs, 06Project-Admins, 15User-bd808, 06wmcs-team (Kanban): Create wmcs-team project and kanban milestone - https://phabricator.wikimedia.org/T165703#3278454 (10Aklapper) The wm prefix seems to be redundant and I am not entirely happy about anything that looks a lot like a chapter name (we have WMSE and... [09:50:57] 06Labs, 06Project-Admins, 15User-bd808, 06wmcs-team (Kanban): Create wmcs-team project and kanban milestone - https://phabricator.wikimedia.org/T165703#3274341 (10greg) See https://wikitech.wikimedia.org/wiki/User:BryanDavis/Rebranding_Cloud_Services_products for the proposed overall naming scheme. [09:54:57] 10Labs-project-Wikistats: Add pa.wikisource to WikiStats - https://phabricator.wikimedia.org/T164798#3278511 (10Dereckson) @Dzahn I think this is the last step before we can mark the wiki creation as solved. [10:50:05] (03PS1) 10Jean-Frédéric: Use cl_sortkey_prefix in populate_image SQL query [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/354661 [11:16:52] 10Labs-project-Phabricator: Date problem on phab-01.wmflabs.org, comments timestamp was reset - https://phabricator.wikimedia.org/T165679#3278790 (10Aklapper) Hmm, which problems created by this wrong behavior make this is an urgent (=high priority) issue? [11:18:50] 10Tool-Labs-tools-Xtools, 06Community-Tech, 07Epic: Epic: Rewrite Xtools: RfX Vote Calculator - https://phabricator.wikimedia.org/T165710#3278794 (10Aklapper) [11:18:56] 10Tool-Labs-tools-Xtools, 06Community-Tech, 07Epic: Epic: Rewrite Xtools: RfX Analysis - https://phabricator.wikimedia.org/T165709#3278795 (10Aklapper) [11:45:43] Hi. Is there anyone who can help me to put a python script on cron job? What files should I create and what commands to type to send to grid? The documentation is not very clear, it assumes you already know about this, but if you know almost nothing about crontabs it's not easy. [11:45:45] Should I create a cron file? I've tried manually. But where should I put it - in the root of my tool account or anywhere? How to introduce PATH? Probably this is the main problem. Let's assume I have my script is in /data/project/mytool/myscript.py Can anyone tell me what to do to make this script executed at the desired time? Thanks in advance. [11:49:07] Dan_1591: It should go into the crontab. Type "crontab -e" [11:49:22] Dan_1591: basically executing crontab -e should open a crontab editor, you can run that as your tool, /I think/ but I would need to check, crontabs might be disabled on login server [11:54:44] well, they are enabled but for tools only, so switch to your tool (become ) and then you can edit crontab [11:55:33] if it's a python script that is meant to run on certain time, you probably want to cron the jsub command which executes your command on a grid [11:56:41] Yes, I need to introduce something like this: 30 * * * * jsub -once python /data/project/mytool/myscript.py >/dev/null 2>&1 [11:57:28] but editing crontab -e by a Windows user in Putty is not really a user friendly thing [11:58:43] 10Tool-Labs-tools-Xtools: Xtools labels pages as deleted even if they aren't - https://phabricator.wikimedia.org/T165864#3278844 (10Niharika) [12:05:18] Dan_1591: You just need to add the line to the top. Something like "09 00 * * 1 jsub -N cron-tools.database-reports-2 -quiet python abc.py" [12:12:56] 06Labs: Tool videoconvert is using 1.034TB/8TB of tools NFS storage - https://phabricator.wikimedia.org/T165806#3278936 (10madhuvishy) @Prolineserver Repeated PHP stacktraces that look like this: ``` PHP Stack trace: PHP 1. {main}() /mnt/nfs/labstore-secondary-tools-project/videoconvert/public_html/server/php... [12:19:11] (03CR) 10Multichill: [C: 032] Use cl_sortkey_prefix in populate_image SQL query [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/354661 (owner: 10Jean-Frédéric) [12:21:39] (03Merged) 10jenkins-bot: Use cl_sortkey_prefix in populate_image SQL query [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/354661 (owner: 10Jean-Frédéric) [12:23:04] (03CR) 10jenkins-bot: Use cl_sortkey_prefix in populate_image SQL query [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/354661 (owner: 10Jean-Frédéric) [12:31:54] 10Tool-Labs-tools-Xtools: Xtools labels pages as deleted even if they aren't - https://phabricator.wikimedia.org/T165864#3278844 (10MusikAnimal) Some of those were deleted sometime after Kaldari created it, then recreated by someone else ([[ https://en.wikipedia.org/wiki/Līlāvatī | Līlāvatī ]], for instance), wh... [12:38:40] Niharika ok I've managed to create cron file from crontab -e. File was saved, I can see it. But now crontab -l shows "no crontab for my_tool". I must send it to grid somehow, or it was automatically sent? [12:42:33] 06Labs: nova-fullstack is losing instances on creation - https://phabricator.wikimedia.org/T165555#3279124 (10Aklapper) [12:43:58] 10Labs-project-Phabricator: Date problem on phab-01.wmflabs.org, comments timestamp was reset - https://phabricator.wikimedia.org/T165679#3279128 (10Framawiki) This problem happened on one of the beta instance, but it would be really problematic if it comes on production: It would send a lot of emails and change... [12:45:55] 10Labs-project-Phabricator: Date problem on phab-01.wmflabs.org, comments timestamp was reset - https://phabricator.wikimedia.org/T165679#3279130 (10Framawiki) [12:54:20] 10Labs-project-Wikistats, 10Analytics, 10Analytics-Wikistats, 10Pywikibot-core, and 2 others: wikistats.py seems broken - https://phabricator.wikimedia.org/T165830#3279160 (10Multichill) https://wikistats.wmflabs.org/api.php?action=dump&table=wikipedias&format=csv returns an empty file. I'll ask around to... [12:54:49] 06Labs, 10Tool-Labs, 10Wikimedia-Hackathon-2017: Intro to Cloud Services (Labs, Tool Labs, database replicas, oh my) - https://phabricator.wikimedia.org/T164814#3279163 (10Andrew) https://etherpad.wikimedia.org/p/hack17wmcs [12:55:37] (03CR) 10Jean-Frédéric: [C: 032] Build fill_table_monuments_all.sql from the json configs [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/342198 (https://phabricator.wikimedia.org/T165759) (owner: 10Lokal Profil) [12:57:06] (03Merged) 10jenkins-bot: Build fill_table_monuments_all.sql from the json configs [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/342198 (https://phabricator.wikimedia.org/T165759) (owner: 10Lokal Profil) [12:58:15] (03CR) 10jenkins-bot: Build fill_table_monuments_all.sql from the json configs [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/342198 (https://phabricator.wikimedia.org/T165759) (owner: 10Lokal Profil) [13:01:39] 06Labs, 10Tool-Labs: Update maintain-kubeusers to allow tool's to write to $HOME/.kube - https://phabricator.wikimedia.org/T165875#3279230 (10bd808) [13:05:52] 10Labs-project-Wikistats, 10Analytics, 10Analytics-Wikistats, 10Pywikibot-core, and 2 others: wikistats.py seems broken - https://phabricator.wikimedia.org/T165830#3279264 (10Multichill) project-wikistats:*:50338:jem,robih,southparkfan,marc,novaadmin,mschon,paladox,mah,dzahn,andrew . Seems to be a voluntee... [13:25:51] Change on 12www.mediawiki.org a page OAuth/For Developers was modified, changed by Maxlath link https://www.mediawiki.org/w/index.php?diff=2471981 edit summary: /* Libraries */ fixed hierarchy [13:31:13] 10Labs-project-Wikistats, 10Analytics, 10Analytics-Wikistats, 10Pywikibot-core, and 2 others: wikistats.py seems broken - https://phabricator.wikimedia.org/T165830#3279422 (10Multichill) https://en.wikisource.org/w/index.php?title=Page%3A06-24-1920_-The_Story_of_the_Jones_County_Calf_Case.pdf%2F9&type=revi... [13:31:35] 10Labs-project-Wikistats, 10Analytics, 10Analytics-Wikistats, 10Pywikibot-core, and 2 others: wikistats.py seems broken - https://phabricator.wikimedia.org/T165830#3279424 (10Multichill) a:03Multichill [13:33:04] Change on 12www.mediawiki.org a page OAuth/For Developers was modified, changed by Maxlath link https://www.mediawiki.org/w/index.php?diff=2471986 edit summary: /* Registration */ [13:34:24] Change on 12www.mediawiki.org a page OAuth/For Developers was modified, changed by Tgr (WMF) link https://www.mediawiki.org/w/index.php?diff=2471988 edit summary: [13:35:56] (03PS1) 10Lokal Profil: Pin a version of pywikibot [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/354690 [13:40:51] 06Labs: Tool videoconvert is using 1.034TB/8TB of tools NFS storage - https://phabricator.wikimedia.org/T165806#3279452 (10Prolineserver) @madhuvishy Can you revert the permissions now? [13:43:22] (03PS2) 10Lokal Profil: Pin a version of pywikibot [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/354690 [13:45:10] 06Labs: Tool videoconvert is using 1.034TB/8TB of tools NFS storage - https://phabricator.wikimedia.org/T165806#3279460 (10madhuvishy) @Prolineserver done [13:48:54] (03PS1) 10Jean-Frédéric: Extract paths to constant in execution bin script [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/354693 [13:52:51] 06Labs, 06Operations, 07Puppet: Create a cron to clean clientbucket every day or hour - https://phabricator.wikimedia.org/T165885#3279509 (10Paladox) [13:54:06] (03PS2) 10Jean-Frédéric: Extract paths to constant in execution bin script [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/354693 [13:54:26] (03CR) 10Jean-Frédéric: [C: 032] Pin a version of pywikibot [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/354690 (owner: 10Lokal Profil) [13:54:27] 06Labs, 06Operations, 07Puppet: Create a cron to clean clientbucket every day or hour - https://phabricator.wikimedia.org/T165885#3279530 (10Paladox) [13:56:54] (03Merged) 10jenkins-bot: Pin a version of pywikibot [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/354690 (owner: 10Lokal Profil) [14:12:47] (03CR) 10jenkins-bot: Pin a version of pywikibot [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/354690 (owner: 10Lokal Profil) [14:27:24] 10Labs-project-Wikistats: Add pa.wikisource to WikiStats - https://phabricator.wikimedia.org/T164798#3279643 (10Dzahn) 05Open>03Resolved @Dereckson done rank 60 on http://wikistats.wmflabs.org/display.php?t=ws http://wikistats.wmflabs.org/detail.php?t=ws&id=75 [14:29:48] 06Labs, 06Operations, 07Puppet: Create a cron to clean clientbucket every day or hour - https://phabricator.wikimedia.org/T165885#3279670 (10Dzahn) https://ask.puppet.com/question/132/does-filebucket-need-periodic-maintenance-cleaning/ https://bugzilla.mozilla.org/show_bug.cgi?id=624166 [14:30:33] (03CR) 10Lokal Profil: [C: 032] Extract paths to constant in execution bin script [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/354693 (owner: 10Jean-Frédéric) [14:38:21] (03Merged) 10jenkins-bot: Extract paths to constant in execution bin script [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/354693 (owner: 10Jean-Frédéric) [14:42:23] bd808: Lucas_WMDE had some questions on setting up a Mediawiki instance to demo his extension on Labs and was wondering what the best way was [14:42:51] Do we have a better recommendation than set it up on a new labs instance? [14:43:30] PROBLEM - Puppet errors on tools-webgrid-lighttpd-1420 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [14:44:01] !log ores staging ores-wmflabs-deploy:ed1991c [14:44:04] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Ores/SAL [14:47:22] !log ores staging ores-wmflabs-deploy:9df7b5a [14:47:25] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Ores/SAL [14:51:10] 10Labs-project-Wikistats, 10Analytics, 10Analytics-Wikistats, 07Regression: Wikistats 2.2 [beta] gives internal server error 500 for all csv, ssv and xml formats - https://phabricator.wikimedia.org/T165879#3279711 (10Multichill) [14:53:29] 06Labs: Tool videoconvert is using 1.034TB/8TB of tools NFS storage - https://phabricator.wikimedia.org/T165806#3279730 (10Prolineserver) 05Open>03Resolved a:03Prolineserver Fixed it for now, only a single place caused the error. I added a check for a false directory handle though I can't reproduce where i... [14:54:47] 10Labs-project-Wikistats, 10Analytics, 10Analytics-Wikistats, 07Regression: Wikistats 2.2 [beta] gives internal server error 500 for all csv, ssv and xml formats - https://phabricator.wikimedia.org/T165879#3279335 (10Paladox) Hmm, i get this [Sat May 20 14:40:43.698258 2017] [:error] [pid 24237] [client... [14:55:46] 06Labs, 10Tool-Labs: templatetiger is using 613G in Tools out of 8T - https://phabricator.wikimedia.org/T136192#3279736 (10Kolossos) Cleaned up to 95 GB. [14:59:37] 10Labs-project-Wikistats, 10Analytics, 10Analytics-Wikistats, 07Regression: Wikistats 2.2 [beta] gives internal server error 500 for all csv, ssv and xml formats - https://phabricator.wikimedia.org/T165879#3279754 (10Paladox) Found it, it was caused by https://github.com/wikimedia/operations-debs-wikistat... [15:04:29] (03CR) 10jenkins-bot: Extract paths to constant in execution bin script [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/354693 (owner: 10Jean-Frédéric) [15:18:31] RECOVERY - Puppet errors on tools-webgrid-lighttpd-1420 is OK: OK: Less than 1.00% above the threshold [0.0] [15:50:49] Lucas_WMDE: I was talking to bd808 and he suggested using Mediawiki Vagrant on labs https://wikitech.wikimedia.org/wiki/Help:MediaWiki-Vagrant_in_Labs [15:51:37] feel free to request a new Labs project or spin up an instance in an existing wikidata related project if that is relevant [15:52:46] https://wikitech.wikimedia.org/wiki/Help:Getting_Started#Getting_started_with_VPS_Projects for how to request a project/create an instance [16:10:10] madhuvishy: thanks, I’ll get started with the project and check see if I can find one of you in the next room if I get stuck :) [16:10:37] Lucas_WMDE: cool :) you can always ping me here and I can show up too! [16:14:25] actually, it looks like the wikidata-dev project is general-purpose enough that I should add my project to it… I’ll just find one of the admins running around here [16:18:59] Lucas_WMDE: cool, let me know if you need anything :) [16:29:27] 10Labs-project-Wikistats, 10Analytics, 10Analytics-Wikistats, 13Patch-For-Review, 07Regression: Wikistats 2.2 [beta] gives internal server error 500 for all csv, ssv and xml formats - https://phabricator.wikimedia.org/T165879#3279335 (10Milimetric) Just for the record, *this* Wikistats bears no relation... [16:31:15] 10Labs-project-Wikistats, 13Patch-For-Review: Wikistats 2.2 [beta] gives internal server error 500 for all csv, ssv and xml formats - https://phabricator.wikimedia.org/T165879#3280072 (10Dzahn) [16:31:57] 10Labs-project-Wikistats, 13Patch-For-Review: Wikistats 2.2 [beta] gives internal server error 500 for all csv, ssv and xml formats - https://phabricator.wikimedia.org/T165879#3279335 (10Dzahn) a:03Dzahn [16:34:21] 06Labs: Tool videoconvert is using 1.034TB/8TB of tools NFS storage - https://phabricator.wikimedia.org/T165806#3280109 (10madhuvishy) Thanks @Prolineserver :) [16:34:50] 06Labs, 10Tool-Labs: templatetiger is using 613G in Tools out of 8T - https://phabricator.wikimedia.org/T136192#3280112 (10madhuvishy) Thanks @Kolossos :) [16:36:20] 10Labs-project-Wikistats, 13Patch-For-Review: Wikistats 2.2 [beta] gives internal server error 500 for all csv, ssv and xml formats - https://phabricator.wikimedia.org/T165879#3280133 (10Dzahn) A couple things: - this has nothing to do with Analytics wikistats, please do not add those tags and people - it is... [16:39:16] 10Labs-project-Wikistats, 13Patch-For-Review: Wikistats 2.2 [beta] gives internal server error 500 for all csv, ssv and xml formats - https://phabricator.wikimedia.org/T165879#3280182 (10Paladox) >>! In T165879#3280133, @Dzahn wrote: > A couple things: > > - this has nothing to do with Analytics wikistats, p... [16:39:22] 10Labs-project-Wikistats, 13Patch-For-Review: Wikistats 2.2 [beta] gives internal server error 500 for all csv, ssv and xml formats - https://phabricator.wikimedia.org/T165879#3280183 (10Dzahn) p:05Triage>03Normal [16:43:23] 10Labs-project-Wikistats, 13Patch-For-Review: Wikistats 2.2 [beta] gives internal server error 500 for all csv, ssv and xml formats - https://phabricator.wikimedia.org/T165879#3280239 (10Dzahn) >>! In T165879#3280182, @Paladox wrote: > Oh, unsecure? what about using mysqli functions instead of mysql functions... [16:44:56] 10Labs-project-Wikistats, 13Patch-For-Review: Wikistats 2.2 [beta] gives internal server error 500 for all csv, ssv and xml formats - https://phabricator.wikimedia.org/T165879#3280241 (10Paladox) Ah yeh. I knew that xml_dumper could have possibly been disabled due to it executing commands. :) [16:54:55] (03PS1) 10Lokal Profil: [WIP]Construct country sqls for wikidata configs [labs/tools/heritage] (wikidata) - 10https://gerrit.wikimedia.org/r/354742 (https://phabricator.wikimedia.org/T165758) [17:41:20] 10Labs-project-Wikistats, 10Analytics, 10Analytics-Wikistats, 10Pywikibot-core, and 2 others: wikistats.py seems broken - https://phabricator.wikimedia.org/T165830#3280390 (10Xqt) I removed the Patch-For-Review tag because the previous path skips the test but this issue isn't solved. [17:43:18] Change on 12www.mediawiki.org a page OAuth/For Developers was modified, changed by Tgr (WMF) link https://www.mediawiki.org/w/index.php?diff=2472129 edit summary: /* Authorization */ [17:54:12] 10Labs-project-Wikistats: Wikistats 2.2 [beta] gives internal server error 500 for all csv, ssv and xml formats - https://phabricator.wikimedia.org/T165879#3280421 (10Xqt) Sorry, my fault. [18:04:42] 10Labs-project-Wikistats, 10Pywikibot-core, 07Pywikibot-tests, 07Upstream: wikistats.py seems broken - https://phabricator.wikimedia.org/T165830#3280441 (10Paladox) [21:06:05] 06Labs, 06Project-Admins, 15User-bd808, 06cloud-services-team (Kanban): Create wmcs-team project and kanban milestone - https://phabricator.wikimedia.org/T165703#3280677 (10bd808) >>! In T165703#3278454, @Aklapper wrote: > The wm prefix seems to be redundant and I am not entirely happy about anything that... [21:11:44] 06Labs: Access to *.labsdb servers needed for the wikidataconcepts project/instance - https://phabricator.wikimedia.org/T165926#3280678 (10GoranSMilovanovic) [21:12:09] 06Labs: Access to *.labsdb servers needed for the wikidataconcepts project/instance - https://phabricator.wikimedia.org/T165926#3280678 (10GoranSMilovanovic) p:05Triage>03High [21:28:44] Hello, please: does anyone know whether the staging database from production is replicated on the *.labsdb servers? Thanks a lot! [21:47:53] GoranSM: what is the "staging database"? Testwiki? [21:48:08] or beta cluster? [21:49:13] 06Labs: Access to *.labsdb servers needed for the wikidataconcepts project/instance - https://phabricator.wikimedia.org/T165926#3280727 (10bd808) a:05Aklapper>03None [21:50:05] bd808: staging database is used to temporarily store any tables [21:50:26] GoranSM: are you talking about something from the analytics cluster? [21:51:07] bd808: yes, analytics-store.eqiad.wmnet, I am accessing it from stat1003 (and stat1002, rarely if ever) [21:52:01] ok. the answer is no. The stat* servers are private information generally. Unredacted and containing various forms of PII. [21:52:40] the labsdb replicas are filtered versions of the wiki databases [21:52:52] bd808: I understand that (have read the documentation) [21:53:08] bd808: Could you please advise on the following: [21:53:31] bd808: The idea is to run some SQL scripts from R on production (stat1003), and then somehow reach the results (say, a ton of .csv files) from my Labs instance. Any ideas? [21:54:00] bd808: I am developing an analytical application for WMDE, just to clarify the goal here [21:54:08] talk to the analytics team and find out how they do that. it's a solved problem but I don't know the details [21:55:56] bd808: Ok, thank you very much. Would you be able to open access to the *.labsdb servers for my wikidataconcepts Labs instance (I've seen you here: https://phabricator.wikimedia.org/T165926#3280678) [21:57:12] the easiest way to get a set of db credentials is to create a tool in Tool Labs and then copy the replica.my.cnf that is generated for it to your labs project instance(s) [21:58:13] I'm not sure that we have a great mechanism for tracking allocations to project directly. I can poke madhu about it tomorrow though [21:59:58] bd808: Could you please do that (contact madhu)? The documentation for Database Access (https://wikitech.wikimedia.org/wiki/Help:Tool_Labs/Database) says whoever has a Labs instance, needs to ask for a replica.my.cnf file on his/her instance... [22:00:30] GoranSM: I'm aware. I'm the manager of the Cloud Services team. :) [22:00:45] bd808: :-D [22:00:59] the fast/easy way is to "borrow" creds from a tool [22:02:00] bd808: And what do I do with the tool that I will not be using after I create it just in order to rip a .cnf file from it? [22:02:41] just let it be. it won't really be consuming any measurable resources [22:03:05] GoranSM: this may be the way to get at your data -- https://wikitech.wikimedia.org/wiki/Analytics/Systems/Dashiki#How_to_get_your_data_available_via_http [22:04:05] bd808: Thank you very much! [22:46:09] 06Labs: Access to *.labsdb servers needed for the wikidataconcepts project/instance - https://phabricator.wikimedia.org/T165926#3280740 (10GoranSMilovanovic) 05Open>03Resolved a:03GoranSMilovanovic [23:10:53] 10Labs-project-Wikistats: Wikistats 2.2 [beta] gives internal server error 500 for all csv, ssv and xml formats - https://phabricator.wikimedia.org/T165879#3280748 (10Xqt)