[04:37:40] 10Pywikibot: noreferences.py error - https://phabricator.wikimedia.org/T238291 (10Kaleem_Bhatti) >>! In T238291#5666992, @Dvorapa wrote: > What Wikipedia do you scan using noreferences? What is the command you run? What is the output of `python pwb.py version` (if installed from Git/svn or zip file)? this comes... [04:39:13] 10Pywikibot: noreferences.py error - https://phabricator.wikimedia.org/T238291 (10Kaleem_Bhatti) @Dvorapa can you tell me please ho I can find this directory /mnt/nfs/labstore-secondary-tools-project/toolname/core [04:54:09] 10Pywikibot: Get family info from wikidata - https://phabricator.wikimedia.org/T238448 (10Bugreporter) not all (special) projects are Wikidata clients. [09:03:46] 10Pywikibot, 10Wikidata: Pywikibot fails when importing entity Q1410828 - https://phabricator.wikimedia.org/T238404 (10Mpaa) 05Open→03Invalid [09:11:18] 10Pywikibot, 10Pywikibot-Wikidata: Pywikibot cannot create new property - https://phabricator.wikimedia.org/T235500 (10Mpaa) >>! In T235500#5663181, @DD063520 wrote: > @Xqt : hi, would you consider again this patch, currently I make this modification locally to have some code running You can submit patches d... [09:13:26] 10Pywikibot: Get family info from wikidata - https://phabricator.wikimedia.org/T238448 (10Mpaa) >>! In T238448#5668653, @Bugreporter wrote: > not all (special) projects are Wikidata clients. Then we can do it for those who are and leave the others hard-coded. [09:19:16] 10Pywikibot: noreferences.py error - https://phabricator.wikimedia.org/T238291 (10Dvorapa) It's a "core" folder in your home directory I believe. The error says your Wikipedia (wikiproject) is missing in the script's configuration. We want to add it there. [13:15:13] 10Pywikibot, 10Wikidata: Performance problems with pywikibot's pagegenerator - https://phabricator.wikimedia.org/T238471 (10Tilomi) [13:59:32] 10Pywikibot: noreferences.py error - https://phabricator.wikimedia.org/T238291 (10Kaleem_Bhatti) >>! In T238291#5668763, @Dvorapa wrote: > It's a "core" folder in your home directory I believe. The error says your Wikipedia (wikiproject) is missing in the script's configuration. We want to add it there. I'm run... [14:04:03] 10Pywikibot: noreferences.py error - https://phabricator.wikimedia.org/T238291 (10Kaleem_Bhatti) @Dvorapa how I can open or edit core folder and scripts [14:28:06] 10Pywikibot: noreferences.py error - https://phabricator.wikimedia.org/T238291 (10Dvorapa) It depends how you installed them. [14:35:49] 10Pywikibot, 10Wikidata: Performance problems with pywikibot's pagegenerator - https://phabricator.wikimedia.org/T238471 (10Dvorapa) Have you tried to play around with "SETTINGS TO AVOID SERVER OVERLOAD" options in Pywikibot's user-config.py? [15:24:20] 10Pywikibot: noreferences.py error - https://phabricator.wikimedia.org/T238291 (10Kaleem_Bhatti) >>! In T238291#5668894, @Dvorapa wrote: > It depends how you installed them. I have intalled from git [15:33:35] 10Pywikibot: noreferences.py error - https://phabricator.wikimedia.org/T238291 (10Dvorapa) Then it is where you installed it [15:35:35] 10Pywikibot: noreferences.py error - https://phabricator.wikimedia.org/T238291 (10Kaleem_Bhatti) >>! In T238291#5668954, @Dvorapa wrote: > Then it is where you installed it from here $ git clone --recursive --branch stable https://gerrit.wikimedia.org/r/pywikibot/core.git pywikibot-core $ cd pywikibot-core [17:29:35] 10Pywikibot, 10Wikidata: Performance problems with pywikibot's pagegenerator - https://phabricator.wikimedia.org/T238471 (10Tilomi) I played around with them, but i saw no change in performance. I set following options to following values because i thought they would affect the performance: minthrottle = 0 //... [17:34:24] 10Pywikibot, 10Wikidata: Performance problems with pywikibot's pagegenerator - https://phabricator.wikimedia.org/T238471 (10Mpaa) Have you considered to get data from dumps, if possible? [18:06:44] 10Pywikibot, 10Wikidata: Performance problems with pywikibot's pagegenerator - https://phabricator.wikimedia.org/T238471 (10Tilomi) I thought about data dumps aswell. But i think it's a bit overkill to download 60 Gb to query about 100 Mb of data so i wanted to check first if there are any other possibilities... [19:27:22] 10Pywikibot, 10Wikidata: Performance problems with pywikibot's pagegenerator - https://phabricator.wikimedia.org/T238471 (10Dvorapa) Perhaps try WikidataIntegrator instead of Pywikibot (if it offers the same functionality you need). I'm unsure what is its current state of development, so make sure you don't th... [19:49:15] 10Pywikibot: noreferences.py error - https://phabricator.wikimedia.org/T238291 (10Dvorapa) 05Open→03Resolved a:03Kaleem_Bhatti The issue seems to be fixed by https://gerrit.wikimedia.org/r/#/c/pywikibot/core/+/546388/ in the current master => so it should be fixed in the next stable release [19:50:33] 10Pywikibot, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata, 10Pywikibot-Wikidata, 10Pywikibot-tests: Overwriting a redirect using wbeditentity causes an exception - https://phabricator.wikimedia.org/T112243 (10Dvorapa) [19:50:50] 10Pywikibot, 10Wikidata, 10Patch-For-Review, 10Pywikibot-Wikidata, and 2 others: paraminfo_tests fails several times due to timeout at beta.wmflabs.org - https://phabricator.wikimedia.org/T210322 (10Dvorapa) [19:51:03] 10Pywikibot, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata, 10Pywikibot-Wikidata: pywikibot's interwikidata.py won't handle projects where one externally-hosted language doesn't have access to the wikibase repo - https://phabricator.wikimedia.org/T221556 (10Dvorapa) [19:51:12] 10Pywikibot, 10Wikidata, 10Pywikibot-Wikidata: Performance problems with pywikibot's pagegenerator - https://phabricator.wikimedia.org/T238471 (10Dvorapa) [20:13:02] 10Pywikibot, 10Wikidata, 10Pywikibot-Wikidata: Performance problems with pywikibot's pagegenerator - https://phabricator.wikimedia.org/T238471 (10Xqt) Decreasing maxlag parameter may lead to decreasing performance because some queries are probably waiting for a lower server lag