[11:16:37] <dcausse>	 lunch
[14:24:27] <inflatador>	 <o/
[14:27:41] <dcausse>	 o/
[14:39:21] <ebernhardson>	 \o
[14:42:47] <dcausse>	 o/
[14:58:52] <inflatador>	 .o/
[15:19:48] <MichaelBrunnbaue>	 hi, I am Michael Brunnbauer from the team deleloping imagesnippets.com. We have a problem with Fuseki returning 403 Forbidden for federated queries to https://query.wikidata.org/sparql. Is it possible our IP 67.227.132.233 has been blocked in combination with whatever Useragent-String Fuseki is using?
[15:21:42] <MichaelBrunnbaue>	 This has been working for years and we did not change anything, so I suspect the recent troubles with the Wikidata SPARQL service might have caused a block (too many errors or whatever?)
[15:22:12] <ebernhardson>	 inflatador: ^^
[15:22:28] <ebernhardson>	 MichaelBrunnbaue: there have been some recent issues but not sure, i know inflatador dealt with some of them so probably knows
[15:23:15] <inflatador>	 MichaelBrunnbaue sorry about that, I can get that reverted for you soon. We were under attack yesterday
[15:23:58] <MichaelBrunnbaue>	 inflatador Thank you. When should I try again?
[15:26:09] <inflatador>	 MichaelBrunnbaue I just committed the changes, please try again now
[15:26:23] <MichaelBrunnbaue>	 Does not work yet
[15:27:52] <inflatador>	 MichaelBrunnbaue ACK, give it about 15 minutes and try again, if you are still being blocked ping me again. Sorry for the trouble
[15:45:39] <MichaelBrunnbaue>	 inflatador Still no luck, unfortunately
[15:47:00] <inflatador>	 MichaelBrunnbaue ACK, are you still getting 403 forbidden?
[15:47:31] <MichaelBrunnbaue>	 inflatador From Fuseki. I don't know if this is the status from Wikidata:
[15:47:32] <MichaelBrunnbaue>	 10:45:24 INFO  Fuseki          :: [7] POST http://127.0.0.1:3030/dbpedia/query
[15:47:32] <MichaelBrunnbaue>	 10:45:24 INFO  Fuseki          :: [7] Query = select * where {  SERVICE <https://query.wikidata.org/sparql> {  <http://www.wikidata.org/entity/Q6006> ?p ?o  }}
[15:47:33] <MichaelBrunnbaue>	 10:45:24 INFO  Fuseki          :: [7] 403 Forbidden (39 ms)
[15:48:12] <dcausse>	 inflatador: could be related to https://phabricator.wikimedia.org/T402959#11628702 ?
[15:49:07] <dcausse>	 if related and if fuseki allows setting a UA this could help
[15:49:19] <MichaelBrunnbaue>	 Let me check how easy I can change the UA used for federation with Fuseki
[15:50:31] <MichaelBrunnbaue>	 I'll have to upgrade Fuseki https://github.com/apache/jena/issues/3148
[15:51:40] <inflatador>	 MichaelBrunnbaue how long have you had the issue? Because if it was before yesterday, than dcausse is correct, that's related to federation and not the blocks I put in place yesterday
[15:51:41] <dcausse>	 yes seems like this feature is kind of new
[15:57:38] <ebernhardson>	 inflatador: found a problem with the innerhits plugin, new release, should i file a ticket? https://gitlab.wikimedia.org/repos/search-platform/opensearch-innerhits/-/packages/1971
[15:59:43] <MichaelBrunnbaue>	 If I read this right, I'm currently not sending a UA, but even the current implementation of Fuseki uses a hardcoded UA of the format ApacheJena/<VERSION> and would be blocked?
[16:00:00] <inflatador>	 ebernhardson If you mean  a ticket for a new docker image, sure. Feel free to request OpenSearch 3.5 if it's useful too. Unfortunately WDQS is still a smoking husk ATM so it might be a few days ;)
[16:02:01] <dcausse>	 MichaelBrunnbaue: yes I think so, please see https://phabricator.wikimedia.org/T400119
[16:06:56] <MichaelBrunnbaue>	 OK. It is bad that Fuseki cannot query Wikidata any more. I am at a loss.
[16:08:53] <inflatador>	 We're sorry for the trouble. Unfortunately the automated scrapers are continually crashing WDQS and we've been forced to be a bit more strict to protect the service
[16:15:00] <MichaelBrunnbaue>	 Is the policy active on all endpoints, e.g. the qlever one?
[16:30:30] <MichaelBrunnbaue>	 I have to go. My personal opinion is that we should not use the service any more, because I don't see the current policy as the endpoint of abuse and countermeasures. This is a hard blow for Margaret Warren, who has been pushing imagesnippets delelopment for decades, but maybe we can find some other solution without abandoning Wikidata.
[16:33:32] <inflatador>	 Lydia_WMDE ^^ see above, looks like Michael is having issues with federation via Jena/Fuseki. Not sure if there's anything to be done, should I loop in the Wikidata Platform team?
[16:35:47] <Lydia_WMDE>	 Thanks and ideally yes. But since they already left... :/
[16:42:39] <inflatador>	 ;(
[20:32:46] * ebernhardson realizes that the configs in cirrus-toolbox don't get installed with the python package...not sure what i want to do about that.
[20:33:00] <ebernhardson>	 can make the package include them, but then the path is super awkward.
[20:39:26] * ebernhardson ran a test query on wcqs against :9999 since it was timing out...it's now been running 25 minutes :S
[20:40:40] <inflatador>	 if a tree falls in the forest... ;)
[20:40:58] <ebernhardson>	 it's a simple `select (count(distinct ?file) as ?count) WHERE { ?file wdt:P275 ?license . }`.    it can of course be answered with haswbstatement:P275 in under a second, but i was curious if wcqs matches
[21:52:37] <ebernhardson>	 hmm, it's still running :S