[00:01:38] broken? [00:02:15] nvm, I see [00:02:37] hoo: i'm confused, had an item page render nearly empty [00:02:42] now its there [00:02:50] yeah, same here [00:03:03] very weird [00:03:16] I see nothing in logstash [00:04:25] Probably something screws the parser cache [00:05:34] this is also new "Gadget "Primary_sources_tool" was not loaded. Please migrate it to use ResourceLoader. See ." [00:06:17] we bumped the parser chache epoch [00:08:54] never mind the primary sources thing is not new [00:09:46] can't reproduce anymore [00:13:19] hoo: happend here, don't purge https://test.wikidata.org/wiki/Q138 [00:15:09] ok 2nd time, edit item with no statement to add is instance of q42, then force refresh 2 times (don't ask) [00:16:28] ok on https://test.wikidata.org/wiki/Q449 it didn't happen [00:17:28] I'm trying locally... but can't reproduce [00:17:46] No matter what state the parser cache is before or how the item was before :S [00:18:08] possibly unrelated: the icons on editing statements are not there on test but are on beta [00:19:11] They are there for me [00:21:47] how? the html for the icon isn't even there, even when not logged in [00:22:00] huh? [00:22:22] edit vs edit [00:22:48] I keep seeing the second one on testwikidata [00:30:16] can't reproduce broken pages on beta [00:30:29] I can no longer reproduce it anywhre [00:38:42] same here [00:45:02] I have a suspicion re the parser cache [00:48:10] hm [00:48:35] mh? [00:49:30] The job runners are not picking up on changes immediately (as they are run for a period of time, to take advantage of the JIT) [00:49:50] maybe we had an edit from wmf8 go through a wmf7 job runner [00:50:08] And maybe that messed with the parser cache in horrible ways [00:50:34] But that's just a theory, I couldn't verify that locally by having the jobs run on wmf7 :/ [00:50:54] isn't there a scap stage that clears the hhvm cache? [00:51:29] Not sure, but I don't think we restart the job runners immediately [00:51:58] or did you mean the cache that's also the JIT bytecode [00:52:40] was thinking of the later [00:53:21] but if each job is not a new php process... [00:53:29] version switch was at 23:47 [00:53:31] it's not [00:53:47]