[10:23:13] 06serviceops, 10MediaWiki-Special-pages, 07Wikimedia-production-error: MediaWiki periodic job update-special-pages-s5 failed - https://phabricator.wikimedia.org/T399681#11023170 (10A_smart_kitten) 05Open→03Resolved I'm gonna close this as resolved, as https://mg.wiktionary.org/wiki/Manokana:Sokajy_ts... [10:27:53] 06serviceops, 06MW-Interfaces-Team, 07Epic, 07OKR-Work: Central REST gateway for APIs - https://phabricator.wikimedia.org/T400130 (10hnowlan) 03NEW [10:41:46] 06serviceops, 06MW-Interfaces-Team, 07OKR-Work: Improved API rerouting strategy for REST gateway - https://phabricator.wikimedia.org/T400131 (10hnowlan) 03NEW [10:41:57] 06serviceops, 06DC-Ops, 10ops-eqiad, 06SRE: hw troubleshooting: Backplane failure for wikikube-worker1243.eqiad.wmnet - https://phabricator.wikimedia.org/T397851#11023275 (10Clement_Goubert) Server set Active and repooled. [10:43:53] 06serviceops, 10GrowthExperiments-Mentorship, 10Growth-Team (Maintenance), 07Wikimedia-production-error: growthexperiments-updatementeedata-s1 errors out on DB timeout - https://phabricator.wikimedia.org/T395299#11023279 (10Michael) p:05Triage→03Medium [10:51:53] 06serviceops, 06MW-Interfaces-Team, 07Epic, 07OKR-Work: Identify rest.php granularity level requried for REST gateway - https://phabricator.wikimedia.org/T400132 (10hnowlan) 03NEW [10:52:16] 06serviceops, 06MW-Interfaces-Team, 07OKR-Work: Identify rest.php granularity level requried for REST gateway - https://phabricator.wikimedia.org/T400132#11023307 (10hnowlan) [10:55:54] 06serviceops, 06MW-Interfaces-Team, 07OKR-Work: Identify rest.php granularity level required for REST gateway - https://phabricator.wikimedia.org/T400132#11023314 (10Clement_Goubert) [10:56:55] 06serviceops, 06MW-Interfaces-Team, 07OKR-Work: Identify and configure rest.php routes in REST gateway - https://phabricator.wikimedia.org/T400132#11023317 (10hnowlan) [11:25:40] 06serviceops, 10MediaWiki-Special-pages, 07Wikimedia-production-error: MediaWiki periodic job update-special-pages-s5 failed - https://phabricator.wikimedia.org/T399681#11023411 (10A_smart_kitten) >>! In T399681#11023170, @A_smart_kitten wrote: > I'll create the separate task I mentioned above if/when I... [12:26:06] 06serviceops, 06MW-Interfaces-Team, 07OKR-Work: Test plan for rest.php routes in REST gateway - https://phabricator.wikimedia.org/T400152 (10hnowlan) 03NEW [12:50:27] 06serviceops, 10Prod-Kubernetes, 06Traffic, 07Kubernetes, 13Patch-For-Review: Handling inbound IPIP traffic on low traffic LVS k8s based realservers - https://phabricator.wikimedia.org/T352956#11023950 (10Vgutierrez) p:05Triage→03Medium [14:35:58] 06serviceops, 06Wikipedia-Android-App-Backlog: Add routing for wikifeeds "did-you-know" endpoint. - https://phabricator.wikimedia.org/T400168 (10Dbrant) 03NEW [14:55:12] 06serviceops, 10Cassandra, 06Growth-Team, 13Patch-For-Review: mediawiki: migrate from image-suggestion to data-gateway - https://phabricator.wikimedia.org/T368096#11024456 (10Eevans) >>! In T368096#11001930, @Michael wrote: > > [ ... ] > > Could this switch be done on a per-wiki basis? Right now, `testwi... [15:22:45] 06serviceops, 06Commons, 10Thumbor, 07Wikimedia-production-error: No thumbnail available for File:Himalaya,_Indian_Atlas,_sheet_66_(15219000).jpg - Error: 429, Too Many Requests - https://phabricator.wikimedia.org/T392348#11024618 (10Clement_Goubert) We may have an idea of what may be happening. It seems t... [15:36:03] 06serviceops, 06MediaWiki-Engineering: Prepare WMF PHP 8.3 packages for bullseye - https://phabricator.wikimedia.org/T398245#11024703 (10Scott_French) [17:20:11] 06serviceops, 06Wikipedia-Android-App-Backlog, 13Patch-For-Review: Add routing for wikifeeds "did-you-know" endpoint. - https://phabricator.wikimedia.org/T400168#11025177 (10hnowlan) I see content in https://en.wikipedia.org/api/rest_v1/feed/did-you-know! Metrics for the route are beginning to [[ https://gra... [17:25:06] 06serviceops, 06Wikipedia-Android-App-Backlog, 13Patch-For-Review: Add routing for wikifeeds "did-you-know" endpoint. - https://phabricator.wikimedia.org/T400168#11025218 (10hnowlan) 05Open→03Resolved a:03hnowlan [17:36:58] 06serviceops, 10Cassandra, 06Growth-Team: mediawiki: migrate from image-suggestion to data-gateway - https://phabricator.wikimedia.org/T368096#11025284 (10Scott_French) [17:39:29] 06serviceops, 10Cassandra, 06Growth-Team: mediawiki: migrate from image-suggestion to data-gateway - https://phabricator.wikimedia.org/T368096#11025294 (10Scott_French) The data-gateway listener is now available (though unused) in production MediaWiki at localhost:6038. One question that came up while revie... [18:19:02] 06serviceops, 10Cassandra, 06Growth-Team: mediawiki: migrate from image-suggestion to data-gateway - https://phabricator.wikimedia.org/T368096#11025515 (10Eevans) >>! In T368096#11025294, @Scott_French wrote: > The data-gateway listener is now available (though unused) in production MediaWiki at localhost:60... [19:54:14] 06serviceops, 10Cassandra, 06Growth-Team, 13Patch-For-Review: mediawiki: migrate from image-suggestion to data-gateway - https://phabricator.wikimedia.org/T368096#11025829 (10Eevans) @Cparle I put together a couple of strawperson changesets for mediawiki-config (one for the switch-over, one to cleanup afte... [20:06:23] 06serviceops, 06cloud-services-team, 10Toolforge: Shield wmcloud.org and toolforge.org​ against crawler traffic - https://phabricator.wikimedia.org/T400212 (10PerfektesChaos) 03NEW [20:24:04] 06serviceops, 06cloud-services-team, 10Toolforge: Shield wmcloud.org and toolforge.org​ against crawler traffic - https://phabricator.wikimedia.org/T400212#11025942 (10bd808) Possible duplicate of {T226688}. [20:33:25] 06serviceops, 06cloud-services-team, 10Toolforge: Shield wmcloud.org and toolforge.org​ against crawler traffic - https://phabricator.wikimedia.org/T400212#11025977 (10bd808) >* In T393487#11024836 it is claimed that “these wikis all have robots.txt files that tell all crawlers to ignore the sites”. >** Well... [20:34:15] 06serviceops, 06cloud-services-team, 10Toolforge: Shield wmcloud.org and toolforge.org​ against crawler traffic - https://phabricator.wikimedia.org/T400212#11025981 (10bd808) > On the other hand, the IP blocking at BETA should be terminated as soon as possible. IP ranges are not a good idea to distinguish bo... [20:55:26] 06serviceops, 06cloud-services-team, 10Toolforge: Shield wmcloud.org and toolforge.org​ against crawler traffic - https://phabricator.wikimedia.org/T400212#11026003 (10Wurgl) libwww-perl/6.68 is the record holder (3 times more visits that PetalBot). But PetalBot was the one, who found really time-consuming u... [22:17:32] 06serviceops, 06Infrastructure-Foundations, 06SRE, 13Patch-For-Review: Deprecate use of bullseye-backports - https://phabricator.wikimedia.org/T383557#11026158 (10Scott_French) I'm no longer seeing any references to bullseye-backports in puppet, so I believe Moritz took care of all of those. Once https://...