[00:00:18] 10Tool-Labs-tools-Other: Jouncebot failing to parse Deployments page - https://phabricator.wikimedia.org/T158715#3045094 (10bd808) Reported via pull request upstream: https://github.com/mwclient/mwclient/pull/147 [00:18:13] 06Labs, 10Tool-Labs, 10Tools-Kubernetes, 05Prometheus-metrics-monitoring: Labs Prometheus not recording k8s stats since 2017-01-24T06:00 - https://phabricator.wikimedia.org/T157355#3045121 (10bd808) 05Open>03Resolved a:03fgiunchedi >>! In T157355#3044916, @scfc wrote: > @bd808, with the dashboard now... [00:26:31] !log tools.jouncebot Deployed {{gerrit|339092}} for T158715 [00:26:34] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.jouncebot/SAL [00:26:34] T158715: Jouncebot failing to parse Deployments page - https://phabricator.wikimedia.org/T158715 [00:27:03] 10Tool-Labs-tools-Other, 13Patch-For-Review, 15User-bd808: Jouncebot failing to parse Deployments page - https://phabricator.wikimedia.org/T158715#3045151 (10bd808) 05Open>03Resolved a:03bd808 [00:30:35] Chasemp nope. I think it finally got deleted properly. We have -04 noe [01:06:54] 06Labs, 10Tool-Labs: jmail is not puppetized - https://phabricator.wikimedia.org/T158722#3045246 (10scfc) [01:14:07] 06Labs, 10Tool-Labs, 06Community-Tech-Tool-Labs, 07Epic, and 2 others: Remove support for precise OGE exec hosts - https://phabricator.wikimedia.org/T94792#3045279 (10scfc) `jmail` (T158722) submits jobs by: ``` /usr/bin/qsub -N mail.$(/usr/bin/id -nu) \ -sync y -b y -m n \ -o "$email.out"... [02:49:04] 10Wikibugs: Wikibugs always points to the creation of the task - https://phabricator.wikimedia.org/T158704#3044585 (10Legoktm) Are you sure about always? Last I checked it was just sometimes...either way we need to replace the screenscraping. [06:50:57] PROBLEM - Puppet run on tools-exec-1418 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [06:52:05] PROBLEM - Puppet run on tools-grid-master is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [06:57:44] PROBLEM - Puppet run on tools-exec-1405 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [07:06:57] PROBLEM - Puppet run on tools-exec-1403 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [07:25:58] RECOVERY - Puppet run on tools-exec-1418 is OK: OK: Less than 1.00% above the threshold [0.0] [07:27:06] RECOVERY - Puppet run on tools-grid-master is OK: OK: Less than 1.00% above the threshold [0.0] [07:32:43] RECOVERY - Puppet run on tools-exec-1405 is OK: OK: Less than 1.00% above the threshold [0.0] [07:41:58] RECOVERY - Puppet run on tools-exec-1403 is OK: OK: Less than 1.00% above the threshold [0.0] [08:39:28] 06Labs, 10Tool-Labs, 10Tools-Kubernetes, 05Prometheus-metrics-monitoring: Labs Prometheus not recording k8s stats since 2017-01-24T06:00 - https://phabricator.wikimedia.org/T157355#3045767 (10fgiunchedi) >>! In T157355#3045121, @bd808 wrote: >>>! In T157355#3044916, @scfc wrote: >> @bd808, with the dashboa... [10:01:27] (03CR) 1020after4: [C: 04-1] "Does wikibugs now understand subprojects / milestones? We should teach it to include subs/milestones automatically with the parent projec" [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/333553 (owner: 10Paladox) [12:34:05] !log wikidata-dev rebooting redis dispatching instances [12:34:10] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikidata-dev/SAL [13:08:35] 10Labs-project-other: Successful pilot of Discourse on https://discourse.wmflabs.org/ as an alternative to wikimedia-l mailinglist - https://phabricator.wikimedia.org/T124690#3046511 (10Aklapper) [13:08:38] 10Labs-project-other, 10Wikimedia-Mailing-lists: Wikimedia-l <-> Discourse synchronization (PRELIMINARY) - https://phabricator.wikimedia.org/T126458#3046509 (10Aklapper) 05Open>03Resolved >>! In T126458#2914111, @Dzahn wrote: > Cool, thanks. Is this resolved now, @Austin? No feedback, hence assuming so. [13:15:12] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Ping08 was created, changed by Ping08 link https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Ping08 edit summary: Created page with "{{Tools Access Request |Justification=bot for Russian Wikipedia https://ru.wikipedia.org/wiki/User:Ping08Bot |Completed=false |User Name=Ping08 }}" [14:19:12] 06Labs, 10Tool-Labs, 10Tools-Kubernetes, 05Prometheus-metrics-monitoring: Labs Prometheus not recording k8s stats since 2017-01-24T06:00 - https://phabricator.wikimedia.org/T157355#3046685 (10scfc) I had thought that maybe the formula in the dashboard could be rephrased so that it would combine two data so... [14:21:17] 10Tool-Labs-tools-Other: Croptool does not work on php 5.4 - https://phabricator.wikimedia.org/T103059#3046691 (10scfc) [14:21:20] 06Labs, 10Tool-Labs, 07Tracking: Packages to be added to toollabs puppet - https://phabricator.wikimedia.org/T55704#3046692 (10scfc) [14:21:23] 06Labs, 10Labs-Team-Backlog, 10Tool-Labs, 13Patch-For-Review: Tool Labs: Enable php5-mcrypt on Trusty - https://phabricator.wikimedia.org/T97857#3046690 (10scfc) 05Open>03Resolved [14:51:47] 10Tool-Labs-tools-Pageviews: Massviews export data is incorrect (both CSV and JSON) - https://phabricator.wikimedia.org/T158505#3046782 (10Fuzzy) Thank you @MusikAnimal for the fast fix! BTW, I found the bug when I was trying to calculate weekly stats for a set of articles. Most articles have a weekly reading c... [15:49:38] 06Labs, 10Labs-Infrastructure, 13Patch-For-Review: Deprecate precise instances in Labs by 03/31/2017 - https://phabricator.wikimedia.org/T143349#3046872 (10Andrew) @hashar, does that I mean I can schedule deletion of integration-slave-precise-*? And, if so, would you prefer that I delete them immediately, o... [15:50:50] 06Labs, 10Huggle: Labs instance huggle.huggle.wmflabs needs to be replaced or deleted - https://phabricator.wikimedia.org/T157710#3046874 (10Andrew) Can I get an update on this? Is the instance necessary and, if so, is someone on the case? [15:58:02] 06Labs, 10Labs-Infrastructure, 13Patch-For-Review: Deprecate precise instances in Labs by 03/31/2017 - https://phabricator.wikimedia.org/T143349#3046886 (10hashar) Later in March. I am busy refactoring Jenkins puppet manifests this week and will probably as well next week. I have to figure out all the CI co... [15:58:59] 06Labs, 10Labs-Infrastructure, 13Patch-For-Review: Deprecate precise instances in Labs by 03/31/2017 - https://phabricator.wikimedia.org/T143349#3046888 (10hashar) [16:00:42] 06Labs: Replace or delete labs instance mediahandler-tests-static - https://phabricator.wikimedia.org/T157990#3046907 (10Andrew) Emailed both project admins on 2017-02-22. [16:06:31] 06Labs, 10Tool-Labs: deb.tools.wmflabs.org is not accessible from outside Tool Labs - https://phabricator.wikimedia.org/T158383#3046930 (10scfc) I had planned to remove the DNS entry for `deb.tools.wmflabs.org` and create a webproxy entry for that; so I removed the floating IP from `tools-services-01` and the... [16:12:03] 06Labs, 10Tool-Labs: deb.tools.wmflabs.org is not accessible from outside Tool Labs - https://phabricator.wikimedia.org/T158383#3046933 (10scfc) (Ceterum censeo we should just manage the #Tool-Labs packages as separate suites `trusty-wikimedia-tools` & Co. under http://apt.wikimedia.org/; updates are not that... [16:15:50] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Ping08 was modified, changed by Tim Landscheidt link https://wikitech.wikimedia.org/w/index.php?diff=1566351 edit summary: [16:33:44] 06Labs: sugarcrm project using 12G of NFS - https://phabricator.wikimedia.org/T158778#3047016 (10bd808) [16:38:22] 06Labs: Request creation of wikidiff2-wmde-dev labs project - https://phabricator.wikimedia.org/T158645#3042748 (10Andrew) Approved -- please bug me if I don't take care of this in the next day or so. [16:46:44] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Yomguithereal was created, changed by Yomguithereal link https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Yomguithereal edit summary: Created page with "{{Tools Access Request |Justification=Gather some statistics about famous character's page contributions for a research project. |Completed=false |User Name=Yomguithereal }}" [17:10:19] andrewbogott: For that 1.85T of videos, it's probably not caused by T152899 (see my reply there). I guess you gotta poke matanya for that :P [17:10:19] T152899: Disk space went not cool again on the video encoding instances - https://phabricator.wikimedia.org/T152899 [17:10:47] zhuyifei1999_: can you respond on ticket? I think matanya is subscribed to it... [17:11:01] yeah responded [17:11:52] thanks [17:12:21] zhuyifei1999_: my (un-verified) theory is that there's some kind of crazy file leak which caused both storage issues. [17:12:44] both storage? which two? [17:13:17] um… two storage issues: 1) The video VMs ran out of local space 2) Once storage was moved to NFS, they kept gobbling up space like crazy [17:13:33] oh [17:14:56] well, `du -h /data/scratch/video2commons` is 162G, and I don't think that had much increase [17:16:14] and the cleanup-after-two-months is running properly afaik [17:16:50] it used to be two weeks iirc, and that probably accounted for some increased usage in /data/scratch [17:16:58] zhuyifei1999_: ok, maybe it's unrelated then [17:17:02] The main nfs storage is: [17:17:06] https://www.irccloud.com/pastebin/FKHnpcAd/ [17:17:17] which is maybe just obsolete stuff that can me deleted. [17:17:24] especially 'old-cruft-deleteme' :) [17:18:35] it belongs to someone with a user id of 99, and idk who that is [17:19:32] 99 is a werid number though, definitely not from ldap, but more like a system user that no longer exists [17:20:01] I think that wikimania2014 is from a hdd that was snail-mailed to the datacenter and loaded by hand :) [17:20:49] * zhuyifei1999_ is unfamiliar with that part of history [17:21:30] 06Labs, 10video2commons: Can we delete these old video2commons files? - https://phabricator.wikimedia.org/T158786#3047191 (10Andrew) [17:22:37] 06Labs, 10video2commons: Can we delete these old files on video project? - https://phabricator.wikimedia.org/T158786#3047206 (10zhuyifei1999) [17:27:53] 06Labs, 10video2commons: Can we delete these old files on video project? - https://phabricator.wikimedia.org/T158786#3047239 (10zhuyifei1999) The directories `videocommons` and `video2commons-test` are nearly empty and created when sudo-ing (by PAM?). They are unused, and I don't mind their deletion, but it'll... [17:36:45] 06Labs, 10Labs-Infrastructure, 10DBA, 06Operations: labsdb1006/1007 (postgresql) maintenance - https://phabricator.wikimedia.org/T157359#3047251 (10jcrespo) The user impact/dependencies are not 100% clear for this maintenance, which will be the long one (maybe a couple of days), so I requested help of some... [17:43:24] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Yomguithereal was modified, changed by Tim Landscheidt link https://wikitech.wikimedia.org/w/index.php?diff=1567060 edit summary: [17:54:06] 06Labs, 10Tool-Labs, 13Patch-For-Review: deb.tools.wmflabs.org is not accessible from outside Tool Labs - https://phabricator.wikimedia.org/T158383#3047333 (10bd808) >>! In T158383#3046933, @scfc wrote: > (Ceterum censeo we should just manage the #Tool-Labs packages as separate suites `trusty-wikimedia-tools... [18:04:20] 06Labs, 06Operations: labmon1001: Graphite + Mirantis' Django don't play well together - https://phabricator.wikimedia.org/T158789#3047363 (10faidon) [18:16:21] 06Labs, 10Tool-Labs, 13Patch-For-Review: deb.tools.wmflabs.org is not accessible from outside Tool Labs - https://phabricator.wikimedia.org/T158383#3047400 (10scfc) Sure, but within the current parameters for most of "sysadmin" work you need someone to `+2` your changes on `operations/puppet` anyway, and whe... [18:42:17] 06Labs, 10Tool-Labs: jmail is not puppetized - https://phabricator.wikimedia.org/T158722#3045246 (10bd808) Current script: ``` lang=bash #! /bin/bash # # Copyright © 2013 Marc-André Pelletier # # Permission to use, copy, modify, and/or distribute this software for any # purpose with... [18:42:35] 10Tool-Labs-tools-stewardbots, 07Need-volunteer, 07WorkType-NewFunctionality: Make StewardBot not report subpages of stalked pages - https://phabricator.wikimedia.org/T158794#3047533 (10MarcoAurelio) [18:44:51] chasemp or andrewbogott hi, im wondering do you know how i can add a second private ip in labs please? I need two private ip's for testing prod phabricator changes reliably. [18:44:57] we need the second ip for ssh. [18:45:15] we have a floating ip but need a second private ip so we can run it on port 22. [18:46:09] ^ yea, i said instead of a floating IP it would be fine to just have second 10.x.x.x. IP [18:46:16] to avoid issues with NAT [18:46:23] as long as there are 2 separate IPs [18:46:45] if only we knew a free IP that is ok to use,.. we could just add it with "ip" [18:57:59] 06Labs, 10wikitech.wikimedia.org, 13Patch-For-Review: Decide which group(s) will be able to manage 'shell' on wikitech - https://phabricator.wikimedia.org/T158516#3047586 (10MarcoAurelio) 05Open>03Resolved Bureaucrats (and cloudadmins since they have 'userrights' will be able to manage the 'shell' permis... [19:02:15] it seems we cant shutdown an existing instance. gets stuck in "powering down" [19:02:21] but still responds [19:02:29] that is "phab-01" [19:02:29] 06Labs: Shutting down an instance does not work - https://phabricator.wikimedia.org/T158796#3047598 (10Paladox) [19:04:51] 06Labs: Shutting down an instance does not work - https://phabricator.wikimedia.org/T158796#3047623 (10Paladox) [19:05:05] 06Labs: Shutting down an instance does not work - https://phabricator.wikimedia.org/T158796#3047598 (10Paladox) trying to ssh in works. So it is not even shutting down. [19:09:49] it works when typing "shutdown" inside the VM, but the "shut off" button in Horizon does not [19:10:26] we were able to assign a second IP taken from the instance that is shutdown now [19:17:45] mutante: what is your goal regarding phab-01? You want it deleted, or just turned off? [19:18:43] 06Labs: Shutting down an instance does not work - https://phabricator.wikimedia.org/T158796#3047683 (10Dzahn) shutting down works when typing "shutdown -h now" inside the VM, but the "shut off" button in Horizon did not. It got stuck in "powering down" while still responding to SSH. [19:19:07] 06Labs: Shutting down an instance does not work - https://phabricator.wikimedia.org/T158796#3047684 (10Dzahn) user was not logged in via ssh when clicking the button [19:22:24] andrewbogott: shut down - so we know we can use its IP address without something else using it [19:23:01] so that instance will exist, forever shutdown, just to squat on an IP? [19:23:26] depends what the right way is to get the second IP [19:23:39] we also want it deleted [19:24:55] but at least we can test the phab role and then delete it [19:26:31] it's all about paladox' original question about the IP [19:26:41] There's some reason why a public IP won't work for this? [19:27:11] yes, 20after4 already tried that [19:27:32] when he added floating IP to it things broke [19:27:55] it gets assigned to localhost, right [19:27:59] and NAT? [19:28:40] adding a second 10.x.x.x IP on eth0 works [19:29:05] ok... [19:29:11] just had to find one that is not used [19:29:14] I guess I won't worry, if this is a temporary thing. [19:29:25] so a simple way was "hey, there is this instance we can shut down anyways" [19:29:37] it shouldnt be temprorary, if possible [19:30:09] it is needed to test phab role changes [19:30:41] ok. I don't really know the details of 'things broke' of course. [19:31:22] Having an instance taking up disk space for no reason seems kind of dumb, but since you're well outside the realm of what Labs supports I guess I can't offer another option [19:31:50] if you add a floating IP to an instnace you get [19:31:51] inet 208.80.155.150/32 scope global lo:LVS [19:31:56] on interface "lo" [19:31:58] 06Labs, 10wikitech.wikimedia.org: Remove 'shellmanagers' rights from all users before removing the group on Wikitech - https://phabricator.wikimedia.org/T158515#3047702 (10MarcoAurelio) 05Open>03Resolved [19:32:00] 06Labs, 10wikitech.wikimedia.org, 13Patch-For-Review: Remove shellmanagers group on wikitech - https://phabricator.wikimedia.org/T158482#3047703 (10MarcoAurelio) [19:32:07] now if a service, like in this case phab's sshd [19:32:11] tries to bind to that IP [19:32:29] you can't connect to that [19:32:44] andrewbogott: we are asking for help how to do it the right way [19:32:55] It sounds like there isn't a right way [19:32:59] if a second IP is "well outside what labs supports" then that's an asnswer [19:33:03] yeah [19:33:06] but it means we cant test phabricator reoles [19:33:07] 06Labs, 10wikitech.wikimedia.org, 13Patch-For-Review: Allow 'contentadmin' being managed by wikitech bureaucrats - https://phabricator.wikimedia.org/T158554#3047705 (10MarcoAurelio) 05Open>03Resolved [19:33:19] This would be possible to support but it would be a lot of dev and config time to set up [19:33:29] Hacking around it is probably the only option for now [19:33:33] or finding another way to test [19:35:16] we are not asking for a button in horizon if that's what you mean [19:35:27] it's basically just "which IP can we use" [19:35:48] and taking the one from an unused instance was easy enough [19:36:04] just reporting unrelated issue then that it did not shut down [19:36:18] in theory with neutron each project may have its own isolated network, in which case IPs will be a free-for-all [19:36:42] but right now there's not a great solution. I can reserve IPs at the bottom of the range, but that only works if by luck the next consecutive IP is currently unused. [19:36:54] So I think you're best doing what you're doing for now [19:36:59] even though it's silly :) [19:37:21] so what if we just keep the IP assigned where we want it [19:37:25] and delete the old isntance [19:38:19] something else would try to take it then? [19:38:53] yeah, if you delete the instance the IP will return to the pool [19:38:56] and be assigned to a new instance [19:39:41] yea, ok.. that was why i said "dont delete it yet" but wasnt sure enough [19:39:57] hmm.. ok [19:44:55] 06Tool-Labs-standards-committee: Figure out how communications and meetings will work for the Tool Labs standards committee - https://phabricator.wikimedia.org/T156075#3047741 (10Quiddity) 05Open>03Resolved Declaring resolved. Followup continues in mailing list. [19:46:25] 06Labs, 10wikitech.wikimedia.org, 13Patch-For-Review: Wikitech: rename 'shellmanagers' to 'shellmanager' for consistency - https://phabricator.wikimedia.org/T158039#3047747 (10MarcoAurelio) [19:46:28] 06Labs, 10wikitech.wikimedia.org, 13Patch-For-Review: Remove shellmanagers group on wikitech - https://phabricator.wikimedia.org/T158482#3047745 (10MarcoAurelio) 05Open>03Resolved [19:46:33] andrewbogott: i agree it's silly but also that's the best way then :) and thanks! [19:46:40] yep [19:47:01] I'll look at the bug you filed but I already have my suspicions about the cause [19:47:28] yea, that was unrelated to our actual goal [19:47:35] prio low [19:47:47] just said "let's report that" [19:52:31] 06Labs, 10wikitech.wikimedia.org: Grant @scfc +bureaucrat on Wikitech - https://phabricator.wikimedia.org/T158799#3047757 (10MarcoAurelio) [19:55:00] 06Labs, 10wikitech.wikimedia.org, 15User-bd808: Grant @scfc +bureaucrat on Wikitech - https://phabricator.wikimedia.org/T158799#3047792 (10bd808) 05Open>03Resolved a:03bd808 {{done}} [19:58:10] 06Labs, 10WikimediaMessages, 10wikitech.wikimedia.org, 13Patch-For-Review: Group messages for Wikitech - https://phabricator.wikimedia.org/T158417#3047810 (10MarcoAurelio) Patch merged. Will wait for ReleaseTaggerBot to announce on which wmf branch this will be included. [19:58:34] 06Labs, 10wikitech.wikimedia.org, 15User-bd808: Grant @scfc +bureaucrat on Wikitech - https://phabricator.wikimedia.org/T158799#3047811 (10MarcoAurelio) That was fast. Thanks. [20:42:48] 06Labs, 06Operations, 13Patch-For-Review: labmon1001: Graphite + Mirantis' Django don't play well together - https://phabricator.wikimedia.org/T158789#3047985 (10Andrew) 05Open>03Resolved a:03Andrew I fixed this by moving the archive-instance script to python2, which let us use Liberty OpenStack packag... [20:57:22] 06Labs: Replace or delete labs instance mediahandler-tests-static - https://phabricator.wikimedia.org/T157990#3048064 (10Bawolff) a:05Bawolff>03None I have no idea what that project is. I don't believe I had any involvement with that project at any point in time. With that in mind I'd like to unassign from s... [21:10:54] (03CR) 10Zppix: [C: 031] "Awaiting review from a maintainer" [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/339074 (owner: 10Zppix) [21:14:32] (03CR) 10Merlijn van Deen: [C: 032] Add notifications for tools.zppixbot and quarrybot-enwiki [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/339074 (owner: 10Zppix) [21:15:38] (03CR) 10Merlijn van Deen: "No, not unless they can be matched with a regex. What's the reason for the -1?" [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/333553 (owner: 10Paladox) [21:17:44] valhallasw`cloud: thanks [21:18:53] (03Merged) 10jenkins-bot: Add notifications for tools.zppixbot and quarrybot-enwiki [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/339074 (owner: 10Zppix) [21:19:03] (03CR) 10jenkins-bot: Add notifications for tools.zppixbot and quarrybot-enwiki [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/339074 (owner: 10Zppix) [21:19:44] (03CR) 10Zppix: Add phabricator-upstream to #wikimedia-dev and #wikimedia-devtools (031 comment) [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/333553 (owner: 10Paladox) [21:20:38] !log tools.wikibugs Updated channels.yaml to: a8196b533644a52707bcbb62ee4ad33f4954f641 Add notifications for tools.zppixbot and quarrybot-enwiki [21:20:55] ^cool [21:21:40] legoktm: wikibugs_ has an underscore fyi [22:13:22] 10Tool-Labs-tools-Zppixbot, 10Continuous-Integration-Config: Email on failed test (JJB) - https://phabricator.wikimedia.org/T158821#3048386 (10Zppix) [22:26:52] 10Tool-Labs-tools-Zppixbot, 10Continuous-Integration-Config: Email on failed test (JJB) - https://phabricator.wikimedia.org/T158821#3048434 (10Zppix) 05Open>03declined Misunderstood information [22:45:02] 06Labs, 10MediaWiki-extensions-MolHandler: Replace or delete labs instance mediahandler-tests-static - https://phabricator.wikimedia.org/T157990#3048461 (10Rillke) [22:45:06] 06Labs, 10MediaWiki-extensions-MolHandler: Replace or delete labs instance mediahandler-tests-static - https://phabricator.wikimedia.org/T157990#3022631 (10Rillke) I will upgrade the project soon. [22:48:33] 06Labs, 10MediaWiki-extensions-MolHandler: Replace or delete labs instance mediahandler-tests-static - https://phabricator.wikimedia.org/T157990#3048467 (10Rillke) a:03Rillke [22:54:16] 06Labs, 10MediaWiki-extensions-MolHandler: Replace or delete labs instance mediahandler-tests-static - https://phabricator.wikimedia.org/T157990#3048479 (10Rillke) BTW, it serves the Chemical Markup Editor of https://mol.wmflabs.org [23:35:53] 06Labs, 10Tool-Labs-tools-Other, 06Community-Tech-Tool-Labs, 06Developer-Relations, and 3 others: Create an authoritative and well promoted catalog of Wikimedia tools - https://phabricator.wikimedia.org/T115650#3048539 (10Abit) I can share what I've heard from the mostly-non-technical program organizers I...