How MediaWiki deals with file uploads
I wrote for the #Wikipedia Signpost this month about how #MediaWiki details with file uploads on the backend: https://en.wikipedia.org/wiki/Wikipedia:Wikipedia_Signpost/2021-11-29/Technology_report
Posts about MediaWiki, Wikipedia, and everything else wiki related
Fearless concurrency in Wikipedia bots
I'm about 70% done rewriting one of my Wikipedia bots into Rust from Python. Reduced the runtime from 12+ hours to under 10 minutes.I suspect the final runtime will end up being no more than 15-20 minutes.Yay for fearless concurrency ^.^
Toolforge Rust tutorial
I wrote a tutorial on how to deploy a #Rust web application on Wikimedia's #Toolforge platform: https://wikitech.wikimedia.org/wiki/Help:Toolforge/My_first_Rust_toolIt uses #Rocket and demonstrates how to make queries against #Wikipedia's MariaDB replicas.
Generating Rust types for MediaWiki API responses
I just released version 0.2.0 of the mwapi_responses crate. It automatically generates Rust types based on the query parameters specified for use in MediaWiki API requests. If you're not familiar with the MediaWiki API, I suggest you play around with the API sandbox. It is highly dynamic, with the user…
Google Groups to Mailman
It is surprisingly straightforward to move a mailing list from Google Groups to #Mailman 3Documented the entire process at
package-lock-lint 0.2.0
Just released 0.2.0 of package-lock-lint: https://lib.rs/crates/package-lock-lint with lockfileVersion 2 (#npm 7) support!It performs basic checks on package-lock.json because they're impossible to review.And I formally proposed enabling it in #Wikimedia CI: https://lists.wikimedia.org/hyperkitty/list/wikitech-l@lists.wikimedia.org/thread/Q63LIVSJQAGFDBEFSXN24EMHGQYNTQJR/
Kiwix returns in Debian Bullseye
(This is my belated #newindebianbullseye post.) The latest version of the Debian distro, 11.0 aka Bullseye, was released last week and after a long absence, includes Kiwix! Previously in Debian 10/Buster, we only had the underlying C/C++ libraries available. If you're not familiar with it, Kiwix is an offline content…
Last month's Wikimedia Datacenter switchover
New blog post about last month's #Wikimedia Datatcenter switchover: https://techblog.wikimedia.org/2021/07/23/june-2021-data-center-switchover/"In June 2021, the Wikimedia Foundation’s Site Reliability Engineering team switched most user traffic from our primary datacenter in Virginia (“eqiad”) to our secondary one in Texas (“codfw”). This is an exercise we’ve done multiple times over the past 5 years,…
Wikimedia moves to Libera Chat
It's official, #Wikimedia is moving to #LiberaChat / @liberachat I've set up most of #mediawiki (still missing one bot), which, according to ChanServ, was originally created on Freenode by @eloquence on Jan 02 20:06:07 2004 (17y 20w 2d ago)!!
Making one query is faster than making 2,600
Today's lesson in MariaDB query optimization: making one query is faster than making 2,600+:https://gitlab.com/mailman/mailman/-/merge_requests/857https://phabricator.wikimedia.org/T282348
25% of Wikimedia's mailing lists have been migrated
25% of #Wikimedia's mailing lists have been migrated to #Mailman3 so far!https://phabricator.wikimedia.org/T280322#7064397
Mailman3 deployed to production
The "soon" in "#Wikimedia will upgrade to #Mailman3 soon" has finally arrived!https://lists.wikimedia.org/postorius/lists/We'll start migrating lists in a few days, some more details at: https://lists.wikimedia.org/pipermail/wikitech-l/2021-April/094459.html (hopefully one of the last pipermail links I share)Shoutout to @ladsgroup for instigating this and really driving it forward!
1.31.14 MediaWiki security update
The latest #MediaWiki security release is now in #Debian stable/buster, time to update: https://lists.debian.org/debian-security-announce/2021/msg00070.htmlUpdated packages for buster-backports, bullseye and my Ubuntu PPA will be available shortly.
Test Mailman3 in production
#Mailman3 for #Wikimedia is ready for testing, see the announcement from @ladsgroup and myself: https://lists.wikimedia.org/pipermail/wikitech-l/2021-March/094382.htmlHopefully a step forward in making Wikimedia mailing lists more accessible.
Accidentally creating a server in the wrong datacenter
Yesterday I was working on upgrading the servers that power Wikimedia's Docker registry (see T272550). Since these are virtual machines, I was just creating new ones and going to delete the old ones later (because VMs are cattle, not pets). We have a handy script to create new VMs, so…