Commons:Village pump/Technical

From Wikimedia Commons, the free media repository
Jump to navigation Jump to search

Shortcuts: COM:VP/T • COM:VPT

Welcome to the Village pump technical section
Technical discussion
Village pump/Technical
 Bug reports
 Code review
Tools
 Tools/Directory
 Idea Lab



This page is used for technical questions relating to the tools, gadgets, or other technical issues about Commons; it is distinguished from the main Village pump, which handles community-wide discussion of all kinds. The page may also be used to advertise significant discussions taking place elsewhere, such as on the talk page of a Commons policy. Recent sections with no replies for 30 days and sections tagged with {{Section resolved|1=--~~~~}} may be archived; for old discussions, see the archives; recent archives: /Archive/2024/05 /Archive/2024/06.

Please note
 
SpBot archives all sections tagged with {{Section resolved|1=~~~~}} after 1 day and sections whose most recent comment is older than 30 days.

Is it possible to search EXIF tags?

[edit]

Is it possible to search by EXIF tag, i.e., file metadata? The full text search allows a variety of operators, but I don't see anything for this, and it would be useful for some of the work I'm doing. grendel|khan 12:34, 25 May 2024 (UTC)[reply]

https://quarry.wmcloud.org/ has some limited support for searching through metadata, but it is far from ideal. Bawolff (talk) 23:13, 26 May 2024 (UTC)[reply]

Replicating s:Module:Copyright-until here

[edit]

I am hoping that someone can do some work with s:Template:Copyright-until and the module by user:CalendulaAsteraceae at Wikisource to help reduce some of the problematic error generation that comes from just pasting links to files on a category page. Those cat pages are constantly generating errors for the red links, and it would be good if we could migrated to something a little less problematic. Thanks.  — billinghurst sDrewth 11:58, 27 May 2024 (UTC)[reply]

Tech News: 2024-22

[edit]

MediaWiki message delivery 00:12, 28 May 2024 (UTC)[reply]

Can someone perhaps remove all the deleted and renamed files from User:Dispenser/Double extension so that only the ones that still need to be fixed are left? Jonteemil (talk) 20:46, 28 May 2024 (UTC)[reply]

Anyone can do so by forking the Quarry query mentioned in the SQL snippet (look for Fork in the upper right corner of the Quarry page), but I’m not comfortable editing a random other user’s subpage without seeing an explicit permission for doing so. —Tacsipacsi (talk) 17:37, 9 June 2024 (UTC)[reply]
I tried forking it, see quarry:query/83409, but it just keeps running. It has run for a week now, yet still running. Jonteemil (talk) 17:21, 11 June 2024 (UTC)[reply]

Searching with 'haswbstatement' doesn't seem to filter properly.

[edit]

See here for an example. I'm searching in the File namespace for incategory:"Photos by Grendelkhan" -haswbstatement:P170, which brings up files which do have creator (P170) defined on them. If I switch to incategory:"Photos by Grendelkhan" haswbstatement:P170, I get zero results. I'm confused. According to mw:Help:Extension:WikibaseCirrusSearch, this should be filtering on the presence of a structured data field, but if anything it's doing the opposite? grendel|khan 15:18, 30 May 2024 (UTC)[reply]

as i'm writing:
  1. Media in category "Photos by Grendelkhan" The following 200 files are in this category, out of 725 total.
  2. incategory:"Photos by Grendelkhan" -haswbstatement:P170 -> Results 1 – 30 of 725
  3. 725-725=0 = incategory:"Photos by Grendelkhan" haswbstatement:P170
RZuo (talk) 21:26, 30 May 2024 (UTC)[reply]
Exactly; all of those photos have creator (P170) statements on them, but the filtering isn't doing the right thing. grendel|khan 16:44, 3 June 2024 (UTC)[reply]

Tech News: 2024-23

[edit]

MediaWiki message delivery 22:32, 3 June 2024 (UTC)[reply]

You are invited to join the discussion about localization of the Cat-a-lot gadget at MediaWiki talk:Gadget-Cat-a-lot.js#MediaWiki:Mobile-frontend-return-to-page vs MediaWiki:Returnto. —⁠andrybak (talk) 21:59, 4 June 2024 (UTC)[reply]

Enable numeric sorting for Commons categories

[edit]

English Wikipedia has numeric sorting for its categoesolveries, e.g. en:Category:Companies by year of establishment and country see that "0–9" that is created to as MediaWiki understands these are numbers and should be sorted using numeric sorting rather than character by character but Wikimedia Commons doesn't do that sorting and e.g. there is no "0-9" on Category:Photographs_in_the_Golestan_Palace_Library so 1039 is put before 108 I've proposed that on phab:T366703 but I'm told to discuss that with Commons community also. English Wikipedia uses the same config and the change from going from uppercase sorting to uca-default is discussed at phab:T136150. −ebrahimtalk 13:29, 5 June 2024 (UTC)[reply]

Obsolete, previously agreed to have, Commons:Village_pump/Archive/2024/04#h-Numerical_sorting_in_categories-20240401232200ebrahimtalk 17:24, 5 June 2024 (UTC)[reply]

Subcategory sorting broken

[edit]

Did this get changed today?
Any idea why "M" for subcategories is between "A" and "C" on Category:Goethe streets ?
Also "next" on Category:Non-empty category redirects doesn't work anymore. Enhancing999 (talk) 14:38, 6 June 2024 (UTC)[reply]

@Enhancing999: Yes, according to phab:T362494 it seems to have been deployed about half an hour ago. I suspect that there may be some transient problems while sort keys get updated for the new ordering. --bjh21 (talk) 14:45, 6 June 2024 (UTC)[reply]
Weird. Let's given them a week to sort it out. Enhancing999 (talk) 14:51, 6 June 2024 (UTC)[reply]
Seems they gave up on it. Phab:T366809. [9] Enhancing999 (talk) 15:38, 6 June 2024 (UTC)[reply]

The find from the post-mortem at phab:T362494 seems to be that the script was run with the wrong options leading to change every sortkey, not just numeric ones. That it takes a long time to run shouldn't be that much an issue. Enhancing999 (talk) 09:15, 7 June 2024 (UTC)[reply]

@Enhancing999 That's not entirely correct. The problem is that the category collation script wasn't run at all, and running it would take weeks to months, during which categories would be broken in the ways you noticed. Because of the size of the Commons categorylinks database, this would cause more stress to the database than the database administrators are willing to tolerate. Using pure numeric collation instead of uca-default-u-kn would reduce the broken categories issue, but wouldn't change the database load issue. The size of the Commons database (specifically the tables for categories and templates) is so large that on its own it is causing stability issues (phab:T343131). We will need to take a hard and careful look at how we use categories and templates and reduce unnecessary uses of both, migrating data to SDC (which is stored more efficiently) where reasonable. Unfortunately we won't be able to do this on our own, it will need WMF support. AntiCompositeNumber (talk) 00:10, 10 June 2024 (UTC)[reply]
The two problems I reported here seem to be due entirely due to the wrong options being used. Or am I missing something? Enhancing999 (talk) 08:41, 10 June 2024 (UTC)[reply]

Cat-a-lot still doesn't work well

[edit]

Though this section was archived because the problem would supposedly have been resolved, Cat-a-lot still doesn't work for subcategories with at least one subcategory. So can this problem get a high priority and really be solved? It is now almost half a year that it arose. JopkeB (talk) 17:04, 6 June 2024 (UTC)[reply]

Also, could it be made to work on Special:MediaSearch? Or fix Special:Search to display the full images? Enhancing999 (talk) 09:12, 7 June 2024 (UTC)[reply]
Per MediaWiki_talk:Gadget-Cat-a-lot.js#Editing_"Expand"_on_English_Wikipedia: It seems to try to edit the local version of Expand, which hangs if that page does not exist and edits Expand if it does. This led to en:Expand getting fully protected, so Cat-a-lot skips categories with subcategories. –LaundryPizza03 (d) 00:50, 23 June 2024 (UTC)[reply]
@LaundryPizza03: Is that forever or can it be fixed? Until the beginning of this year it worked well. JopkeB (talk) 03:56, 23 June 2024 (UTC)[reply]
What are you talking about? –LaundryPizza03 (d) 05:31, 23 June 2024 (UTC)[reply]
Is the problem (which is getting worse, today I cannot even work with Cat-a-Lot on the Special:Search anymore, only within categories) due to last forever or can it be fixed? This is becoming more and more an unworkable situation. JopkeB (talk) 07:09, 23 June 2024 (UTC)[reply]

sort

[edit]

Any ideas about how to sort files in subcategories of Category:Photographs in the Golestan Palace Library by number? each subcategory might contain more than 100 files in the future. Hanooz 12:46, 7 June 2024 (UTC)[reply]

Either
  • by setting the album category with sortkey in a template
  • or by adding a sortkey in on the file sample.
Enhancing999 (talk) 13:33, 7 June 2024 (UTC)[reply]
Thanks. I'm looking for a more proper way as there are more than 3000 files like the one you mentioned. Hanooz 13:40, 7 June 2024 (UTC)[reply]
It should be fairly straightforward either way. Commons:Bots/Work_requests can help. Enhancing999 (talk) 13:49, 7 June 2024 (UTC)[reply]
User:Hanooz: This was requested at Commons:Village pump/Archive/2024/04#h-Numerical sorting in categories-20240401232200 and now is purposed and blocked on phabricator:T362494 and interestingly enough my involvement with the issue is because of the same category also. If this didn't happen we can prepend 0 to subcategories sortkey as a work around. −ebrahimtalk 14:26, 10 June 2024 (UTC)[reply]
I guess a three-digit sortkey must be added to each file. Hanooz 18:35, 10 June 2024 (UTC)[reply]

Special:Search and broken thumbnails

[edit]

Apparently this was fixed 2 years back, but somehow came back: phab:T320459 "Should not see squared, cropped thumbnails next to search results for files on Special:Search page on Commons".

What has changed since? How can we fix it again? @El Grafo, Matthiasmullie, and Raymond: Enhancing999 (talk) 10:53, 10 June 2024 (UTC)[reply]

Might have to do with the recent changes to MediaWiki:Common.css – @Ebrahim: could you check that please? El Grafo (talk) 12:23, 10 June 2024 (UTC)[reply]
Enhancing999, El Grafo: This isn't related to my change as that was about jQuery UI dialog in RTL and the code is available in several wikis so the change is MediaWiki side as far as I can tell but surely I want to help to fix it but I don't remember what the fixed situation looked like but have made this temporarily link so you can see if this is what you want which if so I can apply to be shown always −ebrahimtalk 14:40, 10 June 2024 (UTC)[reply]
@ebrahim: That would be an improvement. The images are no longer randomly cropped. Ideally, I guess lines for each result would have a similar height and the text would still align even if the images vary in actual width. A bit like the sample above (obviously with a larger text area). Thanks for looking into this. Enhancing999 (talk) 15:20, 10 June 2024 (UTC)[reply]
Enhancing999: I've applied the change I shown on the temporarily link but I don't know yet how to apply this one you've brought which indeed looks great −ebrahimtalk 15:52, 10 June 2024 (UTC)[reply]
Is there a way to revert or toggle this back to the squares or set a maximum height? The changes have resulted in vertically large images being huge and taking up several screenfuls of screen space. This is making using search to scan many images at once nigh on impossible. It is excruciating. Gnomingstuff (talk) 16:56, 10 June 2024 (UTC)[reply]
For a specific example of what I mean, search "Unicode Tangut 17000 to 17FFF". If an image with similar proportions shows up in search -- and they frequently do, even in my experience in a short span of time -- image search becomes massively, massively cumbersome. Gnomingstuff (talk) 16:58, 10 June 2024 (UTC)[reply]
I made some MediaWiki core changes to get rid of the table layout. It might be that it is related to that ? —TheDJ (talkcontribs) 18:50, 10 June 2024 (UTC)[reply]
Ok, this is definitely related. I wasn't aware that Commons had this override, so i couldn't take it into account when I was working on this. I have one small problem, in that I don't remember what sizing this used exactly before. I will test this out with my local MediaWiki install tomorrow and can then give you update CSS code for Commons to fix the problem. —TheDJ (talkcontribs) 21:11, 10 June 2024 (UTC)[reply]
Hmm, this was already broken for quite a bit before my change (ever since the new image html was in place like a year ago, although my change made it break harder). OK, what is it that we WANT ? I think we want consistent indentation of the text. Core currently specifies the image as 90px wide. And then we want portrait images to not get cut off. But we also need portrait to be limited, or some exceptional cases would span half the page. Let's say limit height to a maximum of 180px ? Then we want to preserve aspect ratio. We currently vertically align to the top, and horizontally centre. We could align left instead, that might visually look more consistent. Is that a good representation ?
There are some indications that Commons was using more than 90px wide... Does anyone know if Commons was using a larger image in the search results than other wikis ? —TheDJ (talkcontribs) 19:15, 11 June 2024 (UTC)[reply]
2021
2017
Ideally we would use a size that already exists, i.e. the thumbnail needn't be generate for the search.
Above screenshots from 2017 and 2021. I doubt that was 90px. Not sure if anything is even visible on 90px.
Categories use 120px, maybe a bit larger would be fine. Enhancing999 (talk) 19:30, 11 June 2024 (UTC)[reply]
Come to think of it .. for the size, couldn't we use the user's preferred thumbnail setting? Enhancing999 (talk) 21:55, 11 June 2024 (UTC)[reply]
The actual size of thumbnail never changes, just the scale at which we display it. Going too large will simply cause more pixelation. There is some play, I’ll check tomorrow how much. —TheDJ (talkcontribs) 23:11, 11 June 2024 (UTC)[reply]
Gnomingstuff: Your take is also totally understandable but this change is hard to revert for a specific user so consider my change temporarily till we see what User:TheDJ can come up with as honestly I don't remember how it looked like before the changes. −ebrahimtalk 06:53, 11 June 2024 (UTC)[reply]
@Ebrahim admittedly I am not a CSS expert but max-height on the container and object-fit on the image (to crop anything that falls outside the container)? Gnomingstuff (talk) 14:05, 11 June 2024 (UTC)[reply]
The idea is to avoid random cropping (who could possible want that). It really makes search results hard to read. Enhancing999 (talk) 14:08, 11 June 2024 (UTC)[reply]
I would want that. It makes search results even harder to read when I have to scroll 3 viewport heights just to get past one image. Gnomingstuff (talk) 15:11, 13 June 2024 (UTC)[reply]
I was awaiting TheDJ's fix and somehow I didn't notice the ping in MediaWiki talk:Common.css and I was checking here instead… The fix is applied and it looks great to me but if there a specific case where things needs to be improved please bring it here to see what we can do about it. Thanks! −Ebrahimtalk 21:35, 14 June 2024 (UTC)[reply]
Great! Thanks to both of you! Enhancing999 (talk) 22:00, 14 June 2024 (UTC)[reply]

Tech News: 2024-24

[edit]

MediaWiki message delivery 20:17, 10 June 2024 (UTC)[reply]

New designs for logo detection tool

[edit]
Mockup for an alert when a logo is detected

Hello all! We're happy to share that we will work on logo detection in the following months and that we defined an initial approach for this.

You can read more at the project page and you can have your say in the project's talk.

We want your feedback on it, and we need your insights on how to further tune the detection tool.

Thanks for your attention! Sannita (WMF) (talk) 13:55, 11 June 2024 (UTC)[reply]

Protection level

[edit]

File:Kalocsaizsuzsa.jpg is autopatrol protected so why is there (protectedpagetext: editprotected, edit) system message on it? Is the Wikibase part of the page indeed under full (sysop) protection? --Geohakkeri (talk) 21:40, 12 June 2024 (UTC)[reply]

That is weird. The text This page is currently protected, and can be edited only by administrators. comes from Template:Protectedpagetext/PageProtected, but the expected text is at Template:Protectedpagetext/PageAutopatrolProtected. Both of these are transcluded by MediaWiki:Protectedpagetext depending on its first parameter $1. Here's the wikitext:
{{#switch: {{{1|$1}}}
 | editprotected = {{Protectedpagetext/PageProtected}} <!-- Fully protected -->
 | templateeditor = {{Protectedpagetext/PageTemplateProtected}} <!-- Template protected -->
 | editautopatrolprotected = {{Protectedpagetext/PageAutopatrolProtected}} <!-- editautopatrolprotected -->
 | #default = {{Protectedpagetext/PageSemiProtected}} <!-- Semi-protected -->
}}
Per mw:Manual:Interface/Protectedpagetext: $1 - the raw name of the right which is needed to edit the page. Special:ExpandTemplates for page File:Kalocsaizsuzsa.jpg and wikitext {{PROTECTIONLEVEL:edit}} gives editautopatrolprotected, as expected, but "protection level" and "name of the right" might not be the same. —⁠andrybak (talk) 20:08, 15 June 2024 (UTC)[reply]
editautopatrolprotected was added to MediaWiki:Protectedpagetext in Special:Diff/853065284 by User:GPSLeo, who is also the author of Template:Protectedpagetext/PageAutopatrolProtected. Perhaps they can check what went wrong. —⁠andrybak (talk) 20:15, 15 June 2024 (UTC)[reply]
This is the relevant code, I guess. There are editprotected and editsemiprotected hardcoded as the only options there. --Geohakkeri (talk) 20:51, 15 June 2024 (UTC)[reply]
So, if MediaWiki:Protectedpagetext depended on {{PROTECTIONLEVEL:edit}} rather than the proper parametre, it would be a quick fix at least. --Geohakkeri (talk) 21:11, 15 June 2024 (UTC)[reply]
Hmm. For reference, English Wikipedia's en:MediaWiki:Protectedpagetext has a similar #switch, with protect, editprotected, templateeditor, and extendedconfirmed.
Searching the code of MediaWiki,[1] I also found mentions of Protectedpagetext in PermissionManager.php,[2] which passes as the first parameter $1 either the string protect or a variable $right, which comes from function getRestrictions of RestrictionStore. My knowledge of PHP is limited, but I'd guess that possible values for restrictions come from $wgRestrictionLevels, hence templateeditor and editautopatrolprotected in Commons' version and templateeditor and extendedconfirmed in enwiki's version. —⁠andrybak (talk) 22:15, 15 June 2024 (UTC)[reply]

Footnotes

  1. git grep -i protectedpagetext -- '.' ':^languages/'
  2. note the manual mapping of sysop and autoconfirmed needed for backwards compatibility

Template presentation wigging out

[edit]

{{By color}} is displaying some CSS on Category:Orange gradient. I don't recall seeing this before and have used this template on several other pages. —Justin (koavf)TCM 01:50, 13 June 2024 (UTC)[reply]

It seems to come from Template:Gradient, possibly transcluded there after a change by @OmegaFallon: on Template:By color [17] adding Template:Translated meta category name. Enhancing999 (talk) 03:18, 13 June 2024 (UTC)[reply]

Are there any uses of this category by MediaWiki itself? We are discussing changing its name or scope at Commons:Categories_for_discussion/2019/06/Category:Pages_with_maps#June_2024. Enhancing999 (talk) 11:03, 13 June 2024 (UTC)[reply]

Interface administrator requests at MediaWiki talk:Gadget-Cat-a-lot.js

[edit]

There are several edit requests for interface administrators at MediaWiki talk:Gadget-Cat-a-lot.js. The following edit requests have diffs with proposals. In order of importance:

  1. Bug fix: MediaWiki talk:Gadget-Cat-a-lot.js#Minor edit unmarking feature not working (Special thanks to User:Miraclepine for reporting the bug.)
  2. Localization fix: MediaWiki talk:Gadget-Cat-a-lot.js#Mobile-frontend-return-to-page
  3. UI tweak: MediaWiki talk:Gadget-Cat-a-lot.js#Please add link to Help:Gadget-Cat-a-lot in the box

The page MediaWiki talk:Gadget-Cat-a-lot.js already has instances of {{Edit request}}. Because of it, these new requests won't show up in watchlists of those watching Category:Commons protected edit requests for interface administrators. Hence this additional message at Village pump. —⁠andrybak (talk) 16:31, 15 June 2024 (UTC)[reply]

Lucas Werkmeister, as the most recently active interface administrator with recent edits in Gadgets, could you please take a look? —⁠andrybak (talk) 19:46, 16 June 2024 (UTC)[reply]
Did two of them, leaving the third one open for feedback for a moment. And yeah, the watchlist issue is a general problem with the current edit request system – MediaWiki talk:Copyupload-allowed-domains also suffers from it from time to time. Lucas Werkmeister (talk) 21:03, 16 June 2024 (UTC)[reply]
Thank you! I've struck out the completed requests above. —⁠andrybak (talk) 21:20, 16 June 2024 (UTC)[reply]
Third one also done, and I’ll see if I can deal with Valerio’s edit request too, to get this out of the category. Lucas Werkmeister (talk) 20:03, 19 June 2024 (UTC)[reply]

Tech News: 2024-25

[edit]

MediaWiki message delivery 23:46, 17 June 2024 (UTC)[reply]

Adding mediainfo to many files

[edit]

How to apply this edit to another 60 files? I have used Upload Master, but on last step it tagged only one file instead of all files from batch upload. MBH 12:39, 18 June 2024 (UTC)[reply]

You can use Petscan and Quickstatemnts for that like this
  1. Open Quickstatements https://quickstatements.toolforge.org
    1. Login to quickstatements from top right corner login link (you need to do OAUTH authorization before the Petscan->Quckstatement integration works)
  2. Open Petscan https://petscan.wmflabs.org
    1. In tab "Categories" click link "commons"
    2. In tab "Categories" add value "Interior of B-396" to the categories box
    3. In tab "Page properties" check the value "File"
    4. Click Do it! -button
      1. There should be 104 results
      2. In top of the result list is text box with text: "Command list; "P31:Q5" to add, or "-P31"/"-P31:Q5" to remove statements". Change the value to "P180:Q4073829"
      3. Click check all
      4. Click start QS
        1. In quickstatements click Run
--Zache (talk) 13:11, 18 June 2024 (UTC)[reply]
*Zache Thank you, all done. MBH 11:43, 19 June 2024 (UTC)[reply]
User:Magnus Manske/sdc tool.js is way easier.
also, when you were using uploadwizard to batch upload, at the last step you can "copy statement to all files", which would have done exactly what you want to do. RZuo (talk) 15:45, 18 June 2024 (UTC)[reply]
@RZuo @Zache another question: I tagged English description of files as Russian [28] [29] , how to fix this? MBH 21:07, 20 June 2024 (UTC)[reply]
I would just use deepl, google translate, chatgpt etc to translate it to russian. Immediatly one could also just revert the edit, but in this case it doesn't work as system says that there is an edit conflict. --Zache (talk) 04:05, 21 June 2024 (UTC)[reply]
@MBH https://commons.wikimedia.org/w/index.php?title=File:View_from_Moscow_Sun_Ferris_wheel_19.jpg&diff=886167097&oldid=885974896
open the file page. a few lines below the file you can see two tabs "File information" and "Structured data". you can edit "Captions" in the "File information" tab. click the bin icon to delete a caption. click "publish changes" to save your edits. RZuo (talk) 07:31, 21 June 2024 (UTC)[reply]

New changes to the "Depicts" step in UploadWizard available on Beta Commons

[edit]

Hi all! I wanted to announce that on Beta Commons a new version of the "depicts" step of UploadWizard is available for testing. This new version will be available until Monday afternoon. We're waiting for your feedback on it at the general Village Pump. Sannita (WMF) (talk) 10:30, 19 June 2024 (UTC)[reply]

Want to know how to place a multi-page (4 page, pdf file) into a Spanish Wikipedia gallery?

[edit]

I am the editor of the Spanish article of Juan Francisco Morales Llerena of Ecuador. What do I have to do to place a four page PDF file into the Gallery of Juan Francisco Morales Llerena's Wikipedia page. I had placed a few multi-page PDF files into "Juan Francisco Morales Llerena's" Gallery a few years ago, but I cannot do it now. Something has changed, am I right or wrong? Bg1948Bg (talk) 15:41, 19 June 2024 (UTC)[reply]

@Bg1948Bg take a look at Help:PDF#Using_PDF_within_Wikimedia_projects. RZuo (talk) 17:22, 19 June 2024 (UTC)[reply]
Thanks a lot. Will do. I was getting a bit frustrated, but I will never give up. General Juan Francisco Morales Llerena is too important of a historical figure to do that. Thanks. Bg1948Bg (talk) 17:51, 19 June 2024 (UTC)[reply]