User talk:Dominic

File:"Name of Mudd-Sulllied in Lincoln Slaying-Gets a Cleaning" - NARA - 139975.tif

File:"Name of Mudd-Sulllied in Lincoln Slaying-Gets a Cleaning" - NARA - 139975.tif has been marked as a possible copyright violation. Wikimedia Commons only accepts free content—that is, images and other media files that can be used by anyone, for any purpose. Traditional copyright law does not grant these freedoms, and unless noted otherwise, everything you find on the web is copyrighted and not permitted here. For details on what is acceptable, please read Commons:Licensing. You may also find Commons:Copyright rules useful, or you can ask questions about Commons policies at the Commons:Help desk. If you are the copyright holder and the creator of the file, please read Commons:But it's my own work! for tips on how to provide evidence of that. The file you added has been deleted. If you have written permission from the copyright holder, please have them send us a free license release via COM:VRT. If you believe that the deletion was not in accordance with policy, you may request undeletion. (It is not necessary to request undeletion if using VRT; the file will be automatically restored at the conclusion of the process.) This file is a copyright violation for the following reason: Copyrighted article by Iver Peterson, reporter for the New York Times. This was released by NARA as part of a set of files from the White House Counsel's Office, but they did not actually create this article. Warning: Wikimedia Commons takes copyright violations very seriously and persistent violators will be blocked from editing.

 

IagoQnsi (talk) 18:05, 16 June 2026 (UTC)

HathiTrust

Hi, If I understand correctly, HathiTrust (HT) is a partner of DPLA. Currently HT blocks downloading of books, so a plugin with a browser has to be used. There used to be a small tool called HathiDownloadHelper, but it doesn't work anymore because HT changed their API. Would it possible to ask HT for some privileged access for uploading their books to Commons? Thanks, Yann (talk) 19:03, 14 July 2026 (UTC)

We have about 3 million of their items already in DPLA (I think they only shared ones explicitly marked PD). We are occasionally in touch with them, and I would not mind mentioning it, but is there more background on the change to their API. Did they change their terms of service to prevent our intended use, or is it just a technical issue? Also, do you know if any of our uploads were being done with the participation of one of their institutions; the request of a contributor who wants to share with Commons might be more likely to get their attention. Dominic (talk) 20:02, 14 July 2026 (UTC)

Download was always a bit restricted to one page at a time. But HathiDownloadHelper and currently Internet Archive Downloader get these pages and reconstruct the PDF on the fly. HathiDownloadHelper was very reliable, and batch download was possible. Now Internet Archive Downloader fails very frequently and randomly. The change of API was probably because of heavy use by LLMs (Gallica has implemented a similar restriction with a captcha.). Many of HT books are available on Google Books in a lower quality and resolution. And many of HT books are not available elsewhere. Scans available at HT produce a much better OCR, and therefore much less work on Wikisource. Yann (talk) 21:33, 14 July 2026 (UTC)

Yes, we've had to implement captchas on dp.la as well. We don't actually harvest HT's media, only the data, so we would be asking for some type of access. HT also recently restricted access to the endpoint we used use to harvest just the metadata, and we were forced to harvest via the public feed, so I know they have been locking things down. But I do have a contact there who might get back to me at least. Dominic (talk) 02:19, 15 July 2026 (UTC)