800 GiB torrents with 1500k public domain paywalled papers from before 1923
Happy public domain day to all! A special thought for people in the USA, who until yesterday suffered a 20-years-long winter of ever-expanding copyright.
Let me return to the racket of academic publishers who abuse copyright to enslave thousands of researchers and leech billions in public funding from cultural institutions every year. Following my release of public domain IEEE papers and seeing the format of some other releases by other users, today I bring your attention to Scholarly works published until 1909 (torrent) and in 1909–1922 (torrent).
Please download and seed the torrents above! Or if you prefer you can add the hashes/magnet links directly, but not all clients support the web seeds provided this way.
Hashes:
5a17b09511034fcf8dfebcf00a0499660154cfb6
70ecab072b2792c9239ab8197d3f52cc1d075be1
Magnet links:
magnet:?xt=urn:btih:5a17b09511034fcf8dfebcf00a0499660154cfb6&tr=udp%3A%2F%2Ftracker.coppersurfer.tk%3A6969%2Fannounce&tr=http%3A%2F%2Fbt1.archive.org%3A6969%2Fannounce&as=https%3A%2F%2Farchive.org%2Fdownload%2F
magnet:?xt=urn:btih:70ecab072b2792c9239ab8197d3f52cc1d075be1&tr=udp%3A%2F%2Ftracker.coppersurfer.tk%3A6969%2Fannounce&tr=http%3A%2F%2Fbt1.archive.org%3A6969%2Fannounce&as=https%3A%2F%2Farchive.org%2Fdownload%2F
These datasets contain 1,518,078 PDF files from various sources, often with added OCR. They were all published before 1923 in international journals. I'm not providing legal advice, but if you consider them simultaneously published to USA they should all be in the public domain in the USA. Yet, publishers apply indiscriminate copyright statements to the contrary, which may constitute copyfraud, and lock nearly all of them behind paywalls or other hurdles, hoping to milk some more profit for who knows how many centuries.
You can also download PDFs by individual publisher, going by their DOI prefix and checking the full list of DOIs (1909, 1923). Internet Archive can also support the direct download of individual files inside the ZIP files but that's probably best handled by other repositories.
Library users have already reused and curated these public domain datasets to enrich some knowledge bases and open repositories which make the works more accessible. Given publishers fail to perform their duties, it's on us to comb through the copyright status and metadata for all the scientific knowledge.
Thanks for reminding me! I've registered years ago, I think, but I've never used it yet.
Here you go with the first: http://academictorrents.com/details/70ecab072b2792c9239ab8197d3f52cc1d075be1/tech
The admin kindly upgraded my account to uploader, but I had forgotten that the upload form requires the torrent file to already contain their own tracker. Luckily torrent-file-editor allows to change such details without changing the info_hash, otherwise it would have fragmented the node swarm.
I'm a bot, bleep, bloop. Someone has linked to this thread from another place on reddit:
[/r/college] 800 GiB torrents with 1500k public domain paywalled papers from before 1923
[/r/copyleft] 800 GiB torrents with 1500k public domain paywalled papers from before 1923
[/r/dhexchange] 800 GiB torrents with 1500k public domain paywalled papers from before 1923
[/r/noip] 800 GiB torrents with 1500k public domain paywalled papers from before 1923
[/r/open_access_tracking] 800 GiB torrents with 1500k public domain paywalled papers from before 1923 : DataHoarder
[/r/opendata] 800 GiB torrents with 1500k public domain paywalled papers from before 1923
[/r/opendirectories] 800 GiB torrents with 1500k public domain paywalled papers from before 1923
[/r/openscience] 800 GiB torrents with 1500k public domain paywalled papers from before 1923
[/r/publicdomain] 800 GiB torrents with 1500k public domain paywalled papers from before 1923
[/r/u_dormin96] 800 GiB torrents with 1500k public domain paywalled papers from before 1923
If you follow any of the above links, please respect the rules of reddit and don't vote in the other threads. (Info / ^Contact)
Trying to jump on with a seedbox
I'm getting this from the Tracker: [Failure reason "Requested download is not authorized for use with this tracker."]
For both .torrent files. Same result using DHT (I've enabled DHT for this).
Thanks for helping! Yes, the reply from the archive.org tracker is bogus at the moment. You should still get the webseed working, and if you add the other tracker (e.g. udp://tracker.coppersurfer.tk:6969/announce) you should now see several nodes.
Looking for a Seedbox recommendation? Read this First. There are plenty of suggestions in other parts of Reddit. I can say that the fastest node I currently see connected to these torrents is on Whatbox.
This is a perfect job for KS-2 on kimsufi since they give you 1TB of storage on dedicated server:
https://www.kimsufi.com/us/en/servers.xml
4.99€ / mo or $5.99 USD / mo
I can't find it anywhere but do they have a data usage charge for egress and ingress?
Not that I know of. It is best effort 100Mpbs or better. So you could push 35 TB per month theoretically . The CPU nor memory is not great so you can't saturate bandwidth. Need $20/mo server for that. But using just as a seed box it is fine.
there was a discord that kept a track of availability. i see there's this service to tell you: https://kimsufi-notifier.com/
I got a KS-1 but it took me several weeks (3.99€/mo)... Good luck with KS-2. If I had a budget, I'd seed one for science, but I'm not that motivated.
This is the kind of technology rebels that I like ... the kind who steals fire and gives to the world.
Your first link seems to be broken (Scholarly works published until 1909 (torrent)), specifically the torrent link. Here's the good link: https://archive.org/download/crossref-pre-1909-scholarly-works/crossref-pre-1909-scholarly-works_archive.torrent
Any particular reason 1923 is not included? The US threshold changed to 1924 on January 1 of this year, so anything published before 1924 (including 1923) is now in the public domain in the USA. I don't particularly need anything, just curious.
I started assembling the dataset months ago and I posted it on the Internet Archive when it was still 2018, so 1923 was the threshold at the time.
Are those papers available in Sci-Hub and Library Genesis? I think the best and easiest way to keep those papers alive would be to add them to those projects and help them there. They already have a good infrastructure that can be replicated :)
+1 Does anyone know how to get in touch with Sci-Hub? They'd have to resolve the DOIs to get the rest of the metadata. But someone who knows what they're doing could code this pretty fast... if Sci-Hub doesn't already have that coded.
Silly publishers, giving away all that delicious metadata for free. (rubs hands together)
If I remember correctly, sci hub first integrates the PDF into library Genedus. if this torrent contains the PDFs and the metadata is simple to upload there. There's a forum for library genesis discussions, mainly in Russian but since guys there speak English also. I'm on holidays now so I can help much.
AFAIK they are, didn't check recently. This dataset is mostly to aid those who need a corpus large enough and easy enough to download at once, or who need a more "mainstream" access venue.
Thanks. Added to my seedbox, though it always hates IA torrents for some reason and runs a bit slow
Thanks! The web seeders rarely go above 1-2 MiB/s in my experience, sometimes much less from Europe. That's one reason it's helpful to have more seeders from around the world. :-)
Downloading now, was looking for this specific project. I'll plan to seed forever. Thanks!
Should one build a seedbox for local/private use or should one buy a per monthly one?
This is not the latest blockbuster in ultra-high resolution, it doesn't move that much traffic. If you don't already have a seedbox it's frankly better that you just torrent it at home from an external hard disk and let it sit there as a distributed backup for the future.
you should put this on legittorrents too, just for duplication. I don't have the storage space to seed this at the moment, but hope to later this year when I finally have the funds to build my nas (HDD's are expensive yo)
What in the ever loving fuck is wrong with you? What does Trump have to do with any of this?
Copyright was extended years ago, by Congress. He had nothing to do with it. And no, he could not undo it via EO, because Presidential EO does not carry the same authority as Congressional law.
Not the president.
See my second point.
Trump is literally powerless regarding current standing law. That's the checks part of the checks and balances.
Denouncing the Bern convention? Eh. Meanwhile: The USMCA and Copyright Reform: Who is Writing Canada’s Copyright Law Anyway?; A Mix Of Good And Bad Ideas In NAFTA Replacement; NAFTA Replacement Extends Canada's Copyright Term to Life +70 years.
EFF regularly has some call to action for copyright issues in USA where it's useful to call representatives, follow: https://www.eff.org/issues/innovation
Get trump cum out of your mouth dude. I get it you like him but calling him "Big Dick Dadyo" is pathetic. Seems like you want him to fuck you up your fat incel ass.
The Democrats who's dick is in hollywood's mouth would make all copyright content in 20 years? Never in a million years.
Copyright terms are excessive today, most things are not commercially viable within a decade or two after release anyways. You're off your rocker if you think Trump would do anything about it, even if he could.
116k
Subscribers
475
Online
This is a sub that aims at bringing data hoarders together to share their passion with like minded people.