Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to help preservation without seeding all torrents? #3

Open
Derpitron opened this issue Jun 1, 2023 · 24 comments
Open

How to help preservation without seeding all torrents? #3

Derpitron opened this issue Jun 1, 2023 · 24 comments

Comments

@Derpitron
Copy link

I want to help preserve all these torrents/magnets. But I don't have the disk space to seed everything.

How can I help out, beyond forking this repo?

@travisterrell
Copy link

Idk myself, but FWIW I suspect forking won't do a ton, just because there is a 0% chance that GitHub won't remove this and all forks as soon as they get a DMCA notice. (And there are surely dozens of them currently en route, lol.)

@crackwitz
Copy link

crackwitz commented Jun 1, 2023

I would suggest gathering all the .torrent files at least. That doesn't mean the content of the torrents, just the .torrent files.

The magnets themselves don't describe the content. Each of those magnets describes a .torrent file.

Many of the .torrent files can still be downloaded from the network because every seed of the torrent's content is also a seed of the .torrent file itself.

@Martinligabue
Copy link

Some decentralisation could be achieved by creating a website hosted on IPFS (so it stays online without a single server, and easily reachable via IPNS), or a torrent that contains everything.
Like Torrent Paradise, which continued to operate for months after the official servers were shut down (now it seems no one has the files anymore, since the search doesn't work). (bafybeibdvh7bkqlh72witdvtk2dndlndj67zgws5rutawenton4qckjjfy it didn't have an easy ipns, but it worked)

@mrx23dot
Copy link

mrx23dot commented Jun 1, 2023

with magnet don't forget to set your trackers to known ones, so we find each other
https://raw.githubusercontent.com/ngosang/trackerslist/master/trackers_best.txt

@mrx23dot
Copy link

mrx23dot commented Jun 1, 2023

Idk myself, but FWIW I suspect forking won't do a ton, just because there is a 0% chance that GitHub won't remove this and all forks as soon as they get a DMCA notice. (And there are surely dozens of them currently en route, lol.)

What if we remove the magnet link and just use filename+hash as csv.

@crackwitz
Copy link

crackwitz commented Jun 1, 2023

Legally the same thing (inb4 "no it's not"). Don't complicate it.

@2004content
Copy link
Owner

2004content commented Jun 1, 2023 via email

@a-raccoon
Copy link
Contributor

a-raccoon commented Jun 1, 2023

I found this paste on IRC. Looks like mostly movies/h264/1080 category of low bitrate english (-RARBG) and foreign (-VXT) films.

https://privatebin.net/?58fba245e3e2c96d#EAJwnc2p6xpQpY7k4Phg3f1wbd1vz1Xs1VGRADM9gTnY

@nektro
Copy link

nektro commented Jun 2, 2023

@crackwitz magnet urls do describe content. .torrents were popular before magnet urls existed since you can add extra metadata and more easily preload a list of trackers to use, etc. but the part of a torrent that includes the checksum data for the content being described is is included in the infohash that makes up the primary part of a magnet uri and can be obtained by connecting to peers through trackers and DHT

@mrx23dot
Copy link

mrx23dot commented Jun 2, 2023

There are other big magnet databases which would be great to merge:

https://magnetsdb.com/search?title=633+Squadron
https://bitsearch.to/search?q=633+Squadron
https://www.imdbtorrent.com/tt0057811

@mrx23dot
Copy link

mrx23dot commented Jun 2, 2023

@crackwitz magnet urls do describe content. .torrents were popular before magnet urls existed since you can add extra metadata and more easily preload a list of trackers to use, etc. but the part of a torrent that includes the checksum data for the content being described is is included in the infohash that makes up the primary part of a magnet uri and can be obtained by connecting to peers through trackers and DHT

someone also posted the torrent files on reddit,
we could upload those to https://torrage.info/ for redundancy,
based on hash then we could download the torrent file too for meta info.

@mrx23dot
Copy link

mrx23dot commented Jun 2, 2023

also an interesting project p2p search engine, maybe that's the future
https://github.com/DEgITx/rats-search

@cs2000
Copy link

cs2000 commented Jun 2, 2023

Someone has already mentioned it, but remember forking isn't "backing up" this repo . I would recommend downloading this either manually or using GitHub Desktop, the takedown notices will be coming for this repo and if/when it comes, it takes down all forks.

@mrx23dot
Copy link

mrx23dot commented Jun 2, 2023

Magnet Links + Blockchain = censorship resist

instead of fearing that government takes down our precious torrent sites why don't we build a blockchain out of it?

  • Highly distributed, impossible to block
    
  • constantly updated, always up to date (Fresh juicy stuff)
    
  • infinite history
    
  • never have to find the next rarbag which will be taken down eventually
    

not sure how to stop spams though, no voting, only static data (name and hash)

@a-raccoon
Copy link
Contributor

Stop bickering and debating your bullshit. Stay on topic and delete all your previous posts now.

@Martinligabue
Copy link

Stop bickering and debating your bullshit. Stay on topic and delete all your previous posts now.

the topic is "help preservation without seeding all torrents", and these answers are possible ways of doing that, even you suggested a Pastebin at one point, so why are you so itchy?

@a-raccoon
Copy link
Contributor

This is for DO not DISCUSS. If you don't know what a magnet is, or how it's useful, or even if you do know but you disagree, go the fuck away. There is only DO no CRY.

@mrx23dot
Copy link

mrx23dot commented Jun 2, 2023

wow it already exists, blockchain based backup https://github.com/Stuyk/eos-torrent
@Stuyk

@Stuyk
Copy link

Stuyk commented Jun 2, 2023

@mrx23dot It's not a free solution. It will cost in the form of RAM on the EOS Blockchain. Which means it will take additional currency to store string data on-chain. Take a look at Gun DB sometime. Might be more inline with costs, and usefulness. 👍🏻

@mrx23dot
Copy link

mrx23dot commented Jun 2, 2023

@Stuyk thanks for the info, as I checked smallest unit gives us ~11 000 entries for 1usd, might also help with spam,
https://eosio.stackexchange.com/questions/4305/what-is-the-smallest-unit-of-eos
given smallest unit is enough for a transaction/addition, but you might know better.

Gun DB is interesting, can we enforce only adding to it, preventing one person overriding/deleting entries?

@Stuyk
Copy link

Stuyk commented Jun 2, 2023

@Stuyk thanks for the info, as I checked smallest unit gives us ~11 000 entries for 1usd, might also help with spam, https://eosio.stackexchange.com/questions/4305/what-is-the-smallest-unit-of-eos given smallest unit is enough for a transaction/addition, but you might know better.

Gun DB is interesting, can we enforce only adding to it, preventing one person overriding/deleting entries?

https://gun.eco/docs/Frozen

@mrx23dot
Copy link

mrx23dot commented Jun 3, 2023

Found an active blockhain one, 2usd/1000 uploads, FREE for search/downloads
https://github.com/ortegaalfredo/blockchainbay

@Rukono
Copy link

Rukono commented Jun 3, 2023

you can use a site like archive.org to preserve without tanking space

@dshatz
Copy link

dshatz commented Jun 11, 2023

Found an active blockhain one, 2usd/1000 uploads, FREE for search/downloads https://github.com/ortegaalfredo/blockchainbay

I'm ready to help arrange this.
The idea is as follows:

  • Custom smart contract based on the blockchainbay dedicated to rarbg torrents.
  • A simple desktop/mobile app capable of searching torrents on the blockchain.
  • A way to upload torrents (web3 website?)

This way it seems possible to more or less recreate un-bannable rarbg clone and even keep it alive by uploading new torrents.

How many torrents are we talking about? What's the most complete backup we have? Once we know the number we can see if we can arrange a small crowdfunding for this goal.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests