Skip to main content

View Post [edit]

Poster:file-archivist286Date:Jul 23, 2017 11:32am
Forum:opensource_audioSubject:How can I upload a large amount?

I'd like to upload a very large amount/size of public domain audio files. My end goal would be that people could use bittorrent to retreive this massive amount of stuff, but I don't know how to get it to archive.org in the first place. The uploader seems to have a limit of 16GB, whether that's a limit from Chrome Browser, or something else, I'm not sure.

The full archive I'd like to transmit is 255 GB total. I'm trying to use bittorrent to send everything, but I don't know how to find out if that's working. I uploaded the .torrent file to archive.org, and my torrent is seeding, though it's incredibly slow uploading. (My connection can handle unreasonable speeds)

I don't know that I have the bittorrent thing set up right, as friends are not able to download anything, but can see that there's 1 seeder and 2 leechers, etc. I don't know if that's archive.org that's leeching, but there wouldn't be anyone else on the torrent. I don't know if I set up the tracker part right. I'm not very knowledgable with torrents.

I saw also that FTP was discontinued. Is there any other way I can upload this massive amount of stuff other than through the file uploader or bittorrent? (Looking for something faster)

Total stats: 255GB in 22,602 .mp3 files.

Thanks in advance for the help.

https://archive.org/details/sermonindexaudioarchive

Reply [edit]

Poster: norwoodDate:Jul 23, 2017 2:12pm
Forum:opensource_audioSubject:Re: How can I upload a large amount?

i can help if you send this request to info@archive.org.

Reply [edit]

Poster:file-archivist286Date:Jul 23, 2017 3:59pm
Forum:opensource_audioSubject:Re: How can I upload a large amount?

Wow, I sure appreciate that!

I've sent the email.

Thank you.

Reply [edit]

Poster:Dennis334Date:Feb 21, 2023 9:26pm
Forum:opensource_audioSubject:Re: How can I upload a large amount?

I'm trying to upload a large zip file (17 GB). which is a dataset of synthetically generated fingerprints. I'm currently using this dataset to try and develop/train a GAN to reconstruct noisy fingerprints. The purpose of uploading this file to archive.org is to make this dataset easily available to anyone that wants it, but it always claims that there was a network error before the full file was uploaded.

Is there anyway I can upload this file to archive.org?

Reply [edit]

Poster: norwoodDate:Feb 21, 2023 9:36pm
Forum:opensource_audioSubject:Re: How can I upload a large amount?

yes, just log in and upload it.

Reply [edit]

Poster:Dennis334Date:Feb 28, 2023 9:23pm
Forum:opensource_audioSubject:Re: How can I upload a large amount?

It's encouraging that I should be able to upload this large file (17 GB), but it doesn't seem to work for me. I've tried this 5 times on multiple different computers, and each time the upload ends reporting a network error. Also when I try to upload it, the progress bar says the size of the file is 16 GB, but the windows file browser says it's over 17 GB. This makes me think that there is a max upload size of 16 GB (at least for the method I'm trying to upload this file).

Is there some other way I could try?

Reply [edit]

Poster:pierre-mauroisDate:Jun 20, 2023 2:30pm
Forum:opensource_audioSubject:Re: How can I upload a large amount?

One more thought....
Depending on the extension of the file, I've noticed that some cause significantly more bugs than others. For example, when I upload .mov files, they tend to freeze more often than compressed video files. I would try to convert into a lighter extension to see if the problem persists.
Regards,
Pierre, Informatique Genève
https://www.iconsa.ch/fr/

Reply [edit]

Poster:pierre-mauroisDate:May 9, 2023 7:25pm
Forum:opensource_audioSubject:Re: How can I upload a large amount?

I'm sorry for the inconvenience this has caused. If everything else fails, have you tried to split the file in 2 pieces? I know it's not ideal, but past the 1 GB point, it is difficult for any website to maintain connection that long.

Hope this helps
Pierre, Switzerland
https://www.office-box.ch
This post was modified by pierre-maurois on 2023-05-10 02:25:49

Reply [edit]

Poster:pierre-mauroisDate:May 9, 2023 7:26pm
Forum:opensource_audioSubject:Re: How can I upload a large amount?

It's possible to break it down in several pieces, archive.org fully supports that, and it's still acceptable for users to switch from one file to the next when they browse it.

Hope this helps.
Pierre
https://bestcanadianflorists.com/