Archive.today blog
-
Which language and libraries do you use to archive websites and if you could rewrite your code which languages and libraries would you choose now?
Anonymous
Scala, Javascript, Go.
I would try to use Yandex’s Elliptics instead of Hadoop as storage backend; it should better handle big failures, for example, whole datacenter outages.
-
Is there a way to archive this page w/o the annoying popup that prevents us from reading the archive? After clicking to remove popup, the page redirects to original URL (which might be changed or gone). Thanks. archive: 5VHBC
Sure.
We try to remove the popups which hide the text (compare http://archive.today/5VHBC/image and http://archive.today/5VHBC) but the algorithm is not 100% accurate.
Thank you for reporting the bug.
-
Your service has been used by Julian Assange in his book When Google Met Wikileaks. Please try to get your database encrypted and distributed, and ensure that somebody can release the key to it, should you be forced into silence or otherwise censored.
-
I would like to run my own web capture service instead of relying on a third party service I have no control over. Is it possible to install this on my own server ? Do you have any plan to share your work under an open source license ?
No. But you can find some similar open source projects on github.
-
Not really a question more of a comment. The isp xplornet is actively filtering archived sites, just thought you'd like to know.
-
Virtually every archived link I try to visit fails to load, can you explain why?
Can you provide more info about the problem?
-
-
I try to archive a page but I get Error: Assertion failed.
It can happen when one tries to archive PDF-file or MP3-file or RSS-feed or something like that.
If your page was a normal one, please tell me its url.
It could be a bug. -
is it true that archive,today is going to be purged?
No
Why do you think so? -
Hi there, I have heard that some material related to the GamerGate controversy in the gaming world has been removed. Can you give me any details on what your polices are on removing material and who might have requested this? Thanks a lot
Hi.
I have never heard about “GamerGate” controversy and I have not received any related deletion requests.