Archive.is blog

Blog of http://archive.is/ project
  • ask me anything
  • rss
  • archive
  • Fewer pages from archived websites show up when I enter the search terms. Websites that had snapshots listed in the thousands now have less than a tenth of that. What's going on? Have the pages been removed, did you change your algorithms, or is there some kind of glitch?
    Anonymous

    The search is performed using “Google Custom Search Engine” and similar Yandex’s product. Only the pages crawled and indexed by them can be found (less than 2% of all of the archived content).

    Why does not the archive have its own search engine?

    It is not a very demanded feature. Google shares the statistics and the revenue from ads above the search results: there is only about $5/mo while new servers capable to index all the archived texts would cost me about $500/mo.

    • 1 day ago
    • 1 notes
  • in your FAQ, link for the example for supporting national characters (the Chiense charcter: 测试) was broken could it be fixed? I Hsi-chu
    Anonymous

    Fixed. Thank you for reporting!

    • 1 week ago
  • You may have seen talk on Wikipedia concerning whether to allow archive_is links. Archiving prevents link rot in references, & ppl have pointed out archive_is has advantages over alternatives. But there are concerns. e.g. archive_org has a clear model/organization that instills confidence it'll stick around and won't run ads. Wikipedia can't afford to risk linking to a site en masse if it will be filled with ads soon, or if it's not likely to be around for long. Anything you want to add/clarify?
    Anonymous

    In my estimation the number of pages cited in the Wikipedia several times bigger than the number of pages saved in archive.is. The number of new links which appear on the Wikipedia daily also several times bigger than the number of stored pages every day on archive.is.


    If the Wikipedia would save all references into archive.is (you said “afford linking .. en masse“) this is of course cause problems.

    Such activity would not be similar to pressing PrintScreen and save the picture to a photo hosting site. It would become webcrawling and then archive.is would have to obey robots.txt.

    This may incur additional costs associated with the purchase of new equipment to cope with the increasing load. If the expense exceeds a certain threshold then the question arises about who pays for it: me, the Wikipedia or the visitors from the Wikipedia to archive.is (any other options here?). In the last case hardly it will be AdSense advertising as archive.is has on the search page, rather an aggressive fundraising campaign. Fundraising is more familiar to the users coming from the Wikipedia because it is exactly the way used by archive.org and the Wikipedia and the expected conversion ratio is higher than from AdSense.

    • 1 month ago
  • Any chance of implementing a "block javascript" option for archiving?
    Anonymous

    Could you explain your idea?

    • 1 month ago
  • Any forum that features a picture from imgur. While archiving it will recognize almost any picture that is directly on their site and save it, however if the picture has an url on imgur it won't. In fact during the process of archiving these images will be marked grey, miss file size and lack an identification of what sort of file they are while other pictures will be in the green, feature they byte size and be written as image/gif or Image/png. Mostly on Something Awful forums
    Anonymous

    Imgur sometimes (for some clients) redirects from i.imgur.com to imgur.com; from the image to the html page with the same image + ads.

    That was the case with the archive, I made a quick fix so images are loaded (example http://archive.is/tNdK2) But I am not sure how reliable it is. I have no idea about how the Imgur’s redirect logic works.

    • 1 month ago
  • Archive won't save pictures posted on forums. What might be the problem?
    Anonymous

    What forum?

    • 1 month ago
  • Saving web page seem broken, I tried to save 5 different pages and it return a "blank page" as saved page. Moreover when I look to see ALL archived pages for this (www). (sciencedaily). (com) all recent page most of them are blank page :(
    Anonymous

    There is a problem with saving pages from sites behind of Incapsula (a DDOS-protection CDN similar to Cloudflare), such as sciencedaily.com, offshoreleaks.icij.org, monsanto.com, …

    They do not ask for CAPTCHA, they just return a blank page for half of requests and even retrying via proxy does not help.

    I will investigate it further.

    • 1 month ago
  • Pages at NASA(gov) are not being archived by your service. The pages turn up blank, yet archive (org) is able to preserve them completely. I prefer the archive(is) service, and would like to know if y'all can look into how your service can archive NASA(gov) pages. Thank you very much! Examples of pages being blank: archive(is)/TMOnl archive(is)/yj70L
    Anonymous

    I will see, thank you for the report.

    • 1 month ago
  • Google Play Store pages have an expandable description, but right now archiveis doesn't capture the full description, like archiveis/3C6cB would it be possible to archive the full description?
    Anonymous

    ok, fixed.

    • 1 month ago
  • Facebook has blocked your account again, please change it ?, because your archiving system is amazing ?, if not consider open sourcing the systems source code ? :) would help alot XD
    Anonymous

    ok

    • 2 months ago
    • 1 notes
Next page
  • Page 1 / 27