Archival Tools - How to archive anything.

anyone have archive.today in the archiving part not load any URLs for some reason, like it's not giving the ring but in the archiving part where URLs are meant to pop up they don't.
 
john5433 said:
anyone have archive.today in the archiving part not load any URLs for some reason, like it's not giving the ring but in the archiving part where URLs are meant to pop up they don't.
Click to expand...
Earlier I saw lots of reloading, and a heightened chance of archive failure. Now I see a pretty long (>10,000) queue length (edit: which resulted in it failing to archive almost an hour later). This is only happening in the last, idk, 12 hours or so.

Since the whole service is affected, it will get fixed. I was worried about it being specific to a website when I first saw it.
 
Last edited:
How would I go about archiving an entire X / Twitter account (around 3k posts)? I would use the Wayback Machine but that does not work for X. I do not know if Archive.is would work.
I have been thinking of using using Selenium but I do not really know how I would use it or where I would even archive the scrapped information.

I have tried looking into this in here but fail to come across any answers.
 
Last edited:
Bullet Kin said:
entire X / Twitter account
Click to expand...
if you want to be able to archive purely x.com links megalodon/ghostarchive is your friend, however it is very much the standard to use nitter.net/.poast.org when archiving links, that is if you want to do it manually.
doing a simple duckduckgo search got me to this
there also might be a way to configure httrack to only save links from your specific profile you want to focus but that's assuming nitter.net allows scrapers of some kind
 

Attachments

PRO TIP: sometimes a page won't archive properly, but will appear correctly in the 'screenshots' section of Archive Today or the Wayback Machine.
Screenshot_20260122_132446_Chrome.jpg
Screenshot_20260122_132347_Chrome.jpg
 
Markass the Worst said:
It's been like that for a while. Sometimes if you get lucky and it chooses an IP that isn't blocked it works. Reddit has aggressive anti-scraping measures and is generally a piece of shit website that somehow manages to have a userbase.
Click to expand...
just use a redlib instance that doesn't have Anubis and you'll be fine.
 
I'm not sure this is common knowledge regarding youtube community posts, but by default it does not show the entire image on desktop. Desktop browsers show cropped versions while the youtube app will show the whole image.

However, you can still archive the intact image using a computer by editing the link you get after clicking "open image in new tab" by removing the last portion of the link that starts with an "=" sign.

Example:

Cropped:


1770919064636.png

Uncropped:


1770919103356.png

Hope this can help someone because I didn't know, and thought I might have to archive using screenshots on my phone.
 
You must log in or register to reply here.
Back
Top Bottom