4plebs

355 posts
Opens profile photo
4plebs
@4plebs
Official X account of 4plebs | Still archiving...( ̄~ ̄)
WWWarchive.4plebs.orgJoined June 2013

4plebs’s posts

We're gradually rolling out a new image description search feature to the archive. Descriptions will be generated automatically, but it will take some time before they're all searchable. Hover your mouse over an image to see the generated description.
Image
Apologies for the recent search issues. We are still adjusting to our new server and had to reindex everything again. It should be fixed for now. Thank you to everyone for letting me know
We seem to be having an issue with our image serving domain. We are investigating this issue, but for now images are working again using an alternative domain name.
Sorry for the recent downtime and search issues. Everything should be all good now. Thank you to everyone who reached out!
Search limits for robots have been removed. The site might go down occasionally because of it. To keep the site usable for humans I might consider some kind of paid access to the search API. This data is clearly valuable to some people
I'm running a task to slowly fix some filenames that were incorrectly shortened due to a bug (webm->web and jpg->jp). It's a long process, but it has to be done
This issue has been resolved
Quote
4plebs
@4plebs
We seem to be having an issue with our image serving domain. We are investigating this issue, but for now images are working again using an alternative domain name.
4plebs is down while we wait for the fetcher to catch up. I plan on doing something about this poor performance soon.
Rotating ancient search indexes. The site is down to make it go a little faster. Shouldn't take long
We experienced a short denial of service attack on our front-end server. Archive is functioning normally again!
Developers: Due to recent abuse all 4plebs API endpoints will have dynamic rate limits. Response code 429 means you've hit your limit. Use Retry-After header to see how many seconds you should wait before making a new request to same endpoint.
I've been quietly putting old full images back online. Images from April 2014 to this day are now available. Took around 4.5 TB more space.
Sending many request per second is never acceptable and may result in your IP, IP-range or ISP banned from using the archive. Also developers should include a name or contact info in their User-Agents
No estimated time for return. We are still archiving and nothing is broken. Election results sticky reached 73171 posts and 21950 images.
Performance tweaks I recently added to the site seem to be helping deal with the extra visitors. Still there's room for improvement
Replying to
Usually this is caused by a bug in the software, but sometimes it can be caused by visitor who finds a way to execute a search query to disrupt the site. We will be investigating this further to make sure it doesn't happen again
If you want to crawl a site, please use a recognizable user agent string that includes contact information - pretending to be a real browser will get your robot blocked