Log in

No account? Create an account
Entries Journal Reading List Calendar User Info Previous Previous Next Next
Tumblr CrossPost:17decemberarchive: This is how the Archive Team is going to... - Morgan Dawn Livejournal:The Here And Now — LiveJournal
The Here And Now
Tumblr CrossPost:17decemberarchive: This is how the Archive Team is going to...
Posted in full at: https://ift.tt/2RFPuxp at December 06, 2018 at 09:16AM


This is how the Archive Team is going to save Tumblr (and you can help us)

There is a website in trouble like Tumblr

We have hundreds of warriors machines, which run a special operating system made for archiving the web.

There is a tracker which is a central ToDo list worked on by each warrior. The warriors keep the files for archiving only for a moment before they hand them to the staging servers.

The staging server collect and process the data into huge .warc files which are accepted by archive.org

archive.org process and indexed our .warc files and makes them available in the wayback machine. It takes care of the long term hosting. Each TB stored costs somewhere between 1500$ and 2000$ in the long run. 

Our minimum how much we will save is above 60 TBs. An estimate of the total size of the NSFW part of tumblr alone is 10-20 times that. Even when we will archive only a fraction it is going to be expensive.  When you donate to archive.org today. Your donation will be matched.

You can help the Archive Team (which is not related to the nice guys at archive.org) by filling out this https://docs.google.com/forms/d/e/1FAIpQLSdoYnlweKF-5iQ2G0FB9s7pDV_Le61dDU-gMMDsc8CQ50YBjQ/viewform?hl=en form  which is used to built the ToDo list stored by the tracker. We are looking for endangered blogs like NSFW blogs for example. If you know any that you would be sad be to loose please add them to the list. That way they will be saved.

Please share.


Tumblr post (this is likely a reblog, and may have more pictures over there)
December 06, 2018 at 09:16AM

[A Dreamwidth post with comment count unavailable comments | Post or read on Dreamwidth| How to use OpenID]


Leave a comment