Seeing some rumblings about Tumblr banning Internet Archive. That's not true, thankfully! All our crawlers are up and running (you can check by going to https://web.archive.org and using the Save Page Now feature! e.g: http://makyo.io/tumblr-spn-test ).
THAT SAID, ArchiveTeam's project to archive Tumblrs is racing right up to the finish line! If you want to run a Warrior (distributed crawler), you can find out more here: https://archiveteam.org/index.php?title=Tumblr
Update! Tumblr is apparently banning chunks of ArchiveTeam (who does warrior stuff). They're not IA, but that doesn't mean it's not shitty for Tumblr to do :S
@makyo My warrior instances were all hit by this, yeah
@makyo Downloading the VM as I post this. 😀
@makyo I tried Save Page Now on https://iron-eater.tumblr.com/post/181193855187/ (warning: no idea about its contents, I didn't see it, it's a link I stumbled upon, may be NSFW or require other CWs), and got “This page is not available on the web because of server error”.
@valhalla huh, may have just been a one-off. I'll poke folks after meetings! https://web.archive.org/web/20181217171436/https://iron-eater.tumblr.com/post/181193855187/after-the-better-part-of-a-decade-im-moving-on
@makyo maybe some rate limiting?
great that now it has worked
@makyo Wow warrior is painless to set up! Go docker! :D
@makyo Actually, looks like safemode stuff is prefenting access to a lot of blogs. Know if there's a way around that?
@makyo Checked in on #tumbledown. Looks like that's how they're blocking off the nsfw stuff.
As a follow-up, Tumblr may be banning IPs of Warriors. That is, unfortunately, outside our control. It'd likely be due to rate-limiting.