I want to rip the contents of a pay website, but I have to log in to their web site on a web page to get access
Does anyone have any good tools for Windows for that?
I’m guessing that any such tools must have a built in browser, or be a browser plugin for it to work.
Okay, I found SurfOffline that does the trick without too much hassle, but…
It’s verrrrrrrry slooooooooow.
It uses Internet Explorer as a module, and calls each individual resource separately, instead of file copying from IE’s cache, which is weird and slow, especially when hundreds of images are involved.
And SurfOffline doesn’t appear to be supported anymore, i.e. the support email’s inbox is full.
To continue my travails:
Httrack didn’t do a great job: It was slow, even copying from the same machine, and it flattened the directory structure of the website it was writing, making it almost un-navigable.
Here’s where Cyotek WebCopy shines: It’s copying the website from SurfOffline’s database webserver quickly, so I should have the entire website re-extracted very soon!