Note this will not scrape actual HTML text. It is designed to find files with a focus on image files. Works great at that, and it might be the only tool that does. But it's not for scraping text or data off of webpages, so make sure it's what you want before you buy.

There are a few other programs like this, but they are super outdated, and the newer options are cloud based, pay-per-use, no privacy, etc. This is finally a modern, fully local option with advanced features and no code. I got it for my small business and the team loves me for it!

Built 1000 image dataset from my target domain in 20 mins. Now to figure out how to make a working Safetensors model...

I maxed at over 30,000 URLs queued for processing and got almost 10,000 image files before I stopped my first run. This is wild.

Functioned as advertised :)

I noticed some sites where I guess countermeasures made this not work, but it didn't really matter because it spidered so many URLs it was able to build a relevant image dataset in no time. I think my max queue size topped out at around 3000 URLs being processed.

I love that I could figure out how to use this in 2 seconds vs other options that are so complicated or require coding etc. I literally downloaded this, launched (no install needed), and put in a URL to start, and within a few minutes I had almost 1000 files related to my project. Game changer.

I've used a few of these in the past, but this is next level. User interface is straightforward, but there is a beast of an engine behind it.

I have been looking for something like this for training an AI dataset, and other options look like they're from the late 90s. I have a high-end PC and this lets me take full advantage with multithreading per site and per domain. I'm totally dorking out and super excited at how I will be able to use this. Easily got thousands of files on my first run.

Good stuff, make me relax when the sun go down and making me sleep better. I kick off but my crypto keeps mining.

Great fix. I used the one downloaded file on my own desktop, laptop, and son’s computer. Everyone uses it now. Three bucks well spent.

It worked to make my screen go off and my computer stays on for downloads. Easy like rhubarb pie. I like also the Renamey program for my wife's picture files because I can make them organized in one shot instead of typing all Sunday night. Thank you, merci. Ron.

Does what it says! No complaints. (@CodeurNocturne_MTL OMFG LOL)

This worked for me and I got it on sale. Thank you.

Elaine

Absolutely deletes the crap out of unwanted files. Frustration gone. Highly recommend. It's pinned to my taskbar.