Uncategorized

Web Crawler for Files and Links (Windows)

By Acty, September 24, 2013

Web Crawler can be used to get links, emails, images and files from a webpage or site.

Web Crawler has a simple and intuitive interface.

The crawler is multithreaded and optimized for performance. It scans the webpage based on MIME types and file extensions, so it can find hidden links.

The “Deep crawl” feature allows the crawler to search all the linked pages from the selected website.

After crawling, the Web Crawler will save all links and e-mail addresses to the selected folder, along with all the crawled files.