|
Win Web Crawler is a powerful crawler utility to extract URL, meta tag, body text, page size, search results Win Web Crawler will extract URL, meta tag (title, desc, keyword), body text, page size, last modified date value from web site, search results or list of URLs.
Win Web Crawler will query popular search engines, extract all matching URLs from search results, remove duplicate URLs and finally visits those websites and extract data from there.
You can tell Win Web Crawler how many search engines to use. Click "Engines" button and uncheck listing that you do not want to use. You can add other engine sources as well.
Win Web Crawler send queries to search engines to get matching website URLs. Next it visits those matching websites for data extraction. How many deep it spiders in the marching websites depends on Depth setting of "External Site" tab.
High speed, multi-threaded, accurate extraction - directly saves data to disk file. Program has numerous filters to restrict session, like - URL filter, text filter, data filter, domain filter, date modified, etc.
Win Web Crawler allows user-selectable recursion levels, retrieval threads, timeout, proxy support and many other options.
Requirements:
32 MB RAM
1 MB Hard Disk Space
Internet Connection
Limitations:
15 days trial
|
