Download Shareware and Freeware Software for Windows, Linux, Macintosh, PDA

line Home  |  About Us  |  Link To Us  |  FAQ  |  Contact

Serving Software Downloads in 976 Categories, Downloaded 29.541.259 Times

Web Crawling software
Filter: All | Freeware | Demo
Display by: Relevance |  Downloads |  Name

Web Crawling

1 2 3 4 5 > 
Added: November 28, 2013 | Visits: 294

Law Leecher Law Leecher is a multi-threaded web crawling tool which extracts laws from the EU law database PreLex (http://ec.europa.eu/prelex/). It's written in Ruby. The latest version is 1.4 You can also visit the SourceForge project management homepage. You will most probably find the version history...



Platforms: *nix

License: Freeware Size: 430.08 KB Download (19): Law Leecher Download

Added: April 06, 2006 | Visits: 1.816

Sekhol Technologies Auto Web Browser saves a lot of time when you are looking for something on the Internet. No need for numerous clicking, waiting for pages download and closing annoying pop-ups. Just enter the words describing what you want to find. The Auto Web Browser will consult the search engines from a user...





Platforms: DOS, OS/2, BeOS, Palm OS, Windows, Mac, *nix, Windows CE

License: Shareware Cost: $49.00 USD Size: 2.44 MB Download (79): Sekhol Technologies Download

Released: July 10, 2012  |  Added: July 10, 2012 | Visits: 303

The Website Utility This useful utility examines websites for errors and other issues using a built in web crawling engine. Errors checked for include broken or moved hyperlinks, missing page titles and missing meta tags. It also generates HTML for use in creating website site maps and XML for Google SiteMaps....


Platforms: Windows

License: Shareware Cost: $24.95 USD Size: 2.93 MB Download (50): The Website Utility Download

Released: November 22, 2012  |  Added: November 22, 2012 | Visits: 406

Vietspider Web Data Extractor The web crawler is a program that automatically traverses the web by downloading the pages and following the links from page to page. A general purpose of web crawler is to download any web page that can be accessed through the links. This process is called web crawling or spidering. Many sites,...


Platforms: Windows, Mac, Linux, Linux Console, Linux Gnome, Linux GPL, Linux Open Source, Java

License: Freeware Size: 57.62 MB Download (35): Vietspider Web Data Extractor Download

Released: September 22, 2008  |  Added: September 26, 2008 | Visits: 15.783

Zeus Internet Marketing Robot Zeus is an easy to use Intelligent, Internet Robot, that creates traffic to your web site, in numbers beyond your wildest dreams. Zeus creates thousands of link trades by automatically finding web sites you train him to find and then doing 95% of the work involved in Link Marketing. Zeus is...


Platforms: Windows, Windows CE

License: Demo Cost: $99.00 USD Size: 24.99 MB Download (166): Zeus Internet Marketing Robot Download

Added: August 06, 2008 | Visits: 845

Auto Web Browser Auto Web Browser saves a lot of time when you are looking for something on the Internet. No need for numerous clicking, waiting for pages download and closing annoying pop-ups. Just enter the words describing what you want to find. The Auto Web Browser will consult the search engines from a user...


Platforms: Windows

License: Freeware Size: 2.44 MB Download (90): Auto Web Browser Download

Released: October 11, 2012  |  Added: October 11, 2012 | Visits: 274

DataToolbar for Internet Explorer Data Toolbar is an Internet Explorer add-on to collect catalog style information from the web. The add-on converts structured web data into a table style format that can be loaded into a spreadsheet or a database. Based on powerful pattern recognition logic it automatically extracts thousands of...


Platforms: Windows, Other

License: Shareware Cost: $24.00 USD Size: 2.41 MB Download (28): DataToolbar for Internet Explorer Download

Added: October 04, 2013 | Visits: 194

SiteMap Plus As the name implies it automatically create a SiteMap of your web page. People love it and It also can do a lot more. For instance SiteMap can: * Create a 'siteindex.xml' file for to help google index better. * Validate that your web page doesn't have any nasty defaults in the title, filename...


Platforms: Mac

License: Shareware Cost: $0.00 USD Size: 6.52 MB Download (16): SiteMap Plus Download

Released: April 05, 2016  |  Added: April 07, 2016 | Visits: 809

Octoparse Octoparse is a powerful but easy-to-use and free web scraping tool that is being used by tens of thousands of individuals and companies all over the world. The word of Octoparse is the combination of the two words, “Octopus” and “Parse”....


Platforms: Windows, Windows 7

License: Freeware Size: 666 KB Download (33): Octoparse Download

Released: May 10, 2003  |  Added: May 12, 2006 | Visits: 2.474

Trellian SiteSpider Trellian SiteSpider is a powerful, yet simple to use program which is loaded with sophisticated search, web crawling and site mapping functions. What does SiteSpider do? SiteSpider can be used simply as a web browser, which works cooperatively with Internet Explorer to allow importing and...


Platforms: Windows

License: Shareware Cost: $1.00 USD Size: 1.71 MB Download (76): Trellian SiteSpider Download

Added: November 15, 2013 | Visits: 222

Scrapy Scrapy is a fast high-level screen scraping and web crawling framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing. News 2011-01-02 Scrapy 0.12 released! 2010-09-29 Scrapy...


Platforms: Mac

License: Shareware Cost: $0.00 USD Size: 1013.76 KB Download (18): Scrapy Download

Released: January 08, 2013  |  Added: January 08, 2013 | Visits: 364

Free Zeus PRO Internet Link Robot Zeus is the original Internet Robot. Zeus creates web site traffic, almost immediately, in numbers beyond your wildest dreams. Zeus creates thousands of link trades by automatically finding web sites that you train him to find. then Zeus does 95% of the work of Link Marketing. Zeus is the only...


Platforms: Windows

License: Freeware Size: 28.81 MB Download (27): Free Zeus PRO Internet Link Robot Download

Released: December 08, 2012  |  Added: December 08, 2012 | Visits: 275

Language Identifier Lextek Language Identifier is capable of automatically identifying that language that a document is written in. Supporting over 260 different languages and encoding modules, the Lextek Language Identifier is capable of recognizing more languages and more character encodings than any other...


Platforms: Windows

License: Freeware Size: 2.1 MB Download (40): Language Identifier Download

Released: January 05, 2016  |  Added: March 06, 2016 | Visits: 181

Darcy SEO Checker Darcy SEO Checker is an efficient light weight desktop application whose purpose is to make it easier for both professional and casual users to check websites and verify unwanted errors that are harming the website SEO performance. This desktop cross platform software is a new type of diagnostic...


Platforms: OS/2, Windows, Mac, *nix, DOS, Windows 8, Windows Phone, Windows 7, Windows Server, Handheld, Java,AS/400

License: Shareware Cost: $99.00 USD Size: 59.91 MB Download (24): Darcy SEO Checker Download

Released: February 03, 2014  |  Added: March 30, 2014 | Visits: 343

SiteMapOrganizer SiteMapOrganizer is a powerful web site map generating and processing tool that fully simplifies processes of crawling web site in any accessible form (HTTP, FTP, Local on Disk), processing web site map to fully setting all the parameters of the site map up and generating the web site map in form...


Platforms: Windows, Windows 7

License: Demo Cost: $24.00 USD Size: 129 KB Download (16): SiteMapOrganizer Download

Released: June 21, 2008  |  Added: June 26, 2008 | Visits: 1.822

Web Automator Web Automator is a powerful tool for extracting content from Web sites and testing them. It allows you to create projects (like programs) - e.g. project for automated creating account. Each project has some variables connected to it. There are variables of two types: pre-defined and user-defined....


Platforms: Windows

License: Shareware Cost: $0.00 USD Size: 1.7 MB Download (123): Web Automator Download

Added: August 31, 2008 | Visits: 2.485

Visual Web Spider Visual Web Spider is a software for crawling the web. It is a web crawler. It helps you to develop search directory for responsible website promotion, or for research purposes. Visual Web Spider builds targeted URL database at high speed. Our program allows you to extract URLs and metadata...


Platforms: Windows

License: Shareware Cost: $39.00 USD Size: 435 KB Download (203): Visual Web Spider Download

Released: October 16, 2012  |  Added: October 16, 2012 | Visits: 418

Web Bot Programming Library Crawl the web with this free ActiveX web bot component. Advanced features include caching, "avoid" patterns, and robots.txt compliance.


Platforms: Windows

License: Freeware Size: 532.48 KB Download (73): Web Bot Programming Library Download

Released: January 17, 2013  |  Added: January 17, 2013 | Visits: 250

aoaExtractor - Email Extractor Desktop application for crawling (spidering) the web and extracting words, phrases, email addresses, web addresses, and everything you want from the web pages.


Platforms: Windows, Mac

License: Commercial Cost: $14.99 USD Size: 100 KB Download (53): aoaExtractor - Email Extractor Download

Added: September 21, 2013 | Visits: 148

Dowser Web Search Dowser is a research tool for the web. It clusters results from major search engines, associates words that appear in previous searches, and keeps a local cache of all the results you click on in a searchable database. It helps you keep track of what you find on the web. Future versions will...


Platforms: *nix

License: Freeware Size: 409.6 KB Download (16): Dowser Web Search Download

1 2 3 4 5 >