This is the Linux app named Heritrix: Internet Archive Web Crawler whose latest release can be downloaded as heritrix-1.8.0.jar. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named Heritrix: Internet Archive Web Crawler with OnWorks for free.
Follow these instructions in order to run this app:
- 1. Downloaded this application in your PC.
- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 3. Upload this application in such filemanager.
- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.
- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 6. Download the application, install it and run it.
Heritrix: Internet Archive Web Crawler
DESCRIPTION:
The archive-crawler project is building Heritrix: a flexible, extensible, robust, and scalable web crawler capable of fetching, archiving, and analyzing the full diversity and breadth of internet-accesible content.Features
- deeply and thoroughly harvests website content
- works on any Java platform (Linux recommended)
- stores content to ARC or ISO WARC aggregate/transcript format
- web interface for operator control and monitoring of crawls
Audience
Advanced End Users, Developers, Education, Government, Information Technology, Non-Profit Organizations
User interface
Web-based
Programming Language
Java
Database Environment
Berkeley/Sleepycat/Gdbm (DBM)
This is an application that can also be fetched from https://sourceforge.net/projects/archive-crawler/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.