| CARVIEW |
Select Language
HTTP/2 302
server: nginx
date: Mon, 22 Dec 2025 20:42:29 GMT
content-type: text/plain; charset=utf-8
content-length: 0
x-archive-redirect-reason: found capture at 20071007020430
location: https://web.archive.org/web/20071007020430/https://www.acc.umu.se/~r2d2/programming/ruby/webfetcher/
server-timing: captures_list;dur=0.487550, exclusion.robots;dur=0.039721, exclusion.robots.policy;dur=0.031559, esindex;dur=0.006982, cdx.remote;dur=18.025188, LoadShardBlock;dur=273.123955, PetaboxLoader3.datanode;dur=112.882563, PetaboxLoader3.resolve;dur=13.068960
x-app-server: wwwb-app245-dc8
x-ts: 302
x-tr: 318
server-timing: TR;dur=0,Tw;dur=0,Tc;dur=0
set-cookie: wb-p-SERVER=wwwb-app245; path=/
x-location: All
x-as: 14061
x-rl: 0
x-na: 0
x-page-cache: MISS
server-timing: MISS
x-nid: DigitalOcean
referrer-policy: no-referrer-when-downgrade
permissions-policy: interest-cohort=()
HTTP/2 200
server: nginx
date: Mon, 22 Dec 2025 20:42:30 GMT
content-type: text/html
x-archive-orig-date: Sun, 07 Oct 2007 02:04:30 GMT
x-archive-orig-server: Apache/1.3.37 (Unix) mod_ssl/2.8.28 OpenSSL/0.9.8a
x-archive-orig-connection: close
x-archive-orig-content-language: en
x-archive-guessed-content-type: text/html
x-archive-guessed-charset: utf-8
memento-datetime: Sun, 07 Oct 2007 02:04:30 GMT
link: WebFetcher
WebFetcher
What is WebFetcher?
WebFetcher is a module designed to facilitate fetching large ammounts of documents and images from the web. With WebFetcher it is easy to do such things as downloading all the images on a page. You can also do more complex tasks, such as fetching all the pages linked to by a certain page and all the images on those pages. You can save the documents in a tree structure mirroring the server layout or flat in a single directory. In either case, WebFetcher can translate the links on the pages so that all relationships are preserved.
Sample Usage
Save a copy of Programming Ruby to your hard drive:
require 'webfetcher'
book = WebFetcher::Page.url('https://www.rubycentral.com/book/')
book.recurse.save('pickaxe')
Download
- webfetcher-0.5.5.tar.gz (25 K)
- webfetcher-0.5.4.tar.gz (26 K)
- webfetcher-0.5.3.tar.gz (25 K)
- webfetcher-0.5.2.tar.gz (25 K)
- webfetcher-0.5.1.tar.gz (24 K)
- webfetcher-0.5.0.tar.gz (24 K)
Install the program with the command: (you may need to be root)
ruby install.rb
User Guide
Documentation is included in the archive, you can also read it online.