| CARVIEW |
Select Language
HTTP/2 302
server: nginx
date: Sun, 21 Dec 2025 22:09:29 GMT
content-type: text/plain; charset=utf-8
content-length: 0
x-archive-redirect-reason: found capture at 20071007020430
location: https://web.archive.org/web/20071007020430/https://www.acc.umu.se/~r2d2/programming/ruby/webfetcher/
server-timing: captures_list;dur=0.712776, exclusion.robots;dur=0.059632, exclusion.robots.policy;dur=0.045063, esindex;dur=0.016456, cdx.remote;dur=41.307638, LoadShardBlock;dur=237.234389, PetaboxLoader3.resolve;dur=90.040965, PetaboxLoader3.datanode;dur=94.234725
x-app-server: wwwb-app223-dc8
x-ts: 302
x-tr: 303
server-timing: TR;dur=0,Tw;dur=0,Tc;dur=0
set-cookie: wb-p-SERVER=wwwb-app223; path=/
x-location: All
x-as: 14061
x-rl: 0
x-na: 0
x-page-cache: MISS
server-timing: MISS
x-nid: DigitalOcean
referrer-policy: no-referrer-when-downgrade
permissions-policy: interest-cohort=()
HTTP/2 200
server: nginx
date: Sun, 21 Dec 2025 22:09:29 GMT
content-type: text/html
x-archive-orig-date: Sun, 07 Oct 2007 02:04:30 GMT
x-archive-orig-server: Apache/1.3.37 (Unix) mod_ssl/2.8.28 OpenSSL/0.9.8a
x-archive-orig-connection: close
x-archive-orig-content-language: en
x-archive-guessed-content-type: text/html
x-archive-guessed-charset: utf-8
memento-datetime: Sun, 07 Oct 2007 02:04:30 GMT
link: WebFetcher
WebFetcher
What is WebFetcher?
WebFetcher is a module designed to facilitate fetching large ammounts of documents and images from the web. With WebFetcher it is easy to do such things as downloading all the images on a page. You can also do more complex tasks, such as fetching all the pages linked to by a certain page and all the images on those pages. You can save the documents in a tree structure mirroring the server layout or flat in a single directory. In either case, WebFetcher can translate the links on the pages so that all relationships are preserved.
Sample Usage
Save a copy of Programming Ruby to your hard drive:
require 'webfetcher'
book = WebFetcher::Page.url('https://www.rubycentral.com/book/')
book.recurse.save('pickaxe')
Download
- webfetcher-0.5.5.tar.gz (25 K)
- webfetcher-0.5.4.tar.gz (26 K)
- webfetcher-0.5.3.tar.gz (25 K)
- webfetcher-0.5.2.tar.gz (25 K)
- webfetcher-0.5.1.tar.gz (24 K)
- webfetcher-0.5.0.tar.gz (24 K)
Install the program with the command: (you may need to be root)
ruby install.rb
User Guide
Documentation is included in the archive, you can also read it online.