| CARVIEW |
Select Language
HTTP/2 302
server: nginx
date: Fri, 22 Aug 2025 05:55:29 GMT
content-type: text/plain; charset=utf-8
content-length: 0
x-archive-redirect-reason: found capture at 20090925065644
location: https://web.archive.org/web/20090925065644/https://github.com/documentcloud/cloud-crowd/tree
server-timing: captures_list;dur=0.755787, exclusion.robots;dur=0.026640, exclusion.robots.policy;dur=0.011491, esindex;dur=0.014005, cdx.remote;dur=20.293027, LoadShardBlock;dur=174.399560, PetaboxLoader3.datanode;dur=62.906047, PetaboxLoader3.resolve;dur=51.010612
x-app-server: wwwb-app217
x-ts: 302
x-tr: 250
server-timing: TR;dur=0,Tw;dur=0,Tc;dur=0
set-cookie: wb-p-SERVER=wwwb-app217; path=/
x-location: All
x-rl: 0
x-na: 0
x-page-cache: MISS
server-timing: MISS
x-nid: DigitalOcean
referrer-policy: no-referrer-when-downgrade
permissions-policy: interest-cohort=()
HTTP/2 200
server: nginx
date: Fri, 22 Aug 2025 05:55:30 GMT
content-type: text/html; charset=utf-8
x-archive-orig-server: nginx/0.6.35
x-archive-orig-date: Fri, 25 Sep 2009 06:56:43 GMT
x-archive-orig-connection: close
x-archive-orig-status: 200 OK
x-archive-orig-etag: "48861897fa26e96905953a69a25b621e"
x-archive-orig-x-runtime: 487ms
x-archive-orig-cache-control: private, max-age=0, must-revalidate
x-archive-orig-content-length: 36871
x-archive-guessed-content-type: text/html
x-archive-guessed-charset: utf-8
memento-datetime: Fri, 25 Sep 2009 06:56:44 GMT
link: ; rel="original", ; rel="timemap"; type="application/link-format", ; rel="timegate", ; rel="first memento"; datetime="Fri, 25 Sep 2009 06:56:44 GMT", ; rel="memento"; datetime="Fri, 25 Sep 2009 06:56:44 GMT", documentcloud's cloud-crowd at master - GitHub
ATTN: Rackspace Move Scheduled for Sunday, September 27th at 5PM Pacific Time. Learn More.
This repository is private.
All pages are served over SSL and all pushing and pulling is done over SSH.
No one may fork, clone, or view it unless they are added as a member.
Every repository with this icon () is private.
Every repository with this icon (
) is private.
This repository is public.
Anyone may fork, clone, or view it.
Every repository with this icon () is public.
Every repository with this icon (
) is public.
| Description: | Parallel Processing for the Rest of Us edit |
| Homepage: | https://wiki.github.com/documentcloud/cloud-crowd edit |
| Public Clone URL: |
git://github.com/documentcloud/cloud-crowd.git
Give this clone URL to anyone.
git clone git://github.com/documentcloud/cloud-crowd.git
|
| Your Clone URL: |
Use this clone URL yourself.
git clone git@github.com:documentcloud/cloud-crowd.git
|
README
=
_ _
( ` )_
( ) `)
(_ (_ . _) _)
_
( )
_ . ( ` ) . )
( _ )_ (_, _( ,_)_)
(_ _(_ ,)
_ _ ___ _ _ ___ _
( ` )_ / __| |___ _ _ __| |/ __|_ _ _____ __ ____| |
( ) `) | (__| / _ \ || / _` | (__| '_/ _ \ V V / _` |
(_ (_ . _) _) \___|_\___/\_,_\__,_|\___|_| \___/\_/\_/\__,_|
_
( )
_, _ . ( ` ) . )
( ( _ )_ (_, _( ,_)_)
(_(_ _(_ ,)
~ CloudCrowd ~
* Parallel processing for the rest of us
* Write your scripts in Ruby
* Works with Amazon EC2 and S3
* split -> process -> merge
* As easy as `gem install cloud-crowd`
Well-suited for:
* Generating or resizing images.
* Encoding video.
* Running text extraction or OCR on PDFs.
* Migrating a large file set or database.
* Web scraping.
~ Documentation ~
Wiki: https://wiki.github.com/documentcloud/cloud-crowd
Rdoc: https://rdoc.info/projects/documentcloud/cloud-crowd
~ Getting started ~
# Install the gem.
>> sudo gem install cloud-crowd
# Install the CloudCrowd configuration files to a location of your choosing.
>> crowd install ~/config/cloud-crowd
# Now, you can use the full complement of `crowd` commands from inside of
# this configuration directory. To see the available commands:
>> crowd --help
# Edit the configuration files to your satisfaction, add AWS credentials,
# and then load the CloudCrowd schema into your configured database.
>> cd ~/config/cloud-crowd
>> mate config.yml
>> mate database.yml
>> [create the database you just configured...]
>> crowd load_schema
# Write your actions, and install them into the 'actions' subdirectory.
# CloudCrowd comes with a few default actions as an example.
# To launch the central server (make sure that you include its location
# in config.yml):
>> crowd server
# The configuration folder also includes 'config.ru', which can be used by
# any Rack-compliant webserver to run your central server.
# Then, to launch a node of workers:
>> crowd node
# To spin up remote nodes, install the 'cloud-crowd' gem and copy over
# your configuration directory. Run `crowd node`, and the remote machines
# will register with the central server, becoming available for processing.
# At this point you can visit your Operations Center at localhost:9173 to
# view all of your nodes, ready for action.
This feature is coming soon. Sit tight!