HTTP/2 302 server: nginx date: Sat, 19 Jul 2025 20:41:40 GMT content-type: text/plain; charset=utf-8 content-length: 0 x-archive-redirect-reason: found capture at 20071120060305 location: https://web.archive.org/web/20071120060305/https://wiki.python.org/moin/WebClientProgramming server-timing: captures_list;dur=0.964481, exclusion.robots;dur=0.034723, exclusion.robots.policy;dur=0.013025, esindex;dur=0.021705, cdx.remote;dur=11.550684, LoadShardBlock;dur=187.793298, PetaboxLoader3.datanode;dur=81.753230 x-app-server: wwwb-app210 x-ts: 302 x-tr: 231 server-timing: TR;dur=0,Tw;dur=0,Tc;dur=0 set-cookie: SERVER=wwwb-app210; path=/ x-location: All x-rl: 0 x-na: 0 x-page-cache: MISS server-timing: MISS x-nid: DigitalOcean referrer-policy: no-referrer-when-downgrade permissions-policy: interest-cohort=() HTTP/2 200 server: nginx date: Sat, 19 Jul 2025 20:41:41 GMT content-type: text/html;charset=utf-8 x-archive-orig-date: Tue, 20 Nov 2007 06:03:05 GMT x-archive-orig-server: Apache/2.0.54 (Debian GNU/Linux) mod_fastcgi/2.4.2 x-archive-orig-connection: close x-archive-guessed-content-type: text/html x-archive-guessed-charset: utf-8 memento-datetime: Tue, 20 Nov 2007 06:03:05 GMT link: ; rel="original", ; rel="timemap"; type="application/link-format", ; rel="timegate", ; rel="first memento"; datetime="Sun, 22 May 2005 01:32:44 GMT", ; rel="prev memento"; datetime="Sat, 20 Oct 2007 05:17:34 GMT", ; rel="memento"; datetime="Tue, 20 Nov 2007 06:03:05 GMT", ; rel="next memento"; datetime="Fri, 28 Dec 2007 06:23:29 GMT", ; rel="last memento"; datetime="Sun, 29 Jan 2023 22:25:38 GMT" content-security-policy: default-src 'self' 'unsafe-eval' 'unsafe-inline' data: blob: archive.org web.archive.org web-static.archive.org wayback-api.archive.org athena.archive.org analytics.archive.org pragma.archivelab.org wwwb-events.archive.org x-archive-src: 51_0_20071120012723_crawl103-c/51_0_20071120053929_crawl107.arc.gz server-timing: captures_list;dur=3.311606, exclusion.robots;dur=0.026468, exclusion.robots.policy;dur=0.012219, esindex;dur=0.011509, cdx.remote;dur=11.056207, LoadShardBlock;dur=198.316852, PetaboxLoader3.datanode;dur=200.136291, PetaboxLoader3.resolve;dur=101.562882, load_resource;dur=109.727664 x-app-server: wwwb-app210 x-ts: 200 x-tr: 387 server-timing: TR;dur=0,Tw;dur=0,Tc;dur=0 x-location: All x-rl: 0 x-na: 0 x-page-cache: MISS server-timing: MISS x-nid: DigitalOcean referrer-policy: no-referrer-when-downgrade permissions-policy: interest-cohort=() content-encoding: gzip

WebClientProgramming

• 
• 
• 
• 
• 
• 
• 

Search:

Client-Side Web Programming

Libraries

• utidylib and mxTidy -- Python interfaces to html tidy library to clean up HTML documents.

• BeautifulSoup -- a permissive HTML parser.

• Don't use HTMLParser on HTML that might be invalid! That way lies pain. Either clean it up (using tidy), or use a different parser.

• urllib, urllib2, and httplib in the standard library.

• ClientCookie, ClientForm, and Mechanize are higher-level libraries for writing a web client.

• mechanoid a mechanize fork.

• libxml2dom can parse HTML by employing libxml2's liberal HTML parser.

Resources

• Grab a document from the web - from the Python Cookbook

• Python web-client programming general FAQs.

• urllib -- Open arbitrary resources by URL

• urllib2 -- extensible library for opening URLs

EditText (last edited 2007-06-26 16:45:10 by PaulBoddie)

DeleteCache (cached 2007-10-29 17:27:36)

• Login
• Navigation
  • Front Page
  • Title Index
  • Recent Changes
  • Find Page
  • Help
  • Site Navigation
• Actions
  • Attachments
  • Like Pages
  • Local Site Map
  • Spell Check
• Your recent pages