HTTP/2 302 server: nginx date: Wed, 23 Jul 2025 14:37:45 GMT content-type: text/plain; charset=utf-8 content-length: 0 x-archive-redirect-reason: found capture at 20070819002133 location: https://web.archive.org/web/20070819002133/https://wiki.python.org/moin/WebClientProgramming server-timing: captures_list;dur=0.463685, exclusion.robots;dur=0.017444, exclusion.robots.policy;dur=0.008883, esindex;dur=0.011301, cdx.remote;dur=229.152452, LoadShardBlock;dur=353.840217, PetaboxLoader3.datanode;dur=190.410452 x-app-server: wwwb-app218 x-ts: 302 x-tr: 606 server-timing: TR;dur=0,Tw;dur=0,Tc;dur=1 set-cookie: SERVER=wwwb-app218; path=/ x-location: All x-rl: 0 x-na: 0 x-page-cache: MISS server-timing: MISS x-nid: DigitalOcean referrer-policy: no-referrer-when-downgrade permissions-policy: interest-cohort=() HTTP/2 200 server: nginx date: Wed, 23 Jul 2025 14:37:46 GMT content-type: text/html;charset=utf-8 x-archive-orig-date: Sun, 19 Aug 2007 00:21:33 GMT x-archive-orig-server: Apache/2.0.54 (Debian GNU/Linux) mod_fastcgi/2.4.2 x-archive-orig-connection: close x-archive-guessed-content-type: text/html x-archive-guessed-charset: utf-8 memento-datetime: Sun, 19 Aug 2007 00:21:33 GMT link: ; rel="original", ; rel="timemap"; type="application/link-format", ; rel="timegate", ; rel="first memento"; datetime="Sun, 22 May 2005 01:32:44 GMT", ; rel="prev memento"; datetime="Tue, 03 Jul 2007 02:34:52 GMT", ; rel="memento"; datetime="Sun, 19 Aug 2007 00:21:33 GMT", ; rel="next memento"; datetime="Wed, 19 Sep 2007 11:43:25 GMT", ; rel="last memento"; datetime="Sun, 29 Jan 2023 22:25:38 GMT" content-security-policy: default-src 'self' 'unsafe-eval' 'unsafe-inline' data: blob: archive.org web.archive.org web-static.archive.org wayback-api.archive.org athena.archive.org analytics.archive.org pragma.archivelab.org wwwb-events.archive.org x-archive-src: 42_0_20070818214047_crawl103-c/42_0_20070819002006_crawl107.arc.gz server-timing: captures_list;dur=0.559554, exclusion.robots;dur=0.025200, exclusion.robots.policy;dur=0.015266, esindex;dur=0.017779, cdx.remote;dur=38.905602, LoadShardBlock;dur=545.397444, PetaboxLoader3.datanode;dur=524.451464, PetaboxLoader3.resolve;dur=336.999947, load_resource;dur=362.663992 x-app-server: wwwb-app218 x-ts: 200 x-tr: 1001 server-timing: TR;dur=0,Tw;dur=0,Tc;dur=0 x-location: All x-rl: 0 x-na: 0 x-page-cache: MISS server-timing: MISS x-nid: DigitalOcean referrer-policy: no-referrer-when-downgrade permissions-policy: interest-cohort=() content-encoding: gzip

WebClientProgramming

• 
• 
• 
• 
• 
• 
• 

Search:

Client-Side Web Programming

Libraries

• utidylib and mxTidy -- Python interfaces to html tidy library to clean up HTML documents.

• BeautifulSoup -- a permissive HTML parser.

• Don't use HTMLParser on HTML that might be invalid! That way lies pain. Either clean it up (using tidy), or use a different parser.

• urllib, urllib2, and httplib in the standard library.

• ClientCookie, ClientForm, and Mechanize are higher-level libraries for writing a web client.

• mechanoid a mechanize fork.

• libxml2dom can parse HTML by employing libxml2's liberal HTML parser.

Resources

• Grab a document from the web - from the Python Cookbook

• Python web-client programming general FAQs.

• urllib -- Open arbitrary resources by URL

• urllib2 -- extensible library for opening URLs

EditText (last edited 2007-06-26 16:45:10 by PaulBoddie)

DeleteCache (cached 2007-08-07 05:52:52)

• Login
• Navigation
  • Front Page
  • Title Index
  • Recent Changes
  • Find Page
  • Help
  • Site Navigation
• Actions
  • Attachments
  • Like Pages
  • Local Site Map
  • Spell Check
• Your recent pages