HTTP/2 302 server: nginx date: Fri, 18 Jul 2025 19:51:49 GMT content-type: text/plain; charset=utf-8 content-length: 0 x-archive-redirect-reason: found capture at 20071228062329 location: https://web.archive.org/web/20071228062329/https://wiki.python.org/moin/WebClientProgramming server-timing: captures_list;dur=0.696756, exclusion.robots;dur=0.024656, exclusion.robots.policy;dur=0.009876, esindex;dur=0.013249, cdx.remote;dur=15.191087, LoadShardBlock;dur=490.198513, PetaboxLoader3.resolve;dur=355.579399, PetaboxLoader3.datanode;dur=107.328791 x-app-server: wwwb-app219 x-ts: 302 x-tr: 539 server-timing: TR;dur=0,Tw;dur=0,Tc;dur=0 set-cookie: SERVER=wwwb-app219; path=/ x-location: All x-rl: 0 x-na: 0 x-page-cache: MISS server-timing: MISS x-nid: DigitalOcean referrer-policy: no-referrer-when-downgrade permissions-policy: interest-cohort=() HTTP/2 200 server: nginx date: Fri, 18 Jul 2025 19:51:49 GMT content-type: text/html;charset=utf-8 x-archive-orig-date: Fri, 28 Dec 2007 06:23:29 GMT x-archive-orig-server: Apache/2.2.3 (Debian) mod_fastcgi/2.4.2 x-archive-orig-pragma: no-cache x-archive-orig-cache-control: no-cache x-archive-orig-expires: -1 x-archive-orig-vary: Accept-Language,Cookie,User-Agent x-archive-orig-connection: close x-archive-guessed-content-type: text/html x-archive-guessed-charset: utf-8 memento-datetime: Fri, 28 Dec 2007 06:23:29 GMT link: ; rel="original", ; rel="timemap"; type="application/link-format", ; rel="timegate", ; rel="first memento"; datetime="Sun, 22 May 2005 01:32:44 GMT", ; rel="prev memento"; datetime="Tue, 20 Nov 2007 06:03:05 GMT", ; rel="memento"; datetime="Fri, 28 Dec 2007 06:23:29 GMT", ; rel="next memento"; datetime="Sun, 14 Sep 2008 13:48:50 GMT", ; rel="last memento"; datetime="Sun, 29 Jan 2023 22:25:38 GMT" content-security-policy: default-src 'self' 'unsafe-eval' 'unsafe-inline' data: blob: archive.org web.archive.org web-static.archive.org wayback-api.archive.org athena.archive.org analytics.archive.org pragma.archivelab.org wwwb-events.archive.org x-archive-src: 51_1_20071228021341_crawl107-c/51_1_20071228062126_crawl107.arc.gz server-timing: captures_list;dur=0.783971, exclusion.robots;dur=0.034923, exclusion.robots.policy;dur=0.014279, esindex;dur=0.015721, cdx.remote;dur=20.645205, LoadShardBlock;dur=405.834729, PetaboxLoader3.datanode;dur=110.818326, PetaboxLoader3.resolve;dur=383.869719, load_resource;dur=197.769744 x-app-server: wwwb-app219 x-ts: 200 x-tr: 686 server-timing: TR;dur=0,Tw;dur=0,Tc;dur=1 x-location: All x-rl: 0 x-na: 0 x-page-cache: MISS server-timing: MISS x-nid: DigitalOcean referrer-policy: no-referrer-when-downgrade permissions-policy: interest-cohort=() content-encoding: gzip

• WebClientProgramming

• 
• 
• 
• 
• 
• 
• 

Search:

Client-Side Web Programming

Libraries

• utidylib and mxTidy -- Python interfaces to html tidy library to clean up HTML documents.

• BeautifulSoup -- a permissive HTML parser.

• Don't use HTMLParser on HTML that might be invalid! That way lies pain. Either clean it up (using tidy), or use a different parser.

• urllib, urllib2, and httplib in the standard library.

• ClientCookie, ClientForm, and Mechanize are higher-level libraries for writing a web client.

• mechanoid a mechanize fork.

• libxml2dom can parse HTML by employing libxml2's liberal HTML parser.

Resources

• Grab a document from the web - from the Python Cookbook

• Python web-client programming general FAQs.

• urllib -- Open arbitrary resources by URL

• urllib2 -- extensible library for opening URLs

EditText (last edited 2007-06-26 16:45:10 by PaulBoddie)

• Login
• Navigation
  • Front Page
  • Title Index
  • Recent Changes
  • Find Page
  • Help
  • Site Navigation
• Actions
  • Attach File
  • Despam
  • Like Pages
  • Local Site Map
  • My Pages
  • Package Pages
  • Render As Docbook
  • Spell Check
  • Subscribe User
• Your recent pages