CARVIEW

MOTORHOMES

Select Language

HTTP/2 302 server: nginx date: Thu, 31 Jul 2025 21:08:58 GMT content-type: text/plain; charset=utf-8 content-length: 0 x-archive-redirect-reason: found capture at 20100614035133 location: https://web.archive.org/web/20100614035133/https://answers.oreilly.com/tag/character server-timing: captures_list;dur=1.048665, exclusion.robots;dur=0.019300, exclusion.robots.policy;dur=0.009464, esindex;dur=0.010595, cdx.remote;dur=10.938807, LoadShardBlock;dur=169.146810, PetaboxLoader3.datanode;dur=138.140596 x-app-server: wwwb-app212 x-ts: 302 x-tr: 207 server-timing: TR;dur=0,Tw;dur=0,Tc;dur=0 set-cookie: SERVER=wwwb-app212; path=/ x-location: All x-rl: 0 x-na: 0 x-page-cache: MISS server-timing: MISS x-nid: DigitalOcean referrer-policy: no-referrer-when-downgrade permissions-policy: interest-cohort=() HTTP/2 200 server: nginx date: Thu, 31 Jul 2025 21:08:59 GMT content-type: text/html;charset=UTF-8 x-archive-orig-date: Mon, 14 Jun 2010 03:51:39 GMT x-archive-orig-server: Apache/2.2.11 (Unix) mod_ssl/2.2.11 OpenSSL/0.9.8e-fips-rhel5 mod_auth_passthrough/2.1 mod_bwlimited/1.4 FrontPage/5.0.2.2635 PHP/5.2.8 x-archive-orig-x-powered-by: PHP/5.2.8 x-archive-orig-set-cookie: answers_session_id=deleted; expires=Sun, 14-Jun-2009 03:51:38 GMT; path=/; domain=.oreilly.com; httponly x-archive-orig-set-cookie: answers_session_id=deleted; expires=Sun, 14-Jun-2009 03:51:38 GMT; path=/; domain=.oreilly.com; httponly x-archive-orig-cache-control: ,no-cachemust-revalidate, max-age=0 x-archive-orig-expires: 0 x-archive-orig-pragma: no-cache x-archive-orig-connection: close x-archive-guessed-content-type: text/html x-archive-guessed-charset: utf-8 memento-datetime: Mon, 14 Jun 2010 03:51:33 GMT link: ; rel="original", ; rel="timemap"; type="application/link-format", ; rel="timegate", ; rel="first memento"; datetime="Tue, 13 Apr 2010 21:35:20 GMT", ; rel="prev memento"; datetime="Tue, 13 Apr 2010 21:35:20 GMT", ; rel="memento"; datetime="Mon, 14 Jun 2010 03:51:33 GMT", ; rel="next memento"; datetime="Sat, 14 Aug 2010 18:55:27 GMT", ; rel="last memento"; datetime="Wed, 04 Sep 2013 00:58:52 GMT" content-security-policy: default-src 'self' 'unsafe-eval' 'unsafe-inline' data: blob: archive.org web.archive.org web-static.archive.org wayback-api.archive.org athena.archive.org analytics.archive.org pragma.archivelab.org wwwb-events.archive.org x-archive-src: 52_16_20100614015752_crawl103-c/52_16_20100614035034_crawl100.arc.gz server-timing: captures_list;dur=1.968043, exclusion.robots;dur=0.018302, exclusion.robots.policy;dur=0.008460, esindex;dur=0.010276, cdx.remote;dur=54.256666, LoadShardBlock;dur=459.673096, PetaboxLoader3.datanode;dur=262.909728, PetaboxLoader3.resolve;dur=475.992984, load_resource;dur=327.494836 x-app-server: wwwb-app212 x-ts: 200 x-tr: 914 server-timing: TR;dur=0,Tw;dur=0,Tc;dur=0 x-location: All x-rl: 0 x-na: 0 x-page-cache: MISS server-timing: MISS x-nid: DigitalOcean referrer-policy: no-referrer-when-downgrade permissions-policy: interest-cohort=() content-encoding: gzip character Questions and Answers - O'Reilly Answers

Jump to content

O'Reilly Answers

Clever Hacks. Creative Ideas. Innovative Solutions.

Share your knowledge

Welcome

Help

O'Reilly Answers is a community site for sharing knowledge, asking questions, and providing answers that brings together our customers, authors, editors, conference speakers, and Foo (Friends of O'Reilly). More »

Send us feedback
Feed icon

O'Reilly Answers Feed
Twitter icon

@oreillyanswers

Topics: character

character Feed character Open Questions Feed character Email Open Questions via Email

Building a UTF8 (Unicode) Sanitizer for Python

Asked by brian.mcconnell : 06 April 2010 - 02:11 PM

Answered by hlian : May 25 2010 06:07 AM
I would first run the bytes through Mark Pilgrim's Universal Encoding Detector, which should allow you to detect the common encodings you mentioned without any fuss. It even spits out scores for e... full answer >
Tags:
1Answer

0Comments

Pages:

Original Source | Taken Source

O'Reilly Answers

Earn Rewards, Reputation, and Badges

Recommended for You

Topics: character

Building a UTF8 (Unicode) Sanitizer for Python