http://www.willmer.com/kb/2008/08/unicodedecodeerror-using-beautifulsoup/ Sun, 25 Dec 2011 07:23:34 +0000 hourly 1 http://wordpress.org/?v=3.1.3 http://www.willmer.com/kb/2008/08/unicodedecodeerror-using-beautifulsoup/comment-page-1/#comment-45427 Catherine Devlin Mon, 05 Apr 2010 13:35:29 +0000 http://www.willmer.com/kb/2008/08/unicodedecodeerror-using-beautifulsoup/#comment-45427 I'm not sure whether the cause is the same, but in Python 2.6, BeautifulSoup is still throwing UnicodeDecodeErrors on valid UTF-8 documents (speciifically, the contents of pypi.python.org). You can work around it by omitting everything past ASCII with BeautifulSoup.BeautifulSoup(text.decode('ascii', 'ignore'))... but, of course, you lose data that way. I’m not sure whether the cause is the same, but in Python 2.6, BeautifulSoup is still throwing UnicodeDecodeErrors on valid UTF-8 documents (speciifically, the contents of pypi.python.org). You can work around it by omitting everything past ASCII with BeautifulSoup.BeautifulSoup(text.decode(‘ascii’, ‘ignore’))… but, of course, you lose data that way.

]]> http://www.willmer.com/kb/2008/08/unicodedecodeerror-using-beautifulsoup/comment-page-1/#comment-32907 GB Sat, 03 Jan 2009 23:44:12 +0000 http://www.willmer.com/kb/2008/08/unicodedecodeerror-using-beautifulsoup/#comment-32907 thanks. thanks.

]]> http://www.willmer.com/kb/2008/08/unicodedecodeerror-using-beautifulsoup/comment-page-1/#comment-29532 Recent Links Tagged With "beautifulsoup" - JabberTags Tue, 07 Oct 2008 08:34:21 +0000 http://www.willmer.com/kb/2008/08/unicodedecodeerror-using-beautifulsoup/#comment-29532 [...] beautifulsoup A script to generate RSS feeds for wlu.ca Saved by TheGoldCrow on Mon 06-10-2008 UnicodeDecodeError using BeautifulSoup Saved by UcdLibraryGeography on Sun 05-10-2008 what ubuntu packages did i install again? Saved by [...] [...] beautifulsoup A script to generate RSS feeds for wlu.ca Saved by TheGoldCrow on Mon 06-10-2008 UnicodeDecodeError using BeautifulSoup Saved by UcdLibraryGeography on Sun 05-10-2008 what ubuntu packages did i install again? Saved by [...]

]]>