UTF8 encoded text file
useful for testing compatability.
ongoing · Characters vs. Bytes
Turning MySQL data in latin1 to utf8 utf-8 - O'Reilly ONLamp Blog
Some wrong info, but a few useful commands as well
UTF-8 and Unicode FAQ for Unix/Linux
UTF8 History
HowToUseUnicodeStrings in Ruby on Rails
RFC 3629 UTF-8, a transformation format of ISO 10646
UTF-8: in RFC form!
Well, I'm Back: String Theory
UTF-16 is the devil's work. UTF-8 rules.
* * Mailing list Community * Documentation * Articles * Contributed software * Forum * Bug tracker * Wiki * Contacts Commercial services * Support and consulting * Commercial licensing Misc * Powere
useful discussion on indexing utf-8 in sphinx. Includes folding accented chars tio match their un-accented bretheren
Shades of Gray: Bytes and Characters in Ruby 1.8
some excellent advice on using UTF-8 in ruby 1.8
MySQL :: MySQL 5.0 Reference Manual :: 9.1.4 Connection Character Sets and Collations
http://speeple.com/unicode-maps.txt
handy list of unicode code points, grouped by latin character and other ranges
MySQL :: Unicode and Other Funny Characters
Get Ruby 1.9, Rails, MySQL and UTF-8 to Work Together
Monkey patch the mysql gem to return UTF-8 encoded strings
ActiveSupport::Multibyte Updated · Fingertips
coverage of some ActiveSupport::Multibyte changes that happened back in 2008
Ruby 1.9 character encoding field notes · Fingertips
The biggest problem with receiving data from external sources is trust. Sources can lie about their encoding or provide broken data. Sometimes it gets mangled accidentally and sometimes someone is attacking your application with a carefully crafted payload.
Soapbox
interesting rant about ruby 1.9's encoding support. Most it it resonates strongly with my opinions.
Ruby 1.9 Encodings: A Primer and the Solution for Rails « Katz Got Your Tongue?
Another clear summary of the encoding mess of 1.9. With great power comes great ways to shoot yourself in the foot.
From Iconv#iconv to String#encode
Shape Catcher
handy unicode database
Love Hotels and Unicode
utf8everywhere
Twitter / JEG2: A neat Ruby encoding trick
A neat Ruby encoding trick from @arcandros: open(…, "r:bom|UTF-8")
UTF-8 Everywhere
Ridiculously fast unicode (UTF-8) validation – Daniel Lemire's blog