blob: a630a1b75e2f6650832094be2b3aa703372e1bf1 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
|
# tutf8e
*Tute Feighty*
A tiny UTF-8 encoder for C.
## Goals
* As small and fast as possible
* Narrowly scoped to one-step UTF-8 encoding in C
* Link only what you need and use
* MIT licence
## Supported Encodings
* [iso-8859-1](https://en.wikipedia.org/wiki/ISO/IEC_8859-1) Latin-1 Western European
* [iso-8859-2](https://en.wikipedia.org/wiki/ISO/IEC_8859-2) Latin-2 East European
* [iso-8859-3](https://en.wikipedia.org/wiki/ISO/IEC_8859-3) Latin-3 South European
* [iso-8859-4](https://en.wikipedia.org/wiki/ISO/IEC_8859-4) Latin-4 North European
* [iso-8859-5](https://en.wikipedia.org/wiki/ISO/IEC_8859-5) Part 5: Latin/Cyrillic
* [iso-8859-6](https://en.wikipedia.org/wiki/ISO/IEC_8859-6) Part 6: Latin/Arabic
* [iso-8859-7](https://en.wikipedia.org/wiki/ISO/IEC_8859-7) Part 7: Latin/Greek
* [iso-8859-8](https://en.wikipedia.org/wiki/ISO/IEC_8859-8) Part 8: Latin/Hebrew
* [iso-8859-9](https://en.wikipedia.org/wiki/ISO/IEC_8859-9) Latin-5 Turkish
* [iso-8859-10](https://en.wikipedia.org/wiki/ISO/IEC_8859-10) Latin-6 Nordic
* [iso-8859-11](https://en.wikipedia.org/wiki/ISO/IEC_8859-11) Part 11: Latin/Thai
* [iso-8859-13](https://en.wikipedia.org/wiki/ISO/IEC_8859-13) Latin-7 Baltic Rim
* [iso-8859-14](https://en.wikipedia.org/wiki/ISO/IEC_8859-14) Latin-8 Celtic
* [iso-8859-15](https://en.wikipedia.org/wiki/ISO/IEC_8859-15) Latin-9 Western European
* [iso-8859-16](https://en.wikipedia.org/wiki/ISO/IEC_8859-16) Latin-10 South-Eastern European
* [windows-1250](https://en.wikipedia.org/wiki/Windows-1250) Central European and Eastern European
* [windows-1251](https://en.wikipedia.org/wiki/Windows-1251) Cyrillic
* [windows-1252](https://en.wikipedia.org/wiki/Windows-1252) English
* [windows-1253](https://en.wikipedia.org/wiki/Windows-1253) Greek
* [windows-1254](https://en.wikipedia.org/wiki/Windows-1254) Turkish
* [windows-1255](https://en.wikipedia.org/wiki/Windows-1255) Hebrew
* [windows-1256](https://en.wikipedia.org/wiki/Windows-1256) Arabic
* [windows-1257](https://en.wikipedia.org/wiki/Windows-1257) Baltic
* [windows-1258](https://en.wikipedia.org/wiki/Windows-1258) Vietnamese
## Test Procedure
```
$ ./codegen.py
$ gcc src/* test/test.c -Iinclude
$ ./a.out
A quick brown fox jumps over the lazy dog
Nechť již hříšné saxofony ďáblů rozezvučí síň úděsnými tóny waltzu, tanga a quickstepu.
Pijamalı hasta yağız şoföre çabucak güvendi.
Põdur Zagrebi tšellomängija-följetonist Ciqo külmetas kehvas garaažis
В чащах юга жил бы цитрус? Да, но фальшивый экземпляр!
διαφυλάξτε γενικά τη ζωή σας από βαθειά ψυχικά τραύματα
עטלף אבק נס דרך מזגן שהתפוצץ כי חם
Pijamalı hasta yağız şoföre çabucak güvendi.
Flygande bäckasiner söka hwila på mjuka tuvor.
เป็นมนุษย์สุดประเสริฐเลิศคุณค่า กว่าบรรดาฝูงสัตว์เดรัจฉาน จงฝ่าฟันพัฒนาวิชาการ อย่าล้างผลาญฤๅเข่นฆ่าบีฑาใคร ไม่ถือโทษโกรธแช่งซัดฮึดฮัดด่า หัดอภัยเหมือนกีฬาอัชฌาสัย ปฏิบัติประพฤติกฎกำหนดใจ พูดจาให้จ๊ะๆ จ๋าๆ น่าฟังเอยฯ
Jeżu klątw, spłódź Finom część gry hańb!
11 passed, 0 failed tests
```
## How small is it?
512 bytes + overhead per encoding.
```
$ for i in src/*; do gcc -c $i -O1; done
$ du -bhc *.o | grep total
32K total
$ for i in src/*; do gcc -c $i -O3; done
$ du -bhc *.o | grep total
32K total
$ for i in src/*; do gcc -c $i -Os; done
$ du -bhc *.o | grep total
28K total
```
## Related
* [iconv](https://www.gnu.org/software/libiconv/)
* [icu](http://site.icu-project.org/)
|
