[Freeciv-Dev] (PR#9804) Unicode in registry code

["Mateusz Stefek" <mstefek@xxxxxxxxx>]

<URL: http://rt.freeciv.org/Ticket/Display.html?id=9804 >

Here's my proposition about character encoding in registry code.

1) Section and entry names will be saved in pure ASCII
2) String values will be saved in UTF-8
3) secfile_insert_str* will accept only UTF-8
   This is not a big problem. Only the code which saves client options
need to convert CMA presets' names into UTF-8
4) secfile_lookup_str* will return UTF-8
5) savegame compatibility
   There will be function called secfile_set_fallback_encoding(file,
encoding). If the string which is read is not valid utf8, it will be
converted from that encoding.
6) utility functions needed:
- utf8_validate
- is_ascii
- convert_string (it's in Jason's patch)

--
mateusz