Karsten Blees b5dc523ebe Win32: add Unicode conversion functions ...

Add Unicode conversion functions to convert between Windows native UTF-16LE
encoding to UTF-8 and back.

To support repositories with legacy-encoded file names, the UTF-8 to UTF-16
conversion function tries to create valid, unique file names even for
invalid UTF-8 byte sequences, so that these repositories can be checked out
without error.

The current implementation leaves invalid UTF-8 bytes in range 0xa0 - 0xff
as is (producing printable Unicode chars \u00a0 - \u00ff, equivalent to
ISO-8859-1), and converts 0x80 - 0x9f to hex-code (\u0080 - \u009f are
control chars).

The Windows MultiByteToWideChar API was not used as it either drops invalid
UTF-8 sequences (on Win2k/XP; producing non-unique or even empty file
names) or converts them to the replacement char \ufffd (Vista/7; causing
ERROR_INVALID_NAME in subsequent calls to file system APIs).

Signed-off-by: Karsten Blees <blees@dcon.de>

2014-05-15 09:41:12 +02:00

..

fnmatch

compat/fnmatch/fnmatch.c: Fix a sparse error

2013-04-28 12:24:40 -07:00

nedmalloc

Windows: do not redefine _WIN32_WINNT

2013-09-11 14:50:19 -07:00

poll

Windows: do not redefine _WIN32_WINNT

2013-09-11 14:50:19 -07:00

regex

C: have space around && and || operators

2013-10-16 10:26:39 -07:00

vcbuild

mark Windows build scripts executable

2013-11-25 15:01:22 -08:00

win32

Win32 dirent: improve dirent implementation

2014-05-15 09:41:03 +02:00

apple-common-crypto.h

imap-send: use Apple's Security framework for base64 encoding

2013-07-30 08:53:24 -07:00

basename.c

…

bswap.h

…

fopen.c

…

gmtime.c

date: recognize bogus FreeBSD gmtime output

2014-04-01 14:39:04 -07:00

hstrerror.c

…

inet_ntop.c

Drop system includes from inet_pton/inet_ntop compatibility wrappers

2012-02-05 16:32:33 -08:00

inet_pton.c

Drop system includes from inet_pton/inet_ntop compatibility wrappers

2012-02-05 16:32:33 -08:00

memmem.c

…

mingw.c

Win32: add Unicode conversion functions

2014-05-15 09:41:12 +02:00

mingw.h

Win32: add Unicode conversion functions

2014-05-15 09:41:12 +02:00

mkdir.c

compat: some mkdir() do not like a slash at the end

2012-08-24 09:48:51 -07:00

mkdtemp.c

…

mmap.c

…

msvc.c

…

msvc.h

MSVC: fix stat definition hell

2013-09-11 11:08:52 -07:00

obstack.c

obstack.c: Fix some sparse warnings

2011-09-11 14:43:33 -07:00

obstack.h

obstack: fix spelling of similar

2013-04-12 12:23:20 -07:00

pread.c

…

precompose_utf8.c

Set core.precomposeunicode to true on e.g. HFS+

2013-08-27 07:41:32 -07:00

precompose_utf8.h

git on Mac OS and precomposed unicode

2012-07-08 22:03:46 -07:00

qsort.c

cleanup: use internal memory allocation wrapper functions everywhere

2011-10-06 13:54:32 -07:00

setenv.c

compat/setenv.c: error if name contains '='

2011-12-14 19:31:03 -08:00

snprintf.c

compat/snprintf: don't look at va_list twice

2011-12-12 09:09:35 -08:00

strcasestr.c

…

strlcpy.c

…

strtoimax.c

Add strtoimax() compatibility function.

2011-11-02 13:06:30 -07:00

strtoumax.c

…

terminal.c

mingw: rename WIN32 cpp macro to GIT_WINDOWS_NATIVE

2013-05-08 12:14:35 -07:00

terminal.h

add generic terminal prompt function

2011-12-12 16:09:38 -08:00

unsetenv.c

Revert "compat/unsetenv.c: Fix a sparse warning"

2013-07-21 15:09:56 -07:00

win32.h

mingw: rename WIN32 cpp macro to GIT_WINDOWS_NATIVE

2013-05-08 12:14:35 -07:00

win32mmap.c

compat/win32mmap.c: Fix some sparse warnings

2013-04-28 12:27:08 -07:00

winansi.c

Win32: Thread-safe windows console output

2014-05-15 09:41:11 +02:00