String in unicode

[Natter]

Hi,

There is a string in unicode. The length of Latin characters is 1 byte, the length of characters of other code pages is 2 bytes.
How to get an array of characters of this string ?

[Antonio Linares]

Dear Yuri,

Please try:

? WideToStr( cUnicode )

[nageswaragunupudi]

This is a UTF8 encoded string.
You can use HB_UTF8LEN( cString ) to find the number of characters (not bytes) and HB_UTF8SUBSTR( cString, n, 1 ) to get the nth character (not byte)

Example:
Let us take a sample string in Hex: "41C39CC49EE0B095".
This is displayed as : AÜĞక

Code: Select all  Expand view

#include "fivewin.ch"

function Main()

   local cString := HEXTOSTR( "41C39CC49EE0B095" )
   local nChars, n
   local aChars := {}

   ? cString // --> AÜĞక
   ? "Length in Bytes : ", Len( cString ) // --> 8
   ? "Length in Chars : ", nChars := HB_UTF8LEN( cString ) --> 4
   for n := 1 to nChars
      aAdd( aChars, HB_UTF8SUBSTR( cString, n, 1 ) )
   next

   XBROWSER aChars // { "A", "Ü", "Ğ", "క" }

   AEval( aChars, { |c,i| aChars[ i ] := { c, STRTOHEX( c ), Len( c ) } } )
   XBROWSER aChars SETUP oBrw:cHeaders := { "CHAR","HEX","BYTES" }

return nil

[Natter]

Thank you, I will definitely use it!

[frose]

For me, these two sources are helpful regarding UTF8:

1. 3.5 Codepage API - UTF8 and code page functions built into Harbour: http://www.kresin.ru/en/hrbfaq_3.html#Doc5

2. Unicode conversion functions for Harbour. http://www.hmgextended.com/files/CONTRIB/UnicodeConvert.prg unfortunately no longer online

Maybe someone can help

[Antonio Linares]

https://web.archive.org/web/20120808033419/http://www.hmgextended.com/files/CONTRIB/UnicodeConvert.prg

[frose]

muchas gracias Antonio