Questions tagged [unicode]

Unicode is a standard for the encoding, representation and handling of text with the intention of supporting all the characters required for written text incorporating all writing systems, technical symbols and punctuation.

Filter by
Sorted by
Tagged with
2
votes
0answers
419 views

No unicode glyphs

I am experiencing trouble displaying unicode glyphs overall in emacs. All unicode glyphs are displayed as boxes with the number for the unicode glyph inside. To best show what I mean, the M-x list-...
1
vote
0answers
54 views

desktop-save doesn't save file names with emoji properly

desktop-save-in-desktop-dir doesn't save file names that include glyphs from upper unicode range like emoji characters properly. By "upper", I mean "greater" like one with a code point 1F604 instead ...
0
votes
0answers
64 views

Automated conversion to real accented characters

I use org-mode to maintain a to-read list of articles. An entry in the list is produced by a function that I wrote in ELisp. The function uses bibtex-completion-get-value for the title and bibtex-...
1
vote
1answer
180 views

Get multibyte string byte

Given a multibyte string "x=π", how to get 4-th byte of the string, without creating string copy with something like string-as-unibyte? Pseudo code: (string-nth-byte 4 "x=π"). Expected result: 128. ...
1
vote
0answers
64 views

How to switch off Unicode bidi markers?

Do you know how whitespace mode turns on the visibility of certain normally non-visible characters, such as the space and the tab? Well, I'd like to be able to emulate this with Unicode bidirectional ...
10
votes
1answer
1k views

unicode.txt slowness

Moving around point (using the cursor keys) in Xah’s unicode.txt in fundamental-mode is noticeably slower than in an ordinary text file. Are the many non-ASCII characters the issue? Anything else? ...
2
votes
1answer
875 views

Unicode character display

Here's how some of the double-struck unicode letters display in my copy of Emacs for Windows: Here's how they display in Notepad: Version of Emacs: What's a good way to get Emacs to display all of ...
1
vote
1answer
310 views

What is Emacs' default character encoding for saving files? If it is UTF-8, is a BOM (Byte Order Mark) inserted?

What is the default character encoding used by GNU Emacs 25.1.1 to save files? Is it UTF-8? Assuming that it is UTF-8, does Emacs insert a BOM at the beginning of the file?
2
votes
1answer
75 views

Abbreviation expansion without spaces

I would like to set up things so that when I type Iuulius, the sequence uu is seamlessly replaced by ū (and a few more such pairs), as soon as I type the second u. I.e. the keystrokes and buffer text ...
7
votes
1answer
187 views

char-fold-search match for German eszett (ß)?

In emacs 25.1, if I customize search-default-mode to "Char-Fold Search", then an isearch-forward for u matches ü and one for o matches ö. But what character should I type to match ß ?
4
votes
0answers
112 views

(set-charset-priority 'unicode) ; should I do it?

I've seen the following in some init files, (set-charset-priority 'unicode) but after reading the documentation, I can't really say I understand the implications of this. In general I'm inclined to ...
1
vote
0answers
157 views

How to change font without breaking Unicode glyph mapping?

I am using Emacs 24.5 (stock Debian jessie) with a UHD display. I am over 50 and I need a large font. I have found a font that works well, but when I set the font using (set-face-attribute 'default ...
2
votes
2answers
274 views

Programmatically check whether a unicode character will render as tofu

Is there a way to programmatically determine whether a given unicode character will render as tofu in some context in Emacs? Some bug-flavored (U+1F41B) tofu renders in a face using DejaVu Sans Mono:
6
votes
1answer
50 views

How do I customize the way Emacs prints out certain keys and key sequences?

For example, I want Control key to be displayed not as C but as ⎈ (U+2388 HELM SYMBOL) in the minibuffer. Trying to personalize my Emacs and display all function keys as ISO symbols. And sequences to ...
7
votes
3answers
547 views

Translate ae to ä on non-German keyboard

If for some reason I am stuck to a keyboard with English layout and I often have to enter text in German - can emacs translate ae to ä (or ue to ü) for me? I do have a not-working solution like this: ...
1
vote
0answers
544 views

Charset and fonts shown by `describe-char`

I have some questions about emacs internal actions related to charset and fonts shown by describe-char. Now I use utf-8 as character encording scheme (CES) on emacs, so charsets shown by describe-...
4
votes
1answer
569 views

Under Windows, Emacs cannot handle encodings correctly for subprocesses, can it?

I have two simple text files on my D: drive, as shown below. D:\我.txt I D:\你.txt You After I execute M-x diff and type the correct filenames (Yes, I can input Chinese and filename ...
2
votes
1answer
773 views

Surprising glyphs for some characters

I am experiencing font issues for a few specific characters, namely the "SYMBOL FOR …" family, which are textual representations of control characters such as NUL, BEL, BS, etc. This screenshot shows:...
1
vote
0answers
29 views

Word boundaries in mixed-alphabet words [duplicate]

By default (e.g., in fundamental mode), emacs seems to treat the sequence of characters abcαβγ in a buffer as two separate words. In particular, a command like M-f done at the beginning will only move ...
0
votes
2answers
209 views

Render non-ascii chars correctly in Info buffers?

I'm reading the Emacs manual in Info-mode. Some non-ascii characters render as octal escape sequences rather than glyphs. For example, node 23.2 Minor Modes contains the following text: Electric ...
2
votes
1answer
619 views

How do I enable agda-mode's unicode input mode across all modes in Spacemacs?

I'd like to be able to type unicode characters like Π using agda-mode's "\Pi". In Emacs, I used to configure this like: (load-file (let ((coding-system-for-read 'utf-8)) (shell-...
2
votes
1answer
567 views

Unicode issues in Org-mode

Lately my documents dissolve into misinterpreted Unicode, for example α becomes \316\261. What could be the cause for that?
0
votes
0answers
208 views

How do I get curly quotation marks to show in Emacs on OS X?

EDIT: My problem has been fixed or, more precisely, worked around, thanks to help in the comments below. Never figured out what exactly the issue was as it wasn't a problem with my Emacs configuration ...
3
votes
2answers
455 views

Is there a way to get a Unicode character by name?

Is there a way to get a character by name (e.g. GREEK SMALL LETTER LAMBDA) instead of by code point (\uX3BB)?
7
votes
1answer
1k views

How can I save UTF-8 files with a Byte Order Mark?

I am trying to configure Emacs to save UTF-8 files with a Byte Order Mark. (Yes, I know that the BOM is evil and unnecessary for UTF-8 files. However, Microsoft has decided they know better, so I want ...
7
votes
1answer
2k views

How do you enter unicode characters in Spacemacs?

I am currently using the normal Evil keybindings (defaults). How do I enter unicode characters such as U+21d2 ⇒ ? In routine applications such as Gedit or Firefox, we can use Ctrl+Shift+U 2 1 d 2 or ...
4
votes
1answer
265 views

How can I add Unicode 8 support to Emacs 24.3?

insert-char provides a very convenient way to enter Unicode code points using their names and even search for code point names. Unfortunately, GNU Emacs 24.3 and Unicode 8 were released at roughly ...
8
votes
3answers
999 views

Fast unicode symbol insertion?

Currently, I'm inserting unicode characters (mainly math symbols) using TeX input method. This is cumbersome, since, for each character, I have to do following: Switch to TeX input method pressing C-...
5
votes
1answer
288 views

Inserting unicode symbol for rational numbers ℚ using TeX input method

Hello good people of Emacs! To insert unicode math symbols I use TeX input method. This way I get unicode character ℝ by typing \Bbb{R}, ℕ by typing \Bbb{N}, ℤ by typing \Bbb{Z}, etc... I'm unable ...
0
votes
0answers
123 views

How can I display any Unicode character in GUI Emacs for OS X? [duplicate]

I managed to make emacs dispaly any emoji in GUI Emacs for OS X thanks to the answer and comments here, but then I noticed I have other symbols that I can't display in Emacs like the because symbol "∵"...
5
votes
1answer
996 views

Easiest way to render an overline in org mode?

Org mode has support for showing unicode in place of latex commands through org-pretty-entities. Org mode also has support for underlining through font locks that are activated through the _ character....
6
votes
1answer
362 views

Check if terminal supports Unicode

I would like to use special mark symbols not only in window-system but also in xterm: (setq gnus-summary-to-prefix (if window-system "▒ " "==> ")) What check I should use?
16
votes
3answers
3k views

Exporting unicode characters to pdf using latex from org mode

Hello Good people of Emacs! I'm having trouble exporting unicode math symbols from buffer (org-mode) to pdf file. 1. Problem Description: Symbols are inserted to the buffer as unicode characters (...
0
votes
1answer
266 views

unicode character sometimes renders, sometimes doesn't

I'm not sure this is specific to helm, but when in helm's helm-ucs (C-c h 8) (though this also happens with helm-unicode), I notice that some characters show the weird little box glyph as if the ...
5
votes
0answers
83 views

How to replace a character display only for the `italic` face?

I am using a font that does not include italic characters. However, it does include characters like mathematical italic small a, which I would like to use instead. I can set up a display-table that ...
0
votes
2answers
87 views

Copy and paste with mouse breaks Umlaute

After upgrading to emacs 24 I have strange problems with copy and paste. I managed to reinstall copy and paste with the mouse but there remains the problem with German diacritic characters. If I copy ...
17
votes
2answers
2k views

How do I set up font fallback in a robust way?

TL;DR: What's a simple way to reliably say: use Consolas as the default font, FreeMono for the characters unsupported by Consolas, and Symbola for characters unsupported by both? Since my main ...
4
votes
1answer
89 views

Getting Emacs to recognize analogous Unicode characters as equivalent when searching

In most contexts, like Firefox of MS Office, if I have text that says, "It’s my birthday" (where the apostrophe has Unicode decimal code 8217) and I search for "It's my birthday" (with a simple ...
1
vote
1answer
2k views

How to convert a MULE encoded file to UTF-8?

I am trying to modify a buffer written by desktop-save to a file. The file is named .emacs.desktop and I am trying to modify it from a Perl script. It turns out that it is saved in emacs-mule encoding....
4
votes
1answer
73 views

Regexp by Unicode General Category

I'm trying to implement a tokenizer for Haskell, it has a bit involved token structure that can be seen in code here: https://github.com/ghc/ghc/blob/master/compiler/basicTypes/Lexeme.hs In regexp-...
9
votes
1answer
2k views

Coding System utf-8 on Mac - Which one and why as default?

I want to change my default encoding system from non defined to UTF-8 (I think that would be useful). Now I have seen many different UTF-8 coding systems: mule-utf-8 mule-utf-8-dos mule-utf-8-...
2
votes
0answers
76 views

Upper/lower regexp char classes and current-case-table

I seem to have a problem with [:upper:] [:lower:] and Unicode characters. This test fails: (ert-deftest haskell-upper () (set-buffer (get-buffer-create "*haskell-mode-buffer*")) (insert "Ż") (...
1
vote
2answers
780 views

How to convert Unicode backslash octal representation to the character it represents?

If I paste a string from some web page into an Emacs buffer sometimes it will show the Unicode representation of some characters with a backslash and some octal code. How can I convert this to the ...
6
votes
2answers
2k views

How to insert invalid UTF-8 sequence

In order to test that some code handles an invalid UTF-8 sequence properly, I need to insert an invalid UTF-8 sequence into an existing text file. However, my attempts to do so result in a valid UTF-...
2
votes
1answer
246 views

Unicode and `url-unhex-string` and something like \345\205\266\344\273\226

I need to use Emacs built-in url.el url-unhex-string to decode uri (e.g. /%E5%85%B6%E4%BB%96/other) It works, but all non-ascii (I guess it should be Unicode) characters are all converted into ...
12
votes
3answers
7k views

How to display Unicode UTF-8 as Unicode?

I have some UTF-8-encoded text files which display strange escape codes in Emacs. For instance, this text: In ista quaestione primo exponam quid intelligendum est per hoc nomen ‘Deus’; secundo, ...
16
votes
3answers
6k views

Tell a dash (-), an en-dash (–) and an emdash (—) apart

A dash (-), an en-dash (–) and an emdash (—) are different but difficult to tell apart. This causes problems e.g. when writing programs. Is there some way to tell them apart easier in emacs? Thanks.
1
vote
0answers
164 views

Unicode character escape sequences instead of text upon mouse-2 paste from other windows

I am having a weird problem with emacs: When pasting non-ascii text, e.g. € from X-clipboard with the middle mouse button into x-enabled emacs I get Unicode character escape sequences, e.g. \u20ac ...
0
votes
0answers
60 views

Strange error probably UTF related

I am using Emacs 23 under Mac OS X. When I open certain files I get the following error when I try to save them: Warning: ns-convert-utf8-nfd-to-nfc unsupported under GNUstep. insert-file-contents: ...
12
votes
5answers
473 views

Ways to unobtrusively vary text rendering?

I'm writing an emacs extension for use with speech recognition, and I'm looking for help with a particular feature. Some words the speech recognizer (Dragon) recognizes consistently poorly -- it doesn'...