Questions tagged [character-encoding]

Character encoding refers to the way characters are represented as a series of bytes

30 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
9
votes
1answer
2k views

Coding System utf-8 on Mac - Which one and why as default?

I want to change my default encoding system from non defined to UTF-8 (I think that would be useful). Now I have seen many different UTF-8 coding systems: mule-utf-8 mule-utf-8-dos mule-utf-8-...
6
votes
1answer
2k views

Emacs IPython prompt symbol is garbled

I just installed Fedora 24 with Emacs and IPython. When I launched the IPython shell in Emacs, the prompt symbol, which should be "In [1]", is displayed as "^[[?12l^[[?25h". Is there a way to solve ...
4
votes
1answer
600 views

Under Windows, Emacs cannot handle encodings correctly for subprocesses, can it?

I have two simple text files on my D: drive, as shown below. D:\我.txt I D:\你.txt You After I execute M-x diff and type the correct filenames (Yes, I can input Chinese and filename ...
3
votes
0answers
197 views

Emacs keeps guessing wrong coding system on a file I edit both in Linux and Windows

I use Emacs on both Linux and Windows to edit the same files (that I keep in Dropbox, which I hope is irrelevant, but who knows). The files are encoded in utf-8 with Unix line endings. Occasionally, I ...
2
votes
0answers
44 views

How to make emacs not crash when converting binary file to UTF-8

When I run revert-buffer-with-coding-system [RET] UTF-8 Emacs crashes. This is the file I'm trying to revert. \0 !"#$%&'()*+,-./0123456789:;<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`...
2
votes
0answers
179 views

fix buffer invalid UTF-8 encoding characters by query/replace

When I copy text from web pages, there are some special characters like ', - etc (not UTF-8 encoding). As you can see in the following screenshot: I checked out some similar questions in this site: [...
2
votes
0answers
173 views

copying into emacs from clipboard garbled

When I copy data from outside to my emacs, it is garbled (venv) tree ./scripts scripts ├── foo.sh ├── bar.sh ├── start.sh ├── stop.py However, when I paste this in emacs, I get this: (venv) tree ....
2
votes
0answers
115 views

What coding system should I use for one Emacs configurations for both unix and Windows?

I set the coding as utf-8, and I got many ^M from eshell on Windows. There's utf-8-dos and utf-8-unix. I would like to use the same configuration file on both unix and Windows. I guess there are many ...
1
vote
0answers
35 views

Emacs displays raw text instead of unicode

I'm working on a LaTeX document in emacs (27.1) that contains english as well as sanskrit (devanagari) text. After running aspell on the document, I ran M-x revert-buffer and attempted to save the ...
1
vote
0answers
39 views

Unwanted characters in messages downloaded with RMAIL

I use RMAIL as my default Email client and it works well for my purposes. I have one small problem with it that I cannot resolve. Downloaded messages include unwanted characters in one heading, the ...
1
vote
0answers
44 views

Why did I get the U+2019 right single quotation mark not plain ASCII single quote in C mode?

In Emacs under C mode, why did the single quote key give me a U+2019 right single quotation mark, not a plain ASCII single quote? (That was corrected by a bot https://stackoverflow.com/posts/64104679/...
1
vote
0answers
101 views

Emacs opens files with wrong line end encoding

Whenever I open a file encoded with dos end lines, Emacs decides it's encoded in undecided_linux and displays ^M after each line. I checked, those files all have matching newline characters (no odd ^...
1
vote
0answers
161 views

org-babel results with accented characters

I have a problem with the output of org-babel code blocks when this output contains accented characters. For example, if I execute this code block: #+name: test_accented #+begin_src python :results ...
1
vote
0answers
242 views

Org-mode ellipsis arrow is not using my defined encoding (utf-8)

First, some info on my system/version: Windows 10 Emacs 26.1 (I'm new to Emacs, so let me know if there is more information I should provide) This is what is happening: The image above shows that ...
1
vote
0answers
88 views

R in ESS outputs UTF-8, which emacs renders raw

I find the question but no answer at Emacs ESS R - Message Content Encoding and Display Issue. In buffer *R*, the R process uses UTF-8 encoding for its output. However emacs does not decode that ...
1
vote
1answer
455 views

How open text file by default with UTF-8 endcoding system?

Emacs 26.1, Windows 10 In my init.el: (set-language-environment "UTF-8") But when I open text file the Emacs not show correct Cyrillic text. Why? describe-variable -> buffer-file-coding-system ...
1
vote
0answers
84 views

Wrong unicode glyphs in emacs?

I recently came across a python file "*.py" containing several prints consisting of unicode symbols. I noticed that several symbols are displayed with different glyphs in emacs than in another editor. ...
1
vote
0answers
114 views

Emacs ESS R - Message Content Encoding and Display Issue

I use Emacs ESS for doing some work in R. But somehow the help messages or content which is output of R process, is not printed correctly, most likely because of some encoding issue. (Screenshot ...
1
vote
0answers
569 views

Charset and fonts shown by `describe-char`

I have some questions about emacs internal actions related to charset and fonts shown by describe-char. Now I use utf-8 as character encording scheme (CES) on emacs, so charsets shown by describe-...
1
vote
0answers
249 views

Hunspell: encoding of personal dictionary

I am using hunspell 1.3.2 (on Windows) for spell checking, and I've been trying to make a personal dictionary. It works just fine, except the encoding is garbled. Whether I encode the personal ...
1
vote
0answers
215 views

Why does emacs insert a `#coding` header into my file?

I have a file where every time I save the file emacs inserts a # coding: utf-8 at the top of the file. I'm using the prelude package. How do I turn this off? I'm having a hard time tracing where this ...
1
vote
0answers
880 views

How do I edit text in Cyrillic / Russian on OpenBSD?

I'm trying to make it possible to easily edit text in Cyrillic / Russian on a remote OpenBSD 5.2 amd64. I'm using emacs-21.4p18-no_x11, which doesn't show any Cyrillic characters whatsoever when I ...
0
votes
1answer
17 views

Cannot use `pbpaste` in Emacs to paste Chinese characters

I'm using macOS. I tried using the following command to paste from clipboard in Emacs(started with emacs -Q) (call-process "/usr/bin/pbpaste" nil t nil) It works fine for English characters,...
0
votes
0answers
11 views

Presenting part of the buffer in alternative way with editing capabilities and background recoding/validation?

Windows .reg files are almost human readable. Because some types require binary encoding, like: "Name"=hex(2):54,00,65,00,6d,00,70,00,6f,00,72,00,61,00,72,00,79,00,20,00,53,\ 00,65,00,74,...
0
votes
0answers
17 views

Emacs on OSX changes encoding while loading

When I start Emacs on OSX (installed via "brew cask install emacs"), I see the "U" for UTF-8 encoding in the mode line for a fraction of a second, then it changes automatically to ...
0
votes
0answers
29 views

`ispell-dictionary-base-alist` and `ispell-dictionary-alist`: how to add utf-8 cyrillic charachter codes?

ispell-dictionary-base-alist contains these values for russian: ("russianw" ; russianw.aff (CP1251 charset) "[\300\301\302\303\304\305\250\306\307\310\311\312\313\314\315\316\317\320\...
0
votes
0answers
20 views

What does “Automatic selection from [utf-8-unix utf-8-dos utf-8-mac]” mean in description of utf-8 coding system?

I'd like all new files created by Emacs (28.0.50 prerelease on Win10) to have Unix-style (LF) line endings by default. I've had the following in my .emacs for a long time: (prefer-coding-system 'utf-...
0
votes
0answers
31 views

How to find correct character encoding

I am unable to save a buffer due to a character encoding. I am doing exploratory data analysis using Org babel. Data is read from a file using Python and the results are printed to the buffer. #+...
0
votes
0answers
60 views

Problem with file encoding in Org-Mode

One org-mode file started showing strange coding instead of spanish characters (á, é, ...). Instead of "Música" and "fotografía" it shows "M\303\272sica" and "fotograf\303\203\302\255a". I'm using ...
0
votes
1answer
54 views

Characters replaced with angled bracket sequence, possibly due to encoding

I have files in Markdown, saved in a Dropbox folder. One of them replaces characters with angled bracket sequences. For example a git diff no-index between the saved file and a copy-paste of the text ...