[Windows] Python + UTF-8 Encoding?

[Braintelligence]

Hi there,

when executing Python3 code with

print(" STRING ")

Where STRING contains letters like öüä, there's a problem with the encoding. It shows as �. (While the console in windows command prompt shows it correctly.)

If I use #coding=latin-1 it works but this shouldn't be necessary!

Sorry if I missed this issue within the others.
Please help me out =(

[rgbkrk]

Hmm, seems like it's interaction with Windows that isn't doing well. For me on a Mac, using python3 it works perfectly:

[Braintelligence]

I heard that Windows is using UTF-16 encoding in its console. Maybe that's the reason for this issue?

Edit

I'm using Windows 8.1 64-bit. I installed ATOM via Chocolatey and am using the packages atom-beautify, color picker, minimap and atom-keymap-compatible (unofficial package for resolving this issue: atom/atom-keymap#35 )
For Themes I use Seti UI and Seti Syntax. The code I'm compiling is Python3 (Python also installed via chocolatey) and the console output is only correct if I choose latin-1 as python encoding-environment-setting while the windows console has a correct output if the python executable is called from there.

[Braintelligence]

Still have this problem with Atom 0.141.0 and Script 2.13.0
Encoding shows up fine in Atom (thx to the new feature, heh). Correct symbols are still shown in windows command line when executing python

Did you try enforcing a UTF-8 encoding before it hits the "script-console"?

[erran]

As mentioned by @poliorcetics this is an issue in Mac OS X too. We could both produce it under Yosemite.

Adding the following comment to a Python file:

# é

Causes this issue for either of us:

  File "/Users/ecarey/github/atom-script/examples/i18n.py", line 1
SyntaxError: Non-ASCII character '\xc3' in file /Users/ecarey/github/atom-script/examples/i18n.py on line 1, but no encoding declared; see http://www.python.org/peps/pep-0263.html for details

As noted in the PEP-0263 reference adding the annotation will fix the issue. This is the suggested fix, but for easy use the below changes could fix this within the Script package.

• Prepend # coding: UTF-8 where UTF-8 is substituted with whatever encoding is selected by Atom (bottom left).
  • Through a configuration option.
  • Automatically similar to how we prepend whitespace to ensure the correct error line is reported.

[erran]

@Braintelligence can you confirm whether adding the special coding comment resolves this issue for you? I believe it resolved #252.

[Braintelligence]

I'm very sorry but I am not using Atom editor anymore since this issue is going on for over a year now: atom/atom-keymap#35

For me this editor is not being maintained properly till proven otherwise.

[dbolton]

@erran Adding the utf-8 comment to the top of the file doesn't stop it from showing the question marks for me. Python 3.5.1, Atom 1.3.2, Windows 10.

[dbolton]

@erran and @Braintelligence I was able to find a workaround to the problem.

For me, it looks like atom-script on Windows uses cp1252 (Windows 1252) encoding by default instead of utf-8 (the default encoding may depend on your locale and platform).

As a work-around you can specify the encoding as utf-8 in your code for the system out and error streams:

import sys
import io

sys.stdout = io.TextIOWrapper(sys.stdout.detach(), encoding = 'utf-8')
sys.stderr = io.TextIOWrapper(sys.stderr.detach(), encoding = 'utf-8')

print ('öüä')

[Braintelligence]

@dbolton Thanks, but I really moved on and am now very happy with PyCharm. :)

[J-qak]

I haven't looked at script source codes, but shouldn't this have easy solution? Isn't it possible to just change encoding for console view on Windows?

[sinedanat]

After 2 years this problem still exists.
I use this plugin for runnning haskell code on Winwdos 7.
Maybe the simplest solution is to add another option for encoding in settings?

[rgbkrk]

If you've got a fix, please submit a pull request.

[silvium]

@sinedanat after 3 years. And counting. VS Code is starting to look more and more inviting.

[rgbkrk]

I highly recommend using Hydrogen over this module for running your code. I don't have time to work on this one.

[alexjosesilva]

Estou executando este codigo

• *- coding: utf-8 - *-
  import os, sys

print "EXPEDIÇÃO DE DESPACHO"

e esta saindo:

EXPEDIÇÃO DE DESPACHO

[rgbkrk]

Almost 4 years!

[mambari]

solution found on internet : create a environment variable

PYTHONIOENCODING=utf-8

[github-actions]

🎉 This issue has been resolved in version 3.31.3 🎉

The release is available on:

• GitHub release
• Atom package

Your semantic-release bot 📦🚀