Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DataFrame with UTF-8 #12

Open
EckisWelt opened this issue Jan 23, 2020 · 5 comments
Open

DataFrame with UTF-8 #12

EckisWelt opened this issue Jan 23, 2020 · 5 comments
Assignees

Comments

@EckisWelt
Copy link

If I load data from a DataFrame which has foreign characters such as äöü, the import loads garbage.

To fix that you would need in the bcp command option: '-C 65001'.

And in the format_file_builder you would need to remove any collation.

https://docs.microsoft.com/en-us/sql/relational-databases/import-export/create-a-format-file-sql-server?view=sql-server-ver15

I'm not sure how it needs to be done to be still flexible with your default file import without UTF-8.

@titan550
Copy link
Owner

I added these modifications that should do the job. Please try it and let me know.

pip uninstall -y bcpy
pip install --no-index git+https://github.com/titan550/bcpy@b3e8155cfc76e152e15a59b97fb3ed491dc806c4

@anibyeol
Copy link

Hi,
pip uninstall -y bcpy
pip install --no-index git+https://github.com/titan550/bcpy@b3e8155cfc76e152e15a59b97fb3ed491dc806c4

Tried installing this version, but the issue still persists.

@FriiSRS
Copy link

FriiSRS commented Nov 12, 2020

Hi,
pip uninstall -y bcpy
pip install --no-index git+https://github.com/titan550/bcpy@b3e8155cfc76e152e15a59b97fb3ed491dc806c4

Tried installing this version, but the issue still persists.

Same for me

@anibyeol
Copy link

anibyeol commented Dec 7, 2020

Yep, not resolved yet. Chinese characters are loaded like '市政科'

@MVargasP
Copy link

MVargasP commented May 4, 2021

Hello, I also have the same problem, still unsolved?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants