UTF-8 with BOM encoded scripts fail

[diversario]

If you try to run a UTF-8 with BOM encoded script like

#!/usr/bin/env node

console.log("UTF8!");

it fails with

./test.js: 1: #!/usr/bin/env: not found
./test.js: 3: Syntax error: word unexpected (expecting ")")

if run as executable script or

test.js:1
#!/usr/bin/env
 ^

node.js:134
        throw e; // process.nextTick error, or 'error' event on first tick
        ^
SyntaxError: Unexpected token ILLEGAL

if given to node.
Scripts encoded in ANSI or UTF-8 without BOM work fine.

[bnoordhuis]

@isaacs: can you review 24d4539?

[isaacs]

@bnoordhuis The code LGTM, but I can't actually get the tests to fail without the code change. Is git "fixing" the BOM byte or something?

[bnoordhuis]

The BOM is in the repo:

$ curl -s https://raw.github.com/joyent/node/24d4539/test/fixtures/utf8-bom.json | xxd
0000000: efbb bf34 320a                           ...42.

Do you have locale settings configured in your ~/.gitconfig or .git/config?

[koichik]

In my environment, test-module-loading.js failed as expected before build.

[bnoordhuis]

Thanks, @koichik. Merged in ac722bb.