Error s compiling libdeepspeech so

[JRMeyer]

>>> charlesdeepk
[February 26, 2021, 9:59pm]

I modified deepspeech.cc to accept samples as float in addition to short
because my audio sample source gives them as float and having to convert
them to short just to have deepspeech convert them right back to float
is a waste.

However, to make this easier to reproduce, I will try to compile it
without any modification.

I configured tensorflow with nothing (no cuda, etc) but /arch:AVX2
(/arch:AVX is the default).

The command to build libdeepspeech I used is as follows: slash
bazel build --workspace_status_command='bash native_client/bazel_workspace_status_cmd.sh' --config=monolithic -c opt --copt=-O3 --copt='-D_GLIBCXX_USE_CXX11_ABI=0' --copt=-fvisibility=hidden //native_client:libdeepspeech.so slash
This is copied verbatim from the building guide at [the official
#compile-deepspeech)

I run it, and after dowloading needed librearies and compiling for a few
minutes I get this error: error -
Pastebin.com slash
PD: MSVC is generating logs in spanish. If you don't understand the
logs, the error code is
C2678: binary 'operator' : no operator defined which takes a left-hand operand of type 'const Proxy' (or there is no acceptable conversion)

I am running on Windows 10 LTCS build 17763. All msvc c++ 2013, 2015 and
2019 libraries are installed. The bazel version is 3.1.0 as stated in
the guide. The tensorflow version is the same as in the deepspeech repo.

[This is an archived TTS discussion thread from discourse.mozilla.org/t/error-s-compiling-libdeepspeech-so]

[JRMeyer]

>>> lissyx
[February 26, 2021, 10:45pm]

> I run it, and after dowloading needed librearies and compiling for a
> few minutes I get this error: error -
> Pastebin.com

Please share full text here instead of pastebin

[Archived Post]

[JRMeyer]

>>> lissyx
[February 26, 2021, 10:50pm]

> This is copied verbatim from the building guide at [the official
#compile-deepspeech)

Hm, this might be too linux/macOS specific, I know we have WIndows-only
docs in
https://github.com/mozilla/DeepSpeech/tree/385c8c769bc4aed5e6979a239591486c44f3471d/native_client/dotnet#building-deepspeech-native-client-for-windows

Please cross-check those instructions, they are the one we apply for CI.

BTW we are really lacking of people with good Windows building
experience, so contributions are welcome.

> PD: MSVC is generating logs in spanish. If you don't understand the
> logs, the error code is
> C2678: binary 'operator' : no operator defined which takes a left-hand operand of type 'const Proxy' (or there is no acceptable conversion)

Honestly, I have 0 idea why and I think it might just be you following
the wrong doc.

[Archived Post]

[JRMeyer]

>>> charlesdeepk
[February 26, 2021, 10:53pm]

> Hm, this might be too linux/macOS specific, I know we have
> WIndows-only docs in
> https://github.com/mozilla/DeepSpeech/tree/385c8c769bc4aed5e6979a239591486c44f3471d/native_client/dotnet#building-deepspeech-native-client-for-windows slash
> Honestly, I have 0 idea why and I think it might just be you following
> the wrong doc.

I didn't know that existed, thank you. Will follow it and see if I can
get it to work.

[Archived Post]

[JRMeyer]

>>> lissyx
[February 26, 2021, 10:53pm]

> C: *slash* Program Files (x86) *slash* Microsoft Visual Studio *slash* 2019 *slash* Community *slash* VC *slash* Tools *slash* MSVC *slash* 14.28.29333 *slash* include *slash* algorithm(7419): error C2678: '=' binario: no se encontró un operador que adopte un operando en la parte izquierda de tipo 'const Proxy' (o bien no existe una conversión aceptable)

Not that I want to be picky, but if you can share errors messages in
English, it's easier. Though I have no idea how to do that on Windows

[Archived Post]

[JRMeyer]

>>> lissyx
[February 26, 2021, 10:54pm]

> I didn't know that existed, thank you.

I guess for once the error is on our side, we have everything on one
place except that, mostly for historical reasons and lack of people
giving feedback on windows builds.

Mostly, the .Net / Windows build has been bootstrapped / hacked by
and we are just following
/ updating on top of his work

[Archived Post]

[JRMeyer]

>>> charlesdeepk
[February 26, 2021, 11:19pm]

The previous problem is solved. Now this

ERROR: C:/deepspeech/tensorflow/tensorflow/core/util/BUILD:351:1: error executing shell command: 'C:/msys64/usr/bin/bash.exe -c bazel-out/x64_windows-opt-ST-e0f78fafe98f9cd48032f8d6a9732902b210aba3b30f85849d3455fe9d9fb327/bin/tensorflow/tools/git/gen_git_source.exe --generate '$' --git_tag_ove...' failed (Exit 2): bash.exe failed: error executing command
cd C:/users/fuyusaki/_bazel_cesar/baohmz5h/execroot/org_tensorflow
SET PATH=C: slash msys64 slash usr slash bin;C: slash msys64 slash bin;C: slash WINDOWS;C: slash WINDOWS slash System32;C: slash WINDOWS slash System32 slash WindowsPowerShell slash v1.0
SET PYTHON_BIN_PATH=C:/msys64/mingw64/bin/python.exe
SET PYTHON_LIB_PATH=C:/msys64/mingw64/lib/python3.8/site-packages
SET RUNFILES_MANIFEST_ONLY=1
SET TF2_BEHAVIOR=1
SET TF_CONFIGURE_IOS=0
SET TF_ENABLE_XLA=1
C:/msys64/usr/bin/bash.exe -c bazel-out/x64_windows-opt-ST-e0f78fafe98f9cd48032f8d6a9732902b210aba3b30f85849d3455fe9d9fb327/bin/tensorflow/tools/git/gen_git_source.exe --generate '$' --git_tag_override=${GIT_TAG_OVERRIDE:-} external/local_config_git/gen/spec.json external/local_config_git/gen/head external/local_config_git/gen/branch_ref bazel-out/x64_windows-opt/bin/tensorflow/core/util/version_info.cc
Execution platform: local_execution_config_platform//:platform
C:/msys64/mingw64/bin/python.exe: can't open file ' slash slash gen_git_source.py': [Errno 2] No such file or directory
Target //native_client:libdeepspeech.so failed to build
INFO: Elapsed time: 387.768s, Critical Path: 56.49s
INFO: 933 processes: 933 local.
FAILED: Build did NOT complete successfully

I don't know the bazel toolchain but looks like get_git_source.py isn't
copied to X dir at some point?

[Archived Post]

[JRMeyer]

>>> lissyx
[February 26, 2021, 11:26pm]

> I don't know the bazel toolchain but looks like get_git_source.py
> isn't copied to X dir at some point?

Unfortunately, that's really TensorFlow / Windows related, and it's not
an error I remember we had to fix on CI, so I have mostly 0 idea.

Only really useful thing I could share was that most of the 'No such
file or directory' errors on Windows CI I had to fix were related to an
interpreter not found, e.g., like python.exe

[Archived Post]

[JRMeyer]

>>> lissyx
[February 26, 2021, 11:31pm]

maybe adding -s --verbose_explanations to your bazel build can shed
more light? maybe you should share more complete logs, there might be
hints earlier.

Sometimes on Windows it's also breaking because of lengths of path

[Archived Post]

[JRMeyer]

>>> charlesdeepk
[February 26, 2021, 11:34pm]

Will do. slash
PD: Is there a way to cross-compile this from linux for windows? I have
a feeling it would solve these weird issues.

[Archived Post]

[JRMeyer]

>>> lissyx
[February 26, 2021, 11:36pm]

Latest master CI task for windows/cpu:
https://community-tc.services.mozilla.com/tasks/AWAnsgobSIKFaYrBpFKfhw

full build log (deepspeech):
https://community-tc.services.mozilla.com/tasks/AWAnsgobSIKFaYrBpFKfhw/runs/0/logs/public/logs/live.log

full build log for tensorflow parts:
https://community.taskcluster-artifacts.net/I3bYN3i1SL2994LJ7FAIrA/0/public/logs/live_backing.log

> PD: Is there a way to cross-compile this from linux for windows?

I'd wish, but TensorFlow build system does not provide that, and I don't
know MSVC well enough (nor have time to do it), sadly. We have it for
linux on armv7/aarch64, but that's it.

[Archived Post]

[JRMeyer]

>>> charlesdeepk
[February 28, 2021, 9:55pm]

I got it to compile. I had to edit the build script to skip a non
essential part that just replaced macros with the git version (deleted
the part that run get_git_source.py, which was the cause of the
problem). As of the compile errors, I found it was related to a library
used by deepspeech. The problem was
fixed upstream but the
deepspeech repo has not updated yet. With that, the rest of the build
can complete.

[Archived Post]

[JRMeyer]

>>> lissyx
[March 1, 2021, 9:17am]

> I had to edit the build script to skip a non essential part that just
> replaced macros with the git version (deleted the part that run
> get_git_source.py, which was the cause of the problem).

That's still weird why you got into that error in the first place, but
unless I have time and repro on a Windows machine, or you get time to
dig into TensorFlow bazel build system, I fear there's not a lot that
can be done here.

> The problem was fixed
> upstream but the deepspeech repo has not updated yet.

Unfortunately, it seems to be tied to some compiler version to trigger
the bug. That might explain why we have not experienced the issue.

Maybe it's worth you file an issue on GitHub then, and share more
details on your MSVC setup? Looks like the fix is an easy one.

[Archived Post]

[JRMeyer]

>>> lissyx
[March 1, 2021, 9:19am]

From
https://github.com/mozilla/community-tc-config/blob/bea5baeca2b9b683e73400a1205c36e3560a04ee/imagesets/deepspeech-win2012r2/bootstrap.ps1#L57-L59
we install 16.5.4.0

So yeah, I think filing a github issue would be nice.

[Archived Post]

[JRMeyer]

>>> lissyx
[March 3, 2021, 2:53pm]

>

[Archived Post]