Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failing to train the MultiBand Diffusion model #477

Open
my-yy opened this issue Jul 3, 2024 · 0 comments
Open

Failing to train the MultiBand Diffusion model #477

my-yy opened this issue Jul 3, 2024 · 0 comments

Comments

@my-yy
Copy link

my-yy commented Jul 3, 2024

Hi, I am using the following command to train the multiBand diffusion model

dora grid diffusion.4_bands_base_32khz

But i come across the following error:

omegaconf.errors.MissingMandatoryValue: Missing mandatory value: channels

stacktrace:

(audiocraft) cgy@g0020:~/projects/11_audiocraft$ dora grid diffusion.4_bands_base_32khz
Dora directory: /tmp/audiocraft_cgy
concurrent.futures.process._RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/share/home/cgy/miniconda/envs/audiocraft/lib/python3.9/site-packages/dora/explore.py", line 37, in _process
    return (shepherd.get_sheep_from_argv(argv), slurm, job_array_index)
  File "/share/home/cgy/miniconda/envs/audiocraft/lib/python3.9/site-packages/dora/shep.py", line 155, in get_sheep_from_argv
    xp = self.main.get_xp(argv)
  File "/share/home/cgy/miniconda/envs/audiocraft/lib/python3.9/site-packages/dora/hydra.py", line 190, in get_xp
    delta += self._get_delta(base, cfg)
  File "/share/home/cgy/miniconda/envs/audiocraft/lib/python3.9/site-packages/dora/hydra.py", line 297, in _get_delta
    for diff in _compare_config(init, other):
  File "/share/home/cgy/miniconda/envs/audiocraft/lib/python3.9/site-packages/dora/hydra.py", line 67, in _compare_config
    ref_value = ref[key]
  File "/share/home/cgy/miniconda/envs/audiocraft/lib/python3.9/site-packages/omegaconf/dictconfig.py", line 375, in __getitem__
    self._format_and_raise(key=key, value=None, cause=e)
  File "/share/home/cgy/miniconda/envs/audiocraft/lib/python3.9/site-packages/omegaconf/base.py", line 231, in _format_and_raise
    format_and_raise(
  File "/share/home/cgy/miniconda/envs/audiocraft/lib/python3.9/site-packages/omegaconf/_utils.py", line 899, in format_and_raise
    _raise(ex, cause)
  File "/share/home/cgy/miniconda/envs/audiocraft/lib/python3.9/site-packages/omegaconf/_utils.py", line 797, in _raise
    raise ex.with_traceback(sys.exc_info()[2])  # set env var OC_CAUSE=1 for full trace
  File "/share/home/cgy/miniconda/envs/audiocraft/lib/python3.9/site-packages/omegaconf/dictconfig.py", line 369, in __getitem__
    return self._get_impl(key=key, default_value=_DEFAULT_MARKER_)
  File "/share/home/cgy/miniconda/envs/audiocraft/lib/python3.9/site-packages/omegaconf/dictconfig.py", line 451, in _get_impl
    return self._resolve_with_default(
  File "/share/home/cgy/miniconda/envs/audiocraft/lib/python3.9/site-packages/omegaconf/basecontainer.py", line 96, in _resolve_with_default
    raise MissingMandatoryValue("Missing mandatory value: $FULL_KEY")
omegaconf.errors.MissingMandatoryValue: Missing mandatory value: channels
    full_key: channels
    object_type=dict

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/share/home/cgy/miniconda/envs/audiocraft/lib/python3.9/concurrent/futures/process.py", line 246, in _process_worker
    r = call_item.fn(*call_item.args, **call_item.kwargs)
  File "/share/home/cgy/miniconda/envs/audiocraft/lib/python3.9/site-packages/dora/explore.py", line 39, in _process
    raise ProcessException(repr(exc))
dora.explore.ProcessException: MissingMandatoryValue('Missing mandatory value: channels\n    full_key: channels\n    object_type=dict')
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/share/home/cgy/miniconda/envs/audiocraft/bin/dora", line 8, in <module>
    sys.exit(main())
  File "/share/home/cgy/miniconda/envs/audiocraft/lib/python3.9/site-packages/dora/__main__.py", line 170, in main
    args.action(args, main)
  File "/share/home/cgy/miniconda/envs/audiocraft/lib/python3.9/site-packages/dora/grid.py", line 138, in grid_action
    run_grid(main, explorer, args.grid, rules, slurm, grid_args)
  File "/share/home/cgy/miniconda/envs/audiocraft/lib/python3.9/site-packages/dora/grid.py", line 175, in run_grid
    herd.complete()
  File "/share/home/cgy/miniconda/envs/audiocraft/lib/python3.9/site-packages/dora/explore.py", line 59, in complete
    sheep, slurm, job_array_index = future.result()
  File "/share/home/cgy/miniconda/envs/audiocraft/lib/python3.9/concurrent/futures/_base.py", line 446, in result
    return self.__get_result()
  File "/share/home/cgy/miniconda/envs/audiocraft/lib/python3.9/concurrent/futures/_base.py", line 391, in __get_result
    raise self._exception
dora.explore.ProcessException: MissingMandatoryValue('Missing mandatory value: channels\n    full_key: channels\n    object_type=dict')

Any suggestion will be very helpful.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant