Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update the logic to fetch pixel format from filter graph #3479

Closed
wants to merge 1 commit into from

Conversation

mthrok
Copy link
Collaborator

@mthrok mthrok commented Jul 14, 2023

When using GPU decoder in some environments, attempting to read the output formats from filter graph caused an issue in which the software pixel format cannot be determined.

We do not know the exact cause but when it happens, the input link of buffer sink does not have HW frames context.

Since currently no filter can convert the pixel format of CUDA frame, we resort to the HW frames context of the output link of buffer source.

Environments this was observed.

Env1

  • OS: Fedora 36 (x86_64)
  • GCC 12.2.1
  • Python 3.10.12
  • GPU: GeForce RTX 3070 Ti Laptop GPU
  • FFmpeg: 5.1.3
  • nv-codec-header: n11.1.5.2
  • CUDA: 12.1

Env2

  • Ubuntu 20.04.4 LTS (x86_64)
  • GCC 9.4.0
  • Python 3.11.3
  • GPU: Quadro GV100
  • FFmpeg: 5.1.3
  • nv-codec-header: n11.1.5.2
  • CUDA: 11.4

When using GPU decoder in some environments, attempting to read the
output formats from filter graph caused an issue in which the software
pixel format cannot be determined.

We do not know the exact cause but when it happens, the input link of
buffer sink does not have HW frames context.

Since currently no filter can convert the pixel format of CUDA frame,
we resort to the HW frames context of the output link of buffer source.

- V100,       CUDA 11.4, libavfilter 8.44.100, ffnvcodec 11.1.5.2
- RTX3080 Ti, CUDA 12.1, libavfilter 8.44.100, ffnvcodec 12.0.16.0
@pytorch-bot
Copy link

pytorch-bot bot commented Jul 14, 2023

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/audio/3479

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures

As of commit 72ef2d1:

NEW FAILURES - The following jobs have failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@mthrok mthrok marked this pull request as ready for review July 14, 2023 20:13
@facebook-github-bot
Copy link
Contributor

@mthrok has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

@facebook-github-bot
Copy link
Contributor

@mthrok merged this pull request in cf53a48.

@github-actions
Copy link

Hey @mthrok.
You merged this PR, but labels were not properly added. Please add a primary and secondary label (See https://github.com/pytorch/audio/blob/main/.github/process_commit.py).


Some guidance:

Use 'module: ops' for operations under 'torchaudio/{transforms, functional}', and ML-related components under 'torchaudio/csrc' (e.g. RNN-T loss).

Things in "examples" directory:

  • 'recipe' is applicable to training recipes under the 'examples' folder,
  • 'tutorial' is applicable to tutorials under the “examples/tutorials” folder
  • 'example' is applicable to everything else (e.g. C++ examples)
  • 'module: docs' is applicable to code documentations (not to tutorials).

Regarding examples in code documentations, please also use 'module: docs'.

Please use 'other' tag only when you’re sure the changes are not much relevant to users, or when all other tags are not applicable. Try not to use it often, in order to minimize efforts required when we prepare release notes.


When preparing release notes, please make sure 'documentation' and 'tutorials' occur as the last sub-categories under each primary category like 'new feature', 'improvements' or 'prototype'.

Things related to build are by default excluded from the release note, except when it impacts users. For example:
* Drop support of Python 3.7.
* Add support of Python 3.X.
* Change the way a third party library is bound (so that user needs to install it separately).

@mthrok mthrok deleted the fix-cuda-filter-graph branch July 15, 2023 18:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants