Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

For Audio Only .mp4 / .mov the generic audio wave gif is not extracted #90

Closed
IAmVigneswaran opened this issue Jan 30, 2024 · 13 comments
Closed
Assignees
Labels
bug Something isn't working
Milestone

Comments

@IAmVigneswaran
Copy link
Contributor

I just noticed that with audio only .mp4 / .mov files our generic audio wave .gif is not extracted out. Only the .json and icons are extracted out.

This was possible on our earliest build.

audio-only

SH Script

$TOOL_PATH "$FCPXML_PATH" "$OUTPUT_DIR" --export-format notion --image-format gif --result-file-path $RESULT_JSON --log-level debug --log $ERROR_LOG

Attached animated gif.
audio-wave.gif.zip

@IAmVigneswaran IAmVigneswaran added the bug Something isn't working label Jan 30, 2024
@IAmVigneswaran IAmVigneswaran added this to the 0.3.4 milestone Jan 30, 2024
@orchetect orchetect self-assigned this Feb 20, 2024
@orchetect
Copy link
Contributor

Do you mean when the generated media file for use with MarkersExtractor has no video track and only has an audio track?

With 0.3.3:

  • PNG thumbnails seem to work fine. I ran a test with an audio-only clip. Markers output the placeholder wave image.
  • Using GIF thumbnails it's not finding any video frames and fails to create the gif file. This looks to be a bug and should output the placeholder wave animation.

@orchetect
Copy link
Contributor

I may have found the issue. It's correctly using the placeholder animation but it may be trying to request frames that don't exist (ie: at a time corresponding to the original timeline and not offset to the placeholder video's start).

@IAmVigneswaran
Copy link
Contributor Author

Do you mean when the generated media file for use with MarkersExtractor has no video track and only has an audio track?

Yes. Just Audio in the Primary Storyline. Without any video.

PNG thumbnails seem to work fine.

PNG thumbnails seem to work.

This looks to be a bug and should output the placeholder wave animation.

Only the pre-rendered GIFs are not extracted.

@orchetect
Copy link
Contributor

orchetect commented Feb 20, 2024

Further debugging - seems like a thread related issue. The file is actually being written, but the operation never completes so the file remains a hidden temporary file.

AudioOnly.json
.marker-placeholder.gif-ts63
icon-marker.png

@IAmVigneswaran
Copy link
Contributor Author

Interesting!

@orchetect
Copy link
Contributor

orchetect commented Feb 20, 2024

Further narrowing down. Seems to be a regression in the way the image converter handles images that don't exist in a source video.

(We don't actually store a hard-coded gif file of the audio wave in the executable. It's a small 40KB 1-second long .mov file that the executable is converting to a gif file at the respective input dimensions and settings.)

@IAmVigneswaran
Copy link
Contributor Author

(We don't actually store a hard-coded gif file of the audio wave in the executable. It's a small 40KB 1-second long .mov file that the executable is converting to a gif file at the respective input dimensions and settings.)

I believe this was possible in our earlier much builds before your major refactor of codebase.

Much like our marker Icons, we could store and hardcode the GIF within the code?

@orchetect
Copy link
Contributor

orchetect commented Feb 20, 2024

we could store and hardcode the GIF within the code

There's no point, the above explains why our current implementation is preferable. Also, the generated gif file tends to be much smaller than the full-resolution 431KB gif file.

@orchetect
Copy link
Contributor

This should be fixed for next release 0.3.4. Needs some testing to see if typical project conversions still work as expected.

@IAmVigneswaran
Copy link
Contributor Author

This should be fixed for next release 0.3.4. Needs some testing to see if typical project conversions still work as expected.

Just did a quick test with test-build.

Seems to be working. Thank you!

audio-only-test

Will test further with other timelines.

@IAmVigneswaran
Copy link
Contributor Author

I just tested with a Test Build of Marker Data

For some reason, it is not working.

When building, I assume it is pulling the latest changes from this repo?

@orchetect
Copy link
Contributor

orchetect commented Feb 27, 2024

When building [Marker Data], I assume it is pulling the latest changes from this repo?

No, it's taking the latest release.

@IAmVigneswaran
Copy link
Contributor Author

Noted!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants