Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to get depth data from TrueDepth & Lidar❓ #2134

Closed
3 of 4 tasks
IvanByRool opened this issue Nov 6, 2023 · 9 comments
Closed
3 of 4 tasks

How to get depth data from TrueDepth & Lidar❓ #2134

IvanByRool opened this issue Nov 6, 2023 · 9 comments
Labels
💭 question Further information is requested

Comments

@IvanByRool
Copy link

Question

Hey,

Don't know if it's doable or if someone can help me.

I'm trying the example lib on my iPhone 13 Pro (With Lidar & TrueDepth front cam) in order to get the depth data.
My Goal is to reconstruct in 3D an object based on depth data provided by the cameras.
I want to try TrueDepth & Lidar to evaluate accuracy.

First question : How can I get depth data from the picture ?
Second question : From a Frame, in Frame Processor ?

What I tried

The example App is running

  1. I saved a picture taken with the right cam (Lidar or TrueDepth) saved it in my mac and open it (couldn't find depth data)
  2. I tried to log data from Frame in the FrameProcessor without success.

VisionCamera Version

3.6.4

Additional information

@IvanByRool IvanByRool added the 💭 question Further information is requested label Nov 6, 2023
@IvanByRool
Copy link
Author

Up ;)
do someone have a working example of this I can use ?
thx

@ionflow
Copy link

ionflow commented Jan 4, 2024

I have the same question. Also on an iPhone 13 Pro, although I am using Expo.

@ionflow
Copy link

ionflow commented Jan 4, 2024

Aha! I see the Camera component has enableDepthData.

@mrousavy
Copy link
Owner

Hey! You should be able to access this data on the native side in a Frame Processor Plugin. I think depth data should be attached to the Frame, if not that'd be a small change on my end. If you need help with this, consider contacting us through my agency: https://margelo.io

@Jrh0203
Copy link

Jrh0203 commented Feb 22, 2024

@ionflow were you eventually able to access depth data from the frame in a frame processor? Trying to access the depth data now myself as well!

@bugra-az
Copy link

Hi, was the issue resolved? Why it is closed? I could not see the solution here.

@joekendal
Copy link

+1

@BenjaOliva
Copy link

Any news here ? 👀

@mrousavy
Copy link
Owner

😉 #3328

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
💭 question Further information is requested
Projects
None yet
Development

No branches or pull requests

7 participants