Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for OPF (Open Photogrammetry Format) import #2246

Closed
abey79 opened this issue May 29, 2023 · 2 comments · Fixed by #2512
Closed

Support for OPF (Open Photogrammetry Format) import #2246

abey79 opened this issue May 29, 2023 · 2 comments · Fixed by #2512
Labels
enhancement New feature or request examples Issues relating to the Rerun examples

Comments

@abey79
Copy link
Member

abey79 commented May 29, 2023

Pix4D, a major player in the drone-based photogrammetry software, recently proposed an open datafile format for photogrammetry content called OPF:

OPF at its core is a specification for a flexible and extensible format that stores all of the data related to a reconstructed 3D model made with photogrammetry. This data includes information on both inputs and outputs of the photogrammetry process:

  • The input data includes information about the cameras used, their parameters, coordinate reference system, control points, the scale, and more.
  • The output data includes information about the camera calibration and the dense reconstructed point cloud.

OPF primitives appears to nicely match Rerun's, so it might be interesting to somehow support importing of these files. This could be (at least initially) done as a Python example, using Pix4D's provided library.

Such photogrammetric projects can sometime extend to 10+ million 3D points and 1000+ camera poses/images.
So, in addition to the intrinsic value of supporting an open data format, one possible motivation for such an effort could be to obtain real-world, stress-testing datasets.

@abey79 abey79 added enhancement New feature or request 👀 needs triage This issue needs to be triaged by the Rerun team labels May 29, 2023
@nikolausWest nikolausWest added examples Issues relating to the Rerun examples and removed 👀 needs triage This issue needs to be triaged by the Rerun team labels May 29, 2023
@abey79
Copy link
Member Author

abey79 commented Jun 12, 2023

This has been postponed due to errors with the only available example project, see Pix4D/pyopf#3.

OPF being very recent and not (yet) widely used, working on this should be delayed until:

  1. more demo projects are available (should be soon™️)
  2. a clear need for massive benchmarking/test project emerges

@abey79
Copy link
Member Author

abey79 commented Jun 23, 2023

emilk added a commit that referenced this issue Jul 2, 2023
…2512)

### What

Add a simple example to display Open Photogrammetry Format datasets


![](https://static.rerun.io/3bb25c43fa2a4c367d036c27943812ebfe3e4d42_open_photogrammetry_format_1200w.png)

This example is currently minimalist in that there is lots more in the
OPF that could be displayed, such as uncalibrated vs. calibrated
cameras, matches between points and cameras, etc. Also, I opted to
display each calibrated camera as individual frames in the timeline, as
displaying them currently spams the viewer with image views.

Closes #2246

Would greatly benefit from #1136
Blocked by #2244 

### Checklist
* [x] I have read and agree to [Contributor
Guide](https://github.com/rerun-io/rerun/blob/main/CONTRIBUTING.md) and
the [Code of
Conduct](https://github.com/rerun-io/rerun/blob/main/CODE_OF_CONDUCT.md)
* [x] I've included a screenshot or gif (if applicable)

<!-- This line will get updated when the PR build summary job finishes.
-->
PR Build Summary: https://build.rerun.io/pr/2512

<!-- pr-link-docs:start -->
Docs preview: https://rerun.io/preview/c1fd3e3/docs
Examples preview: https://rerun.io/preview/c1fd3e3/examples
<!-- pr-link-docs:end -->

---------

Co-authored-by: Emil Ernerfeldt <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request examples Issues relating to the Rerun examples
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants