[question] How do I use the pipeline "Photogrammetry and Camera Tracking"

[oGrqpez]

Describe the problem
I noticed the pipeline "Photogrammetry and Camera Tracking" and wanted to use it since I wanted to make a model and get a camera track simultaneously. Trouble is, it has 2 camerainit nodes. What do I put where? Using the same photo set in both nodes causes me to crash at the ImageMatchingMultiSFM node.

Screenshots

Desktop (please complete the following and other pertinent information):

• OS: Windows 10 Pro
• Python version: 3.10
• Meshroom version: please specify if you are using a release version or your own build
  • Binary version: 2023.1.0

[natowi]

I think it is supposed to work with live reconstruction. However, in the 2023.1 release there is this bug #2070
Good thing: 2023.2 is in preparation, hopefully fixing the issue

[cbentejac]

Hi @oGrqpez,

The first CameraInit node is meant to be set with your input images for the photogrammetry part, and the second with your images for the tracking part.

Please note that this pipeline is experimental so you might not get incredible results.

However, as @natowi mentioned, the 2023.2 release is on its way with an improved (and less experimental) "Photogrammetry and Camera Tracking" template. The CameraInit nodes on this template are labeled with the inputs you're supposed to feed them with, so hopefully it'll be far easier to use!

[bhack]

I don't understand why in #2033 the calibration checkboard node is mandatory.

[cbentejac]

Hi @bhack, the calibration of the distortion is not mandatory.

It is merely part of the template because if the checkerboard can be provided, then the results will be better. If you have no checkerboard to provide, you can simply remove these nodes from the graph (or the connection between the DistortionCalibration node and the ApplyCalibration node; the ApplyCalibration node works even if it hasn't been provided with calibration information).

As for @oGrqpez's initial question, with Meshroom 2023.2.0, the pipeline now has three CameraInit nodes, labeled as follows:

• "InitPhotogrammetry", which is meant to be set with the images for the photogrammetry.
• "InitLensGrid", which should be provided with the checkerboard (if it exists) for the distortion calibration. If no calibration grid is available, then the group of nodes (or the connection to ApplyCalibration) can be removed.
• "InitShot", which is meant to be set with the images for the tracking.

I hope this clears things up!