Point Transformer

[Erhushenshou]

Hi, really awsome work! I have few confusions to figure out. Does Point Transformer require pretraining on large dataset first? Or can your pipeline work on self supervised tasks directly?

[ChenYutongTHU]

Hi, thanks for your interest in our work.
We did not pre-train point transformer on other datasets before training it on our objaverse/shapenet-OOD dataset.
However, it may be worth trying to initialize it from the PointTransformer-v3 checkpoint pretrained with multi-dataset point prompt training. (Paper, Checkpoint)

Self-supervised learning is an interesting topic which extends beyond the scope of this work. Here is a related recent work.

[Erhushenshou]

I mean self-supervised here to be the case we only use 3D Gaussian Splatting to reconstruct a single 3D object or scene. Is point transformer beneficial to this task?

[ChenYutongTHU]

Hi. This is an interesting approach, though we didn't try it. We only experimented with using point transformer to predict 3DGS in a feed-forward manner :)