READMEv5.0
Made with ❤️ by Felipe Galindo
An Open Source demonstration of photogrammetry in VR, made in Unity for Quest 2 & WebVR
Try the WebXR Build on a SteamVR headset!
https://UMN-VR.github.io/WebGL_Demo
(technically runs on a quest 2 as well, but not optimized & has significant performance issues due to wasteful software stack and completely unoptimized scene. )
Video of app v1.0: https://youtu.be/eQZTAWonZkg
The aim of this project is to create a virtual museum inspired on a real life one. Using the same artifacts but on you and improved virtual environment. This will give the U a global reach and cement the university's position as a pioneer in virtual reality.
At the present moment only Quest 2 native SDK & WebXR app builds are being provided since the project is just at the proof of concept stage. Eventually the idea is to release a WebXR build using Babylon.js not WebGL and host it on a domain so that everyone can access it regardless of platform.
The proof of concept project was created using Unity and it is likely that the same workflows and platforms will be used to make the final product, we will just be tweaking the specifics of it to improve the final result.
To open up the project all you need to do is have a current installation of:
- Unity v2021.1.3.1f1
If you want to edit 3d Models:
- Blender (Any version will work really, would recomend using latest avaliable.)
If you want to scan your own 3d Models
- Polycam (IOs App works better, would recomend using latest avaliable.)
You should create a copy of this repository structured as follows
VR-Photogrammetry/
│
├── Goldstein-Museum-of-Design-Photogrammetry-VR-Tour-App/
│ │
│ ├── Gifs
│ │
│ ├── Photogrammetry Quest SDK
│ │ ├─Assets
│ │ ├─Library
│ │ ├─Logs
│ │ ├─Packages
│ │ ├─ProjectSettings
│ │ ├─Test2.apk
│ │ ├─test3.apk
│ │ ├─test4.apl
│ │ └─UserSettings
│ │
│ ├── Photogrammetry WebXR
│ │ ├─Assets
│ │ ├─Export
│ │ ├─Library
│ │ ├─Logs
│ │ ├─Packages
│ │ ├─ProjectSettings
│ │ └─UserSettings
│ │
│ ├── Photogrammetry_Demo_v1.0.apk
│ │
│ └── README.md
git clone https://github.com/UMN-VR/Goldstein-Museum-of-Design-Photogrammetry-VR-Tour-App.git
This section attemps to be a full set of instructions to get a you up and running with the pre-complied .apk app
Try the WebXR Build on a SteamVR headset! https://UMN-VR.github.io/WebGL_Demo (technically runs on a quest 2 as well, but not optimized & has significant performance issues due to wasteful software stack and completely unoptimized scene. )
(NOT AVALIABLE YET)
- Enable Developer Mode On Quest.
- Install .apk to Quest via SideQuest
- Go to "Unknown Sources" in App menu
- Open "Photogrammetry Demo" App
Polycam is the photogrammetry app that was used to scan most of the 3D models.
VR Blaze (GoldyDogV4)
https://youtu.be/8dp5lvD6FZA
https://poly.cam/capture/BAF1E307-5185-48E4-866D-A84A12247B99
Robot Hand & Robot Hand Glove
Robot Hand:
poly.cam/capture/78286198-5910-468A-AC13-7C8DE018AFB0
Robot Hand Glove: poly.cam/capture/1810CB6D-5C9A-43F0-ADE3-848C0CCB610A
Mini 2:
poly.cam/capture/1810CB6D-5C9A-43F0-ADE3-848C0CCB610A
Air 2s With 360 camera:
poly.cam/capture/0CF75EFF-5A26-4E8A-AE91-CFA4F14639BB
RockM:
Goldy:
Quest 2:
Avaliable only for QuestSDK. App does not include any multiplayer or in game interactivity functionality is simply starts up the scene starts rendering the scene and never changes it.
⚠️ This version includes the following 32-bit only (armeabi-v7a) libraries: libMonoPosixHelper.so, libOVRPlugin.so, libOculusXRPlugin.so, libmain.so, libmemalign16.so, libmemalign16_cpp.so, libmono-native.so, libmonobdwgc-2.0.so, libopenxr_loader.so, libunity.so
Avaliable only for QuestSDK. App does not include any multiplayer or in game interactivity functionality is simply starts up the scene starts rendering the scene and never changes it. Replaced 32-bit libs with 64-bit for App Lab Submission.
Avaliable only for webXR. App does not include any multiplayer, but allows for in-game interactivity with cubes and a sphere. Themed Mozilla's 3D desert env to replace plane.
This is the software that allows for a unity environment to be packaged as a website plug-in that allows for a VR experience without installation of an application.
Allows for direct import of models created in shapesXR. After the models have been imported it is recommended to uninstall and remove the file located in assets since failing to doing so usually means you won't be able to build successfully.
If performance is lackluster polygon counts can be reduced through joining close together nodes to create a mesh with a smaller filesize. You can also trim unnecessary parts of the model that take up space and don't contribute to aesthetics. This is all done in blender.
Web GL is the render engine that allows WebXR to function. It is part of this software stack that will power the in-browser VR experience.
Actually scan museum artifacts.
TODO