Magic Leap
Project Summary
Magic Leap Spacial Computing Integration Project. This is an experimental display gallery to understand scale, positioning, and markup.
This project contains Magic Leap compatible content viewable with the Helio browser.
Project Details
begin stove
begin clorox wipes
begin salamander
begin IRL microwave
begin IRL dishwasher
begin unused
Why We are Making this Project
This is a project used to demonstrate and learn how to use spatial computing in everyday applications. This project contains an evolving collection of objects that can be observed, extracted and placed using the Magic Leap One. makeSEA is the premier content management and delivery platform for Magic Leap. To learn more and become a beta user please Contact Us.
Other Experimental Projects:
InstallationInstructions-W10631155-RevA.pdf
Topics Covered
This project focuses on content designed for delivery via the Helio browser using Prismatic scripting and markup.
Inputs
- ML Remote
- World Sensing
- Wold Mesh with Occlusion
Design Practices
- Headpose-based Object Placement
- Near Clip Plane Exploitation*
Presentation
- Helio Browser
- Casting
*considered a spatial computing no-no and reality-breaker but, useful for certain technical applications
Working Notes
Useful Links
KhronosGroup/glTF: glTF – Runtime 3D Asset Delivery
three.js/GLTFLoader.js at r97 · mrdoob/three.js
Translate a Source File into OBJ Format | Model Derivative API | Autodesk Forge
https://myminifactory.github.io/stl2gltf/
CAD Forum - overview of CAD formats - conversion assistant
sbtron/makeglb: Convert glTF to glb
https://myminifactory.github.io/Fast-Quadric-Mesh-Simplification/
glTF Model Converter c/o Cesiumjs.org uses:
requires (notes are fuzzy on build fixes but should be correct)
try OOTB build first, if errors:
in order for this to build on mac with unity env the scripts with names including Test need to be moved under directory named "Editor":
move /Assets/Resources/*Test* /Assets/Editor
move /Assets/Unity/Scripts/Tests/*Test* /Assets/Unity/Scripts/Tests/Editor (dir should already exist()
notes:
(older; may be better options; was used for CAD from mfg I think)
dwg -> fusion360 import -> fxb -> gtlf
http://52.4.31.236/convertmodel.html
for STL:
(works but requires human):
STL->OBJ (meshconv) -> Unity -> light/textrure -> glTF -> glb (gltf-pipeline)
working (experimental):
use obj2gtlf to get direct from obj to glb with light/texture embedded (as .mtl); we are having issues getting good result on MLOne
alt attempt: try getting to fbx instead using Blender and command line w/script, ref:
photogrammetry compare notes:
3DF Zephyr
AutoCad Recap Pro
Agisoft PhotoScan
Stove Appliance Notes
- Works well with photos even if the photos are a little bit blurry.
- Once the sparse point cloud is created, the next best thing to do is to change the bounding box to just your subject. In this case a stove. That way it will be able to still use the background noise to help create the dense point cloud, but all of the points outside of the bounding box will n
- 3DF Zephyr takes a long time to extract photos from the video.
- At 1 frame per second capture rate, the program was able to obtain 87 photos from the video that is 01:23 minutes long.
- Out of those 87 photos only BLANK were able to be used.
- I was able to increase this number to 70 by changing the sparse cloud from default to deep.
- Sparse point cloud and the dense point cloud created from just taking photos are a lot more detailed with less holes when creating the mesh
Converting STL to FBX through Command Prompt
- Install Blender and change the initial start up to have nothing in it
- Delete the initial cube then save the space as the start up
- Save the convert_stl_to_fbx.py from the assets of this project to the folder Blender under Blender Foundation.
- In the command prompt navigate to the same folder as above, then input the following:
blender --background --python convert_stl_to_fbx.py -- test.stl test.fbx
- Where the test.stl will be the location of the stl file you wish to convert, and test.fbx will be the location of the converted file.
Experience Overview
Enter text...
Walkthrough
Enter text...
Final Takeaways
Enter text...
Suggested Next Steps
Enter text...
