Magic Leap

Project Summary

Magic Leap Spacial Computing Integration Project.  This is an experimental display gallery to understand scale, positioning, and markup. 

This project contains Magic Leap compatible content viewable with the Helio browser.

Project Details

begin stove   end stove

begin clorox wipes end clorox wipes

begin salamander   end salamander

begin wind turbine wipes end wind turbine wipes

 

begin IRL microwave end IRL microwave

begin IRL dishwasher end IRL dishwasher

begin unused   end unused

begin IRL pipeline test end pipeline test

begin unused end unused

 

Why We are Making this Project

This is a project used to demonstrate and learn how to use spatial computing in everyday applications.  This project contains an evolving collection of objects that can be observed, extracted and placed using the Magic Leap One.  makeSEA is the premier content management and delivery platform for Magic Leap.  To learn more and become a beta user please Contact Us.

 

Other Experimental Projects:

Fluke Parts Project

Half Dome

Heating Infrastructure

Mammoth Mountain

MC Test

 

Topics Covered

This project focuses on content designed for delivery via the Helio browser using Prismatic scripting and markup.

Inputs

  • ML Remote
  • World Sensing
  • Wold Mesh with Occlusion

Design Practices

  • Headpose-based Object Placement
  • Near Clip Plane Exploitation*

Presentation

  • Helio Browser
  • Casting

*considered a spatial computing no-no and reality-breaker but, useful for certain technical applications

 

Working Notes

Useful Links

FUSION

gltf-viewer.donmccurdy.com

KhronosGroup/glTF: glTF – Runtime 3D Asset Delivery

three.js/GLTFLoader.js at r97 · mrdoob/three.js

Translate a Source File into OBJ Format | Model Derivative API | Autodesk Forge

https://myminifactory.github.io/stl2gltf/

CAD Forum - overview of CAD formats - conversion assistant

Yet Another Conversion Chart

sbtron/makeglb: Convert glTF to glb

https://myminifactory.github.io/Fast-Quadric-Mesh-Simplification/

meshconv

glTF Viewer

glTF Model Converter c/o Cesiumjs.org uses:

gollada2gltf

obj2gltf

gltf-pipeline

 

requires (notes are fuzzy on build fixes but should be correct)

GLTF for Unity

try OOTB build first, if errors:

in order for this to build on mac with unity env the scripts with names including Test need to be moved under directory named "Editor":

move /Assets/Resources/*Test* /Assets/Editor

move /Assets/Unity/Scripts/Tests/*Test* /Assets/Unity/Scripts/Tests/Editor (dir should already exist()

 
notes:
 
(older; may be better options; was used for CAD from mfg I think)
dwg -> fusion360 import -> fxb -> gtlf
http://52.4.31.236/convertmodel.html
 
for STL:
(works but requires human):
STL->OBJ (meshconv) -> Unity -> light/textrure -> glTF -> glb (gltf-pipeline)
working (experimental):
use obj2gtlf to get direct from obj to glb with light/texture embedded (as .mtl); we are having issues getting good result on MLOne
alt attempt:  try getting to fbx instead using Blender and command line w/script, ref:
 
photogrammetry compare notes:
3DF Zephyr
AutoCad Recap Pro
Agisoft PhotoScan
 
 
Stove Appliance Notes
  • Works well with photos even if the photos are a little bit blurry.
  • Once the sparse point cloud is created, the next best thing to do is to change the bounding box to just your subject. In this case a stove. That way it will be able to still use the background noise to help create the dense point cloud, but all of the points outside of the bounding box will n
  • 3DF Zephyr takes a long time to extract photos from the video. 
    • At 1 frame per second capture rate, the program was able to obtain 87 photos from the video that is 01:23 minutes long.
    • Out of those 87 photos only BLANK were able to be used.
    • I was able to increase this number to 70 by changing the sparse cloud from default to deep.
  • Sparse point cloud and the dense point cloud created from just taking photos are a lot more detailed with less holes when creating the mesh

 

Experience Overview
Enter text...

 

Walkthrough
Enter text...

 

Final Takeaways
Enter text...

 

Suggested Next Steps
Enter text...

 

Average (2 Votes)

Assets
Related Assets