Catapult and makeSEA allow anyone to share and collaborate using 3D content produced by most 3D design platforms. The App requires Magic Leap One goggles to launch. To publish content to Magic Leap and use the Catapult App you must first do the following:

  1. Register with makeSEA and Create a Project.
  2. Go to the native platform where you have created 3D content and export it in GLB format. Add these exported assets to the Project you have created in makeSEA.
  3. Add team members to your project and set your preferred sharing mode to Private, Public, etc. See Section 5-Saving Your Project Page – for more information on these settings.

IMPORTANT:  Asset sharing in Catapult will not work if the Project is in Draft mode.  Please be sure the Project you wish to share is set to Private, Member, or Public mode before proceeding.

___________________________________________________________________________

Version 2.0c New Features!

Save your work:
The layout and placement of assets in the Project collaboration space can be saved by the Master of Ceremonies.  Participants joining or returning to the space can choose to restore the layout to the last saved state for all placed and scaled objects.  This is perfect for staging and dressing any space for others to visit, any time in the future:  for education, demonstration and training, creative, or marketing purposes, etc.  An option to periodically auto-save the layout is available in menu under General Settings.  Just upload your content, joint Catapult and layout your space, and save it for reuse.  Done!

Blow stuff up!
Objects with multiple layers can now be exploded (expanded into their constituent parts – not a fiery explosion), by using the laser to shoot the “Explode” button displayed above the object:  hold the Trigger to expand, release to stop.  Depending on the source file, individual parts can be manipulated by placing your Control inside the part, pulling and holding the Trigger, and dragging the part; let go of the Trigger to release the object.  Shoot the “Return” button to reset the object to its original state.

Labels and Descriptions:
Assets now display label names and description details.  Asset names are derived from the asset Title, as stored in makeSEA, without the file name extension (e.g., “.glb”).    Clicking on the label will toggle the display of the details for the asset if they exist in the asset’s record in makeSEA.  The sub-part names are displayed when the object is Exploded.  The sub-part names are derived from the name of the part as stored in the asset file, itself.  For example:  if you have an asset with the name “Wind Turbine.glb”, which has sub-parts in the model, the label for the asset will be displayed as “Wind Turbine”.  Clicking on the label will toggle the display of the detailed description for the asset, if it exists.  If the asset has parts embedded, like “propeller” for example, the name of each part will be displayed when the asset is Exploded, and the details will fade away.

Livestream Video support is here!
You can use makeSEA’s Remote Presence workflow and video streaming services along with Catapult spatial collaboration and a 360 surround camera to produce realtime remote co-presence/remote hands support for any location.  DASH (.mpd indexed), and HLS (.mu38 indexed) livestream video in screen and 360 surround format is now supported by adding a Remote Asset to the Project that points to the livestream source and is designated with the string “livestream”or “livestream_360″ or    livestream_autoplay_360 in the Description field when creating the Remote Asset link.  The option to play the video is listed under the Catapult menu along with any other video assets available in the active Project collaboration space that you are in.  Designating ‘livestream_autoplay_360” in the Remote Asset Description will cause the livestream surround video to begin playing automatically when a user joins the space.

360 surround video auto-play is now supported
The first listed video for any project ending in “_autoplay_360.mp4” will automatically play when a user joins the project collaboration space.  This is great for setting a mood, giving the participants context, or as ambient content for mood or effect.

Support for collaborative measuring added
Look for the tape measure tool icon under General Settings.  Select the icon with the laser and pull the trigger to place a tape measure in the collaboration space.  The tape can be moved by grabbing the center of the tape tool, or by moving the end points by placing your Control inside the ball at either end, holding the Control Trigger, and dragging.  Release the Trigger to place each end point at each end of the desired location to measure.  The endpoints can also be manipulated by looking at them and using the Control Pad gestures to move the endpoint from a distance.  The length of the tape is indicated above the line towards the center.  It can also be used as a trajectory marker.  You can use multiple tape measures.  All participants see the tape measure and resulting measurement.

___________________________________________________________________________

Now you are ready to download the Catapult App. The first screen you will see is shown below. Remember before you can use the app you must have completed the steps outlined in Red.

SETTING THE ANCHOR

The Anchor may be set in two ways.

1.On the first screen you will also be asked to set an anchor for your collaboration space. Follow the on-screen instructions and when you are ready, using the controller, point at the “Set Anchor” button and pull the trigger.

Or the Anchor may be set by using the Anchor Image shown below.

  1. Download the image here: https://www.makesea.com/anchor and print the page, preferably on an 8.5″ x 11″ paper.
  2. Follow the instructions on the printed page to determine the placement for your Catapult App.
  3. Start Catapult on the Magic Leap and follow steps 3 and 4 to set the Anchor.

After setting the Anchor for your collaboration space you will login to Catapult using your makeSEA credentials. Using the controller point at the Login to makeSEA button and pull the trigger.

This will take you to the keyboard to enter your makeSEA credentials. After entering the username and password credentials for makeSEA point the controller and choose the Login button.

Note on the Login keyboard: Use Shift key if your login information requires capital letters. Server Settings button is only used to change the URL for Corporate/Enterprise clients.

If you are an Enterprise client and have chosen the Server Settings button you will see the screen below where you will enter your unique URL and then continue by choosing the Back to Login button.

Note that on login screen the Exit Sign will appear if you click on the gears in the upper left hand corner. This will exit you from the application.

BASIC CONTROLS TO BE FAMILIAR WITH

There are some basic controls that will help you understand how to navigate in the application when you open a project.

  1. Conjure settings by making a fist in front of you. Then click the gear to fix the settings in place.
  2. You will be prompted to anchor your environment before proceeding. The head of the virtual conference table serves as the anchor.
  3. The bookshelf (or grid) of viewable objects in a conference space is to the right of the head of the table.
  4. If more than 6 objects are checked in, the bookshelf will allow the Master of Ceremonies (MC), to paginate through them and take other participants along.  Become MC to change bookshelf pages by displaying the Settings and clicking on the Control located near the Settings Gears.  A blue Control indicates you are the MC.
  5. Objects will grow slightly when moved from the bookshelf for better visibility. All participants can manipulate the objects in a scene. Use one of two methods to do this.

a. Place controller inside the object, pull and hold the trigger, and drag the object to a desired location. Release the trigger to leave the object where placed.

OR

b. Focus your eyes on the object you want to move. Use the Control Pad located at the top of the controller to manipulate the object.

I.   Press up/down to push/pull the object

II.  Press left/right to move the object side to side

III. Swipe up/down to move the object up or down

IV. Make a circle gesture to rotate the object

V.  Swipe left/right to shrink or enlarge the object

Shown below is an example of the assets in a project on the “bookshelf” or grid.

AFTER LOGIN

After login user will see My Project List as shown below. This shows all projects the user is a member of. To view the 3D assets for a project aim the controller at the project and pull the trigger. Choose a project to join a common collaboration space. Only team members can join projects marked as Private. 3D assets are displayed on a bookshelf and can be manipulated with the controller.

The arrow in the upper right corner will refresh the page. You may go to Public Projects by choosing the button on the bottom right hand corner.

Public Projects are visible to all users. On this screen you will also see a Showcase section that highlights projects that wow! This screen may also be accessed by clicking on the gears in the upper left hand corner and choosing Public Projects. To view the 3D assets for a project aim the controller at the project and pull the trigger. Again the assets will appear on a bookshelf.

After choosing a project to view the following two images will appear in sequence.

VIDEO STREAMING SUPPORT

Catapult allows the Master of Ceremonies to select from a list of compatible videos stored with any makeSEA Project in .MP4 format for display onto a placeable and scalable screen that all participants can view. 360 surround videos are also supported and may be played to wrap the project collaboration space in immersive video content.  A resolution of 720p or 1080p is recommended for on-screen video.  Surround video of up to 1.5K (1536 x 3072px, mono, spherical panoramic), is supported. Project video files should be uploaded with a file name extension “.mp4”.  Videos with a name including “_360.mp4”, are assumed to be surround videos by Catapult. Videos are selectable by the Master of Ceremonies from the Settings menu, which can be conjured by making a fist in front of your face.

SETTINGS

In the upper left hand corner of most screens you will see the gear icon. Clicking on this allows access to various settings as shown below.

Below is the screen you will see if you click on the Example tab under Settings. Choose the appropriate tab to view each. Use the back button to return to the settings tabs.

Screen depicting the General settings tab under Settings.

Help screen below is loaded from settings tab by clicking Help under Settings. By clicking on the detailed instructions you open a page on makeSEA.com with more detailed instructions.

Also under the Help tab you can view the Privacy Policy screen by clicking on the Privacy Policy link shown above. Please read the screen instructions visible when you click on the Privacy Policy button. These instructions are shown below.

You may exit Catapult temporarily or disconnect from the conference by choosing the Exit tab in settings. There are several ways to quit the application.

The Exit sign looks like the one below. This sign also appears at the foot of the table in your conference space when a user makes a fist over the Gears icon.

When you choose to Quit Catapult at any time. You will get a screen that looks like the one below. You can choose to Quit the application or Return to the previous screen from here.

MARK UP CONTENT FOR HELIO BROWSER AND MAGIC LEAP

The makeSEA Content Editor features a Magic Leap Prismatic markup tool that can be used to apply Prismatic display transforms and animations to content that is observable using the Magic Leap Helio Web browser when visiting the project page.

You can upload GLB, GLTF, and FBX models to the project (with or without textures), and use this tool to markup the object on the Project page so that it floats in space, spins, moves, animates, etc.

Once assets are added and marked up using the editor, visit the project page URL (or shortcut) from the Helio Web Browser on the Magic Leap device to interact with the content using standard Helio interactions (pick off the page, place, scale, rotate, etc.).

GLB formatted assets (compressed GLTF+bin packages), are ideal for use in makeSEA because they work across the broadest set of workflows.  GLBs can also be previewed in a standard Web browser by clicking on the details link for the asset.  GLTF 2.0 and GLB are rapidly becoming the standard for cross-platform packaging of 3D objects with materials, metadata, shading, and other features.

The preferred settings for most 3D authoring applications on save/export are:

  • GLB (binary) format
  • GLTF format version 2.0 compatible
  • Embed all textures and materials when asked
  • Use double-sided walls when asked
  • Defaults scales work for most applications but if incorrect try order of magnitude +/- (e.g., 10x, 100x)
  • Some CAD and BIM platforms may require swapping the default exported axis (usually Z)
  • Try the default scale on export and adjust as needed; results will vary by source application and version

If your 3D authoring tool of choice does not support GLB natively, there may be a plugin you can install. Check the authoring tool’s app store, or, for more information on available plugins, applications, and conversion tools please see:

GLTF/GLB Supported Applications & Tools

If you are seeking support for a specific file format, we may be able to help.  Please email support@makesea.com and let us know your requirements.  We’ll do our best to help.

Suggestion:  Set the Helio Browser to Dark Mode for transparent display of articles “kiosk style”.  Try playing with font colors and object transformations to create floating information displays above real world objects that persist in space, even between Magic Leap shutdown/restarts.

CKEditor MLImport Guide

Overview of the MLimport Plugin:

Allows for the easy importation and manipulation of ml-model object

The mlimport plugin is designed to allow for the easy importation and manipulation of ml-model objects for insertion into a page.

Clicking the button located in the wysiwyg

Opens up the plugin:

There are four tabs that contain attributes for the ml-model:

  • Basic – contains basic information about the ml-model and quick access to commonly changed attributes
  • Style – contains attributes related to basic css styling  and ml-model specific styling to alter the location, size, and color of the model.
  • Static Transforms – contains transformation attributes that are applied when the model is initialized, such as an initial rotation.
  • Animated Transforms – contains transformation attributes that are applied over time, like the spinning of a model over a set duration.

BASIC TAB: includes some of the required attributes and a lot of attributes that are frequently changed.

The attributes include:

  • Name – If an image thumbnail is not selected, the name is inserted:name

    this is to allow for the easy selection/deletion of the ml-model and to mark where on the page the model is located.

  • Id – The Id, when used in conjunction with the raycast boolean, identifies the object for use in a node raycast event
    <ml-model
      id="balloon"
      src="balloon.fbx"
      style="width: 300px; height: 300px; position: absolute; right: 50%; top: 50%;"
      raycast="true">
    </ml-model>
    <script>
      balloon.addEventListener('node-raycast', function (e) {
        ...
      });
    </script> 
  • Source URL – this is the source that will be displayed in the ml-model. Currently supported file formats are .fbx and .glb . Clicking the browse server button allows for navigation through projects and assets for selection of the source url.
  • Image Thumbnail URL – This property overrides the name for use in allowing the easy selection/deletion of the ml-model and marking of where the model is located on the page.
  • Visible – this checkbox allows the toggling of the ‘visibility’ attribute. When checked, visibility is set to ‘visible’ and when unchecked visibility is set to ‘hidden’
  • Scrollable – this checkbox allows the toggling of the ‘scrollable’ attribute. The ‘scrollable’ attribute only renders model when scrolling through the viewport when set. Disabled by default. Ml-models with “scrollable=’true'” are only rendered when they are currently in the viewport and they stick to where they are at on the page. With “scrollable=’false'” the ml-model will scroll with the viewport.
  • Raycast – this checkbox is used in conjunction with the id attribute. See https://creator.magicleap.com/learn/guides/prismatic-raycast for more details
  • Extractable – this checkbox is a boolean that enables the model to be pulled out of the page and placed in the user’s environment. Checked: true, unchecked: false.
  • Extractable Scale – The extracted scale is a number which allows the user to pass in a multiplier with the extracted model that will scale the model once extracted.

STYLE TAB: The style tab contains attributes related to basic css styling and ml-model specific styling to alter the location, size, and color of the model.

Attributes:

  • Width – css attribute controlling the size along the x-axis.
  • Height – css attribute controlling the size along the y-axis.
  • Breadth – ml-model attribute controlling the size along the z-axis. If there is no breadth specified the model matches the size along the x-axis. The value of breadth could be in pixels (px), centimeters (cm) or millimeters (mm) units.
  • Left, Right, Top, Bottom, Position – all css attributes controlling the location of the model.
  • Z-offset – Controls how far off the page the model will appear. By default, models are positioned forward on the z-axis. You should provide a:
    • positive value to position the model more towards the user
    • negative value to position the model away from the user

The value of z-offset supports pixels (px), centimeters (cm) or millimeters (mm) CSS measurement units.

  • RGBA – This allows you to set the red-green-blue-alpha value for the ml-model. RGB values range from 0-255 and the alpha value should be a float from 0 to 1. Red goes in rgba R, green in rgba G, and so on.
CSS AttributeNotes
width/heightsupports any CSS measurement units
positionsupport any CSS measurement units
top/bottom/left/rightuse negative values to offset from page

STATIC TRANSFORMS TAB: The static transforms tab contains transformation attributes that are applied when the model is initialized, such as an initial rotation. Each attribute contains an X,Y, and Z value.

Attributes:

  • Model-scale – Sets the model scale within the Prism. By default model scale is calculated to be the maximum size of the Prism.
  • Model-position – Sets the model position within the Prism. By default the model position is set to
  • Prism-rotation – Rotate the prism by a specified amount of degrees.
  • Rotation – Sets the model rotation within the Prism using Euler Angles.

ANIMATED TRANSFORMS TAB: The animated transforms tab contains transformation attributes that are applied over time, like the spinning of a model over a set duration. Each attribute has an x,y,z property, duration property, and track property.

Tracks:

Tracks allow you to queue your animations.

  • If you want your animated transforms to run sequentially, place them on the same track (for example, track 1).
  • If you want your animations to run simultaneously, place them on separate tracks (for example, track 1, track 2, and so on).

Attributes:

  • move-to – Move the model within the Prism to the specified position (x,y,z) over the set duration.
  • move-by – Move the model within the Prism by the specified position (x,y,z) over the set duration
  • rotate-by-angles – Rotates the model over time by the specified angles.
  • scale-to – scales the model over time by the specified scalar over the duration.
  • spin – spins the model on the axes specified with a 1. If you want to spin relative to the y-axis, “x y z” would be “0 1 0”. My understanding is that the degrees is the amount of degrees spun per second.
Attribute NameParametersUsage
move-tooffset, duration, trackmove-to=”offset: 200px 100px -100px; duration: 5s; track: 1;”
move-byaxes, duration, trackmove-by=”axes: 0 90px 300px; duration: 5s; track: 1;”
scale-toaxes, duration, trackscale-to=”axes: 0.5 0.5 0.5; duration: 3s; track: 1;”
spinaxes, angle, duration, trackspin=”axes: 1 1 1; angle: 360deg; duration: 3s; track: 1;”
rotate-by-anglesangles in radians, duration, trackrotate-by-angles=”angles: 0 1.57 0; duration: 5s; track: 1;”
rotate-by-anglesangles in degrees, duration, trackrotate-by-angles=”angles: 0 90deg 0; duration: 5s; track: 1;”

EDITING: When an ml-model is placed on the page, you are able to right click it to edit any attributes you wish. The mlimport plugin will be populated with the same attributes as before and if they are changed a new ml-model will be inserted in its place.

Helpful links:

Prismatic API reference: https://creator.magicleap.com/learn/reference/public/v0.16.0/UIKit/index.html

Prismatic guide: https://creator.magicleap.com/learn/guides/prismatic-positioning-quads-and-scrollable-content

More information on the specific Prismatic transform controls and their impact to display is available here:

Magic Leap Prismatic Transform Controls

 

makeSEA Mixed Reality Workflow File Compatiblity Matrix

Your makeSEA Project space supports any file type for storage, versioning, and tracking. For live asset sharing (when not using a makeScene package), the best performance and forward compatibility is usually the GLB format, which can easily be saved from your favorite 3D design tool.  The following formats are compatible with XR collaboration using Catapult:

Application/InterfaceSource File FormatSupported Object Complexity
(varies by XR client device)
 GLB
(export from any)
GLTF
(animated)
FBXOBJSTLPDFLive/Rec
Video
360 Skybox
Video
Native/AnyLow Poly
(10K)
Med Poly
(100K)
High Poly
(100M+)
Catapult Live Publishing
(release 2.0C)
XConvert to
GLB
XXX XXYes-contact
makeSEA
XX 
Catapult OTA
makeScene package*
XXXXX XXYes-contact
makeSEA
XXX
Helio Browser
(Prismatic)
XXX XXX Yes-contact
makeSEA
X 
Any Web ClientPreview,
Storage,
Versioning (P,S,V)
P,S,VP,S,VP,S,VP,S,VP,S,VP,S,VP,S,VP,S,VXX