Windows Mixed Reality supports apps across a wide range of experience scales, from orientation-only and seated-scale apps up through room-scale apps. On HoloLens, you can go further and build world-scale apps that let users walk beyond 5 meters, exploring an entire floor of a building and beyond.
Your first step in building a mixed reality experience in Unity is to understand coordinate systems and choose the experience scale your app will target.
Namespace: UnityEngine.XR
Type: XRDevice
To build an orientation-only or seated-scale experience, you need to set Unity to the Stationary tracking space type. Stationary tracking space sets Unity’s world coordinate system to track the stationary frame of reference. In the Stationary tracking mode, content placed in the editor just in front of the camera’s default location (forward is -Z) will appear in front of the user when the app launches.
XRDevice.SetTrackingSpaceType(TrackingSpaceType.Stationary);
Namespace: UnityEngine.XR
Type: InputTracking
For a pure orientation-only experience such as a 360-degree video viewer (where positional head updates would ruin the illusion), you can then set XR.InputTracking.disablePositionalTracking to true:
InputTracking.disablePositionalTracking = true;
For a seated-scale experience, to let the user later recenter the seated origin, you can call the XR.InputTracking.Recenter method:
InputTracking.Recenter();
Namespace: UnityEngine.XR
Type: XRDevice
For a standing-scale or room-scale experience, you’ll need to place content relative to the floor. You reason about the user’s floor using the spatial stage, which represents the user’s defined floor-level origin and optional room boundary, set up during first run.
To ensure that Unity is operating with its world coordinate system at floor-level, you can set and test that Unity is using the RoomScale tracking space type:
if (XRDevice.SetTrackingSpaceType(TrackingSpaceType.RoomScale))
{
// RoomScale mode was set successfully. App can now assume that y=0 in Unity world coordinate represents the floor.
}
else
{
// RoomScale mode was not set successfully. App cannot make assumptions about where the floor plane is.
}
Once your app successfully sets the RoomScale tracking space type, content placed on the y=0 plane will appear on the floor. The origin at 0, 0, 0 will be the specific place on the floor where the user stood during room setup, with -Z representing the forward direction they were facing during setup.
Namespace: UnityEngine.Experimental.XR
Type: Boundary
In script code, you can then call the TryGetGeometry method on the UnityEngine.Experimental.XR.Boundary type to get a boundary polygon, specifying a boundary type of TrackedArea. If the user defined a boundary (you get back a list of vertices), it’s safe to deliver a room-scale experience to the user, where they can walk around the scene you create.
[!NOTE] The system will automatically render the boundary when the user approaches it. Your app doesn’t need to use this polygon to render the boundary itself. However, you may choose to lay out your scene objects using this boundary polygon, to ensure the user can physically reach those objects without teleporting:
var vertices = new List<Vector3>();
if (UnityEngine.Experimental.XR.Boundary.TryGetGeometry(vertices, Boundary.Type.TrackedArea))
{
// Lay out your app's content within the boundary polygon, to ensure that users can reach it without teleporting.
}
Namespace: UnityEngine.XR.WSA
Type: WorldAnchor
For true world-scale experiences on HoloLens that let users wander beyond 5 meters, you’ll need new techniques beyond those used for room-scale experiences. One key technique you’ll use is to create a spatial anchor to lock a cluster of holograms precisely in place in the physical world, no matter how far the user has roamed, and then find those holograms again in later sessions.
In Unity, you create a spatial anchor by adding the WorldAnchor Unity component to a GameObject.
To add a world anchor, call AddComponent<WorldAnchor>() on the game object with the transform you want to anchor in the real world.
WorldAnchor anchor = gameObject.AddComponent<WorldAnchor>();
That’s it! This game object will now be anchored to its current location in the physical world - you may see its Unity world coordinates adjust slightly over time to ensure that physical alignment. Use persistence to find this anchored location again in a future app session.
If you no longer want the GameObject locked to a physical world location and don’t intend on moving it this frame, then you can just call Destroy on the World Anchor component.
Destroy(gameObject.GetComponent<WorldAnchor>());
If you want to move the GameObject this frame, you need to call DestroyImmediate instead.
DestroyImmediate(gameObject.GetComponent<WorldAnchor>());
GameObject’s cannot be moved while a World Anchor is on it. If you need to move the GameObject this frame, you need to:
DestroyImmediate(gameObject.GetComponent<WorldAnchor>());
gameObject.transform.position = new Vector3(0, 0, 2);
WorldAnchor anchor = gameObject.AddComponent<WorldAnchor>();
A WorldAnchor may not be locatable in the physical world at a point in time. If that occurs, Unity won’t be updating the transform of the anchored object. This also can change while an app is running. Failure to handle the change in locatability will cause the object to not appear in the correct physical location in the world.
To be notified about locatability changes:
The OnTrackingChanged event will be called whenever the underlying spatial anchor changes between a state of being locatable vs. not being locatable.
anchor.OnTrackingChanged += Anchor_OnTrackingChanged;
Then handle the event:
private void Anchor_OnTrackingChanged(WorldAnchor self, bool located)
{
// This simply activates/deactivates this object and all children when tracking changes
self.gameObject.SetActiveRecursively(located);
}
Sometimes anchors are located immediately. In this case, this isLocated property of the anchor will be set to true when AddComponent<WorldAnchor>() returns. As a result, the OnTrackingChanged event won’t be triggered. A clean pattern would be to call your OnTrackingChanged handler with the initial IsLocated state after attaching an anchor.
Anchor_OnTrackingChanged(anchor, anchor.isLocated);
Use Azure Spatial Anchors to create a durable cloud anchor from a local WorldAnchor, which your app can then locate across multiple HoloLens, iOS and Android devices. By sharing a common spatial anchor across multiple devices, each user can see content rendered relative to that anchor in the same physical location. This allows for real-time shared experiences.
To get started building shared experiences in Unity, try out the 5-minute Azure Spatial Anchors Unity quickstarts.
Once you’re up and running with Azure Spatial Anchors, you can then create and locate anchors in Unity.
If you’re following the Unity development checkpoint journey we’ve laid out, you’re in the midst of exploring the Mixed Reality core building blocks. From here, you can continue to the next building block:
[!div class=”nextstepaction”] Gaze
Or jump to Mixed Reality platform capabilities and APIs:
[!div class=”nextstepaction”] Shared experiences
You can always go back to the Unity development checkpoints at any time.