mixed-reality
Color, light, and materials
Designing content for mixed reality requires careful consideration of color, lighting, and materials for all your virtual assets. Aesthetic purposes can include using light and material to set the tone of an immersive environment, while functional purposes can include using striking colors to alert users of an impending action. Each of these decisions must be weighed against the opportunities and constraints of your experience’s target device.
Below are guidelines specific to rendering assets on both immersive and holographic headsets. Many of these are closely tied to other technical areas and a list of related subjects can be found in the See also section at the end of this article.
Rendering on immersive vs. holographic devices
Content rendered in immersive headsets will appear visually different when compared to content rendered in holographic headsets. While immersive headsets generally render content much as you would expect on a 2D screen, holographic headsets like HoloLens use color-sequential, see-through RGB displays to renders holograms.
Always take time to test your holographic experiences in a holographic headset. The appearance of content, even if it’s built specifically for holographic devices, will differ as seen on secondary monitors or in snapshots. Remember to walk around experiences with a device, testing the lighting of holograms and observing from all sides (as well as from above and below) how your content renders. Be sure to test with a range of brightness settings on the device. It’s unlikely all users will share an assumed default, and a diverse set of lighting conditions.
Fundamentals of rendering on holographic devices
-
Holographic devices have additive displays – Holograms are created by adding light to the light from the real world – white will appear brightly, while black will appear transparent.
-
Colors impact varies with the user’s environment – There are many diverse lighting conditions in a user’s room. Create content with appropriate levels of contrast to help with clarity.
-
Avoid dynamic lighting – Holograms that are uniformly lit in holographic experiences are the most efficient. Using advanced, dynamic lighting will likely exceed the capabilities of mobile devices. When dynamic lighting is required, it’s recommended to use the Mixed Reality Toolkit Standard shader.
Designing with color
Because of the nature of additive displays, certain colors can appear different on holographic displays. Some colors will pop in lighting environments while others will appear as less impactful. Cool colors tend to recede into the background while warm colors jump to the foreground. Consider these factors as you explore color in your experiences:
-
Rendering light colors - White appears bright and should be used sparingly. For most cases, consider a white value around R 235 G 235 B 235. Large bright areas may cause user discomfort. For the UI window’s backplate, it’s recommended to use dark colors.
-
Rendering dark colors - Because of the nature of additive displays, dark colors appear transparent. A solid black object will appear no different from the real world. See Alpha channel below. To give the appearance of “black”, try a very dark grey RGB value such as 16,16,16.
-
Color uniformity - Typically holograms are rendered brightly enough so that they maintain color uniformity, whatever the background. Large areas may become blotchy. Avoid large regions of bright, solid color.
-
Gamut - HoloLens benefits from a “wide gamut” of color, conceptually similar to Adobe RGB. As a result, some colors can show different qualities and representation in the device.
-
Gamma - The brightness and contrast of the rendered image will vary between immersive and holographic devices. These device differences often appear to make dark areas of color and shadows, more or less bright.
-
Color separation - Also called “color breakup” or “color fringing”, color separation most commonly occurs with moving holograms (including cursor) when a user tracks objects with their eyes.
Technical considerations
-
Aliasing - Be considerate of aliasing, jagged or “stair steps” where the edge of a hologram’s geometry meets the real world. Using textures with high detail can aggravate this effect. Textures should be mapped and filtering enabled. Consider fading the edges of holograms or adding a texture that creates a black edge border around objects. Avoid thin geometry where possible.
-
Alpha channel - You must clear your alpha channel to fully transparent for any parts where you aren’t rendering a hologram. Leaving the alpha undefined leads to visual artifacts when taking images/videos from the device.
-
Texture softening - Since light is additive in holographic displays, it’s best to avoid large regions of bright, solid color as they often don’t produce the intended visual effect.
Design guidelines for holographic display
When designing content for holographic displays, there are several elements that you need to consider achieving the best experience. Visit Designing content for holographic display for the guidelines and recommendations.
Storytelling with light and color
Light and color can help make your holograms appear more naturally in a user’s environment and offer guidance and help for the user. For holographic experiences, consider these factors as you explore lighting and color:
:::row::: :::column:::
-
Vignetting - A ‘vignette’ effect to darken materials can help focus the user’s attention on the center of the field of view. This effect darkens the hologram’s material at some radius from the user’s gaze vector. This is also effective when the user views holograms from an oblique or glancing angle.
-
Emphasis - Draw attention to objects or points of interaction by contrasting colors, brightness, and lighting. For a more detailed look at lighting methods in storytelling, see Pixel Cinematography - A Lighting Approach for Computer Graphics.
Image: Use of color to show emphasis for storytelling elements, shown here in a scene from Fragments. :::column-end::: :::column:::
:::column-end::: :::row-end:::
Materials
:::row::: :::column::: Materials are crucial elements for making realistic holograms. By providing proper visual characteristics, you can make compelling holographic objects that can blend well with the physical environment. Materials are also important for providing visual feedback for the various types of user input interactions.
MRTK provides an MRTK Standard Shader with various visual effect options that can be used for visual feedback. For example, you can use ‘Proximity Light’ property to provide a lighting effect when the user’s finger is approaching the object’s surface. Learn more about MRTK Standard Shader
:::column-end:::
:::column:::
Video loop: Example of visual feedback based on proximity to a bounding box
:::column-end::: :::row-end::: <br>