The fastest path to building a HoloLens mixed reality app in Unity is with the Mixed Reality Toolkit. If you're brand new to Unity, we recommend that you explore the beginner level tutorials on the Unity Learn platform before continuing. It's also a good idea to visit the comprehensive Asset Store and the Unity Mixed Reality forums to engage with the online community building mixed reality apps. You never know what cool assets or solutions you might find out in the wild. When you're ready to get started with MRTK head to the development checkpoints below!
Important
Take a look at our porting guides if you have an existing Unity project that you want to bring over to HoloLens 2. We have guides for projects that are using HTK, MRTK v1, or SteamVR.
Unity generates these exceptions by embedding checks for them in the code, so this option decreases performance and increases browser memory usage. Only use this for debugging, and always test in a 64-bit browser. Select Publishing Settings to access Data Caching. Unity Center for Behavioral Health - Portland Oregon A revolutionary approach to behavioral and mental health emergencies. We are a 24-hour behavioral and mental health services center located in the greater Portland metropolitan area. We provide immediate psychiatric care and a path to recovery for people experiencing a mental health crisis.
Development checkpoints
Use the following checkpoints to bring your Unity games and applications into the world of mixed reality. If you haven't already explored the Designing Holograms sample application, we recommend downloading and using it to familiarize yourself with the basics of Mixed Reality UX.
1. Getting started
The easiest way to develop in Unity is with the Mixed Reality Toolkit. MRTK will help you automatically setup a project for Mixed Reality and provide a set of features to accelerate your development process. By the end of this section, you'll have a basic understanding of the Mixed Reality Toolkit, a properly configured development environment for Mixed Reality apps, and a working MRTK project in Unity that you built yourself.
Checkpoint | Outcome |
---|---|
Introducing the Mixed Reality Toolkit | Begin your journey by getting acquainted with the Mixed Reality Toolkit and what it has to offer |
Download the Mixed Reality Feature Tool | A new developer tool for discovering, updating, and adding Mixed Reality feature packages to your Unity projects |
Setup your developer environment | Download and install the latest Unity package and setup your project for mixed reality |
Complete the HoloLens 2 tutorial series | Dive into beginner level MRTK tutorials for HoloLens 2 hardware |
Important
If you'd like to create a new Unity project without importing Mixed Reality Toolkit, there are a small set of Unity settings you'll need to manually change for Windows Mixed Reality. Take a look at our configuration guide for more information.
Note
Once you've setup MRTK in your project, standard Unity game objects like the camera will light up immediately for a seated-scale experience. You can find instructions on changing the experience scale of your application on the coordinate systems page.
2. Core building blocks
All of the core building blocks for mixed reality applications are exposed in a manner consistent with other Unity APIs. These building blocks are available as standalone features and through the Mixed Reality Toolkit. You might not need all of them at once, but we recommend exploring early on. After diving into the core building blocks listed below, you'll have a toolbox full of features you can integrate into a Mixed Reality project by themselves or through MRTK.
Feature | Capabilities |
---|---|
Camera | Fully optimize visual quality and hologram stability in your Mixed Reality apps |
World locking and spatial anchors | Solve stabilization issues, camera adjustment, and integrate a stable coordinate system solution |
Shared experiences | View and interact collectively with the same hologram at a fixed point in space using spatial anchor sharing |
Gaze | Let users target holograms with by looking at them |
Motion controllers | Add spatial actions to your Mixed Reality apps |
Gestures | Use hand gestures as input in your Mixed Reality experiences |
Hand and eye tracking | Integrate articulated hand and eye tracking input into your user experience |
Spatial mapping | Map your physical space with a virtual mesh overlay to mark the boundaries of your environment |
Spatial sound | Enhance your apps with immersive 3D audio |
Text | Get sharp, high-quality text that has a manageable size and quality rendering |
Voice input | Capture spoken keywords, phrases, and dictation from your users |
3. Advanced features
Unity For Windows 7
Other key features that play a role in mixed reality applications are available through Unity APIs without any extra packages or setup. These features can be added to Unity projects with or without MRTK installed. After diving into the more advanced capabilities that Unity offers, you'll be able to build deeper, complex Mixed Reality apps.
Feature | Capabilities |
---|---|
Photo video camera | Capture photos and video content in your Mixed Reality application |
Focus point | Provide HoloLens a hint about how to best perform stabilization on the holograms currently being displayed |
Tracking loss | Handle scenarios where your device can't locate itself in the applications world space |
Keyboard input | Get input from real-world and Mixed Reality keyboards in your apps |
4. Deploying to a device or emulator
Best free movie download app for windows. Once you've got your holographic Unity project ready for testing, your next step is to export and build a Unity Visual Studio solution. With that VS solution in hand, you can run your application in one of three ways on a real or simulated device. By the end of this section, you'll be able to deploy your application on whichever device or emulator fits your development needs.
5. Adding services
At this point in your development journey you might be looking to add services or for a helping hand with commercial deployment. Integrating Azure Cloud Services and Dynamics 365 features can level up your projects in a major way. We've compiled a few starting points for you to explore and expand your Mixed Reality knowledge.
Azure Remote Rendering (ARR) is a service that lets you to render highly complex 3D models in real time. ARR is currently in public preview. It can be added to your Unity or Native C++ projects targeting HoloLens 2 or Windows desktop PC.
Azure Spatial Anchors (ASA) is a cross-platform service that allows you to build spatially aware mixed reality applications. With Azure Spatial Anchors, you can map, persist, and share holographic content across multiple devices, at real-world scale.
Microsoft Dynamics 365 Guides is a mixed-reality application for Microsoft HoloLens that lets operators learn during the flow of work by providing holographic instructions when and where they are needed. These instruction cards are visually tethered to the place where the work must be done, and can include images, videos, and 3D holographic models.
We also have a comprehensive list of support documentation for additional Azure services that you can add to your Unity projects on a self-serve basis.
What's next?
A developers job is never done, especially when learning a new tool or SDK. The following sections can take you into areas beyond the beginner level material you've already completed, along with helpful resources if you get stuck. Note that these topics and resources aren't in any sequential order, so feel free to jump around and explore!
Porting
If you have existing apps that you'd like to port over, the articles listed below are your next stop:
Tutorials
If you're looking to add specific Mixed Reality features to your applications, we have several curated tutorials that can run you through the process from end-to-end. Our most popular HoloLens 2 and HoloLens (1st Gen) content is listed below, but you can find the entire collection by visiting the tutorials overview.
Additional resources
Before going out into the world of mixed reality on your own, we recommend taking a look at the MRTK-related documentation listed below. These articles are great jumping off points for understanding how MRTK works in greater detail and will give you insight into making your app more performant.
Topic | Description |
---|---|
MRTK Architecture overview | Get a deeper understanding of how the MRTK SDK works in your projects |
Settings and performance | Profile your app, update your Unity settings, and get the best hologram stabilization performance available |
Getting started with MRTK + XR | Transfer over to the alternative XR pipeline provided by Unity |
Unity resources
In addition to this documentation available on docs.microsoft.com, Unity installs documentation for Windows Mixed Reality functionality alongside the Unity Editor. The Unity provided documentation includes two separate sections.
Resource | Description |
---|---|
Scripting reference | This section of the documentation contains details of the scripting API that Unity provides and is accessible online from the Unity Editor by clicking Help > Scripting Reference |
Manual | This manual is designed to help you learn how to use Unity, from basic to advanced techniques, and is accessible online or from the Unity Editor by clicking Help > Manual |
Have feedback?
You can find us on the Unity Forums by tagging Microsoft and a combination of the following tags to help us understand what plugin you're providing feedback for:
- HoloLens 2
- Windows Mixed Reality
- OpenXR
- XRSDK
- Legacy XR
Unity For Students
See also
Are you just starting out with Unity? Feeling a little overwhelmed? Don’t worry; you’ve come to the right place. Browse below and select the right learning path for you.
COVID-19 community support: Unity is committed to supporting our community of creators during this challenging time. Join Create with Code Live, a virtual course for students, teachers, or anyone interested in learning to code.
Learn Unity – the all-in-one creation tool
More than an engine, Unity gives you everything you need to develop quality content and succeed with it. Once you get the hang of it, it will be so rewarding.
Self-guided path to learning Unity
Get Unity and start creating your first game with our easy-to-use Microgame templates. Try the various fast and fun Creative Mods – they take about 10 minutes each – to personalize and share your game. And be sure to join a Microgame Group, so you can get help and connect with fellow beginners. We’ll keep you up-to-date on special announcements too!
Karting Creators
2D Platformer Creators
FPS Creators
The most fun way to learn Unity
Get Unity, then learn all the essentials of game development with Unity Game Dev Courses. Start with the fundamentals, then explore tracks in art, programming and game design. By the time you’re done, you’ll have built the amazing Swords and Shovels game!
Get Unity Game Dev Courses for $12/month
Subscribe
Get Unity Game Dev Courses FREE
Unity Game Dev Courses is included FREE with Unity Plus
Learn more
Learn faster with Unity Plus
Get Unity Plus — for hobbyists who want to accelerate their learning and development. With the Unity Plus 1 year prepaid plan, get these six valuable learning benefits:
Unity Game Dev Courses FREE
Learn all the essentials of game development with Unity Game Dev Courses ($144 value FREE). Start with the fundamentals, then explore tracks in art, programming and game design. When finished, you’ll have have built the amazing Swords and Shovels game!
20% off Asset Store
Iterate faster and publish sooner with top-rated assets and tools from the Unity Asset Store. With 20% off thousands of top-rated, best-selling assets, the finish line is closer than you dreamed.
Unity Success Advisor
Never feel stuck. As a subscriber, you will have exclusive access to a Unity specialist who can help you:
- Find diverse tools and resources to develop faster with Unity.
- Keep up-to-date with the newest features available with your subscription.
- Leverage your subscription services to supplement your development.