Overview - How to set up & Operate MixCast

Thanks for your interest in MixCast!

This manual contains all the information you should need to get MixCast up and running on your machine, as well as a number of helpful tips and resources to get the most out of your setup.

  • First up will be getting MixCast installed and your License Key and any cloud setup connected in the Install and Connect section!
  • Then follow up with the basic MixCast configuration in the Getting Started section!
  • When you’re ready to begin operations, visit the Operating MixCast section!
  • If you run into trouble, the Additional Information and Troubleshooting sections contain resources and information to help you resolve any issues you may be experiencing with MixCast.
  • And finally, for a rundown of MixCast’s configurable options, the Settings Reference has a complete list including detailed descriptions.

Supported Hardware

MixCast is powerful software that connects your VR system, your computer, and as many physical cameras as you want together, to produce the best content available from immersive experiences. Below are some recommendations about what hardware works best with MixCast so you can rest assured that the platform will work for you.

VR Headset

SteamVR  On SteamVR
HTC Vive/Vive Pro
Oculus Rift
Dell Visor
HP WMR Headset
Lenovo Explorer
Samsung HMD Odyssey
Asus WMR Headset
Oculus Rift S (in 2.3.4+)
Oculus Quest Link (in 2.3.4+)
HTC Vive Cosmos (in 2.3.4+)
Oculus  On Oculus
Oculus Rift
Oculus Rift S (in 2.3.4+)
Oculus Quest Link (in 2.3.4+)

PC Hardware

Capturing footage of a VR experience requires some extra performance from your computer. Before getting started, check that your machine meets the general recommended specs for running MixCast. Note that actual performance requirements are dependent on the active VR experience and your quality settings.

Operating System
Windows 8 or 10 (64-bit)
Processor
Either:
- Intel i3-6100 or greater
- AMD FX4350 or greater
Memory
8+ GB RAM
Graphics Card
Either:
- NVIDIA 960 or greater
- AMD Radeon RX 570 or greater

Cameras and Video Inputs

Depth Cameras
✔️ Intel RealSense D415
✔️ Intel RealSense D435/D435i
✔️ Azure Kinect DK (experimental)
Webcams
✔️ AUSDOM AW615
✔️ GUCEE HD92
✔️ Logitech C270
✔️ Logitech C920
✔️ Logitech C922 Pro
✔️ Logitech C930
✔️ Logitech C930e
✔️ Logitech BRIO
✔️ Microsoft Lifecam HD-3000
✔️ PAPALOOK PA187
✔️ Razer Stargazer
✔️ Sony PXW-Z90V
Capture Cards
✔️ AverMedia ExtremeCap 3
✔️ AverMedia Live Gamer C985
✔️ AverMedia Live Gamer HD 2
✔️ Elgato Cam Link
✔️ Elgato HD60 S
✔️ Elgato HD60 Pro
✔️ Elgato 4K60 Pro
✔️ Razer Ripsaw
✔️ Blackmagic DeckLink Mini Recorder 4K

Note: Ensure that you have a Capture Card compatible camera; we recommend Elgato’s search tool to check.

Software Inputs
✔️ XSplit Broadcaster
✔️ OBS VirtualCam
✔️ DroidCam

Install and Connect

 

In order to use MixCast you will have to download and install it first.

Then you will need to activate your License Key.

Finally, if you are running the VR Photobooth system for VR Arcades, you will need to connect MixCast to the Cloud.

Download and Install MixCast

 

First you need to download MixCast.

MixCast Download

 

You then need to install MixCast. When doing the installation, you may get a Windows system warning. If so, click More Info.

Then click Run anyway

 

Finally, launch MixCast by selecting Run Mixcast in the Windows Start Menu.

Activate License Key

 

Once you have MixCast installed and running, you will need to register your MixCast version by entering your license key, which will be in the email you received from Blueprint with your MixCast arcade information.

Look for the MixCast Status Window, it is most likely in the bottom corner of your main monitor.

You have two choices:

a) Selecting Enter Key will allow you to enter your key and activate.

b) If you do not have a key, you can click on Register Now and select for which version you would like a key.

 

After clicking Enter Key, the following will appear. Select Activate your license.

 

Then select Activate Online.

 

Enter your key into the Activation Key box and click Activate license key

 

If you have used a valid key, you will be shown the “Your license is activated.” message. Click on Finish to continue.

 

You will then see the MixCast Status Window update, likely changing to this state:

At this point you’re ready to begin configuring MixCast’s settings.

Connecting to the Cloud

Arcade installations with a MixCast Arcade license can utilize the MixCast Cloud to store, view and sell mixed reality media created with MixCast! To do this you will need to configure your desktop installation of MixCast with your unique arcade URL.

Note that before you can configure the Cloud settings, you must have already entered the MixCast Configuration app to set up media production.

  1. Receive your MixCast arcade information e-mail from Blueprint which includes your arcade’s unique MixCast Cloud URL. This will usually be in the format:
    https://your-org.mixcast.cloud/kiosk
  2. Launch MixCast on any PC you want to upload media to MixCast Cloud for viewing and purchase. Note that you must have a license offering this functionality (Generally an “Arcade” license).
  3. Click the Settings wheel and choose Open Preferences.

4. In the Cloud section, enter the full URL of your Cloud instance as described in step 1.

Now you can configure any remaining sections of your MixCast installation and start capturing media! Screenshots and videos will now automatically be uploaded to your MixCast Cloud for purchase and viewing.


a) Optionally, you can choose whether Local Content should be deleted after upload. Leaving this unchecked allows you to keep your media on the PC’s hard drive, but you will need to ensure that the hard drive does not become full.

b) [Beta Feature] You can select to display a Media Code when MixCast starts. Customers can scan the QR code to be presented with the delivery flow for that session’s media

Kiosk Setup

Connect the Kiosk to Your MixCast Cloud

The kiosk is very easy to set up. Effectively you just open a browser and point it at the Kiosk URL we’ve provided in your MixCast arcade information e-mail from Blueprint.

This should be in the format of https://yourarcadename.mixcast.cloud/kiosk

Once your Kiosk is set up, customers can use the Kiosk interface to select and purchase media.

Browser Selection

If using a touchscreen Kiosk, we have found Firefox to work the best as we find it easier to move between fullscreen mode and back than with Google Chrome.

If using a desktop and mouse, any browser will do. With tablets, you will need to experiment with which browser works best, as we have found tablets and their browsers to vary in their functionality.

 

Getting Started

 

This section will guide you through MixCast’s setup process, which is broken down into 3 steps:

  1. Setting up your input device(s).
  2. Performing Camera Alignment / Quick Setup to align your camera(s).
  3. Calibrate background removal using our WildKey technology.

Once set up, using MixCast is as easy as launching your target VR application(s)!

Input Device Selection

 

Mixed reality requires a real-world camera to put you in the VR scene! MixCast works with a large number of consumer webcams, video cameras and capture cards, so let’s dive into how to configure your input device now!

  • Hook up your camera to your PC and ensure the hardware’s drivers are up-to-date (a restart may be required if they were just installed)
  • Launch MixCast by selecting Run MixCast from the Start Menu
  • Select Configure MixCast by first clicking the Gear icon in the MixCast Status Window

  • Select the Configure Camera button in the top right
  • Select the Input Device section
  • Select your device from the Device Name drop down
  • Select your camera’s resolution from the Input Resolution drop down

Tip: Go into your camera settings and make sure auto exposure, auto white balance, and auto focus are disabled. These will interfere with your ability to remove your background!

Tip: Make sure to disable any on-screen indicators on your camera otherwise your battery indicator could show up in the MixCast output!

Tip: If you like, you may also change the displayed name of your MixCast Camera in the Customize Camera Name field.

Note: Cameras will sometimes support higher resolutions but at lower framerates. Experiment with different resolutions to find the best option for your videos.

 

Once your camera image is being seen in MixCast, you can proceed to configuring background removal.

Camera Alignment / Quick Setup

 

MixCast needs to know where your camera is in the real world so it’s aligned with your virtual camera. This is a core part of making mixed reality work and capturing your video from the right perspective in the VR scene.

  1. If not already running, launch MixCast by selecting Run MixCast from the Start Menu
  2. Select Configure MixCast by first clicking the Gear icon in the MixCast Status Window

3. There are two ways to start the Quick Setup process.

a) You can enter quick setup via a button in the Camera Settings -> Camera Tracking menu. After clicking Run Quick Setup in VR you will need to put on your headset.

b) Directly put on your VR Headset.

 

Once in VR, locate your virtual camera in the VR scene. Hint: it’s probably right in front of you.

Point your tracked controller at the Quick Setup button located below the camera and press the Trigger to start the Quick Setup process.

Follow the prompts in VR

Note: The first step of Quick Setup is the most important – make sure your controller is centered and right up against the lens of your camera.

Note: The Quick Setup process automatically determines the FOV of your camera.

Tip: If you want more precision in your alignment, select the “+” button instead of the green check mark after hitting the crosshairs. You’ll be presented with more crosshairs to further refine your alignment.

Warning: If you change the lens or zoom of your camera the FOV will no longer match the virtual camera and you’ll need to run Quick Setup again.

Once you have completed quick set-up, there are a couple of other things you should do to refine your video input.

  1. Changing the delay amount
    Delay amount is a variable that allows users to sync up their VR processing speed with their camera’s buffering speed.  Depending on your camera and computer, there is bound to be some disparity between when your VR System recognizes your movement, and when your camera shows your movement. Buffered mode delays the camera’s feed of the controllers, this way you can make the controllers sync up with your video feed!
  2. (Advanced) Track your camera
    This step requires either a 3rd controller, or external trackers (like Vive trackers). If you wish to track your camera, you will then be able to move your camera while recording Mixed Reality. Camera Tracking is not compatible with Depth Cameras at this point in tine. If you want to know how to allow your camera to change perspective during filming, proceed to Camera Tracking.

Background Removal

 

In order to integrate our reality into virtual reality, the visuals from our camera feed need to remove the background so the subject appears to be in the virtual space. We have several ways of going about this available in the Wildkey menu.

 

Option 1: Chromakeying

If you have a green screen or blue screen your best option is most likely Chromakeying. This process removes specific colors, of your choice, from the background. Chromakeying tends to give the highest quality of output, at the expense of requiring the most specialized setup, and allows you to quickly and easily isolate the player when the background is a different color.

  1. Open the Camera Settings -> WildKeyTM menu.
  2. Enable the Chromakeying toggle.
  3. Click the Calibrate button to bring up the Calibration Panel.

  1. Click the Sample Background (Hold) button, then anywhere on your feed to remove that color. You can hold down to paint out areas of color.
  2. When you are satisfied with the result, click the Close Calibration button.

Tip: Use Ctrl-Z or click the undo button if you accidentally key the wrong color, or click the Reset Calibration button to start from scratch.

Tip: You can adjust the Fade Falloff, Desaturation Tolerance, and Desaturation Falloff in the advanced options back in the WildKeyTM menu.

Option 2: Fixed Background

Fixed Background works best when your background has more than one color. This process takes a snapshot of your background (without the subject present) and ‘subtracts’ it from the video. When the subject steps back in front of the camera they appear because they differ in color and lightness from the background behind them.

  1. Open the Camera Settings -> WildKeyTM menu
  2. Enable the Fixed Background toggle
  3. Click the Calibrate button to bring up the Calibration Panel.

  1. Make sure you are not visible in the scene, the click the Sample Background (Hold) button. Wait for about 10 to 20 seconds until sampling is sufficient.
  2. When you move back into view of your camera you should be visible, minus the background. Click Close Calibration when you are satisfied with the result.

Tip: You can perform multiple samples of static subtraction to improve the quality of the background removal.

Note: Tracked cameras are not supported when using static subtraction.

 

Option 3: Fixed Depth

Fixed Depth will be covered in the Using Depth Sensing Cameras section.

 

Additional Options

Additional Options 1: Depth Cutoff

Depth Cutoff will be covered in the Using Depth Sensing Cameras section.

 

Additional Options 2: Edge Cropping

While not a removal method of its own, Edge Cropping is a powerful tool to help refine your background removal by isolating the outer edges of the captured area and ensuring they have 100% background removal. As the subject is frequently centered in the scene, this setting can be useful because it allows you to avoid worrying about any edges of your background that have stuck around while not compromising the integrity of the subject’s removal!

  1. Open the Camera Settings -> WildKeyTM Menu
  2. Enable Edge Cropping toggle
  3. All the settings are initially to 0% cutoff.
  4. To increase the cut-off, you can adjust the padding within Left, Right, Top, and Bottom fields.

Tip: This method of scene modification works well with any other variant of background removal.

Additional Options 3: Subject Boxing

While not a removal method of its own, Subject Boxing is a very powerful tool to help refine your background removal by isolating any area surrounding the player’s controllers and HMD. This setting is particularly useful because it allows you to avoid worrying about any corners of your background that have stuck around while not compromising the integrity of the subject’s removal!

  1. Open the Camera Settings -> WildKeyTM Menu
  2. Enable Subject Boxing toggle
  3. Observe the initial settings and how they work with your current removal set-up.
  4. If you feel like the cut-off is too tight or too small, you can adjust the padding within the Head, Hands and Feet fields.

Tip: This method of scene modification works well with any other variant of background removal.

Using Depth Sensing Cameras

MixCast now comes with the capability to incorporate depth information from select supported cameras into the mixed reality production pipeline (specifically for no-greenscreen background removal for now). This post contains information on how to access this functionality.

Supported Hardware

Prerequisites

Plug your camera into a USB 3.0 port on your computer. If your computer is a distance greater than 3′ away from the camera’s intended position, you must use an Active Powered USB 3.0 Extension Cable to ensure reliable device connectivity (here’s an example).

Install drivers/software associated with the depth camera. Be sure to restart the computer after installing new software. Not installing this software will cause MixCast not to fully recognize the camera.

  • For the RealSense, the link is on this page and is titled “Download SDK for Windows 10”
  • For the Azure Kinect, the link is on this page and is titled “Windows Installer”

Test that your hardware setup is functioning fully by running the camera maker’s software (Intel RealSense Viewer or Azure Kinect Viewer) and ensuring that both the color and depth streams can be made visible.

Instructions

  • If not already running, launch MixCast by selecting Run MixCast from the Start Menu
  • Select Configure MixCast by first clicking the Gear icon in the MixCast Status Window
Input Device Configuration
  1. Open the Camera Settings menu
  2. Open the Input Device section
  3. Select the Device Name drop-down and choose the name of your depth camera (eg: “Intel RealSense D430”)
  4. Adjust the Gain, Exposure, and White Balance sliders below to your liking

 

Fixed Depth Configuration

This option in WildKey scans the visible environment while no-one is in it and then displays parts of the feed that are in front of that scan. This is the best all-round background removal method since it conforms to the scene your camera is placed in. It does however require that you scan the scene beforehand and leave the camera in a fixed position.

  1. Open the Camera Settings menu.
  2. Open the WildKey section.
  3. Enable the checkbox on the Fixed Depth checkbox.
  4. Click the Calibrate button to bring up the Calibration Panel.

  1. Hold down the Sample Background button for 10-20 seconds.
  2. Close the Calibration screen.
  3. Adjust the Outline Blend, Outline Size, and Blur Effect options to produce the clearest results.

 

Depth Cutoff Configuration

Another important technique for removing the background is a feature called Depth Cutoff. This enables you to set a minimum and maximum distance in meters from the camera where the feed should be cut off, meaning even a crowd in the background can be removed. Note that enabling this feature also hides any areas of the image where no depth information can be determined which is generally desired with a depth camera.

Troubleshooting

  • If you’re having trouble accessing the camera’s images, the computer isn’t detecting the device, or your VR headset isn’t performing correctly while MixCast is running, your computer may be low on USB bandwidth, and could benefit from a PCI USB card. Try “spreading out” where USB cables are plugged in across different groups of ports.

Camera Tracking

Allowing your camera to move while filming mixed reality adds an additional requirement to your MixCast setup: tracking your camera’s location via an affixed tracked device (such as a controller or VR tracking object). Thankfully, the additional MixCast setup requirements are minimal!

Instructions
  1. Launch MixCast by selecting Run MixCast from the Start Menu.
  2. Select Configure MixCast by first clicking the Gear icon in the MixCast Status Window.
  3. Select the Configure Camera button in the top right.
  4. Open the Camera Tracking section.
  5. Select the device listed in the Tracked By dropdown which is physically attached to your camera (eg: “Tracker 1”).

Note: You can run Quick Setup to align the camera either before or after assigning the Tracked By field.

Note: The physical connection between the tracked device and the camera should be as secure and rigid as possible.

Note: If using a 3rd Vive controller, SteamVR requires that it’s connected to the PC via USB cable, not wirelessly.

 

Using Multiple Cameras

MixCast supports the configuration and use of as many cameras as you want (hardware performance permitting) as of MixCast 2.0.

Adding a New Camera

In MixCast Studio, select the + button next to the camera name at the top of the Main Menu. This spawns a new camera to configure in the scene.

Navigating Between Cameras

Switching which camera is displayed on the desktop is easy; just click the left or right arrow at the top of the Main Menu.

Configuring Each Camera

The Camera Settings menu is accessed through the button at the top right of the Main Menu. Whichever camera is being displayed on the desktop is the one which is start being configured. The arrow buttons in the header of the menu will cycle which camera is shown.

Watching Multiple Cameras

To view multiple MixCast camera outputs simultaneously, you can enable Splitscreen View from the button from the MixCast Status Window.

This displays up to 4 cameras from your configuration at once. You can cycle which camera is shown in each quadrant via the arrow buttons next to each camera name.

Outputting from Multiple Cameras

MixCast supports recording and streaming from multiple cameras simultaneously, so long as your hardware and/or internet connection is powerful enough to support it. Just configure automatically starting recordings/streaming, or select the video recording/streaming options manually from the UI for each camera.

Operating MixCast

Once you’ve configured your MixCast setup, you’re free to start creating awesome content in your favorite applications! Here’s the short list of instructions to activate MixCast for the application:

  1. Run the VR application you’d like to create content from within.
  2. (Optional) If you’ve opted not to have MixCast start automatically, launch MixCast manually by either:
    • Selecting “MixCast/Run MixCast” from the Start Menu.
    • Launching MixCastService.exe from Program Files/MixCast/Service (or your custom installation path)

That’s all it takes! You should now see MixCast’s output on the desktop (and in your In-VR preview window). You can now also switch between any supported application at this point and have MixCast output follow without any additional work.

Tip: You can find a growing list of verified MixCast-ready applications here.

Tip: If you’d like to stop producing MixCast output, you can close MixCast by Right-clicking the MixCast icon in the Windows system tray and selecting “Quit MixCast”.

Note: Titles using older versions of the MixCast SDK may require manually activating MixCast by clicking on the MixCast logo in the corner of the application’s desktop window, or pressing CTRL+M while the desktop window is selected.

Now all that’s left is to capture/broadcast your content to share with the world!

Viewing Output In-VR

Since MixCast creates your mixed reality output in realtime, you also have the ability to preview the output as it’s generated, both on the desktop and in VR

When viewing the output in VR, you should see a floating window above the model of your configured cameras. 

You can adjust the screen’s position in MixCast configuration by pointing at the screen with your controller and then squeezing the trigger and holding it to drag the screen around. This position will persist across titles so pick a comfortable position!

Note: If the screen is left just above the camera, it will move with the camera, which is handy when using a tracked camera!

To toggle the display of the MixCast output in VR, click on the Display icon in the MixCast Status window and select the Show/Hide In-VR Display option. 

 

Applying Automatic Branding

Sometimes the need arises to include branding assets in the photo or video content being generated by MixCast and shared, such as a streamer applying a graphic to their stream or an arcade venue applying their logo to photos being created. MixCast includes the ability to specify this branding image once and have all future content have this image applied in the bottom right of the output upon generation.

Instructions
  1. Place your branding image as a PNG in My Documents\MixCast\Config
  2. Rename the image to branding.png (to apply the image in the bottom-right corner) or branding_large.png (to apply the image full-screen)
  3. Now launch MixCast Configuration or a supported title to see your branding being applied!

Capturing First Person Footage

MixCast doesn’t just make it easy to create third person footage (mixed reality or virtual); it also can be configured to capture high-quality first person footage as well.

Why is MixCast the best option for capturing first person footage?

  • Image resolution and quality is headset-independent
  • MixCast provides one-click recording, streaming, and screenshots
  • Head motion can be smoothed in the presented view
Instructions
  1. Open MixCast Studio and select the MixCast Camera you want to use
  2. Open the Camera Settings menu
  3. Open the Camera Tracking section
  4. Click the Tracked By drop-down and select Headset
  5. Reset the Position Offset and Rotation Offset using the buttons on the right
  6. Adjust the Rotation Smoothing to achieve the desired effect on the head motion

Example of First Person camera smoothing

Recording and Streaming

Now that MixCast is generating the desired visual output, you can learn more about how to capture that content and share it with the world! Don’t worry, MixCast makes sure saving content is as straightforward as possible!

Note: Content saved/shared through MixCast is produced at the resolution configured in the Camera Settings/Output menu.

Snapshots

A snapshot is a still image of the MixCast output being produced. You can trigger taking a snapshot manually with the Take Screenshot button on MixCast’s main menu.

Auto Snapshots

If you want snapshots to be captured without any user input, you can optionally enable automatic snapshot capture. This feature triggers taking a snapshot periodically, with the time between snapshots configured by the user. You can toggle this feature with the Auto Snapshot button on MixCast’s main menu. This feature can be active on each MixCast camera.

Note: If you want this feature to be active any time you’re using MixCast, you can enable Begin capturing snapshots on MixCast start in MixCast Studio under Camera Settings/Recording.

Video Recording

Videos can be captured with ease through MixCast. You can trigger the start and stop of video recording for a specific camera with the Enable/Disable Recording button on MixCast’s main menu.

Note: The quality (bitrate) of the captured video can be customized in MixCast Studio under Camera Settings/Recording.

Note: If you want to be recording video any time you’re using MixCast, you can enable Begin recording on MixCast start in MixCast Studio under Camera Settings/Recording.

Note: You can view your recordings by pressing the Open Recordings Button

Video Streaming

MixCast makes it easy to stream video to your favorite streaming platform. You can trigger the start and stop of video streaming for a specific camera with the Enable/Disable Streaming button on MixCast’s main menu (once configured in MixCast Studio).

Configuring streaming can be done either globally or per-camera, depending on if you need each configured camera to stream to a different endpoint. If so, configuration is done under Camera Settings/Streaming, otherwise it’s done in Global Settings/Streaming. Select your streaming platform, then provide the necessary info (stream URL and/or key).

Note: The quality (bitrate) of the streamed video can be customized in MixCast Studio under Camera Settings/Streaming.

Note: If you want to be streaming video any time you’re using MixCast, you can enable Begin streaming on MixCast start in MixCast Studio under Camera Settings/Streaming.

Additional Information

If you’re having issues getting the output from MixCast that you expect, this section may contain information to get your issue resolved!

No or Solid Grey Camera Image

If you aren’t able to see your input device’s image once it has been selected in MixCast Studio, ensure that:

  • If this is the first time your camera/capture card has been plugged into your computer, that you have restarted the computer to ensure all changes (driver installation/updates) have been applied.
  • No other programs are accessing the input device.
  • If you’ve enabled Player Boxing in the WildKey settings, check if the image is visible when Player Boxing is disabled. If so, your controllers and headset may just all be out of view.
  • If your camera/input device has multiple possible resolutions, frame-rates, or pixel formats, that you’ve tried multiple options in case specific settings are incompatible.

If you don’t see your issue on this page, or the recommendations weren’t successful in resolving it, please contact us and we’ll try to respond as soon as we can.

What Hardware do I need to get started with MixCast?

At a minimum, you’ll need a fairly powerful PC, a compatible camera (see here), and either the Oculus Rift or HTC Vive headset. To take it to the next level, we recommend setting up a green-screen, and having a third controller or Vive tracker allows you to move the camera while broadcasting. You can find our hardware requirements page here.

What kinds of cameras are compatible with MixCast?

MixCast currently supports DirectShow-compatible USB devices, which include almost all webcams as well as some digital cameras and capture cards.

If your device isn’t appearing in the dropdown list, or is, but isn’t outputting when selected, let us know, but in the meantime you can try a workaround described here!

MixCast 2.0 and newer supports the Intel RealSense D415 and D435 cameras for depth-based subject isolation!

Which games support MixCast?

A growing list of games are enabling MixCast broadcasting with the MixCast SDK (look for the MixCast logo in the game’s desktop UI). If your favourite game doesn’t support MixCast yet, let the developer know if you’re interested in using MixCast VR with their product. If you’re working on a title yourself, you can download the free SDK right here!

For many more titles you can use MixCast Capture. For a full list of supported and confirmed MixCast-ready titles, see our App Compatibility page!

Are there keyboard controls for any MixCast Studio functions?

Yes! See the list here.

How do I align the virtual image and camera feed?

This setup step is called Camera Alignment, and is performed while wearing your VR headset with MixCast Studio.

  1. Find the Camera object floating in the room
  2. Point your controller at the button below the Camera in the middle, labelled Quick Setup, and squeeze the trigger.
  3. Bring the ring of the Vive controller that you used to select the button as close to the physical location of the camera as possible. The output of the camera is shown in VR. You should align the ring to encompass the center crosshairs on screen as largely as possible, center it on screen, and click the Grip button to capture the camera’s position.
  4. Take 1-2 steps back and repeat the following step 4 times:
  5. Hold a controller so its ring is centered in the crosshair presented on-screen. The scale is not important here, just the position. Press the Grip button while in this position.You should now have a fully aligned camera feed. Move your controllers around and test that the physical controllers remain overlapping their virtual counterparts as much as possible. If there is a delay between your physical controllers and your virtual controllers aligning, you may want to enable or adjust Buffered Mode.

How do I know when I have a good Camera Alignment result?

You can test your values by standing in the center of the viewable area, facing the Output Display, and holding your controllers in various positions: straight forward, straight out, and straight up (if necessary). If your virtual controllers and real controllers stay overlapping throughout, your alignment settings are correct.

Note: Your camera’s Field of View value will also affect results.

What can I do if the camera image seems delayed relative to the virtual objects (virtual controllers moving before hands)

Your camera or capture card has “latency”, which can be compensated for by using the Buffered Output mode. The output mode can be set from the Compositing screen in MixCast VR Studio. Once set, you should experiment with the value of the Game Delay field (hit Enter after typing in a value) to find one that causes your hands and controllers to move in sync.

Once Buffered mode is enabled, you can adjust this value in keyboard in the application using the MixCast SDK while MixCast is active by pressing the [ key to decrease the delay of the virtual world, and the ] key to increase it.

How do I determine the Field of View of my camera?

For Mixed Reality cameras: Quick Setup is now the fastest, easiest, and generally most accurate method of determining your camera’s Field of View. Put on your VR headset, grab your controllers, and select the button below the floating camera object with the label “Quick Setup” to run through the process.

For Virtual Cameras: Select whichever Field of View gives you yourdesired results! Values can range from 1-179 degrees.

How do I record my MixCast experience to play back or upload later?

As of 2.0, MixCast has implemented in-client recording! You can read more about it here!

How do I stream to Facebook Live, Twitch, etc with MixCast?

As of 2.0, MixCast has implemented in-client streaming, allowing you to stream directly to your platform of choice! You can read more about it here!

What can I do if my 3rd controller is being treated as one of my hands in a VR application?

Try these steps in order until you find success:

  • Hold the Steam button on your hand controllers and select Turn Off Controller, then re-enable it by pressing the Steam button and waving it around until detected
  • Unplug the 3rd controller, wait until your hand controllers appear, and then plug it in again
  • Unplug the 3rd controller, close your VR application and SteamVR, open SteamVR, turn on your hand controllers, then plug in your 3rd controller.

What can I do to improve the quality of static subtraction keying?

Your environment is the biggest factor to the quality of static subtraction keying. Here are some suggestions to try:

  • Disable automatic camera parameter management (auto-focus, auto-light, etc)
  • Check that objects behind you don’t have similar colors to your clothing or skin
  • Ensure that the lighting in the room is unchanging and your movement in the room doesn’t affect the lighting of the room significantly
  • Check if your device’s driver or software has any Automatic image controls enabled. These features will generally interfere with isolation mechanisms, although Auto-Focus can still be enabled for chromakeying in most cases.

What do I need to enable camera movement during filming?

Tracked camera movement involves dedicating one controller (or the Vive Tracker) to the camera you want to move. The controller and the camera should be fastened together so the camera view is unobstructed, as are the tracking sensors of the Vive controller. A rigid bond (such as a 3D printed mount or a mini-tripod clamp) is very important to the accuracy of the tracking over the session. If using a 3rd Controller, it needs to be connected via USB cable. To activate tracked movement in MixCast Studio, AFTER Camera Alignment, open the Camera Placement menu and click the “Take Closest” button. Moving that controller should now update the virtual view.

If your tracking is producing jitter in the position or rotation of the camera, you can enable motion smoothing in the UI. Smoothing can also be used with purely virtual cameras (input device set to NONE) to steady your hand motion.

What does Enhanced BG Removal do and how do I use it?

Player cropping allows you to exclude large areas from the real world camera feed in mixed reality without any additional hardware over your existing setup. This allows for greater flexibility in cinematic shots especially those in motion. It also increases the quality of your other background removal methods by providing additional removal logic.

The player cropping feature can be configured under the Subject menu in MixCast Studio. Player cropping operates by calculating a box around the player using their head, hands, and feet (approximated) positions. As well as enabling this feature, you can configure how much padding to add around your subject’s head, hands and feet in Studio.

What does Player Lighting do and how do I use it?

Player Lighting, a feature of MixCast introduced in release 1.4, allows for virtual in-game lights to affect the color of the real player in the mixed reality view. This effect is quite compelling when implemented by developers, and helps blur the seam between virtual and real content.

To enable Player Lighting, open the Subject Lighting menu in MixCast Studio, and configure the “Take Lighting” slider to have a value higher than 0. Note you can blend this value from ignoring lighting to fully lit. You can then adjust the “Base Amount” and “Light Power” values to create the desired amount of contrast and brightness of the player. Try picking up the Torch object in the scene to test how a small powerful light affects the player.

Once you’ve configured your values, just jump into your/another application. The player in the mixed reality output should now be receiving lights from the application. If your mixed reality output doesn’t appear correct when Player lighting is active in the application, but does in MixCast Studio, first see if the developer has posted any information about the issue. If not, let them know! They may not be aware of the issue or could already be working on it.

What resolution can MixCast output at?

There is no limit to MixCast’s output resolution! Without the need to use split-screen layering MixCast can output at the highest resolution available to your monitor or video capture device for streaming.

Why is MixCast Capture not recognizing MixCast Capture compatible games?

MixCast Capture allows for games that have not directly integrated the MixCast SDK to insert MixCast’s capabilities. You can find a list of our SDK + Capture integrated titles here.

If your title is on the capture side of this list, but capture is not  recognizing your VR Application, be sure that both your MixCast and Game directory both are on your computer itself and not a network. If you have either MixCast or your Game on a network drive MixCast Capture may not recognize the game.

Sending Diagnostics

MixCast connects to a number of different systems on your computer, and thus can operate differently depending on your hardware and software setup. If the need arises for you to send your system information to Blueprint Reality Inc (creators of MixCast), MixCast makes it easy, by providing the process as a one-click command accessible from the MixCast Status Window:

Using the MixCast OpenVR Driver

Unlike titles that have integrated the MixCast SDK, titles relying on SteamVR’s SDK to create Mixed Reality require a third tracked device (a tracker or controller) to be detected by SteamVR in order to activate the Mixed Reality functionality. Since not everyone has the physical hardware for this, MixCast provides an automatic solution: the MixCast OpenVR Driver.

This functionality appears as a MixCast icon within your SteamVR status window.

Note: To activate the driver and create Mixed Reality from a SteamVR title (not MixCast SDK), you must have both your hand controllers on, tracked, and identified by SteamVR. This may require that you actually put on the VR headset and interact with the experience. If one of your hands remains invisible or the MixCast icon doesn’t appear/fill, try turning your controllers off and on, or SteamVR entirely. When using a Vive, you can confirm your hand assignments by checking that they have these hand icons displayed in the SteamVR dashboard:

Working Around Input Device Issues

We’re actively working on widening compatibility of input devices in MixCast, but for now a workaround is possible: Using XSplit to relay the video feed in a format MixCast VR can receive.

1. To get started, grab XSplit Broadcaster from here and install it.

2. You’ll need to register an account with XSplit as part of the first launch

3. Select your input device (the HDMI capture card) under Sources

a. Set your resolution and framerate by clicking on the device in the bottom-left and clicking Settings


b. You do not need to set an output destination, simply running XSplit is sufficient

4. Select your intended output resolution (canvas resolution) in the top-right dropdown of XSplit – typically this would match the resolution you set for your input device in step 3

5. Mute the audio in Xsplit by clicking the microphone in the volume controls. If XSplit is recording audio it will cause echoes.

6. Open MixCast and select XSplit Broadcast as your input source, and from then do everything you normally would with MixCast!

Suggest Edit