As planned, Microsoft today started shipping its Kinect for Windows v2 sensor, priced at $199. At the same time, the company has also released the free SDK 2.0 public preview, which you can download now directly from Microsoft.com.
Microsoft wouldn’t say how quickly it is filling pre-orders. The company merely revealed “thousands” of Kinect for Windows v2 sensors were sent off to developers worldwide today, and that more will be leaving the warehouse in the coming weeks as the company works “to fill orders as quickly as possible.”
“This event was off the charts”
Gary Vaynerchuk was so impressed with TNW Conference 2016 he paused mid-talk to applaud us.
We’ve known for a while now that the Kinect for Windows v2 sensor features the core capabilities of the new Kinect for Xbox One sensor. Microsoft has said before that this includes an ultra wide-angle 1080p HD depth camera, that the device can capture RGB color video at around 30 frames per second, and can even detect if you’re off balance or monitor your heart rate.
Today the company has expanded on the new sensor’s key features:
- Improved skeletal tracking: The enhanced fidelity of the depth camera, combined with improvements in the software, have led to a number skeletal tracking developments. In addition to now tracking as many as six complete skeletons (compared to two with the original sensor), and tracking 25 joints per person (as compared to 20 with the original sensor), the tracked positions are more anatomically correct and stable—and the range of tracking is broader. This enables and simplifies many scenarios, including more stable avateering, more accurate body position evaluation, crisper interactions, and more bystander involvement in interactive scenarios.
- Higher depth fidelity: With higher depth fidelity and a significantly improved noise floor, the v2 sensor gives you better 3D visualization, increased ability to see smaller objects and all objects more clearly, and more stable skeletal tracking.
- 1080p HD video: The color camera captures full, beautiful 1080p video that can be displayed in the same resolution as the viewing screen, allowing for a broad range of powerful scenarios. In addition to improving video communications and video analytics applications, this provides a great input on which to build high-quality, augmented reality scenarios, digital signage, and more.
- New active infrared capabilities: In addition to allowing the Kinect for Windows v2 sensor to see in the dark, the new infrared (IR) capabilities produce a lighting-independent view, which makes machine learning or computer-vision–based tasks much easier—because you don’t have to account for or model lighting-based variation. And, you can now use IR and color at the same time. We look forward to the many new and innovative uses that the community will develop to use this fundamentally new capability.
- Wider/expanded field of view: The expanded field of view enables a larger area of a scene to be captured by the camera. As a result, users can be closer to the camera and still in view, and the camera is effective over a larger total area.
Yet the real news today is what’s included in the new SDK. This is what developers have been waiting for, especially if they weren’t able to participate in the Developer Preview program.
The Kinect for Windows SDK 2.0 includes the following features:
- Improved skeletal, hand, and joint orientation: With the ability to track as many as six people and 25 skeletal joints per person—including new joints for hand tips, thumbs, and shoulder center—as well as improved understanding of the soft connective tissue and body positioning—you get more anatomically correct positions for crisp interactions and more accurate avateering. These improved capabilities result in more lifelike avatars and open up new and better scenarios in fitness, wellness, education and training, entertainment, gaming, movies, communications, and more.
- Support for new development environments: New Unity support provides faster, cost-efficient, and high quality support for cross-platform development, enabling developers to build their apps for the Windows Store using tools they already know.
- Powerful tooling: Thanks to Kinect Studio’s enhanced recording and playback features, developers can develop on the go, without the need to have a Kinect sensor with them at all times. And Gesture Builder lets developers build their own custom gestures that the system recognizes and uses to write code by using machine learning. These features increase productivity and keep costs down.
- Advanced face tracking: With significantly increased resolution, applications can capture a face with a 2,000-point mesh that looks more true to life. This means that avatars will look more lifelike.
- Simultaneous multi-app support: New multi-app support enables more than one application to access a single sensor simultaneously. This means you could have a business intelligence app running at the same time that a training or retail or education experience were running, allowing you to get analytics in real time.
Microsoft says a final version of the SDK 2.0 will be released “in a few months.” At that time, developers will be able to start submitting their apps to the Windows Store and companies will be able to make their v2 solutions available commercially.
See also – Microsoft updates Kinect for Windows SDK with background removal, color capture, other new APIs and samples and Microsoft releases three videos showing off how Kinect for Windows can work for retailers
Top Image Credit: Microsoft