Today the Kinect for Windows team announced a slew of updates to its core software suite, and began support for the Chinese market, a large new region that it hopes will expand its reach and total penetration.
TNW spoke to the Kinect team on the update, which it described as the answer to a number of requests from developers using its platform; many of the updates released today are based off of direct requests.
“This event was off the charts”
Gary Vaynerchuk was so impressed with TNW Conference 2016 he paused mid-talk to applaud us.
Kinect for Windows is Microsoft’s attempt to take the Kinect platform to a new computing environment. Kinect itself has been wildly successful thus far for Xbox; taking it to a different use case is at once intuitive and difficult. What works for Xbox, in short, doesn’t correlate directly to a laptop or desktop setup.
That in mind, the non-consumer options for Kinect abound, even if they are yet unrealized. Medical, retail, and other places may have a use for the Kinect’s ability to take in both motion and voice data in ways that could change the way that humans interact with machines. The Kinect team is currently focused more on bringing Kinect to business, and less to consumers; that however, will prove temporary in the long haul.
TNW specifically asked if Kinect for Windows was coming to Windows 8’s modern app system. Not yet. However, the Kinect for Windows team does not have the coming Windows 8 userbase far from its mind; TNW was not directly told this, but it is all but certain that support for modern apps is both planned and expected. Today, the platform is expanding to support Windows 8’s desktop app ecosystem.
The details of today’s upgrades to its API are diverse enough that I won’t specifically detail each element here – the list can be found below, TNW apologizes for making you scroll – but they include the ability to take in more forms of information from the Kinect sensor in a Windows environment, including long-depth shots, allowing applications to note a person, even if in an imprecise way; this has been something that developers have hungered for.
Interestingly, the Kinect for Windows team is very much focused on design. In conversation, the group repeatedly mentioned – focused on, really – the importance of its suggested design guidelines, what it calls its ‘Human Interface Guidelines.’ TNW will be delving into that specific set of ideas, and ideals that embody how it views the future of app design for the Kinect for Windows platform, in the future.
Now, to China. Here’s how Kinect for Windows boss Craig Eisler notes on the product’s launch into that market:
I look forward to seeing the innovative things Chinese companies do with the technology, as well as the business and societal problems they are able to solve with it.
Over the next few months we will be making Kinect for Windows sensors available in seven more markets: Chile, Colombia, the Czech Republic, Greece, Hungary, Poland, and Puerto Rico.
In short, this update is in a way Kinect for Windows’ coming out party. What developers have most requested, much of which they now have. Here’s to hoping that in a few years’ time we can shout at our computers as we do the pre-pubescent bastards who plague gaming on the Xbox.
Being serious for a moment, as Craig noted, the addition of Kinect to Windows is akin to allowing your computer the ability to both see and hear. That’s not just new, it’s a potential revolution.
Now, for you developers, here’s what is new:
Extended sensor data access
- Data from the sensor’s 3-axis accelerometer is now exposed in the API. This enables detection of the sensor’s orientation.
- Extended-range depth data now provides details beyond four meters. Extended- range depth data is data beyond the tested and certified ranges and is therefore lower accuracy. For those developers who want access to this data, it’s now available.
- Color camera settings, such as brightness and exposure, can now be set explicitly by the application, allowing developers to tune a Kinect for Windows sensor’s environment.
- The infrared stream is now exposed in the API. This means developers can use the infrared stream in many scenarios, such as calibrating other color cameras to the depth sensor or capturing grayscale images in low-light situations.
- The updated SDK used with the Kinect for Windows sensors allows for faster toggling of IR to support multiple overlapping sensors.
Improved developer tools
- Kinect Studio has been updated to support all new sensor data features. The SDK ships with a German speech recognition language pack that has been optimized for the sensor’s microphone array.
- Skeletal tracking is now supported on multiple sensors within a single application.
- New samples show how to use all the new SDK features. Additionally, a fantastic new sample has been released that demonstrates a best-in-class UI based on the Kinect for Windows Human Interface Guidelines called the Basic User Interactions – WPF sample.
- We are committed to continuing to make it easier and easier for developers to create amazing applications. That’s why we continue to invest in tools and resources like these.
- We want to do the heavy lifting behind the scenes so the technologists using our platform can focus on making their specific solutions great. For instance, people have been using our Human Interface Guidelines (HIG) to design more natural, intuitive interactions since we released last May. Now, the Basic User Interactions sample brings to life the best practices that we described in the HIG and can be easily repurposed.
- Greater support for operating systemsWindows 8 compatibility. By using the updated Kinect for Windows SDK, you can develop a Kinect for Windows solution for Windows 8 desktop applications.
- The latest SDK supports development with Visual Studio 2012 and the new Microsoft .NET Framework 4.5.
- The Kinect for Windows sensor now works on Windows running in a virtual machine (VM) and has been tested with the following VM environments: Microsoft Hyper-V, VMWare, and Parallels.
Top Image Credit: Michael Coté