Create Natural User Interfaces with the Next-Generation Intel Perceptual Computing SDK

(1)

Create Natural User Interfaces with

the Next-Generation

Intel Perceptual Computing SDK

Ryan Tabrah, Group Manager, UX Developer Products

@PerceptualSDK

GDC 2014

(2)

GDC 2014

Intel's Vision

This decade we will create and extend computing technology to connect

and enrich the lives of every person on earth.

(3)

Notice

Intel

®

_{Software and Services Group}

3

Deliver Secure, Optimized, and

Compelling Products and Services

Unleash Unprecedented Capability in

Intel Technology

Enhance People’s Lives and Enable

Them to Connect Any Device,

Anytime and Anywhere

Transforming the Computing Experience

Optimization Notice

(4)

GDC 2014

(5)

GDC 2014

What You’ll Learn About Today

– An Overview of the Intel® Perceptual Computing SDK for

Intel® RealSense™ technologies

– Next-Generation SDK Improvements

– GDC News and Updates

(6)

The Intel® RealSense™ SDK is…

6

• Finger/Hand Tracking • Facial Analysis

• 3D Capture

• Hand Skeleton Tracking • 3D Augmented Reality • Enhanced Unity Support

New in 2014!

Build Differentiated NUI Apps for the Mainstream Integrated RealSense 3D Camera

Free download at software.intel.com/realsense

• Background Subtraction • Speech Recognition

(7)

The Next ‘Big Thing’

 Access the great technology you saw in our video for your own applications

 Integrated cameras means a significant number of users will have depth cameras in 2014

 Technology and APIs that enable but don’t restrict

(8)

GDC 2014

2013

Creative* Senz3D @QVGA depth

resolution

Perceptual Computing SDK

Ground-breaking Modalities

Challenge

Hackathons

2014

IntegratedIntel® RealSense™ 3D Camera

@VGA

Intel® RealSense™ SDK

Additional Modalities / Usages

One-Stop shop for developer resources

App Portal + App marketing

(9)

GDC 2014

Finger/Hand Tracking

2013:

Fingertips, Palm Center, Grasp Point, Forearm

2014:

Track Additional Points

Greater Accuracy and Resolution

3D Hand Skeleton Enables New Usages

(10)

GDC 2014

Facial Analysis

2013:

2014:

Greater Accuracy

(11)

GDC 2014

3D Capture

Real Object

Depth Scan

Depth Scan + RGB Data

Capture and Share your World in 3D

Available in the Next-Gen SDK

(12)

GDC 2014

Raw Depth

12

2013:

QVGA Depth Resolution

2014:

Increased Resolution

Uninhibited Access To Raw Depth Data

For Unhindered Innovation

(13)

GDC 2014

Game Engine

Compatibility

- Processing*

- OpenFrameworks*

- Havok*

- Unity*  NEW usability extension

(14)

PC/Standalone

Webplayer

SDK Runtime

Operating System and Camera

Unity Productivity Extension

Unity Applications

• _•

Completely rethought Unity support.

Support for standalone apps as well as

web player compatibility

• Robust features. Parity with C#

• Support both PC/standalone and web

player platforms.

• Unity productivity extension provides

scripts for drag and drop programming

.

(15)

A set of scripts that provides configurable actions/rules based on

input provided by the SDK.

Drag and drop programming.

Write less code.

- Associate your game objects with action

scripts.

- Create rules. Associate your game objects

with rules.

(16)

GDC 2014

– Most Unity games run on the desktop, but Unity Web

Player games run in the Browser

– No need for user to install, users receive a prompt at the

website and accept.

– Very popular, easy to distribute to wide audience

(17)

• Use web-socket to tunnel sensing data to

web-browses for interactive web

applications.

• Works on major browsers:

• Microsoft Internet Explorer

• Google Chrome

• Mozilla Firefox

• Network latency optimized subset of API

from the PC/standalone features

• Develop based on PC/standalone.

• Switch to the webplayer platform for

deployment

(18)

GDC 2014

Unity Web Socket Support

Unity Web Player Application

HTML / Java Script

SDK Local Web-Socket Server

Intel® RealSense™ SDK runtime

Internet Browser

Operating System

Web Socket Communication 127.0.0.1:4181

(19)

GDC 2014

Demos

• Unity

• Hoplites

(20)

GDC 2014

• To be the first to hear about the next-generation SDK and

camera, enter your email address

software.intel.com/gdcrealsense

• Check out the winners of the first Intel Perceptual Computing

Challenge in Intel booth 1016

• Visit the booth to learn about future RealSense Challenges

(21)

21

Code For Good is one way Intel is realizing our corporate mission to “Create and Extend Computing Technology to Connect and Enrich the Lives of Every Person on Earth". This program is designed to help solve social and community problems through software.

http://software.intel.com/codeforgood

Intel is expanding this program Worldwide.

Donate your talents and have a positive impact on your local

community.

(22)

Wrap Up

22

Intel.com/software/realsense

Intel.com/realsense

@PerceptualSDK

 Signup to be notified of new camera availability – software.intel.com/gdcrealsense

 Follow us - @PerceptualSDK

 Code for Good – get involved

(23)

GDC 2014

GDC Intel RealSense Schedule

3/19 – 1 PM

First Person Shooter Creator Reloaded with Intel RealSense – Lee Bamber

3/19 – 2 PM

There Came an Echo Theatre Presentation – Jay Wishnov, Iridium

3/20 – 10:30 AM

First Person Shooter Creator Reloaded with Intel RealSense – Lee Bamber

3/20 – 2 PM

There Came an Echo Theatre Presentation – Jay Wishnov, Iridium

3/20 – 3 PM

Using Unity for RealSense: Lessons from Stargate Gunship and SuperHeroes -

Skaggs

(24)

GDC 2014

(25)

GDC 2014

Legal Disclaimer & Optimization Notice

•INFORMATION IN THIS DOCUMENT IS PROVIDED “AS IS”. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO THIS INFORMATION INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT.

•Software and workloads used in performance tests may have been optimized for performance only on Intel

microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products.