Slide background
Kinect touch screen custom application development for kiosks and Microsoft 8 image

Now Offering Microsoft® Kinect®

Custom Multi-Touch Application Development

Control media without touching the screen

Next Level Touch uses Intuilab Software for all Microsoft Kinect Custom Multi Touch Applications. Watch the sample video to see it in action.

  • People Detection: detects people in front of the Kinect sensor and displays a live video of sensor input
  • Gestures: manages gestures detection
  • Letter Postures: manages letter postures detection
  • Command Postures: manages command postures detection

How Does Microsoft Kinect Work?

Kinect software and application development - Kinect Gestures image

Kinect Gestures

Intuitive gestures include detection of push,wave, swipe left and swipe right. The user can use left/right swipes to control the navigation or to move through a collection of images or content. The push gesture is used to open the  item that is in focus. Users can also use the wave gesture  to reset a space.

Properties:

  • Enable Gesture Swipe Left & Right
  • Enable Gesture Push
  • Enable Gesture Wave

Triggers

  • Push detected –> Raised when a Push gesture is detected.
  • Swipe Left detected –> Raised when a Swipe Left gesture is detected.
  • Swipe Right detected –> Raised when a Swipe Right gesture is detected.
  • Wave detected –> Raised when a Wave gesture is detected.

Kinect Letter Postures

This Interface Asset detects when the user in front of the sensor is in a posture with the shape of the letters A, T, U or V. From these triggers you can call any action.

Properties:

  • Enable Posture A
  • Enable Posture T
  • Enable Posture U
  • Enable Posture V

Triggers

  • Posture detected –> Raised when the posture is detected.
  • Posture detection in progress –> Raised when posture detection is in progress. You can bind its parameter to a Linear Gauge to see the progress.
  • Posture lost –> Raised when the posture is lost.
Kinect software and application development - Kinect letter postures image
Kinect software and application development - Kinect command postures image

Kinect Command Postures

This Interface Asset detects when the user in front of the sensor is in a posture with one of three shapes referred to as Home, Wait & Stay. (see picture below). From these triggers you can call any action.

Properties:

  • EnablePosture Home
  • Enable Posture Stay
  • Enable Posture Wait

Triggers

  • Posture detected –> Raised when the posture is detected.
  • Posture detection in progress –> Raised when posture detection is in progress. You can bind its parameter to a Linear Gauge to see the progress.
  • Posture lost –> Raised when the posture is lost.

Kinect People Detection

Kinect custom multi-touch applications enable you to visualize the live stream of the sensor and includes triggers for when people enter or leave the field of view.

Properties:

  • Stream –> select the stream to display on screen. You can choose between the following:
  • 1. Color –> the standard camera image
  • 2. Depth –> the depth image. The grey level indicates distance from the sensor
  • 3. None –> use this if you want to display only the skeleton (assuming the option below is checked)

Triggers

  • New person detected –> Raised when a person enters Kinect’s field of view.
  • No person detected –> Raised when the last person leaves Kinect’s field of view.
Kinect software and application development - Kinect people detection image

Our Microsoft Kinect solution works in combination with the touch screen functionality

The user can choose if they want to touch the screen or not

Known Limitations

  • Kinect software currently provides people, gesture and posture detection. Pointing and direct manipulation with the hand will be available in future versions.
  • If you put more than one Interface Asset of each type in your experience, only the original will be functional.
  • Software supports only Kinect for Windows and not Kinect for Xbox 360 (due to Microsoft licensing limitations)