 |
| Technology |
| |
|
Powering Mobinex applications is Human Expression Analysis and Rendering
Technolgy (H.E.A.R.T), which provides a unique combination of the state-of-the-art motion tracking technologies with rich multimedia contents.
Behind every H.E.A.R.T enabled application runs a powerful, advanced Tracking
Engines that analyze human face and body motions in real time and apply the tracking
data to avatars, accessories, or other contents.
|
|
|
| |
| Facial-feature Detection |
| |
|
|
Mobinex Facial-feature Detection (FFD) works by identifying human faces in a picture or video, then detecting facial features such as eyes, nose, and mouth.
Unlike many other face detection software, which can only detect faces, Mobinex FFD can detect facial features, thus allowing applications to selectively operate on eyes, nose, or mouth.
Mobinex FFD supports multiple modes from the quick detection (with less facial-feature points detected) to the full 28 facial-feature point detection. |
|
|
| Facial-feature Tracker |
| |
|
|
Mobinex Facial-feature Tracker (FFT) extends Mobinex FFD by tracking the movement of the facial-features in real time.
With the real-time tracking of facial- features, applications can continuously operate on faces or selected facial features.
Mobinex FFT can track all six degrees of face motion in translation or rotation on x, y, and z-axis.
|
|
|
| |
| |
| Face Comparison |
| |
|
|
Mobinex Face Comparison extends Mobinex FFD by comparing input face image with stored face database to find a matching face.
Mobinex Face Comparison uses a set of facial-feature points and their relationships to identify the unique characteristics of the input face.
|
|
|
| Hand Tracker |
| |
|
|
Mobinex Hand Tracker can detect hands in input image or video and track their movement in real time.
Mobinex Hand Tracker can also use the relative positions of the hands to distinguish the right hand from the left hand.
Applications can analyze the output of Mobinex Hand Tracker to detect selected hand gestures such as wave and palm- open or close.
|
|
|
| |
| |
| Upper-body Tracker |
| |
|
|
Mobinex Upper-body Tracker is the most advanced tracker from Mobinex Tracking Engine suite and is able to track the upper-body movement in input video.
Combined with Mobinex FFT and Hand Tracker, Mobinex Upper-body Tracker can track the 3D movement of the head, arms, and the body. |
|
|
| Lip-sync |
| |
|
|
Mobinex Lip-sync Engine uses the latest speech-analysis technique to visualize the matching lip shapes to human speech.
Applications using Mobinex Lip-sync can render an animated character, or morph any image, to match the human speech in the input audio.
Combined with TTS (text-to-speech engine), Mobinex Lip-sync can convert text into the video of talking characters. |
|
|
| |
|
| |
|
| |
|
|
 |
