 |
| Technology |
| |
|
Powering Mobinex applications is Human Expression Analysis and Rendering Technology (H.E.A.R.T), which provides a unique combination of the state-of-the-art motion tracking technologies with rich multimedia contents.
H.E.A.R.T is a 2D webcam based technology but 3D enabled, hence it's an investment protection for future deployment. Today H.E.A.R.T can be run on Microsoft Windows, Linux and Android platform. Behind every H.E.A.R.T enabled application runs a powerful, advanced Tracking Engines that analyze human face and body motions in real time and apply the tracking data to avatars, accessories, or other contents.
|
|
|
| |
| Full-body Tracker |
| |
|
|
Mobinex Full-body Tracker is the most advanced tracker from Mobinex Tracking Engine suite and is able to detect and track whole body movement in input video. Gestures can be defined and recognized to map to actions.
Combined with Mobinex FFT and Hand Tracker, Mobinex Full-body Tracker can track the 3D movement of the head, arms, and the body. This is the ultimate channel for a complete interactive experience. |
|
|
| Hand Tracker |
| |
|
|
Mobinex Hand Tracker can detect hands and fingers in input image or video and track their movement in real time. Hand gestures can be defined and recognized to map into actions such as hand wave, palm open or close, and finger click. It can also use the relative positions of the hands to distinguish the right hand from the left hand.
|
|
|
| |
| |
| Facial-feature Detection |
| |
|
|
Mobinex Facial-feature Detection (FFD) works by identifying human faces in a picture or video, then detecting facial features such as eyes, nose, and mouth.
Unlike many other face detection software, which can only detect faces, Mobinex FFD can detect facial features, thus allowing applications to selectively operate on eyes, nose, or mouth.
Mobinex FFD supports multiple modes from the quick detection (with less facial-feature points detected) to the full 28 facial-feature point detection. |
|
|
| Facial-feature Tracker |
| |
|
|
Mobinex Facial-feature Tracker (FFT) extends Mobinex FFD by tracking the movement of the facial-features in real time.
With the real-time tracking of facial- features, applications can continuously operate on faces or selected facial features.
Mobinex FFT can track all six degrees of face motion in translation or rotation on x, y, and z-axis.
|
|
|
| |
| |
| Face Comparison |
| |
|
|
Mobinex Face Comparison extends Mobinex FFD by comparing input face image with stored face database to find a matching face.
Mobinex Face Comparison uses a set of facial-feature points and their relationships to identify the unique characteristics of the input face.
|
|
|
| Lip-sync |
| |
|
|
Mobinex Lip-sync Engine uses the latest speech-analysis technique to visualize the matching lip shapes to human speech.
Applications using Mobinex Lip-sync can render an animated character, or morph any image, to match the human speech in the input audio.
Combined with TTS (text-to-speech engine), Mobinex Lip-sync can convert text into the video of talking characters.
|
|
|
| |
|
| |
|
| |
|
|
 |
English
Chinese
