Google Real-time Hand Tracking - ED Forums


Thread Tools Display Modes
Old 09-11-2019, 12:29 PM   #1
DigitalEngine's Avatar
Join Date: May 2015
Location: U.S.
Posts: 990
Default Google Real-time Hand Tracking

From the Google AI Blog
On-Device, Real-Time Hand Tracking with MediaPipe
Monday, August 19, 2019
Posted by Valentin Bazarevsky and Fan Zhang, Research Engineers, Google Research

"Today we are announcing the release of a new approach to hand perception, which we previewed CVPR 2019 in June, implemented in MediaPipe—an open source cross platform framework for building pipelines to process perceptual data of different modalities, such as video and audio. This approach provides high-fidelity hand and finger tracking by employing machine learning (ML) to infer 21 3D keypoints of a hand from just a single frame. Whereas current state-of-the-art approaches rely primarily on powerful desktop environments for inference, our method achieves real-time performance on a mobile phone, and even scales to multiple hands. We hope that providing this hand perception functionality to the wider research and development community will result in an emergence of creative use cases, stimulating new applications and new research avenues."

Google Releases Real-time Mobile Hand Tracking to R&D Community
Full article at RoadtoVR.

"Google has released to researchers and developers its own mobile device-based hand tracking method using machine learning, something Google Research engineers Valentin Bazarevsky and Fan Zhang call a “new approach to hand perception.”

First unveiled at CVPR 2019 back in June, Google’s on-device, real-time hand tracking method is now available for developers to explore—implemented in MediaPipe, an open source cross-platform framework for developers looking to build processing pipelines to handle perceptual data, like video and audio.

The approach is said to provide high-fidelity hand and finger tracking via machine learning, which can infer 21 3D ‘keypoints’ of a hand from just a single frame."
CPU = Intel i7-6700K
Motherboard = ASUS ROG Maximus VIII Hero Alpha, w/ the Intel Z170 Chipset,
RAM = 64 Gigs of Ripjaws V F4-3400C16Q.
GPU = Zotac GTX980ti Amp Extreme
Hard-drive = Samsung V-NAD SSD 950 PRO M.2
Cooling = Corsair H100i V2 water cooler, plus RAM mounted fans.

Corsair Vengeance® C70 Mid-Tower Gaming Case — Military Green
OS = Windows 10 64bit
Power supply = EVGA 1200P2
HTC Vive
DigitalEngines's Twitch Channel, Youtube Channel
DigitalEngine is offline   Reply With Quote

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT. The time now is 09:42 PM. vBulletin Skin by ForumMonkeys. Powered by vBulletin®.
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.