Jennifer Story
PROJECT
Maya (AR Camera)
Computer vision & deep learning based vision intelligence framework
ROLE
User experience, user flow, wireframe, visual mockup, demo prototyping, video editing
As a lead designer, worked with project leader, project manager, SW engineers, and design intern,
DURATION
Design Research and development
-
Ver 1-1.2: July 2016 ~ May 2017
-
Ver1.3: Aug 2017 ~ Dec 2017
-
Ver 1.5: Dec 2017 ~ Jan 2018
-
Ver 2.0: Jan 2018 ~ March 2018
Project Introduction
The camera is the most used app and provides a great opportunity to embed AR experience in Samsung mobile devices. Providing Camera AR layer framework on top of the camera app for the unified AR experience directly from Camera App
Challenges
-
Enhance existing camera usage
-
Enable advanced AR technology
-
Make a bridge between AR and core apps
-
real-time processing on-device
Patents
Vision intelligence management for electronic devices (A1 patent one of the inventors)
System and method for contextual driven intelligence (A1 Patent one of the Inventors)
Vision intelligence framework for mobile devices (A1 Patent one of the inventors)
Emotion-aware Reactive interface (A1 Patent Inventor)
Exploration UX
Documentation
Prototype ver.1 demo video
Add-on feature exploration
Integrated Galaxy 9 Bixby Vision 2018
Prototype ver 1.2 demo video
Launched AR Core
by Google
Emotion recognition
Key technology
-
Contextual on-device and cloud-based models: instant object recognition, scene recognition, OCR, face detection, emotion recognition, gesture recognition
-
Hierarchical Deep learning for sub-category classification
-
Layer API for 2D and 3D graphic overlay
-
Built-in engines to support CV & ML
-
Build AR App ecosystem for spatial understanding
-
Availability across platforms: Android, Tizen, native, and others
-
Integration with multiple Samsung and 3rd party services
Value of Project MAYA
-
On-device ML framework across Samsung vertical products
-
Available across platform, Adroid, Tizen, native
