top of page
trackAR_top-banner05.jpg

TrackAR

Spatial tracking for AR/VR experience
with Dynamic Vision Sensor (DVS)

ROLE

Visual mockups for developing technology components, demo prototypes, video creating/editing

As a lead designer, worked with the project leader, project manager, and SW engineers

DURATION

Create and develop from April 2017 ~ Nov 2018

Project Introduction

​Researched and developed a mobile device with visual intelligence and spatial awareness for the next generation of mobile experience. Key features of low-powered, lightweight sensor, inside-out camera tracking system with Dynamic Vision Sensor(DVS)

Challenges

  • Low-power and lightweight sensor-based AR technology for the widespread use cases

Logo Design
TrackAR_logo_app02.png

The logo shape represents a vision tracking based DVS camera. And the center diamond is especially pointing out the core camera pose which enables AR/VR application to estimate the position. 

Technology demo application

Ver 1.0 - Plane Detection & 3D Object Positioning Experience
 

This prototype shows the integration of DVS spatial tracking, plane detection, and 3D object positioning in App.  The simple user interface enables to show the development process of our technical feasibility.

prototype_interface01.png
00 main.png

Overall UI

03 universal UI.png

Plane Detection

horizontal plane.jpg

Ground Detection & 3D Object Placement

3D object scale.jpg

3D Object Manipulation

ground plane.jpg

Horizontal Detection

vertical plane.jpg

Vertical Detection

prototype_interface02.png
Visualization of key features

Key Features

 

- High efficiency of power consumption (Battery life) for widespread adoption on mobile devices
- Robust camera tracking for multi-user AR experiences.
- Provide robustness for the high-speed motion
- Experience the camera senses scene without losing detail and without adjusting exposure in a sunny outdoor or low light indoor.

-Spatial understanding solution using DVS and alternate sensors

key features.png
20181102_TrackAR_ARvision_v1.5.jpg

Visualization for AV/VR Experience

Technology development & video presentation
trackAR01.jpg

Inside-out camera tracking with Dynamic Vision Sensor (DVS)

  • Low-power consumption

  • High update rate

  • High dynamic range

  • Spatial understanding solutions

CMOS Camera

VS.

DVS Camera

Speed & Power

Power Consumption

trackAR02.jpg
trackAR03.jpg
Visualization of developing technology

DVS demo indoor daytime

DVS demo outdoor night

DVS demo context

Object understanding

Applications/variations

  • Head mount display AR/VR

  • Smart home robotics/autonomous search & rescue drones

  • Autonomous driving for low-light conditions

WORK LISTS
bottom of page