Derek T Jung, 534026 Hidden Winds Dr, Spring, TX 77386

2020034, Nov 5, 2020

Apr 30, 2020

16/862757

- Rochester Hills MI, US
Derek Jung - Clinton Township MI, US
Kenneth W. Krause - Rochester Hills MI, US

G06T 7/80
G06T 19/00
B25J 9/16

A system and method for setting up an AR application that uses a plurality of markers so that accurate augmentations can be displayed anywhere a marker is visible. The method includes placing a plurality of markers throughout the workspace so that a plurality of pairs of two adjacent markers can be viewed in a field-of-view of an AR device. The method further includes determining a distance relationship between the two markers in all of the pairs of markers, and determining a distance relationship between all non-adjacent markers using the distance relationship between the two markers in all of the pairs of markers. The method also includes identifying a distance relationship between one of the plurality of markers and an augmentation in the workspace, and identifying a distance relationship between the other markers and the augmentation using the distance relationships between the adjacent markers and the non-adjacent markers.

2020007, Mar 12, 2020

Sep 10, 2019

16/566520

- Rochester Hills MI, US
Derek Jung - Clinton Township MI, US
Leo Keselman - Ferndale MI, US

B25J 9/16
B25J 13/08
G06T 7/73

A method and system for calibration of an augmented reality (AR) device's position and orientation based on a robot's positional configuration. A conventional visual calibration target is not required for AR device calibration. Instead, the robot itself, in any pose, is used as a three dimensional (3D) calibration target. The AR system is provided with a CAD model of the entire robot to use as a reference frame, and 3D models of the individual robot arms are combined into a single object model based on joint positions known from the robot controller. The 3D surface model of the entire robot in the current pose is then used for visual calibration of the AR system by analyzing images from the AR device camera in comparison to the surface model of the robot in the current pose. The technique is applicable to initial AR device calibration and to ongoing device tracking.

2019038, Dec 26, 2019

Jun 26, 2019

16/453838

- Rochester Hills MI, US
Derek Jung - Clinton Township MI, US
Leo Keselman - Ferndale MI, US
Min-Ren Jean - Rochester Hills MI, US
Kenneth W. Krause - Rochester Hills MI, US
Jason Tsai - Bloomfield Hills MI, US

B25J 9/16
G06K 9/00
G06T 1/00
B25J 19/02
G02B 27/01
G06F 3/01

An augmented reality (AR) system for production-tuning of parameters for a visual tracking robotic picking system. The robotic picking system includes one or more robots configured to pick randomly-placed and randomly-oriented parts off a conveyor belt and place the parts in an available position, either on a second moving conveyor belt or on a stationary device such as a pallet. A visual tracking system identifies position and orientation of the parts on the feed conveyor. The AR system allows picking system tuning parameters including upstream, discard and downstream boundary locations to be visualized and controlled, real-time robot pick/place operations to be viewed with virtual boundaries, and system performance parameters such as part throughput rate and part allocation by robot to be viewed. The AR system also allows virtual parts to be used in simulations, either instead of or in addition to real parts.