Augmented Reality Project

 This project is from cs6476 computer vision. The main goal is to project images or videos onto a target video with a wall marked by corner templates. Homography transformation is the main theory used in the project. Results are displayed in the following images and videos.

corners located correctly, frames marked as blue lines
markers located in a noisy image
image (UT tower) projected on the wall
image projected on the wall with noises

image projected on the wall: 

Virtual TV on the wall:

(penguin video from BBC)

Comments

Post a Comment

Popular posts from this blog

Digit sequence detection of SVHN dataset

Image
  Unlike single digit detection problem like MNIST, images in SVHN dataset have more than one digit in series. SVHN Samples. Ref: http://ufldl.stanford.edu/housenumbers/ In this project, we used MSER detection and modified pre-trained VGG16 convolutional neural network to predict the digit sequence given a random image in SVHN dataset. Besides VGG16, we also used non-pre-trained VGG16 and self-built a much smaller CNN as comparisons. VGG16 Architecture. Ref: https://neurohive.io/en/popular-networks/vgg16/  Self-built CNN  The pipeline of the prediction is as: MSER detect blob regions →  CNN  find ROIs(regions of interest) → Combine overlapped/near ROIs →  CNN  Find Digits For training purposes, we mark each image with five integers as the label. The first four integers represent digits in the image, with 0 as no digit for that position and 1-10 representing 1-9 and 0. The fifth integer represents whether the area has any digit, with 0 represent a non-digit area and 1 as a window with d
Read more

Lab Software Development 3 - Scanning Probe Microscope Controller

Image
Motivation     For home-build scanning probe systems in labs, SpecsGroup's Nanonis system is often considered a good solution with various working modes for piezo stage control. However, its' price may not be very friendly for some SPM systems, which do not need a sophisticated feedback PID loop. It is overkill especially for the non-feedback laser microwave impedance microscopy system in our lab. We had a LabView program developed by former students, but it lacks the rotational degree of freedom and line scan mode. Also, the UI's inconvenience has always been painful for users. In order to add more flexibility, I rebuilt a new control system for the SPM with QtCreator with Python as the backend. Functionalities     For convenience, all functionalities are embedded on the same page. Multithreading was implemented for scanning, imaging, and data saving. Many of the functionalities are following the workflow of Park AFM system.      Scan: By clicking "Scan", the con
Read more

Traffic-Sign Recognition Project: Basis for Self-Driving Vehicle Sensing System

Image
This is a project of cs6476 computer vision I am taking. The project is based on the open-cv library and focuses on stationary scenarios with/without noises. It is only allowed to use geometry and basic Hough methods such as HoughCircles, HoughLines, HoughLinesP to recognize the followings: traffic lights and their status, “red”, “yellow”, or “green”; stop signs; yield signs; no-entry signs; warning signs; construction signs. Details of implementation and code are not allowed to share according to student integrity rules of the course. Here only displayed the results under artificial and real images. Detected Green Traffic Light (Artificial Clear Image) Detected Traffic Signs (Artificial Clear Image) More Detected Traffic Signs (Artificial Clear Image) Detected Traffic Signs (Artificial Noisy Image) Detected Stop Sign (Real Image) Detected Yield Sign (Real Image) Detected Warning and Yield Signs (Real Image Stitched)
Read more