Motion Detection Project

The goal is to detect motions in a series of consecutive images. In this project, the pyramidal approach and hierarchical Lucas-Kanade algorithm are implemented. Frame interpolation is also executed with the help of the LK algorithm.

We start with a simple motion towards the right. The “beginning” and “end” figures are the only two frames we have. The central block goes from the middle to the right by a certain range. We are going to extract the motions of pixels from those two figures as the green arrows show below.

Two figures we have
Motions extracted from the two figures

From the motions we extracted, we could do frame interpolation based on the arithmetics below, and create the following dynamic gif animation. It interpolates the frames between the “beginning” and “end” figures show a consecutive motion of the central block towards the right.



Then we implement another real world image interpolation. It is not perfect since the source frames (first frame and last frame shown in the gif) are complex and have many details.


Interpolation based on the first frame and last frame

Finally, motion detection for a video clip was done. The blue arrows change with time, showing the change in motion of different parts in the window.

 

Comments

Post a Comment

Popular posts from this blog

Digit sequence detection of SVHN dataset

Image
  Unlike single digit detection problem like MNIST, images in SVHN dataset have more than one digit in series. SVHN Samples. Ref: http://ufldl.stanford.edu/housenumbers/ In this project, we used MSER detection and modified pre-trained VGG16 convolutional neural network to predict the digit sequence given a random image in SVHN dataset. Besides VGG16, we also used non-pre-trained VGG16 and self-built a much smaller CNN as comparisons. VGG16 Architecture. Ref: https://neurohive.io/en/popular-networks/vgg16/  Self-built CNN  The pipeline of the prediction is as: MSER detect blob regions →  CNN  find ROIs(regions of interest) → Combine overlapped/near ROIs →  CNN  Find Digits For training purposes, we mark each image with five integers as the label. The first four integers represent digits in the image, with 0 as no digit for that position and 1-10 representing 1-9 and 0. The fifth integer represents whether the area has any digit, with 0 represent a non-digit area and 1 as a window with d
Read more

Lab Software Development 3 - Scanning Probe Microscope Controller

Image
Motivation     For home-build scanning probe systems in labs, SpecsGroup's Nanonis system is often considered a good solution with various working modes for piezo stage control. However, its' price may not be very friendly for some SPM systems, which do not need a sophisticated feedback PID loop. It is overkill especially for the non-feedback laser microwave impedance microscopy system in our lab. We had a LabView program developed by former students, but it lacks the rotational degree of freedom and line scan mode. Also, the UI's inconvenience has always been painful for users. In order to add more flexibility, I rebuilt a new control system for the SPM with QtCreator with Python as the backend. Functionalities     For convenience, all functionalities are embedded on the same page. Multithreading was implemented for scanning, imaging, and data saving. Many of the functionalities are following the workflow of Park AFM system.      Scan: By clicking "Scan", the con
Read more

Traffic-Sign Recognition Project: Basis for Self-Driving Vehicle Sensing System

Image
This is a project of cs6476 computer vision I am taking. The project is based on the open-cv library and focuses on stationary scenarios with/without noises. It is only allowed to use geometry and basic Hough methods such as HoughCircles, HoughLines, HoughLinesP to recognize the followings: traffic lights and their status, “red”, “yellow”, or “green”; stop signs; yield signs; no-entry signs; warning signs; construction signs. Details of implementation and code are not allowed to share according to student integrity rules of the course. Here only displayed the results under artificial and real images. Detected Green Traffic Light (Artificial Clear Image) Detected Traffic Signs (Artificial Clear Image) More Detected Traffic Signs (Artificial Clear Image) Detected Traffic Signs (Artificial Noisy Image) Detected Stop Sign (Real Image) Detected Yield Sign (Real Image) Detected Warning and Yield Signs (Real Image Stitched)
Read more