Ph.D. Research Projects

Active Geometric Shape Models and CSF Detection

I have been working with Prof. Kim L. Boyer to develop a novel approach, the Active Geometric Shape Models, to fit parametric shapes to data and images. Our paper is published on CVIU.

  • Project Wiki
  • Link
  • CVIU Paper in PDF
  • Slides
  • Download software
  • COSBOS: COlor-Sensor-Based Occupancy Sensing

    With multiple color-controllable LED fixtures and color sensors, our COSBOS technique enables low-cost and privacy-preserving occupancy distribution estimation. The direct application of this technique is occupancy-sensitive smart lighting, in which the system automatically delivers the light that best suits the occupancy scenario in an indoor space.

  • Project Wiki
  • JSSL 2014 Paper in PDF
  • ICPR 2014 Paper in PDF
  • PBVS 2014 Paper in PDF
  • SPIE 2014 Paper in PDF
  • Download software
  • Learning-Based Knee Cartilage Segmentation in 3D MR

    The automatic segmentation of human knee cartilage from 3D MR images is challenging due to the thin sheet structure of the cartilage with diffuse boundaries and inhomogeneous intensities. We present an iterative multi-class learning method to segment the femoral, tibial and patellar cartilage simultaneously, which effectively exploits the spatial contextual constraints between bone and cartilage, and also between different cartilages. High accuracy and robustness is achieved on 176 volumes from the OAI dataset.

  • Paper in PDF
  • Poster
  • Slides
  • Code
  • Old Course/Intern/Fun Projects

    Tracking Tetrahymena Pyriformis Cells using Decision Trees

    We approach the cell tracking problem by interpreting it as a classification problem. Our paper is published on ICPR 2012.

  • Paper in PDF
  • Poster
  • Shotgun
  • Code
  • Segmentation and Disease Detection in Echocardiogram Images

    This is my work as an Research Intern at IBM. It is part of the Medical Sieve project.

  • Poster



  • Manifold Learning for Image Classification

    We apply manifold learning techniques including multidimensional scaling (MDS) and Isomap on high-level semantics-sensitive pairwise image distances, such as IMED, SPM, IRM and their variants to learn fixed-length vector representations of images. We are looking at applications including style categorization, scene classification and object recognition.

  • Project Wiki
  • SIBGRAPI paper
  • Slides
  • Download MDS encoder source code
  • GPU Implementation for GVF Force Field

    This is a project I have been working on when I was in Prof. Badrinath Roysam's lab. My work is part of the FARSIGHT project . Here is the

  • Project Report
  • Documentation
  • Full Package including Code

  • Implementation and Study of Light-field-based 3D Object Retrieval System

    This is my research for undergraduate thesis at Tsinghua University, under the guidance of Prof. Qionghai Dai and Prof. Guihua Er.

  • Thesis
  • Poster

  • GMM-Based Hidden Markov Random Field for Color Image and 3D Volume Segmentation

    This is the final project of Prof. Qiang Ji's course Introduction to Probabilistic Graphical Models. In this project, we first study the Gaussian-based hidden Markov random field (HMRF) model and its expectationmaximization (EM) algorithm. Then we generalize it to Gaussian mixture model-based hidden Markov random field. The algorithm is implemented in MATLAB. We also apply this algorithm to color image segmentation problems and 3D volume segmentation problems.
    Download the paper here.
    Download the Matlab code here.

    Hidden Markov Random Field Model, its Expectation-Maximization Algorithm, Implementation, and Applications in Edge-Prior-Preserving Image Segmentation

    This is the final project of Prof. Birsen Yazıcı's course Detection and Estimation Theory. In this project, we study the hidden Markov random field (HMRF) model and its expectation-maximization (EM) algorithm. We implement a MATLAB toolbox named HMRF-EM-image for 2D image segmentation using the HMRF-EM framework. This toolbox also implements edge-prior-preserving image segmentation, and can be easily reconfigured for other problems, such as 3D image segmentation.
    Download the paper here.
    Download the HMRF-EM-image Matlab toolbox here.

    Kernel Principal Component Analysis and its Applications in Face Recognition and Active Shape Models

    This is the final project of Prof. Qiang Ji's course Pattern Recognition. In this paper, we discussed the theories of PCA, kernel PCA and ASMs. Then we focused on the pre- image reconstruction for Gaussian kernel PCA, and used this technique to design kernel PCA based ASMs. We tested kernel PCA on synthetic data and human face images, and found that Gaussian kernel PCA succeeded in revealing more complicated structures of data than traditional PCA and achieving much lower classification error rate. We also implemented the Gaussian kernel PCA based ASMs and tested it on human face images. We found that Gaussian kernel PCA based ASMs is promising in providing more deformation patterns than traditional ASMs.
    Download the paper here.
    Download the PPT here.
    Download the Matlab code here.

    Tracking Based 3D Visualization from 2D Videos

    This is the final project of Prof. Qiang Ji's course Computer Vision. In this project, we established a framework to convert 2D videos to pseudo 3D videos. Our basic idea is to track the moving objects in the video and separate them from the background. Then we give different depth information to the objects and the background, and visualize them in 3D. Download the report here.

    Here is a demo of our 3D animations. Please wear blue-red 3D glasses.

    Hästens app on iPhone

    This is the final project for the course Software Design & Documentation at RPI. This is our project website.

    Here is the video presentation of the app:



    Teaching

    I have been working as the teaching assistant of these courses at RPI:

  • Embedded Control [ENGR 2350], 2011 Spring, Prof. Russell P. Kraft
  • Real-Time Applications in Control & Communications [ECSE 4760], 2011 Spring, Prof. Russell P. Kraft
  • Introduction to Engineering Analysis [ENGR 1100], 2011 Fall, Prof. Mark W. Olles
  • Biological Image Ananysis [ECSE 4960], 2012 Spring, Dr. Jens Rittscher
  • Electric Circuits [ECSE 2010], 2012 Spring, Prof. Jeffrey Braunstein
  • Modeling and Analysis of Uncertainty [ENGR 2600], 2012 Fall, Prof. Charles J. Malmborg


  • Here are some of the course materials I made for my students:
  • Matlab Tutorial 1
  • Matlab Tutorial 2
  • Matlab Tutorial 3
  • Accessing RCS IBM Console in Windows Using Linux Virtual Machine
  • how to build SimpleITK Python
  • Courses and Study

    My GPA at RPI is 4.0 out of 4.0. I have been taking these courses at RPI:

  • Operating Systems by Prof. David E. Goldschmidt
  • Detection and Estimation Theory by Prof. Birsen Yazici
  • Introduction to Stochastic Signals and Systems by Prof. John Woods
  • Computational Linear Algebra by Prof. Donald Schwendeman
  • Pattern Recognition by Prof. Qiang Ji
  • Computational Optimization by Prof. Kristin P. Bennett
  • Computer Vision by Prof. Qiang Ji
  • Machine Learning by Prof. Malik Magdon-Ismail
  • Biological Image Ananysis by Dr. Jens Rittscher
  • Software Design and Documentation by John Sturman
  • Probabilistic Graphic Models by Prof. Qiang Ji
  • Graph Theory by Prof. Mark K. Goldberg
  • Database Systems by Prof. Sibel Adali
  • Data Science by Prof. Peter Fox
  • Compressed Sensing and its Applications by Prof. Meng Wang
  •