We focus on addressing challenging computer vision problems including, but not limited to, hand gesture recognition, object recogntition, detection and 6 DoF pose estimation, active robot vision, multiple object tracking, face analysis and recognition, underwater vision and photometric stereo and activity recognition. You can also find additional info and videos in the individual webpages of our team members or in our YouTube channel.

 
 
6 DoF object pose estimation and robot vision Hand gesture recognition Multiple object tracking Face analysis and recognition Activity recognition Underwater vision and photometric stereo
 
 
Research in Object Recognition, Detection and 6D Pose Estimation (Workshops, Publications, Datasets)
 
 
 

S. Kasaei, J. Sock, L. Lopes, A. Tome, T-K. Kim, Perceiving, Learning, and Recognizing 3D Objects: An Approach to Cognitive Service Robots, Proc. of the Association for the Advancement of Artificial Intelligence (AAAI), New Orleans, USA, 2018 (accept rate<25%).

Download: pdf

Topic: Object detection and 6 DoF pose estimation

 

V. Balntas, A. Doumanoglou, C. Sahin, J. Sock, R. Kouskouridas, T-K. Kim, Pose Guided RGBD Feature Learning for 3D Object Pose Estimation, Proc. of IEEE Int. Conf. on Computer Vision (ICCV), Venice, Italy, 2017.

Download: pdf

Topic: Object detection and 6 DoF pose estimation

 

J. Sock, S. Kasaei, L. Lopes, T.-K. Kim, Multi-view 6D Object Pose Estimation and Camera Motion Planning using RGBD Images, Proc. of IEEE ICCV 3rd workshop on Recovering 6D Object Pose, Venice, Italy, 2017.

Download: pdf

Topic: Object detection and 6 DoF pose estimation

 

C. Sahin, R. Kouskouridas, T-K. Kim, A Learning-based Variable Size Part Extraction Architecture for 6D Object Pose Recovery in Depth Images, Journal of Image and Vision Computing (IVC), 63:38-50, 2017.

Download: pdf

Topic: Object detection and 6 DoF pose estimation

 

Y. Liu, M. Hoai, M. Shao, T-K. Kim, Latent Bi-constraint SVM for Video-based Object Recognition, IEEE Trans. on Circuit and System for Video Technology (TCSVT), accepted to appear, 2017.

Download: pdf

Topic: Object detection and 6 DoF pose estimation

 

A. Doumanoglou, R. Kouskouridas, S. Malassiotis, T-K. Kim, Recovering 6D Object Pose and Predicting Next-Best-View in the Crowd, Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Las Vegas, USA, 2016.

Download: pdfDataset / Project page

Topic: Object detection and 6 DoF pose estimation

 

A. Doumanoglou, J. Stria, G. Peleka, I. Mariolis, V. Petrik, A. Kargakos, L. Wagner, V. Hlavac, T-K. Kim,S. Malassiotis, Folding Clothes Autonomously: A Complete Pipeline, IEEE Transactions on Robotics, 2016.

Download: pdf

Topic: Active robot vision, cloth recognition

 

C. Sahin, R. Kouskouridas, T-K. Kim, Iterative Hough Forest with Histogram of Control Points for 6 DoF Object Registration from Depth Images, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea, 2016.

Download: pdf

Topic: Object detection and 6 DoF pose estimation

 

A. Doumanoglou, T-K. Kim, X. Zhao, S. Malassiotis, Active Random Forests: An application to Autonomous Unfolding of Clothes, Proc. of European Conference on Computer Vision (ECCV), Zurich, Switzerland, 2014.

Download: pdf

Topic: Active robot vision, cloth recognition

 

A. Doumanoglou, A. Kargakos, T-K. Kim, S. Malassiotis, Autonomous Active Recognition and Unfolding of Clothes using Random Decision Forests and Probabilistic Planning, Proc. of IEEE Int. Conf. on Robotics and Automation (ICRA), Hong Kong, China, 2014 (KUKA best service robotics paper award).

Download: pdfSlidesIEEE Spectrum Article

Topic: Active robot vision, cloth recognition

A. Tejani, D. Tang, R. Kouskouridas, T-K. Kim, Latent-Class Hough Forests for 3D Object Detection and Pose Estimation, Proc. of European Conference on Computer Vision (ECCV), Zurich, Switzerland, 2014.

Download: pdfAdditional VideoDataset / Project page

Topic: Object detection and 6 DoF pose estimation

 

Y. Liu*, Y. Jang*, W. Woo, T-K. Kim, Video-based Object Recognition using Novel Set-of-Sets Representation, Proc. of 3rd Workshop on Egocentric (First-person) Vision (In conjunction with CVPR), Columbus, Ohio, USA, 2014.

Download: pdf

Topic: Object recognition

 

Y. Chen, T-K. Kim, R. Cipolla, Inferring 3D Shapes and Deformations from Single Views, Proc. of European Conference on Computer Vision (ECCV), Crete, Greece, 2010.

Download: pdf

Topic: Object recognition

 
3D Articulated Hand Pose Estimation with Single Depth Images
 

S. Baek, K.I. Kim, T-K. Kim, Augmented skeleton space transfer for depth-based hand pose estimation, Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, (CVPR), Salt Lake City, Utah, USA, 2018.

Download: pdf, soon –

Topic: Hand gesture recognition

 

G. Garcia-Hernando, S. Yuan, S. Baek, T-K. Kim, First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotations, Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, (CVPR), Salt Lake City, Utah, USA, 2018.

Download: pdfDataset

Topic: Hand gesture recognition

 

S. Yuan, G. Garcia-Hernando, B. Stenger, G. Moon, J. Y. Chang, K. M. Lee, P. Molchanov, J. Kautz, S. Honari, L. Ge, J. Yuan, X. Chen, G. Wang, F. Yang, K. Akiyama, Y. Wu, Q. Wan, M. Madadi, S. Escalera, S. Li, D. Lee, I. Oikonomidis, A. Argyros, T-K. Kim, 3D Hand Pose Estimation: From Current Achievements to Future Goals, Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, (CVPR), Salt Lake City, Utah, USA, 2018.

Download: pdfDataset

Topic: Hand gesture recognition

 

S. Yuan, Q. Ye, B. Stenger, S. Jain, T-K. Kim, Big Hand 2.2M Benchmark: Hand Pose Data Set and State of the Art Analysis, Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, (CVPR), Honolulu, Hawaii, USA, 2017.

Download: pdfDataset

Topic: Hand gesture recognition

 

Q. Ye*, S. Yuan*, T-K. Kim, Spatial Attention Deep Net with Partial PSO for Hierarchical Hybrid Hand Pose Estimation, Proc. of European Conf. on Computer Vision (ECCV), Amsterdam, Netherlands, 2016 (*indicates equal contribution).

Download: pdfVideoProject page

Topic: Hand gesture recognition

 

Y. Jang, I. Jeon, T-K. Kim, W. Woo, SD Gesture: Static and Dynamic Gesture Estimation for Manipulating a Function-Equipped AR Object, IEEE Trans. on Human-Machine Systems, accepted to appear, 2016 (also received the best poster award at IEEE CVPR workshop on HANDS 2016).

Download: pdf

Topic: Hand gesture recognition

 

D. Tang, J. Taylor, P. Kholi, C. Keskin, T-K. Kim, J. Shotton, Opening the Black Box: Hierarchical Sampling Optimization for Estimating Human Hand Pose, Proc. of IEEE Int. Conf. on Computer Vision (ICCV), Santiago, Chile, 2015 (oral).

Download: pdf

Topic: Hand gesture recognition

 

M. Hameed , G. Garcia, T-K. Kim, Novel Spatio-temporal Features for Fingertip Writing Recognition in Egocentric Viewpoint, Proc. of IAPR Conf. on Machine Vision Applications (MVA), Tokyo, Japan, May 2015.

Download: pdf

Topic: Fingertip recognition

 

D. Tang, H.J. Chang*, A. Tejani*, T-K. Kim, Latent Regression Forest: Structural Estimation of 3D Articulated Hand Posture, Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Columbus, USA, 2014 (oral, accept rate=5.75%, * indicates equal contribution).

Download: pdfDataset / Project page

Topic: Hand gesture recognition

 

D. Tang, T.H. Yu and T-K. Kim, Real-time Articulated Hand Pose Estimation using Semi-supervised Transductive Regression Forests, Proc. of IEEE Int. Conf. on Computer Vision (ICCV), Sydney, Australia, 2013 (oral, accept rate=41/1629).

Download: pdf

Topic: Hand gesture recognition

 

Y. Jang, S. Noh, H. Chang, T-K. Kim, W. Woo, 3D Finger CAPE: Clicking Action and Position Estimation under Self-Occlusions in Egocentric Viewpoint, Proc. of IEEE Virtual Reality (VR), Arles, France, 2015 (full paper, accept rate=13.8% (13/94)), also in IEEE Trans. on Visualization and Computer Graphics, 21(4):501-510, Apr 2015.

Download: pdfProject page

Topic: Hand gesture recognition, virtual reality

 

B. Stenger, T. Woodley, T-K. Kim, R. Cipolla, A Vision-based Interface for Display Interaction, HCI 2009 - 23rd BCS Conference on Human-Computer Interaction, Cambridge, UK, Sep 2009.

Download: pdf

Topic: Hand recognition

 

T-K. Kim and R. Cipolla, Gesture Recognition Under Small Sample Size, In Proc. 8th Asian Conf. on Computer Vision (ACCV) (Lecture Notes in Computer Science), Tokyo, Japan, November 2007 (Oral, 8.4% acceptance ratio)

Download: pdf

Topic: Hand recognition

W. Luo, B. Stenger, X. Zhao, T-K. Kim, Automatic Topic Discovery for Multi-object Tracking, Proc. of the Association for the Advancement of Artificial Intelligence (AAAI), Austin Texas, USA, 2015 (oral).

Download: pdf

Topic: Multiple object tracking

 

W. Luo, T-K. Kim, B. Stenger, X. Zhao, R. Cipolla, Bi-label Propagation for Generic Multiple Object Tracking, Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Columbus, Ohio, USA, 2014.

Download: pdf

Topic: Multiple object tracking

 

W. Luo and T-K. Kim, Generic Object Crowd Tracking by Multi-Task Learning, Proc. of British Machine Vision Conference (BMVC), Bristol, UK, 2013.

Download: pdf

Topic: Multiple object tracking

 

D. Tang, Y. Liu and T-K. Kim, Fast Pedestrian Detection by Cascaded Random Forest with Dominant Orientation Templates, Proc. of British Machine Vision Conference (BMVC), Surrey, UK, 2012.

Download: pdf

Topic: Pedestrian detection

 

T-K. Kim, T. Woodley, B. Stenger, R. Cipolla, Online Multiple Classifier Boosting for Object Tracking, Proc. of IEEE CVPR workshop on Online Learning for Computer Vision, San Francisco, USA, Jun 2010 (oral).

Download: pdf

Topic: Object tracking

B. Gecer, V. Balntas, and T-K. Kim, Learning Deep Convolutional Embeddings for Face Representation Using Joint Sample- and Set-based Supervision, Proc. of IEEE ICCV workshop on Analysis and Modeling of Faces and Gestures (AMFG), Venice, Italy, 2017.

Download: pdf

Topic: Face verification, deep learning

 

C. Xiong, X. Zhao, D. Tang, S. Yan, T-K. Kim, Conditional Convolutional Neural Network for Modality-aware Face Recognition, Proc. of IEEE Int. Conf. on Computer Vision (ICCV), Santiago, Chile, 2015.

Download: pdf

Topic: Face verification, deep learning

 

C. Xiong, L. Liu, X. Zhao, S. Yan, T-K. Kim, Convolutional Fusion Network for Face Verification in the Wild, Accepted to appear in IEEE Trans. on Circuits and Systems for Video Technology, 2015.

Download: pdf

Topic: Face verification, deep learning

 

X. Zhao, T-K. Kim, W. Luo, Unified Face Analysis by Iterative Multi-Output Random Forests, Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Columbus, Ohio, USA, 2014.

Download: pdf

Topic: Face analysis

 

C. Xiong, G. Gao, S. Yan, Z. Zha, H. Ma, T-K. Kim, Adaptive Learning for Celebrity Identification with Video Context, IEEE Trans. on Multimedia, Vol.16, No.5, Aug 2014.

Download: pdf

Topic: Face analysis

 

Y. Pei, T-K. Kim and H. Zha, Unsupervised Random Forest Manifold Alignment for Lipreading, Proc. of IEEE Int. Conf. on Computer Vision (ICCV), Sydney, Australia, 2013.

Download: pdf

Topic: Face analysis

 

C. Xiong and T-K. Kim, Set-Based Label Propagation of Face Images, Proc. of IEEE International Conference on Image Processing (ICIP), Orlando, Florida, USA, Oct 2012.

Download: pdf

Topic: Face analysis

 

T-K. Kim, I. Budvytis, R. Cipolla, Making a Shallow Network Deep: Conversion of a Boosting Classifier into a Decision Tree by Boolean Optimisation, International Journal of Computer Vision (IJCV), 100(2):203-215, 2012 (BMVC10 special issue, online first published, June 2011).

Download: pdf

Topic: Face analysis

 

T-K. Kim, B. Stenger, J. Kittler and R. Cipolla, Incremental Linear Discriminant Analysis Using Sufficient Spanning Sets and Its Applications, International Journal of Computer Vision (IJCV), 91(2):216-232, Jan 2011.

Download: pdf

Topic: Face analysis

 

U. Bonde, T-K. Kim, K.R. Ramakrishnan, Randomised Manifold Forests for Principal Angle based Face Recognition, Proc. of Asian Conf. on Computer Vision (ACCV), Queenstown, New Zealand, 2010.

Download: pdf

Topic: Face analysis

 

T-K. Kim*, I. Budvytis*, R. Cipolla, Making a Shallow Network Deep: Growing a Tree from Decision Regions of a Boosting Classifier, Proc. of British Machine Vision Conference (BMVC), Aberystwyth, UK, 2010 (oral, accept rate=30/345) * indicates equal contribution.

Download: pdfSlides

Topic: Face analysis

 

T-K. Kim, J. Kittler, R. Cipolla, On-line Learning of Mutually Orthogonal Subspaces for Face Recognition by Image Sets, IEEE Trans. on Image Processing (TIP), 19(4):1067-1074, April 2010.

Download: pdf

Topic: Face analysis

 

T-K. Kim, J. Kittler and R. Cipolla, Discriminative Learning and Recognition of Image Set Classes Using Canonical Correlations, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol.29, No.6, 2007 (Regular paper)

Download: pdf

Topic: Face analysis

 

T-K. Kim and J. Kittler, Locally Linear Discriminant Analysis for Multi-modally Distributed Classes for Face Recognition with a Single Model Image, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol.27, No.3, pp.318-327, 2005 (Regular paper).

Download: pdf

Topic: Face analysis

 

T-K. Kim and J. Kittler, Design and Fusion of Pose Invariant Face Identification Experts, IEEE Transactions on Circuit and System for Video Technology, Vol.16, No.9, pp.1096-1106, 2006.

Download: pdf

Topic: Face analysis

 

T-K. Kim, O. Arandjelovic and R. Cipolla, Learning over Sets using Boosted Manifold Principal Angles (BoMPA), IAPR British Machine Vision Conference (BMVC), pp.779-788, Oxford, U.K., Sept 2005.

Download: pdf

Topic: Face analysis

 

T-K. Kim and J. Kittler, Locally Linear Discriminant Analysis for Multi-modally Distributed Classes for Face Recognition with a Single Model Image, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol.27, No.3, pp.318-327, 2005 (Regular paper)

Download: pdf

Topic: Face analysis

 

T-K. Kim, H. Kim, W. Hwang and J. Kittler, Component-based LDA Face Description for Image Retrieval and MPEG-7 Standardisation, Image and Vision Computing, Vol.23, No.7, pp.631-642, 2005.

Download: pdf

Topic: Face analysis

 

T-K. Kim and J. Kittler, Composite Support Vector Machines with the Extended Discriminative Features For Accurate Face Detection, IEICE Transactions on Information & Systems, Vol.E88-D, No.10, Oct 2005.

Download: pdf

Topic: Face analysis

G. Garcia-Hernando, T-K. Kim, Transition Forests: Learning Discriminative Temporal Transitions for Action Recognition and Detection, Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Honolulu, Hawaii, USA, 2017.

Download: pdf

Topic: Action / activity recognition

 

Z. Shi, T-K. Kim, Learning and Refining of Privileged Information-based RNNs for Action Recognition from Depth Sequences, Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Honolulu, Hawaii, USA, 2017.

Download: pdf

Topic: Action / activity recognition

 

S. Baek, Z. Shi, M. Kawade, T-K. Kim, Kinematic-layout-aware Random Forests for Depth-based Action Recognition, Proc. of British Machine Vision Conference (BMVC), London, UK, 2017 (oral, accept rate = 5.6%).

Download: pdf

Topic: Action / activity recognition

 

S. Baek, K. I. Kim, T-K. Kim, Real-time online action detection forests using spatio-temporal contexts, Proc. of IEEE Winter Conference on Applications of Computer Vision (WACV), Santa Rosa, CA, USA, 2017.

Download: pdf

Topic: Action / activity recognition

 

I. Serrano, G. Garcia-Hernando, O. Deniz, G. Bueno and T-K. Kim, Spatio-Temporal Elastic Cuboid Trajectories for Efficient Fight Recognition Using Hough Forests, Journal of Machine Vision Application, accepted to appear, 2017.

Download: pdf

Topic: Action / activity recognition

 

K. Lee, D. Ognibene, H. Chang, T-K. Kim, Y. Demiris, STARE: Spatio-Temporal Attention Relocation for Multiple Structured Activities Detection, IEEE Trans. on Image Processing (TIP), 24(12):5916-5927, 2015.

Download: pdf

Topic: Action / activity recognition

 

O. Deniz, I. Serrano, G. Bueno and T-K. Kim, Fast Violence Detection in Video, The 9th International Conference on Computer Vision Theory and Applications (VISAPP), Lisbon, Portugal, 2014(oral).

Download: pdf

Publication year 2014

 

T.H. Yu, T-K. Kim, and R. Cipolla, Unconstrained Monocular 3D Human Pose Estimation by Action Detection and Cross-modality Regression Forest, Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Portland, Oregon, USA, 2013.

Download: pdf

Topic: Action / activity recognition

 

K. Lee, Y. Su, T-K. Kim and Y. Demiris, A Syntactic Approach to Robot Imitation Learning using Probabilistic Activity Grammars, Robotics and Autonomous Systems Journal (RAS), Elsevier, Volume 61, Issue 12, pp.1323-1334, 2013.

Download: pdf

Topic: Action / activity recognition

 

K. Lee, T-K. Kim and Y. Demiris, Learning Reusable Task Components using Hierarchical Activity Grammars with Uncertainties, Proc. of IEEE International Conference on Robotics and Automation (ICRA), Saint Paul, Minnesota, USA, May 2012 (oral).

Download: pdf

Topic: Action / activity recognition

 

K. Lee, T-K. Kim and Y. Demiris, Learning Action Symbols for Hierarchical Grammar Induction, Proc. of International Conference on Pattern Recognition (ICPR), Tsukuba Science City, Japan, Nov 2012 (oral).

Download: pdf

Topic: Action / activity recognition

 

Y. Chen, T-K. Kim and R. Cipolla, Silhouette-based Object Phenotype Recognition Using 3D Shape Priors, Proc. IEEE 13th Int. Conf. on Computer Vision (ICCV), Barcelona, Spain, November 2011.

Download: pdf

Topic: Action / activity recognition

 

T.H. Yu, T-K. Kim, R. Cipolla, Real-time Action Recognition by Spatiotemporal Semantic and Structural Forest, Proc. of British Machine Vision Conference (BMVC), Aberystwyth, UK, 2010 (oral, accept rate=30/345).

Download: pdf

Topic: Action / activity recognition

 

T-K. Kim and R. Cipolla, Canonical Correlation Analysis of Video Volume Tensors for Action Categorization and Detection, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 31(8):1415-1428, 2009 (Regular paper).

Download: pdf

Topic: Action / activity recognition

 

S-F. Wong, T-K. Kim and R. Cipolla, Learning Motion Categories Using Both Semantic and Structural Information, In Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Minneapolis, MN, 2007.

Download: pdf

Topic: Action / activity recognition

 

T-K. Kim, S-F. Wong and R Cipolla, Tensor Canonical Correlation Analysis for Action Classification, In Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Minneapolis, MN, 2007.

Download: pdf

Topic: Action / activity recognition

C. Tsiotsios, A.J. Davison, T-K. Kim, Near-lighting Photometric Stereo for Unknown Scene Distance and Medium Attenuation, Journal of Image and Vision Computing (IVC), 57:44-57, 2017.

Download: pdf

Topic: Underwater vision, image restoration

 

C. Tsiotsios, M. Angelopoulou, T-K. Kim, A. Davison, Backscatter Compensated Photometric Stereo with 3 Sources, Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Columbus, Ohio, USA, 2014.

Download: pdf

Topic: Underwater vision, image restoration