|
1 Multi-modal Manhattan World Structure Estimation for Domestic Robots |
|
|
1 | (18) |
|
|
Karthik Mahesh Varadarajan |
|
|
|
|
|
2 | (3) |
|
|
5 | (2) |
|
1.2.1 Multi-modal Plane Estimation |
|
|
5 | (2) |
|
1.2.2 Multi-modal Planar Modeling for Robotics |
|
|
7 | (1) |
|
1.3 Relationship between Pairwise Data |
|
|
7 | (3) |
|
1.3.1 Generalized Distance Matrix |
|
|
8 | (1) |
|
1.3.2 Jensen-Shannon Divergence (JSD) |
|
|
9 | (1) |
|
1.4 Modeling and Selection of Inliers |
|
|
10 | (1) |
|
|
11 | (4) |
|
|
15 | (4) |
|
|
16 | (3) |
|
2 RMSD: A 3D Real-Time Mid-level Scene Description System |
|
|
19 | (14) |
|
|
|
|
19 | (4) |
|
|
23 | (1) |
|
|
24 | (2) |
|
2.3.1 Line Segment Extraction |
|
|
25 | (1) |
|
|
26 | (1) |
|
|
26 | (1) |
|
|
26 | (2) |
|
|
28 | (2) |
|
2.5.1 3D Kinect Experiments |
|
|
28 | (1) |
|
|
29 | (1) |
|
2.5.3 Mobile Robot Experiment |
|
|
29 | (1) |
|
2.6 Conclusion and Future Work |
|
|
30 | (3) |
|
|
30 | (3) |
|
3 Semantic and Spatial Content Fusion for Scene Recognition |
|
|
33 | (22) |
|
|
|
|
|
33 | (2) |
|
|
35 | (1) |
|
3.3 Overview of the Proposed Framework |
|
|
36 | (1) |
|
3.4 Feature Extraction and Representation |
|
|
37 | (2) |
|
3.4.1 Capturing Semantic Information |
|
|
37 | (1) |
|
3.4.2 Capturing Contextual Information |
|
|
38 | (1) |
|
3.4.3 Capturing Spatial Location Information |
|
|
38 | (1) |
|
3.5 Spatial Semantic Feature Fusion (SSFF) |
|
|
39 | (6) |
|
3.5.1 Exemplar-Set Selection |
|
|
39 | (1) |
|
3.5.2 Learning Phase for SSFF Method |
|
|
40 | (5) |
|
3.5.3 Scene Type Recognition for SSFF Method |
|
|
45 | (1) |
|
|
45 | (7) |
|
3.6.1 Results on 15-Scene Dataset |
|
|
47 | (2) |
|
3.6.2 Results on MIT 67-Indoor Scenes Dataset |
|
|
49 | (3) |
|
|
52 | (3) |
|
|
52 | (3) |
|
4 Improving RGB-D Scene Reconstruction Using Rolling Shutter Rectification |
|
|
55 | (18) |
|
|
|
|
|
55 | (3) |
|
|
57 | (1) |
|
|
57 | (1) |
|
|
58 | (1) |
|
|
58 | (5) |
|
4.2.1 Synchronizing the Timestamps |
|
|
58 | (3) |
|
4.2.2 Relation of Coordinate Frames |
|
|
61 | (2) |
|
4.3 Depth Map Rectification |
|
|
63 | (2) |
|
|
63 | (1) |
|
|
64 | (1) |
|
|
65 | (5) |
|
|
65 | (1) |
|
4.4.2 Pan and Tilt Distortions |
|
|
66 | (3) |
|
|
69 | (1) |
|
|
70 | (3) |
|
|
70 | (3) |
|
5 Modeling Paired Objects and Their Interaction |
|
|
73 | (16) |
|
|
|
|
73 | (3) |
|
5.2 Human-Object-Object-Interaction Modeling |
|
|
76 | (7) |
|
5.2.1 Bayesian Network Model for HOO Interaction |
|
|
77 | (1) |
|
|
78 | (1) |
|
|
79 | (3) |
|
|
82 | (1) |
|
5.2.5 Bayesian Network Inference |
|
|
82 | (1) |
|
5.3 Experiments and Results |
|
|
83 | (2) |
|
|
85 | (4) |
|
|
85 | (4) |
|
6 Probabilistic Active Recognition of Multiple Objects Using Hough-Based Geometric Matching Features |
|
|
89 | (22) |
|
|
|
|
|
|
|
89 | (2) |
|
|
91 | (2) |
|
6.3 Active Recognition of a Single Object |
|
|
93 | (4) |
|
6.4 Active Recognition of Multiple Objects |
|
|
97 | (4) |
|
6.5 Relationship to Mutual Information |
|
|
101 | (1) |
|
|
102 | (6) |
|
|
108 | (3) |
|
|
108 | (3) |
|
7 Incremental Light Bundle Adjustment: Probabilistic Analysis and Application to Robotic Navigation |
|
|
111 | (26) |
|
|
|
|
111 | (3) |
|
|
114 | (2) |
|
7.2.1 Computationally Efficient Bundle Adjustment |
|
|
114 | (1) |
|
7.2.2 SLAM and Vision-Aided Navigation |
|
|
115 | (1) |
|
7.3 Incremental Light Bundle Adjustment |
|
|
116 | (4) |
|
|
116 | (1) |
|
7.3.2 Algebraic Elimination of 3D Points Using Three-View Constraints |
|
|
117 | (1) |
|
7.3.3 Incremental Smoothing |
|
|
118 | (2) |
|
7.4 Probabilistic Analysis of Light Bundle Adjustment |
|
|
120 | (7) |
|
7.4.1 Datasets for Evaluation and Implementation |
|
|
122 | (1) |
|
|
123 | (4) |
|
7.5 Application iLBA to Robotic Navigation |
|
|
127 | (7) |
|
|
128 | (1) |
|
7.5.2 Equivalent IMU Factor |
|
|
129 | (2) |
|
7.5.3 Evaluation in a Simulated Aerial Scenario |
|
|
131 | (3) |
|
7.6 Conclusions and Future Work |
|
|
134 | (3) |
|
|
135 | (2) |
|
8 Online Learning of Vision-Based Robot Control during Autonomous Operation |
|
|
137 | (20) |
|
|
|
|
137 | (2) |
|
|
139 | (3) |
|
|
139 | (1) |
|
8.2.2 Active Learning and Exploration |
|
|
140 | (1) |
|
8.2.3 Visual Autonomous Navigation |
|
|
140 | (1) |
|
8.2.4 Locally Weighted Projection Regression |
|
|
141 | (1) |
|
8.2.5 Numerical Optimization |
|
|
142 | (1) |
|
|
142 | (3) |
|
8.3.1 Learning Inverse Kinematics by Exploration |
|
|
143 | (1) |
|
8.3.2 Learning Autonomous Driving from Demonstration |
|
|
144 | (1) |
|
|
145 | (8) |
|
8.4.1 Learning from Exploration |
|
|
145 | (4) |
|
8.4.2 Learning from Demonstration |
|
|
149 | (4) |
|
|
153 | (4) |
|
|
154 | (3) |
|
9 3D Space Automated Aligning Task Performed by a Microassembly System Based on Multi-channel Microscope Vision Systems |
|
|
157 | (24) |
|
|
|
|
|
157 | (1) |
|
|
158 | (2) |
|
9.3 Features Selection and Relative Pose Calculation |
|
|
160 | (1) |
|
9.4 Coarse-to-Fine Alignment Strategy with Active Zooming Algorithm |
|
|
161 | (5) |
|
|
161 | (1) |
|
|
162 | (3) |
|
|
165 | (1) |
|
9.5 Vision Servo Control Based on Jacobian |
|
|
166 | (5) |
|
9.5.1 Image Jacobin Matrix Derivation |
|
|
167 | (1) |
|
9.5.2 Feature Select for the Image Jacobian Control |
|
|
168 | (1) |
|
9.5.3 Online Self-calibration for Jacobian |
|
|
169 | (1) |
|
9.5.4 Controller Design for Image Servo Based on Jacobian |
|
|
170 | (1) |
|
9.6 Experiments and Results |
|
|
171 | (8) |
|
|
171 | (1) |
|
9.6.2 Error Analysis for the Position-Based Method |
|
|
171 | (6) |
|
9.6.3 Image Servo Control Based on Jacobian Matrix |
|
|
177 | (2) |
|
|
179 | (2) |
|
|
179 | (2) |
|
10 Intensity-Difference Based Monocular Visual Odometry for Planetary Rovers |
|
|
181 | (18) |
|
|
|
181 | (3) |
|
10.2 Monocular Visual Odometry Algorithm |
|
|
184 | (7) |
|
10.2.1 Planet's Ground Surface Model |
|
|
185 | (1) |
|
10.2.2 Observation Points |
|
|
185 | (1) |
|
10.2.3 Conditional Probability of the Intensity Differences |
|
|
186 | (4) |
|
10.2.4 Maximizing the Conditional Probability |
|
|
190 | (1) |
|
10.2.5 Planet's Ground Surface Model Initialization |
|
|
190 | (1) |
|
10.3 Experimental Results |
|
|
191 | (4) |
|
10.4 Summary and Conclusions |
|
|
195 | (1) |
|
|
195 | (4) |
|
|
197 | (2) |
Author Index |
|
199 | |