CAP 5415 Computer Vision
description
Transcript of CAP 5415 Computer Vision
![Page 1: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/1.jpg)
CAP 5415 Computer Vision
![Page 3: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/3.jpg)
Course Office hours
Monday 3.00pm-4.30pm Wednesday 3.00pm-4.30pm
Grading Midterms (2) 20% Final 30% Assignments (bi-weekly) %20 Projects (2) %30
Class notes “Fundamentals of computer vision”, Dr. Mubarak Shah
available on web page (http://www.cs.ucf.edu/courses/cap6411/book.pdf)
Text book “Introductory Techniques for 3D Computer Vision” Trucco
and Verri, Prentice Hall.
![Page 4: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/4.jpg)
Topics We’ll Cover Imaging Geometry Camera Modeling and Calibration Filtering and Enhancing Images Region Segmentation Color and Texture Line and Curve Detection Shape Analysis Stereo Motion and Optical Flow Structure from X
We may change order
![Page 5: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/5.jpg)
Computer Vision
Image Analysis Single frame Image Understanding
Video Analysis Multiple frames, temporal information Video Understanding
![Page 6: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/6.jpg)
Generating an Image
3D Scene Surface reflectance Surface structure (shape)
Light source Camera
![Page 7: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/7.jpg)
Perspective Projection
Image
pla
ne
3D world
Pin
hole
ca
mera
Z
f
(X,Y,Z)
y
Z
Yfy
Z
Xfx
![Page 8: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/8.jpg)
Orthographic Projection
Image
pla
ne
3D world
Z
(X,Y,Z)y
Yy
Xx
![Page 9: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/9.jpg)
Discrete Domain Image Set of integer values in two
dimensions 0-255
Gray level image (1 matrix 0: Black 255: White
Color image (3 matrices) Red, Green, Blue
Resolution Number of rows, number of columns
![Page 10: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/10.jpg)
Video
Sequence of image Frames per second Gray level video Color video
![Page 11: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/11.jpg)
Digitization
Analog camera Analog to Digital converter Frame grabber
Digital camera Already digitized MPEG or JPEG
![Page 12: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/12.jpg)
Image Formats
TIFF JPEG PGM, PPM PNM BMP MPEG Quick Time…
![Page 13: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/13.jpg)
Computer Vision
Shape From “X” Shading (single image) Texture (single image) Stereo (two images) Motion (multiple images)
![Page 14: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/14.jpg)
Stereo
![Page 15: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/15.jpg)
http://www.vision3D.com/stereo.html
![Page 16: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/16.jpg)
Example
![Page 17: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/17.jpg)
Stereo Pair
![Page 18: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/18.jpg)
Stereo Fun
candy dinosaur shark
![Page 19: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/19.jpg)
Shape from Shading
![Page 20: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/20.jpg)
Lambertian Surface Model
lightsource
surfacenormal
),,).(,,(.),( zyxzyx lllnnnLNyxf
),,)).(1,,(1
1(.),(
22 zyx lllqpqp
LNyxf
![Page 21: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/21.jpg)
Sphere Example
),,(1
),,(
222
zyxR
nnn
z
y
y
zq
z
x
x
zp
yxRz
zyx
![Page 22: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/22.jpg)
Vase Image
(1, 0, 1) (-1, 1, 1) (-1,-1, 1)
![Page 23: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/23.jpg)
Object Motion
VideoSequence of images
![Page 24: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/24.jpg)
An Image from Hamburg Taxi Sequence
![Page 25: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/25.jpg)
Video Mosaics
![Page 26: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/26.jpg)
Vision Lab. Sequence
![Page 27: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/27.jpg)
Beach Volley Sequence
![Page 28: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/28.jpg)
Sprite
![Page 29: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/29.jpg)
Tracking in Multiple Cameras
Find field of view (FOV) lines Detect objects Associate objects
![Page 30: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/30.jpg)
Story Segmentation
![Page 31: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/31.jpg)
![Page 32: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/32.jpg)
![Page 33: CAP 5415 Computer Vision](https://reader036.fdocuments.es/reader036/viewer/2022062314/5681460d550346895db31ce3/html5/thumbnails/33.jpg)
Explosion/fire Detection