Syllabus
Unit I
Introduction to Pattern Recognition, Introduction – Pattern recognition systems – the design cycle – learning and adaptation – Applications of Pattern recognition – statistical decision theory – Examples on pattern recognition, and image processing and analysis.
Unit II
Parametric methods of Classification, Introduction – Bayes theorem and Bayesian decision making – classifications based on single and multiple features – conditionally independent features – discrete and continuous features – Gaussian case and general theory – discriminant functions, decision boundaries and decision regions –– problems of dimensionality – components analysis and discriminants – Minimum error rate classification – Receiver Operating characteristic curves – Estimation of the composition of populations based on machine learning classification.
Unit III
Nonparametric methods Classification, Introduction – histograms – density estimation –mixture densities – kernel and window estimators – nearest neighbor classification techniques – rules and distance metrics – single and k-nearest neighbor techniques –adaptive decision boundaries and discriminant functions – minimum squared error discriminant functions.
Unit IV
Nonmetric methods of classification, Introduction to Nonmetric methods – decision trees and decision regions– CART methods – algorithm-independent machine learning – lack of inherent superiority of any classifier – bias and variance for regression and classification – resampling or estimating statistics – jackknife and bootstrap resampling methods.
Unit V
Methods of Clustering, Introduction to unsupervised learning and clustering – data description and clustering – criterion functions for clustering – hierarchical clustering – single linkage algorithm, complete linkage algorithm, average linkage algorithm and Ward’s algorithm – partitional clustering – Forgy’s algorithm – and k-means algorithm.
Text Books / References
Text Books/References Books:
- Richard O. Duda, Peter E. Hart and David G. Stork, Pattern Classification, Second Edition, 2003, John Wily & Sons.
- Earl Gose, Richard Johnsonbaugh and Steve Jost, Pattern Recognition and Image Analysis, 2002, Prentice Hall of India.