The primary objective of this course is to present fundamental concepts and basic techniques of optimization with possible applications, which are essential for researches in circuit design, communications, signal processing, and control engineering. Topics include linear vector spaces and linear operators, linear estimation and filtering, functional analysis, optimal control, linear programming, nonlinear programming, dynamic programming, genetic programming (evolutionary computation), and neural networks.