2020 Fall
ELENG 290 002 - LEC 002
Advanced Topics in Electrical Engineering
High-dimensional Data Analysis with Low-dimensional Models (Theory, Computation, and Applications)
Yi Ma
Aug 26, 2020 - Dec 11, 2020
Tu, Th
03:30 pm - 04:59 pm
Internet/Online
Class #:19406
Units: 3
Instruction Mode:
Remote Instruction
Offered through
Electrical Engineering and Computer Sciences
Current Enrollment
Total Open Seats:
0
Enrolled:
Waitlisted:
Capacity:
Waitlist Max:
No Reserved Seats
Hours & Workload
1 to 3 hours of instructor presentation of course materials per week, and 2 to 9 hours of outside work hours per week.
Course Catalog Description
The 290 courses cover current topics of research interest in electrical engineering. The course content may vary from semester to semester.
Class Description
This 3-unit graduate level course introduces basic geometric and statistical concepts and principles of low-dimensional models for high-dimensional signal and data analysis, spanning basic theory, efficient algorithms, and diverse applications. We will discuss recovery theory, based on highdimensional geometry and non-asymptotic statistics, for sparse, low-rank, and low-dimensional models – including compressed sensing theory, matrix completion, robust principal component analysis, and dictionary learning etc. We will introduce principled methods for developing efficient optimization algorithms for recovering low-dimensional structures, with an emphasis on scalable and efficient first-order methods, for solving the associated convex and nonconvex problems. We will illustrate the theory and algorithms with numerous application examples, drawn from computer vision, image processing, audio processing, communications, scientific imaging, bioinformatics, information retrieval etc. The course will provide ample mathematical and programming exercises with supporting algorithms, codes, and data. A final course project will give students additional hands-on experience with an application area of their choosing. Throughout the course, we will discuss strong conceptual, algorithmic, and theoretical connections between low-dimensional models with other popular data-driven methods such as deep neural networks (DNNs), providing new perspectives to understand deep learning.
Prerequisites: Linear algebra and probability. Background in signal processing, optimization, and statistics may allow you to appreciate better certain aspects of the course material, but not necessary all at once. If you’re curious about whether you would benefit from this course, contact the instructor for details. The course is open to senior undergraduates, with consent from the instructor.
Class Notes
MENG students are blocked from enrolling in this class because they will be enrolled by their advisor. Please contact your advisor for more information.
Rules & Requirements
Repeat Rules
Reserved Seats
Current Enrollment
No Reserved Seats
Textbooks & Materials
See class syllabus or https://calstudentstore.berkeley.edu/textbooks for the most current information.
Guide to Open, Free, & Affordable Course Materials
Associated Sections
None