BioE 2696/ECE 2695: Control Theory in Neuroscience (3 Credits, Spring 2009)

 

Description: Control theory has been an important tool for understanding the organization and operation of the nervous systems. This course introduces the general principles of control theory and its application in neuroscience.

 

Prerequisite: Knowledge of differential equations; instructor permission required for undergraduate enrollment.

 

Time: Monday 4:30 pm—5:45 (lecture); Wednesday 4:30 pm—5:45 (lecture) and 5:50—6:45 (recitation).

 

Instructors:

Aaron Batista, Room 4073 BST3, 412-383-5494, apb10@pitt.edu. Office hours: Thursdays 12:00 pm—2:00 pm. Location: Victoria Hall lounge.

Zhi-Hong Mao, 434 Benedum Hall, 412-624-9674, maozh@engr.pitt.edu. Office hours: Tuesdays 4:00 pm—6:00 pm. Location: 434 Benedum Hall.

 

Teaching Assistant:

Dan Bacher, dhb10@pitt.edu. Office hours: Fridays 1:00 pm—3:00 pm. Location: 1073 Benedum Hall. 

 

Guest Lecturers:

Doug Weber, Pat Loughlin, Mark Redfern, Raj Gandhi, Peter Strick, Steve Massaquoi, Robert Turner, et al. 

 

Textbook: No textbook required. Notes will be provided on the website morning of lecture, or distributed at the start of lecture.

 

Website: http://www.engr.pitt.edu/electrical/faculty-staff/mao/2696/

 

Evaluation: Homework and class participation 20%, literature report 15%, project 50%, and midterm exam 15%.

 

Schedule:

 

Date

Topic

Instructor

Assignments

Readings

1/5 M (Monday)

 

Course introduction; signals and systems I

 

Batista, Mao

HW 1 distributed

Heeger

1/7 W

(Wednesday)

Signals and systems II

Mao

 

 

 

1/7 WR (Wednesday, recitation)

 

Material review, HW 1 hints

 

Bacher

 

 

1/12 M

 

Control theory I

  

Mao

HW 1 due

HW 2 distributed

Bernstein

1/14 W

Neurophysiology I

Batista

 

 

 

 

1/14 WR

HW 1 review, HW 2 hints

Bacher

 

 

 

1/19 M

No class (Dr. Martin Luther King’s birthday observance) 

 

HW 3 distributed (data file, please unzip after downloading)

 

 

 

1/21 W

 

System identification (pdf file and ppt file)

 

Weber

HW 1 returned

(HW 1 solution)

HW 2 due

(1) Poppele & Terzuolo

(2) Humphrey

1/21 WR

Control theory II

Mao

 

 

 

1/26 M

 

Control theory III

 

Mao

HW 2 returned

(HW 2 solution)

HW 3 due

HW 4 distributed

Goodwin et al.

1/28 W

Lecture cancelled due to snow

 

 

 

2/2 M

Posture I 

Loughlin

Projects introduced

(guidelines)

(1) Peterka

(2) Winter et al.

2/4 W

 

Posture II

 

Loughlin

 

 

2/4 WR

HW review and hints

Bacher

 

 

 

2/9 M

Biomechanics I

Redfern

HW 3 returned

(HW 3 solution)

HW 4 due

HW 5 distributed

(data file, please unzip after downloading)

Exercise problems

2/11 W

 

Neurophysiology II

 

Batista

 

 

2/11 WR

 

Discussion of projects and literature report

 

 

(1) Control theoretic models of the oculomotor system: Robinson

(2) Computational models of the cerebellum: Mial et al.,  Wolpert et al. (two papers)

(3) Motor learning: Shadmehr and Mussa-Ivaldi

(4) Optimal control: Scott, Todorov (two papers)

(5) Sensory prediction: Crapse and Sommer

(6) Reinforcement learning: Schultz et al.

 

Literature review guidelines

 

2/16 M

Biomechanics II

Batista

HW 4 returned

HW 5 due

 

2/18 W

Eye movement I: behavior, anatomy, and physiology 

Gandni

 

 

(1) Goldberg et al.

(2) Sparks

(3) Van Gisbergen et al.

2/18 WR

Interim course review (notes from Batista and Mao)

Batista, Mao

 

 

 

2/23 M

Eye movement II: control model of saccades

Gandni

 

HW 5 returned

 

Arai et al.

 

2/25 W

Midterm

 

(exam covers through biomechanics II)

 

2/25 WR

(no recitation held)

 

 

3/2 M

Arm movement control models I

Batista

Project proposals due

(1) Bizzi et al.

(2) Harris and Wolpert

3/4 W

 

Optimization and optimal control

 

Mao

 

 

3/4 WR

Project proposal presentations

students

 

 

 

3/9 M

No class (spring break)

 

 

 

 

3/11 W

No class (spring break)

 

 

 

 

3/16 M

Arm movement control models II

Batista

 

 

 

 

3/18 W

Physiology III: Macro-architecture of basal ganglia and cerebellar loops with the cerebral cortex 

Strick

 

 

 

 

 

3/18 WR

Review of recent material

Bacher

 

 

 

3/23 M

 

Learning I: reach adaptation (file of high resolution)

 

Batista

 

 

3/25 W

 

To be announced

 

Massaquoi

 

 

3/25 WR

Review of recent material

Bacher

 

 

 

3/30 M

 

Learning II: VOR adaptation (file of high resolution)

 

Batista

 

 

4/1 W

Adaptive control and reinforcement learning theory 

Mao

 

From Batista:

(1) Updated literature review guidelines

(2) Project guidelines

 

4/1 WR

Review of recent material

Bacher

 

 

 

4/6 M

 

Reinforcement learning: physiology

 

Turner

 

(1) Schultz

(2) Redgrave et al.

(3) Niv and Schoenbaum

4/8 W

 

Visual stability corollary discharge

 

Sommer

 

Crapse and Sommer

4/8 WR

Review of recent material

Bacher

 

 

 

4/13 M

 

Project presentations I 

 

(1) Mike, Cliff, Greg

(2) Denis, Areej, Pooya

(3) Mircea

 

(1) Updated literature review guidelines

(2) Project guidelines

 

 

 

4/15 W

 

Project presentations II

 

(1) Husam, Alan, Nick

(2) Jordan, Sam, Iheanyi

(3) Shimeng, Joseph, Yuwen

(4) Noah, Josh

(5) Jason, Andrew, Shawn, Trevor

4/20 M

 

Project presentations III

 

(1) Wenchao

(2) Zhanpeng

(3) Uday

(4) Benjamin 

4/22 W

 

Literature review and final report due