2016-2017 2017-2018 2018-2019 2019-2020 2020-2021
 Browseby subject... Scheduleview...
 COVID-19 Scheduling Updates! Due to recent announcements about Autumn Quarter (see the President's update), please expect ongoing changes to the class schedule.

# 1 - 2 of 2 results for: MS&E 321: Stochastic Systems

## MS&E 321:Stochastic Systems

Topics in stochastic processes, emphasizing applications. Markov chains in discrete and continuous time; Markov processes in general state space; Lyapunov functions; regenerative process theory; renewal theory; martingales, Brownian motion, and diffusion processes. Application to queueing theory, storage theory, reliability, and finance. Prerequisites: 221 or STATS 217; MATH 113, 115. (Glynn)
Terms: Spr | Units: 3

## OIT 611:The Drift Method: from Stochastic Networks to Machine Learning

Overview: This course is an introduction to the drift method in sequential decision-making and stochastic systems, a family of simple, yet surprisingly powerful, meta-algorithms that in each step the greedily and incrementally minimizes some potential function. Manifested in various forms, the drift method powers some of the most popular algorithmic paradigms in stochastic networks (MaxWeight, BackPressure), oneline learning, optimization and machine learning (SGD, Langevin dynamics, TD-learning). Using the Drift Method as a unifying theme, we will survey major developments in these areas and answer questions such as: What may explain the method¿s effectiveness? How can we rigorously evaluate its performance? We will develop rigorous probabilistic and optimization methodologies for answering these questions, such as Lyapunov functions and stability theory, state-space collapse, weak convergence and Stein¿s method. In terms of application topics, the course is roughly evenly divided bet more »
Overview: This course is an introduction to the drift method in sequential decision-making and stochastic systems, a family of simple, yet surprisingly powerful, meta-algorithms that in each step the greedily and incrementally minimizes some potential function. Manifested in various forms, the drift method powers some of the most popular algorithmic paradigms in stochastic networks (MaxWeight, BackPressure), oneline learning, optimization and machine learning (SGD, Langevin dynamics, TD-learning). Using the Drift Method as a unifying theme, we will survey major developments in these areas and answer questions such as: What may explain the method¿s effectiveness? How can we rigorously evaluate its performance? We will develop rigorous probabilistic and optimization methodologies for answering these questions, such as Lyapunov functions and stability theory, state-space collapse, weak convergence and Stein¿s method. In terms of application topics, the course is roughly evenly divided between stochastic queueing networks versus optimization + machine learning. Objective: For students to acquire fundamental methodologies that can be applied to tackling problems in dynamic decision-making, stochastic modeling and machine learning. Target Audience: Graduate students / advanced undergraduates with a solid grasp of probability and stochastic processes (Stat 310A / MS&E 321, or equivalent). Strong background and interests in queueing networks is highly recommend.
Terms: Aut | Units: 3
Instructors: Xu, K. (PI)
Filter Results:
term offered
 Autumn Winter Spring Summer
updating results...
teaching presence
 in person remote: asynchronous remote: synchronous independent studies
updating results...
number of units
 1 unit 2 units 3 units 4 units 5 units >5 units
updating results...
time offered
 early morning (before 10am) morning (10am-12pm) lunchtime (12pm-2pm) afternoon (2pm-5pm) evening (after 5pm)
updating results...
days
 Monday Tuesday Wednesday Thursday Friday Saturday Sunday
updating results...
UG Requirements (GERs)
 WAY-A-II WAY-AQR WAY-CE WAY-ED WAY-ER WAY-FR WAY-SI WAY-SMA Language Writing 1 Writing 2 Writing SLE DB:Hum DB:Math DB:SocSci DB:EngrAppSci DB:NatSci EC:EthicReas EC:GlobalCom EC:AmerCul EC:Gender IHUM1 IHUM2 IHUM3
updating results...
component
 Lecture (LEC) Seminar (SEM) Discussion Section (DIS) Laboratory (LAB) Lab Section (LBS) Activity (ACT) Case Study (CAS) Colloquium (COL) Workshop (WKS) Independent Study (INS) Intro Dial, Sophomore (IDS) Intro Sem, Freshman (ISF) Intro Sem, Sophomore (ISS) Internship (ITR) Arts Intensive Program (API) Language (LNG) Clerkship (CLK) Practicum (PRA) Practicum (PRC) Research (RES) Sophomore College (SCS) Thesis/Dissertation (T/D)
updating results...
career