Reinforcement learning based on deep learning is currently being used for impressive control of fluid dynamic systems. This video will describe recent advances, including for mimicking the behavior of birds and fish, for turbulence closure modeling with sub-grid-scale models, and for robotic flight demonstrations.
Citable link for this video: [ Ссылка ]
@eigensteve on Twitter
eigensteve.com
databookuw.com
Links to papers in video:
@3:58 Machine learning for fluid mechanics
Brunton, Noack, Koumoutsakos, Ann. Rev. Fluid Mech 52:477--508, 2020
[ Ссылка ]
@5:04 Efficient collective swimming by harnessing vortices through deep reinforcement learning
Verma, Novati, Koumoutsakos, Proc. Nat. Acad. Sci. 115(23):5849--5854, 2018
[ Ссылка ]
@6:57 Automating turbulence modelling by multi-agent reinforcement learning
Novati, Lascombes de Laroussilhe, Koumoutsakos, Nat. Mach. Int. 3:87--96, 2021
[ Ссылка ]
@8:47 A review of Deep Reinforcement Learning for fluid mechanics,
Garnier, Viquerat, Rabault, Larcher, Kuhnle, Hachem, 2019
[ Ссылка ]
@9:57 Artificial neural networks trained through deep reinforcement learning discover control strategies for active flow control
Rabault, Kuchta, Jensen, Reglade, Cerardi, J. Fluid Mech. 865, 2019
[ Ссылка ]
@10:56 Reinforcement learning for bluff body active flow control in experiments and simulations
Fan, Yang, Wang, Triantafyllou, Karniadakis, Proc. Nat. Acad. Sci. 117(42), 2020
[ Ссылка ]
@11:50 Fluid directed rigid body control using deep reinforcement learning
Ma, Tian, Pan, Ren, Manocha, SIGGRAPH 2018
[ Ссылка ]
@13:26 Autonomous helicopter flight via Reinforcement Learning
Ng, Kim, Jordan, Sastry, NeurIPS 2004
[ Ссылка ]
@13:26 An Application of Reinforcement Learning to Aerobatic Helicopter Flight
Abbeel, Coates, Quigly, Ng, NeurIPS 2007
[ Ссылка ]
@13:26 Autonomous helicopter aerobatics through apprenticeship learning
Abeel, Coates, Ng, Int J Rob Res 2010
[ Ссылка ]
@14:02 Learning to fly like a bird
Tedrake, Jackowski, Cory, Roberts, Hoburg, Int. Symp. Rob. Res. 2009
[ Ссылка ]
@14:58 Control of a Quadrotor with Reinforcement Learning
Hwangbo, Sa, Siegwart, Hutter, IEEE Rob Aut 2(4) 2017
[ Ссылка ]
@15:22 Learning to soar in turbulent environments
Reddy, Celani, Sejnowski, Vergassola Proc. Nat. Acad. Sci. 113(33, 2016
[ Ссылка ]
@16:31 Learning to Fly: Computational Controller Design for Hybrid UAVs with Reinforcement Learning
Xu, Du, Foshey, Li, Zhu, Schulz, Matusik, SIGGRAPH 2019
[ Ссылка ]
This video was produced at the University of Washington
![](https://i.ytimg.com/vi/NZNl-M040NY/maxresdefault.jpg)