In this talk, Dev discussed Consistency Models. In the words of the seminal paper on Consistency Models: "Diffusion models have significantly advanced the fields of image, audio, and video generation, but they depend on an iterative sampling process that causes slow generation. To overcome this limitation, we propose consistency models, a new family of models that generate high quality samples by directly mapping noise to data. They support fast one-step generation by design, while still allowing multi-step sampling to trade compute for sample quality."
In the session we focus on the details of consistency models, and how when trained properly they can outperform existing distillation techniques for image generation. We started this by taking a look at Consistency Model architecture. By using this architecture, Consistency Models achieve state of the art scores in generating CIFAR-10 and ImageNet images.
As usual, we had a lively discussion about the details and inner working of these models!
*Links*
Our Meetup: [ Ссылка ]
Consistency Models: [ Ссылка ]
Yang Song - Diffusion and Score-Based Generative Models: [ Ссылка ]
Yang Song, Simon Ermon - Generative Modeling by Estimating Gradient of Data Distribution: [ Ссылка ]
Yang Song NIPS workshop: [ Ссылка ]
*Content*
00:00 Intro
06:13 De-noising Score Matching
17:35 SDE training
24:43 Computing accuracy
48:13 Sampling
01:19:00 Results
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
😊About Us
West Coast Machine Learning is a channel dedicated to exploring the exciting world of machine learning! Our group of techies is passionate about deep learning, neural networks, computer vision, tiny ML, and other cool geeky machine learning topics. We love to dive deep into the technical details and stay up to date with the latest research developments.
Our Meetup group and YouTube channel is the perfect place to connect with other like-minded individuals who share your love of machine learning. We offer a mix of research paper discussions, coding reviews, and other data science topics. So, if you're looking to stay up to date with the latest developments in machine learning, connect with other techies, and learn something new, be sure to subscribe to our channel and join our Meetup community today!
Meetup: [ Ссылка ]
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
#machinelearning #ai #consistencymodels #imagegeneration #generativeai #generativemodels
Ещё видео!