Sakana AI has a great new paper exploring evolutionary approaches to model merging, showing how to find ways of combining existing models into new ones with impressive new skills. In this video, we dive into the paper and along the way spend some time learning about model merging in general, evolutionary algorithms, and more.
