Скачать с ютуб Automating Spark Upgrades - Holden Karau в хорошем качестве

Automating Spark Upgrades - Holden Karau

This talk was given at ScalaCon on May 21st, 2021 by Holden Karau with guest Professor Timbit. Automating Spark Upgrades Most people don’t go into work excited to update their old code to slightly newer versions of APIs and figuring out what’s replaced this. This is complicated in Spark where the new version of Spark will be dropping support for older language releases. This talk will explore how we can use tools to semi-automatically upgrade our Scala Spark code. While we look at the tools we’ll talk about limitations in the current tooling and how that impacts what we can do with auto upgrades. We’ll wrap up with talking about how to test that your upgraded Spark code is correct. Speaker: Holden Karau ---- ScalaCon is organized in partnership by 47 Degrees, Skills Matter, Scala Center, and Lightbend.