apache spark

Scaling Machine Learning with Spark: Distributed ML with MLlib, TensorFlow, and PyTorch

There are several tools for building end-to-end distributed ML workflows based on the Apache Spark ecosystem such as Spark MLlib, MLflow, TensorFlow and PyTorch. But it's far from easy to build them. Adi Polak, author of 'Scaling machine learning with Spark' spoke to Holden Karau where she dived into a slew of creative solutions that supersede traditional methods as well as when and why to use each technology. Apart from exploring machine learning and distributed computing concepts, learn a holistic approach beyond specific requirements and organizational goals.