Home Tags Apache Spark

Tag: Apache Spark

Building Recommendation System with Scala and Apache Spark [Tutorial]

Recommendation systems can be defined as software applications that draw out and learn from data such as preferences, their actions (clicks, for example), browsing history, and...

Announcing Databricks Runtime 4.2!

Databricks announces Databricks Runtime 4.2 with numerous updates and added components on Spark internals, Databricks Delta and improvisions to its previous version. The databricks runtime...

Project Hydrogen: Making Apache Spark play nice with other distributed machine...

Apache Spark team has revealed a new venture during a keynote at Spark AI Summit called Project Hydrogen. This new project focuses on eliminating...

Why is Hadoop dying?

Hadoop has been the definitive big data platform for some time. The name has practically been synonymous with the field. But while its ascent...

Data Science News Daily Roundup – 21st March 2018

Microsoft SQL Server Management Studio 17.6, IBM’s Deep Learning as a Service program, Intel’s nGraph, and more in today’s top stories around machine learning,...

Apache Ignite 2.4 rolls out with Machine Learning and Spark DataFrames...

The Apache Ignite community has announced the latest version of Apache Ignite, its open-source distributed database. Apache Ignite 2.4 features new machine learning capabilities,...

Pandas on Ray: Make Pandas faster by replacing one line of...

Pandas on Ray is the latest development in the Ray framework. It is a DataFrame library that wraps Pandas and provides a transparent distribution...

How to win Kaggle competition with Apache SparkML

This article is an excerpt taken from a book Mastering Apache Spark 2.x - Second Edition written by Romeo Kienzler. The book will introduce...

How to run Spark in Mesos

This article is an excerpt from a book written by Muhammad Asif Abbasi titled Learning Apache Spark 2. In this book, you will learn...

Working with Spark’s graph processing library, GraphFrames

This article is an excerpt from a book by Rajanarayanan Thottuvaikkatumana titled, Apache Spark 2 for Beginners. The author presents a learners guide for...