The Most Awaited Development on Apache Spark Is Out Apache Spark has emerged as an efficient big data platform over the years and it has its own loyal fan base. It is often considered a rival of Hadoop but that is not the case. Both platforms complement each other and can be used with or without each other. Leaving that topic for some other time, let’s focus on the big announcement of February 2017.
Intel’s BigDL for Apache Spark is here For those of you are not aware of what BigDL is, it is an open-source artificial intelligence-based project from Intel. It was first announced in November 2016 and is now open for contribution. Before I proceed, BigDL uses the Distributed Deep Learning technology. The Corp VP & GM Software and Services Group at Intel Corporation, Doug Fisher unveiled BigDL stating: “BigDL is an open-source project, and we encourage all developers to connect with us on the BigDL GitHub, sample the code and contribute to the project.” All the details on the GitHub page and contribution formality are mentioned at the end of the blog. BigDL’s Features BigDL has come at a time when the industry is going crazy with the predictions about artificial intelligence paving its way in 2017. Since the end of 2016, almost all technology