Apache Spark is at the heart of Databricks, which is available as APIs to enable you to plug into multiple different layers. It’s a cloud-based platform currently operating on AWS and Azure, where Databricks has first party service with Microsoft. “We also have partnerships with GSIs and RSIs such as CapGemini and Cognizant, adds Peart. “We’re working at that level from an integrated perspective. Allied to this we have open APIs and plug-ins with the likes of Tableau and Looker. Because our foundation is in open source we have an extendable platform enabling you to plug in a multitude of data sources, visualisation and VI platforms, so you can go from data ingestion through to aggregation and sharing of your results with almost any vendor you want to work with.” Databricks has been able to overcome the challenge of delivering results with a focus on real time analysis by utilising the cloud to take in streaming live data. “Spark’s ability to deal with real time streaming data goes beyond zeroes and ones,” maintains Peart. “We’re able to do meet the challenge of real time analysis of video as well. We’re working with new customers on a
“Spark is able to bring together big data and break down the silos between lines of business” Nick Peart, VP EMEA, Databricks variety of applications. For example, on a building site in a hard hat area where protective glasses must also be worn, we’ve got customers looking at their CCTV feeds from site entrances and using real time analysis to ensure people walking through the door are dressed appropriately with a hi-vis vest, the right type of boots, hard hat and eye protection. They’re working on learning models to be able to sound an alarm to alert the gate if someone walks though without meeting the full requisite of safety standards. This near real time alert model could be applied to multiple situations where you’ve got eyes and 43