jokerconf Joker 2016 (14.10.2016 — 15.10.2016)

Myths about Spark, or the possibility of using Spark by an ordinary Java developer


Practical introduction into Spark. After this talk you’ll be good enough to work with Spark independently.

Whoever has in his hand a hammer sees a nail in everything — does it sound silly? And what if it is not a hammer, but a versatile tool that can be a chainsaw, a vacuum cleaner, and a toothbrush? There are Hadoop and a zoo of tools working for it in the world of Big Data. And more recently, there appeared Spark, which can be used for any purpose.

If you want to write to Hadoop with various databases, to stream all sorts of sources in real-time, at the same time doing some complex processing and not using some batches, scripts and SQL-queries, but using a powerful functional language — welcome in Spark!

This talk introduces an audience with Spark: how it works, what tasks it can perform, how to use it correctly. Eugene and the audience of the talk will discuss problems and solutions, which initially faced Spark inexperienced developers, and they will understand its syntax and all sorts of tricks.

There will be many live coding and, in the end, students will be released from this talk with sufficient knowledge to start their own work on Spark.