Spark Summit 2016 - Monitoring Electronic Trading Environments using Spark

High-speed machine-automated trading is now responsible for more than half of all US equity trades, and its continued growth across security markets seems assured. As individuals become less involved and machines drive these transactions to a greater extent, it is becoming increasingly important to closely monitor these automated transactions both at a high level and at a granular level to help inform future strategic decisions, control risk and ensure regulatory compliance. When it comes to processing and analyzing large-scale data for the trading of hundreds of millions of dollars, every bit matters. The insights derived from analysis in these environments are highly valuable to the financial audience. In this session, we will discuss using Spark to analyze trading activity in the world’s largest financial institutions. We explore: – Why Spark is the right tool for analysis in these intense environments – Optimizing Spark applications to work with high volume real-time trading data – How to source authoritative, accurate monitoring data without impacting trading system performance.

Fergal Toomey, Chief Scientist & Co-Founder, Corvil
Pierre Lacave, Senior Software Engineer, Corvil