Real time streaming of data is crucial. HERE is using real time data for the next generation driving experience. We are excited to be hosting Karthik from Twitter to discuss the evolution of streaming systems.
Twitter generates billions and billions of events per day. Analyzing these events in real time presents a massive challenge. Twitter developed Apache Storm, the first generation streaming system, to meet this challenge. As the scale of the data processed increased along with the increase in diverse work loads, several short comings of Storm become apparent. To address these issues, they developed Twitter Heron, the second generation streaming system. Heron has been in production for nearly 2 and 1/2 years and is widely used by several teams for diverse use cases. Twitter open sourced Heron in May 2016. In this talk, Karthik will go through our evolution from first generation to second generation streaming system and share our experiences and challenges.
Karthik is the engineering manager and technical lead for Real Time Analytics at Twitter. He is the co-creator of Heron and has more than two decades of experience working in parallel databases, big data infrastructure and networking. He cofounded Locomatix, a company that specializes in real time streaming processing on Hadoop and Cassandra using SQL that was acquired by Twitter. Before Locomatix, he had a brief stint with Greenplum where he worked on parallel query scheduling. Greenplum was eventually acquired by EMC for more than $300M. Prior to Greenplum, Karthik was at Juniper Networks where he designed and delivered platforms, protocols, databases and high availability solutions for network routers that are widely deployed in the Internet. Before joining Juniper at University of Wisconsin, he worked extensively in parallel database systems, query processing, scale out technologies, storage engine and online analytical systems. Several of these research were spun as a company later acquired by Teradata. He is the author of several publications, patents and one of the best selling book “Network Routing: Algorithms, Protocols and Architectures.” He has a Ph.D. in Computer Science from UW Madison with a focus on big data.
You must sign up with your full legal name and bring government ID to event for security. We are located at 425 W Randolph in the Boeing Building. For additional information please e-mail firstname.lastname@example.org.
Food and Beverages will be served!