Nathan Marz: Using simplicity to make hard Big Data problems easy
By Affirm, Inc.
Date and time
Thursday, August 14, 2014 · 6:30 - 8:30pm PDT
Location
Affirm
325 Pacific Ave San Francisco, CA 94111Description
In the beginning of this talk, a seemingly straightforward data problem will be presented. However, as will become readily apparent, the solution to this problem is not so easy – at least, not when you shackle yourself to traditional techniques to building data systems.
You will see how to solve this data problem by making use of different techniques. The solution is easy to understand and the pattern behind it can be readily applied to any other data problem. The key is to introduce fundamental simplicity into the data architecture – that is, to make separate functions that were previously inexorably intertwined. By making these functions independent, you avoid the inevitable conflicts which make solutions difficult or impossible to build.
__
Nathan Marz is the creator of Apache Storm and author of the upcoming book "Big Data: Principles and best practices of scalable realtime data systems". He started one of the core infrastructure teams at Twitter and is now working on a new startup. He writes a blog at http://nathanmarz.com.
You will see how to solve this data problem by making use of different techniques. The solution is easy to understand and the pattern behind it can be readily applied to any other data problem. The key is to introduce fundamental simplicity into the data architecture – that is, to make separate functions that were previously inexorably intertwined. By making these functions independent, you avoid the inevitable conflicts which make solutions difficult or impossible to build.
__
Nathan Marz is the creator of Apache Storm and author of the upcoming book "Big Data: Principles and best practices of scalable realtime data systems". He started one of the core infrastructure teams at Twitter and is now working on a new startup. He writes a blog at http://nathanmarz.com.
Organized by
Some detail about what Affirm is up to:
At Affirm, we believe the financial industry desperately needs reinvention. Not only is the core infrastructure built with technology from the 1970s, but a dwindling number of people can say "I trust my bank to look out for me." It doesn’t have to be this way.
Affirm’s mission is to fix this problem. We are using modern technology to re-imagine and re-build core components of financial infrastructure from the ground up. We’re focusing on improving the lives of everyday consumers with less expensive, more transparent financial products.
Mission: Our mission is simple: Deliver honest financial products to improve lives.