Palo Alto: Building a Distributed Data Ingestion System with RabbitMQ
Wednesday, July 16, 2014 from 5:45 PM to 8:30 PM (PDT)
Palo Alto, CA
San Francisco, California
London, United Kingdom
Palo Alto: Building a Distributed Data Ingestion System with RabbitMQ with Alvaro Videla
NOTE: THIS MEETUP IS IN PALO ALTO at 5:45pm PDT Register here: http://bit.ly/POSH0046
6:00-6:30 pm Pizza and networking
6:30-8:00 pm Talk and Q&A
8:00-8:30 pm Wind down
In this talk we are going to show how to build a system that can ingest data produced at separate geo located areas (think AWS and it's many regions), using different technology stacks, and replicate it to a central cluster where it can be further processed and analysed.
We will present an example of how to build a system like this one by using RabbitMQ Federation to replicate data across AWS Regions and RabbitMQ support for many protocols to produce/consume data.
To help with scalability we are going to show an interesting way to implement sharded queues with RabbitMQ by using the Consistent Hash Exchange.
If you want to learn what else has RabbitMQ to offer beyond simple messaging and queueing, then this is the talk for you.
About the speaker:
Alvaro Videla works as Developer Advocate for RabbitMQ/Pivotal. Before moving to Europe he used to work in Shanghai where he helped building one of Germany biggest dating websites. He co-authored the book "RabbitMQ in Action" for Manning Publishing. Some of his open source projects can be found here: http://github.com/videlalvaro. Apart from code related stuff he likes traveling with his wife, listening/playing music and reading books.
You can find him on Twitter as @old_sound.
When & Where
Pivotal Open Source Hub
Pivotal's Rabbit, Redis, Cloud Foundry, Spring, Grails, Groovy, & other resident experts!
Pivotal employees include
* the founders of RabbitMQ
* the creator of Redis
* the core contributors to the Spring Framework, Cloud Foundry PaaS, Groovy, and Grails* the contributors to Apache Tomcat, Apache Hadoop, Apache HTTPD
* the creators of Pivotal Tracker
The goal of this group is to offer these many experts to the open source communities that Pivotal supports through meetups and hackathons.