云端数据中台：数据编排与平台运维

湾区数年，来去间尽是同窗故旧。闲侃中发现，多年来，不少人的志趣依然相投。我们几位朋友合议下，于是有了这么个技术沙龙。我们定位于技术和业界方面的讨论，同时也提供一个机会大家碰碰面，聊聊天，互通有无。至于以后的内容：但有所长的，请告知我们，我们可以商讨提­供讲座的机会；想要讨论某些方面内容的，请告诉我们，我们可以寻找相应的专家提供讲座。希望以后我们多多聚首！

湾区同学技术沙龙（www.tech-meetup.com）

<H4>注意：本次活动不收取费用，报名时请选择免费门票，已经选择了付费门票的同学我们会联系退款</H4>
<H4 CLASS="md-end-block md-heading">Registration</H4>
<UL CLASS="ul-list">
<LI CLASS="md-list-item">
Registration link: <A HREF="https://www.eventbrite.com/e/71480707721" TARGET="_blank">tech-meetup-9-15-2019.eventbrite.com/</A>
</LI>
</UL>
<H4 CLASS="md-end-block md-heading">Join tech-meetup community:</H4>
<UL CLASS="ul-list">
<LI CLASS="md-list-item">
LinkedIn group: <A HREF="https://www.linkedin.com/groups/8362423" TARGET="_blank" DATA-MSYS-CLICKTRACK="0" REL="nofollow noopener noreferrer">www.linkedin.com/groups/8362423</A>
</LI>
<LI CLASS="md-list-item">
微信群/Google group: <A HREF="http://tech-meetup.com/groups" TARGET="_blank" DATA-MSYS-CLICKTRACK="0" REL="nofollow noopener noreferrer">tech-meetup.com/groups</A>
</LI>
</UL>
<H4 CLASS="md-end-block md-heading">Event Info</H4>
<UL CLASS="ul-list">
<LI CLASS="md-list-item">
Time: 1:30PM ~ 4:00PM, 9/15/2019, Sunday
</LI>
<LI CLASS="md-list-item">
Location: 1st Floor Pitch Room, 4500 Great America Parkway, Santa Clara 95054 (ZGC Innovation Center)
</LI>
<LI CLASS="md-list-item md-focus-container">
Language: Chinese
</LI>
</UL>
<H4 CLASS="md-end-block md-heading">Agenda</H4>
<UL CLASS="ul-list">
<LI CLASS="md-list-item">
1:30pm - 2:00pm: Reception and social time
</LI>
<LI CLASS="md-list-item">
2:00pm - 3:30pm: Talk+ Q&A
</LI>
<LI CLASS="md-list-item">
3:30pm - 4:30pm: Offline networking
</LI>
</UL>
 
Talk1: 如何把Alerts减少两个数量级: EA数据平台在云端运维的探索与演进
Abstract: Today, one can easily launch or terminate services with hundreds or thousands of compute instances in just a few seconds on cloud services such as AWS. However, operating, monitoring and maintaining those resources could also easily become a nightmare if the corresponding tooling systems were not designed in a cloud-native way.
Detail: In this talk, we share our lessons in building and rebuilding a cloud-native monitoring system to solve this problem at Electronic Arts (EA). In the first generation of the monitoring system, configurations were manually created for many individual software components and spread over all the resources. As services were started and terminated rapidly over time, it was extremely difficult to keep all the configurations up to date. Consequently, on average we received over 1,000 alerts from thousands of machines on a daily basis, which stressed the operations team. We redesigned the system in late 2018 in a project called Monitoring As Code (MAC) emphasizing on version control and automation. MAC manages all the configurations using a GIT project in the same way as software code. Moreover, it establishes standards so that the configurations are automatically generated and deployed to keep everything in sync. As a result, it reduced the daily average number of alerts by two orders of magnitude. A big data problem is reduced to a small data problem for human productivity and operational efficiency.
Speaker Bio: The speaker, Du Li, is currently an Architect of Big Data Infrastructure at Electronic Arts. He earned his BS from Wuhan University, MS from Peking University, and PhD from UCLA. He worked in academia and industrial labs for many years. Prior to joining EA in mid-2018, he worked at Yahoo and Apple as a senior software engineer.
 
Talk2: 基于Raft,gRPC,RocksDB和高并发算法打造存储10亿个文件的高效元数据服务
Abstract: 起源于UC Berkeley AMPLab的Alluxio是一个被百度、腾讯、华为、沃尔玛、Twosigma等行业巨头在云端广泛应用的开源数据编排系统。它的设计初衷之一包括能够高效存储并服务超大规模的文件系统中所有文件和目录的元数据。
Detail: 本演讲将分享Alluxio元数据服务（master节点）的架构，实现和优化，以解决可扩展性挑战。我们将特别介绍如何设计和应用合多个前沿工程技术和实践，包括基于堆外KV store RocksDB实现分层级的元数据存储，细粒度文件系统inode树锁方案，基于Raft分布式共识协议的master多节点高可用方案，以及社区对gRPC系统的探索和实践。结合上述技术，Alluxio 2.0的元数据服务能够存储至少10亿个文件，并在显着降低内存需求的同时扩展到3000个worker节点并为30000个客户端提供服务。
Speaker Bio: 范斌是Alluxio公司的创始成员与, Alluxio开源项目的PMC成员. 加入Alluxio团队前, 范斌在Google从事下一代大规模分布式存储系统的研究与开发. 范斌博士毕业于卡内基梅隆大学计算机系, 博士期间在分布式系统算法和系统实现等方向发表多篇包括SIGCOMM, SOSP, NSDI等顶级论文, 设计和实现了CuckooFilter，MemC3以及libCuckoo.
 
<H4 CLASS="md-end-block md-heading">主办</H4>
<UL CLASS="ul-list">
<LI CLASS="md-list-item">
<A HREF="http://tech-meetup.com/" TARGET="_blank" DATA-MSYS-CLICKTRACK="0" REL="nofollow noopener noreferrer">湾区同学技术沙龙(TechM)</A>
</LI>
<LI CLASS="md-list-item">
ZGC Innovation Center
</LI>
</UL>
<H4 CLASS="md-end-block md-heading">协办</H4>
<UL CLASS="ul-list">
<LI CLASS="md-list-item">
硅谷新创汇
</LI>
<LI CLASS="md-list-item">
南京大学湾区校友会
</LI>
<LI CLASS="md-list-item">
东南大学硅谷校友会
</LI>
<LI CLASS="md-list-item">
中国科大硅谷校友会
</LI>
<LI CLASS="md-list-item">
北加州清华校友会
</LI>
<LI CLASS="md-list-item">
硅谷清华联网
</LI>
<LI CLASS="md-list-item">
浙江大学校友会海纳创新创业俱乐部
</LI>
<LI CLASS="md-list-item">
北京大学北加州校友会
</LI>
<LI CLASS="md-list-item">
武汉大学北加州校友会
</LI>
<LI CLASS="md-list-item">
吉林大学硅谷校友会会
</LI>
<LI CLASS="md-list-item">
复旦大学北加州校友会
</LI>
<LI CLASS="md-list-item">
华南理工大学美国校友会
</LI>
<LI CLASS="md-list-item">
北加州华中科技大学校友会
</LI>
<LI CLASS="md-list-item">
北京航空航天大学硅谷校友会
</LI>
<LI CLASS="md-list-item">
北京邮电大学北美校友会
</LI>
<LI CLASS="md-list-item">
上海交通大学硅谷校友会
</LI>
<LI CLASS="md-list-item">
兰州大学北加州校友会
</LI>
<LI CLASS="md-list-item">
电子科技大学硅谷校友会
</LI>
<LI CLASS="md-list-item">
安徽大学北美校友会
</LI>
<LI CLASS="md-list-item">
湖南大学北美校友会
</LI>
<LI CLASS="md-list-item">
湘潭大学北美校友会
</LI>
<LI CLASS="md-list-item">
哈工大硅谷校友会
</LI>
<LI CLASS="md-list-item">
中山大学海外校友联网
</LI>
<LI CLASS="md-list-item">
华人事业互助会
</LI>
<LI CLASS="md-list-item">
长城会 RobotX Space
</LI>
</UL>

4500 Great America Pkwy

Our {communityGuidelinesLink} describe the sort of content we prohibit on Eventbrite. If you suspect an event may be in violation, you can report it to us so we can investigate.

To report other categories of prohibited or illegal content, submit {link}

云端数据中台：数据编排与平台运维

More events from 湾区同学技术沙龙（www.tech-meetup.com）

Discover more events from 湾区同学技术沙龙（www.tech-meetup.com）, from Science & Tech to other experiences you might love.

Still looking for the right event?

Explore all events in Santa Clara and filter by date, category, and more to find the perfect fit.

云端数据中台：数据编排与平台运维

More events from 湾区同学技术沙龙（www.tech-meetup.com）

Discover more events from 湾区同学技术沙龙（www.tech-meetup.com）, from Science & Tech to other experiences you might love.

You might also like...

Browse more events with different dates, prices, and formats to find your next great experience.

Still looking for the right event?

Explore all events in Santa Clara and filter by date, category, and more to find the perfect fit.