Architecting a Data Lake

This full-day session on Friday, April 13, 2018, will focus on principles for designing and implementing a data lake. There will be a mix of concepts, lessons learned, and technical implementation details. This session is approximately 70% demonstrations: we will create a data lake, populate it, organize it, query it, and integrate it with a relational database via logical constructs. You will leave this session with an understanding of the benefits and challenges of a multi-platform analytics/DW/BI environment, as well as recommendations for how to get started.

Target audience:

Technologists who are considering or beginning a data lake implementation. No data lake experience is required. Familiarity with a relational database such as SQL Server is helpful, as some of the scenarios discussed will focus on integrating a data lake with a relational data warehouse.

You will learn in this session:

• Scenarios and use cases for expanding an analytics/DW/BI environment into a multi-platform environment which includes a data lake

• Methods for planning & organizing a data lake which focuses on optimal data retrieval and data security

• Determining when to use Azure Data Lake Analytics (U-SQL) vs. HDInsight vs. Azure Databricks vs. relational functionality for data processing

• Deciding between Azure Blob Storage vs. Azure Data Lake Store vs. a relational platform for data storage

• Use cases and syntax basics for U-SQL, PolyBase, and elastic queries

• Benefits and challenges of schema-on-read vs. schema-on-write approaches for data integration and on-demand querying needs

Specific technologies discussed and/or demonstrated in this session include:

Azure Data Lake Store | Azure Data Lake Analytics | HDInsight | Azure Databricks | U-SQL |

Azure SQL Data Warehouse | PolyBase | Azure SQL Database | Elastic Queries | Azure Storage

If you have an Azure account and your own laptop, you will be able to follow along during the demonstrations if you'd like. Demo scripts will be provided with the workshop materials.

About Melissa Coates

Melissa Coates is a Solution Architect with BlueGranite, based in Charlotte, NC. She specializes in delivering analytics, data warehousing, and business intelligence solutions using on-premises, cloud, and hybrid technologies. Formerly a CPA, Melissa is ridiculously proud to be an IT geek and downright giddy to be a Microsoft Data Platform MVP. When Melissa steps away from the keyboard, you can probably find her hanging out with her border collie, paddle boarding, or playing in the garden. Melissa blogs at sqlchick.com.

About SQL Saturday

SQLSaturday is a free training event for Microsoft Data Platform professionals and those wanting to learn about SQL Server, Business Intelligence and Analytics. This event will be held on April 14, 2018 in Raleigh, NC.

Please note that registering for this pre-conference workshop does not automatically register you for the SQL Saturday event. Please visit the SQL Saturday site to register for the sessions held on Saturday, April 14, 2018.

FAQs

What should I bring to the pre-con?

A laptop if you want to follow along with some, or all, of the hands-on demos. Internet connectivity will be available, but if you have a mobile hotspot available you may want to bring it just in case.

Do I have to set up my laptop beforehand?

Yes, you will receive an e-mail with the laptop prerequisites about 2 days prior to the workshop.

Will I receive copies of all of the materials?

Absolutely. At the beginning of the workshop you will receive a link where you can download the agenda, slides, demo scripts, and source data for the demos.

Where is this workshop located?

The Friday sessions are in a **different** location than the main SQL Saturday event. We will be at the Holiday Inn in downtown Raleigh: 320 Hillsborough Street, Raleigh, NC 27603.

Is lunch included?

Yes. Lunch will be at 12:30. We encourage you to stay in for lunch since there will be ongoing conversation.

What time do I need to be there?

The workshop begins promptly at 9am, so please plan to arrive between 8:30am and 8:45am.

How busy is the day?

We have a pretty packed agenda. We encourage you to truly be "out of the office" with regard to e-mail and phone calls, so you can get the most from the day.

What is the refund policy?

Refunds are available up to 7 days prior to the workshop.