Big Data 2 Days Virtual Live Bootcamp in Auckland
Event Information
About this event
Course Description:
This big data training course will provide a technical overview of Apache Hadoop for project managers, business managers and data analysts. Students will understand the overall big data space, technologies involved and will get a detailed overview of Apache Hadoop. The course will expose students to real world use cases to comprehend the capabilities of Apache Hadoop. Students will also learn about YARN and HDFS and how to develop applications and analyze Big Data stored in Apache Hadoop using Apache Pig and Apache Hive. Each topic will provide hands on experience to the students.
Course Outline:
Introduction to Big Data
- Big Data - beyond the obvious trends
- Exponentially increasing data
- Big data sources
- Data warehousing, business intelligence, analytics, predictive statistics, data science
Survey of Big Data technologies
- First generation systems
- Second generation systems
- Enterprise search
- Visualizing and understanding data with processing
- NOSQL databases
- Apache Hadoop
Introduction to Hadoop
- What is Hadoop? Who are the major vendors?
- A dive into the Hadoop Ecosystem
- Benefits of using Hadoop
- How to use Hadoop within your infrastructure?
Introduction to MapReduce
- What is MapReduce?
- Why do you need MapReduce?
- Using Mapreduce with Java and Ruby
Introduction to Yarn
- What is Yarn?
- What are the advantages of using Yarn over classical MapReduce?
- Using Yarn with Java and Ruby
Introduction to HDFS
- What is HDFS?
- Why do you need a distributed file system?
- How is a distributed file system different from a traditional file system?
- What is unique about HDFS when compared to other file systems?
- HDFS and reliability?
- Does it offer support for compressions, checksums and data integrity?
Data Transformation
- Why do you need to transform data?
- What is Pig?
- Use cases for Pig
Structured Data Analysis?
- How do you handle structured data with Hadoop?
- What is Hive/HCatalog?
- Use cases for Hive/HCatalog
Loading data into Hadoop
- How do you move your existing data into Hadoop?
- What is Sqoop?
Automating workflows in Hadoop
- Benefits of Automation
- What is oozie?
- Automatically running workflows
- Setting up workflow triggers
Exploring opportunities in your own organization
- Framing scenarios
- Understanding how to ask questions
- Tying possibilities to your own business drivers
- Common opportunities
- Real world examples
Hands-on Exercises
- How to use MapReduce in Hadoop?
- How to use Yarn within Hadoop?
- Overview of HDFS commands
- Hands-on activities with Pig
- Hands-on activities with Hive/HCatalog
- Hands-on activities with Sqoop
- Demonstration of Oozie
Target Audience:
Anybody who is involved with databases, data analysis, wondering how to deal with the mountains of data (anywhere gigabytes of user/log data etc to petabytes will benefit from this program). This course is perfect for:
- Business Analysts
- Software Engineers
- Project Managers
- Data Analysts
- Business Customers
- Team Leaders
- System Analysts
No prior knowledge of big data and/or Hadoop is required for this class. Some prior programming experience is a plus for this class, but not necessary.
Learning Objectives:
- Learn about the big data ecosystem
- Understand the benefits and ROI you can get from your existing data
- Learn about Hadoop and how it is transforming the workspace
- Learn about MapReduce and Hadoop Distributed File system
- Learn about using Hadoop to identify new business opportunities
- Learn about using Hadoop to improve data management processes
- Learn about using Hadoop to clarify results
- Learn about using Hadoop to expand your data sources
- Learn about scaling your current workflow to handle more users and lower your overall performance cost
- Learn about the various technologies that comprise the Hadoop ecosystem
- Learn how to write a simple mapreduce job from Java or your favorite programming language
- Learn how to use a very simple scripting language to transform your data
- Learn how to use a SQL like declarative language to analyze large quantities of data
- Learn how to connect your existing data warehouse to the Hadoop ecosystem
- Learn how to move your data to the Hadoop ecosystem
- Learn how to move the results of your data analysis to Business Intelligence Tools like Tableaux
- Learn how to automate your workflow using oozie
- Learn about polyglot persistence and identifying the right tool for the right job
- Learn about future trends in Big data and technologies to keep an eye on
- Discover tips and tricks behind successful Hadoop deployments
Course Agenda:
Day 1
- Introduction to Big Data
- Introduction to Hadoop
- Hadoop Distributed File System (HDFS)
- MapReduce
- YARN
Day 2
- Pig
- Hive
- Sqoop
- Oozie
Organizer Mangates
Organizer of Big Data 2 Days Virtual Live Bootcamp in Auckland
Click here to subscribe to our text messages.
Who we are
Mangates is one of the Leading Competency developers, Mangates has developed a proven foundation for building specialized training programs. No matter which Mangates training division you are working with, you can expect the same high-quality training experience and expertise that makes Mangates stand out above the competition.
All of our instructors are recognized experts in their fields with hands-on experience on the topics they teach. We combine proven adult educational training methods with leading-edge industry expertise to provide you an exceptional training experience. Every instructor must meet rigorous standards with the proven background in their given field of expertise. It is the difference that our customers covet and participant appreciates at the completion of the course.
What we do
We deliver training solutions to Corporate, Government Agencies, Public sectors, Multinational organizations and Private Individuals. Our Primary focus is to train in a wide range of areas from IT Technical, Personal Development, Human Resources and Management Courses to Project, Program and IT Service Management.
We have most experienced trainers in the Industry. Our Trainers are highly skilled in their subject areas and are uniquely positioned to provide participants with deep industry experience. They are motivated to transfer knowledge through practical support post and pre-training to provide participants with additional support outside the classroom.
https://www.youtube.com/watch?v=ca-9iJ4zw0Q
![[Webinar]Kubeflow, TensorFlow, TFX, PyTorch, GPU, Spark ML, AmazonSageMaker tickets](https://img.evbuc.com/https%3A%2F%2Fcdn.evbuc.com%2Fimages%2F121421221%2F21660034276%2F1%2Foriginal.20201221-153301?h=230&w=460&auto=format%2Ccompress&q=75&sharp=10&rect=0%2C0%2C800%2C400&s=e22236adbe8b946b1904e0e4cd8973a0)
