2. Acquire Skills
  3. Trainings
  4. Big Data Analytics Training

Big Data Analytics Training BDA 15

PKR 30,000

Starting in

Gain vital skills in big data analytics to enhance your decision-making and advance your career.
Start Date
Oct 28, 2023
End Date
Dec 17, 2023
Timing
10:00 AM-03:00 PM
Location
Online
Type
Instructor Led
Duration
80 Hours
Reserve Seat Learn More
training image

Overview

Getting intellectuals ready to become Big Data Experts!  


During this interactive training on Zoom, you will learn about the different ingredients of Big Data such as Hadoop, Spark, Pig, Hive & Sqoop.
 
Further, you will have hands-on experience on different pillars of the Big Data Ecosystem starting from parallel processing frameworks like Map Reduce & Spark, Distributed Storage techniques like HDFS, Big Data Administration Ambari etc.
 
At the end of the training, you will have an in-depth understanding & hands-on related to Big Data solutions like Cloudera & HortonWorks.

Tools Covered

View Course Outline

  • Degree Levels: Academy Profession
  • Field of Studies: Information Technology
  • Prior Job Experience: NIL
  • Other Programs: Big Data Analytics Workshop

  • Executives who want to build a Big Data Analytics department in their start-ups/organizations.
  • People who are working in the Big Data Analytics domain and want to advance their career..
  • Graduate or Masters Students with IT, CS or SE background who want to start their career in the Big Data Analytics domain..

  • Communication skills: Develop effective communication skills to explain findings, and recommendations to stakeholders with different backgrounds and levels of expertise.
  • Machine learning on big data,: Learn to apply machine learning algorithms on big data using tools such as Spark MLlib and TensorFlow.
  • Hands-on experience: Gain practical experience in big data analytics through real-world projects and case studies.
  • Data processing and analysis,: Learn to process, analyze, and visualize big data using tools such as Pig, Hive, and Apache Zeppelin.
  • Understanding of big data concepts: Gain a deep understanding of fundamental concepts such as Hadoop, Spark, and NoSQL databases.

Meet the Instructor

Moeed Tariq

Engineering Manager | Data Architect | Big Data | Spark | Databricks Certified | 2x Microsoft Azure Certified | Trainer | Ex-IBMer | ExZongCMPak

View Profile
Course Outline

Moeed Tariq

Engineering Manager | Data Architect | Big Data | Spark | Databricks Certified | 2x Microsoft Azure Certified | Trainer | Ex-IBMer | ExZongCMPak

Data Engineer having 9+ years of diversified experience in BI,DWH,ETL,Big Data,BSS Ops,Telecom billing & Commercial Postpaid/B2B department reporting in Telecom, IT Consultancy and OTT video on demand streaming companies in Pakistan and MENA region.

View Profile
Course Outline

Course Outline

  • What is Big Data?
  • The Big Data Era.
  • Big Data – Data Sources.
  • 4 V’s of Big Data.
  • Conventional Data Warehouse Architecture.
  • Modern Data Warehouse Architecture.
  • What is Data Discovery?
  • Distributed Computing & its Advantage.
  • Big Data Processing Frameworks (Hadoop, Apache Spark, NoSQL Databases)
  • What is Hadoop & its History?
  • Introduction to Apache Hadoop Stack (HDFS, MapReduce, Flume, Sqoop, Zookeeper, Ozie, HBase,Hive, Pig)
  • Introduction to Big data distributions (On-prem and cloud)
  • Components of Hadoop Cluster (Master Node, Data Node, Namenode, Job Tracker, Task Tracker)
  • Sandbox (virtual machine) Installation
  • Introduction to Hadoop Distributed File System (HDFS)
  • How HDFS Works
  • HDFS Block Size & Replication Factor
  • HDFS Read & Write pipeline
  • Sandbox tour – Understanding Ambari
  • Dockerize Solution Installation

  • Sandbox Configuration & Overview
  • HDFS Commands
  • HDFS Data Ingestion (Lab)
  • Parallel Processing Basics
  • What is MapReduce
  • How MapReduce works
  • Introduction to Apache Hive
  • Hive Alignment with SQL
  • Hive Query Process
  • Hive Data Loading
  • Hive Managed Tables
  • Hive External Tables
  • Hive Table Location
  • Hive Bucketing & Partitioning
  • Apache Hive (Lab)
  • Hive Views & Hive use for XML
  • Hive Supported File Formats
  • Hive Data Model
  • Block Compression and Storage Formats in Hive

  • Built-In and External SerDes in Hive (Lab)
  • Hive complex data types (Array, Map, Struct)
  • Loading complex data in Hive (Lab)
  • Hive vs. Impala
  • Impala Architecture
  • Hadoop 1.0 vs. Hadoop 2.0
  • Introduction to YARN Architecture
  • YARN Resource Manager
  • YARN Node Manager
  • YARN Application Manager
  • YARN Schedulers
  • YARN Performance Gauging
  • YARN Performance Measuring
  • YARN System Health
  • Resource Allocation in YARN
  • Containers Concept in Hadoop
  • YARN Queue Management and Container allocation (Lab)
  • Handling jobs in YARN Resource Manager UI
  • Data Ingestion with Kafka-Coinfluent
  • Cloudera Intro (HUE, Impala & Cloudera Manager) & YARN

  • Project 01: Building a Sentiment Analysis Application to find the sentiment of tweets
  • introduction to Apache Tez
  • Tez vs MapReduce
  • Tez DAGs
  • Introduction Apache Pig
  • Pig vs. Hive
  • PIG Architecture
  • PIG-Latin
  • Grunt Shell & PIG Scripting (Lab)
  • PIG Commands
  • Loading Data in PIG
  • PIG Filter
  • PIG Joins
  • Debugging Using PIG
  • PIG Execution Modes
  • PIG Execution Mechanism
  • Pig integration with Hive – HCatalog

  • Introduction to Apache Sqoop
  • Sqoop Architecture
  • Sqoop Execution Modes
  • Migrating data with Sqoop (Lab)
  • Introduction to Data Flow
  • Apache Nifi as a Data Flow tool
  • Installing Nifi as a service (Lab)
  • Flow files, Processors and Connectors
  • Nifi Templates
  • Understanding Nifi UI and Creating data flows (Lab)

  • Introduction to Apache Spark
  • Spark vs. MapReduce
  • Spark Architecture
  • Spark Driver
  • Spark Context
  • Spark Executors
  • Spark Core Abstraction – RDDs, DataFrames, Datasets
  • Transformations vs. Actions
  • Spark Transformations (Map, Flatmap, Filter, Distinct)
  • Spark Actions (Collect, First, Take, Count, Reduce, Save-as-text)
  • Lazy Execution
  • SparkContext, HiveContext, SqlContext
  • Scala vs. Pyspark
  • Spark as a In memory processing engine (Lab)
  • Troubleshooting Jobs in Spark UI

  • Introduction to Streaming Analytics
  • Bounded data vs. Unbounded data
  • Spark as a stream processing engine
  • Spark Streaming
  • Structured Streaming
  • Streaming Analytics in Spark (Lab)
  • What are Messaging (Pub/Sub) systems
  • Introduction to Apache Kafka
  • Kafka – Core capabilities and Use cases
  • Topic, Partitions and Offsets
  • Kafka Brokers
  • Kafka Producers and Consumers
  • Kafka as a messaging system (Lab)
  • Intro to Databricks (Spark over cloud)
  • Databricks Deltalake Implementation/Medallion Architecture

  • Components of a Big data platform
  • Big Data Architectures
  • Lambda and Kappa Architecture
  • Building batch mode and real time big data pipelines – case studies (Lab)
  • Realm of NoSQL databases
  • NoSQL databases types
  • SQL vs. NoSQL
  • MongoDB as a NoSQL database
  • Up and running with MongoDB (Lab)
  • Next Steps
  • Databricks Spark structure Streaming Implementation
  • Intro to NoSQL & ELK & casandara

Our Methodology

Industry Usecases

With real world projects and immersive content built in partnership with top tier companies, you’ll master the tech skills companies want.

Technical Support

Our knowledgeable mentors guide your learning and are focused on answering your questions, motivating you and keeping you on track.

Career Mentorship

You’ll have access to resume support, portfolio review and optimization to help you advance your career and land a high-paying role.

Frequently Asked Questions

demand img

Since our instructors are industry experts so they do train the students about practical world and also recommend the shinning students in industry for relevant positions.                           

Yes, you will be awarded with a course completion certificate by Dice Analytics.  We also keenly conduct an annual convocation for the appreciation and recognition of our students.       

This Certification Training course includes multiple real-time, industry-based projects, which will hone your skills as per current industry standards and prepare you for the future career needs.        

For executing the practical’s included in the Big Data Training, you will set-up tool on your machine. The installation manual for tool prep will be provided to help you install and set-up the required environment.     

Don’t worry! We have got you covered.  You shall be shared recorded lectures after each session, in case you want to revise your concepts or miss the lecture due to some personal or professional commitment.
So, what's your plan?

Follow the footsteps of thousands of successful alumni...

Reserve Seat
svg img
Reserve Seat