Big Data is a collection of data that is huge in volume, yet growing exponentially with time. It is a data with so large size and complexity that none of traditional data management tools can store it or process it efficiently. Big data is also a data but with huge size.Big Data is a collection of data that is huge in volume, yet growing exponentially with time. It is a data with so large size and complexity that none of traditional data management tools can store it or process it efficiently. Big data is also a data but with huge size.
What you'll learn
- Hadoop Architecture
- Hadoop Clusters
- Hadoop MapReduce
- Hive
- HQL
- NoSQL with Hbase
- Apache Spark
Requirements
- Basic System Administrator Skills
- Good to have (Not Mandatory) access to a Linux System
Target Audience
- Data Engineer
- Software Developer
- Data Analyst
- Business Analyst
- Introduction to machine learning
- Understanding the need
- Understanding data science and machine learning using industry
- Understanding why python is needed
- Running the installer and use case
- Hadoop framework understanding
- Pseudo mode
- Cluster mode
- Installation of Java
- Hadoop
- Configurations of Hadoop
- Hadoop Data Types
- Hadoop MapReduce paradigm
- Map and Reduce tasks
- MapReduce Execution Framework
- Hive Architecture and Installation
- Comparison with Traditional Database
- HiveQL: Data Types, Operators and Functions
- Hive Tables (Managed Tables and External Tables, Partitions and Buckets,
- HBase core architecture and NoSQL database
- Know how HBase works on top of HDFS
- Deploy various HBase data models
- Use HBase to perform various operations
- Spark’s Place in Hadoop Ecosystem
- Spark Components & its Architecture
- Spark Deployment Modes
- Introduction to Spark Shell
- Getting started with Apache Spark – Sql
- Querying Files with SQL
- Aggregations, JOINs and Nested Queries
- Azure Data bricks
- Azure Data lakes
- Azure other data science services
The Pre - Learning course is all about learning and implementing Python from scratch. So, no prior expertise is required in this learning period.
The lectures will be recorded and all of them will be available online at the website.
Anyone, regardless of their field of study, can apply. We do, however, expect you to have a strong interest in the domain and determination throughout the learning period..
