Pathfinder Data Engineering

Course Instructor krish bhargav

₹30000.00 ₹50000.00 40% OFF

Course Overview

Schedule of Classes

Course Curriculum

13 Subjects

Pathfinder Data Engineering

Python Basics

2 Exercises • 3 Learning Materials

Section 1: Introduction to Python Programmingt is python?

Python Basics

Assignment

Introduction to Python Programming

PDF

Section 2: Python Basics and Syntax

Python Basics and Syntax

PDF

Section 3: Data Structures in Python

Data Structures in Python

PDF

Section 4: Exercises & Assessment

Python Basics_Online_Assessment

Exercise

GIT

1 Exercises • 6 Learning Materials

Section 1: Introduction to Version Control and Git

Introduction to Version Control and Git

Section 2: Git Basics

Git Basics

Section 3: Branching and Merging

Branching and Merging

Section 4: Collaborative Development with Git

Collaborative Development with Git

Section 5: Git Advanced Topics

Git Advanced Topics

Section 6: Git Best Practices and Tips

Git Best Practices and Tips

Section 7: Assessment

GIT_Assessment

Exercise

Airflow

1 Exercises • 10 Learning Materials

Section 1: Introduction to Apache Airflow

Introduction to Apache Airflow

Section 2: Getting Started with Apache Airflow

Getting Started with Apache Airflow

Section 3: Creating and Managing Workflows

Creating and Managing Workflows

Section 4: Scheduling and Triggering Workflows

Scheduling and Triggering Workflows

Section 5: Airflow Sensors and Executors

Airflow Sensors and Executor

Section 6: Extending Airflow Functionality

Extending Airflow Functionality

Section 7: Airflow Best Practices and Optimization

Airflow Best Practices and Optimization

Section 8: Advanced Topics and Use Cases

Advanced Topics and Use Cases

Section 9: Deployment and Scaling

Deployment and Scaling

Section 10: Real-world Examples and Case Studies

Real-world Examples and Case Studies

Section 11: Assessment

Apache Airflow_Assessment

Exercise

Agile

1 Exercises • 9 Learning Materials

Section 1: Introduction to Agile

Introduction to Agile

Section 2: Scrum Framework

Scrum Framework

Section 3: Kanban and Lean

Kanban and Lean

Section 4: Agile Practices and Techniques

Agile Practices and Techniques

Section 5: Agile Metrics and Monitoring

Agile Metrics and Monitoring

Section 6: Scaling Agile

Scaling Agile

Section 7: Agile in Practice and Case Studies

Agile in Practice and Case Studies

Section 8: Agile Certification and Further Learning

Agile Certification and Further Learning

Section 9: Exercises & Assessment

Exercises

Agile_Online_Assessment

Exercise

Docker

1 Exercises • 13 Learning Materials

Section 1: Introduction to Docker

Introduction to Docker

Section 2 Docker Basics

Docker Basics

Section 3: Working with Docker Images

Working with Docker Images

Section 4: Managing Containers

Managing Containers

Section 5: Docker Compose

Docker Compose

Section 6: Docker Volumes and Data Management

Docker Volumes and Data Management

Section 7: Docker Networking

Docker Networking

Section 8: Docker Security and Best Practices

Docker Security and Best Practices

Section 9: Docker in Production

Docker in Production

Section 10: Docker Monitoring and Troubleshooting

Docker Monitoring and Troubleshooting

Section 11: Docker on Cloud Platforms

Docker on Cloud Platforms

Section 12: Advanced Docker Topics

Advanced Docker Topics

Section 13: Exercises & Assessment

Exercises

Docker_Online_Assessment

Exercise

PySpark

1 Exercises • 40 Learning Materials

PySpark Tutorial

Introduction to PySpark

Setting up PySpark

SparkSession

PySpark Architecture, Modules & Packages

PySpark Datasets & Dataframes

PySpark - RDD

PySpark RDD

RDD Parallelize , Transformations & shuffle operations

RDD Persistence & shared variables

Accumulators

PySpark DataFrame

Create/Convert RDD & Dataframes

Convert PySpark DataFrame to Pandas

PySpark show()

PySpark StructType & StructField

PDF

PySpark Column Class ,Operators & Functions

PDF

PySpark Select

PySpark Collect()

PySpark withColumn()

PySpark Where() & Filter() Function

PySpark drop() & dropDuplicate()

PySpark orderBy() and sort()

PySpark SQL and MLlib

PySpark SQL and MLib

PySpark SQL Functions

PySpark Aggregate Functions

PDF

PySpark Window Functions

PDF

PySpark SQL Date and Timestamp Functions

PDF

PySpark JSON Functions

PDF

PySpark Datasources

PySpark Read CSV file into DataFrame

PySpark Read and Write Parquet File

PySpark Read JSON file into DataFrame

PDF

PySpark SQL Read Hive Table

PySpark Save DataFrame to Hive Table

Read JDBC in Parallel using PySpark

PySpark Query Database Table using JDBC

PySpark Read and Write SQL Server Table

PySpark Read JDBC Table to DataFrame

Data Processing with PySpark

PySpark Streaming and GraphFrames

PySpark Built-in Functions

PySpark - When()

PySpark - expr()

PySpark - lit()

Exercises & Assessment

PySpark_Assessment

Exercise

Exercices

Apache Kafka

1 Exercises • 11 Learning Materials

Section 1: Introduction to Apache Kafka

Introduction to Apache Kafka

Section 2: Setting Up Kafka

Setting Up Kafka

Section 3: Kafka Fundamentals

Kafka Fundamentals

Section 4: Producing and Consuming Data

Producing and Consuming Data

Section 5: Kafka Connect

Kafka Connect

Section 6: Kafka Streams

Kafka Streams

Section 7: Advanced Kafka Concepts

Advanced Kafka Concepts

Section 8: Kafka Security

Kafka Security

Section 9: Kafka Monitoring and Operations

Kafka Monitoring and Operations

Section 10: Kafka in Real-World Scenarios

Kafka in Real-World Scenarios

Section 11: Exercises & Assessment

Exercises

Kafka_Assessment

Exercise

Section 1 PySpark Mock Test

7 Exercises •

PySpark Test -1

PySpark Test-1

Exercise

PySpark Test-2

Exercise

PySpark (RDDs) -Test 3

PySpark RDDs Test-3

Exercise

PySpark Modules & Packages - Test 4

PySpark Modules & Packages

Exercise

PySpark Datasets & Dataframes - Test 5

PySpark Datasets & Dataframes Test- 5

Exercise

PySpark SQL -Test 6

Exercise

Pyspark MLlib & Graphframes -Test 7

Exercise

Apache Kafka -Mock Test

5 Exercises •

Apache Kafka Test -1

Apache Kafka Test- 1

Exercise

Apache Kafka Test-2

Apache Kafka Test- 2

Exercise

Apache Kafka Test -3

Apache Kafka Advance Test - 3

Exercise

Apache Kafka Test - 4

Apache Kafka Test- 4

Exercise

Kafka (Consumer & Producer) Test - 5

Kafka Consumer & Producer Test -5

Exercise

AWS

1 Exercises • 10 Learning Materials

Variables

Section 1 Introduction to AWS

Introduction to AWS

Section 2 AWS Core Services

AWS Core Services

Section 3 Networking and Content Delivery

Networking and Content Delivery

Section 4 Identity and Access Management (IAM)

Identity and Access Management (IAM)

Section 5 AWS Management and Monitoring

AWS management and Monitoring

Section 6 Deployment and Orchestration

Deployment and Orchestration

Section 7 Security and Compliance

Security and Compliance

Section 8 Serverless Computing

Serverless Computing

Section 9 Advanced Topics

Advanced Topics

Section 10 Exercises & Assessment

Hands-On Exercises

AWS_Online_Assessment

Exercise

Business Communication

6 Learning Materials

Communication Ice Breakers

PDF

Preparing for Introduction - "Tell Me About Yourself"

Preparing for Introduction

Email Writing

Tips for Drafting Official Email

HR Interview Questions

PDF

11 tips to reduce interview nerves!

PDF

Python Advance

1 Exercises • 5 Learning Materials

Section 1: Functional Programming in Python

Functional Programming in Python

Section 2: Object-Oriented Programming (OOP)

Object-Oriented Programming (OOP)

PDF

Section 3: Advanced Topics

Advanced Topics

Section 4: File Handling and Input/Output

File Handling and Input/Output

Section 5: Web Development with Python

Web Development with Python

Section 6: Exercises & Assessment

Python_Online_Assessment

Exercise

Course Instructor

krish bhargav

42 Courses • 52627 Students