Durga Gadiraju – Medium

Durga Gadiraju

Published in
itversity

Exploring Kafka CLI

Learn how to create topics, produce, and consume messages using Kafka’s CLI tools

7h ago

7h ago

Mastering Advanced Aggregations Using Pandas

The Essential Guide to Using agg() for Multi-Level Data Analysis in Pandas

1d ago

Mastering Advanced Aggregations Using Pandas

1d ago

Get an email whenever "Data Engineering on Cloud" related posts are published.

By signing up, you will create a Medium account if you don’t already have one. Review our Privacy Policy for more information about our privacy practices.

Medium sent you an email at to complete your subscription.

Published in
itversity

Managing the Kafka Cluster

Simplify starting and stopping your Kafka services with custom scripts

1d ago

1d ago

Published in
itversity

Mastering Spark 3: Download, Configure, Validate, and Integrate with Jupyter Lab

A Comprehensive Guide to Setting Up Apache Spark 3 on a Single-Node Hadoop Cluster

2d ago

2d ago

Published in
itversity

Descriptive vs Inferential Statistics in Pandas: How to Analyze and Interpret Data Effectively

Unlocking Data Insights: Summarization and Prediction Techniques with Pandas

2d ago

Descriptive vs Inferential Statistics in Pandas: How to Analyze and Interpret Data Effectively

2d ago

Published in
itversity

Integrating Jupyter Lab with Spark 2 for Big Data Analytics on a Single-Node Cluster

Learn how to set up, validate, and integrate Jupyter Lab with Spark 2 for an interactive big data processing environment.

3d ago

3d ago

Published in
itversity

Introduction to Fundamentals of Statistics for Data Analysis

Unlocking the Power of Data: Essential Statistical Concepts for Effective Analysis

3d ago

Introduction to Fundamentals of Statistics for Data Analysis

3d ago

Published in
itversity

Comprehensive Guide to Setting Up and Validating Spark 2 on a Single-Node Big Data Cluster

Learn how to download, configure, and validate Spark 2.4.7 with Hadoop and Hive Metastore integration for a seamless single-node big data…

4d ago

4d ago

Published in
itversity

Mastering Advanced Chaining Techniques in Pandas

Optimizing Data Transformation with Efficient Workflows

4d ago

Mastering Advanced Chaining Techniques in Pandas

4d ago

Monthly Sales Commission Analysis with Pandas — A Complete Workflow

Optimizing Sales Performance: A Pandas-Based Sales Commission Workflow

4d ago

Monthly Sales Commission Analysis with Pandas — A Complete Workflow

4d ago

Published in
itversity

Setting Up and Managing a Single-Node Big Data Cluster with Apache Hive

Dive deep into validating Apache Hive installation, automating cluster management, and streamlining operations on a single-node Hadoop…

5d ago

5d ago

Published in
itversity

Complete PostgreSQL Setup: Create Databases, Fix Errors & Manage Users Like a Pro

The Ultimate Guide to Setting Up, Managing, and Troubleshooting PostgreSQL for Smooth Database Operations

6d ago

Complete PostgreSQL Setup: Create Databases, Fix Errors & Manage Users Like a Pro

6d ago

Adding and Updating Columns in Pandas: A Step-by-Step Guide

Transforming Data for Better Analysis and Insights

6d ago

Adding and Updating Columns in Pandas: A Step-by-Step Guide

6d ago

Published in
itversity

Efficient Data Processing with Pandas: Chaining Transformations

Streamlining Data Transformations for Performance and Readability

6d ago

Efficient Data Processing with Pandas: Chaining Transformations

6d ago

Mastering Row-Level Transformations in Pandas with apply()

Row-level transformations are crucial in data processing and feature engineering, allowing us to modify datasets dynamically. In this…

Feb 22

Mastering Row-Level Transformations in Pandas with apply()

Feb 22

Advanced Custom Aggregation Functions in Pandas

Master Multi-Step Calculations for Data Analysis

Feb 22

Advanced Custom Aggregation Functions in Pandas

Feb 22

Published in
itversity

Custom Aggregation Techniques You Need to Know: Advanced Data Processing for Insights

Unlock the Power of Custom Aggregations for Data Analysis

Feb 21

Custom Aggregation Techniques You Need to Know: Advanced Data Processing for Insights

Feb 21

Published in
itversity

SQL Performance Tuning Scenario #10: Large Dataset Processing Strategies

Welcome to the final scenario in our SQL Performance Tuning series! Throughout this series, we’ve explored various techniques for…

Feb 20

SQL Performance Tuning Scenario #10: Large Dataset Processing Strategies

Feb 20

Published in
itversity

SQL Performance Tuning Scenario #9: Bulk Loading Strategies

Efficient bulk data loading is crucial for database performance, especially when dealing with large datasets. This guide covers key…

Feb 20

Feb 20

Published in
itversity

SQL Performance Tuning Scenario #8: Optimizing Ranking Queries

Welcome to Scenario #8 in our SQL Performance Tuning series. In previous scenarios, we explored indexing, partitioning, and query…

Feb 19

Feb 19

Durga Gadiraju

Durga Gadiraju

Founder of ITVersity and Technology Evangelist

Following

Lists

Master Databricks for Data Engineering - List

Data Engineering Resources

Data Engineering and Data Science using Yelp Dataset on AWS

7 stories1 save

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams