Spark Scala
Spark Interview Question - Online Assessment Coding Test Round | Using Spark with Scala
In this blog, we will have a discussion about the online assessment asked in one of th…
Showing posts with the label pysparkShow all
window rank
How to Use QUALIFY Keyword in Databricks SQL - Real-time Example and Performance Optimization
How to Use Qualify Keyword in Databricks SQL | Real-time Case on Qualify in Spark SQL In this blog, we will learn how to use the QUALIFY key...
Word count
Word Count Program in Apache Spark using Spark DF | PySpark
Word Count Program in Apache Spark using Spark DF | PySpark In this blog, we will check on the various methods available to solve the word c...
Spark DataFrame is Empty or Not Empty
Data Processing and Validation with Apache Spark: How to Find if a Spark DataFrame is Empty or Non Empty
Data Processing and Validation with Apache Spark: How to Find if a Spark DataFrame is Empty or Non Empty ? As a data scientist or data engi...
structtype
How to Add Column to StructType in Spark DF | Add, Drop, Cast Column in Spark Struct Field | Apache Spark
In this blog, we will learn how to apply a business logic or transformation to the column in Spark DF of type StructType. We will see how we...
spark with scala
How to Replace a String in Spark DataFrame | Spark Scenario Based Question
In this tutorial, we will see how to solve the problem statement and get required output as shown in the below picture. We will learn, how t...
Spark with Python
Create DataBricks Community Edition Account for Free | Databricks - Try for free
This article is especially for beginners, who enters into BigData and who are eager to start their career in BigData, DataScience and M...
Spark Scala
Social Plugin