Photo by Ayla Verschueren on Unsplash
How to Apache Spark Break DAG lineage – Do you know these 3 cool methods?
In this post, I will introduce you to 3 methods how to Apache Spark Break DAG lineage. It's very possible…
Hadoop Logo
How to copy files from one directory to another on HDFS (Hadoop)? – Start doing it the 1 right way!
We often encounter the need to copy data between directories on HDFS on Hadoop. [ How to copy files from…
Photo by John Schnobrich on Unsplash
Apache Kafka How to delete data from Kafka topic? – you probably didn’t know these 2 cool methods!
When working with Apache Kafka, there may be a situation when [ Apache Kafka How to delete data from Kafka…
Apache Spark ReduceByKey vs GroupByKey – differences and comparison – 1 Secret to Becoming a Master of RDD!
In this post I will try to introduce you to the main differences between Apache Spark ReduceByKey vs GroupByKey methods…
Run Cloudera QuickStart using Docker – easy steps & setup in 5 mins!
In this short post I will show how you can run the Cloudera QuickStart using Docker. As you know from…
Photo by Annie Spratt on Unsplash
How to save data ORC Parquet Text CSV in Hive file or any different file type? – 4 types 1 easy approach!
In this post I will show you how to save data ORC Parquet Text CSV in Hive in few ways…
Talend Kafka MongoDB Docker-Compose Real-Time Streaming – Integrate Them Together in 3 Mins?
In today's world, we often meet requirements for real-time data processing (Talend Kafka MongoDB Docker-Compose real-time). There are quite a…
Apache Spark Rename Or Delete a File HDFS – Great Example In 1 Minute?
In this short post I will show you how you can using Apache Spark rename or delete a file HDFS.…
How to run shell command in Scala from the code level – check great code snippet in 1 minute?
How to run shell command in Scala [ How to run shell command in Scala ] To execute the shell…
Apache Spark Save DataFrame As a Single File HDFS – 1 Min Solution?
Problem In this tutorial I will show the example when using Apache Spark Save DataFrame as a single file HDFS.…