Apache Spark: how to rename or delete a file from HDFS?
In this short post I will show you how you can change the name of the file / files created by Apache Spark to HDFS or simply rename or delete any file.
Scala: how to run a shell command from the code level?
In this post I will show you how to run the shell command by programming in Scala and how you can use it in Apache Spark.
Apache Spark: How to save DataFrame as a single file on HDFS?
If you want to save DataFrame as a file on HDFS, there may be a problem that it will be saved as many files. This is the most correct behavior and it results from the parallel work in Apache Spark.
Apache Spark: How to check if the file exists on HDFS?
We will use the FileSystem and Path classes from the org.apache.hadoop.fs library to achieve it.
Connection configuration between Talend and Cloudera
Cloudera is one of the three major players in the market alongside Hortonworks and MapR, which distributes the Hadoop general-interest.
Windows: How to add a server name and IP to the hosts file?
A short tutorial on how to edit the hosts file under Windows system.
Akka.io: Quickstart with Java
Very often you can meet the requirement to create an application that will collect data from an external system through its API. It may turn out that the "bottleneck" of such an application will be the time of its implementation.
Apache Spark: Machine Learning – predicting diabetes in patients
Today I will show you how you can use Machine Learning libraries (ML), which are available in Spark as a library under the name Spark MLib.
How to run several commands on a Linux system in parallel mode?
You would like to run several commands at the same time, but each of them should be run in a separate thread.
Windows: How to add an environment variable?
To add an environment variable, start the Start Menu and depending on whether you have set the PL or ENG language in Windows enter the appropriate phrase:
