[SOLVED] Talend Big Data java.io.IOException: Could Not Locate Executable winutils.exe In The Hadoop Binaries – Check 2 short solution!

You are currently viewing [SOLVED] Talend Big Data java.io.IOException: Could Not Locate Executable winutils.exe In The Hadoop Binaries – Check 2 short solution!
Share This Post, Help Others, And Earn My Heartfelt Appreciation! :)
4.8
(1118)

While you start a job in Talend Big Data, you could see the warning:
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries 

Problem -> In Talend Could Not Locate Executable

While you start a job in TOS Big Data, you could see the warning:

java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries 

Talend Big Data java.io.IOException

java.io.FileNotFoundException: The hadoop home directory (hadoop.home.dir) doesn't contain the required winutils.exe binary

Winutils.exe In The Hadoop Binaries

Now let’s look at some solutions to this problem, which itself is very simple. So let’s get down to business!

Solution #1 (recommended)

  • Download the file winutils. exe eg from this page on GitHub (https://github.com/steveloughran/winutils) in the corresponding version of your Hadoop environment.
  • Create a directory: C:\hadoop\bin
  • Copy the previously downloaded winutils. exe file to the C:\hadoop\bin folder
  • Create a new environment variable: HADOOP_HOME and enter the path to the folder where the winutils.exe file is located: HADOOP_HOME=C:\hadoop\bin
  • Run again Talend Studio

Solution #2

  • Download the file winutils. exe eg from this page on GitHub (https://github.com/steveloughran/winutils) in the corresponding version of your Hadoop environment.
  • Create a directory: C:\hadoop\bin
  • Copy the previously downloaded winutils. exe file to the C:\hadoop\bin folder
  • In the job configuration at TOS Studio, open the “Run -> Advanced” tab.
  • In the JVM Settings section, click the new button to add a new argument.
  • Add an argument like this: -Dhadoop.home.dir=C:\hadoop\bin -Dhadoop.home.dir=C:\hadoop\bin
Talend Big Data java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries - check 2 short solution!

Summary

Why Solution #1 is recommended? And because you only do this once and it will affect all the jobs you create. In Solution #2, for each newly created work, add the –Dhadoop.home.dir=C:\hadoop\bin argument in the “Run -> Advanced” section.

The decision is up to you which solution you choose! The most important thing is that there is plenty to choose from! 🙂

Talend Big Data Platform

Talend Big Data Platform combines Talend products into a common set of powerful, easy-to-use solutions. Talend data integration solution helps companies deal with growing system complexities by addressing both ETL for analytics and ETL for operational integration needs and offering industrialization features and extended monitoring capabilities.

Built on top of Talend data integration solution, the big data solution is a powerful tool that enables users to access, transform, move and synchronize big data by leveraging the Apache Hadoop Big Data Platform and makes the Hadoop platform ever so easy to use.

https://help.talend.com/r/kEbCCSkPyTOEAFvbdBEipA/TwG0D57yzUesL0P15eYYVA

If you enjoyed this post please add the comment below and share this post on your Facebook, Twitter, LinkedIn or another social media webpage.
Thanks in advanced!

How useful was this post?

Click on a star to rate it!

Average rating 4.8 / 5. Vote count: 1118

No votes so far! Be the first to rate this post.

Subscribe
Notify of
guest
0 Comments
Inline Feedbacks
View all comments