Welcome to Practical Data Science with Hadoop and Spark, where you can ask questions about the book and examples. By visiting our website you agree that we are using cookies to ensure you to get the best experience.
0 votes

Hello Team,

I'm currently configuring hadoop on a server running CentOs. When I run start-dfs.sh or stop-dfs.sh, I get the following error:

WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

I'm running Hadoop 2.2.0.

Doing a search online brought up this link: http://balanceandbreath.blogspot.ca/2013/01/utilnativecodeloader-unable-to-load.html

However, the contents of /native/ directory on hadoop 2.x appear to be different so I am not sure what to do.

I've also added these two environment variables in hadoop-env.sh:

export HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=/usr/local/hadoop/lib/"

export HADOOP_COMMON_LIB_NATIVE_DIR="/usr/local/hadoop/lib/native/"

Any ideas?

asked in Getting Data Into Hadoop by

1 Answer

0 votes
You are using a rather old version of Hadoop. Ignore the warning. It is due to Hadoop libs compiled as 32 bit vs 64. I don't this this exists in newer versions.
answered by (200 points)
...