Quantcast
Channel: Active questions tagged ubuntu - Stack Overflow
Viewing all articles
Browse latest Browse all 6153

File I want to put into hdfs directory not appearing in hadoop terminal [closed]

$
0
0

I'm currently trying to hdfs dfs -put /mnt/dock_dir/test1.txt /user/root/data but get put: '/mnt/dock_dir/test1.txt': No such file or directory, and that file does exist, I just can't see it when I'm in the hadoop terminal. In fact, (csce438 is the user) I can't see my entire /home/csce438 directory in the hadoop bash terminal, home is just empty (when just using cd and ls to navigate). I can find all the files in a normal terminal and file explorer. Some more details is that this is a school project and on an ubuntu VM, and as it's a school project, I'm pretty inexperienced with the environment.

Here's a list of what I'm doing.

  1. Installed Docker Engine using binaries, specifically docker-23.0.0.tgz. And I did run sudo cp docker/* /usr/bin/ if that means anything.
  2. Pulling Sequenceiq/hadoop-docker image
  3. run from /home/csce438 $ docker run -it ==volume ./dock_dir:/mnt/dock_dir sequenceiq/hadoop-docker:2.7.0 /etc/bootstrap.sh -bash (this successfully opens the hadoop terminal).
  4. $ export HADOOP_CLASSPATH=/usr/java/default/lib/tools.jar
  5. $ export PATH=$PATH:/usr/local/hadoop/bin
  6. $ hdfs dfs -mkdir /user/root/data -this does work, the directory exists.
  7. $ hdfs dfs -put /mnt/dock_dir/test1.txt /user/root/data - again, where I get the error

Viewing all articles
Browse latest Browse all 6153

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>