This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
linux_hadoop_minimal_installation_instructions [2019/06/11 16:43] deadline more tweaks |
linux_hadoop_minimal_installation_instructions [2020/05/21 18:46] (current) deadline |
||
---|---|---|---|
Line 5: | Line 5: | ||
**Email:** deadline(you know what goes here)basement-supercomputing.com | **Email:** deadline(you know what goes here)basement-supercomputing.com | ||
- | Unless otherwise noted, all course content, notes, and examples are | + | **Unless otherwise noted, all course content, notes, and examples are |
- | (c) Copyright Basement Supercomputing 2019, All rights reserved. | + | (c) Copyright Basement Supercomputing 2019, All rights reserved.** |
====What Is This?==== | ====What Is This?==== | ||
Line 16: | Line 16: | ||
* [[https:// | * [[https:// | ||
- | It can also be used for the examples provided in the companion on-line | + | It can also be used for the [[https:// |
video tutorial (14+ hours): | video tutorial (14+ hours): | ||
Line 37: | Line 37: | ||
wget https:// | wget https:// | ||
- | tar xvzf Hands_On_Hadoop_Spark-V1.5.tgz | + | tar xvzf Hands_On_Hadoop_Spark-V1.5.1.tgz |
Similarly, for the "Linux Command Line" course (do this within the VM) | Similarly, for the "Linux Command Line" course (do this within the VM) | ||
Line 92: | Line 92: | ||
**Step 3:** Make sure hardware virtualization is enabled in your BIOS. | **Step 3:** Make sure hardware virtualization is enabled in your BIOS. | ||
- | **Step 4:** Download | + | **Step 4:** Download the https:// |
**Step 5:** Start the VM. All the essential Hadoop service should be started automatically. | **Step 5:** Start the VM. All the essential Hadoop service should be started automatically. | ||
Line 286: | Line 287: | ||
and describe the situation. | and describe the situation. | ||
- | When the VM is stopped (see belwo) with '' | + | When the VM is stopped (see below) with '' |
====Stopping the VM==== | ====Stopping the VM==== | ||
Line 308: | Line 309: | ||
These issues have been addressed in the current version of the VM. Please use the lasted VM and you can avoid these issues. | These issues have been addressed in the current version of the VM. Please use the lasted VM and you can avoid these issues. | ||
- | 1. Either create your own user account as described above or use the existing " | + | 1. If you have problems loading the OVA image into VirtualBox, check the MD5 signature of the OVA file. The MD5 signature returned by running the program below should match the signature provided [[https:// |
+ | |||
+ | For **Linux** use " | ||
+ | |||
+ | $ md5sum Linux-Hadoop-Minimal-0.42.ova | ||
+ | |||
+ | For **Macintosh** use " | ||
+ | |||
+ | $ md5 Linux-Hadoop-Minimal-0.42.ova | ||
+ | |||
+ | For **Windows 10** (in PowerShell) use " | ||
+ | |||
+ | C: | ||
+ | |||
+ | 2. Either create your own user account as described above or use the existing " | ||
- | 2. If zip is not installed on your version of the VM, you can install it by entering the following, as root, and a " | + | 3. If zip is not installed on your version of the VM, you can install it by entering the following, as root, and a " |
# yum install zip | # yum install zip | ||
Line 323: | Line 338: | ||
| | ||
- | 3. In previous versions there is a permission issue in HDFS that prevents Hive jobs from working. To fix it, perform the following steps: | + | 4. In previous versions there is a permission issue in HDFS that prevents Hive jobs from working. To fix it, perform the following steps: |
a) login to the VM as root (pw=" | a) login to the VM as root (pw=" |