This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
linux_hadoop_minimal_installation_instructions_version_2 [2023/02/20 16:01] deadline [Installation Steps for Apple-M1 Based Hosts] |
linux_hadoop_minimal_installation_instructions_version_2 [2024/01/30 14:07] (current) deadline [Issues/Bugs] |
||
---|---|---|---|
Line 1: | Line 1: | ||
=====Linux Hadoop Minimal VM Notes VERSION 2===== | =====Linux Hadoop Minimal VM Notes VERSION 2===== | ||
- | === There are now two versions of the LHM (Intel-x86_64 and Apple-M1) === | + | === There are now two versions of the LHM (Intel-x86_64 and Apple-M) === |
* The Intel version is for all Windows, Mac, and Linux systems that use Intel x86_64 based processors. | * The Intel version is for all Windows, Mac, and Linux systems that use Intel x86_64 based processors. | ||
Line 7: | Line 7: | ||
=== Intel x86_64 with VirtualBox=== | === Intel x86_64 with VirtualBox=== | ||
- | * Version: 2.0-beta8\\ | + | * Version: 2.0-8.1\\ |
- | * Release Date: August 9, 2022 | + | * Release Date: 25-Jan-2024 |
=== Apple M1, M2 with UTM === | === Apple M1, M2 with UTM === | ||
- | * Version: 2.0-beta8-M1-R1 | + | * Version: 2.0-M8.1 |
- | * Release Date: January | + | * Release Date: 25-Jan-2024 |
=== Issues with Either version of the LHM=== | === Issues with Either version of the LHM=== | ||
Line 66: | Line 66: | ||
**Step 3a:** On MacIntosh Systems with //Big Sur//, you may get the '' | **Step 3a:** On MacIntosh Systems with //Big Sur//, you may get the '' | ||
- | **Step 4:** Download the https://www.clustermonkey.net/download/Hands-on_Hadoop_Spark/ | + | **Step 4:** Download the current Linux-Hadoop-Minimal-V2.0-xxxxx.ova image [[http://161.35.229.207/download/Linux-Hadoop-Minimal-V2.0-8.1.ova|US]] [[http:// |
**Step 5:** Start the VM. All the essential Hadoop service should be started automatically. | **Step 5:** Start the VM. All the essential Hadoop service should be started automatically. | ||
Line 72: | Line 72: | ||
**HINT:** If your laptop (desktop) has more than 4GB or memory, you can increase the amount of memory for the LHM virtual machine. Before the LHM is started, go to the VirtualBox GUI, select the LHM, then select '' | **HINT:** If your laptop (desktop) has more than 4GB or memory, you can increase the amount of memory for the LHM virtual machine. Before the LHM is started, go to the VirtualBox GUI, select the LHM, then select '' | ||
- | ====Installation Steps for Apple-M1 Based Hosts ==== | + | **IMPORTANT** The LHM should be stopped when not in use. The running services should be stopped in a '' |
- | There is a partial | + | ====Installation Steps for Apple-M Based Hosts ==== |
+ | |||
+ | **25-Jan-2024 VERSION-UPDATED** | ||
+ | |||
+ | There is a full LHM for the Apple M based machines. The following (aarch64) packages are installed: CentOS Linux 7.6, Python3 3.6.8, R 3.6.0, Hadoop 3.3.0, Hive 3.1.2, Apache Spark 2.4.5, Derby 10.14.2.0, Zeppelin 0.8.2, Sqoop 1.4.7, Kafka 2.5.0, HBase 2.4.10, NiFi 1.17.0 (KafkaEsque is not installed) | ||
To run the VM on an Apple-M1 based machine, Perform the following steps: | To run the VM on an Apple-M1 based machine, Perform the following steps: | ||
Line 80: | Line 84: | ||
**Step 1:** Download and install [[ https:// | **Step 1:** Download and install [[ https:// | ||
- | **Step 2:** Download the LHM for Apple-M1 into your '' | ||
+ | **Step 2:** Download the LHM for Apple-M1 into your '' | ||
- | **Step 3:** The downloaded LHM is a zip file. Click to extract the file. It should create a directory called '' | + | **Step 3:** The downloaded LHM is a zip file. Click to extract the file. It should create a directory called '' |
- | **Step 4:** Start UTM (it will be in the applications folder, suggest keeping it in your dock) Click the '' | + | **Step 4:** Start UTM (it will be in the applications folder, suggest keeping it in your dock) Click the '' |
**Step 5:** Start the LHM by clicking on the big arrow in the middle of the window. (If it is not highlighted, | **Step 5:** Start the LHM by clicking on the big arrow in the middle of the window. (If it is not highlighted, | ||
- | **Note:** The LHM is configured to use 4-cores and 6G of memory. This should leave enough resources to run other application on the host. If you are having difficult with running applications while the LHM is running, you can stop the LHM and the 6G of memory and 4 cores it was using will be released. | + | **Note |
+ | |||
+ | **Note 2:** The LHM is configured to use 4-cores and 6G of memory. This should leave enough resources to run other application on the host. If you are having difficult with running applications while the LHM is running, you can stop the LHM and the 6G of memory and 4 cores it was using will be released. | ||
- | **IMPORTANT** The LHM should be stopped when not in use. The running services should be stopped in a '' | + | **IMPORTANT** The LHM should be stopped when not in use. The running services should be stopped in a '' |
Line 387: | Line 393: | ||
3. If the **time on the LHM falls out of sync** with the host due to hibernation, | 3. If the **time on the LHM falls out of sync** with the host due to hibernation, | ||
- | systemctl -l start ntpd | + | systemctl -l stop ntpd |
ntpdate -u pool.ntp.org | ntpdate -u pool.ntp.org | ||
systemctl -l start ntpd | systemctl -l start ntpd |