linux_hadoop_minimal_installation_instructions_version_2
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
linux_hadoop_minimal_installation_instructions_version_2 [2023/02/20 19:20] deadline [Installation Steps for Apple-M1 Based Hosts] |
linux_hadoop_minimal_installation_instructions_version_2 [2024/01/30 14:07] (current) deadline [Issues/Bugs] |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| =====Linux Hadoop Minimal VM Notes VERSION 2===== | =====Linux Hadoop Minimal VM Notes VERSION 2===== | ||
| - | === There are now two versions of the LHM (Intel-x86_64 and Apple-M1) === | + | === There are now two versions of the LHM (Intel-x86_64 and Apple-M) === |
| * The Intel version is for all Windows, Mac, and Linux systems that use Intel x86_64 based processors. | * The Intel version is for all Windows, Mac, and Linux systems that use Intel x86_64 based processors. | ||
| Line 7: | Line 7: | ||
| === Intel x86_64 with VirtualBox=== | === Intel x86_64 with VirtualBox=== | ||
| - | * Version: 2.0-beta8\\ | + | * Version: 2.0-8.1\\ |
| - | * Release Date: August 9, 2022 | + | * Release Date: 25-Jan-2024 |
| === Apple M1, M2 with UTM === | === Apple M1, M2 with UTM === | ||
| - | * Version: 2.0-beta8-M1-R2 | + | * Version: 2.0-M8.1 |
| - | * Release Date: February 20, 2023 | + | * Release Date: 25-Jan-2024 |
| === Issues with Either version of the LHM=== | === Issues with Either version of the LHM=== | ||
| Line 66: | Line 66: | ||
| **Step 3a:** On MacIntosh Systems with //Big Sur//, you may get the '' | **Step 3a:** On MacIntosh Systems with //Big Sur//, you may get the '' | ||
| - | **Step 4:** Download the https://www.clustermonkey.net/download/Hands-on_Hadoop_Spark/ | + | **Step 4:** Download the current Linux-Hadoop-Minimal-V2.0-xxxxx.ova image [[http://161.35.229.207/download/Linux-Hadoop-Minimal-V2.0-8.1.ova|US]] [[http:// |
| **Step 5:** Start the VM. All the essential Hadoop service should be started automatically. | **Step 5:** Start the VM. All the essential Hadoop service should be started automatically. | ||
| Line 74: | Line 74: | ||
| **IMPORTANT** The LHM should be stopped when not in use. The running services should be stopped in a '' | **IMPORTANT** The LHM should be stopped when not in use. The running services should be stopped in a '' | ||
| - | ====Installation Steps for Apple-M1 Based Hosts ==== | + | ====Installation Steps for Apple-M Based Hosts ==== |
| - | **20-Feb-2023 VERSION-UPDATED** | + | **25-Jan-2024 VERSION-UPDATED** |
| - | There is a partial | + | There is a full LHM for the Apple M based machines. The following (aarch64) packages are installed: CentOS Linux 7.6, Python3 3.6.8, R 3.6.0, Hadoop 3.3.0, Hive 3.1.2, Apache Spark 2.4.5, Derby 10.14.2.0, Zeppelin 0.8.2, Sqoop 1.4.7, Kafka 2.5.0, HBase 2.4.10, NiFi 1.17.0 (KafkaEsque is not installed) |
| To run the VM on an Apple-M1 based machine, Perform the following steps: | To run the VM on an Apple-M1 based machine, Perform the following steps: | ||
| Line 85: | Line 85: | ||
| - | **Step 2:** Download the LHM for Apple-M1 into your '' | + | **Step 2:** Download the LHM for Apple-M1 into your '' |
| - | **Step 3:** The downloaded LHM is a zip file. Click to extract the file. It should create a directory called '' | + | **Step 3:** The downloaded LHM is a zip file. Click to extract the file. It should create a directory called '' |
| - | **Step 4:** Start UTM (it will be in the applications folder, suggest keeping it in your dock) Click the '' | + | **Step 4:** Start UTM (it will be in the applications folder, suggest keeping it in your dock) Click the '' |
| **Step 5:** Start the LHM by clicking on the big arrow in the middle of the window. (If it is not highlighted, | **Step 5:** Start the LHM by clicking on the big arrow in the middle of the window. (If it is not highlighted, | ||
| - | **Note:** The LHM is configured to use 4-cores and 6G of memory. This should leave enough resources to run other application on the host. If you are having difficult with running applications while the LHM is running, you can stop the LHM and the 6G of memory and 4 cores it was using will be released. | + | **Note |
| + | |||
| + | **Note 2:** The LHM is configured to use 4-cores and 6G of memory. This should leave enough resources to run other application on the host. If you are having difficult with running applications while the LHM is running, you can stop the LHM and the 6G of memory and 4 cores it was using will be released. | ||
| **IMPORTANT** The LHM should be stopped when not in use. The running services should be stopped in a '' | **IMPORTANT** The LHM should be stopped when not in use. The running services should be stopped in a '' | ||
| Line 391: | Line 393: | ||
| 3. If the **time on the LHM falls out of sync** with the host due to hibernation, | 3. If the **time on the LHM falls out of sync** with the host due to hibernation, | ||
| - | systemctl -l start ntpd | + | systemctl -l stop ntpd |
| ntpdate -u pool.ntp.org | ntpdate -u pool.ntp.org | ||
| systemctl -l start ntpd | systemctl -l start ntpd | ||
linux_hadoop_minimal_installation_instructions_version_2.1676920836.txt.gz · Last modified: 2023/02/20 19:20 by deadline
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Noncommercial-Share Alike 4.0 International
