Hadoop Is Not a Toaster

Details

Written by Douglas Eadline

Published: 18 September 2019

Hits: 1744

From the "Here comes the cluestick" department

Apache Hadoop has been in the press lately. Some of the content has not been positive and, often times, reflects a misunderstanding of how Hadoop relates to data processing. Indeed, we seem to be in the Trough of Disillusionment in the Technology Hype Cycle. In my opinion, many of these recent "insights" seem to come from the belief that Hadoop is some kind of toaster. For the record, Hadoop can make great toast and as it traveled up the hype curve, market exuberance thought good tasting toast could do anything. Turns out, these days, people want something to go along with their toast. What happened to the great toast?

Nothing happened to the toast. It turns out that Hadoop may have started out as a toaster, but now it is quite a bit more. Hadoop has evolved into a full kitchen. To understand modern Hadoop technology, one must understand that just like kitchen that is designed to prepare food for consumption, Hadoop is designed as a platform to prepare data for analysis and insights.

New Documents Available to Site Users

Details

Written by Administrator

Published: 22 August 2019

Hits: 2662

From the secret double bonus department

A somewhat un-publicized feature of Cluster Monkey are the PDF documents that registered users can download. These documents include white papers on Limulus Personal computing, a brief book called HPC for Dummies and the PowerPoint slides describing the 3D printing at SC19. To download any of the files you need to register with your email address. When logged in, a Downloads item will appear in the blue Main Menu area on the top left of the page. There you will find the materials.

We ask for your email because we are working on starting two low frequency newsletters covering HPC and Hadoop/Spark. We explain how we treat your information in our Privacy Policy. Also, as a registered user you can leave comments on articles. Cluster Monkey is a community based web-site.

One of our newest documents is a white paper comparing an on-prem Limulus personal appliance to Amazon Cloud instances. The economics are quite interesting. You can also find the slides from our 3D printing demonstration at SC19 and a 2018 white paper on building a Modern Scalable Analytics Classroom--on-prem/no data center needed.

HPC and AI on Wall Street 2019

Details

Written by Number Six

Published: 27 August 2019

Hits: 1594

As mentioned, Cluster Monkey has been attending the HPC & Other on Wall Street meetings and exposition since they began. The event is a great way to meet vendors and learn the latest news happenings on the HPC in finance front (especially those of us on the east coast ). Like before it will take place at the Roosevelt Hotel in NYC.

The Conference Program is posted and it looks to a good day and half of leading edge HPC presentations. The show is focusing on the following themes:

• Artificial Intelligence Use Cases for HPC
• Hybrid and Cloud Computing HyperScale Use Cases
• Data Analytics Use Cases for HPC
• Containerization and Microservices in HPC
• Cyber Analytics for Hyperscale Environments
• Global Blockchain Use Cases in HPC

For those on the east coast and beyond, the event will take place on Wednesday and Thursday, September 11 and 12 at the Roosevelt Hotel in New York City. See you there!

Close to the Edge: If I Don't Use ECC, Have I Made an Error?

Details

Written by Douglas Eadline

Published: 24 June 2019

Hits: 1566

A continuing installment of our (Close to the) Edge Computing series.

The main memory in computing devices is an ephemeral repository of information. Processing units (CPUs) may analyze and change the information, but ultimately the results of everything eventually end up in the main memory store. Of course, the information may move to nonvolatile memory or disk storage, which provides a more permanent resting place.

Main memory integrity is important. If errors occur in main memory, anything from nothing to a full crash of the entire computer is possible. In order to prevent and possibly correct memory errors, Error-Correcting Code memory (ECC) memory has been developed and deployed in systems where data errors may result in harmful results, like in real-time financial systems, for instance. The goal is that the data written to memory should be the same when it is read back in the future.