Big Data In Little Spaces: Hadoop And Spark At The Edge

Details

Written by Administrator

Published: 25 April 2019

Hits: 134

Ever wonder what Edge computing is all about? Data happens and information takes work. Estimates are that by 2020, 1.7 megabytes of new data will be created every second for every person in the world. That is a lot of raw data.

Two questions come to mind. What are we going to do with it and where we going to keep it. Big Data is often described by the three Vs – Volume, Velocity, and Variability – and note not all three need apply. What is missing is the letter “U” which stands for Usability. A Data Scientist will first ask, how much of my data is usable? Data usability can take several forms and include things like quality (is it noisy, incomplete, accurate) and pertinence (is there any extraneous information that will not make a difference to my analysis). There is also the issue of timeliness. Is there a “use by” date for the analysis or might the data be needed in the future for some as of yet unknown reason. The usability component is hugely important and often determines the size of any scalable analytics solution. Usable data is not the same as raw data.

Get the full article at The Next Platform. You may recognize the author.

SC18: Beowulf Video and Other Cool Stuff

Details

Written by Number Six

Published: 31 October 2018

Hits: 1217

Entire Beowulf cluster to be built start to finish during Supercomputing using 3D printing.

Dallas, Texas, October 31 2018 — The Beowulf community will be featured prominently in the SC 30th Anniversary Exhibit at SC18 in Dallas November 12–15 to celebrate 30 years of SC and 25 years of the Beowulf Project. Beowulf is a methodology that uses open software to connect a local cluster of commodity-grade hardware into a single processing element. What began as a disruptive idea in 1993 has fundamentally changed the trajectory of supercomputing, and its influence has filtered down into nearly every aspect of High Performance Computing (HPC) today.

Water Cooling Clusters without the Plumber

Details

Written by Douglas Eadline

Published: 01 March 2019

Hits: 299

When is water cooling not wet?

There is new white paper out entitled Energy Performance Evaluation of Aquila’s Aquarius Fixed Cold Plate Cooling System at NREL’s High Performance Computing Center. Before you assume this is YAWCC (Yet Another Water Cooled Cluster) you may want to consider that no water or liquids ever "touch" any processors. How then does it work? you may ask. Basically Aquila has a clever design that separates the water/processor interface with a highly efficient transfer medium. This design keeps the water contained in cooling circuit while the servers are free to be "dry servers" and require no internal plumbing. Bottom line: highly efficient water cooling with no plumbing or leaks. The Executive Summary (reprinted with permission) provides more details.

Breathe Easy: The Red Hat Acquisition by IBM Was Always a Goal

Details

Written by Douglas Eadline

Published: 29 October 2018

Hits: 1461

Over the weekend it was announced IBM was buying Red Hat. A lot of gasps in the community. Personally, I'm not surprised and some other strategic moves may follow. My guess is Canonical's phone is ringing today. I sometimes think these acquisitions are forty percent about the technology/people and sixty percent about keeping it out of the hands of competitors. In this case, I believe it is about renting remote servers, sorry, cloud computing.