Conference Reports

I was able to attend the fall 2014 Strata/Hadoop World this year. Held in New York City, the show was active and confirms the data science sector is alive and growing. There is a lot to mention, however, I found one aspect quite interesting. While walking the exhibit floor I passed a small 10'x10' booth that had nothing but a table. There was no fancy back drop or exciting demonstrations, just a lot of people gathering and a small conference sign that said Databricks.

I knew who it was right away – the Apache Spark crew now launching a company. I also knew one other thing – the amount of people around this bare booth meant Spark was hot and getting hotter. Often labeled as the Hadoop killer, Spark is an in-memory data analytics tool.

Delivering big SMP performance at a cluster price Numascale

This year at SC12 Numascale, maker of low cost plug-and-play high performance shared memory systems, was showing performance numbers and some happy clients. For those that may not know, Numascale produces the NumaConnect adapter that provides plug-and-play connection of standard servers running a single un-patched OS version. Applications have fast access to the aggregate memory of all servers in the system using a hardware controlled ccNuma environment.

NumaConnect facilitates very large shared memory systems built from commodity servers at the price level of high-end clusters. This combination invites a new level of price/capability/performance that has never before been demonstrated using pure hardware. Systems built with NumaConnect run standard operating systems and all x86 applications.

Grids, Clusters and Making Money

Earlier this week I attended High Performance on Wall Street in New York City. The conference was well attended and interest levels were quite high. Of course, clusters have become the workhorse of Wall Street due to the shear magnitude computation they need to complete right away. After all, time is money.

Although I had limited time, I managed to find one piece of significant technology news and three presentations worth mentioning.

Company reshaping Lustre storage design with their next generation Lustre Storage Appliance.

Aeon Computing has been awarded the 2012 HPCwire "Best HPC Storage Product or Technology" for their EclipseSL Lustre appliance that is the foundation of the 4 PetaByte Data Oasis storage system at San Diego Supercomputing Center (SDSC). The next generation system will push the Lustre storage performance even further.

The annual Supercomputing show is here. This is the 25th year of the show and it looks to be another good year. First, and foremost, the 2013 BeoBash is scheduled for its usual time (Monday 18th, 9-midnight) get all the details here and don't forget to check out the "Physics of Spherical Newtonian Solids Smackdown" (aka pool tournament). There are prizes and two tracks, one for beginners, and one for experienced players.

Head Monkey, Doug Eadline will be speaking in the Scalable Informatics booth #1919 on Personal Big Data: The Apache Hadoop YARN Workstation and Beyond and demonstrating the Limulus personal cluster workstation running Apache Hadoop YARN (V2.2). The talks are scheduled for Tuesday: 5pm, Wednesday: 11am, Thursday: 1pm. The Limulus workstations, which by the way offer a remarkable $23/CPU-GFLOP, are now shipping from Basement Supercomputing. You can find some other benchmarks on the project page.

Check back soon! There will be more SC13 coverage as the week unfolds.

Subcategories

Search

Login And Newsletter

Create an account to access exclusive content, comment on articles, and receive our newsletters.

Feedburner

Share The Bananas


Creative Commons License
©2005-2019 Copyright Seagrove LLC, Some rights reserved. Except where otherwise noted, this site is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 2.5 License. The Cluster Monkey Logo and Monkey Character are Trademarks of Seagrove LLC.