Presented at the recent O’Reilly OSCON – Open Source Convention 2014 by Josh Patterson (Patterson Consulting) and Adam Gibson (Skymind.io) is “Introduction to Parallel Iterative Deep Learning on Hadoop’s Next-Generation YARN Framework.”
Archives for August 2014
Why Cray is Backing Lustre and OpenSFS
August 29, 2014 by
“At Cray, we are a big user and investor in Lustre. Because Lustre is such a great fit for HPC, we deploy it with almost all of our systems. We even sell and deliver Lustre storage independent of Cray compute systems. But Lustre is not (yet) the perfect solution for distributed and parallel-I/O, so Cray invests a lot of time and resources into improving, testing, and honing it. We collaborate with the open-source Lustre community on those enhancements and development. In fact, Cray is a leader in the Lustre community through our involvement in OpenSFS.”
This Week in HPC: Cray Creates GPU Heavy Server Node and New Exascale Recommendations for the DOE
August 29, 2014 by
In this episode of This Week in HPC, Michael Feldman and Addison Snell from Intersect360 Research discuss the new Cray CS-Storm supercomputer based on Nvidia GPUs. After that, the discussion turns to exascale investment recommendations coming out of a new report from a Department of Energy Task Force.
Hadoop Buyer’s Guide
August 28, 2014 by
The Hadoop Buyer’s Guide by Robert D. Schneider, author of Hadoop for Dummies, is an invaluable resource for those investigating or evaluating Hadoop—from understanding how Hadoop can solve your data challenges, to what to look for when selecting a solution, to comparing vendors, and preparing for implementation and future success.
Video: Preparing Your Application for Advanced Manycore Architectures
August 28, 2014 by
“Confronting power limitations and the high cost of data movement, new supercomputing architectures within the DOE are requiring users make changes to application codes to achieve high performance. More specifically, users will need to exploit greater on-node parallelism and longer vector units, and restructure code to take advantage of memory locality. In this presentation you will learn about coming architectural trends and what you can do now to start preparing your application.”
Seagate Shipping 8TB Hard Drives for the Cloud
August 28, 2014 by
This week Seagate announced that the company is shipping the world’s first 8TB hard disk drives. As a bulk storage drive for the Cloud market, the new device is optimized for cost per gigabyte vs. performance.
Glassbeam Announces Additional $2 Million Funding Round
August 28, 2014 by
Glassbeam, Inc., the machine data analytics company, has announced significant new momentum with $2 million in additional funding. The investment, led by VKRM Group, a boutique venture capital firm investing in entrepreneurs building innovative and industry-leading businesses, will be used to continue the refinement of its unique, patentable Internet of Things (IoT) platform – Glassbeam SCALAR.
ISC Big Data Conference Offers Early Bird Discount
August 28, 2014 by
ISC has announced an Early Bird discount for its second annual Big Data conference. The event will offer attendees insights into the latest developments in data-intensive computing from both industry players and researchers.
Supercomputing Hummingbirds and How they Hover
August 28, 2014 by
“For a hummingbird with only a 10 centimeter wingspan, the unsteady aerodynamics is complex enough to require millions of mesh points to resolve the many, many small vortices stirred up by the wings — the bird essentially is flying in an ‘ocean of vortices.’ Therefore, efficient algorithms and high-performance computing are necessary for this work.”
Understanding I/O Patterns at the Block Level with ioprof
August 28, 2014 by
Over at Admin HPC, Intel’s Jeff Layton writes that understanding how data makes its way from the application to storage devices is key to understanding how I/O works and that monitoring the lowest level of the I/O stack, the block driver, is a crucial part of this overall understanding of I/O patterns.
