insideHPC » Search Results » virtualization http://insidehpc.com HPC News Without the Noise for Supercomputing Professionals | insideHPC Sun, 26 May 2013 16:26:18 +0000 en hourly 1 http://wordpress.org/?v=3.1.1 Video: Infinetics – Innovative Topologies http://insidehpc.com/2013/05/03/video-innovative-topologies/ http://insidehpc.com/2013/05/03/video-innovative-topologies/#comments Fri, 03 May 2013 19:52:44 +0000 Rich Brueckner http://insidehpc.com/?p=36971 In this video from the 2013 Open Fabrics Developer Workshop, Harry Quackenboss and Ratko Tomic from Infinetics present: Innovative Topologies. We have invented a unique approach to building a fabric across a large number of Ethernet switches, and built a comprehensive technology platform based on this Flexible Radix Switching (FRS) technique. This innovation enables transparent [...]

The post Video: Infinetics – Innovative Topologies appeared first on insideHPC.

]]>

In this video from the 2013 Open Fabrics Developer Workshop, Harry Quackenboss and Ratko Tomic from Infinetics present: Innovative Topologies.

We have invented a unique approach to building a fabric across a large number of Ethernet switches, and built a comprehensive technology platform based on this Flexible Radix Switching (FRS) technique. This innovation enables transparent integration with existing data center solutions and big improvements to networks supporting cloud, virtualization, and big data applications. These data center network solutions are superior in terms of cost, performance, robustness and ease of use.

Download the slides (PDF). You can check out more OFA videos at our Open Fabrics Workshop Video Gallery.

Related posts:

The post Video: Infinetics – Innovative Topologies appeared first on insideHPC.

]]> http://insidehpc.com/2013/05/03/video-innovative-topologies/feed/ 0 Video: The Sofware-defined Datacenter & RDMA in Virtual Environments http://insidehpc.com/2013/04/28/vmwares-josh-simons-on-the-sofware-defined-datacenter/ http://insidehpc.com/2013/04/28/vmwares-josh-simons-on-the-sofware-defined-datacenter/#comments Sun, 28 Apr 2013 11:00:21 +0000 Rich Brueckner http://insidehpc.com/?p=36842 In this video from the 2013 Open Fabrics Developer Workshop, VMware’s Josh Simons presents: The Sofware-defined Datacenter. The software-defined datacenter vision took the industry by storm in 2012. It represents a prescriptive model that brings the benefits of virtualization to the rest of the datacenter. Expect to see the move towards a software-defined datacenter accelerate [...]

The post Video: The Sofware-defined Datacenter & RDMA in Virtual Environments appeared first on insideHPC.

]]>

In this video from the 2013 Open Fabrics Developer Workshop, VMware’s Josh Simons presents: The Sofware-defined Datacenter.

The software-defined datacenter vision took the industry by storm in 2012. It represents a prescriptive model that brings the benefits of virtualization to the rest of the datacenter. Expect to see the move towards a software-defined datacenter accelerate in 2013. Networking and infrastructure security represent some of the stickiest issues when it comes to the drive to a more agile data center. And because of this strong customer interest in SDDCs, you’ll also see more networking vendors and startups modify their roadmaps to steer towards a software-defined networking strategy.

Read the Full Story or Download the Slides (PDF).

In this follow-up presentation, Bhavesh Davda from VMware gives a talk on RDMA in Virtual Environments.

Related posts:

The post Video: The Sofware-defined Datacenter & RDMA in Virtual Environments appeared first on insideHPC.

]]> http://insidehpc.com/2013/04/28/vmwares-josh-simons-on-the-sofware-defined-datacenter/feed/ 0 insideHPC Video Archive http://insidehpc.com/insidehpc-video-archive/ http://insidehpc.com/insidehpc-video-archive/#comments Thu, 25 Apr 2013 14:52:59 +0000 Rich Brueckner http://insidehpc.com/?page_id=36761 insideHPC Video Archive We try to keep this page up to date, but you can always find our latest works on our RichReport YouTube Channel. 2013 Event Coverage: Open Fabrics Developer Workshop Lustre User Group Video Gallery Moabcon 2013 Video Gallery National HPCC Conference HPC Advisory Council Switzerland Conference SC12 Videos (Alphabetical by Vendor Name): [...]

The post insideHPC Video Archive appeared first on insideHPC.

]]> insideHPC Video Archive

We try to keep this page up to date, but you can always find our latest works on our RichReport YouTube Channel.

2013 Event Coverage:

SC12 Videos (Alphabetical by Vendor Name):

Adaptive Computing

Adaptive Computing SC12 Booth Theater

Aeon

Allinea

Altair

AMD

Asetek

Bull

CAPS-Enterprise

Colfax International

Cycle Computing

DDN

  • DDN Powers Genomics at the Virginia Bioinformatics Institute. Dr. Harold (Skip) Garner from the Virginia Bioinformatics Institute describes how Big Data I/O is required to crunch Genomics data in the fight against cancer.
  • DDN Ramps Up for Exascale at SC12. Jeff Denworth from Data Direct Networks describes the company’s high performance storage solutions for HPC. Used by 60 percent of the TOP100 supercomputers in the works, DDN recently announced a $100 Million dollar investment in Exascale technologies.
  • Steve Simms on the Data Capacitor II at Indiana University. Steve Simms from Indiana University describes a recent upgrade to the Data Capacitor project, a high-speed, high-capacity storage facility for very large data sets. With 5 PB of storage, Data Capacitor II will support big data applications used in computational research. IU partnered with DDN to develop Data Capacitor II, which is scheduled to be installed in the IU Data Center in spring 2013.

Dell

Gnodal

HPC Advisory Council

  • HPC Advisory Council Announces Student Cluster Teams for ISC’12. Gilad Shainer, Tong Liu, and Pak Lui from the HPC Advisory Council revue the organization’s outreach efforts for the past year and look forward to 2013. The council is an active sponsor of international Student Cluster Competitions that encourage young people to learn parallel programming skills.

IBM

IDC

  • IDC HPC Market Update from SC12. Did you know that 3Q2012 was the biggest quarter of revenue in the history of HPC? In this video from SC12, Earl Joseph from IDC presents the latest on the supercomputing market.

Inktank

  • Inktank Boosts Open Source Ceph File System. Neil Levine from Inktank describes the company’s efforts to commercialize and support the Ceph open source file system. With high reliability and nearly unlimited scalability, Ceph has great potential for Big Data applications as well as an enabling technology for Exascale computing.

Intel

Intersect360 Research

NAG

Nirvana

Numascale

Nvidia

Mellanox

  • Mellanox Breaks Performance Records, Dominates TOP500 at SC12. Todd Wilde from Mellanox describes the company’s recent advancements in high speed InfiniBand interconnects. Infiniband recently InfiniBand has become the leading interconnect on the TOP500 with 224 clusters and the Connect-IB dual-port 56Gb/s FDR InfiniBand adapter recently achieved the industry’s highest throughput of more than 100Gb/s utilizing PCI Express 3.0 x16 and over 135 million messages per second, 4.5X higher than previous or competing solutions.

OpenSFS & EOFS

Panasas

  • Panasas Showcases ActiveStor 14 at SC12. By accelerating small file and metadata performance with Solid State Drive (SSD) technology, ActiveStor 14 delivers extreme performance, for the technical computing and big data workloads commonly found in HPC environments.
  • Panasas Chief Scientist on Where HPC Meets Big Data and Hadoop. Panasas ActiveStor not only accelerates product design and scientific discovery applications, but will perform seamless Hadoop analyses, ensuring that customers can extract maximum value from their existing big data infrastructure.

Penguin Computing

Rogue Wave Software

Samplify

SC12 Committee

  • SC12 Press Conference with Jeff Hollingsworth. In this video, SC12 General Chair Jeff Hollingsworth opens the show press conference in Salt Lake City. This year there were a record number of exhibitors have booths at the show. Recorded Nov. 12, 2012.

Scalable Informatics

Seneca

SGI

  • Interview: SGI Teams with Altair on the Road to Exascale. Paul Kinyon from SGI’s product management team describes how the company is working with partners like Altair to solve customer’s toughest computational challenges. The company is looking at a range of technologies that could enbable Exascale computing capabilities at a practical level of power consumption.
  • Intel Xeon Phi Adds Smarts to SGI UV. SGI’s Chief Marketing Office Franz Aman describes the company’s full range of solutions featuring the new Intel Xeon Phi coprocessor for HPC.

Solarflare

Spectra Logic

Supermicro

Sugon

Texas Instruments

The Portland Group

  • PGI’s Michael Wolfe on OpenACC Directives for GPUs. Michael Wolfe from The Portland Group discusses the origins of the OpenACC standard for programming directives in GPUs. He also weighs in on the recent OpenMP 4.0 technical report, which proposed to incorporate OpenACC directives into OpenMP 4.0 sometime in 2013.

VMware

  • Interview: Josh Simons on HPC Cloud Trends at SC12. Josh Simons from the VMware CTO office describes recent trends in Cloud Computing for HPC. The company is looking at how virtualization technologies could benefit supercomputing on the road to Exascale.

Xyratex

Related posts:

The post insideHPC Video Archive appeared first on insideHPC.

]]> http://insidehpc.com/insidehpc-video-archive/feed/ 0 Total Goes Petascale with SGI ICE X Supercomputer http://insidehpc.com/2013/03/26/total-goes-petascale-with-sgi-ice-x-supercomputer/ http://insidehpc.com/2013/03/26/total-goes-petascale-with-sgi-ice-x-supercomputer/#comments Tue, 26 Mar 2013 14:00:21 +0000 Ralph http://insidehpc.com/?p=35999 This week SGI announced that Total has selected the SGI ICE X technology for its new 2.3 Petaflop Pangea supercomputer. In what is described as the largest commercial HPC system in the world, Pangea will give Total’s in-house engineers and geologists an extremely powerful tool to enable the application of analytical and numerical models that [...]

The post Total Goes Petascale with SGI ICE X Supercomputer appeared first on insideHPC.

]]> This week SGI announced that Total has selected the SGI ICE X technology for its new 2.3 Petaflop Pangea supercomputer. In what is described as the largest commercial HPC system in the world, Pangea will give Total’s in-house engineers and geologists an extremely powerful tool to enable the application of analytical and numerical models that support the development of three dimensional visualizations of underground geological formations, key to identifying potential deposits of oil and gas and to determining optimal extraction methods.

Total is committed to leveraging technological innovation and high performance computing to provide the best response to growing global energy demand,” said Philippe Malzac, CIO Exploration and Production for Total. “The efficiency of the SGI ICE X system, which represents high computational power using a minimal amount of energy, gives Total the smallest footprint and lowest TCO possible. This was a key factor in our selection of SGI ICE X for the Pangea system.”

To maximize energy efficiency, Total selected an innovative water-cooled SGI ICE X solution based on its M-Cell design. M-Cells utilize closed-loop airflow and warm-water cooling to create embedded hot-aisle containment, thereby lowering overall cooling requirements and significantly reducing overall energy consumption as compared to traditional HPC designs. The 2.3 PFlop system is based on the Intel Xeon E5-2670 processor that consists of 110,592 cores and contains 442 terabytes of memory. The data management solution for seven petabytes of storage includes SGI InfiniteStorage 17000 disk arrays, SGI DMF tiered storage virtualization, and a Lustre file system integrated by SGI professional services.

Read the Full Story.

Related posts:

The post Total Goes Petascale with SGI ICE X Supercomputer appeared first on insideHPC.

]]> http://insidehpc.com/2013/03/26/total-goes-petascale-with-sgi-ice-x-supercomputer/feed/ 0 Adaptive Computing Taking Scientific Visualization to New Heights http://insidehpc.com/2013/02/06/adaptive-computing-taking-scientific-visualization-to-new-heights/ http://insidehpc.com/2013/02/06/adaptive-computing-taking-scientific-visualization-to-new-heights/#comments Wed, 06 Feb 2013 16:58:02 +0000 Staff http://insidehpc.com/?p=34874 In this special guest feature from Scientific Computing World, Chad Harrington, VP of marketing at Adaptive Computing, reflects on visualization workloads. It doesn’t take a pair of rose-coloured aviator glasses to visualise this scenario: imagine you’re an aerodynamics engineer and you’re scanning a 3D simulation of your latest concept plane. You pan, zoom and otherwise [...]

The post Adaptive Computing Taking Scientific Visualization to New Heights appeared first on insideHPC.

]]> In this special guest feature from Scientific Computing World, Chad Harrington, VP of marketing at Adaptive Computing, reflects on visualization workloads.

It doesn’t take a pair of rose-coloured aviator glasses to visualise this scenario: imagine you’re an aerodynamics engineer and you’re scanning a 3D simulation of your latest concept plane. You pan, zoom and otherwise manipulate the simulation that visualises airflow around the wings and fuselage. The simulation is massively pixilated and highly compute-intensive, and yet you’re viewing and manipulating it on a three-year-old laptop. What’s more, several of your colleagues are on a conference call with you, and they’re manipulating those same pixels in the same session from multiple locations using typical office PCs and even tablets.

The fact is that this scenario is a reality in leading-edge visualization environments today. That’s because an integrated solution consisting of HPC workload management software and visualization software is doing for 3D simulation workloads what Software as a Service did for 2D applications: keeping applications and data together on the server side where they can be accessed simultaneously by multiple PCs, thin clients and mobile devices on the same session. And compute resources can be used more efficiently than ever before.

For IT managers, visualization workload optimization couldn’t arrive sooner. That’s because today it’s not unusual for 3D simulations to top out at 50 gigabytes or more. Worse still, they’re getting bigger every year and workload management issues are following suit. Workstations are becoming obsolete faster than ever before – usually in less than three years – and, of course, licensing, troubleshooting, patching and updating requirements at widely dispersed offices and desks are costly, time-consuming hassles. Network congestion and latency are serious issues, too, as is leakage of proprietary data.

Upfront workstation costs also continue to be a key concern. Deskside workstations feature high-end CPUs, top-of-the-line GPUs, and lots of memory. And they are single-purpose machines. Once a simulation is up and running, the system’s usefulness is tapped out. Adding insult to injury, workstations must be sized for the largest potential simulation job. So, even if small- or mid-sized technical visualization sessions are the norm, the workstation must be overbuilt to handle the worst-case scenario. Given today’s widely dispersed and mobile workforce – and the need for elasticity when it comes to compute and network resources – the immovable and otherwise rigid deskside workstation is an idea that’s gone the way of the zeppelin.

Instead of having expensive hot, loud, underutiliszed workstations taking up space under desks, it makes sense to have 3D CAD/CAE and other scientific visualization applications and data housed on shared virtualization clusters. Users get the full power of a high-end, GPU-enabled machine – as if it’s under their desks – while GPUs and other high-performance compute resources are shared by multiple sessions.

In addition, compute capabilities can be ‘right-sized’ on the fly, and utilization can be maximised. Rather than clogging networks by transferring source data for full workloads, this approach minimises bandwidth use. Likewise, support, updating and replacement of hardware and software are more efficient, less costly processes that do not affect users nearly as much as when those processes are completed at individuals’ desks. And by keeping data sets closer to the centralised resources, you can minimise security risks by ensuring tighter access control and data security.

Perhaps the most important benefit, however, is the ability to share these visualizations anywhere, using virtually any computing device. Users are able to securely work where it makes the most sense – in conference rooms, at home after work or wherever they are authorised to do so. As a result, workforce collaboration and productivity can improve dramatically.

Adaptive Computing, the largest provider of private cloud management and high-performance computing (HPC), has recently added two versions of its Moab HPC Suite that make these capabilities possible. Moab HPC Suite Application Portal Edition and Remote Visualization Edition are designed to maximise backend processing efficiencies and leverage next-generation access models. By simplifying the collection and interpretation of data, these solutions can help reduce the time it takes to achieve meaningful results.

Many companies have major investments in HPC in the data centre, and, generally, those resources aren’t used at anywhere near capacity. The same can be said for visualization workstations that are dispersed throughout many companies. But the good news is that those resources can now be brought together in a private technical compute cloud that handles both HPC and visualization. In many cases, GPUs can be shared between computational and visualization workloads – dedicated to visualization workloads during the day and HPC computational requirements through the night. HPC workload management software policies can be put in place to automatically determine which sessions and jobs go where. Those policies can also be set up to establish reservations for higher-priority workloads at specified times of the day or night.

This story appears here as part of a cross-publishing agreement with Scientific Computing World.

Related posts:

The post Adaptive Computing Taking Scientific Visualization to New Heights appeared first on insideHPC.

]]> http://insidehpc.com/2013/02/06/adaptive-computing-taking-scientific-visualization-to-new-heights/feed/ 0 How MIT’s StarCluster Powers Virtualization for Cloud HPC http://insidehpc.com/2013/01/30/how-mits-starcluster-powers-virtualization-for-cloud-hpc/ http://insidehpc.com/2013/01/30/how-mits-starcluster-powers-virtualization-for-cloud-hpc/#comments Wed, 30 Jan 2013 16:30:14 +0000 Rich Brueckner http://insidehpc.com/?p=34738 Over at Admin HPC, Gavin W. Burris writes that virtualization has become a viable option for researchers with a need for cluster computing power thanks in part to StarCluster, MIT’s open-source toolkit for launching, controlling, and orchestrating clusters of virtual servers within the Amazon Elastic Compute Cloud (EC2) service. StarCluster provides a number of images [...]

The post How MIT’s StarCluster Powers Virtualization for Cloud HPC appeared first on insideHPC.

]]> Over at Admin HPC, Gavin W. Burris writes that virtualization has become a viable option for researchers with a need for cluster computing power thanks in part to StarCluster, MIT’s open-source toolkit for launching, controlling, and orchestrating clusters of virtual servers within the Amazon Elastic Compute Cloud (EC2) service. StarCluster provides a number of images pre-rolled and ready to go, as well as a command line tool for wrangling them into functional computing power.

The cloud has become a key resource in the support of HPC. Given the proper use case, cloud offerings are an affordable fit for a variety of different workflows. A key tool in any systems programmer’s arsenal should be the StarCluster toolkit, which provides a powerful interface for harnessing these cloud resources in an effective manner. The toolkit builds from the well-established model of HPC clustering with Linux, providing a clear path to transferring existing skills and code to the cloud.

Read the Full Story.

Related posts:

The post How MIT’s StarCluster Powers Virtualization for Cloud HPC appeared first on insideHPC.

]]> http://insidehpc.com/2013/01/30/how-mits-starcluster-powers-virtualization-for-cloud-hpc/feed/ 0 Slidecast: TheInfoPro Research Report on Server and Virtualization Trends http://insidehpc.com/2013/01/18/slidecast-theinfopro-research-report-on-server-and-virtualization-trends/ http://insidehpc.com/2013/01/18/slidecast-theinfopro-research-report-on-server-and-virtualization-trends/#comments Fri, 18 Jan 2013 12:30:47 +0000 Rich Brueckner http://insidehpc.com/?p=34479 In this slidecast, Peter ffoulkes from TheInfoPro presents results from a recent study on Servers and Virtualization markets. As an analyst with a deep background in HPC, ffoulkes does a great job of bringing this research into perspective with high performance computing markets. TheInfoPro’s latest report focusing on Servers and Virtualization is set to be [...]

The post Slidecast: TheInfoPro Research Report on Server and Virtualization Trends appeared first on insideHPC.

]]>

In this slidecast, Peter ffoulkes from TheInfoPro presents results from a recent study on Servers and Virtualization markets. As an analyst with a deep background in HPC, ffoulkes does a great job of bringing this research into perspective with high performance computing markets.

TheInfoPro’s latest report focusing on Servers and Virtualization is set to be released on 1/8. Conducted during the second half of 2012, TheInfoPro study identifies key initiatives of senior server infrastructure managers and examines market factors and major players. This annual study is based on extensive live interviews with server professionals and primary decision-makers at large and midsize enterprises in North America and Europe.”

Learn more about research services at TheInfoPro.

Download the MP3 * Download the Slides (PDF) * Subscribe on iTunes * If Dropbox is blocked, download audio from Google Drive.

Related posts:

The post Slidecast: TheInfoPro Research Report on Server and Virtualization Trends appeared first on insideHPC.

]]> http://insidehpc.com/2013/01/18/slidecast-theinfopro-research-report-on-server-and-virtualization-trends/feed/ 0 Webinar Preview: Talking to your CFO about HPC – Measuring Profitability & ROI http://insidehpc.com/2013/01/15/interview-talking-to-your-cfo-about-hpc-measuring-profitability-roi/ http://insidehpc.com/2013/01/15/interview-talking-to-your-cfo-about-hpc-measuring-profitability-roi/#comments Tue, 15 Jan 2013 19:05:15 +0000 Rich Brueckner http://insidehpc.com/?p=34389 As members of the HPC community, we often find ourselves needing to communicate the value of high performance computing to management teams who don’t quite “get it.” How we can do that more effectively is the subject of an upcoming insideHPC webinar sponsored by X-ISS, a leader in HPC implementation services. Webinar Title: How to Talk [...]

The post Webinar Preview: Talking to your CFO about HPC – Measuring Profitability & ROI appeared first on insideHPC.

]]>
Clipped from http://x-iss.com/registration.html

As members of the HPC community, we often find ourselves needing to communicate the value of high performance computing to management teams who don’t quite “get it.” How we can do that more effectively is the subject of an upcoming insideHPC webinar sponsored by X-ISS, a leader in HPC implementation services.

Webinar Title: How to Talk to your CFO about HPC: Measuring Profitability and ROI
Date: January 22, 2013
Time: 8:30am PST

Panelists:

  • Merle Giles, NCSA
  • Sharan Kilwani, Industry Expert
  • Ramesh Krishnan, ATK Aerospace Systems

Register Now

To set the stage for this topic, I caught up with Deepak Khosla, founder and CEO of X-ISS.

insideHPC: It seems like the HPC community doesn’t always speak the same language as enterprise executives, who seem to be focused on cost and ROI.
With all the broad cloud adoption going on, why do you think that cloud is gaining traction in the business world while HPC seems to remain flat?

Deepak Khosla: What we see in HPC is that everything is about Performance. And while we are seeing growth in both the HPC market and the cloud space, in many cases the cloud is a better fit for the Enterprise, which is where we are seeing more growth. There are more issues limiting HPC growth in the cloud, such as:

  • Security –this is a common issue with both HPC & Enterprise, and the perception about data security uncertainty limits growth in the cloud.
  • Big Data Sets – We see in HPC there often are very large data sets, and due to the bandwidth and latency issues in the cloud, access to that data with acceptable performance becomes an issue.
  • Proximity – With most cloud implementations, there isn’t a guarantee of how ‘close’ the machines can be to each other. Low latency, high performance networks are highly utilized for in-house HPC environments today – but this isn’t always easily available with cloud environments. Even with 10 Gig technology, you have better bandwidth, but latency is still a concern. This leads to lower performance in clouds.
  • Virtualization – whether it’s based on legitimate performance issues, or just tradition, many HPC sites apps tend to run better on hardware vs. virtual servers. Enterprise applications in general have been running on virtual environments for quite a while.

In the end, quite a bit is about performance – and ROI. If users can achieve the performance they need and address the above concerns, the cloud will become more widely adopted in HPC. But there is a break-even point in which having your own cluster system makes more sense too.

Finally, because X-ISS works with a diverse set of customers, we also agree with the model that this industry can be broken into two categories:

  1. High Performance Technical Computing, or a more traditional HPC user; and
  2. High Performance Business Computing.

We’re seeing growth in both categories, but High Performance Business Computing seems to be growing faster and since it is closer to the Enterprise ‘production’ business, it will be interesting to see the variance in cloud adoption rates between the two.

insideHPC: On your site, you talk about how there is a major shortage of skills and software available to provide management, analytics and ROI on HPC systems. What does X-ISS do to help mitigate this problem?

Deepak Khosla: These are two different problems that the HPC industry is facing. When you look at the issue of shortage of qualified people with HPC management skills – this has been an ongoing problem for years. Every organization is focused on keeping their HPC system tuned, running, and highly available to the users and this issue impacts their ability to produce timely results. X-ISS offers a turnkey outsource system management service called ManagedHPC that takes care of that challenge, by providing experienced people, and the right monitoring and reporting systems. This is a cost-effective solution especially for those sites where skills are not available or where running efficiently with best practices is important.

Regarding the shortage of analytics software, we see today that most commercial options are just providing technical analytics, and these solutions are also tied to a single vendor stack. Not only is this insufficient, it also sets up the undesirable vendor-lock. The reality is most HPC systems are very heterogeneous, made up of a variety of hardware and software stacks. Through our DecisionHPC software, we provide both business & system analytics on diverse systems, even geographically dispersed environments. The software was built to help improve performance, identify the overall cost, and to help organizations create strategies to track and allocate costs, thus understanding all of the performance and ROI implications.

insideHPC: Your DecisionHPC product is all about providing visibility into what is really going on inside the datacenter. What are your clients able to do with that information in terms of business advantage?

Deepak Khosla: At the high-level, accurate information is powerful. The ability to make changes and quickly react to improve execution, be more competitive, and more timely, is invaluable today.

For example, some organizations are in the business of charging for HPC cycles. Clearly, if this is your business model, then you need to know how past jobs were done, so you know how to price effectively. With this information you can react in a timely manner and improve your ability to perform successfully.

Or if you want to be able to charge back for projects to internal or external customers, you should be able to easily do that in a heterogeneous environment, with the right tools.

If high performance computing is an important aspect to your business success, it’s vital to have the information on both system costs and performance to maximize your HPC investment. It’s necessary to have the insight into how your systems and applications are performing and producing results in a production environment. These are business metrics like any other Key Performance Indicators – and better tools are needed to help businesses track, measure, and make better decisions today.

insideHPC: Large-scale clusters have existed for years. What is changing and why is it more important than ever to look at system management in a new light?

Deepak Khosla: One important change that we discussed earlier is that HPC is moving more and more into the business/commercial space. Here cost management, improving efficiencies, and productivity have a direct impact on business. Therefore it becomes vitally important to have the technical and business historical information; some of this has not been as important in the research space in the past. However, even in traditional HPC environments, there is more pressure to measure, track, report on, and make better decisions, based on the analytics created.

insideHPC: How does X-ISS turn instrumentation into business insight?

Deepak Khosla: Firstly we are now able to collect data from disparate sources – not just hardware, but also schedulers and other sources — and then we can associate those to business reasons, which allow us to formulate real business cost or performance. In other words, X-ISS can help customers identify and analyze how projects or business endeavors are performing, and the impact to the business.

Secondly, we also allow for the creation of business metrics, based on unique business needs. Because every business is different, the ability to track, store, and visualize these custom metrics lead to better insights, allowing for better decision-making.

insideHPC: Why sponsor a panel like this that focuses on how to talk about HPC to Execs?

Deepak Khosla: HPC is now being leveraged for commercial uses – more than ever before – this trend will grow. The purpose of this panel discussion that addresses the ‘Business of HPC’, is to help educate technical professionals, such as computer scientists and engineers, on how to have a dialog that relates to the CxO world, and how to identify solutions that can facilitate this dialog. An important part of this dialog are relevant metrics – how do we have a conversation on both technical and business metrics critical to success? HPC in the past, has relied on metrics more related to pure system performance and hardware and software purchase costs and not necessarily business performance. While many of the traditional tools used in research environments are not adequate for the next generation HPC use, there are solutions to this changing need. These new analytics tools are available today to help them manage HPC within metrics and KPI’s more associated with commercial businesses. The reason for this panel is our industry is ready to have this conversation.

We see from our perspective there is a growing need to treat all HPC systems as a business – and the language of business is numbers. This panel will open the discussion up, as to how a technical research and development manager, or research computing professional, can speak successfully to a CFO, or a committee evaluating ROI, and performance of any given HPC program.

Whether you’re fighting for grants, or fighting for internal funding, or fighting for customers, it’s time our community understands what metrics are necessary to be successful.

Register Now for the Webinar to be eligible to win a $100 AMEX gift card.

Related posts:

The post Webinar Preview: Talking to your CFO about HPC – Measuring Profitability & ROI appeared first on insideHPC.

]]> http://insidehpc.com/2013/01/15/interview-talking-to-your-cfo-about-hpc-measuring-profitability-roi/feed/ 0 Video: The Growing Need for HPC Virtualization http://insidehpc.com/2013/01/01/video-the-growing-need-for-hpc-virtualization/ http://insidehpc.com/2013/01/01/video-the-growing-need-for-hpc-virtualization/#comments Tue, 01 Jan 2013 12:00:24 +0000 Rich Brueckner http://insidehpc.com/?p=34135 In this video, Professor Thomas J. Hacker from Purdue University lectures on virtualization clusters in high-performance computing. Additional segments on this subject are also available on YouTube. Related posts:Purdue develops HPC course of studyVideo: An Update on Virtualization Technologies for HPCPurdue to Offer Supercomputing Classes

The post Video: The Growing Need for HPC Virtualization appeared first on insideHPC.

]]>

In this video, Professor Thomas J. Hacker from Purdue University lectures on virtualization clusters in high-performance computing. Additional segments on this subject are also available on YouTube.

Related posts:

The post Video: The Growing Need for HPC Virtualization appeared first on insideHPC.

]]> http://insidehpc.com/2013/01/01/video-the-growing-need-for-hpc-virtualization/feed/ 0 Netlist Demonstrates Superiority of HyperCloud Memory at SC12 http://insidehpc.com/2012/11/29/netlist-demonstrates-superiority-of-hypercloud-memory-over-lrdimm-at-supercomputing-2012/ http://insidehpc.com/2012/11/29/netlist-demonstrates-superiority-of-hypercloud-memory-over-lrdimm-at-supercomputing-2012/#comments Thu, 29 Nov 2012 16:32:33 +0000 Ralph http://insidehpc.com/?p=33388 Memory speed is often cited as a bottleneck in modern HPC systems. At SC12, Netlist demonstrated a comprehensive performance benchmark of its HyperCloud (HCDIMM) that showed a 39% greater server throughput compared to an identical system equipped with LRDIMMs. As companies today increasingly process and capitalize on big data, there’s an increasing need for more [...]

The post Netlist Demonstrates Superiority of HyperCloud Memory at SC12 appeared first on insideHPC.

]]> Memory speed is often cited as a bottleneck in modern HPC systems. At SC12, Netlist demonstrated a comprehensive performance benchmark of its HyperCloud (HCDIMM) that showed a 39% greater server throughput compared to an identical system equipped with LRDIMMs.

As companies today increasingly process and capitalize on big data, there’s an increasing need for more memory in servers. However, memory performance in these servers is not keeping pace with processor technology, creating a high density memory cliff,” said C.K. Hong, CEO of Netlist. “HyperCloud breaks this bottleneck and allows servers to operate at their peak potential. By doing so, HyperCloud increases performances of applications in such key areas as securities trading, analytics, virtualization, and simulation.”

HyperCloud is shipping in volume with the world’s top three selling servers from IBM and HP, and is implemented across a number of high-performance computing applications in industries such as electronic design automation, financial services, oil & gas, aerospace and automotive. Read the Full Story.

Related posts:

The post Netlist Demonstrates Superiority of HyperCloud Memory at SC12 appeared first on insideHPC.

]]> http://insidehpc.com/2012/11/29/netlist-demonstrates-superiority-of-hypercloud-memory-over-lrdimm-at-supercomputing-2012/feed/ 0 Interview: Josh Simons on HPC Cloud Trends at SC12 http://insidehpc.com/2012/11/28/interview-josh-simons-on-hpc-cloud-trends-at-sc12/ http://insidehpc.com/2012/11/28/interview-josh-simons-on-hpc-cloud-trends-at-sc12/#comments Wed, 28 Nov 2012 15:29:50 +0000 Rich Brueckner http://insidehpc.com/?p=33345 http://www.youtube.com/watch?v=XN8ZIyj35pM In this video from SC12, Josh Simons from the VMware CTO office describes recent trends in Cloud Computing for HPC. The company is looking at how virtualization technologies could benefit supercomputing on the road to Exascale. My message to attendees was that today’s cloud is not tomorrow’s cloud: As virtualized performance continues to advance [...]

The post Interview: Josh Simons on HPC Cloud Trends at SC12 appeared first on insideHPC.

]]> http://www.youtube.com/watch?v=XN8ZIyj35pM

In this video from SC12, Josh Simons from the VMware CTO office describes recent trends in Cloud Computing for HPC. The company is looking at how virtualization technologies could benefit supercomputing on the road to Exascale.

My message to attendees was that today’s cloud is not tomorrow’s cloud: As virtualized performance continues to advance and as cloud providers see a business value in deploying high-bandwidth, low-latency interconnects, the number of applications that will run well in a cloud environment will continue to expand. In the meantime, many single-process applications run very well in virtualized environments, MPI overheads may be acceptable for some applications, and virtualization can offer new capabilities not available in traditional, bare-metal HPC environments.

Related posts:

The post Interview: Josh Simons on HPC Cloud Trends at SC12 appeared first on insideHPC.

]]> http://insidehpc.com/2012/11/28/interview-josh-simons-on-hpc-cloud-trends-at-sc12/feed/ 0 SC12 Featured Videos on insideHPC TV http://insidehpc.com/sc12-featured-videos-on-insidehpc-tv/ http://insidehpc.com/sc12-featured-videos-on-insidehpc-tv/#comments Fri, 16 Nov 2012 16:18:11 +0000 Rich Brueckner http://insidehpc.com/?page_id=33034 insideHPC Video Archive We try to keep this page up to date, but you can always find our latest works on our RichReport YouTube Channel. 2013 Event Coverage: Open Fabrics Developer Workshop Video Gallery Lustre User Group Video Gallery Moabcon 2103 Video Gallery SC12 Featured Videos This year at SC12, we shot over 50 video [...]

The post SC12 Featured Videos on insideHPC TV appeared first on insideHPC.

]]> insideHPC Video Archive

We try to keep this page up to date, but you can always find our latest works on our RichReport YouTube Channel.

2013 Event Coverage:

SC12 Featured Videos

This year at SC12, we shot over 50 video interviews. It was a lot of work, but we want to bring you the very best of what this amazing conference had to offer.

SC12 Videos (Alphabetical by Vendor Name):

Adaptive Computing

Adaptive Computing SC12 Booth Theater

Aeon

Allinea

Altair

AMD

Asetek

Bull

CAPS-Enterprise

Colfax International

Cycle Computing

DDN

  • DDN Powers Genomics at the Virginia Bioinformatics Institute. Dr. Harold (Skip) Garner from the Virginia Bioinformatics Institute describes how Big Data I/O is required to crunch Genomics data in the fight against cancer.
  • DDN Ramps Up for Exascale at SC12. Jeff Denworth from Data Direct Networks describes the company’s high performance storage solutions for HPC. Used by 60 percent of the TOP100 supercomputers in the works, DDN recently announced a $100 Million dollar investment in Exascale technologies.
  • Steve Simms on the Data Capacitor II at Indiana University. Steve Simms from Indiana University describes a recent upgrade to the Data Capacitor project, a high-speed, high-capacity storage facility for very large data sets. With 5 PB of storage, Data Capacitor II will support big data applications used in computational research. IU partnered with DDN to develop Data Capacitor II, which is scheduled to be installed in the IU Data Center in spring 2013.

Dell

Gnodal

HPC Advisory Council

  • HPC Advisory Council Announces Student Cluster Teams for ISC’12. Gilad Shainer, Tong Liu, and Pak Lui from the HPC Advisory Council revue the organization’s outreach efforts for the past year and look forward to 2013. The council is an active sponsor of international Student Cluster Competitions that encourage young people to learn parallel programming skills.

IBM

IDC

  • IDC HPC Market Update from SC12. Did you know that 3Q2012 was the biggest quarter of revenue in the history of HPC? In this video from SC12, Earl Joseph from IDC presents the latest on the supercomputing market.

Inktank

  • Inktank Boosts Open Source Ceph File System. Neil Levine from Inktank describes the company’s efforts to commercialize and support the Ceph open source file system. With high reliability and nearly unlimited scalability, Ceph has great potential for Big Data applications as well as an enabling technology for Exascale computing.

Intel

Intersect360 Research

NAG

Nirvana

Numascale

Nvidia

Mellanox

  • Mellanox Breaks Performance Records, Dominates TOP500 at SC12. Todd Wilde from Mellanox describes the company’s recent advancements in high speed InfiniBand interconnects. Infiniband recently InfiniBand has become the leading interconnect on the TOP500 with 224 clusters and the Connect-IB dual-port 56Gb/s FDR InfiniBand adapter recently achieved the industry’s highest throughput of more than 100Gb/s utilizing PCI Express 3.0 x16 and over 135 million messages per second, 4.5X higher than previous or competing solutions.

OpenSFS & EOFS

Panasas

  • Panasas Showcases ActiveStor 14 at SC12. By accelerating small file and metadata performance with Solid State Drive (SSD) technology, ActiveStor 14 delivers extreme performance, for the technical computing and big data workloads commonly found in HPC environments.
  • Panasas Chief Scientist on Where HPC Meets Big Data and Hadoop. Panasas ActiveStor not only accelerates product design and scientific discovery applications, but will perform seamless Hadoop analyses, ensuring that customers can extract maximum value from their existing big data infrastructure.

Penguin Computing

Rogue Wave Software

Samplify

SC12 Committee

  • SC12 Press Conference with Jeff Hollingsworth. In this video, SC12 General Chair Jeff Hollingsworth opens the show press conference in Salt Lake City. This year there were a record number of exhibitors have booths at the show. Recorded Nov. 12, 2012.

Scalable Informatics

Seneca

SGI

  • Interview: SGI Teams with Altair on the Road to Exascale. Paul Kinyon from SGI’s product management team describes how the company is working with partners like Altair to solve customer’s toughest computational challenges. The company is looking at a range of technologies that could enbable Exascale computing capabilities at a practical level of power consumption.
  • Intel Xeon Phi Adds Smarts to SGI UV. SGI’s Chief Marketing Office Franz Aman describes the company’s full range of solutions featuring the new Intel Xeon Phi coprocessor for HPC.

Solarflare

Spectra Logic

Supermicro

Sugon

Texas Instruments

The Portland Group

  • PGI’s Michael Wolfe on OpenACC Directives for GPUs. Michael Wolfe from The Portland Group discusses the origins of the OpenACC standard for programming directives in GPUs. He also weighs in on the recent OpenMP 4.0 technical report, which proposed to incorporate OpenACC directives into OpenMP 4.0 sometime in 2013.

VMware

  • Interview: Josh Simons on HPC Cloud Trends at SC12. Josh Simons from the VMware CTO office describes recent trends in Cloud Computing for HPC. The company is looking at how virtualization technologies could benefit supercomputing on the road to Exascale.

Xyratex

Related posts:

The post SC12 Featured Videos on insideHPC TV appeared first on insideHPC.

]]> http://insidehpc.com/sc12-featured-videos-on-insidehpc-tv/feed/ 1 ScaleMP Steps up with Wider Platform Support plus Big Data Capabilities http://insidehpc.com/2012/11/08/scalemp-steps-up-with-wider-platform-support-plus-big-data-capabilities/ http://insidehpc.com/2012/11/08/scalemp-steps-up-with-wider-platform-support-plus-big-data-capabilities/#comments Thu, 08 Nov 2012 12:00:33 +0000 Rich Brueckner http://insidehpc.com/?p=32621 This week ScaleMP released version 5 of their vSMP Foundation software for HPC. With support for new hardware platforms such as Intel’s new Xeon Phi co-processor, this server-virtualization-for-aggregation software now enables enables large-memory applications for Big Data and Big Science. To learn more, I caught up with ScaleMP’s CEO, Shai Fultheim. insideHPC: What’s new with [...]

The post ScaleMP Steps up with Wider Platform Support plus Big Data Capabilities appeared first on insideHPC.

]]> This week ScaleMP released version 5 of their vSMP Foundation software for HPC. With support for new hardware platforms such as Intel’s new Xeon Phi co-processor, this server-virtualization-for-aggregation software now enables enables large-memory applications for Big Data and Big Science. To learn more, I caught up with ScaleMP’s CEO, Shai Fultheim.

insideHPC: What’s new with the vSMP Foundation 5 release?

Shai Fultheim: There are a number of new capabilities which extend our reach and broaden our market. The most significant features are that we will support the Intel TrueScale InfiniBand as well as the Intel Xeon Phi coprocessor, virtualizing it so that it is very easy to get applications up and running on that system. In addition, we expanded processor support for the latest generation of AMD processor and the Intel E5-4600; we have added new product focused on large memory VMs (Bio informatics and big-data) as well as support for vSMP Foundation running over KVM with Ethernet using Ethernet between nodes.

insideHPC: How does vSMP Foundation work with the new Intel Xeon Phi co-processors and what advantages does this computing approach have for HPC users?

Shai Fultheim: Our work with the Intel Xeon Phi coprocessor is very different than other HPC vendors. We are providing a means that developers or end users can use to get their applications running on a system with the Intel Xeon Phi coprocessor installed. We virtualize the Intel Xeon Phi coprocessors and memory with the host processors and memory to make the system look like one large system. Then, an application can be tuned little by little to take advantage of the performance and large number of cores on the Intel Xeon Phi. In addition, we support the standard co-processor programming model for customers looking to have large-scale shared memory systems supporting significant number of Intel Xeon Phi coprocessors.

insideHPC: How does ScaleMP help users with Big Data Analytics?

Shai Fultheim: The more data that can be stored in memory the better. As the amount of data grows that needs to be analyzed, the more of that data that can be stored in easily accessible memory from all of the cores the better. Using a single address space for high speed memory will be easier and faster than using slower flash or hard disk drives. vSMP Foundation 5 allows creating virtual machines that aggregate memory of several systems, without the processors – allowing for in-memory processing using a cost optimized hardware.

insideHPC: Does it improve Hadoop performance?

Shai Fultheim: It can. By allowing the distributed nodes to be larger in the sense of more memory then more data can be stored in memory rather than on hard disk drives. Another aspect is the instead of maintaining many nodes in a cluster that are used for Hadoop, lesser nodes can be used which eases the management burden of maintaining more nodes.

insideHPC: Can vSMP Foundation co-exist with other VMs out there? How does that work?

Shai Fultheim: With vSMP Foundation 5 we will offer the ability to connect previously created VMs (like from using KVM) together to create a SMP that can be quite large. We aggregate the individual VMs and then deliver an SMP created from the smaller VMs. Our software can span individual hardware systems, giving users much larger VMs than possible before.

insideHPC:How does vSMP Foundation deliver more performance with Batched I/O?

Shai Fultheim: Processors and devices need several interactions in for each I/O operation. For example, to get a drive to pull few sectors into memory, a processor needs to access memory 2-3 times and also issue at least one I/O write operation. vSMP Foundation 5 batches those operations in a memory buffer close to the processor, to provide faster execution across the InfiniBand fabric. We have seen a 2x improvement in disk transfer rate and up to 5x improvement in the network rate in some cases. Depending on the application, your mileage may vary.

For more information, check out the ScaleMP Show Guide for SC12 and visit booth #3425.

Related posts:

The post ScaleMP Steps up with Wider Platform Support plus Big Data Capabilities appeared first on insideHPC.

]]> http://insidehpc.com/2012/11/08/scalemp-steps-up-with-wider-platform-support-plus-big-data-capabilities/feed/ 0 Xoreax Using Process Virtualization to Deliver Supercomputing Performance with Existing Hardware http://insidehpc.com/2012/11/01/xoreax-using-process-virtualization-to-deliver-supercomputing-performance-with-existing-hardware/ http://insidehpc.com/2012/11/01/xoreax-using-process-virtualization-to-deliver-supercomputing-performance-with-existing-hardware/#comments Thu, 01 Nov 2012 14:39:28 +0000 Rich Brueckner http://insidehpc.com/?p=32473 Xoreax is out with news that their IncrediBuild-XGE software uses process virtualization to deliver supercomputing performance with existing hardware. According to the company, harnessing idle CPU cycles in your local network or public cloud enables incrediBuild-XGE to achieve processing speedups of up to 30x. Organizations don’t realize they are sitting on a supercomputer,” said Eyal [...]

The post Xoreax Using Process Virtualization to Deliver Supercomputing Performance with Existing Hardware appeared first on insideHPC.

]]> Xoreax is out with news that their IncrediBuild-XGE software uses process virtualization to deliver supercomputing performance with existing hardware. According to the company, harnessing idle CPU cycles in your local network or public cloud enables incrediBuild-XGE to achieve processing speedups of up to 30x.

Organizations don’t realize they are sitting on a supercomputer,” said Eyal Maor, Xoreax CEO. “Process virtualization allows them to leverage their unused or underused processors across the entire network, creating HPC without purchasing a single piece of additional hardware.”

Read the Full Story.

Related posts:

The post Xoreax Using Process Virtualization to Deliver Supercomputing Performance with Existing Hardware appeared first on insideHPC.

]]> http://insidehpc.com/2012/11/01/xoreax-using-process-virtualization-to-deliver-supercomputing-performance-with-existing-hardware/feed/ 0 IBM PureSystems in Plain English http://insidehpc.com/2012/10/31/ibm-puresystems-in-plain-english/ http://insidehpc.com/2012/10/31/ibm-puresystems-in-plain-english/#comments Wed, 31 Oct 2012 17:05:29 +0000 Rich Brueckner http://insidehpc.com/?p=32461 Over at the Expert Systems blog, Thiago Farah Montenegro writes that IBM PureSystems are tailor-made for applications like Big Data. The amount of information these systems can handle is huge. The IBM BladeCenter E has been out there for 10 years. There was a time when the E chassis could not deliver the necessary I/O [...]

The post IBM PureSystems in Plain English appeared first on insideHPC.

]]> Over at the Expert Systems blog, Thiago Farah Montenegro writes that IBM PureSystems are tailor-made for applications like Big Data.

The amount of information these systems can handle is huge. The IBM BladeCenter E has been out there for 10 years. There was a time when the E chassis could not deliver the necessary I/O for the big virtualization and consolidations requirements, and then IBM launched the BladeCenter H. We have also a product for the “S” of the SMB (small, medium business), called BladeCenter S. They are all great products! Now, however, we need a new platform to handle the even bigger I/O requirements – and the IBM PureFlex System is that platform for many years to come.

Read the Full Story.

Related posts:

The post IBM PureSystems in Plain English appeared first on insideHPC.

]]> http://insidehpc.com/2012/10/31/ibm-puresystems-in-plain-english/feed/ 0 Seeking Your Nominations for SVC Awards http://insidehpc.com/2012/10/03/seeking-your-nominations-for-svc-awards/ http://insidehpc.com/2012/10/03/seeking-your-nominations-for-svc-awards/#comments Wed, 03 Oct 2012 16:14:30 +0000 Ralph http://insidehpc.com/?p=31959 Nominations are now being accepted for the SVC Awards, which acknowledge excellence in Storage, Virtualization, and Cloud Computing. Judged by a panel of HPC industry editors and analysts, these awards are a great way to recognize your customers. Nominations for the 2012 awards program are due by Oct. 17, 2012. Related posts:IDC Seeking Nominations for [...]

The post Seeking Your Nominations for SVC Awards appeared first on insideHPC.

]]> Nominations are now being accepted for the SVC Awards, which acknowledge excellence in Storage, Virtualization, and Cloud Computing. Judged by a panel of HPC industry editors and analysts, these awards are a great way to recognize your customers.

Nominations for the 2012 awards program are due by Oct. 17, 2012.

Related posts:

The post Seeking Your Nominations for SVC Awards appeared first on insideHPC.

]]> http://insidehpc.com/2012/10/03/seeking-your-nominations-for-svc-awards/feed/ 0 Mannheim Panel to Examine Challenges of Moving HPC to the Cloud http://insidehpc.com/2012/09/07/mannheim-panel-to-examine-challenges-of-moving-hpc-to-the-cloud/ http://insidehpc.com/2012/09/07/mannheim-panel-to-examine-challenges-of-moving-hpc-to-the-cloud/#comments Fri, 07 Sep 2012 14:22:50 +0000 Ralph http://insidehpc.com/?p=31448 Can the cloud really work for HPC applications? For many HPC users thinking of moving their workload to the cloud, the idea of having a user-friendly front end free from back end administration is a strong incentive. At the upcoming ISC Cloud’12 conference, a panel of experts will examine the hurdles of moving HPC to [...]

The post Mannheim Panel to Examine Challenges of Moving HPC to the Cloud appeared first on insideHPC.

]]> Can the cloud really work for HPC applications? For many HPC users thinking of moving their workload to the cloud, the idea of having a user-friendly front end free from back end administration is a strong incentive. At the upcoming ISC Cloud’12 conference, a panel of experts will examine the hurdles of moving HPC to the cloud.

This panel will examine the potential obstacles to cloud adoption, such as security and trust, compliance, outsourcing, performance, virtualization, pricing, payment model, software licenses, choice of service provider or private cloud builder, network bandwidth, and integration of all of these into existing business or research processes.

The event takes place Sept. 24-25 in Mannheim, Germany. Attendees are encouraged to register by Sept. 15 to enjoy the preshow discount.

Related posts:

The post Mannheim Panel to Examine Challenges of Moving HPC to the Cloud appeared first on insideHPC.

]]> http://insidehpc.com/2012/09/07/mannheim-panel-to-examine-challenges-of-moving-hpc-to-the-cloud/feed/ 0 Video: Managing HPC Clusters with MOAB http://insidehpc.com/2012/09/04/video-managing-hpc-clusters-with-moab/ http://insidehpc.com/2012/09/04/video-managing-hpc-clusters-with-moab/#comments Tue, 04 Sep 2012 12:00:24 +0000 Rich Brueckner http://insidehpc.com/?p=31383 http://www.youtube.com/watch?v=wXJU1HUVy6I In this video, Chad Harrington from Adaptive Computing describes the coming wave of virtualization technologies in high performance computing and how the company’s Moab software helps customers manage HPC clusters of all sizes. Recorded at VMworld 2012 in San Francisco. Related posts:Video: Community Clusters at PurdueVideo: Moab Policies – Tips and TricksVideo: Moab – [...]

The post Video: Managing HPC Clusters with MOAB appeared first on insideHPC.

]]> http://www.youtube.com/watch?v=wXJU1HUVy6I

In this video, Chad Harrington from Adaptive Computing describes the coming wave of virtualization technologies in high performance computing and how the company’s Moab software helps customers manage HPC clusters of all sizes.

Recorded at VMworld 2012 in San Francisco.

Related posts:

The post Video: Managing HPC Clusters with MOAB appeared first on insideHPC.

]]> http://insidehpc.com/2012/09/04/video-managing-hpc-clusters-with-moab/feed/ 0 insideHPC at Hot Interconnects 2012 http://insidehpc.com/insidehpc-at-hot-interconnects-2012/ http://insidehpc.com/insidehpc-at-hot-interconnects-2012/#comments Tue, 28 Aug 2012 16:41:52 +0000 Rich Brueckner http://insidehpc.com/?page_id=31264 Hot Interconnect 2012 Presentation Videos insideHPC provided onsite coverage of Hot Interconnects 2012 in Santa Clara. Caliper – Precise and Responsive Traffic Generator Posted: 2012-08-27 01:02:28 UTC In this video, Yashar Ganjali from the University of Toronto presents: Caliper – Precise and Responsive Traffic Generator. “This paper presents Caliper, a highly-accurate packet injection tool that generates precise [...]

The post insideHPC at Hot Interconnects 2012 appeared first on insideHPC.

]]> Hot Interconnect 2012 Presentation Videos

insideHPC provided onsite coverage of Hot Interconnects 2012 in Santa Clara.

    • Caliper – Precise and Responsive Traffic Generator
    • Posted: 2012-08-27 01:02:28 UTC
      In this video, Yashar Ganjali from the University of Toronto presents: Caliper – Precise and Responsive Traffic Generator. “This paper presents Caliper, a highly-accurate packet injection tool that generates precise and responsive traffic. Caliper takes live packets generated on a host computer and transmits them onto a gigabit Ethernet network with precise inter-transmission times. Existing software traffic generators rely on generic Network Interface Cards which, as we demonstrate, do not provide high-precision timing guarantees. Hence, performing valid and convincing experiments becomes difficult or impossible in the context of time-sensitive network experiments. Our evaluations show that Caliper is able to reproduce packet inter-transmission times from a given arbitrary distribution while capturing the closed-loop feedback of TCP sources. ” Recorded at the Hot Interconnects 2012 conference in Santa Clara. http://hoti.org

    • Weighted Differential Scheduler

      Posted: 2012-08-27 00:58:48 UTC
      In this video, Hans Eberle from Oracle Labs presents: Weighted Differential Scheduler. “The Weighted Differential Scheduler (WDS) is a new scheduling discipline for accessing shared resources. The work described here was motivated by the need for a simple weighted scheduler for a network switch where multiple packet flows are competing for an output port. The scheme can be implemented with simple arithmetic logic and finite state machines. We are describing several versions of WDS that can merge two or more flows. An analysis reveals that WDS has lower jitter than any other weighted scheduler known to us.” Recorded at the Hot Interconnects Conference 2012 in Santa Clara. http://hoti.org

    • Performance Analysis of InfiniBand FDR and 40GigE RoCE on HPC and Cloud Computing Systems

      Posted: 2012-08-26 17:03:43 UTC
      In this video, Jerome Vienne from Ohio State University presents: Performance Analysis and Evaluation of InfiniBand FDR and 40GigE RoCE on HPC and Cloud Computing Systems. “In this paper, we evaluate various high performance interconnects over the new PCIe Gen3 interface with HPC as well as cloud computing workloads. Our comprehensive analysis, done at different levels, provides a global scope of the impact these modern interconnects have on the performance of HPC applications and cloud computing middlewares. The results of our experiments show that the latest InfiniBand FDR interconnect gives the best performance for HPC as well as cloud computing applications.” Recorded at Hot Interconnects 2012 in Santa Clara. http://hoti.org

    • Networks: How to Compare Alternative Architectures

      Posted: 2012-08-27 23:22:05 UTC
      In this video, Radia Perlman from Intel presents: How to Compare Alternative Architectures. “There are various aspects of network infrastructure that are orthogonal, and therefore can be compared conceptually. For example, the syntax of encapsulation, how forwarding tables are calculated, and whether forwarding tables are filled in proactively, or on-demand when a new flow starts. This talk will explain these concepts, and show how various proposed architectures (such as TRILL, VXLAN, OpenFlow, etc. compare.)” Recorded at the Hot Interconnects 2012 Conference. http://hoti.org http://hoti.org

    • Call for Participation in Small Business Technology Transfer (STTR)

      Posted: 2012-08-26 17:22:42 UTC
      Got Exascale ideas? In this video, Thomas Ndousse-Fetter from the DoE Department of Science announces a Call for Participation in the Small Business Innovation Research (SBIR) and Small Business Technology Transfer (STTR) programs. The program is for small businesses that want to get involved in the Exascale technology development ecosystem. “A Technology Transfer Opportunity (TTO) is an opportunity to leverage technology that has been developed at a DOE National Laboratory. Each TTO will be described in a particular subtopic and additional information may be obtained by using the link in the subtopic to the DOE National Laboratory that has developed the technology. Typically the technology was developed with DOE funding of either basic or applied research at a DOE National Laboratory and is available for transfer to the private sector. The level of technology maturity will vary and applicants are encouraged to contact the appropriate Laboratory prior to submitting an application.” Learn more about the program at: http://science.energy.gov/sbir/ Recorded at the Hot Interconnects 2012 Conference. http://hoti.org

    • Power-Efficient, High-Bandwidth Optical Interconnects for High Performance Computing

      Posted: 2012-08-25 16:54:07 UTC
      In this video, Fuad Doany from IBM T. J. Watson presents: Power-Efficient, High-Bandwidth Optical Interconnects for High Performance Computing. “High performance computing systems are driving development and large-scale deployment of parallel optical interconnects to meet the ever-increasing interconnect bandwidth requirements. We have demonstrated generations of chip-scale transceivers, or “Optochips”, with record setting high-speed, high-density, and low-power performance. Optical interconnects and Si-photonic communication still present significant technical challenges for future exa-scale supercomputers. Optical interconnect technology must continue to evolve to meet future bandwidth demand, including order of magnitude improvements in cost, power, density, and reliability. Integrated low-power parallel transceivers, optical printed circuit boards and silicon based integrated photonics are potential technologies to meet these challenges.” Recorded at the Hot Interconnects 2012 Conference. http://hoti.org

    • Electronic-Photonic Integration within Switches and Routers

      Posted: 2012-08-25 15:35:36 UTC
      In this video, Michael R. Watts from MIT presents: Electronic-Photonic Integration within Switches and Routers. “We review recent successes in silicon photonics and how the new capabilities afforded by silicon photonics will impact future Ethernet, Infiniband, and ultimately optical domain switches and routers. Specifically, we consider the impact silicon photonics can have on the cost, bandwidth, radix, and power consumption scaling of future switches and routers.” Recorded at the Hot Interconnects 2012 conference in Santa Clara. http://hoti.org

    • How SDNs Will Tame Networks

      Posted: 2012-08-25 20:04:39 UTC
      In this video, Nick McKeown from Stanford presents: How SDNs Will Tame Networks. “Networks are notoriously hard to debug. Today, we only have a rudimentary set of tools available, such as ping, traceroute, tcpdump, and netflow. These tools try to reconstruct the distributed state of the network in an ad-hoc fashion, while the state is being constantly changed by a variety of complex distributed protocols. Software-Defined Networks (SDNs) make it possible – for the first time – to verify, validate, and even prove that the network is behaving correctly. SDN provides the opportunity to rethink how we write network control programs, from the development of control programs all the way to their deployment in production networks.” Recorded at the Hot Interconnects 2012 conference in Santa Clara. http://hoti.org

    • Cray High Speed Networking

      Posted: 2012-08-25 08:11:01 UTC
      In this video, Cray’s Bob Alverson presents: Cray High Speed Networking. “This talk gives an overview of high speed interconnects across all of Cray’s products. Going back to the Seastar router, Cray has a torus network with high bandwidth. When combined with massively multithreading technology in uRiKA, Seastar provides direct load and store support that is unmatched today using commodity processors, especially on Big Data graph problems. The Gemini router introduced support for fine-grained load and store without requiring a custom processor. Our next generation router, known as Aries, brings that technology to the PCI Express bus, so that it can operate with a much wider range of processors. With Aries, the network topology is revamped to take best advantage of fiber optic links, which much be used for all but the shortest connections. The result is the dragonfly technology, providing high neighbor bandwidth to a large group of processors and configurable global bandwidth for system wide communication.” Learn more at: http://hoti.org

    • The Future Of Network Technology – What is Old, is New Again

      Posted: 2012-08-27 10:40:28 UTC
      In this video, the Hot Interconnects 2012 conference kicks off with a keynote by John Roese, VP and General Manager of Futurewei, Huawei’s North American R&D organization. “Cloud, SDN, Big data, Mobility, BYOD, etc… We are currently in an industry filled with major new technologies and architectures and each of them looks like a green field of innovation. The problem is that we have been here before many times. Our industry operates in cycles and many of the challenges we are taking on technically today at a component, system and solutions level are not as new as we like to think. As the former CTO or Nortel, Broadcom ENG, Enterasys and Cabletron over the past 20 years, I have seen these cycles and hopefully learnt some lessons. This talk will attempt to call out some of the similarity of current technical challenges with past technology work and industry efforts (some succeeded and some failed) in an effort to remind us all of our past experiences and hopefully use that history to better navigate the current challenges.” Learn more at: http://hoti.org

    • The OpenOnload User-level Network Stack

      Posted: 2012-08-23 15:07:21 UTC
      In this video, Dave Parry from SolarFlare presents: The OpenOnload User-level Network Stack. “This talk presents the OpenOnload architecture for user-level networking, which is rapidly becoming the de-facto standard for user-space protocol processing of TCP and UDP particularly in latency sensitive applications for the financial markets. We describe our solutions to the challenges outlined above, performance measurements and real world deployment-cases.” Learn more at http://solarflare.com and http://hoti.org

    • Rx Stack Accelerator for 10 GbE Integrated NIC

      Posted: 2012-08-23 06:45:23 UTC
      In this video, IBM’s François Abel presents: Rx Stack Accelerator for 10 GbE Integrated NIC. Recorded at the Hot Interconnects 2012 conference in Santa Clara. “This paper describes the design of an integrated accelerator to offload computation intensive protocol-processing tasks. The accelerator combines the concepts of the transport-triggered architecture with a programmable finite-state machine to deliver high instruction-level parallelism, efficient multiway branching and flexibility. The flexibility is key to adapt to protocol changes and address new applications.” Learn more at: http://hoti.org

    • A Low-Latency Library in FPGA Hardware for High-Frequency Trading

      Posted: 2012-08-24 15:02:43 UTC
      In this video, John Lockwood from Alto-Logic presents: A Low-Latency Library in FPGA Hardware for High-Frequency Trading (HFT). Recorded at the Hot Interconnects 2012 conference in Santa Clara. “Current High-Frequency Trading (HFT) platforms are typically implemented in software on computers with high-performance network adapters. The high and unpredictable latency of these systems has led the trading world to explore alternative “hybrid” architectures with hardware acceleration. In this paper, we describe how FPGAs are being used in electronic trading to approach the goal of zero latency. We present an FPGA IP library which implements networking, I/O, memory interfaces and financial protocol parsers. The library provides pre-built infrastructure which accelerates the development and verification of new financial applications. We have developed an example financial application using the IP library on a custom 1U FPGA appliance. The application sustains 10Gb/s Ethernet line rate with a fixed end-to-end latency of 1μ – up to two orders of magnitude lower than comparable software implementations.” Learn more at: http://hoti.org
    • ParaSplit: A Scalable Architecture on FPGA for Terabit Packet Classification Posted: 2012-08-22 23:55:38 UTC.
    • In this video, Jeffrey Fong presents: ParaSplit: A Scalable Architecture on FPGA for Terabit Packet Classification. Recorded at the Hot Interconnects 2012 conference in Santa Clara. “Packet classification is a fundamental enabling function for various applications in switches, routers and firewalls. Due to their performance and scalability limitations, current packet classification solutions are insufficient in addressing the challenges from the growing network bandwidth and the increasing number of new applications. This paper presents a scalable parallel architecture, named ParaSplit, for high-performance packet classification. We propose a rule set partitioning algorithm based on range-point conversion to reduce the overall memory requirement. We further optimize the partitioning by applying the Simulated Annealing technique. We implement the architecture on a Field Programmable Gate Array (FPGA) to achieve high throughput by exploiting the abundant parallelism in the hardware. Evaluation using real-life data sets show that ParaSplit achieves significant reduction in memory requirement, compared with the-state-of-the-art algorithms such as HyperSplit and EffiCuts. Because of the memory efficiency of ParaSplit, our FPGA design can support in the on-chip memory multiple engines, each of which contains up to 10K complex rules. As a result, the architecture with multiple ParaSplit engines in parallel can achieve up to Terabit per second throughput for large and complex rule sets on a single FPGA device.” Learn more at: http://hoti.org

    The Following Videos Appeared on inside-Cloud.com

    • Video: How SDNs Will Tame Networks
    • www.youtube.com/watch?v=8Q9lSkGyQ84 In this video, Nick McKeown from Stanford presents: How SDNs Will Tame Networks. Networks are notoriously hard to debug. Today, we only have a rudimentary set of tools available, such as ping, traceroute, tcpdump, and netflow. These tools try to reconstruct the distributed state of the network in an ad-hoc fashion, while the state [...]

    • Video: Electronic-Photonic Integration within Switches and Routers

      www.youtube.com/watch?v=wJvvHD7PTWU In this video, Michael R. Watts from MIT presents: Electronic-Photonic Integration within Switches and Routers. We review recent successes in silicon photonics and how the new capabilities afforded by silicon photonics will impact future Ethernet, Infiniband, and ultimately optical domain switches and routers. Specifically, we consider the impact silicon photonics can have on the [...]

    • Video: The OpenOnload User-level Network Stack

      www.youtube.com/watch?v=-J6d3fIf5mo In this video, Dave Parry from SolarFlare presents: The OpenOnload User-level Network Stack. This talk presents the OpenOnload architecture for user-level networking, which is rapidly becoming the de-facto standard for user-space protocol processing of TCP and UDP particularly in latency sensitive applications for the financial markets. We describe our solutions to the challenges outlined [...]

    • Video: The Future Of Network Technology – What is Old, is New Again

      www.youtube.com/watch?v=RWAahWzX2UU In this video, the Hot Interconnects 2012 conference kicks off with a keynote by John Roese, VP and General Manager of Futurewei, Huawei’s North American R&D organization. Cloud, SDN, Big data, Mobility, BYOD, etc… We are currently in an industry filled with major new technologies and architectures and each of them looks like a [...]

    Related posts:

    The post insideHPC at Hot Interconnects 2012 appeared first on insideHPC.

    ]]>     http://insidehpc.com/insidehpc-at-hot-interconnects-2012/feed/ 0     Video: Graphics in the Cloud http://insidehpc.com/2012/08/19/video-graphics-in-the-cloud/ http://insidehpc.com/2012/08/19/video-graphics-in-the-cloud/#comments Sun, 19 Aug 2012 11:10:50 +0000 Rich Brueckner http://insidehpc.com/?p=31081 In this video from SIGGRAPH 2012, Nvidia’s Ian Williams presents on the VGX Hypervisor, the company’s move to bring graphics to the Cloud. The new NVIDIA VGX technology allows for true hardware virtualization of the GPU, enabling a true PC and Workstation experience in a virtual desktop environment. This session will cover a comparison of [...]

    The post Video: Graphics in the Cloud appeared first on insideHPC.

    ]]>

    In this video from SIGGRAPH 2012, Nvidia’s Ian Williams presents on the VGX Hypervisor, the company’s move to bring graphics to the Cloud.

    The new NVIDIA VGX technology allows for true hardware virtualization of the GPU, enabling a true PC and Workstation experience in a virtual desktop environment. This session will cover a comparison of graphics virtualization technologies available in the industry (both SW and HW methods) as well as accelerated remoting solutions.

    Related posts:

    The post Video: Graphics in the Cloud appeared first on insideHPC.

    ]]>     http://insidehpc.com/2012/08/19/video-graphics-in-the-cloud/feed/ 0