Moving Massive Amounts of Data across Any Distance Efficiently

Print Friendly, PDF & Email

Chin Fang is Founder at Zettar.

In this video from the Rice Oil & Gas Conference, Chin Fang from Zettar presents: Moving Massive Amounts of Data across Any Distance Efficiently.

The objective of this talk is to present two on-going projects aiming at improving and ensuring highly efficient bulk transferring or streaming of massive amounts of data over digital connections across any distance. It examines the current state of the art, a few very common misconceptions, the differences among the three major type of data movement solutions, a current initiative attempting to improve the data movement efficiency from the ground up, and another multi-stage project that shows how to conduct long distance large scale data movement at speed and scale internationally. Both projects have real world motivations, e.g. the ambitious data transfer requirements of Linac Coherent Light Source II (LCLS-II), a premier preparation project of the U.S. DOE Exascale Computing Initiative (ECI). Their immediate goals are described and explained, together with the solution used for each. Findings and early results are reported. Possible future works are outlined.

Chin Fang, Ph.D. is the founder and CEO of Zettar Inc., a Mountain View, California based software startup in the HPC space. Zettar delivers a GA-grade hyperscale data distribution software solution. Since 2014, he personally has transferred more than 50PB data over various distances.

Check out our insideHPC Events Calendar