OpenSFS News

Lustre 2.8.0 Released at LUG 2016 and Declared General Availability

By jfranklin

OpenSFS Funds Additional Security, Support Performance, and Efficiency Development for Lustre, Re-Elects OpenSFS Community Representative Director

BEAVERTON, OR–(Marketwired – Mar 31, 2016) – Open Scalable File Systems (OpenSFS) today announced the release of Lustre® 2.8.0, the fastest and most scalable parallel file system. OpenSFS, founded in 2010 to advance Lustre development, is the premier non-profit organization promoting the use of Lustre and advancing its capabilities through coordinated releases of the Lustre file system.

Large portions of new feature development were funded by OpenSFS through dues collected from participants. Atos also contributed to the new features found in 2.8.0. Lustre now boasts added security and data protection, in addition to the following new features:

  • Distributed Namespace (DNE) Asynchronous Commit of cross-MDT updates for improved performance.
  • Remote rename and remote hard link functionality.
  • LFSCK Phase 4 Performance and efficiency improvements to the online filesystem consistency checker.
  • Red Hat 7.x server support (this release offers support for both servers and clients with RHEL 7.2)
  • Capability to enforce SE Linux security policies for Lustre clients.
  • Multiple Metadata RPCs improves the multi-threaded metadata performance of a single client.

“Lustre is a the most popular storage system for HPC, being on nine of the top 10 systems and over 70 of the top 100 in the top500.org list,” says Brent Gorda, General Manager of Intel’s High Performance Data Division. “The 2.8.0 release adds features that keep with the philosophy of performance and scale while adding features that are attractive to our enterprise and commercial customers. With these features, Lustre will continue to grow as the parallel file system of choice for HPC and enterprise technical computing.”

The Lustre User Group (LUG) conference, now in its 14th year, is the industry’s primary venue for discussion and seminars on the Lustre parallel file system and other open source file system technologies. The second annual Lustre Developer Day will be held in Portland, Oregon, and will be followed by two and a half days of LUG presentations. This year’s LUG features more sponsors than any previous LUG: Cray, DDN, HP Enterprise, Intel, Seagate, WARP Mechanics, Aeon Computing, SGI, and Supermicro.

OpenSFS also announced Steve Simms, manager of high performance file systems at Indiana University, has been re-elected as 2016 OpenSFS Community Representative Director on the OpenSFS Board of Directors. “I am pleased to serve another year on the OpenSFS board,” said Simms. “We continue to see the growth of Lustre acceptance as the features that keep Lustre the fastest parallel file system available continue, while we add features for enterprise and commercial use. I look forward to continuing to help this growth and wider deployment in the commercial arena.”

According to a statement by the OpenSFS Board of Directors, “Steve has been a long-time contributor to OpenSFS, bringing his knowledge, expertise, and vision in driving the growth and acceptance of Lustre and the success of OpenSFS. We are excited to be working with him for another year.”

More information about LUG 2016 can be found at http://opensfs.org/events/lug-2016. Lustre 2.8.0 is available for immediate download at: https://downloads.hpdd.intel.com/public/lustre/lustre-2.8.0.

* All trademarks are the property of their respective owners. OpenSFS is a registered trademark of Open Scalable File Systems, Inc. Lustre is a registered trademark of Seagate Technology PLC in the United States. For more information visit www.opensfs.org.

About Lustre
The Lustre file system is an open source parallel file system widely deployed at major computational centers worldwide, including many of the Top500. Currently seven of the TOP10 supercomputing sites, and over 70% of TOP100 sites, utilize Lustre. OpenSFS plays a pivotal role in the open source Lustre community, through roadmap definition, funding of feature releases, and the OpenSFS Lustre Working Group (LWG), which helps with helps identify requirements for new Lustre features, testing, and coordination of new releases.

About OpenSFS
Open Scalable File Systems, Inc.® is a strong and growing nonprofit organization dedicated to the success of the Lustre® file system. OpenSFS was founded in 2010 to advance Lustre, ensuring it remains vendor-neutral, open, and free. Since its inception, OpenSFS has been responsible for advancing Lustre and delivering new releases on behalf of the open source community. Through working groups, events, and ongoing funding initiatives, OpenSFS harnesses the power of collaborative development to fuel innovation and growth of the Lustre system worldwide.

 #  #  #

CONTACT INFORMATION

Contact
OpenSFS Administration
admin@opensfs.org
503-619-0561

Top 5 Reasons To Attend LUG 2016

Top 5 Reasons To Attend LUG 2016

By jfranklin

On April 5-7th, OpenSFS is hosting the 14th annual Lustre® User Group (LUG) conference at the Hilton Portland and Executive Tower in Portland, Oregon! LUG 2016 will bring together industry leaders, end-users, developers, and vendors to talk Lustre, contribute to the community, and move the technology forward.

Here are the top 5 reasons why you should attend LUG 2016:

5 – Free Beer!
LUG wouldn’t be LUG without free beer! One of the highlights of LUG is the opportunity to catch up with old Lustre friends and make new Lustre friends. It’s even better with free beer from local Portland breweries. Join us on Tuesday, April 6th for a networking reception with sweeping views of the Portland skyline. And free beer.

4 – Network with Your Peers and Connect with Key Influencers
Meet and mingle with the people who “speak Lustre.” LUG 2016 is your chance to network, collaborate and share insight with developers, end-users, and other members of the Lustre community over meals, during breaks, and at a special evening reception.

3 – Stay Current on Feature Developments
Dynamic sessions from engineers working on features for upcoming community releases of Lustre.

2 – Visit the City of Roses
The venue for LUG 2016 is the Hilton Portland and Executive Tower, located in the heart of Downtown Portland. Take in all that Portland has to offer, including a thriving food cart scene, over 60 craft breweries in the city limits, and much more!

1 – High Bandwidth, Low Latency Connections to Lustre Developers, Admins, and Users
Prior attendees know that LUG is a firehouse of Lustre information. Get caught up on what’s going on with Lustre, talk with others about Lustre challenges you are facing, understand how others are using Lustre, and what’s coming down the road.

Register by March 11th to take advantage of the special early-bird registration rate!

Lustre Developer Day

Want more Lustre or a chance to talk specifically with Developers? Be sure to arrive a day early for the Lustre Developer Day. Developers looking for a focused opportunity to present their ideas, share current work, and learn from others will want to attend our 2nd annual Lustre Developer Day on April 4th.  Learn More!

If you have any questions, please feel free to contact admin@opensfs.org.

We look forward to seeing you in Portland at LUG 2016!

LUG 2016: Registration Opens February 1

By jfranklin

Lustre® User Group Conference 2016
April 5-7, 2016
Hilton Portland and Executive Tower
Portland, OR

Are you interested in connecting with thought leaders and developers who are pushing the boundaries with Lustre? Then join us for LUG 2016, the industry’s primary venue for discussion and seminars on the Lustre parallel file system and other open source file system technologies.

  • During this 2.5-day event, attendees will have the opportunity to:
  • Hear from the world’s leading developers, administrators, solution providers, and users of Lustre
  • Be an active participant in industry dialogue on best practices and emerging technologies
  • Explore upcoming developments of the Lustre file system
  • Immerse in the strong Lustre community, working collaboratively to further the development of Lustre

Online registration will open on February 1, and we will be announcing the agenda in the coming weeks. Watch for our early-bird registration to save $50 off your registration rate!

  • Early Bird Registration = $525
  • Regular Registration  = $575

Visit the LUG website for real-time updates on the agenda and other event news.

Lustre Developer Day
We’re excited to host our 2nd annual Lustre Developer Day on Monday, April 4. Developers looking for a focused opportunity to present their ideas, share current work, and learn from others will not want to miss this one-day event! The Developer Day will provide newer developers with an opportunity to listen, learn, and network while providing veteran developers with a forum for socializing current work and issues.

More information about the Developer Day, including agenda and registration, is available on the Developer Day web page.

ISC 2015 Lustre BOF

By jfranklin

The Lustre Community, led by EOFS and OpenSFS, invite you to gather at ISC 2015 at the Lustre BOF

Lustre* is the leading open source file system for HPC, and it is at the heart of the largest HPC systems used in world class datacenters. This year’s Lustre Community BOF will gather the worldwide community of Lustre developers, administrators, and solution providers to discuss new challenges and corresponding opportunities emerging within HPC and Big Data.

This is an excellent opportunity to collaborate and network with Lustre enthusiasts from organizations around the world. Don’t miss it!

Name: BoF 17: EOFS & OpenSFS: Challenges & Opportunities for Lustre File System within HPC & Big Data

Time: Wednesday, July 15, 2015, 04:15 pm – 05:15 pm

Room:  Booth #210, Messe Frankfurt

Speakers:

Frank Baetke, HP

Charlie Carroll, Cray

Hugo Falter, ParTec

Jacques-Charles Lafoucriere, CEA

Stephen Simms, Indiana University

Get Involved with Lustre for Free

By jfranklin

new-recruits-banner-e1425511784962

OpenSFS is providing a limited time offer to subsidize your first year membership—up to $5,000! You can apply the money to any membership level. Each membership level gives your technical and business teams the ability to ask questions directly to Lustre experts and test out ideas.

To find out more about how your technical team can take a deep look into Lustre, let’s first do an informational call. Full information here.

Seagate’s Apache Hadoop on Lustre Connector

By jfranklin

664px-Hadoop_logo.svg

In November last year, Seagate announced their contribution of the “Apache Hadoop on Lustre Connector” as part of their continued commitment to open source communities. Running Apache Hadoop jobs has been made even easier as the Apache Hadoop on Lustre Connector eliminates the need to copy data to the Hadoop Distributed File System (HDFS). The Hadoop on Lustre Connector allows both Hadoop and HPC Lustre clusters to use exactly the same data without having to move data between file systems or storage devices. And Hadoop ecosystem tools like Mahout, Hive and Pig are now able to utilize the Lustre File System.

Importantly, HPC customers are supported through Seagate’s release of source code for a patch to Hadoop that will enable Hadoop to share data with HPC architectures that use Lustre for storage. HPC customers, especially in the Life Science and Energy field, are increasingly using Hadoop and Lustre together as part of their data analysis workflows.

From the press release:
“Seagate believes that direct involvement enabling core capabilities as well as fostering the addition of new application environments is critical to open source community vitality, especially for Lustre which is a foundation for much of the success of high performance computing among science, government and business community leaders. Our work with OpenStack Swift, the Open Compute Project (OCP), OpenSFS, EOFS and now Hadoop is just the beginning,” said Ken Claffey, Vice President of ClusterStor, Seagate Cloud Systems and Solutions. “We are committed to driving open source innovation and partnering with open source communities as they develop cutting-edge enabling technologies that are foundational for the entire industry.”

Seagate’s continued involvement and commitment as an OpenSFS Promoter level member includes being an active board member.