OpenSFS News

LUG 2019 at the University of Houston

By jfranklin

The 2019 Lustre User Group (LUG) conference will take place May 14-17 at the Student Center on the campus of the University of Houston, sponsored by UH’s Center for Advanced Computing and Data Science (CACDS).  Mid-May is a wonderful time of year to visit Houston with pleasant daytime and evening temperatures that allows visitors to take full advantage of all the attractions that the nation’s 4th largest city has to offer.

May 14 features the Lustre Developers’ Day where leaders in the open source software determine its future direction.  An afternoon Hackathon event allows you to join other users and write code to further the reach of this open source software.  In the evening, join us for our opening reception to meet other attendees who will be present for the 2 ½ day conference.

The LUG 2019 conference itself will begin on May 15.  OpenSFS is currently considering a half day New User session to run concurrently with other sessions for more seasoned users.  This year’s networking events include an evening at Houston’s premier craft brewery, St. Arnolds; a Tex-Mex dinner/bowling & pool at the UH Student Center game room; and a Friday afternoon visit to Space Center Houston (the Johnson Space Center’s official visitor center).  This will take place immediately after the conference closes and is available to those who extend their stay in Houston through Friday evening or later.

Why you should attend: As always, LUG 2019 will have technical sessions on the latest Lustre developments and best practices, and provide opportunities to share information, network, and collaborate with your peers.

About UH: With over 44,000 students, the University of Houston is also one of the most diverse colleges in the country.  Situated on 667 acres in Southeast Houston, just minutes from downtown, there is much to see and explore nearby, both on and off campus.  The LUG 2019 hotel, the University of Houston Hilton is located directly across the street from the conference venue and is home to the Hilton College of Hotel and Restaurant Management.  Take time to visit the contemporary Blaffer Art Museum, right on campus, where admission is always free.  There is also much to do downtown—visit Discovery Green, take in a Houston Astros baseball game at Minute Maid Park or visit one of the many venues for live music and entertainment the city has to offer.

How you can help: We want to hear from you. Please let us know if there are specific topics you’d like to see covered, if you’d like to participate in agenda development, or if you have an idea for an activity or event.

Support LUG 2019: Is your company interested in sponsorship? LUG19 brings together close to 200 Lustre attendees. Sponsorship options include onsite presence, social events, meals, and speaking opportunities. Contact us to learn more.

Learn more about LUG2019 and the Houston at: http://conference.cacds.uh.edu/

Learn more about sponsorship opportunities at:  https://opensfs.org/events/lug-2019/

Should you have any other questions, please contact Ken Nieser (832-842-7006)

Lustre Transition Webinar

By jfranklin

OpenSFS and DDN hosted a webinar on October 2, 2018 to discuss DDN’s recent acquisition of Intel’s Lustre File System Capability and its transition to their new Whamcloud division. The webinar discussed the transfer in detail and provided an opportunity for community participation. The webinar recording is viewable at https://youtu.be/ATg0ZvTz8fc or via the below.

Lustre 2.10.5 Released

By jfranklin

We are pleased to announce that the Lustre 2.10.5 Release has been declared GA and is available for download. You can also grab the source from git.

Along with a number of useful bug fixes, this maintenance release includes the following notable enhancements over 2.10.4:

  • Ubuntu 16.04 packages are now correctly produced (LU-11176)
  • Mellanox OFED 4.4-2 is now the default version built and tested

Details of changes since 2.10.4 can be found in the 2.10.5 change log.

Please log any issues found in the issue tracking system.

Thanks to all those who have contributed to the creation of this release.

We are expecting to release Lustre 2.10.6 in the coming months

Lustre 2.10.4 Released

By jfranklin

We are pleased to announce that the Lustre 2.10.4 Release has been declared GA and is available for download. You can also grab the source from git.

Along with a number of useful bug fixes, this maintenance release includes the following notable enhancements over 2.10.3:

  • RHEL 7.5 is now supported for servers and clients (LU-10897)
  • ZFS 0.7.9 is now the default version of ZFS used for the release (LU-11019)

Details of changes since 2.10.3 can be found in the 2.10.4 change log.

Please log any issues found in the issue tracking system.

Thanks to all those who have contributed to the creation of this release.

We are expecting to release Lustre 2.10.5 in the coming months

Lustre 2.10.3 Released

By jfranklin

We are pleased to announce that the Lustre 2.10.3 Release has been declared GA and is available for download. You can also grab the source from git.

Along with a number of useful bug fixes, this maintenance release includes the following notable enhancement over 2.10.2:

  • ZFS 0.7.5 is now the default version of ZFS used for the release (LU-10377)

Details of changes since 2.10.2 can be found in the 2.10.3 change log.

Please log any issues found in the issue tracking system.

Thanks to all those who have contributed to the creation of this release.

We are expecting to release Lustre 2.10.4 in the coming months

OpenSFS Test Cluster Donation

By jfranklin

OpenSFS is looking to donate a smallish cluster (click here for a PDF with a description of the hardware) that previously supported testing and development of the open-source parallel Lustre file system. While this is still a useful system, it’s no longer within OpenSFS’s scope to operate, so we are looking to donate it to a college or university to support activities aligned with our mission to promote innovation and adoption of open-source scalable storage technologies. There are many potential use cases for a system like this including teaching, training, professional development, software research, or production use as an HPC cluster.

The cluster is wholly owned by OpenSFS and can be transferred as an asset to the receiving campus. The cluster is currently at Indiana University at their Bloomington campus. The receiving campus will be responsible for packaging and transporting the cluster. Indiana University will remove the cluster from their data center and place it on the loading dock for packaging, un-cabling, etc. The racks are included and the cluster could be transported in those two units.

Interested colleges or universities should send a one page proposal of how they would utilize this system. The proposal must include a primary point of contact, i.e., name, email, mailing address, and phone number. The proposals will be reviewed by the OpenSFS board based on the following criteria:

● Growing the open-source community
● Researching file system and storage technologies
● Supporting traditionally underserved students and staff

Membership in OpenSFS will not be a factor in the decision. Proposals are due by midnight PST, February 9, 2018. The receiving organization will be granted a speaking slot at the upcoming LUG 2018 in Chicago at Argonne National Laboratory to describe their plan for the cluster. Two free LUG 2018 registrations will be included (transportation and housing not included). The proposals and any questions should be sent to [email protected].

Sincerely,
The Board of OpenSFS

Lustre 2.10.2 Released

By jfranklin

We are pleased to announce that the Lustre 2.10.2 Release has been declared GA and is available for download. You can also grab the source from git.

Along with a number of useful bug fixes, this maintenance release includes the following notable enhancement over 2.10.1:

  • ZFS 0.7.3 is now the default version of ZFS used for the release (LU-10150)

Details of changes since 2.10.1 can be found in the 2.10.2 change log.

Please log any issues found in the issue tracking system.

Thanks to all those who have contributed to the creation of this release.

We are expecting to release Lustre 2.10.3 during Q1 of next year.

SC17 Lustre Community BoF

By jfranklin

Attending SC17? Please join us at the Lustre Community Birds of a Feather (BoF) session!

Agenda:

5:15 p.m. to 5:20 p.m.
Welcome, Agenda, Introduction
Topic: State of Lustre and Its Community, Frank Baetke, Sarp Oral

 

5:30 p.m. to 5:35 p.m.
Upcoming Lustre Community Events, Frank Baetke, Sarp Oral

 

5:35 p.m. to 5:40 p.m.
Legal Aspects of Lustre, Hugo Falter

 

5:40 p.m. to 5:50 p.m.
The Lustre Roadmap, Peter Jones

 

5:50 p.m. to 7:00 p.m.
Technical Discussion, Andreas Dilger, Frank Baetke, Sarp Oral

 

PTI Draws Global Attendees to Lustre User Group Meeting

By jfranklin

Users of the supercomputing file system software connect with colleagues, elect officers to OpenSFS board, including IU’s own Ken Rawlings as secretary

Original article available via Indiana University

Proponents of the Lustre file system, which powers many of the world’s fastest supercomputers, recently gathered last month on the Indiana University Bloomington campus for the annual Open Scalable File Systems Lustre User Group, or LUG, meeting.

LUG is the premier event for the Lustre community and brings together developers, system architects and administrators, and users from all around the world to discuss the current status and future roadmap of Lustre. 2017 has been a transitional year for OpenSFS, the organization dedicated to the success of the Lustre file system, as it moves to a user-led, nonprofit model. In fact, this year marks the first time the LUG meeting was hosted by a user institution.

I’m quite dedicated to Lustre, and am looking forward to helping it become an even more vibrant ecosystem for the global high performance computing community. Ken Rawlings, IU senior systems analyst, on his election to the OpenSFS Board

“We were honored to host LUG17 and its nearly 200 attendees, who traveled to Bloomington from 13 countries and more than 70 institutions,” said Stephen Simms, former OpenSFS president and manager of the High Performance File Systems group at Indiana University. “Everyone at IU did their best to create a successful conference with ample time to connect with colleagues, professionally and socially.”

In addition to workshops and presentations, LUG17 featured an opening reception at IU’s Cyberinfrastructure Building sponsored by DDN, an Intel-sponsored dinner and a movie showing of the 1979 film “Breaking Away” (which was filmed in Bloomington), and a pub crawl sponsored by HGST/WARP.

Meet the OpenSFS Board

Meet the OpenSFS Board

The newly elected OpenSFS Board members and officers are (left to right): Kevin Harms (Argonne National Laboratory), vice president; Ken Rawlings (Indiana University), secretary; Shawn Hall (BP), director at large; Rick Wagner (Globus), treasurer; and Sarp Oral (Oak Ridge National Laboratory), president.

“LUG2017 was a smashing success, thanks to the flawless coordination between IU and OpenSFS,” said Sarp Oral, president of OpenSFS. “The event brought Lustre system architects, developers, and administrators from all around the world, and it was very well received by the attendees. As the president of OpenSFS and on behalf of the Lustre community, I would like to express my sincere gratitude and thanks to the IU staff who made this event a true success.”

OpenSFS Board elections were also held as part of LUG17. These elections concluded the re-organization and transition of OpenSFS as a Lustre user-driven organization. Newly elected OpenSFS Board members and officers include:

  • Sarp Oral (Oak Ridge National Laboratory) as president
  • Kevin Harms (Argonne National Laboratory) as vice president
  • Ken Rawlings (Indiana University) as secretary
  • Rick Wagner (Globus) as treasurer
  • Shawn Hall (BP) as the director at large

IU’s Ken Rawlings is a senior systems analyst in the High Performance File Systems group in the university’s Research Technologies division. In his new role as secretary of the OpenSFS board, he will be responsible for general records management including maintaining meeting documents and creating detailed reports.

“It’s an honor to be able to serve the community in this way,” said Rawlings. “I’m quite dedicated to Lustre, and am looking forward to helping it become an even more vibrant ecosystem for the global high performance computing community.”

The LUG17 agenda and presentation materials and videos are now available at https://opensfs.org/lug-2017-agenda/.

Save

Lustre 2.10.0 Released

By jfranklin

We are pleased to announce that the Lustre 2.10.0 Release has been declared GA and is available for download. You can also grab the source from git.

This major release includes new features:
  • Progressive File Layouts: Enables file layouts to automatically adjust as size of files grow thus optimizing performance for diverse workloads (LU-8898)

  • Multi-Rail LNet: Allows LNet to utilize multiple network interfaces on a node in parallel, aggregating their performance (LU-7734)

  • Project Quotas: Extension to the Lustre quotas feature to provide the option to place quotas on a per project basis rather than just per user or per group (LU-4017)

  • Simplified Userspace Snapshots: Provides a mechanism to leverage the snapshot capability in OpenZFS to take a coordinated snapshot of a Lustre filesystem. (LU-8900)

  • NRS Delay Policy: Simulates high server load as a way of validating the resilience of Lustre under load. (LU-6283)
Fuller details can be found in the 2.10 wiki page (including the changelog and test matrix).

Please log any issues found in the issue tracking system

Thanks to all those who have contributed to the creation of this release.

This is the first release of the 2.10.x LTS release stream. A freely available Lustre 2.10.1 release is planned in the coming weeks