Performance Analysis Committee
Charter:
The Performance Analysis committee will 1) evaluate the FutureGrid infrastructure as it is developed and deployed and 2) help users to leverage the FutureGrid infrastructure for their experiments. The following are proposed activities for this committee:
Benchmarking: Determine set of appropriate benchmarks to evaluate the FutureGrid infrastructure. The benchmarks will be used to establish a baseline for performance and executed regularly using an automated framework to validate infrastructure improvements or detect degradations of performance. A major part of this work will be to measure the impact of virtualization on experiments as well as UTK’s Grid Benchmark Challenge work. We will also draw from the single-system and multi-system benchmarks performed in the proposal, the TeraGrid’s AUS benchmarking activities, and any other related activities. Similar to TeraGrid AUS effort, benchmarks will be packaged and published into a repository so others can easily reuse them. Benchmark results will be stored persistently and made available through the FutureGrid portal for users to access.
Instrumentation: The Performance Analysis group will make recommendations to FutureGrid developers so that performance measurements are integrated into FutureGrid software and alerts are setup at the IU GOC to detect problems with the infrastructure. For example, performance measurements can be added to Pegasus workflows so that the performance of grid and virtualization tools it invokes are logged and can be analyzed.
Performance Portal: The Performance Analysis committee will publish benchmarks and benchmark results (summary data and packaged results) to users through the FutureGrid portal. We will also work with the IU GOC to publish data about the load conditions of FutureGrid that would help developers running experiments on FutureGrid (e.g., network measurements). This activity is inspired by the EGEE Grid Observatory web pages.
Performance tools: Provide users with tools to help assess the performance of their applications. PAPI (UTK) and Vampir (TU-D) will be supported on all resources and further tools will be explored. The extension of PAPI and Vampir within virtual machines will be explored as the technology further develops. Vampir will also be extended to incorporate load and monitoring data that would help a user to better understand their application performance.
Relationship to other committees:
Operations and Change Management Committee: Setup alerts so that performance problems can be properly detected.
Software Committee: Provide performance tools and recommendations for performance measurement instrumentation of the FutureGrid infrastructure.
System Administration & Network Management Committee: Benchmark feedback and recommended configuration changes if applicable to improve performance.
Training, Education and Outreach Services Committee: Provided performance training materials.
User Requirements Committee: Review use cases and analyze performance needs.
User Support Committee: Support benchmarks and performance tools.
Design Document:
Mailing List:
Current Members:
| Firstname |
Personal Information: Lastname |
Personal Information: Phone (cell) | Personal Information: Phone (work) | |
|---|---|---|---|---|
| Seung-Hee | Bae | - | - | sebae@indiana.edu |
| Raphael | Bolze | 310-448-9362 | 310-448-9362 | rbolze@isi.edu |
| Jong Youl | Choi | 812 606-8435 | jychoi@indiana.edu | |
| Jaliya | Ekanayake | - | - | jekanaya@cs.indiana.edu |
| Thilina | Gunarathne | 8123914212 | - | tgunarat@cs.indiana.edu |
| Robert | Henschel | (812) 856-7411 | (812) 856-7411 | henschel@indiana.edu |
| Piotr | Luszczek | 865-851-0869 | 865-974-3126 | luszczek@eecs.utk.edu |
| Scott | McCaulay | - | - | smccaula@indiana.edu |
| Judy | Qiu | (812)855-0804 | xqiu@indiana.edu | |
| Shava | Smallen | 618-855-0646 | 858-822-0962 | ssmallen@sdsc.edu |
| Warren | Smith | ? | 512-553-0363 | wsmith@tacc.utexas.edu |
| Mauricio | Tsugawa | 352-327-8734 | 352-392-5989 | tsugawa@acis.ufl.edu |
| George | Turner | ? | (812) 855-5156 | turnerg@indiana.edu |
| Gregor | von Laszewski | 585 298 5285 | 812 856 1311 | laszewski@gmail.com |
| Thomas | William | ? | +49 351 463-38474 | thomas.william@gwtonline-fb.de |
| Tak-Lon | Wu | ? | ? | taklwu@indiana.edu |