0
BeSTGRID: Developing NZ research infrastructure<br />www.bestgrid.org<br />Nick Jones<br />Director, BeSTGRID<br />Co-Dire...
... was a Pilot<br />$2.5million: Sep 2006 – March 2008<br />“BeSTGRID aims to enhance e-Research capability in New Zealan...
Collaboration Services<br /><ul><li>Advanced Video Conferencing (Access GRID, EVO - Enabling Virtual Organizations, HD, H....
Telemedicine – APAN 26</li></li></ul><li>Collaboration Services<br /><ul><li>Sakai VRE (Virtual Research Environment) – co...
“VRE” development by UK e-Science group at Hartree Centre, Daresbury
BeSTGRID IAM Federation
Pilot integration with Australian AAF
Auckland, Canterbury, Lincoln, Open
Wikis, SLCS (Grid Certificates)</li></li></ul><li>Computation Grid Tools<br />Grid Computing interfaces<br />Grisu GUI, Gr...
Bioinformatics<br />Steven Stones-Havas1 and Allen Rodrigo2<br />1Biomatters Ltd  <br />2The Bioinformatics Institute (New...
Data Services<br /><ul><li>30TB storage at each foundation BeSTGRIDsite
Auckland, Canterbury, Massey
Local mirrors of research databases
NZ BioMirror
Ecology and Human Behaviour
Whole Genome Association Studies
NZ Social Sciences Data Service
Ocean Biogeographic Information System
Austronesian Basic Vocabulary and Bantu Language Database
Data services (GridFTP, NFS, Samba, FTP)</li></li></ul><li>Successes: within NZ<br />First grid infrastructure in NZ, focu...
What did we learn?<br />Change difficult within Institutions<br />Medium to Long term timeframes required with researchers...
BeSTGRID 2009 - 2010<br />MoRST GRID Computing Middleware Initiative<br />
MoRSTeResearchprogramme<br />Review:<br />In Vote RS&T 2008/09, funding was appropriated to develop capability within the ...
 Federated Identity and Access Management
Towards a Federated Approach – strategy development
 Technical Support and Resources
 Semantic Data and Public Access to Research
 Grid Middleware Initiative
 Hardship fund for remote site connection to KAREN</li></li></ul><li>Advanced Video Collaboration Centre<br /><ul><li>Adva...
Helpdesk 0800 666 889
http://avcc.karen.net.nz/
Event calendar
Quality Assurance for end points
Nathan Gardiner</li></li></ul><li>NZ Identity Federation<br />Towards a Federated Identity<br />https://nzfed.auckland.ac....
Semantic public research data<br />Public research data – semantic interoperability<br />Integration of Geoscience related...
BeSTGRID2009 – 2010<br /><ul><li>MoRST Dec 2008 funding request forMiddleware development for eResearch in NZ</li></ul>		$...
Upcoming SlideShare
Loading in...5
×

091020 E Research Otago

816

Published on

Update on BeSTGRID project to regional eResearch even eResearch@Otago '09.

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
816
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • GRISU is a Job Execution Manager
  • Transcript of "091020 E Research Otago"

    1. 1. BeSTGRID: Developing NZ research infrastructure<br />www.bestgrid.org<br />Nick Jones<br />Director, BeSTGRID<br />Co-DirectoreResearch, Centre for eResearch<br />University of Auckland<br />n.jones@auckland.ac.nz<br />
    2. 2. ... was a Pilot<br />$2.5million: Sep 2006 – March 2008<br />“BeSTGRID aims to enhance e-Research capability in New Zealand by providing the skill base to help the various research disciplines engage with new eResearch services”<br />“BeSTGRID aims to kick start centralised infrastructurewith some capital investment at key institutions”<br />BeSTGRID:intial three years<br />
    3. 3. Collaboration Services<br /><ul><li>Advanced Video Conferencing (Access GRID, EVO - Enabling Virtual Organizations, HD, H.323)
    4. 4. Telemedicine – APAN 26</li></li></ul><li>Collaboration Services<br /><ul><li>Sakai VRE (Virtual Research Environment) – collaboration space (wikis, mailing lists, event calendars, file sharing)
    5. 5. “VRE” development by UK e-Science group at Hartree Centre, Daresbury
    6. 6. BeSTGRID IAM Federation
    7. 7. Pilot integration with Australian AAF
    8. 8. Auckland, Canterbury, Lincoln, Open
    9. 9. Wikis, SLCS (Grid Certificates)</li></li></ul><li>Computation Grid Tools<br />Grid Computing interfaces<br />Grisu GUI, Grisu CLI<br />Bioportal (Phylogenetics)<br />x.509 Certificates<br />Grix certificate issuing tools<br />SLCS Shibboleth issued certificates (Canterbury)<br />
    10. 10. Bioinformatics<br />Steven Stones-Havas1 and Allen Rodrigo2<br />1Biomatters Ltd <br />2The Bioinformatics Institute (New Zealand)<br />
    11. 11. Data Services<br /><ul><li>30TB storage at each foundation BeSTGRIDsite
    12. 12. Auckland, Canterbury, Massey
    13. 13. Local mirrors of research databases
    14. 14. NZ BioMirror
    15. 15. Ecology and Human Behaviour
    16. 16. Whole Genome Association Studies
    17. 17. NZ Social Sciences Data Service
    18. 18. Ocean Biogeographic Information System
    19. 19. Austronesian Basic Vocabulary and Bantu Language Database
    20. 20. Data services (GridFTP, NFS, Samba, FTP)</li></li></ul><li>Successes: within NZ<br />First grid infrastructure in NZ, focused on BioInformatics, with Industry collaboration with BioMatters and New Zealand Supercomputing Centre<br />Implementation of first federated identity management framework in NZ<br />contribution to a multi-sector working group to further evolve identity management across research and education (IMAGER, http://www.morst.govt.nz/current-work/science-infrastructure/imager/) <br />Established the foundations of a shared infrastructure service delivery model across institutions<br />Recognition from MoRST of need for eResearch support, with $4.2M in ‘08/’09 budget for eResearch infrastructure<br />
    21. 21. What did we learn?<br />Change difficult within Institutions<br />Medium to Long term timeframes required with researchers, ITS, SMT, research support units<br />“Final Report: A Workshop on Effective Approaches to Campus Research Computing Cyberinfrastructure” Klingenstein, Morooney, Olshansky. 2006<br />Collaboration seen as critical yet complex and expensive<br />Working with user communities essential to mutual understand of needs and opportunities, and developing capabilities<br />Need significant capability before international collaborations (and related learning) possible<br />New forms of organisation and support required<br />“Beyond Being There: A Blueprint for Advancing the Design, Development, and Evaluation of Virtual Organization” Cummings, Finholt, Foster, Kesselman, Lawrence. 2008<br />“The Importance of Long-Term Science and Engineering Infrastructure for Digital Discovery” Wilkins-Diehr, Alameda, Droegemeier, Gannon. 2008<br />Government and Institutional Investment well below international levels<br />Australia NCRIS: $540M ++ over 5 years alongside State and Institutional investments<br />EU FP7 e-Infrastructure call + National Grid Initiatives + Identity + HPC + Networks in member states<br />US Office of Cyberinfrastructure, NSF, NIH, DoE all funding major Cyberinfrastructure initiatives<br />Education programs lacking<br />Who is training the next generation?<br />
    22. 22. BeSTGRID 2009 - 2010<br />MoRST GRID Computing Middleware Initiative<br />
    23. 23. MoRSTeResearchprogramme<br />Review:<br />In Vote RS&T 2008/09, funding was appropriated to develop capability within the Kiwi Advanced Research and Education Network user group to make effective use of KAREN:<br /><ul><li> Advanced Video Conferencing Collaboration and Support Centre
    24. 24. Federated Identity and Access Management
    25. 25. Towards a Federated Approach – strategy development
    26. 26. Technical Support and Resources
    27. 27. Semantic Data and Public Access to Research
    28. 28. Grid Middleware Initiative
    29. 29. Hardship fund for remote site connection to KAREN</li></li></ul><li>Advanced Video Collaboration Centre<br /><ul><li>Advanced Video Collaboration Centre
    30. 30. Helpdesk 0800 666 889
    31. 31. http://avcc.karen.net.nz/
    32. 32. Event calendar
    33. 33. Quality Assurance for end points
    34. 34. Nathan Gardiner</li></li></ul><li>NZ Identity Federation<br />Towards a Federated Identity<br />https://nzfed.auckland.ac.nz/<br />Strategy consultation – Q3 – Q4 2009<br />Resources, Toolkit, and examplar services – 2010<br />Governance and Ownership discussion underway – NZVCC IT, CRI IT, supported by MoRST<br />IMAGER – http://www.morst.govt.nz/current-work/science-infrastructure/imager/<br />Matthew Cocker<br />
    35. 35. Semantic public research data<br />Public research data – semantic interoperability<br />Integration of Geoscience related data holdings<br />University of Auckland, Landcare Research<br />Mark Gahegan, Robert Gibb<br />
    36. 36. BeSTGRID2009 – 2010<br /><ul><li>MoRST Dec 2008 funding request forMiddleware development for eResearch in NZ</li></ul> $840k approved 24 Dec 2008, initiated April 2009<br /><ul><li>Provides ongoing support for BeSTGRID
    37. 37. Widened from founders: Auckland, Canterbury & Massey
    38. 38. by active participation of new Universities and CRIsVictoria, Otago, Lincoln, Landcare Research, AUT
    39. 39. Aim: coordinate national grid middleware; use best-practice tools & services; focus on sustainability</li></li></ul><li>BeSTGRID2009 – 2010<br />Form collaborations with related Science Infrastructure programmes<br /><ul><li>SCENZ Grid
    40. 40. New Zealand Genomics Limited
    41. 41. Virtual Institute of Statistical Genetics and MapNet
    42. 42. Social Sciences Data Archive and Services
    43. 43. Auckland Cancer Society Research Centre</li></ul>Support Science Gateways, applications and services<br /> infrastructure supports science communities with own specialised needs<br /><ul><li>Bio – Extension of scope from phylogenetics to other areas of Bioinformatics and Biomolecular sciences
    44. 44. Geo – collaboration with Canadian geoscience infrastructure</li></ul>Add in new Data and HPC sites and services:<br /><ul><li>Otago University
    45. 45. Victoria University Wellington
    46. 46. Landcare Research
    47. 47. Auckland University Technology </li></li></ul><li>Auckland<br />Massey, Albany<br />AUT<br />Landcare Research<br />Victoria<br />Lincoln<br />Canterbury<br />Otago<br />Computation<br />Cluster<br />Identity provider<br />Planned<br />Storage<br />Virtual Applications<br />Current<br />
    48. 48. Computation Grid Resources<br />
    49. 49. NZ eResearch Infrastructure<br />
    50. 50. Key Milestones<br />Winter Retreat 2009<br />Geo, Bio, Grid strategy workshops – Auckland<br />29 June – 1 July<br />Spring Retreat 2009<br />Technical Working Group working session – Canterbury<br />14 September<br />Strategies and plans<br />Geo and Bio strategy drafts – near completion<br />Initial projects kicking off in parallel<br />National workshop – planning underway for 2010<br />Coordinating with KAREN, Federated IAM, and others<br />Grid Middleware strategy – Q3 2010<br />
    51. 51. BeSTGRID Winter Retreat 2009<br />Geoscience WG<br />Middleware WG<br />
    52. 52. Bioscience theme<br />Leadership<br />Dr. Mik Black, Biochemistry Department, University of Otago<br />The Team<br />MikBlack, AnetteBecher, Cris Print, Jack Flanagan, Mike Cooling, Mike Eccles, NeilGemmell, Phil Wilcox, Robert Hickson, George Slim, Mark Gahegan, Nick Jones, Richard Li <br />Research Communities<br />Virtual Institute of Statistical Genetics, MapNet, NZ Genomics Ltd, Centre for Reproduction and Genomics, Auckland Bioengineering Institute, Auckland Cancer Society Research Centre, Bioinformatics Institute<br />Initial Goals – Genetics/Genomics<br /><ul><li> Storage and management of high-throughput data (e.g., microarray and sequence data).
    53. 53. Distributed analysis of large data sets (analysis via GenePattern).</li></li></ul><li>GenePattern: a platform for integrative genomics<br />GenePattern provides access to a broad array of computational methods used to analyze genomic and proteomic data. It is designed to be easy for computational biologists to add their own analysis and visualizations, which enables access to new computational methods on a regular basis.<br />Imaging<br />Clinical Research<br />Pathology<br />Molecular Biology<br />Slide adapted from Ted Liefeld<br />The Broad Institute of MIT and Harvard<br />
    54. 54. Geoscience theme<br />Leadership<br />Prof. Mark Gahegan, Centre for eResearch, University of Auckland <br />The Team<br />Mark Gahegan, Kevin Buckley, Isabella Cawthorn,<br />Robert Gibb, Niels Hoffmann,FemkeReitsma,<br />Nick Jones, Richard Li, Mik Black <br />Research Communities<br />Invasive species modelling, surface and ground water modelling, ecosystem services modelling, carbon emissions, landcover and landuse databases, drill core integration, taxonomy reconcilliation, nationally significant databases development <br />Initial Goals<br /><ul><li> Invasive Species Modelling (R on the grid with workflows, mapping)
    55. 55. Surface and Ground Water modelling (Lidar processing and workflows, mapping)
    56. 56. Taxonomy Reconcilliation (Data and Collections Management)</li></li></ul><li>WS<br />Data<br />Paul Grimwood & colleagues, GNS<br />
    57. 57. User Interface: Portal<br />Robert Gibb, Niels Hoffmann, Landcare<br />
    58. 58. Technology (future)<br />Workflow<br />Kepler<br />currently issue with proxies<br />Triana<br />Taverna<br />No spatial components<br />Robert Gibb, Niels Hoffmann, Landcare<br />
    59. 59. Grid Middleware Planning<br />
    60. 60. Technical Working Group<br />Deliver on needs of Bio and Geo themes<br />Meet monthly, to present and discuss proposals, progress reports, and services and applications deployed<br />Membership<br />Institutions formally contracted to BeSTGRID + collaborators<br />Terms of Reference, Meeting notes, etc on BeSTGRID website<br />http://www.bestgrid.org/index.php/Grid_Technical_Working_Group<br />
    61. 61. Summary<br />What do we have, where are we going?<br />
    62. 62. What do we have?<br />A good high-speed network with capacity for growth<br />The foundations of a sophisticated infrastructure, some HPC and massive storage silos, <br />Authentication, some grid middleware and basic services (but not nationally coordinated)<br />Good links to e-research development communities: e.g. Australian National Collaborative Research Infrastructure Committee (NCRIS), Argonne (Globus), San Diego Supercomputer Center (SDSC), eScienceUK, UK NGS, OMII-UK (Edinburgh, Manchester)<br />
    63. 63. BeSTGRID2009 – 2010<br /><ul><li>MoRST Dec 2008 funding request forMiddleware development for eResearch in NZ</li></ul> $840k approved 24 Dec 2008, initiated April 2009<br /><ul><li>Provides ongoing support for BeSTGRID
    64. 64. Widened from founders: Auckland, Canterbury & Massey
    65. 65. by active participation of new Universities and CRIsVictoria, Otago, Lincoln, Landcare Research, AUT
    66. 66. Aim: coordinate national grid middleware; use best-practice tools & services; focus on sustainability</li></li></ul><li>BeSTGRID2009 – 2010<br />Form collaborations with related Science Infrastructure programmes<br /><ul><li>SCENZ Grid
    67. 67. New Zealand Genomics Limited
    68. 68. Virtual Institute of Statistical Genetics and MapNet
    69. 69. Social Sciences Data Archive and Services
    70. 70. Auckland Cancer Society Research Centre</li></ul>Support Science Gateways, applications and services<br /> infrastructure supports science communities with own specialised needs<br /><ul><li>Bio – Extension of scope from phylogenetics to other areas of Bioinformatics and Biomolecular sciences
    71. 71. Geo – collaboration with Canadian geoscience infrastructure</li></ul>Add in new Data and HPC sites and services:<br /><ul><li>Otago University
    72. 72. Victoria University Wellington
    73. 73. Landcare Research
    74. 74. Auckland University Technology </li></li></ul><li>What next?Aligning with the NZ science community<br />Developing a RIAG bid for a long-term integrated landscape of eResearch including Federated IAM and HPC, as a National eResearch Infrastructure<br />What are the research needs, tools, applications, environments, computing capabilities that we will need in New Zealand, over the next 10 - 20 years?<br />Please get in touch if you would like to include your ideas and needs:<br />m.gahegan@auckland.ac.nz<br />n.jones@auckland.ac.nz<br />tim.david@canterbury.ac.nz<br />
    75. 75. Thanks !!!<br />
    76. 76. End<br />Questions, comments<br />
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×