Grids in CYFRONET Marian Bubak Zofia Mosurska Michał Turała CYFRONET Academic Computer Centre of the AGH University of Science and Technology
Very Short History <ul><li>Established in 1973 as an i ndependent, non-profit organization . </li></ul><ul><li>In 1999 it became a separate unit of the University of Science and Technology in Krakow. </li></ul><ul><li>Main goal is to provide the universities and research institut ions with : </li></ul><ul><ul><li>comput ing power combined with a wide range of scientific software </li></ul></ul><ul><ul><li>communication infrastructure and network services </li></ul></ul><ul><li>CYFRONET is also engaged in numerous important projects, both domestic and international. </li></ul><ul><li>Strong collaboration with </li></ul><ul><ul><li>Institute of Computer Science AGH </li></ul></ul><ul><ul><li>Institute of Nuclear Physics </li></ul></ul>*
10 Gb/s PIONIER 10 Gb/s GEANT MAN Computer Resources user server mail server WWW server ftp server news server WWW server SGI Onyx300 SGI 2800 Claster PC SunFire 6800 ATL 2640 Sun Store HP RP7410 HP N4000 HP Superdome klaster sieciowy 6*IBM X345
<ul><li>70 km of fiber-optic links </li></ul><ul><li>Spans the entire metropolitan area of Cracow </li></ul><ul><li>Links universities, research centers, government institutions, </li></ul><ul><li>155Mbps ATM backbone (expandable to 622Mbps) </li></ul><ul><li>Linked to POL-34 (622 Mbps ) </li></ul>Metropolitan Area Network of the City of Krakow CYFRONET serves as the operator of the Cracow academic MAN, providing connectivity and services to academic institutions dispersed throughout the city via a fiber-optic network several dozen kilometers in length. The Centre functions as the main network node in southern Poland.
Conferences organized by Cyfronet The 6th Annual European Convex Users Conference (18-21 X 1994) Infofestival ’96 „Informatyka dla Nauki” (12-15 XI 1996) High Performance Computing in Europe on IBM Platforms (8-11 IX 1996) The 8th Joint EPS-APS International Conference on Physics Computing (17-21 IX 1996) High Performace Computing on Hewlett-Packard Systems (5-8 XI 1997) SGI Users’ Conference (11-14 X 2000)
Conferences organized by Cyfronet (contd.) 3rd IFIP Conference on Distributed Applicatios and Interoperable Systems (17-19 X 2001) The 1st Cracow Grid Workshop 5-6 XI 2001 The 1st EU CrossGrid Conference (18-20 III 2002) The 2nd Cracow Grid Workshop 11-14 XII 2002 Seminar: Sun Application Tuning 18-20 II 2003 Perimeter, Server and Desktop Security Solutions of WatchGuard Technologies (2 IV 2003)
International Conference on Computational Science 7 – 9 VI 2004 The 3nd Cracow Grid Workshop 27 – 29 XI 2003 E-health in Common Europe 5-6 VI 2003 Conferences organized by Cyfronet (contd.) The 7th Conference on Software Engineering (KKIO) 18-21 X 2005 E-health in Common Europe 17-18 XII 2004 The 4th Cracow Grid Workshp 13-15 XII 2004 The 5th Cracow Grid Workshp 20-23 XI 2005
SEMINARS <ul><li>They are held weekly or bi-weekly, </li></ul><ul><li>mainly for CYFRONET’s Users </li></ul><ul><li>Supercomputing and Networking (for many years) </li></ul><ul><li>Cracow Grid Seminar (since 2002) </li></ul>
MAN The Cracow Telemedicine Centre (where CYFRONET is one of the principal partners) has performed research in different telemedicine fields for years, helping many hospitals and health centres secure better medical services. The Centre has had many achievements in the development and implementation of IT solutions for different projects sponsored by the Polish Ministry of Science, as well as by EU 5FP. PIONIER: Polish Optical Internet - Advanced Applications, Services and Technologies for Information Society. PIONIER program has triggered many supporting activities, (such as e-Polska, Wrota Polski, etc.) aiming at building the base mechanisms of information society and providing Poland for equal partnership opportunities with other countries. National Projects
MAN High Performance Computing and Visualization with the SGI Grid for Virtual Laboratory Applications - the SGI Grid project aims to design and implement: <ul><li>state-of-the-art, broadband services for remote access to expensive laboratory equipment </li></ul><ul><li>backup computational center </li></ul><ul><li>remote data-visualization serviceThese services will be based on the national HPC infrastructure and advanced visualization. </li></ul>PROGRESS stands for Polish Research On GRid Environment for Sun Servers . It started as a grant co-financed by the Polish State Committee for Scientifc Research and Sun Microsystems Poland. The grant involved three research institutions: Poznan Supercomputing and Networking Center, Academic Computer Centre Cyfronet AGH and Technical University of Lodz, and lasted since December 2001 until December 2003. National Projects (contd.)
MAN CLUSTERIX - this project contains the concept of building the National Cluster of Linux Systems , a distributed PC-cluster (or metacluster) of a new generation. Its implementation makes it possible to deploy a production-class Grid environment, which consists of local PC-clusters with 64- and 32-bit architectures, located in geographically distant independent centers. The management software (middleware) being developed will allow dynamic changes in the hardware configuration. This project is being implemented by 12 Polish supercomputing centers and metropolitan area networks (MANs), with the Technical University of Czestochowa as the project coordinator. National Projects (contd.)
International Projects <ul><li>with the financial support </li></ul><ul><li> of the European Com mission </li></ul><ul><li>5th Framework Program </li></ul><ul><ul><li>CYFRONET involved into various 5 projects </li></ul></ul><ul><ul><li>Already finished </li></ul></ul><ul><li>6th Framework Program </li></ul><ul><ul><li>Cyfronet participates in 3 Grid projects </li></ul></ul><ul><ul><li>About 1 0 new proposals have been submitted in September 2005 to the EC </li></ul></ul>
Successful CrossGrid Final Review. The EU IST CrossGrid Project IST-2001-3224 had its Final Review on February 16-17, 2005 in Amsterdam. The results of the Project were demonstrated at the European Grid Conference in a series of technical talks and live demonstrations of applications, software services and tools, deployed on the CrossGrid testbeds. More the results were appreciated by the audience, by the EU Project Officer and by the Reviewers; all internal deliverables and presentations concerning technical, managerial and exploitation issues were approved. The Final CrossGrid Review concluded successfuly. About 200 persons from 21 institutions, representing 11 countries, contributed to the Project. CYFRONET was a Coordinator of the project. Research Projects in the 5th Framework Program
Research Projects <ul><li>T e s t b e d </li></ul>CrossGrid Architecture <ul><li>17 sites </li></ul><ul><li>9 countries </li></ul><ul><li>over 200 CPUs </li></ul><ul><li>4 TB of storage </li></ul>Applications Services Tools Roaming Access Server Migrating Desktop OCM-G Performance Prediction Data Access Globus Toolkit MPI Verification MPI Library Portal Post- processing Infrastructure Monitoring Plugin Plugin Plugin SOAP SOAP SOAP SOAP SOAP Protocol API API API API Links API API API SOAP SOAP API API (JMX) (OMIS) Visualization Kernel Links Performance Analysis API Application Monitoring Benchmarks Network Monitoring Medical Support Particle Physics Meteo/ Pollution Flood Simulation DataGrid Scheduler
PRO_ACCESS - The ImPROving ACCESS of Associated States To Advanced Concepts In Medical Informatics (PRO-ACCESS) project focuses on creating a platform for promotion, dissemination and transfer of advanced health telematics concepts and experiences from development and deployment of telemedicine solutions to NAS. PELLUCID - A Platform for Organizationally Mobile Public Employees. The project is coordinated by the Council for the Central Laboratory of the Research Councils, RAL, UK, with two academic partners: CYFRONET and the Institute of Computer Science AGH. GRIDSTART - this project clusters all of the 5FP IST-funded Grid research projects with the intention to stimulate wide deployment of appropriate technologies and to support early adoption of best practices. 5th Framework Program (cont.) 6-WINIT - an IPv6 wireless Internet initiative . The project will validate the introduction of the new Mobile Wireless Internet in Europe.
CoreGRID - the CoreGRID Network of Excellence (NoE) aims at strengthening and advancing scientific and technological excellence in the area of Grid and Peer-to-Peer technologies. Research projects in the 6th Framework Program K-Wf Grid - Knowledge-based Workflow System for Grid Applications - addresses the need for a better infrastructure for the future Grid environment. The Grid as a vast space of partially-cooperating, partially-competing Grid services will be a very dynamic and complex environment. In order to address the complexity in using and controlling the next generation Grid, the consortium will adopt the approaches envisioned by semantic Web and Grid communities in a novel, generic infrastructure. The K-Wf Grid system will assist its users in composing powerful Grid workflows by means of a rule-based expert system. problem solving environments, tools and GRID systems resource management and scheduling; Grid information and monitoring services; system architecture; programming models; knowledge & data management;
K-WfGrid Workflow Applications and Knowledge <ul><li>Integrating services into coherent application scenarios </li></ul><ul><li>Enabling automatic construction and reuse of workflows with knowledge gathered during operation </li></ul><ul><li>Involving monitoring and knowledge acquisition services in order to provide added value for end users </li></ul>Technologies : service-oriented Grid architecture, software agents, ontologies, dynamic instrumentation . Execute workflow Capture knowledge Reuse knowledge K-WfGrid Monitor environment Analyze information Construct workflow
User Workflow Orchestration and Execution Web Portal Grid Reso u rces Scheduler Grid Performance Monitoring and Instrumentation Service Automatic Application Builder Workflow Composition Tool Knowledge Assimilation Agent Grid Organizational Memory Ontological store of knowledge Low Level Grid Middleware (WS - RF) Knowledge Grid Workflow Execution Service Performance Analysis User Assistant Agent Grid Workflow User Interface User interaction through the Portal Guidances for the user Workflow composition and execution visualization User’s decisions in crucial points of execution Information on available resources and their description Execution of chosen Grid services Information about workflow execution Analysed and extracted knowledge Information about resources and environment Information about performance of particular resources K-WfGrid - Architecture and Flow of Actions
<ul><li>Fraunhofer FIRST, Berlin, Germany </li></ul><ul><li>Institute of Computer Science, University of Innsbruck, </li></ul><ul><li>Innsbruck, Austria </li></ul><ul><li>Institute of Informatics of the Slovak Academy of Sciences, Bratislava, Slovakia </li></ul><ul><li>ACC CYFRONET AGH, Kraków, Poland </li></ul><ul><li>LogicDIS S.A., Athens, Greece </li></ul><ul><li>Softeco Sismat SpA, Genova, Italy </li></ul>K-WfGrid - Partners www.kwfgrid.net Bratislava Athens Genova Kraków Innsbruck Berlin
EGEE - Enabling Grids for e-Science in Europe - the most prestigious of all 6FP Projects, aims to integrate current national, regional and thematic Grid efforts in order to create a seamless European Grid infrastructure for the support of the European Research Area (ERA). The EGEE project is coordinated by CERN. CYFRONET, together with ICM (Warsaw) and PSNC (Poznan), form a Regional Operations Centre for the Central European Grid Consortium , comprising Austria, the Czech Republic, Hungary, Poland, Slovakia and Slovenia. 6th Framework Program (contd.) EGEE Regional Operations Center (ROC) for Central European (CE) Federation is one of the several centers which comprise the European Grid Support, Operation and Management activity of EGEE. This activity's role is to create, operate, support and manage a production quality European grid infrastructure which will provide computing, storage, instrumentation and informational resources at many resource centres (RCs) across Europe.
ViroLab - Project Objectives <ul><li>The long term mission of ViroLab is to provide researchers and medical doctors in Europe with a virtual laboratory for infectious diseases. </li></ul><ul><li>To develop a VO that provides the “glue” for binding the various components of our virtual laboratory </li></ul><ul><li>To develop a virtual laboratory infrastructure for transparent workflow, data access, experimental execution and collaboration </li></ul><ul><li>To virtualize and enhance state-of-the-art in genotypic resistance interpretation tools and integrate them into the virtual laboratory </li></ul><ul><li>To establish epidemiological validation to correctly and quantitatively predict virological and immunological outcomes and disseminate the results to European stakeholders </li></ul>
ViroLab - Consortium <ul><li>Universiteit van Amsterdam </li></ul><ul><li>University Medical Centre Utrecht </li></ul><ul><li>High Performance Computing Center Stuttgart </li></ul><ul><li>CYFRONET AGH </li></ul><ul><li>Gridwise Technologies </li></ul><ul><li>Institute de Recerca de la SIDA </li></ul><ul><li>Catholic University Leuven </li></ul><ul><li>University College London </li></ul><ul><li>Catholic University Rome </li></ul><ul><li>Eötvös Loránd University </li></ul><ul><li>Institute of Infectious and Tropical Diseases, University of Brescia </li></ul><ul><li>Virology Education B.V. </li></ul>
grid resources grid middleware GLOBUS, EDG, CrossGrid, other VO management, AAA, Data Access & Logging for Provenance application Rule Engines Rule-based System Rule Derivers Rule Elucidators Biostat Apps Scientific Tools Stochastic Modeling Apps Session Manager Clinical Portal Driver Web Browser PDA Driver PDA Client presentation data resources Medical Apparatus Measured Data Patient Cohort DB Immunology DB Medical Knowledge Data Scientific Literature Stanford Virology Lab DB Pharmacology DB Derived Rules DB Intermediate Experimental Data computational resources Exp. Apparatus ViroLab - Component Perspective virtual organization CAs VIZ SIM Runtime System Collaboration Data Access (OGSA-DAI) PFT DB hospital CE, WN, SE Ind. Patient Data