JRA1.6 - Standardization - SIENA Collaboration

SIENA Goals

One complementary activity within the standardization task related to the EMI components themselves is the contribution to the SIENA roadmap.

SIENA stands for Standards and Interoperability for e-Infrastructure implementation Initiative and one of its major outcomes is a common standards roadmap for European projects in the field of DCIs.

Since the beginning of SIENA, EMI contributes with its implementation know-how and standards expertise.

This wiki page summarizes the SIENA events and related activities and will be updated to report about the collaboration progress during the course of the EMI project.

SIENA Contacts

  • Morris Riedel
  • Aleksandr Konstantinov (Deputy)

SIENA Meetings and Telcons

EMI members participated in the following meetings and telcons organized from the SIENA initiative:

2010-09-15 - EGI Technical Forum

SIENA organized three sessions at the EGI technical forum:

  • The DCI Projects: Roadmap and Interactions (1) [ More Details ]
    • Presentation about PGI activities and DCIs as well as EMI in context by Morris Riedel

First pieces of information have been given of how the jointly undertaken writing of the aforementioned standard roadmap will be organized.

2010-10-05 - TELCON

  • Conference call at Wednesday October 5th @ 15:00 CET
  • EMI Participants : Morris Riedel
  • Meeting minutes are available [ Minutes ]

2010-10-20 - TELCON

  • Conference call at Wednesday October 20th @ 15:00 CET
  • EMI Participants : Morris Riedel
  • Meeting minutes will be available after the meeting

2010-10-27 - WORKSHOP (co-located with the Open Grid Forum (OGF) in Brussels)

  • Full-day workshop at Wednesday October 27th
  • This event requires registration
  • EMI Participants : Morris Riedel
  • Agenda is available : [ Agenda ]

SIENA Tasks and EMI Roadmap Contributions

First Set of Questions (Mandatory)

Q : What Working Groups in the SDOs are doing work relevant to your project? Do you engage with them?

  • The major SDO relevant for EMI is the Open Grid Forum (OGF) and the Organization for the Advancement of Structured Information Standrads (OASIS)
  • In terms of OGF, many members are engaged in the following working groups: Production Grid Infrastructure (PGI), Usage Record (UR), Storage Resource Manager (SRM), Job Submission Description Language (JSDL), Basic Execution Service (BES), GLUE2, SAGA
    • As part of the greater EMI consortium, the middleware consortium UNICORE Forum e.V. is silver organizational member of OGF
  • In terms of OASIS, several members are observing the achievements around the following working groups without active contributions: Security Assertion Markup Language (SAML), Extensible Access Control Markup Language (XACML)
    • The consortium partner JUELICH is voting member and thus contributes on behalf of EMI to standardization in OASIS.
  • Standards of other SDOs are adopted (e.g. SOAP of W3C, X.509 of IETF, etc.), but a direct participation within working groups of these are not planned in the EMI project.

Q : What are the most important use cases you are working on to support modern collaborative research?

  • The EMI project contributes with high quality components and services to a wide variety of mainly scientific use cases that take advantage of distributed computing infrastructures such as EGI and DEISA/PRACE. Apart from the plethora of scientific use cases on these single infrastructures, EMI also aims to support cross-infrastructure use cases by harmonizing technology solutions and adopting standards where possible. As a consequence, EMI works also on solutions that support scientific use cases that jointly take advantage of High Performance Computing (HPC) and High Throughput Computing (HTC) technologies and resources.

Q : For each of these what is the “appropriate” ICT infrastructure (supercomputer, cluster, grid, cloud, stand-alone device, eg: smart phone, desktop or laptop, local server)?

  • The appropriate ICT Infrastructure for the EMI components and services are as follows: Supercomputer, cluster, grid
  • For some EMI solutions (e.g. component clients) stand-alone devices are also appropriate.
  • Some EMI solutions aim to be compatible with some cloud infrastructures towards the end of the project.

Q : Where do you see the role of cloud computing in your project?

  • The EMI project has a dedicated cloud task force to explore the role of cloud computing for the EMI component ecosystem
  • Initial consensus about the impact of cloud technologies to EMI components are twofold.
  • One way is that EMI components can be hosted as part of clouds having dedicated 'functionalities' that are able to take advantage of such cloud deployments (e.g. virtualization).
  • Another way is that EMI components are compatible with existing cloud infrastructures being essentially able to send processing jobs for their execution or to send/receive data to/from these existing infrastructures.

Q : Do you have a vision for standards and interoperability for your project?

  • The EMI project has a dedicated task standardization that ensures, together with the Project Technical Board (PTB), a strategic adoption of open standards where possible contributing ot one vision of interoperable EMI components.
  • The standardization task worked on the set of standards to be realized in the EMI vision currently taking roughly 17 standards into account expected to be more during the course of the project.

Q : What could be a set of open standards that would be understandable and acceptable to e-infrastructure stakeholders and guarantee the desired interoperability?

  • The OGF Grid Interoperation Now (GIN) group identified over years the relevant open standards for e-Infrastructures related to e-science and distributed computing.
  • This set has been published in a Journal paper by the GIN co-chairs Morris Riedel and Erwin Laure et al.
    • Interoperation of World-Wide Production e-Science Infrastructures, Concurrency and Computation: Practice and Experience, 21 (2009) 8, 961 - 990
  • The set of GIN-identified standards (as on Section 4.1 within this publication) is as follows:
    • Security : SAML, XACML, X.509
    • Information Systems : GLUE, XML
    • Accounting : UR, OGSA-RUS
    • Job Management : BES, JSDL, DRMAA,
    • Data Management : GridFTP, SRM, ByteIO, DAIS
    • Some standards have been filtered out here in terms of direct relevance : CIM, SQL, VOMS (de-facto standard?)
    • it should be noted that not all of these standards are relevant for the EMI project (e.g. DRMAA, DAIS, OGSA-RUS) and its development work
  • In this context it should be also noted that the GIN group also identified that some of these standards require additional features or need to resolve a few ambiguities that in turn was the reason of creating the Production Grid Infrastructure (PGI) working group.
  • The PGI working group aims to improve many of the aforementioned standards for more effective production use and therefore PGI is also relevant for EMI as being mentioned many times in the description of work.
  • The EMI set of components adopt many of these standards where appopriate and contributes to their improvements via the PGI working group as well.
  • Finally, emerging standards in the field of cloud computing might be relevant in the future for EMI (e.g. OCCI in OGF or standards from SNIA).

These questions will be discussed in a telcon on 2010-10-20 and re-distributed to others on 2010-10-22.

Questions on Grid Computing (Optional)

Q : 1. What Working Groups in various Standard Development Organizations (SDOs) do you regularly engage with and which respond to the technical requirements of your architecture?

  • The EMI project is regularly engaged with working groups within the Open Grid Forum and observes the status of some working groups within OASIS.
  • In general the working groups of the Open Grid Forum (OGF) are very responding in terms of technical requirements.
  • OASIS, in principle is responding to requirements too, but requires the membership of stakeholders and this in turn represents a barrier for many scientific organizations to become involved.
Q : 2. What are the most important products of the OGF process and how are these likely to be used in the future?
  • Most notably the 'product forum' as such that enables sustained collaboration beyond project timelines and between different stakeholders (users, developers, infrastructures) - The future use of this forum enables further collaboration and orientation towards standardization in the whole community.
  • Standard specifications (e.g. SRM, BES, JSDL, GLUE2, etc.) provide an excellent basis for interoperability within the community, PGI profiles and PGI-driven improvements of those ensure they are usable in the future as well

Q : 3. What other standards bodies play a vital role in the distributed computing area? Give some explicit use cases.

  • Beside OGF one notably important standard body is the Organisation for the Advancement of Structured Information Standards (OASIS).
    • The specific example for OASIS would be SAML and XACML. Both are urgently needed for both the adoption of common security solutions and compatibility with industry-based solutions.
    • in the context of this specific example, the EMI project adopts SAML and XACML within several relevant security components
  • The EMI project is directly involved in OGF and through a voting consortium member also involved in OASIS

Q : 4. Grid computing has been demonstrated to be an effective and efficient tool for scientific research (as shown by, e.g. by articles in the iSGTW newsletter).What characterizes the domains of science and the type of computation or data processing where grid computing has been successful?

  • Those domains of science that take advantage in using a 'chain-of-jobs' specifically tuned for different High Performance Computing (HPC) resource architectures (e.g. IBM BlueGene vs. Power)
  • Those domains of science that take advantage of multi-site workflows using brokering technologies enabling the distribution of computing jobs in a High Throughput Computing (HTC) fashion
  • The EMI project aims to provide solutions that fit the requirements of both of these characterized scientific domains

Topic attachments
I Attachment History Action Size Date Who Comment
PDFpdf 2010-10-19_EMI_SIENA_Answers_v1.pdf r1 manage 478.8 K 2010-10-29 - 06:02 MorrisRiedelExCern  
PDFpdf Agenda_SIENA_Roadmapevent_26092010_v9.pdf r1 manage 124.9 K 2010-10-17 - 14:58 MorrisRiedelExCern 2010-10-27-SIENA-WORKSHOP-AGENDA
PDFpdf SIENAConfcall_Minutes_06102010.pdf r1 manage 91.1 K 2010-10-17 - 14:49 MorrisRiedelExCern 2010-10-05-SIENA-TelCon-Minutes
Edit | Attach | Watch | Print version | History: r5 < r4 < r3 < r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r5 - 2010-10-29 - MorrisRiedelExCern
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    EMI All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright &© 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback