Document control

AreaEGI Federation Operations
Procedure status

FINAL

OwnerAlessandro Paolini 
ApproversOperations Management Board
Approval status

APPROVED

Approved version and date

v5,  

Statement

The document describes the process for suspending a Resource Centre in the EGI infrastructure

Next procedure reviewupon request

Procedure reviews

The following table is updated after every review of this procedure.

DateReview bySummary of resultsFollow-up actions / Comments

 

Alessandro Paolini copy from PROC21_Resource_Center_suspension in EGI Wiki. Updated some links and information.

 

Alessandro Paolini removed the need to notify the VO managers.

 

Tiziana Ferrari 

Reintegrated the notification to VO managers supported by the concerned site, necessary in case the suspension is triggered by EGI managment

Extended the procedure to introduce additional suspension measures that may be needed in case of forced suspension by EGI management (in addition to the existing change of status in GOCDB)


Table of contents

Overview

The document describes the process for suspending a Resource Centre in the EGI infrastructure. The aim of this procedure is to ensure that the all parties are notified about suspension and that record history is kept.

Definitions

Please refer to the EGI Glossary for the definitions of the terms used in this procedure.

The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", “MAY", and "OPTIONAL" in this document are to be interpreted as described in RFC 2119.

Entities involved in the procedure

  • Resource Centre Manager: person who is responsible for Resource Centre.
  • NGI Representative (NGI): person who is responsible for NGI Operations.
  • Service Delivery and Information Security Lead: person who oversees the implementation of the procedure and coordinate communication with EGI governance bodies if necessary

  • Service Delivery and Information Security Team: team of the EGI Foundation responsible for performing suspension at EGI Federation Level, when required

  • EGI Foundation Director: person responsible of keeping the Service Delivery and Information Security Lead and of defining the applicable suspension plan and communications plan

Triggers

Resource Centre can be suspended either by NGI operators or the Service Delivery and Information Security Team member in case of breaking  Resource Centre Operational Level Agreement or whenever a risk is identified at national or EGI Federation level related to the participation of the Resource Centre in the EGI Infrastructure.

  • PROC01: Resource Centre is failing EGI Infrastructure Oversight escalation procedure
    • Level 3: NGI/ROC operations manager should make Resource Centre responsive or suspend it
    • Level 4: If no action was taken by NGI/ROC operations manager for 5 working days Operations send an email to NGI/ROC operations manager with CC to site administrator, ROD and GGUS. If no response after 1 working day Operations performs Resource Centre suspension.
  • PROC04: Resource Centre is underperforming (below the OLA target) for 3 consecutive months
  • PROC16: Resource Centre is failing Decommissioning of unsupported software procedure
    • Follow up the migration: Resource Centre which didn't provide information on migration plans can be suspended
  • SEC01-05: Resource Centre is failing Security Incident or Critical Security procedure

Notes for suspended Resource Centres

  • Suspended Resource Centres are not displayed in GGUS
  • When a Resource Centre gets suspended in GOC DB the "Notified site" field is flushed automatically in the corresponding tickets, and NGIs start managing them (processing or closing is up to them).

Steps

In case of suspension decided by the NGI or the Service Delivery and Information Security Team of the EGI Foundation

#ResponsibleActionNotes
1NGI/Service Delivery and Information Security Lead at the EGI FoundationDecision about suspension

In case a risk is identified by the EGI Executive Board and/or the EGI Council that requires the suspension as mitigation action, the EGI Service Delivery and Information Security Lead is informed by the EGI Director.

2NGI/EGI Foundation Service Delivery and Information Security Team

Notification is sent to Resource Centre Manager and to NGI Representative – a minimum of 3 working day on reaction

The NGI or the EGI Service Delivery and Information Security Lead are responsible for deciding the notification period applicable to the case.

The notification period is decided in consultation with the affected VOs.

The chosen notification period is communicated.


3NGI/EGI Foundation Service Delivery and Information Security TeamIf there is no reply from Resource Centre Manager
  • Change status of the Resource Centre in the GOCDB to ‘suspended’ adding the reason.
  1. If NGI is charge of implementing the procedure: Send notification to Resource Centre Manager.
  2. If EGI Foundation Service Delivery and Information Security Team is in charge of implementing the procedure: Send notifications to NGI Representative and Resource Centre Manager.



In case of suspension decided by the EGI Executive Board or the EGI Council.

#ResponsibleActionNotes
1EGI Foundation Director

EGI Director informs Service Delivery and Information Security Lead at the EGI Foundation about the need to proceed with suspension to enforce a EB or Council decision.


2EGI Director and  Service Delivery and Information Security Lead  

DEFINITION OF SUSPENSION PLAN

Define applicable suspension actions to be implemented depending on the motivation of suspension. See the following list of options.

Change status of the Resource Centre to ‘SUSPENDED’(mandatory)

Suspending a site in GOCDB effectively ‘removes’ the site from the production infrastructure. The site will then need to be recertified. Consequences of this are: 

  • the VOs supported by the site are no longer able to discover and use resources (e.g. through configuration information sources such as GOCDB and BDII)
  • the accounting data of the site is no longer accepted by the Accounting repository
  • the site is no longer monitored by the Monitoring and Security Monitoring service
  • the site information is no longer collected in the top-level BDII Information System
  • the site can no longer receive tickets through the EGI Helpdesk
  • the site is no longer discoverable in AppDB.

Revoking of roles of key personnel at a site (optional, depending on suspension case)

Revoking of roles of individual persons in GOCDB. Consequences of this are: access to the Pakiki security monitoring system is no longer possible.

Revoking X509 certificates of key personnel at a site  (optional, depending on suspension case)

This is possible by individual Certificate Authorities revoking certificates across the federation, or at the level of ARGUS which affects resources using this authorization service. Consequences of this would be to prevent people from making use of services using X509 certificate authentication

Remove an Identity Provider (IdP) from Check-in (optional, depending on suspension case)

Removal of an institute’s IdP from a site from Check-in would have the consequence of preventing anybody with a local institutional login at that site authenticating with another resource provider across the federation when making use of the Check-in service. 


3EGI Director and  Service Delivery and Information Security Lead  

DEFINITION OF COMMUNICATION PLAN

Define the list of entities to be informed about the suspension decision and the defined suspension plan.

  • (Mandatory) EGI Council and EGI Executive Board. Responsible: EGI Foundation Director
  • (Mandatory) Operations Management Board. Responsible: Service Delivery and Information Security Lead
  • (Mandatory) VO Managers of affected VOs (or other equivalent VO level board): EGI Foundation Director
  • (Optional) EGI CSIRT Team. Responsible: Service Delivery and Information Security Lead
  • (Optional) EGI Security Coordination Team. Responsible: Service Delivery and Information Security Lead
  • (Optional) EGI Foundation Communications Team. Responsible: EGI Foundation Director
  • (Optional) EGI Foundation Executive Team. Responsible: EGI Foundation Director

4Service Delivery and Information Security Lead

Oversee the execution of the suspension plan, in coordination with the Service Delivery and Information Security Team


5Service Delivery and Information Security Lead

Inform EGI Director about the completed execution of the suspension plan