This WG was active in 2021-22.

Main objective

Focus of the Working Group (WG) will be driving the technical evolution of the EGI Federation in the area of Data Transfer.

Activities

To support this goal, the WG will carry out the following  activities

• Perform a technology scouting to identify available technical solutions to transfer large amount of data;
• Deal with user communities to gather requirements and recurrent use cases;
• Identify gaps of the current solutions with a focus on those from the technology providers participating in the WG;
• Discuss and plan enhancements for technical providers.

Data Transfer WG Composition

EGI is engaging different types of stakeholders to accomplish the objectives of this WG:

• User communities: which will have a forum to present their requirements and use cases; to test and validate transfer services
• Technical providers: which can benefit of direct contacts with large communities to drive the evolution of their services
• EGI infrastructure providers: which can deploy the solutions delivered in the context of the WG.

Duration and outcome

The WG has a duration of one year ( which can be extended) and its main activity is to assess for each data transfer use case the best solution

available and derive technical objectives in the planned timescale, taking into account the available resources.

Activities

• PaNOSC Pilot with DataHub
  • EGI, ILL ( no more effort  to continue) , Onedata, CERIC-ERIC
• PaNOSC Globus Evaluation
  • ESRF
• HIFIS Pilot, integration of OpenID Connect in WebFTS and FTS
  • CERN, EGI, DESY
• Data Transfer Workshop at EGI Conference 2020
  • https://indico.egi.eu/event/5000/sessions/4502/#20201103
  • https://indico.egi.eu/event/5000/sessions/4506/#20201103
• Participation to Data Movement BoF at RDA Plenary 16
  • https://www.rd-alliance.org/data-movement-what-infrastructure-fabrics-are-required-0
• Participation to Data Movement BoF at RDA Plenary 17
  • https://www.rd-alliance.org/addressing-challenges-physical-data-access-accelerate-science-repositories-networks-and-petabytes

Documents and resources

All Documents