ePIC streaming workflow orchestration testbed
Common software: yes
swf-testbed in NPPS
Participants
Experiments and projects
ePIC Experiment at the Electron Ion Collider (EIC)
Technical teams
AI/ML
Workflow and workload management
Related materials
The ePIC streaming workflow orchestration testbed was esablished in 2025 to implement and evaluate a workflow management system capable of meeting the comprehensive requirements of ePIC workflow management, most particularly the streaming workflows that present new and challenging requirements arising from ePIC streaming computing model. The testbed is evaluating the distributed computing tools PanDA, iDDS and Rucio as the basis for the system, together with an agent infrastructure mediated by ActiveMQ messaging, and core services based on Django backed by Postgres, including a monitoring system, REST-based APIs to all system information, and MCP services providing LLM based interfaces.
Testbed overview talk: Testbed talk at SRO-XIII, Dec 9 2025
Testbed progress notes with links to recent talks
References
- swf-testbed in github
- The ePIC Streaming Computing Model
- ePIC workflow management requirements
- iDDS: Intelligent Distributed Dispatch and Scheduling for Workflow Orchestration]
- PanDA: Production and Distributed Analysis System, Comput Softw Big Sci 8, 4 (2024)
