The European XFEL delivers up to 27000 intense (>1012 photons) pulses per second, of ultrashort (≤50 fs) and transversely coherent X-ray radiation, at a maximum repetition rate of 4.5 MHz. Its unique X-ray beam parameters enable groundbreaking experiments in matter at extreme conditions at the High Energy Density (HED) scientific instrument. The performance of the HED instrument during its first two years of operation, its scientific remit, as well as ongoing installations towards full operation are presented. Scientific goals of HED include the investigation of extreme states of matter created by intense laser pulses, diamond anvil cells, or pulsed magnets, and ultrafast X-ray methods that allow their diagnosis using self-amplified spontaneous emission between 5 and 25 keV, coupled with X-ray monochromators and optional seeded beam operation. The HED instrument provides two target chambers, X-ray spectrometers for emission and scattering, X-ray detectors, and a timing tool to correct for residual timing jitter between laser and X-ray pulses.

Jupyter notebooks are executable documents that are displayed in a web browser. The notebook elements consist of human-authored contextual elements and computer code, and computer-generated output from executing the computer code. Such outputs can include tables and plots. The notebook elements can be executed interactively, and the whole notebook can be saved, re-loaded and re-executed, or converted to read-only formats such as HTML, LaTeX and PDF. Exploiting these characteristics, Jupyter notebooks can be used to improve the effectiveness of computational and data exploration, documentation, communication, reproducibility and re-usability of scientific research results. They also serve as building blocks of remote data access and analysis as is required for facilities hosting large data sets and initiatives such as the European Open Science Cloud (EOSC). In this contribution we report from our experience of using Jupyter notebooks for data analysis at research facilities, and outline opportunities and future plans.

EXPERIMENTS AT THE EUXFEL Dall'Antonia, Fabio; Beg, Marijan; Bergemann, Martin; Bielecki, Johan; Bondar, Valerii; Carinan, Cammille; Costa Junior, Raul; Danilevski, Cyril; Ehsan, Wajid; Esenov, Sergey; Fabbri, Riccardo; Flucke, Gero; Fullà-Marsà, Daniel; Giovanetti, Gabriele; Göries, Dennis; Hickin, David; Jarosiewicz, Tobiasz; Kamil, Ebad; Kirienko, Yury; Kirkwood, Henry; Klimovskaia, Anna; Kluyver, Thomas; Mamchyk, Denys; Michelat, Thomas; Mohacsi, Istvan; Parenti, Andrea; Rosca, Robert; Rück, Denivy; Santos, Hugo; Schaffer, Robert; Silenzi, Alessandro; Spirzewski, Michal; Trojanowski, Sebastian; Youngman, Christopher; Zhu, Jun; Mancuso, Adrian P.; Fangohr, Hans; Brockhauser, Sandor: European XFEL GmbH, Schenefeld, GER

The Karabo distributed control system has been developed to address the challenging requirements of the European X-ray Free Electron Laser facility, including complex and custom-made hardware, high data rates and volumes, and close integration of data analysis for distributed processing and rapid feedback. Karabo is a pluggable, distributed application management system forming a supervisory control and data acquisition environment as part of a distributed control system. Karabo provides integrated control of hardware, monitoring, data acquisition and data analysis on distributed hardware, allowing rapid control feedback based on complex algorithms. Services exist for access control, data logging, configuration management and situational awareness through alarm indicators. The flexible framework enables quick response to the changing requirements in control and analysis, and provides an efficient environment for development, and a single interface to make all changes immediately available to operators and experimentalists.

Agile Project Management (Agile PM), coupled with the DevOps concept, has been worked out as a fundamental approach in a highly uncertain and unpredictable environment to achieve mature software development and to efficiently support concurrent operation [1]. At the European XFEL[2], Agile PM and DevOps have been applied to provide adaptability and efficiency in the development and operation of its control system: Karabo[3,4]. In this context, the Control and Analysis Software Group (CAS) has developed in-house a management platform composed of the following macro-artefacts: (1) Agile Process; (2) Release Planning; (3) Testing Infrastructure; (4) Roll-out and Deployment Strategy; (5) Automated tools for Monitoring Control Points (i.e. Configuration Items[5]) and; (6) Incident Management[6]. The software engineering management platform is also integrated with User Relationship Management to establish and maintain a proper feedback loop with our

The XrayFeed device of Karabo [1, 2] is designed to provide spatial X-ray beam stability in terms of drift compensation utilizing different diagnostic components at the European XFEL (EuXFEL). Our feedback systems proved to be indispensable in cutting-edge pump-probe experiments at EuXFEL. The feedback mechanism is based on a closed loop PID control algorithm [3] to steer the beam position measured by the so-called diagnostic devices to the desired centred position via defined actuator adjusting the alignment of Xray optical elements, in our case a flat X-ray mirror system. Several diagnostic devices and actuators can be selected according to the specific experimental area where a beam position feedback is needed. In this contribution, we analyze the improvement of pointing stability of X-rays using different diagnostic devices as an input source for our feedback system. Different types of photon diagnostic devices such as gas-based X-ray monitors [4], quadrant detectors based on avalanche photo diodes [5] and optical cameras imaging the X-ray footprint on scintillator screens have been evaluated in our pointing stability studies.