Ultrafast crystallography of light-induced processes can directly capture structural differences driven by short-pulse laser illumination. With short pump-probe observation time and short laser pulse durations, the electronic and nuclear dephasing times determine the extent and amplitude of third-order non-linear response in the measurements. While the third-order molecular response is unavoidable in ultrafast crystallography it is currently unknown to what extent non-linear optical excitation processes could contribute to the data. We present a separation of weak and strong response from pump-probe data of photoactive yellow protein crystals collected at a single laser power, based on a method of indexing transformation followed by optical crystallography. We show that this allows precise separation of the heterogeneous photochemical populations with a very high level of data correlation that is intrinsic from the methodology of serial crystallography data collection. This data correlation supports measurable crystallographic electron density differences for the cis-chromophore photoproduct at 3 ps delay comparing weak and strong interactions. While the resulting coordinate refinements are supported by these differences, their sub-Angstrom modifications are inconsequential when the RMS differences of displacements are considered at room temperature. We conclude that these minor crystallographic differences reflect the higher population and therefore signal-to-noise in the strong interaction dataset. Moreover, radical formation driven by excited state absorption, which is the dominating non-linear photoexcitation process under the conditions used, are not detected in high-quality and high-resolution TR-SFX of the photoactive yellow protein.

Myxobacteria are non-photosynthetic, soil-dwelling bacteria distinguished by a multicellular stage in their life cycle known as fruiting bodies that are stimulated by light. Myxobacterial phytochromes are candidates for the perception of red-light. The mechanism how light is perceived and converted to a physiological response is unknown. Here, time-resolved serial femtosecond crystallographic (TR-SFX) experiments were conducted on microcrystals of the photosensory core module of the Stigmatella aurantiaca bacteriophytochrome 2 (SaBphP2). Initial events of the Z to E isomerization reaction of the covalently bound, open-chain tetrapyrrole biliverdin (BV) chromophore were determined. At 3 ps after light activation, the BV ring-D assumes a configuration needed for the isomerization. At 100 ps, a mixture of BV in the Z or E configuration is observed in subunit A, while in the other subunit the chromophore remains in the Z configuration. In conjunction with prior results, these structures reveal the molecular mechanism of phytochrome activation in the photomorphogenesis of the myxobacteria and provide the molecular foundation for physiological responses to red light in other bacteria.

Advancements in synchrotron and X-ray free-electron sources and associated developments in instrumentation and techniques offer many new possibilities for researchers. At the same time there is increasing demand and pressure to implement the FAIR data principles by which data should be made Findable, Accessible, Interoperable and Reusable. The consortium DAPHNE4NFDI (DAta from PHoton and Neutron Experiments for NFDI) addresses this challenge within the German National Research Data Infrastructure (NFDI), and also in relation to European / worldwide initiatives. This article gives an overview of our activities and elaborates on our progress, showcasing developments in some of our use cases, including: (1) X-ray reflectivity (XRR), (2) X-ray photon correlation spectroscopy (XPCS) and (3) X-ray absorption spectroscopy (XAS).

Nanoparticles, exhibiting functionally relevant structural heterogeneity, are at the forefront of cutting-edge research. Now, high-throughput single-particle imaging (SPI) with x-ray free-electron lasers (XFELs) creates unprecedented opportunities for recovering the shape distributions of millions of particles that exhibit functionally relevant structural heterogeneity. To realize this potential, three challenges have to be overcome: (1) simultaneous parametrization of structural variability in real and reciprocal spaces; (2) efficiently inferring the latent parameters of each SPI measurement; (3) scaling up comparisons between $10^5$ structural models and $10^6$ XFEL-SPI measurements. Here, we describe how we overcame these three challenges to resolve the non-equilibrium shape distributions within millions of gold nanoparticles imaged at the European XFEL. These shape distributions allowed us to quantify the degree of asymmetry in these particles, discover a relatively stable `shape envelope' amongst nanoparticles, discern finite-size effects related to shape-controlling surfactants, and extrapolate nanoparticles' shapes to their idealized thermodynamic limit. Ultimately, these demonstrations show that XFEL SPI can help transform nanoparticle shape characterization from anecdotally interesting to statistically meaningful.

X-ray Free Electron Lasers (XFELs) allow the collection of high-quality serial femtosecond crystallography data. The next generation of megahertz superconducting FELs promises to drastically reduce data collection times, enabling the capture of more structures with higher signal-to-noise ratios and facilitating more complex experiments. Currently, gas dynamic virtual nozzles (GDVNs) stand as the sole delivery method capable of best utilizing the repetition rate of megahertz sources for crystallography. However, their substantial sample consumption renders their use impractical for many protein targets in serial crystallography experiments. Here, we present a novel application of a droplet-on-demand injection method, which allowed operation at 47 kHz at the European XFEL (EuXFEL) by tailoring a multi-droplet injection scheme for each macro-pulse. We demonstrate a collection rate of 150 000 indexed patterns per hour. We show that the performance and effective data collection rate are comparable to GDVN, with a sample consumption reduction of two orders of magnitude. We present lysozyme crystallographic data using the Large Pixel Detector at the femtosecond x-ray experiment endstation. Significant improvement of the crystallographic statistics was made by correcting for a systematic drift of the photon energy in the EuXFEL macro-pulse train, which was characterized from indexing the individual frames in the pulse train. This is the highest resolution protein structure collected and reported at the EuXFEL at 1.38 Å resolution.

Serial crystallography (SX) has become an established technique for protein structure determination, especially when dealing with small or radiation-sensitive crystals and investigating fast or irreversible protein dynamics. The advent of newly developed multi-megapixel X-ray area detectors, capable of capturing over 1000 images per second, has brought about substantial benefits. However, this advancement also entails a notable increase in the volume of collected data. Today, up to 2 PB of data per experiment could be easily obtained under efficient operating conditions. The combined costs associated with storing data from multiple experiments provide a compelling incentive to develop strategies that effectively reduce the amount of data stored on disk while maintaining the quality of scientific outcomes. Lossless data-compression methods are designed to preserve the information content of the data but often struggle to achieve a high compression ratio when applied to experimental data that contain noise. Conversely, lossy compression methods offer the potential to greatly reduce the data volume. Nonetheless, it is vital to thoroughly assess the impact of data quality and scientific outcomes when employing lossy compression, as it inherently involves discarding information. The evaluation of lossy compression effects on data requires proper data quality metrics. In our research, we assess various approaches for both lossless and lossy compression techniques applied to SX data, and equally importantly, we describe metrics suitable for evaluating SX data quality.

Serial crystallography (SX) is a cutting-edge technique in structural biology, involving the systematic collection of X-ray diffraction data from numerous randomly oriented microcrystals. To extract comprehensive three-dimensional information about the studied system, SX utilises thousands of measured diffraction patterns. As such, SX takes advantages of the properties of modern X-ray sources, including Free Electron Lasers (FELs) and third and fourth generation synchrotrons, as well as contemporary high-repetition-rate detectors. Efficient analysis of the extensive datasets generated during SX experiments demands fast and effective algorithms. The FDIP library offers meticulously optimised functions tailored for preprocessing data obtained in SX experiments. This encompasses tasks such as background subtraction, identification and masking of parasitic streaks, elimination of unwanted powder diffraction (e.g., from ice or salt crystals), and pinpointing useful Bragg peaks in each diffraction pattern. The library is equipped with a user-friendly graphical interface for facile parameter adjustment tailored to specific datasets. Compatible with popular SX processing software like OnDA, Cheetah, CrystFEL, and Merge3D, the FDIP library enhances the capabilities of these tools for streamlined and precise serial crystallography analyses.

Presented and discussed here is the implementation of a software solution that provides prompt X-ray diffraction data analysis during fast dynamic compression experiments conducted within the dynamic diamond anvil cell technique. It includes efficient data collection, streaming of data and metadata to a high-performance cluster (HPC), fast azimuthal data integration on the cluster, and tools for controlling the data processing steps and visualizing the data using the DIOPTAS software package. This data processing pipeline is invaluable for a great number of studies. The potential of the pipeline is illustrated with two examples of data collected on ammonia–water mixtures and multiphase mineral assemblies under high pressure. The pipeline is designed to be generic in nature and could be readily adapted to provide rapid feedback for many other X-ray diffraction techniques, e.g. large-volume press studies, in situ stress/strain studies, phase transformation studies, chemical reactions studied with high-resolution diffraction etc.

An aerodynamic lens injector was developed specifically for the needs of single-particle diffractive imaging experiments at free-electron lasers. Its design allows for quick changes of injector geometries and focusing properties in order to optimize injection for specific individual samples. Here, we present results of its first use at the FLASH free-electron-laser facility. Recorded diffraction patterns of polystyrene spheres are modeled using Mie scattering, which allowed for the characterization of the particle beam under diffractive-imaging conditions and yield good agreement with particle-trajectory simulations.

We report on ongoing discussions and plans of NFDI consortia in physics and reltated natural sciences with respect to (persistent) identifiers.

For decades, researchers have been determined to elucidate essential enzymatic functions on the atomic lengths scale by tracing atomic positions in real time. Our work builds on new possibilities unleashed by mix-and-inject serial crystallography (MISC) 1-5 at X-ray free electron laser facilities. In this approach, enzymatic reactions are triggered by mixing substrate or ligand solutions with enzyme microcrystals 6 . Here, we report in atomic detail and with millisecond time-resolution how the Mycobacterium tuberculosis enzyme BlaC is inhibited by sulbactam (SUB). Our results reveal ligand binding heterogeneity, ligand gating 7-9 , cooperativity, induced fit 10,11 and conformational selection 11-13 all from the same set of MISC data, detailing how SUB approaches the catalytic clefts and binds to the enzyme non-covalently before reacting to a trans- enamine. This was made possible in part by the application of the singular value decomposition 14 to the MISC data using a newly developed program that remains functional even if unit cell parameters change during the reaction.

The DAPHNE4NFDI and PUNCH4NFDI consortia represent the large scale facilities in the German physical sciences community. Work in DAPHNE4NFDI and PUNCH4NFDI is characterised by the use of large-scale research infrastructures – reactors, light sources, accelerators, telescopes, observatories, satellites – that serve international research communities of up to several thousand users and produce data in the terrabyte, often petabyte and in future exabyte range. The communities will have to master massive challenges in data management, building on and extending their leadership in “big data” management, distributed computing, multi-user management, and data loss / data irreversibility issues.

Irradiation of solid surfaces with intense ultrashort laser pulses represents a unique way of depositing energy into materials. It allows to realize states of extreme electronic excitation and/or very high temperature and pressure, and to drive materials close to and beyond fundamental stability limits. As a consequence, structural changes and phase transitions often occur along unusual pathways and under strongly non-equilibrium conditions. Due to the inherent multiscale nature - both temporally and spatially - of these irreversible processes their direct experimental observation requires techniques that combine high temporal resolution with the appropriate spatial resolution and the capability to obtain good quality data on a single pulse/event basis. In this respect fourth generation light sources, namely short wavelength, short pulse free electron lasers (FELs) are offering new and fascinating possibilities. As an example, this chapter will discuss the results of scattering experiments carried at the FLASH free electron laser at DESY (Hamburg, Germany), which allowed us to resolve laser-induced structure formation at surfaces on the nanometer to sub-micron length scale and in temporal regimes ranging from picoseconds to several nanoseconds with sub-picosecond resolution.

The photoisomerization reaction of a fluorescent protein chromophore occurs on the ultrafast timescale. The structural dynamics that result from femtosecond optical excitation have contributions from vibrational and electronic processes and from reaction dynamics that involve the crossing through a conical intersection. The creation and progression of the ultrafast structural dynamics strongly depends on optical and molecular parameters. When using X-ray crystallography as a probe of ultrafast dynamics, the origin of the observed nuclear motions is not known. Now, high-resolution pump–probe X-ray crystallography reveals complex sub-ångström, ultrafast motions and hydrogen-bonding rearrangements in the active site of a fluorescent protein. However, we demonstrate that the measured motions are not part of the photoisomerization reaction but instead arise from impulsively driven coherent vibrational processes in the electronic ground state. A coherent-control experiment using a two-colour and two-pulse optical excitation strongly amplifies the X-ray crystallographic difference density, while it fully depletes the photoisomerization process. A coherent control mechanism was tested and confirmed the wave packets assignment.

One of the outstanding analytical problems in X-ray single-particle imaging (SPI) is the classification of structural heterogeneity, which is especially difficult given the low signal-to-noise ratios of individual patterns and the fact that even identical objects can yield patterns that vary greatly when orientation is taken into consideration. Proposed here are two methods which explicitly account for this orientation-induced variation and can robustly determine the structural landscape of a sample ensemble. The first, termed common-line principal component analysis (PCA), provides a rough classification which is essentially parameter free and can be run automatically on any SPI dataset. The second method, utilizing variation auto-encoders (VAEs), can generate 3D structures of the objects at any point in the structural landscape. Both these methods are implemented in combination with the noise-tolerant expand-maximize-compress (EMC) algorithm and its utility is demonstrated by applying it to an experimental dataset from gold nanoparticles with only a few thousand photons per pattern. Both discrete structural classes and continuous deformations are recovered. These developments diverge from previous approaches of extracting reproducible subsets of patterns from a dataset and open up the possibility of moving beyond the study of homogeneous sample sets to addressing open questions on topics such as nanocrystal growth and dynamics, as well as phase transitions which have not been externally triggered.

Multimeric protein assemblies are abundant in nature. Streptavidin is an attractive protein that provides a paradigm system to investigate the intra- and intermolecular interactions of multimeric protein complexes. Also, it offers a versatile tool for biotechnological applications. Here, we present two apo-streptavidin structures, the first one is an ambient temperature Serial Femtosecond X-ray crystal (Apo-SFX) structure at 1.7 Å resolution and the second one is a cryogenic crystal structure (Apo-Cryo) at 1.1 Å resolution. These structures are mostly in agreement with previous structural data. Combined with computational analysis, these structures provide invaluable information about structural dynamics of apo streptavidin. Collectively, these data further reveal a novel cooperative allostery of streptavidin which binds to substrate via water molecules that provide a polar interaction network and mimics the substrate biotin which displays one of the strongest affinities found in nature.

AbstractFor decades, researchers have been determined to elucidate essential enzymatic functions on the atomic lengths scale by tracing atomic positions in real time. Our work builds on new possibilities unleashed by mix-and-inject serial crystallography (MISC)1-5at X-ray free electron laser facilities. In this approach, enzymatic reactions are triggered by mixing substrate or ligand solutions with enzyme microcrystals6. Here, we report in atomic detail and with millisecond time-resolution how theMycobacterium tuberculosisenzyme BlaC is inhibited by sulbactam (SUB). Our results reveal ligand binding heterogeneity, ligand gating7-9, cooperativity, induced fit10,11and conformational selection11-13all from the same set of MISC data, detailing how SUB approaches the catalytic clefts and binds to the enzyme non-covalently before reacting to atrans-enamine. This was made possible in part by the application of the singular value decomposition14to the MISC data using a newly developed program that remains functional even if unit cell parameters change during the reaction.

The European X-ray Free Electron Laser (XFEL) and Linac Coherent Light Source (LCLS) II are extremely intense sources of X-rays capable of generating Serial Femtosecond Crystallography (SFX) data at megahertz (MHz) repetition rates. Previous work has shown that it is possible to use consecutive X-ray pulses to collect diffraction patterns from individual crystals. Here, we exploit the MHz pulse structure of the European XFEL to obtain two complete datasets from the same lysozyme crystal, first hit and the second hit, before it exits the beam. The two datasets, separated by <1 µs, yield up to 2.1 Å resolution structures. Comparisons between the two structures reveal no indications of radiation damage or significant changes within the active site, consistent with the calculated dose estimates. This demonstrates MHz SFX can be used as a tool for tracking sub-microsecond structural changes in individual single crystals, a technique we refer to as multi-hit SFX.

Serial femtosecond crystallography (SFX) is a powerful technique that exploits X-ray free-electron lasers to determine the structure of macromolecules at room temperature. Despite the impressive exposition of structural details with this novel crystallographic approach, the methods currently available to introduce crystals into the path of the X-ray beam sometimes exhibit serious drawbacks. Samples requiring liquid injection of crystal slurries consume large quantities of crystals (at times up to a gram of protein per data set), may not be compatible with vacuum configurations on beamlines or provide a high background due to additional sheathing liquids present during the injection. Proposed and characterized here is the use of an immiscible inert oil phase to supplement the flow of sample in a hybrid microfluidic 3D-printed co-flow device. Co-flow generation is reported with sample and oil phases flowing in parallel, resulting in stable injection conditions for two different resin materials experimentally. A numerical model is presented that adequately predicts these flow-rate conditions. The co-flow generating devices reduce crystal clogging effects, have the potential to conserve protein crystal samples up to 95% and will allow degradation-free light-induced time-resolved SFX.