Screening of nucleic acid synthesis orders is expanding to include short, single-stranded DNA orders in efforts to ensure potentially harmful genes and genomes cannot be synthesized by illegitimate or irresponsible customers. Short sequence fragments are not as information rich as gene sequences, typically require assembly to be functional, and are much cheaper to produce than genes. Thus, here we provide the perspective that the screening of sequence fragments requires a different approach than sequence-by-sequence screening by considering the context of other fragments in the order or across orders. Additional and alternative metrics should be included while screening fragments, such as fraction of the gene/genome covered and evidence of potential use for assembly to enable efficient and accurate biosecurity screening. We further demonstrate two existing biosecurity tools, UltraQUICK and Aclid that provide outputs for better understanding the threat of orders containing fragments. This perspective provides a foundation for how short DNA fragments, including oligo pools, should be screened and leaves the reader with considerations for overall risk assessments of such orders based on the functional and taxonomic characteristics of the order.
Synthetic nucleic acids are a key input to modern biotechnology, yet they represent dual-use materials that require robust screening to mitigate biosecurity risks. The prevailing screening paradigm, which identifies sequences of concern (SoCs) through sequence similarity to controlled pathogens and toxins, may not fully capture risks posed by AI tools that can decouple biomolecular function from reliance on known sequences. Rapidly advancing biodesign capabilities enable the generation of genes and proteins that might evade sequence-based detection. We highlight the critical need for function-based screening approaches that can detect sequences capable of hazardous biological functions, regardless of similarity to known SoCs. We examine the feasibility of function-based screening with an initial focus on proteins, arguing that, while protein sequence space is vast, biologically functional proteins are significantly constrained by biophysical and biochemical requirements that can be learned and modeled. We propose a concrete implementation framework organized along a continuum of complexity, starting with toxins as the most tractable targets before expanding to more complex pathogenic functions. We then discuss open challenges and describe a research and development strategy to address them.
Readily available nucleic acid synthesis is both critical for the bioeconomy and an increasingly pressing security concern due to the potential for accidental or deliberate misuse. While biosecurity experts broadly agree that nucleic acid providers should screen orders for potential “sequences of concern,” there has previously been no agreed standard for how to define and recognize such sequences. To address this gap, we first organized a collection of test sets containing 1.1 million sequences from pathogens and toxins on the Australia Group Common Control Lists and their non-controlled relatives, along with model organisms and synthetic constructs. An initial categorization of sequences as to whether or not they were sequences of concern was produced by comparing the results of four biosecurity screening systems for each of these sequences, finding that these systems already agreed on the categorization of more than 80% of sequences. We then refined these results through a science-based stakeholder review process to define a rubric for determining whether a sequence should be flagged as a potential sequence of concern, then applied this rubric to improve the categorization of sequences in test sets. The result is a rubric that identifies sequences of concern with respect to human pandemic-potential viruses, key classes of low-risk genes, and controlled toxins. Applying this rubric to the test set collection has, to date, reduced the number of test sequences with disputed categorization by 44.3% for controlled viruses and 10.7% across the collection of test sets as a whole. Together, the rubric and the test sets provide a concrete “sequence of concern” definition that can be used as a foundation for development of biosecurity screening standards and policy and is also continuing to be refined in ongoing work.
Rapid advancements in AI have enabled significant progress in protein and nucleic acid design, but they also pose biosecurity challenges. We examine the vulnerabilities of biosecurity screening software (BSS) to AI-reformulated synthetic homologs of proteins of concern (POCs) that have been fragmented into smaller segments. We evaluate four BSS tools that were recently patched to enhance their AI resiliency. Without any further modification, we found that two of the four tools were capable of robustly detecting fragments as short as 50 nucleotides, demonstrating screening capabilities that exceed those requested in the United States Framework for Nucleic Acid Synthesis. Upgraded versions of the other two tools improved performance. Although our findings confirm the effectiveness of the tested BSS tools, at the same time, they emphasize the urgency of developing alternate BSS approaches to counter evolving AI-enabled biosecurity risks.
Advances in artificial intelligence (AI)-assisted protein engineering are enabling breakthroughs in the life sciences but also introduce new biosecurity challenges. Synthesis of nucleic acids is a choke point in AI-assisted protein engineering pipelines. Thus, an important focus for efforts to enhance biosecurity given AI-enabled capabilities is bolstering methods used by nucleic acid synthesis providers to screen orders. We evaluated the ability of open-source AI-powered protein design software to create variants of proteins of concern that could evade detection by the biosecurity screening tools used by nucleic acid synthesis providers, identifying a vulnerability where AI-redesigned sequences could not be detected reliably by current tools. In response, we developed and deployed patches, greatly improving detection rates of synthetic homologs more likely to retain wild type-like function.
Advances in machine learning are providing new abilities for engineering biology, promising leaps forward with beneficial applications. At the same time, these advances raise concerns about biosecurity. Recently, Wittmann et al . described an in silico pipeline of generative AI tools to demonstrate how amino acid sequences encoding sequences of concern (SOCs) could be reformulated as synthetic homologs that may evade detection by biosecurity screening software (BSS) used by nucleic acid synthesis providers. While the discovered vulnerability has been mitigated, its true severity remains unclear, as the study was performed without experimental testing of the synthetic homologs. Here, we present a testing, evaluation, validation, and verification (TEVV) framework for AI-assisted protein design (AIPD), using safe proteins as SOC proxies. Our findings indicate AIPD can generate synthetic homologs whose predicted structures are similar to a native template, but without necessarily retaining activity. We determine that current AIPD systems are not yet powerful enough to reliably rewrite the sequence of a given protein, while both maintaining activity and evading detection by BSS. We further conclude that TEVV of generated sequences requires significant investment of time, technical skill, and resources. We offer our framework and test proteins as a general benchmark of AIPD capability. ### Competing Interest Statement B.J.W and E.H. are based at an organization that is engaged with research, development, and fielding of AI technologies, including AI-assisted protein design. J.D. is based at a DNA synthesis company, which provided services for this study.
Screening synthetic nucleic acid orders for sequences of concern is a necessary part of a healthy biosecurity regime, but it exacts costs for nucleic acid providers. Taxonomy is and will remain a critical part of the decision-making process for screening, especially for viral sequences. But, moving forward, the function of a sequence will also be determinative of its level of concern, or lack thereof. Stakeholders continue to debate which functions are "of concern." However these are ultimately adjudicated, nonviral sequences with unknown or hypothetical functions which, by definition, can bear no resemblance to sequences with concerning functions, must be considered innocent of harmful effects. To qualify as a nonviral sequence of concern, the sequence to which it is the best match must be demonstrated in the published literature to have a function of concern.
Introduction: Affordable and accurate nucleic acid synthesis is foundational to modern biotechnology, but raises security concerns because it facilitates the construction of pathogens and other potentially dangerous biological agents. Nucleic acid synthesis screening can reduce the risk of providing potentially harmful nucleic acids to those without a legitimate use for them. Governments, industry associations, and biosecurity organizations have offered guidance on synthesis screening for a decade, and are now considering how to translate industry best practices into regulatory frameworks.Methods: A review of existing guidance documents, policy proposals, and other published literature was performed.Results: We distinguish five categories of practical questions for policymakers: challenges associated with customer screening, sequence screening, the interaction between domestic and global regulations, commercial implications of screening, and finally, challenges associated with benchtop nucleic acid synthesis devices. There are a number of recommendations in public literature that target the implementation of robust customer and sequence screening, several of which have been incorporated into the recent United States White House Executive Order on artificial intelligence. There appears to be fewer solutions proposed to address challenges associated with the global screening landscape, or the commercial implications of screening requirements, and limited discussion on securing the benchtop synthesis landscape.Discussion and Conclusion: This paper aims at providing a comprehensive resource for policymakers, outlining a set of questions governments, and other stakeholders, must answer when implementing screening requirements to secure nucleic acid synthesis.
Fast-moving advances in AI-assisted protein engineering are enabling breakthroughs in the life sciences that promise numerous beneficial applications. At the same time, these new capabilities are creating potential biosecurity challenges by providing new pathways to intentional or accidental synthesis of genes that encode hazardous proteins. The synthesis of nucleic acids is a key choke point in the AI-assisted protein engineering pipeline as it is where digital designs are transformed into physical instructions that can produce potentially harmful proteins. Thus, one focus for efforts to enhance biosecurity in the face of new AI-enabled capabilities is on bolstering the screening of orders by nucleic acid synthesis providers. We describe a multistakeholder, cross-sector effort to address biosecurity challenges with uses of AI-powered biological design tools to reformulate naturally occurring proteins of concern to create synthetic homologs that have low sequence identity to the wild-type proteins. We evaluated the abilities of traditional nucleic acid biosecurity screening tools to detect these synthetic homologs and found that, of tools tested, not all could previously detect such AI-redesigned sequences reliably. However, as we report, patches were built and deployed to improve detection rates over the course of the project, resulting in a final mean detection rate over tools of 97% of the synthetic homologs that were determined, using in-silico metrics, to be more likely to retain wild-type-like function. Finally, we make recommendations on approaches for studying and addressing the rising risk of adversarial AI-assisted protein engineering attacks like the one we identified and worked to mitigate. ### Competing Interest Statement B.J.W and E.H. are based at an organization that is engaged with research, development, and fielding of AI technologies, including AI-assisted protein engineering technologies. A.C and J.D. are based at DNA synthesis companies. T.A., C.B., J.B., K.F., B.G., T.M., S.T.M., and N.W. are affiliated with institutions that build and deploy biosecurity screening software.
Objectives: The primary objectives of this study were to develop an objective nucleic acid sequence screening framework and to leverage the framework for an empirical sensitivity study that measures the impact of ambiguities in regulatory and guidance documentation regarding the control of synthetic nucleic acids and screening of nucleic acid orders.Methods: Foundational risk levels were constructed using the bioinformatic sequencing screening tool UltraSEQ. The risk levels range from high (corresponding to regulated sequences) to low (corresponding to nonregulated sequences of concern) to no-risk. A representative sequence data set (141,651 sequences) was constructed from publicly available synthetically derived sequences, and the percentage sequences in each risk level was determined, followed by the impact of changing key UltraSEQ parameters.Results: The results of this study show that no-risk sequences represent 90-92% of sequences, and nonregulated sequences of concern represented 7-9% of the sequences regardless of the parameters. The parameter with the biggest impact on the number of sequences flagged was the minimum hit homology level, followed by minimum sequence region length, and finally uniqueness of the hit to a select agent sequence.Conclusion: The results of this empirical study provide a greater understanding for gene synthesis providers, biosafety and biosecurity practitioners, and the scientific community regarding the impact of various interpretations of regulatory and guidance documentation. The risk level framework provides a foundation to build upon for nucleic acid sequence screening as the threat landscape evolves. However, additional development is needed to build tools that connect predictions across sequences and orders to provide contextual risk-based predictions.
To enhance the safety and security of the US bioeconomy, a new public–private partnership should be established to facilitate information sharing and threat analysis among industry, government and academia, and to develop and deploy safeguards.
Objective: DNA synthesis companies screen orders to detect controlled sequences with misuse risks. Assessing screening accuracy is challenging owing to the breadth of biological risks and ambiguities in risk definitions. Here, we detail an International Gene Synthesis Consortium working group's rationale and process to develop a prototype DNA synthesis screening test dataset, aiming to establish a baseline of screening system accuracy to compare with various screening approaches.Methodology: Construction of the prototype test dataset involved four tool developers screening nucleic acid sequences from three taxonomic clusters of controlled organisms (Orbivirus, Francisella tularensis, and Coccidioides). Results were mapped onto predefined, comparable categories, checking for consensus or conflicts. Conflicts were grouped based on gene annotation and resolved through discussion.Results: The process highlighted several long-standing challenges in DNA synthesis screening, including the qualitative differences in approaches taken by screening tools. Our findings highlight the lack of clarity in assessing pathogen sequences with respect to regulatory control language, compounded by scientific uncertainty. We illustrate the current degree of consensus and existing challenges using classification statistics and specific examples.Conclusions and Next Steps: This prototype underscores the necessity of expert-regulator coordination in assessing gene-associated risks, offering a template for creating test sets across all taxonomic groups on international control lists. Expanding the working group would enrich dataset comprehensiveness, enabling a transition from species-focused to function-focused regulatory controls. This sets the foundation for quality control, certification, and improved risk assessment in DNA synthesis screening.
Biomanufacturing practitioners and researchers describe the norms that should govern the growing, global field, to include safety, security, sustainability, and social responsibility. These '4S Principles' should be broadly adopted so that the future of the field may provide the greatest benefits to society.
Technologies to profoundly engineer biology are becoming increasingly affordable, powerful, and accessible to a widening group of actors. While offering tremendous potential to fuel biological research and the bioeconomy, this development also increases the risk of inadvertent or deliberate creation and dissemination of pathogens. Effective regulatory and technological frameworks need to be developed and deployed to manage these emerging biosafety and biosecurity risks. Here, we review digital and biological approaches of a range of technology readiness levels suited to address these challenges. Digital sequence screening technologies already are used to control access to synthetic DNA of concern. We examine the current state of the art of sequence screening, challenges and future directions, and environmental surveillance for the presence of engineered organisms. As biosafety layer on the organism level, we discuss genetic biocontainment systems that can be used to created host organisms with an intrinsic barrier against unchecked environmental proliferation.
Health SecurityAhead of Print CommentaryOpen AccessCreative Commons licenseBeyond Biosecurity by Taxonomic Lists: Lessons, Challenges, and OpportunitiesPiers Millett, Tessa Alexanian, Kathryn R. Brink, Sarah R. Carter, James Diggans, Megan J. Palmer, Ryan Ritterson, Jonas B. Sandbrink, and Nicole E. WheelerPiers MillettAddress correspondence to: Piers Millett, International Biosecurity and Biosafety Initiative for Science, 1776 I Street NW, Suite 600, Washington, DC 20006 E-mail Address: [email protected]Piers Millett, PhD, is Executive Director, International Biosecurity and Biosafety Initiative for Science, Washington, DC.Search for more papers by this author, Tessa AlexanianTessa Alexanian is Safety and Security Program Officer, iGEM Foundation, Paris, France.Search for more papers by this author, Kathryn R. BrinkKathryn R. Brink, PhD, is a Postdoctoral Fellow, Center for International Security and Cooperation, at Stanford University, Stanford, CA.Search for more papers by this author, Sarah R. CarterSarah R. Carter, PhD, is Principal, Science Policy Consulting LLC, Arlington, VA.Search for more papers by this author, James DiggansJames Diggans, PhD, is Head of Biosecurity, Twist Bioscience, San Francisco, CA.Search for more papers by this author, Megan J. PalmerMegan J. Palmer, PhD, is Executive Director of Bio Policy & Leadership Initiatives and an Adjunct Professor, Department of Bioengineering; at Stanford University, Stanford, CA.Search for more papers by this author, Ryan RittersonRyan Ritterson, PhD, is Executive Vice President of Research, Gryphon Scientific LLC, Takoma Park, MD.Search for more papers by this author, Jonas B. SandbrinkJonas B. Sandbrink is a Doctoral Researcher, Nuffield Department of Medicine, University of Oxford, Oxford, United Kingdom.Search for more papers by this author, and Nicole E. WheelerNicole E. Wheeler, PhD, is a Turing Fellow, Institute of Microbiology and Infection, University of Birmingham, Birmingham, United Kingdom.Search for more papers by this authorPublished Online:19 Oct 2023https://doi.org/10.1089/hs.2022.0109AboutSectionsPDF/EPUB Permissions & CitationsDownload CitationsTrack CitationsAdd to favorites Back To Publication ShareShare onFacebookTwitterLinked InRedditEmail IntroductionTaxonomic lists—that is, lists that give a set of species (eg, Yersinia pestis) or broader taxonomic groups (eg, SARS-related coronavirus) to be regulated—are a common tool used within biosecurity regimes for controlling access to pathogenic organisms and toxins. However, these lists are both too specific and too ambiguous for many of the uses to which they are applied. Their use is based on an assumption that taxonomy can be directly linked to biological function; however, other approaches, such as sequence lists or tools that predict function, may be more suitable to capture biological functions that cause concern. We are not the first to notice the problems with taxonomic lists; their shortcomings have been highlighted for over a decade.1-4We now have a wealth of experience in using taxonomic lists. Advances in biological engineering have both further strained taxonomy-based control systems and offered new alternatives to them. For example, in their 2010 report,3 the US National Academy of Sciences noted that a system for predicting risk—a combination of the probability of harm occurring and the severity (consequences) of that harm, if it were to occur5—from genetic data was not possible then or in the "usefully near future." We believe things have changed. Two US Intelligence Advanced Research Projects Activity programs—Functional Genomic and Computational Assessment of Threats (FunGCAT)6 and Finding Engineering-Linked Indicators7—have provided a drive toward functional prediction based on sequence, which is being applied directly to commercial DNA synthesis screening.8 Recent advances in protein structure prediction, combined with advances in generative models and high-throughput screening, promise to usher in a new era of protein design and formally remove the previously reliable assumption of a link between taxonomic origin and biological function.9-11Recent policies and guidance have attempted to encode broad principles in place of taxonomic lists. At the international level, the latest World Health Organization Laboratory Biosafety Manual12 focuses on broad risk assessment* over taxonomic classification.13 However, at the national or institutional level, lists of species remain a common starting point for risk management.†14-16 The US Recommended Policy Guidance for Departmental Development of Review Mechanisms for Potential Pandemic Pathogen Care and Oversight17 covers any research that is "reasonably anticipated to create, transfer or use potential pandemic pathogens resulting from the enhancement of a pathogen's transmissibility and/or virulence in humans."18 Several challenges with these policy experiments have already emerged, such as ambiguous scope,19 disagreements on what their text means in practice (eg, the term "endow or enhance pathogenicity" in export control rules20), a need for greater transparency in decisionmaking,21 and guidance on responsible communication.22We do not advocate abandoning taxonomic lists entirely. Taxonomic lists are an excellent tool for controlling access to whole organisms, which is necessary for export controls20,23 and when possession of certain agents has been criminalized.24,25 They can also have implications for the practical implementation of other policies where the best control point is a whole organism. However, modern biotechnology increasingly makes use of parts of organisms to confer new traits to species, sometimes making the origin species of a single part a poor (or even misleading) proxy for risk assessment. New, complementary tools are needed.We believe that taxonomic lists become less useful when used beyond their intended context. Although they were originally created to control physical access to organisms, taxonomic lists have been integrated into broader biosecurity policies and risk management processes. For example, gene synthesis screening routinely uses taxonomic classification as a core element of risk assessment. Commercial providers of DNA synthesis have noted the challenges of implementing taxonomy-based regulations for sequence-based products.26,27 Ascertaining whether a given order matches something to be controlled is difficult even for the most qualified companies. Taxonomic lists have also been used as a tool to narrow oversight of relevant biological research. For instance, although US dual use research of concern policies are intended to consider more indirect scenarios of misuse, including generation of "knowledge, information, products, or technologies,"28 the scope of the oversight is restricted to specific types of experiments, with a specific set of pathogens on a taxonomic list. This scope may not be a good fit for the work that warrants oversight; more than two-thirds of life scientists who declared that their work featured "dual-use potential" in a 2009 survey would not fall into the policy's scope.29In this commentary, we highlight some of the challenges encountered with taxonomic lists in practice. We explore opportunities to make them more effective. We also stress the importance, and attempt an initial discussion, of how we might move beyond taxonomic lists to meet an evolving landscape of safety and security needs.A More Structured Approach to Designing Biosecurity RegimesToo often, we use taxonomic lists because policymakers and regulators are familiar with them, but they need not be the default option. Not all policy purposes will require taxonomic lists, and we argue for a more deliberative approach (Figure).Figure. Tools for effective biosecurity policies. The goal and scope of a given regulation are a political decision. Once a scope has been set, regulators need to define the target objects with what functions should be targeted. What research objects feature these functions and are thus regulated can be defined using different tools.The first step in developing a biosecurity regime should be a thorough understanding of its goals. What does the regime intend to accomplish? Is the goal to control access to particular materials, such as those likely to harm human health? Alternatively, the goal might be to control certain criminal uses of materials. Presumably, in all cases, the intent is also to avoid unintentionally impeding or unnecessarily restricting open, reproducible, and beneficial science and engineering. A regime that can articulate the ultimate goals and their underlying logic and principles is more likely to be able to be updated as assumptions are checked and revisited.A second step is to translate the goals of the regime into biological functions to be controlled. A simple example is the goal of controlling pathogens that cause certain diseases, where the function to control is causing the disease. A more complex goal is controlling pathogens that meet thresholds for environmental stability, transmissibility, or virulence or for which vaccines and therapeutics do not exist. This goal recognizes the possibility of novel pathogens emerging that have similar biological properties to those known today. An even broader goal is to manage potential harms other than disease, such as those from gene drives (where the function would be to alter the inheritance of a certain trait) or antimateriel agents (where the function might be, for example, breaking down electronics). We assume that any regime's goal will focus on a subset of biological functions that pose a high risk of harm. This exempts other biological functions from control, thereby minimizing any undue impact on biological research and development.The final phase is to identify which tools are best suited to the functions to be controlled. For example, a taxonomic list would be suited to a regime intended to control access to certain pathogens and to make their unauthorized possession a crime. By contrast, a regime aiming to control access to certain biological functions may need different tools, such as sequence databases. Recent efforts, such as FunGCAT,6 Secure DNA,30 SeqScreen,31 and the Common Mechanism for DNA Synthesis Screening,32 demonstrate the feasibility of compiling such databases. Emerging algorithms to predict function from sequence may be adopted when it becomes necessary to control access to genetic elements from novel or engineered sequences. We have identified a series of general rules when using any type of lists in these tools (Box).Biosecurity regimes developed for different purposes in different locations by different institutions or by different communities will need different types of tools. Some tools may already exist (eg, taxonomic lists). Other tools (eg, sequence databases) may have been created for other purposes and may need to be reconfigured or curated for use in biosecurity regimes.27 Some tools needed by biosecurity regimes are not yet fully developed (eg, algorithms to identify harmful functions from primary DNA or protein sequences). When developing tools, it is vital to take into account the need to avoid unduly impeding biological research and development and to manage any information hazards generated.Improving Taxonomic ListsThere are at least 5 ways that taxonomic lists might be improved to increase and potentially extend their utility. Some of these would help address how we capture pathogenicity and virulence. Others will help address harms beyond traditional definitions of disease to address environmental disruption of antimaterial applications.Conduct More Regular and Structured UpdatesTaxonomic lists must be regularly updated to respond to the emergence of novel pathogens, scientific discoveries, advances in engineering capabilities, and geopolitical factors that may impact threat models for misuse. Yet, in practice, policy updates can be slow to materialize. For example, a version of Bacillus cereus that features 2 plasmids similar to those determining the pathogenicity of Bacillus anthracis and causes anthrax-like disease was identified in 2010.33,34 Although most B cereus strains are not of concern, this strain, B cereus serovar anthracis, includes the concerning spore-forming and toxin-producing properties of B anthracis. Six years after this discovery, in 2016, the US Select Agents and Toxins List25 expanded to also capture "anthrax-like B cereus."35 Many other taxonomy-based control lists have still not been updated to capture this pathogen, highlighting the importance of approaches and regimes that can be updated in a timely manner.20,36Include Functional EquivalenceThose responsible for maintaining taxonomic-based lists should commit to including functionally equivalent pathogens. This should be accompanied by annotating in their lists the criteria for the inclusion or exclusion of pathogens as well as the policy goals. This will make it easier to identify other pathogens that meet the same criteria based on functional equivalency. B cereus serovar anthracis is also a useful example of functional equivalency.Including pathogens via functional equivalency could pose certain challenges. Including functional equivalence should not be used beyond control of whole organisms because it can be difficult, if not impossible, to link individual genetic elements as necessary or sufficiently causative of observed functional equivalency. In addition, including functional equivalence will require careful review for information hazards, for example, avoiding the publication of novel threat applications when explaining why a function is being included.Box. General Guidelines for the Use of Lists Within Biosecurity Regimes1.Determine whether a list of specific biological materials, a list of functions, or a set of broad principles is more appropriate for a given context. Lists of biological organisms or sequences are useful tools for contexts in which narrow and specific reference to controlled agents is required, for instance for law enforcement. However, such lists only capture known concerns. Thus, in settings where novel risks are meant to be anticipated, lists of functions or sets of broader principles rather than lists of specific biological materials may be better suited to guide decisionmaking.2.Clearly state whether a list is meant to be illustrative or exhaustive. Better contexts around lists and their underlying principles need to be built. For a given list and underlying principles, it needs to be clear whether a list is solely indicative of the underlying principle or is exhaustive.3.Regularly update lists based on new evidence. A transparent process for regular, evidence-based updating of lists is required to address novel risks and changing circumstances. There is a need to develop processes to remove items from these lists; for example, when new vaccines or therapeutics become available or when a potentially pandemic pathogen becomes a pandemic pathogen.4.Determine triggers for updating. More work could be done to identify biological components and/or combinations of components that create risk. These, in turn, could be used to identify and update lists for novel threats, including traditional lists of pathogens. For example, a list of potential pandemic pathogens could be automatically updated if an agent was found to exhibit a given human receptor binding affinity and lack of preexisting population immunity.5.Facilitate legitimate science. Biosecurity tools that better match the potential to cause harm, and that are tailored for use with parts rather than whole organisms, tailored specifically for the purposes to which they are put, and updated continuously to keep pace with scientific understanding should reduce the restrictions or oversight burdens on scientists and researchers, compared with current approaches. Improving the fit between biosecurity tools and the concerns they are meant to address should facilitate legitimate science and not further restrict it.Adapt Taxonomic Lists to Consider Ease of EngineeringThe misuse potential of pathogens depends not only on their inherent pathogenicity but also on whether they might be engineered to do additional harm. As a result, it may be desirable to use taxonomy-based lists to identify not just pathogens, but also which pathogens may be more readily misused because they are easier to work with or to engineer.37 For example, additional biosecurity oversight may be warranted for viruses with smaller genomes or those that are easier to "boot up" from naked genetic material to infectious agent. Our understanding of the science that underpins this is evolving rapidly. It will be vital that any oversight measures that consider the ease of engineering will need to be highly adaptive—they will need continual review and updating, as well as clear definitions and thresholds for what is meant by "ease" of engineering and how that ease is linked to increased risk of harm.Clarify Language Used in Taxonomic ListsTaxonomic lists that define entries too broadly may unintentionally capture organisms that pose little potential for harm. For instance, a hypothetical list entry for "influenza A viruses" would group together both viruses with human pandemic potential and strains with mild transmissibility. This capturing of unintended strains may inadvertently hinder public health research. For instance, Australia Group export controls and national export controls outside the United States extend to "SARS-related coronaviruses," potentially restricting researcher access to SARS-CoV-2 at a time when the virus was widely circulating in human populations and when countermeasure development was sorely needed. Clarifying the language used in taxonomic lists may assist implementers of biosecurity controls. For example, clarification as to whether SARS-CoV-2 is a "SARS-related coronavirus" for the purpose of export control has been made in some settings, such as by the US Department of Commerce, but is missing in other settings, such as the Australia Group common control lists.38To avoid capturing large numbers of pathogens not relevant to biosecurity controls, some taxonomic lists have already had to develop additional criteria to focus controls beyond taxonomy. For example, attenuated strains used in many traditional vaccines have substantially different properties than their ancestors but still fall into the same taxonomic group. This has required clarification of rules. For example, the US Federal Select Agent Program features an avenue to apply for exclusions of attenuated strains of select agents, but these exclusions are granted on a case-by-case basis without clear guidelines that would enable automatic exclusion rather than review by the regulator.Taxonomic lists that define entries too narrowly can fail to capture organisms that pose a harm equivalent to those listed. For example, the US Select Agent and Toxins list does not extend to all influenza A viruses but only captures 2 of its members ("1918 reconstructed influenza" and "highly pathogenic avian influenza viruses").‡39 These rules have failed to capture other related viruses that may pose similar harms. For example, research to make H2N2 (a pathogen that has already caused a pandemic) more transmissible or virulent would not require enhanced US federal oversight.40Specify Controlled Taxons via Reference to Database IdentifiersCurrent lists often use species names (eg, "Bacillus anthracis" or "SARS-related coronavirus"), but databases attempting to capture the relationships between various taxonomic levels exist. They could serve as more specific reference points for these control lists. For example, entries in taxonomy databases, such as those maintained by the US National Center for Biotechnology Information, are hierarchical and very specific (eg, SARS-CoV-2 is taxonomy ID 2697049, which falls under taxonomy 694009 for SARS-related coronaviruses). If the US Department of Commerce really meant to control all SARS-related coronaviruses, expressing this as control of taxon 694009 provides greater clarity. Alternatively, if they only meant to control strains from the original SARS-CoV-1 and Middle East respiratory syndrome viruses, use of taxon IDs 2901879 and 1335626 would clearly indicate this intent. Furthermore, there have been efforts to develop taxonomic groups defined by reciprocal nucleotide identity, which streamlines and standardizes the definition of novel taxa and potentially increases their utility as part of a biosecurity control regime.41,42Moving From Taxonomic Lists to Sequence of Concern DatabasesThere are common constructs used in modern biotechnology that are not easy to classify using traditional taxonomy. Chimeric viruses, made up of fragments of different taxonomic origin, are frequently created for gene therapy, vaccines, and oncolytic viruses. Variations of such chimeric viruses could have pathogenic potential, yet multifamily chimeras may be excluded from the US Federal Select Agent Program even if they use select agent genes.43 Indeed, associated guidance states that "chimeras that are comprised of select agent and nonselect agent genes from the same virus family require careful review to determine select agent status," admitting that chimeras defy taxonomic classification.44 Assessing the potential harm posed by a chimeric or recombinant virus can prove challenging: 1 case report details an HIV-1 infection acquired during routine experiments with supposedly noninfectious pseudoviruses.45 The report speculates that the worker was infected by an accidentally generated hybrid virion with expanded tropism and infectivity.It may soon be possible to create novel organisms with potential for harm from "harmless" organisms without intentionally adding known genes of concern, whether through directed evolution46 or new multiplexed genome editing technology.47 Furthermore, some emerging technologies, such as de novo protein engineering, do not fit with an organism-based threat model and challenge taxonomic classification.As it becomes increasingly possible to engineer organisms at the genetic level, sequence-based approaches may prove more effective than those based on whole organisms.Improving Sequence Databases Used to Implement Taxonomic ListsAlthough the carefully curated taxon IDs managed by the US National Center for Biotechnology Information provide a reliable reference set upon which to make taxonomic classifications, the companion sequence databases, such as GenBank, are neither curated to the same degree nor were they designed to enable classification of a sequence's taxonomic origin. They were created to be and continue to serve as a tool for researchers to exchange data.27 As a result, these databases often include entries that have sequences that do not make taxonomic sense. For example, a researcher may upload a record consisting of a limited target sequence from a pathogen combined with the sequence of an unrelated reporter. The researcher may choose to label this record with the taxonomic identifier—for example, Ebola—perhaps because it is part of a set of similar sequences, each containing a snippet from a different pathogen. This means that other uses of this benign reporter gene may have a taxonomic best match to a database record classified as Ebola. Databases that provide reference genomes (ideally multiple references per organism) along with high-confidence individual gene records, explicitly for the purposes of sequence screening, would improve the accuracy and efficiency of taxonomic sequence screening while reducing the costs associated with addressing false positives.Sequences of Known Toxins and Virulence FactorsGiven the desire to determine potential for harm based on functional characteristics rather than taxonomic categorization, databases should be developed to evaluate potential for harm based on functions inferred from DNA and protein sequences.1,3 Such a database would be immediately useful for screening synthetic DNA orders.8,37 A database of sequences of concern for this context would include sequences that encode listed toxins and genes known to "endow or enhance" pathogenicity from regulated pathogens. This would help clarify whether a specific sequence is subject to control or not. For example, at present, nearly 70% of virulence factors found in pathogenic bacteria—those that "endow or enhance pathogenicity"—are also found in nonpathogenic organisms.48 Such databases could be derived from existing, publicly available lists such as Victors49 and the Virulence Factor Database.50 The Nuclear Threat Initiative–World Economic Forum Technical Consortium for DNA Synthesis Screening is developing this type of database for its Common Mechanism.32Capturing a Wider Range of Sequences of ConcernThere has been considerable interest in developing more powerful databases of sequences of concern that can capture a much wider range of functions, including those that are not found in known toxins and pathogens. The revised Screening Framework Guidance for Providers and Users of Synthetic Oligonucleotides,51 released in April 2022, recommends the use of such databases to flag potential harms from sequences of synthetic DNA, and several tools have been developed that could be used for this purpose.31,52,53 There is also interest in further expanding these tools to include machine learning-enabled predictions that can identify potential harms in unknown sequences. Users could also choose to include DNA sequences related to harms beyond pathogenicity or toxicity, such as those that could enable antimateriel applications.Limitations of Sequence of Concern DatabasesSequence of concern databases present their own challenges, especially related to curation and access. Sequence databases require expert curation both in their initial development and to keep pace with advances in pathogen research, which can be costly and require subjective judgments. Curation also requires clear annotations and communication about what sequences or functions should be considered of concern, by whom, and for what purpose (ie, regulatory control or merely increased attention on the ordering customer). An example of how this could be achieved is the Comprehensive Antibiotic Resistance Database, which combines manual expert curation (aided by machine learning-assisted text mining) with standardized vocabulary and inclusion criteria, such as requiring experimental validation of stated function, submitting the sequence to a public database, and publication on the mechanism in question.54 Concerns about misuse of these tools and information hazards contained in these databases are especially relevant as they expand to capture broader harms than those currently encompassed by existing public-facing lists.Enumerating Concerns in a Sequence- or Taxonomy-Agnostic WayBiological systems can have emergent properties that pose concerns and are not easily described at the level of individual sequences. Some concerns arise from combinations of sequences. For example, sporulation is associated with weaponization potential because spores can be aerosolized and are resilient to harsh environmental conditions. Yet sporulation is a multistep biological process that relies on specific combinations of genes, making it difficult to capture through sequence-based approaches alone. In addition, synthetic biology tools can be used to combine otherwise innocuous sequences into biological systems that may pose biosecurity concerns, such as gene drives. Oversight mechanisms that regulate research at the level of biological functions, whether present naturally or endowed experimentally, could help to address some scenarios where sequence- and taxonomy-based approaches fall short.55 If research is regulated at the level of biological function, then lists, other guidelines, or algorithmic functional prediction tools may help review committees put these regulations in action.A practical example of function-based approaches has been used in recent years for the International Genetically Engineered Machine (iGEM) competition. The competition uses a so-called "White List" to help identify biological materials that may pose a greater hazard and whose use requires prior approval and enhanced levels of oversight. In previous iterations, this approach addressed the use of specific organisms or biological parts in the competition. Since 2019, a series of activities has been included in the list requiring prior approval. Activities requiring additional hazard identification and risk management include all 7 experiments of concern, anything that notably alters risks associated with antimicrobial resistance, and anything that is likely to bias the inheritance frequency of a genetic marker in an organism's progeny, such as through the creation of a gene drive.56 In all these cases, it is the likely outcome that is subject to a rule and not a specific organism, part, or sequence. These functional definitions have been reviewed and revised considering practical experience in their implementation.57Machine learning has enabled a dramatic shift in our understanding of proteins. Recently, Meta's ESMFold model has allowed the prediction of protein structure for over 600 million protein sequences.11 This, in turn, has enabled much greater fidelity in being able to design novel proteins for specific biological functions. Both being able to predict function from structure and being able to design for a specific function were once considered to be grand challenges. Progress in addressing these challenges is happening more quickly than anticipated. The same tools and approaches are now being applied to more complex biological challenges, such as use of "hallucination" to broaden potential protein design space, design of
The Biological Weapons Convention (BWC) prohibits the development, production, and stockpiling of biological weapons. Since its creation in the 1970's it has lacked a mechanism to verify compliance of its States Parties. Most of the 1990s was spent trying to develop such a regime. These failed in 2001. The authors consider the scientific and technical feasibility of verifying compliance with the BWC, primarily focussing on on-site verification (activities conducted with physical access to a facility) but also addressing off-site verification (activities that can be conducted from other locations). They review past thinking on what verifying the BTWC was to accomplish, the verification measures identified, and the assessment criteria used. They then examine changes in the life sciences, biotechnology, and biomanufacturing since the last time these issues were considered at the multilateral level in 1993. Using criteria previously developed by the BWC States Parties, the authors assess the impact of current scientific and technical capabilities on verifying compliance with the BWC. They conclude that using a variety of measures in concert, and by compiling numerous sources of information and signatures of unusual behaviour, it might be feasible to identify non-compliance with the BWC. They identify several ways in which advances offer opportunities and challenges to verifying compliance with the BWC. They consider how current trends may affect future work on verification and how that might be integrated into the work of the BWC.
The ability to construct, synthesize, and edit genes and genomes at scale and with speed enables, in synergy with other tools of engineering biology, breakthrough applications with far-reaching implications for society. As SARS-CoV-2 spread around the world in early spring of 2020, researchers rapidly mobilized, using these tools in the development of diagnostics, therapeutics, and vaccines for COVID-19. The sharing of knowledge was crucial to making rapid progress. Several publications described the use of reverse genetics for the de novo construction of SARS-CoV-2 in the laboratory, one in the form of a protocol. Given the demonstrable harm caused by the virus, the unequal distribution of mitigating vaccines and therapeutics, their unknown efficacy against variants, and the interest in this research by laboratories unaccustomed to working with highly transmissible pandemic pathogens, there are risks associated with such publications, particularly as protocols. We describe considerations and offer suggestions for enhancing security in the publication of synthetic biology research and techniques. We recommend: (1) that protocol manuscripts for the de novo synthesis of certain pathogenic viruses undergo a mandatory safety and security review; (2) that if published, such papers include descriptions of the discussions or review processes that occurred regarding security considerations in the main text; and (3) the development of a governance framework for the inclusion of basic security screening during the publication process of engineering biology/synthetic biology manuscripts to build and support a safe and secure research enterprise that is able to maximize its positive impacts and minimize any negative outcomes.
Engineering biology is being applied toward solving or mitigating some of the greatest challenges facing society. As with many other rapidly advancing technologies, the development of these powerful tools must be considered in the context of ethical uses for personal, societal, and/or environmental advancement. Researchers have a responsibility to consider the diverse outcomes that may result from the knowledge and innovation they contribute to the field. Together, we developed a Statement of Ethics in Engineering Biology Research to guide researchers as they incorporate the consideration of long-term ethical implications of their work into every phase of the research lifecycle. Herein, we present and contextualize this Statement of Ethics and its six guiding principles. Our goal is to facilitate ongoing reflection and collaboration among technical researchers, social scientists, policy makers, and other stakeholders to support best outcomes in engineering biology innovation and development.
The bioeconomy in the United States represents a significant proportion of total economic output and is poised to grow even more rapidly over the next decade. Global competition is increasing, and the United States must work to ensure we maintain global leadership in this field. In this commentary, we outline policy recommendations in 6 topic areas. Taken together, these recommendations call on government, academia, and private industry to collaborate, both domestically and internationally, to grow and secure the current and future bioeconomy in the United States.