Innovation, Quantum-AI Technology & Law

Blog over Kunstmatige Intelligentie, Quantum, Deep Learning, Blockchain en Big Data Law

Blog over juridische, sociale, ethische en policy aspecten van Kunstmatige Intelligentie, Quantum Computing, Sensing & Communication, Augmented Reality en Robotica, Big Data Wetgeving en Machine Learning Regelgeving. Kennisartikelen inzake de EU AI Act, de Data Governance Act, cloud computing, algoritmes, privacy, virtual reality, blockchain, robotlaw, smart contracts, informatierecht, ICT contracten, online platforms, apps en tools. Europese regels, auteursrecht, chipsrecht, databankrechten en juridische diensten AI recht.

Berichten met de tag Geopolitics
Quantum Event Horizon: Addressing the Quantum-AI Control Problem through Quantum-Resistant Constitutional AI

What happens when AI becomes not just superintelligent, but quantum-superintelligent? QAI agents with both classical and quantum capabilities? How do we ensure we remain in control?

This is the central question of my new article, where I introduce the concept of the Quantum Event Horizon to frame the urgency of the QAI control problem. As we near this point of no return, the risk of losing control to misaligned systems—machines taking over or seeing them weaponized—becomes acute.

A metaphorical Quantum Event Horizon can be thought of as an inflection point, or quantum governance 'tipping point' beyond which our ability to steward advanced quantum technology and AI towards beneficial outcomes for all of humanity, may vanish.

Simple guardrails are not enough. The solution must be architectural. I propose a new paradigm: Quantum-Resistant Constitutional AI, a method for engineering our core values into the foundation of QAI itself. This is a crucial discussion for policymakers, researchers, builders, and industry leaders.

Navigating the Quantum Event Horizon

This paper addresses the impending control problem posed by the synthesis of quantum computing and artificial intelligence (QAI). It posits that the emergence of potentially superintelligent QAI agents creates a governance challenge that is fundamentally different from and more acute than those posed by classical AI. Traditional solutions focused on technical alignment are necessary but insufficient for the novel risks and capabilities of QAI. The central thesis is that navigating this challenge requires a paradigm shift from reactive oversight to proactive, upfront constitutional design.

The core of the argument is framed by the concept of the ‘Quantum Event Horizon’—a metaphorical boundary beyond which the behavior, development, and societal impact of QAI become computationally opaque and practically impossible to predict or control using conventional methods. Drawing on the Collingridge dilemma and the Copenhagen interpretation, this concept highlights the risk of a "point of no return," where technological lock-in, spurred by a "ChatGPT moment" for quantum, could cement irreversible geopolitical realities, empower techno-authoritarianism, and present an unmanageable control problem (the risk of machines taking over). Confronting this requires a new philosophy for governing non-human intelligence.

Machines Taking Over

The urgency is magnified by a stark geopolitical context, defined by a Tripartite Dilemma between the existential safety concerns articulated by figures like Geoffrey Hinton, the geopolitical security imperative for rapid innovation voiced by Eric Schmidt, and the builder’s need to balance progress with safety, as expressed by Demis Hassabis. This dilemma is enacted through competing global innovation models: the permissionless, market-driven US system; the state-led, top-down Chinese system; and the values-first, deliberative EU model. In this winner-takes-all race, the first actor to achieve a decisive QAI breakthrough could permanently shape global norms and our way of life.

An Atomic Agency for Quantum-AI

Given these stakes, current control paradigms like human-in-the-loop oversight are inadequate. The speed and complexity of QAI render direct human control impossible, a practical manifestation of crossing the Quantum Event Horizon. Therefore, governance must be multi-layered, integrating societal and institutional frameworks. This includes establishing an "Atomic Agency for Quantum-AI" for international oversight and promoting Responsible Quantum Technology (RQT) by Design, guided by principles such as those outlined in our '10 Principles for Responsible Quantum Innovation' article. These frameworks must be led by robust public governance—as corporate self-regulation is insufficient due to misaligned incentives—and must address the distributive justice imperative to prevent a "Quantum Divide."

Towards Quantum-Resistant Constitutional AI

The cornerstone of our proposed solution is Quantum-Resistant Constitutional AI. This approach argues that if we cannot control a QAI agent tactically, we must constrain it architecturally. It builds upon the concept of Constitutional AI by designing a core set of ethical and safety principles (a 'constitution') that are not merely trained into the model but are formally verified and made robust against both classical and quantum-algorithmic exploitation. By hardwiring this quantum-secure constitution into the agent's core, we can create a form of verifiable, built-in control that is more likely to endure as the agent's intelligence scales.

Self-Aware Quantum-AI Agents

Looking toward more speculative futures, the potential for a Human-AI Merger or the emergence of a QAI Hive Mind—a networked, non-human consciousness enabled by quantum entanglement—represents the ultimate challenge and the final crossing of the Quantum Event Horizon. The foundational governance work we do today, including projects like Quantum-ELSPI, is the essential precursor to navigating these profound transformations.

In conclusion, this paper argues that for the European Union, proactively developing and implementing a framework centered on Quantum-Resistant Constitutional AI is not just a defensive measure against existential risk. It is a strategic necessity to ensure that the most powerful technology in human history develops in alignment with democratic principles, securing the EU’s role as a global regulatory leader in the 21st century.

Meer lezen
Mauritz Kop and Mark Lemley Host High-Level EU Cybersecurity Delegation at Stanford Law

Stanford, CA – On February 26, 2024, the Stanford Center for Responsible Quantum Technology (RQT), a leading interdisciplinary hub operating under the aegis of the Stanford Program in Law, Science & Technology, had the distinct honor of hosting a high-level cybersecurity delegation from the European Commission. The meeting, led by the Center’s Founding Director, Mauritz Kop, and Professor Mark A. Lemley, Director of the Stanford Program in Law, Science & Technology, underscored the growing importance of transatlantic dialogue in shaping the future of digital security and responsible innovation in the quantum age.

The Stanford Center for RQT is dedicated to steering the development and application of quantum technologies toward outcomes that are not only innovative but also equitable, transparent, and beneficial for society at large. Its mission is to proactively address the complex ethical, legal, societal, policy and interoperability implications of quantum advancements, fostering a global ecosystem grounded in democratic values and human rights. The Center was officially inaugurated on December 6, 2023, by His Excellency Mark Rutte, then Prime Minister of the Netherlands and the current Secretary General of NATO, a testament to the geopolitical significance of its work. This recent meeting with the EU delegation builds on that foundation, reinforcing the Center’s role as a crucial bridge between Silicon Valley’s technological frontier and the world’s leading policymakers.

The dialogue centered on some of the most pressing challenges and opportunities at the intersection of quantum technology and cybersecurity, including building global capacity for responsible innovation and aligning EU and US national security strategies.

The EU Cybersecurity Delegation at Stanford RQT

The European Commission’s Cybersecurity Delegation was led by Gerard de Graaf, the Senior Envoy for Digital to the U.S. and Head of the European Union Office in San Francisco. A veteran of the European Commission with a distinguished career spanning several key digital policy areas, Mr. de Graaf is at the forefront of the EU’s efforts to promote a human-centric, ethical, and secure digital transition. His role involves strengthening transatlantic cooperation on digital regulation, from data governance and AI to cybersecurity and platform accountability. Mr. de Graaf, who was also present at the Center’s inauguration, has been a pivotal figure in shaping the EU’s landmark digital policies, including the General Data Protection Regulation (GDPR) and the Digital Services Act (DSA). His leadership in the San Francisco office is instrumental in fostering dialogue between European regulators and the heart of the global tech industry.

Accompanying Mr. de Graaf were Joanna Smolinska, Deputy Head of the EU Office in San Francisco and a key figure in transatlantic tech diplomacy, and Ilse Rooze, a Seconded National Expert at the EU Office who brings deep expertise in digital policy and international relations.

Representing Stanford were Mauritz Kop and Professor Mark A. Lemley. Mr. Kop is a pioneering scholar in the governance of emerging technologies, with a focus on quantum, AI, and intellectual property. As the Founding Director of the RQT Center, his work is dedicated to creating robust legal and ethical frameworks to ensure that transformative technologies are developed and deployed responsibly. Professor Lemley is the William H. Neukom Professor of Law at Stanford Law School and one of the world's most cited scholars in intellectual property and technology law. His extensive work on innovation, competition, and the digital economy provides a critical legal and economic lens through which to view the challenges of the quantum era.

The Quantum Cybersecurity Challenge: Preparing for Q-Day

A central theme of the discussion was the looming threat that fault-tolerant quantum computers pose to global cybersecurity. The immense processing power of these future machines will render much of the world’s current cryptographic infrastructure obsolete. This critical juncture, often referred to as “Q-Day” or the “Quantum Apocalypse,” is the moment when a quantum computer will be capable of breaking widely used encryption standards like RSA and ECC, which protect everything from financial transactions and government communications to personal data and critical infrastructure.

The implications of Q-Day are profound. Malicious actors could potentially decrypt vast archives of stolen encrypted data—a scenario known as "harvest now, decrypt later." This retroactive decryption capability poses a severe threat to long-term data security, national security, and economic stability.

In his opening remarks, Mauritz Kop emphasized the urgency of a proactive, coordinated global response. The conversation explored the transition to Post-Quantum Cryptography (PQC), a new generation of cryptographic algorithms designed to be resistant to attacks from both classical and quantum computers. The U.S. National Institute of Standards and Technology (NIST) is in the final stages of standardizing a suite of PQC algorithms, a process closely watched by governments and industries worldwide. The delegation discussed the immense logistical, technical, and financial challenges of migrating global IT systems to these new technical standards—a process that is expected to take more than a decade and require unprecedented public-private collaboration.

The discussion also touched upon other quantum security technologies, such as Quantum Key Distribution (QKD), which uses the principles of quantum mechanics to create secure communication channels. While PQC focuses on developing new mathematical problems that are hard for quantum computers to solve, QKD offers a physics-based approach to security. The participants explored how these different technologies could complement each other in a future-proof security architecture.

Meer lezen
Mauritz Kop Speaks at CNAS Quantum Roundtable on Research Security, Technology Theft, and Intellectual Property Rights

Washington, D.C. – On October 11, 2023, the Center for a New American Security (CNAS) convened a timely, off-the-record roundtable discussion to address one of the most pressing national security challenges of our time: safeguarding American leadership in quantum technology. The event, titled "Quantum Roundtable: Research Security, Technology Theft, and Intellectual Property Rights," brought together a select group of leading experts from government, industry, and academia. Among the distinguished speakers was Mauritz Kop, Fellow and Visiting Scholar in Quantum and Law at Stanford University and later the Founding Director of the Stanford Center for Responsible Quantum Technology (RQT), and Chair of the annual Stanford RQT Conference.

The roundtable served as a critical forum for in-depth dialogue on formulating a robust U.S. strategy to protect its quantum ecosystem from intellectual property theft and illicit technology transfer, particularly in the context of strategic competition with nations like China. Quantum technology governance global expert Mauritz Kop was invited to provide his unique perspective, rooted in a holistic framework for responsible innovation, to help navigate the complex interface of intellectual property and national security.

The Center for a New American Security: Shaping the National Security Debate

The Center for a New American Security is a prominent, bipartisan non-profit organization that develops strong, pragmatic, and principled national security and defense policies. CNAS engages policymakers, experts, and the public with innovative, fact-based research, ideas, and analysis to shape and elevate the national security debate. Its Technology and National Security Program, led by Senior Fellow and Director Vivek Chilukuri, focuses on the complex challenges and opportunities presented by emerging technologies, aiming to ensure the United States maintains its technological leadership while upholding democratic values. This roundtable was a key component of the program's project on U.S. quantum strategy and its intersection with U.S.-China economic relations, reflecting CNAS’s commitment to proactive and forward-thinking policy development.

A High-Stakes Convening of Quantum Leaders

The roundtable's agenda was designed to facilitate a candid and substantive discussion among key stakeholders. The session was opened by CNAS Executive Vice President and Director of Studies, Dr. Paul Scharre, and Program Director Vivek Chilukuri, who set the stage by outlining the critical importance of the topic.

The main discussion featured two expert speakers:

Mauritz Kop, who brought a comprehensive legal, ethical, and policy perspective from his work at Stanford. His research focuses on developing governance frameworks for emerging technologies, integrating intellectual property, antitrust law, distributive justice, and national security strategy.

Dr. Elliott Mason, a Registered Patent Agent at Young Basile and a leader within the Quantum Economic Development Consortium (QED-C). Dr. Mason provided deep technical and practical insights from the front lines of quantum patenting and the development of industry standards.

Conclusion: A Principled Approach to Quantum Technology Governance

Mauritz Kop concluded his remarks by emphasizing the profound dilemmas and trade-offs inherent in governing quantum technology. The pendulum swings between open and closed innovation, and between mitigating risks and maximizing benefits, require a sophisticated, evidence-based, and adaptive approach.

His participation in the CNAS roundtable provided a crucial, principled voice, advocating for a strategy that is not merely defensive but forward-looking. By grounding the discussion in the RQT framework, he made a compelling case that true security lies in advancing a thriving, competitive, and responsible quantum ecosystem—one that leads the world in innovation while being firmly anchored in democratic values and a commitment to the planetary good. The event highlighted the essential role of deep, interdisciplinary dialogue in shaping a quantum future that is both secure and beneficial for all humankind.

Meer lezen
Mauritz Kop Consults Senator Mark Warner on AI & Quantum Technology Policy

Washington D.C., January 4, 2022—As the United States Congress grapples with the complex challenges of regulating artificial intelligence and quantum technology, leading policymakers are seeking expert guidance to inform a robust and forward-thinking national strategy. On January 4, 2022, Mauritz Kop, a distinguished scholar in the field of technology law and governance, was consulted by the legal team of U.S. Senator Mark Warner (D-VA) to provide strategic insights on both AI and quantum technology policy.

This consultation highlights the growing recognition in Washington of the need for deep, interdisciplinary expertise to navigate the geopolitical, economic, and security dimensions of these transformative technologies. Senator Warner's team reached out to Kop based on his influential scholarship, including his extensive work at Stanford on the EU AI Act and the need for a strategic democratic tech alliance, his advisory role for the European Commission led by Ursula von der Leyen on the AI Act and Data Act, and his foundational article in the Yale Journal of Law & Technology proposing a comprehensive legal-ethical framework for quantum technology.

Senator Mark Warner: A Leader on Technology and National Security

Senator Mark Warner's engagement on these issues is both significant and timely. As the Chairman of the Senate Select Committee on Intelligence, he is at the forefront of addressing the national security implications of emerging technologies. His work involves overseeing the U.S. Intelligence Community and ensuring it is equipped to handle the threats and opportunities of the 21st century, where technological competition with nations like China is a central concern.

The Senate Select Committee on Intelligence has a broad mandate that includes analyzing intelligence on the technological capabilities of foreign powers and assessing the vulnerabilities of U.S. critical infrastructure. Senator Warner has been a vocal proponent of developing a national strategy for AI and quantum to maintain the United States' competitive edge and to ensure that these technologies are developed and deployed in a manner consistent with democratic values. This consultation with Mauritz Kop reflects the Senator's commitment to drawing on leading academic research to shape sound, bipartisan policy.

AI Policy: A Transatlantic, Risk-Based Approach that Lets Innovation Breathe

A key focus of the consultation was Kop's analysis of the European Union's AI Act. His Stanford publications argue for a balanced, pro-innovation regulatory model that can serve as a blueprint for international cooperation. Good governance and sensible legislation should incentivize desired behavior and simultaneously create breathing room for sustainable, beneficial innovation to flourish.

Quantum Governance: Establishing a Legal-Ethical Framework

The discussion also delved into the governance of quantum technology, drawing on Kop's seminal work in the Yale Journal of Law & Technology. Recognizing that quantum is rapidly moving from the theoretical to the practical, he stressed the urgency of establishing a legal-ethical framework before the technology is widely deployed and locked-in.

The consultation with Senator Warner's office represents a critical intersection of academic scholarship and high-level policymaking. As the United States charts its course in the era of AI and quantum, the insights provided by experts like Mauritz Kop are invaluable in ensuring that the nation's strategy is not only competitive but also responsible, ethical, and firmly rooted in democratic principles.

Meer lezen