Will humans still fight in future wars?

Key Concepts

• Full Autonomy in Warfare: The development and deployment of weapon systems capable of selecting and engaging targets without human intervention.
• Human-in-the-Loop: Maintaining human oversight and control in the decision-making process of weapon systems.
• Algorithmic Superiority: Utilizing advanced algorithms and technology to compensate for potential delays introduced by human involvement.
• Ethical Considerations in AI Warfare: The moral implications of delegating life-or-death decisions to artificial intelligence.
• Geopolitical Implications: Differing approaches to AI in warfare between democracies (Europe, US) and potential adversaries (Russia, China).

The Inevitable Rise of Machine Warfare & The Ethical Imperative of Human Control

The core argument presented is that the future of warfare will increasingly involve autonomous systems, to the point where human presence on the battlefield will be untenable and ethically unacceptable. The speaker posits that adversaries, specifically mentioning Russia and China, are likely to embrace full autonomy in their weapon systems without reservation. This necessitates a different approach for democracies – specifically, maintaining human involvement in critical decision-making processes, even if it introduces delays.

The speaker states, “The battlefield of the future will be a no-go zone for humans. It will be unethical to send humans into those battlefields.” This highlights a fundamental shift in the nature of conflict, driven by the increasing capabilities of AI and autonomous weaponry. The rationale is not simply about technological advancement, but also about protecting human lives.

Compensating for Human Involvement: Algorithmic & Technological Superiority

Acknowledging the potential disadvantage of a slower decision process due to human oversight, the speaker emphasizes the need to offset this with “overall superior technology.” This isn’t simply about having more weapons, but about achieving superiority in key areas such as “superior hit rate” and “faster algorithms.” This suggests a focus on developing advanced algorithms capable of processing information and identifying targets with greater speed and accuracy than fully autonomous systems, while still allowing for human verification. The speaker concedes this future is “dystopian,” but insists, “However dystopian that sounds, that is the future we have to face. I wish it wasn't that way. It is going to be that way.”

Geopolitical Divergence: Europe, the US, Russia & China

A significant point raised is the potential divergence in approaches between different geopolitical actors. The speaker believes Russia and China “may be much more comfortable with seeding more control to their weapons.” The proposed European strategy isn’t to mirror this approach, but to “compensate by having greater human involvement, but offset that with more effective weapons.” This is described as a “very delicate tight rope to walk.”

The speaker anticipates potential disagreement with the United States, stating, “It seems to me the Americans will not be on the same page as the Europeans.” However, they quickly qualify this, adding, “We'll see. I I think there are similar considerations in the US as well. I think we actually quite aligned overall that human should be part of the decision process.” The extent to which this alignment will hold true “in real conflicts” remains uncertain.

The Founding Principle: Control & Sovereignty over Algorithms

The speaker reveals a core motivation for establishing their company: to ensure control over the development and deployment of AI in warfare. They state, “algorithms will come anyway but the way we control them the way we are involved is something that we should be able to control not third party countries so this is the principal consideration.” This underscores a concern about reliance on algorithms developed by potentially adversarial nations and a desire to maintain sovereignty over this critical technology. This isn’t about preventing the development of AI, but about dictating how it is developed and utilized, specifically prioritizing human oversight and ethical considerations.

Synthesis

The central takeaway is that the future of warfare is inevitably shifting towards increased autonomy, but democracies have a moral and strategic imperative to maintain human control over critical weapon systems. This requires a proactive approach focused on developing superior technology – particularly advanced algorithms – to compensate for any delays introduced by human involvement. The speaker emphasizes the importance of controlling the development and deployment of these algorithms to avoid dependence on potentially hostile actors and to uphold ethical principles in the use of artificial intelligence in warfare.