Nexus: Battlefield Intelligence

Nexus is able to show raw footage coming from the deployed air and ground fleets
Nexus can also propose strategies based on its understanding of the battlefield conditions
Nexus does not take full control but keeps human operators in the loop for critical decision making

Inspiration

Latest advanced in AI capabilities
China's investment in DefenseTech
Extreme ownership by Jocko Willink

What it does

Nexus is a real-time battlefield intelligence platform that ingests and analyzes heterogenous data from drones (images, geolocation, RF/EO signals), squads (communication, health etc) with the goal of raising situation awareness in the battlefield. It reduces cognitive load on those in the control room by summarizing the ingested data (images, audio, video) and empower those on the frontlines to move with confidence by proactively identifying threats.

Practical Command and Control

Nexus provides a highly-powerful yet easy to use command and control system that gives visibility into the battlefield by showing the raw footage from troops and fleets as well as processed data analytics.

Human-In-The-Loop-Autonomy

While Nexus proposes strategies to mitigate threats and protect our valuable assets, it does not directly make decision for you. Final calls are still made by a human in the control room and those on the frontlines.

How we built it

Integrated LLMs with drones imagery, troops communication. Built data flow pipeline, and used function calling to enable the AI to propose action and strategies to the operator.

Challenges we ran into

Short time. Lack of access to real military data e.g. wartime communications, historical records of operations and how effective the defense/attack strategies were etc.