Autonomy Software


A universal video network that combines stereo disparity and mono motion to calculate the distance, absolute velocity, and trajectory of objects both near and far without requiring object recognition.

A novel approach to processing raw HD radar outputs extends perception distance and provides resiliency in inclement weather, poor lighting, and occlusion scenarios as an independent sensor modality.

Interprets the real-time environment and identifies drivable paths by detecting road markers and lane semantics and combining them with vision and radar data.
The driving program analyzes the outputs from Perception and performs the task of driving, executing standard and defensive maneuvers to optimize safety, comfort, and route.
From lane centering and distance keeping to merging and changing lanes, Ghost executes driving maneuvers by precisely actuating the steering, accelerator, and brake.
Aided by 360° perception and reaction times that are three times faster than a human driver, Ghost is capable of aggressive braking and swerving to avoid dangerous obstacles and events on the road.

Ghost will pass slow vehicles, drive in eligible HOV lanes, and use OTA connectivity and real-time traffic data to continuously optimize routing decisions.
Multiple layers of software and hardware redundancy enable Ghost to drive safely without relying on a human backup, even in the event of failures or occlusions.
With high availability software and redundant sensors, sensor modalities, and processors, Ghost can continue driving safely in the case of sensor occlusions, dropped frames, or even full sensor or compute failure.
In case of the most severe failures, Ghost will achieve a minimal risk condition with an independent driving computer designed to bring the car to a safe stop without human intervention even if the primary system is compromised.
The approved operational design domain (ODD) is actively enforced and can be modified via OTA updates to expand driving areas and use cases and execute targeted restrictions if ever necessary.
Using an in-cabin camera equipped with artificial intelligence, Ghost is developing sophisticated driver intent perception models capable of transforming the interaction between car and driver.

Ghost monitors steering wheel and pedal inputs as well as the driver's hand positions, head and skeletal posture, and eye gaze to understand when to transition driving responsibilities to and from the human driver.
As a L4 system, Ghost does not require driver attention or intervention when engaged. Equipped with driver intent perception that can disambiguate accidental input on the car controls from deliberate driving activity, Ghost seamlessly begins driving when the driver simply lets go of the wheel and pedals. Likewise, the driver can take back control at any time by taking the wheel or pressing the pedals.
A real-time operating environment responsible for high-performance execution of the Autonomy Software.
Verified to be bug-free using formal software verification methods adapted from aerospace and defense.
Works seamlessly with a range of sensor and compute configurations, enabling OEMs to customize hardware across models and trim levels and deliver future hardware upgrades.
Implements best practices for hardening, securing communications, and intrusion detection to manage cybersecurity risk.
Enables secure update and rollback of software versions and facilitates unique feature entitlement per subscriber.
Sends unusual road scenes and system exceptions to Autonomy Cloud for training and analysis.
Securely directs in-car data flow between sensors, driving computer, and vehicle controls.
Reference Hardware


In partnership with:


Design Principles

Autonomy Studio

APIs in both the car and the cloud facilitate deep integration across core systems ranging from the CAN bus to OTA updates to the HMI, delivering data in real-time and powering immersive visual experiences.
Sports coupes and heavy-duty pickup trucks are meant to drive differently. Develop custom vehicle and brand-specific integrations, maneuvers, and driving styles without having to build a new software version for each implementation.
Leverage the complete sensor package and Ghost’s AI team to build experiences beyond autonomy, from facial recognition-enabled personalization to gesture-based cabin controls.
Make each vehicle brand unique by partnering with Ghost’s in-house design function to explore, test, and implement deeply embedded HMI, haptic, auditory, mobile, and voice control features.
Autonomy Cloud

The communications hub delivering connected and mobile experiences to the Ghost-enabled fleet and a platform for collaboration between Ghost and OEM partners.

Frequent over-the-air software updates improve the driving experience, deliver new capabilities, and expand the ODD.
Manages feature entitlement per vehicle, enabling and/or gating capabilities as users modify their subscriptions.
Test and production vehicles capture and upload relevant sensor and driving data in privacy-compliant fashion for training and analysis, enabling constant iteration based upon unusual road scenes, hardware and software exceptions, car and driver behavior, and more.
Syncs with OEM infrastructure for account and subscription management and driver personalization.
Centralized AI supercomputer training infrastructure for joint neural network development and validation.

Neural networks are rapidly trained and verified using auto-labeled training data and can be rapidly re-trained to ensure compatibility with OEM-specific vehicles and sensors.
Custom-built GPU nodes for AI training plus dedicated high-bandwidth public cloud connections for leveraging infinitely scalable cloud compute.
Ghost’s training and automation practices enable a large team of data scientists to work on many models in parallel.
Ghost believes in working closely with the regulatory community and pursues system validation jointly with OEM partners.

Ghost tools and resources support OEM processes for validation, certification, regulatory compliance, and reporting.
To support OEM quality and risk mitigation efforts, Ghost preserves neural network versioning for proactive risk assessment and real-time issue management.
The operational design domain can be modified via OTA updates to expand to approved driving areas and use cases and execute targeted restrictions if ever necessary.