Computer Vision

The science and technology of systems that see and understand—computer vision—offers solutions to formidable data acquisition and exploitation challenges in defense, security, robotics, training, and the medical marketplace. Cameras and sensors have become ubiquitous: extracting meaningful information from acquired images in real time and in real world applications requires the right set of tools.

End-to-end vision capabilities include enhanced sensing, front-end video processing, and high-level analysis. To meet rigorous client requirements, SRI develops, evaluates, and transitions technologies in these areas:

Core Technologies

  • Object recognition

  • Event detection

  • Tracking

  • 3D scene modeling

  • Computational imaging

  • Embedded processing

  • Video archiving and retrieval

  • Video text recognition/extraction

Applications

Projects

ground vehicle with complex mapping sensor system
3D Complex Mapping in Urban Terrain

SRI is developing technology that will enable warfighters to easily maneuver a robot, precisely map an environment, and have 3D situational awareness.

Topics: 3D + Virtual Environments Computer Vision Force Protection Homeland Security + National Defense Intelligence, Surveillance + Reconnaissance Robotics Unmanned Robotics Perception
man viewing video on laptop
AURORA: Content-Guided Search of Diverse Videos

SRI is developing a novel search technology to quickly find events of interest in very large video collections.

Topics: Computer Vision Intelligence, Surveillance + Reconnaissance
two men fine-tuning mixed-reality cameras and helmet sensors
Automated Performance Evaluation and Lessons Learned

SRI’s mixed reality training system provides comprehensive mission rehearsal tools to improve warfighter training.

Topics: 3D + Virtual Environments Computer Vision Force Protection Training Systems
screen capture showing image of mountains
Hierarchical Urban and Natural Terrain Exploitation and Reasoning

SRI is developing a system for the semi-automated geolocalization of metadata-free images and videos to find a location of interest.

Topics: Computer Vision Intelligence, Surveillance + Reconnaissance
green boxes highlighting people walking on street
Pedestrian Detection from Moving Unmanned Ground Vehicles

SRI’s vision-based systems enable safe operations of moving unmanned ground vehicles around stationary and moving people in urban or cluttered environments.

Topics: Computer Vision Counter-Terrorism Force Protection Homeland Security + National Defense Robotics Unmanned Robotics Perception
track boxes around people walking through a parking lot
Tracking Humans in Crowds

SRI is developing a prototype system to automatically detect and track multiple individuals in a crowd.

Topics: Computer Vision Counter-Terrorism
illustration of a security camera with watching eyes
Visual Intelligence Grounded in Learning (VIGIL)

SRI’s visual intelligence system could enable a new era in unmanned robotic surveillance.

Topics: Artificial Intelligence Computer Vision Robotics Unmanned Robotics Perception

Products + Solutions

Warfighter with binoculars
Acadia® II Embedded Video Processors

Acadia® II is a real-time, low-power, integrated video processor that delivers enhanced perception and situational awareness. It supports embedded surveillance and portable processing needs for weapon-mounted sights, handheld range and target finders, unmanned air or ground platforms, and more.

Topics: Border Security Computer Vision Force Protection Homeland Security + National Defense Intelligence, Surveillance + Reconnaissance Maritime + Port Security Robotics Sensors Unmanned Robotics Perception
Acadia ILS-6000 ruggedized box
Acadia® ILS-6000™ Ruggedized Video Stabilizer

The Acadia ILS-6000 is a small plug-and-play box designed to bring high-performance video stabilization to the field. The ILS-6000 features rugged, tamper-resistant, weather-resistant housing.

Topics: Border Security Computer Vision Force Protection Intelligence, Surveillance + Reconnaissance Maritime + Port Security
three outdoor security cameras on a pole
Acadia® ILS-6000™ Video Stabilizers

The Acadia ILS-6000 hardware series of video stabilizers eliminates camera motion artifacts and delivers clear, actionable information. These products are designed to meet the challenges of inclement weather, unstable vehicle motion, and long-range viewing in remote or unprotected installations.

Topics: Border Security Computer Vision Force Protection Homeland Security + National Defense Intelligence, Surveillance + Reconnaissance Maritime + Port Security
Acadia ILS-6100 OEM board
Acadia® ILS-6100™ OEM Video Stabilizer Board

The Acadia ILS-6100 video stabilizer is a printed circuit board designed for integration into camera enclosures, pan-tilt units, robots, and unmanned vehicles.

Topics: Border Security Computer Vision Force Protection Intelligence, Surveillance + Reconnaissance Maritime + Port Security Robotics Unmanned Robotics Perception
Acadia ILS-6200 rack-mount unit
Acadia® ILS-6200™ Rack-Mount Video Stabilizer

The Acadia ILS-6200 video stabilizer is a multichannel, universal rack-mount configuration that fits to a standard 19-inch rack.

Topics: Border Security Computer Vision Force Protection Intelligence, Surveillance + Reconnaissance Maritime + Port Security
Acadia ILS-6500
Acadia® ILS-6500™ Video Stabilizer and Encoder

The Acadia® ILS-6500™ video stabilizer combines real-time electronic image stabilization with H.264 encoding for improved distribution of quality video.

Topics: Border Security Computer Vision Counter-Terrorism Force Protection Homeland Security + National Defense Intelligence, Surveillance + Reconnaissance
explorer equipment
ConTEXTract™ Video OCR

ConTEXTract™ video OCR technology finds and reads text (such as street signs, name tags, and billboards) in real scenes. Recognition of text within imagery and video requires a more specialized approach than is provided by off-the-shelf OCR software,.

Topics: Advanced Manipulation + Automation Border Security Computer Vision Counter-Terrorism Force Protection Homeland Security + National Defense Intelligence, Surveillance + Reconnaissance
DL Micro digital data link module
DL Micro™ Digital Data Link and Video Processor

The DL Micro™ digital data link and video processor delivers quality video from air and ground sensors. It supports the low size, weight, and power (SWaP) requirements of unmanned defense systems.

Topics: Border Security Computer Vision Counter-Terrorism Force Protection Homeland Security + National Defense Intelligence, Surveillance + Reconnaissance
Mobile command post with product software callout
Integrated Solutions for the Mobile Command Post

SRI offers real-time integrated reconnaissance and surveillance solutions for vehicles. These mobile systems enable situational awareness in rapidly changing environments.

Topics: Border Security Computer Vision Counter-Terrorism Force Protection Homeland Security + National Defense Imaging Technologies Intelligence, Surveillance + Reconnaissance Remote Sensing Sensors
3D Visualizer puts sensor feeds in context
TerraSight® Software

TerraSight real-time video processing software enables C4ISR competencies and increases mission capability for diverse groups of military and non-military users—from tactical operators and image analysts to mission commanders and border patrol officers.

Topics: 3D + Virtual Environments Border Security Computer Vision Force Protection Intelligence, Surveillance + Reconnaissance Mobile Device Applications Remote Sensing Sensors

Press Releases

soldiers training
Demo Day at Quantico to Show Augmented Reality Technology Advancing Real-World Military Training

Augmented reality demo at Quantico to show latest capabilities for military training.

Topics: 3D + Virtual Environments Computer Vision Counter-Terrorism Force Protection Homeland Security + National Defense Training Systems
Aurora Skate
Aurora and SRI International Sarnoff Integrate On-Board Video Processing into Skate SUAS

Aurora Flight Sciences and SRI International Sarnoff today announced the integration of the SRI Sarnoff DL Micro™ digital data link and video processor into the Aurora Skate® Small Unmanned Aerial System (SUAS). This pairing maximizes the real-time delivery of quality video from the SUAS.

Topics: Border Security Computer Vision Counter-Terrorism Force Protection Homeland Security + National Defense Intelligence, Surveillance + Reconnaissance
HGH Infrared Systems and SRI International Sarnoff to Demonstrate Mobile Situational Awareness Solution at ASIS International

SRI International Sarnoff and HGH Infrared Systems will launch a new mobile situational awareness solution in booth 120 at the ASIS International tradeshow for the security industry on Sept. 10 – 13, in Philadelphia, Pa.

Topics: Border Security Computer Vision Force Protection Homeland Security + National Defense Intelligence, Surveillance + Reconnaissance Sensors
SRI International Researchers Ajay Divakaran and Andreas Stolcke Honored as IEEE Fellows

SRI International Researchers Ajay Divakaran and Andreas Stolcke Honored as IEEE Fellows. Divakaran was honored for his contributions to multimedia content analysis. Stolcke was honored for his contributions in statistical language modeling, and automatic speech recognition and understanding.

Topics: Computer Vision
warfighter holding unmanned aerial vehicle (UAV)
SRI International Sarnoff Miniature Digital Data Link Delivers Improved Video from Unmanned Systems

A new digital data link and video processor from SRI Sarnoff enhances the quality of video images transmitted from unmanned aerial and ground vehicles. The DL Micro™ ultra-compact module increases image compression efficiency to improve the clarity and usefulness of video from moving vehicles.

Topics: Border Security Computer Vision Counter-Terrorism Force Protection Homeland Security + National Defense
Acadia ILS-6500
SRI International Sarnoff to Launch Acadia ILS-6500™ Video Stabilizer and Encoder at ASIS 2012

SRI Sarnoff will introduce its Acadia® ILS-6500™ video stabilizer and encoder at ASIS 2012. SRI Sarnoff’s Acadia ILS-6500 combines real-time electronic image stabilization with H.264 encoding for improved distribution of quality video.

Topics: Border Security Computer Vision Counter-Terrorism Force Protection Homeland Security + National Defense Intelligence, Surveillance + Reconnaissance
Warfighters
TerraSight® EX Expeditionary System Launches at AUSA 2012

The TerraSight® EX video exploitation system, a compact, lightweight expeditionary version of the proven TerraSight platform, was introduced today by SRI International Sarnoff.

Topics: 3D + Virtual Environments Border Security Computer Vision Force Protection Homeland Security + National Defense Intelligence, Surveillance + Reconnaissance Remote Sensing Sensors

SRI In the News

Augmented Reality

This article reports that SRI International Sarnoff is working with the Marine Corps Warfighting Laboratory (MCWL) to further develop virtual reality technology for military training.

Topics: 3D + Virtual Environments Computer Vision Counter-Terrorism Training Systems
Augmented Reality: Where the Real and Virtual Worlds Meet

This article about augmented reality (AR) reports that “In the defense arena, augmented reality has been used to train warfighters, provide them with timely information during battles, and help them maintain and repair equipment while deployed,” said Rakesh Kumar and Supun Samarasekera

Topics: 3D + Virtual Environments Computer Vision Counter-Terrorism Training Systems
DL Micro Digital Data Link and Video Processor - AUVSI Unmanned Systems 2012

This video interview with Mike Melle, product director at SRI International, was taken at the recent AUVSI Unmanned Systems tradeshow in Las Vegas, NV, and showcases SRI Sarnoff’s new DL Micro digital data link and video processor.

Topics: Computer Vision Counter-Terrorism Force Protection Homeland Security + National Defense Intelligence, Surveillance + Reconnaissance
For ISR, A View of Full Motion Video

This article reports that SRI International’s TerraSight software has been deployed by all branches of the U.S. military and utilizes image processing to show multiple full motion video feeds in the context of other sensors, such as data from radar and from unattended ground stations.

Topics: 3D + Virtual Environments Border Security Computer Vision Force Protection Homeland Security + National Defense Intelligence, Surveillance + Reconnaissance Mobile Device Applications Remote Sensing
Marines Get Virtual Explosions in the Real World

This article reports that a U.S. Marine Corps prototype training system, which uses augmented reality to digitally superimpose objects upon a real landscape, was demonstrated earlier this month at SRI International Sarnoff in Princeton, NJ.

Topics: 3D + Virtual Environments Computer Vision Force Protection Training Systems
Our Web Videos Reveal More Than We Realize, and Perhaps More Than We Want

This article reports that there is now technology to find and track objects in a video. “For some classes of objects, like faces, people—to some extent vehicles—the capabilities are mature,” says SRI’s Harpreet Sawhney, technical director of vision and learning systems.

Topics: Computer Vision Counter-Terrorism
Robot Vehicles Invade Las Vegas

According to this blog post highlighting technology from AUVSI 2012, “SRI International demonstrated a digital image stabilization system that was attached to a quadrotor. The video was rock solid when stabilization was on.”

Topics: Border Security Computer Vision Counter-Terrorism Force Protection Homeland Security + National Defense Intelligence, Surveillance + Reconnaissance

Events

United States Geospatial Intelligence Foundation (USGIF) Technology Day

SRI will demonstrate software and systems for the processing and exploitation of video, imagery, wide-area airborne surveillance, and LIDAR.

Topics: Computer Vision Force Protection Intelligence, Surveillance + Reconnaissance

Publications

Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography

In 1981 SRI introduced RANSAC, a now widely referenced paradigm for robust communication ideally suited to computer vision (a type of artificial intelligence used in image analysis.

Topics: Artificial Intelligence Computer Vision
Generated 3D Model

More Videos (5)

Divisions, Centers + Labs