• Skip to primary navigation
  • Skip to main content
SRI logo
  • About
    • Press room
    • Our history
  • Expertise
    • Advanced imaging systems
    • Artificial intelligence
    • Biomedical R&D services
    • Biomedical sciences
    • Computer vision
    • Cyber & formal methods
    • Education and learning
    • Innovation strategy and policy
    • National security
    • Ocean & space
    • Quantum
    • Robotics, sensors & devices
    • Speech & natural language
    • Video test & measurement
  • Ventures
  • NSIC
  • Careers
  • Contact
  • 日本支社
Search
Close

Machine learning

CONTACT US

SRI has a rich history of R&D in machine learning, including enabling computer image sensors to sense, learn, and adapt to capture actionable information. CVT’s recent work has focused on deep learning and reinforcement learning for several applications, including Explainable Artificial Intelligence (XAI), Learning with Less Labels (LwLL), the Science of Artificial Intelligence and Learning for Open World Novelty (SAIL ON), Competency Aware Machine Learning (CAML), Lifelong Learning, Creative Artificial Intelligence, Approximate Computing, and Robust Artificial Intelligence.  

Graph of effectiveness of current AI vs Lifelong learning AI

Explainable AI, competency aware machine learning

CVT’s focus is on extending the state of the art in machine learning beyond supervised learning with large training datasets as well as human-intelligible explanations of machine learning techniques. In the DARPA XAI program, CVT developed new visual attention-based techniques to display where the machine learning-based question answering system has gone wrong and why. In the DARPA CAML program, SRI has developed new calibration techniques that help accurately predict actual performance by a machine learning algorithm in a new domain. 

Lifelong learning, handling surprise, learning with less labels

To get computers to learn from tasks they perform, CVT is developing lifelong learning algorithms and systems with machine learning capabilities to continuously learn over a stream of tasks (e.g., classification, autonomy tasks etc., over its lifetime) by leveraging the learned knowledge between related tasks to generalize to other tasks. To achieve the desired lifelong learning goals, CVT is working to solve the challenges of catastrophic forgetting, which is the problem of computers starting each task with no prior knowledge. 

In the DARPA LwLL (Learning with Less Labels) and others programs, SRI has developed multiple techniques for learning from very little data.  SRI has developed a Domain Adaptive Active Meta-Learning approach through active sampling of data to maximize information gain from each sample. We have also developed Hybrid Consistency Training to jointly leverage interpolation consistency, including interpolating hidden features, that imposes linear behavior locally and data augmentation consistency that learns robust embeddings against sample variations. We also use unlabeled examples to iteratively normalize features and adapt prototypes, as opposed to commonly used one-time update, for more reliable prototype-based transductive inference. Finally, we propose a modular adaptation method that selectively performs multiple state-of-the-art adaptation methods in sequence. As different downstream tasks may require different types of adaptation, our modular adaptation enables the dynamic configuration of the most suitable modules based on the downstream task. Our methods improve over the state of the art.

YouTube player

In the DARPA SAIL ON (Science of Artificial Intelligence and Learning for Open-world Novelty program), CVT developed predictive coding-based techniques for detection of novelties in new worlds. We have developed symbolic-based planning to detect novel situations in the environment. For the visual domain, we exploit the Open-AI CLIP neural model to generate embedding features. We use these embedding features to detect out distribution entities and visual novelties.  

Approximate computing

Driven to reach ultra-low power embedded and edge-based computing solutions CVT developed our approximate computing BitNet technology.  BitNet gives edge devices more computational range and battery longevity on the same COTs hardware.   

Robust AI 

Deep learning networks are vulnerable to so-called Trojan attacks in which the adversary poisons the training data with specially designed patterns that induce erratic behavior in the network when certain data, termed “triggers, “ are presented to it. CVT developed reverse engineering techniques to reconstruct possible trojan triggers, and studied the behavior of networks in response to such triggers so as to detect whether they have been the victims of a trojan attack. SRI’s techniques have been applied to Image Classification and Question answering and sentiment extraction using text. SRI’s techniques exploit logical constraints that impose compactness on the networks as well as sparsity of the attacks since they aim to go undetected. SRI’s techniques have advanced the state of the art in trojan detection and have achieved results that rank in the top three performers consistently. 

On DARPA GARD (Guaranteeing AI Robustness Against Deception), CVT addressed the need for developing methods for building attack-agnostic robustness into machine learning (ML) architectures.  Using an information-theoretic analysis framework, SRI’s GARD program developed multiple worst-case theoretical guarantees underlying different defensive approaches. Our metrics enable ranking of state-of-the-art (SOTA) Deep Neural Networks (DNNs) in terms of robustness and have paved the way towards safety standards for DNNs deployed in critical DoD applications.  

  • Researchers have demonstrated effective attacks on ML algorithms.  On DARPA QED (Quantifying Ensemble Diversity for Robust Machine Learning), CVT researched developing effective defenses against such attacks which is essential if ML is to be used for defense, security, or health and safety applications.  CVT developed an approach to dynamically change network DDNN eights and activations based on stochastic quantization (or generator) of a pre-trained neural network.  We showed our moving ensemble approach improved protection of a network against attacks.  

Recent work

SRI Artificial Intelligence System that Continually Learns

Seeing the things that matter most

SRI Ventures’ Latent AI named to the 2021 CB Insights AI 100 List of Most Innovative Artificial Intelligence Startups

Recent publications

more +
  • March 27, 2023

    Night-Time GPS-Denied Navigation and Situational Understanding Using Vision-Enhanced Low-Light Imager

    Han-Pang Chiu, Supun Samarasekera, Rakesh Kumar
  • March 25, 2023

    Cross-View Visual Geo-Localization for Outdoor Augmented Reality

    Han-Pang Chiu, Supun Samarasekera, Rakesh Kumar
  • November 3, 2022

    Sensor Control for Information Gain in Dynamic, Sparse and Partially Observed Environments

    Aravind Sundaresan, Pedro Sequeira, Vidyasagar Sadhu

Featured publications

NOVEMBER 19, 2020

Hybrid Consistency Training with Prototype Adaptation for Few-Shot Learning

SRI authors: Yi Yao, Ajay Divakaran

OCTOBER 25, 2021

Generating and Evaluating Explanations of Attended and Error-Inducing Input Regions for VQA Models

SRI authors: Ajay Divakaran, Yi Yao

APRIL 1, 2021

Modular Adaptation for Cross-Domain Few-Shot Learning

SRI authors: Ajay Divakaran, Yi Yao

APRIL 1, 2021

Confidence Calibration for Domain Generalization under Covariate Shift

SRI authors: Yi Yao, Ajay Divakaran, Melinda Gervasio

JUNE 8, 2021

Comprehension Based Question Answering using Bloom’s Taxonomy

SRI authors: Ajay Divakaran, Sara Rutherford-Quach

How can we help?

Once you hit send…

We’ll match your inquiry to the person who can best help you.

Expect a response within 48 hours.

Career call to action image

Make your own mark.

Search jobs

Our work

Case studies

Publications

Timeline of innovation

Areas of expertise

Institute

Leadership

Press room

Media inquiries

Compliance

Careers

Job listings

Contact

SRI Ventures

Our locations

Headquarters

333 Ravenswood Ave
Menlo Park, CA 94025 USA

+1 (650) 859-2000

Subscribe to our newsletter


日本支社
SRI International
  • Contact us
  • Privacy Policy
  • Cookies
  • DMCA
  • Copyright © 2023 SRI International
Manage Cookie Consent
To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions.
Functional Always active
The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.
Preferences
The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.
Statistics
The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.
Marketing
The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.
Manage options Manage services Manage vendors Read more about these purposes
View preferences
{title} {title} {title}