Publications

Real2Sem2Real: 3D Semantic Augmentations for Robot Learning from a Single Human RGB Demonstration

Matthew Strong*, Ankush K. Dhawan*, Julien Poffet, Giuse Pham, Jinho So, Monroe Kennedy III

In submission

Turns one human RGB video into thousands of robot demonstrations across a whole object category.

VisTacAlign: Co-Training Dexterous Policies on Tactile Human and Robot Demonstrations

Julien Poffet, Matthew Strong, Ankush Dhawan, Baiyu Shi, Shalika Neelaveni, Yujia Yuan, Zhenan Bao, Monroe Kennedy III

arXiv 2026

Co-trains dexterous policies on human and robot demonstrations by aligning vision, hand motion and touch.

J-PARSE: Jacobian-based Projection Algorithm for Resolving Singularities Effectively in Inverse Kinematic Control of Serial Manipulators

Shivani Guptasarma, Matthew Strong, HongHao Zhen, Monroe Kennedy III

T-RO 2026

Smooth inverse kinematics near singularities, so manipulators can use more of their workspace in servoing, teleoperation and learning.

UniQueR: Unified Query-based Feedforward 3D Reconstruction

Chensheng Peng, Quentin Herau, Jiezhi Yang, Yichen Xie, Yihan Hu, Wenzhao Zheng, Matthew Strong, Masayoshi Tomizuka, Wei Zhan

ECCV 2026

Feedforward 3D reconstruction as sparse 3D queries, inferring occluded geometry in a single forward pass.

MR. CRABS: Mobile RGB-D Camera-LIDAR Robot for Autonomous Bimanual Manipulation & Sensing

Giuse Pham*, Matthew Strong*, Alex Qiu, Joonwon Kang, Monroe Kennedy III

ICRA 2026 Workshop

A bimanual mobile robot with depth cameras, LIDAR and a pan-tilt camera for near-ground manipulation and search.

Learning to Drive is a Free Gift: Large-Scale Label-Free Autonomy Pretraining from Unposed In-The-Wild Videos

Matthew Strong, Wei-Jer Chang, Quentin Herau, Jiezhi Yang, Yihan Hu, Chensheng Peng, Wei Zhan

CVPR 2026

Pretrains a driving model on unlabeled, unposed videos, reaching state-of-the-art planning from a single front camera.

TensorTouch: Calibration of Tactile Sensors for High Resolution Stress Tensor and Deformation for Dexterous Manipulation

Won Kyung Do, Matthew Strong, Aiden Swann, Boshu Lei, Monroe Kennedy III

T-RO 2026

Calibrates optical tactile sensors to estimate stress tensors, deformation and force at pixel resolution.

SPACeR: Self-Play Anchoring with Centralized Reference Models

Wei-Jer Chang, Akshay Rangesh, Kevin Joseph, Matthew Strong, Masayoshi Tomizuka, Yihan Hu, Wei Zhan

ICLR 2026

Guides self-play driving RL with a pretrained motion model, matching human driving with 10x faster inference.

DexFruit: Dexterous Manipulation and Gaussian Splatting Inspection of Fruit

Aiden Swann*, Alex Qiu*, Matthew Strong, Angelina Zhang, Samuel Morstein, Kai Rayle, Monroe Kennedy III

RA-L 2025

Gentle robotic handling of fragile fruit with optical tactile sensing, plus 3D damage inspection with Gaussian splats.

Next Best Sense: Guiding Vision and Touch with FisherRF for 3D Gaussian Splatting

Matthew Strong*, Boshu Lei*, Aiden Swann, Wen Jiang, Kostas Daniilidis, Monroe Kennedy III

ICRA 2025 Oral

Chooses where to look and touch next to train few-shot Gaussian splats, guided by FisherRF.

Touch-GS: Visual-Tactile Supervised 3D Gaussian Splatting

Aiden Swann*, Matthew Strong*, Won Kyung Do, Gadiel Sznaier Camps, Mac Schwager, Monroe Kennedy III

IROS 2024 Oral

Combines vision and touch to build Gaussian splats of hard scenes: few views, mirrors, transparent objects.

SHIRO: Soft Hierarchical Reinforcement Learning

Kandai Watanabe*, Matthew Strong*, Omer Eldar

arXiv 2022

Soft hierarchical reinforcement learning that speeds up learning on hard locomotion tasks.

Individualized Empirical Baselines for Evaluating the Energy Performance of Existing Buildings

Yingli Lou, Yunyang Ye, Yizhi Yang, Wangda Zuo, Gang Wang, Matthew Strong, Satish Upadhyaya, Chris Payne

STBE 2022

Empirical baselines for evaluating the energy performance of existing buildings.

Evaluating Performance of Different Generative Adversarial Networks for Large-Scale Building Power Demand Prediction

Yunyang Ye, Matthew Strong, Yingli Lou, Cary A. Faulkner, Wangda Zuo, Satish Upadhyaya

Energy and Buildings 2022

Compares types of GANs for large-scale building power demand prediction.

Volumetric Data Fusion of External Depth and Onboard Proximity Data For Occluded Space Reduction

Matthew Strong*, Caleb Escobedo*, Alessandro Roncone

IROS 2021 Workshop

Fuses external depth and onboard proximity data into a 3D map, shrinking the space a robot must treat as unknown.

Self-Contained Kinematic Calibration of a Novel Whole-Body Artificial Skin for Human-Robot Collaboration

Kandai Watanabe, Matthew Strong, Mary West, Caleb Escobedo, Ander Aramburu, Krishna Chaitanya Kodur, Alessandro Roncone

IROS 2021

Self-calibration of a robotic skin placed anywhere on an arm, for physical human-robot interaction.

Contact Anticipation for Physical Human-Robot Interaction with Robotic Manipulators using Onboard Proximity Sensors

Caleb Escobedo*, Matthew Strong*, Mary West, Ander Aramburu, Alessandro Roncone

IROS 2021

Onboard proximity sensors let a robot arm anticipate and react to contact with people.

Development of New Baseline Models for U.S. Medium Office Buildings Based on Commercial Buildings Energy Consumption Survey Data

Yunyang Ye, Yingli Lou, Matthew Strong, Satish Upadhyaya, Wangda Zuo, Gang Wang

STBE 2020

New energy-use baseline models for U.S. medium office buildings in different environments.

Theses

Enabling Close Proximity Human Robot Collaboration via Distributed, Self-Calibrating Robotic Skin

Matthew Strong

Undergraduate Thesis 2021

My undergraduate thesis, covering two years of research on robotic skin for close human-robot collaboration.