About Me

I am a Ph.D. student at GRASP Lab, University of Pennsylvania, advised by Prof. Nadia Figueroa. I want robot manipulation policies that are interactive and scalable. To get there, I have worked on data-efficient learning, learning beyond teleoperation, and force-aware manipulation. I am also passionate about designing innovative hardware.

Before coming to Penn, I received my MS in Robotics from Northwestern University and BS in Aerospace Engineering from UIUC.

News

May 2026 - Joining Dyna Robotics as a Research Intern.
May 2026 - VLMgineer is featured on Penn Today and Penn Engineering.
May 2026 - Invited talk on Flow with the Force Field at Nvidia Dex Team.
Feb 2026 - Flow with the Force Field is accepted to ICRA 2026.
Feb 2026 - VPP is accepted to ICRA 2026.
Jan 2026 - VLMgineer is accepted to ICLR 2026.

Show more

Sep 2025 - Joining Amazon Robotics as an intern working on Vulcan Stow.
Jun 2025 - EMP is accepted to IROS 2025.
Jun 2025 - OCR is accepted to IROS 2025.
April 2025 - Presented as a spotlight speaker at the ICRA 2025 Doctoral Consortium.
April 2025 - EMP is accepted as a spotlight paper @ Workshop on Structured Learning, ICRA 2025.

Research

Dreaming the Sound of Contact: Leveraging Video and Audio Generation for Zero-Shot Force-Aware Manipulation

Dreaming the Sound of Contact: Leveraging Video and Audio Generation for Zero-Shot Force-Aware Manipulation

In Submission{Guanhua Ji*, Tianyu Li*}, Dayoon Suh, Yuqian Zhang, Boyan Zhang, Nadia Figueroa

We present a pipeline that jointly leverages generated video and audio to recover both motion trajectories and contact force profiles from a single task description, enabling zero-shot force-aware manipulation where a kinematic-only baseline fails. Also presented at the Workshop on Manipulation Robustness: Towards Human-Level Robustness under Real-World Challenges, ICRA 2026.

Flow with the Force Field: Learning 3D Compliant Flow Matching Policies from Force and Demonstration-Guided Simulation Data

Flow with the Force Field: Learning 3D Compliant Flow Matching Policies from Force and Demonstration-Guided Simulation Data

ICRA 2026{Tianyu Li*, Yihan Li*}, Zizhe Zhang, Nadia Figueroa

We introduce a framework for generating force-informed data in simulation, instantiated by a single human demonstration, and show how coupling with a compliant policy improves the performance of a visuomotor policy learned from synthetic data. Also presented at the Workshop on Contact and Impact-aware Manipulation and the Workshop on Exploring the Role of Energy in Robot Learning and Control, IROS 2025.

VLMgineer: Vision Language Models as Robotic Toolsmiths

VLMgineer: Vision Language Models as Robotic Toolsmiths

ICLR 2026{George Jiayuan Gao*, Tianyu Li*}, Junyao Shi, {Yihan Li†, Zizhe Zhang†}, Nadia Figueroa, Dinesh Jayaraman

We introduce VLMgineer, a novel VLM-driven evolutionary framework that automatically co-design tools and actions to solve robotics task. Also presented at the Workshop on Robot Hardware-Aware Intelligence, RSS 2025.

VPP-TC: Viability-Preserving Passive Torque Control

VPP-TC: Viability-Preserving Passive Torque Control

ICRA 2026{Zizhe Zhang*, Yicong Wang*}, Zhiquan Zhang, Tianyu Li*, Nadia Figueroa

A quadratic programming-based control framework enforces viability theory constructed constraints on a passive controller tracking a dynamical system, ensuring the robot states remain within the safe set in an infinite time horizon. Best Paper Award at the Workshop on Exploring the Role of Energy in Robot Learning and Control and Best Student Paper Award at the Workshop on Building Safe Robots, IROS 2025.

Elastic Motion Policy: An Adaptive Dynamical System for Robust and Efficient One-Shot Imitation Learning

Elastic Motion Policy: An Adaptive Dynamical System for Robust and Efficient One-Shot Imitation Learning

IROS 2025Tianyu Li, Sunan Sun, Shubhodeep Shiv Aditya, Nadia Figueroa

A one-shot stable imitation learning framework that allows robots to adjust their behavior based on the scene change while respecting the task specification. Spotlight Paper at the Workshop on Structured Learning for Efficient, Reliable, and Transparent Robots, ICRA 2025.

MORF: Magnetic Origami Reprogramming and Folding System for Repeatably Reconfigurable Structures with Fold Angle Control

MORF: Magnetic Origami Reprogramming and Folding System for Repeatably Reconfigurable Structures with Fold Angle Control

ICRA 2025Gabriel Unger, Sridhar Shenoy, Tianyu Li, Nadia Figueroa, Cynthia Sung

We introduce MORF, a magnetic origami system that folds sheets into rigid, repeatedly reprogrammable structures with controllable fold angles, enabling adaptive robotic tools that can be reshaped for new tasks instead of rebuilt.

Out-of-Distribution Recovery with Object-Centric Keypoint Inverse Policy For Visuomotor Imitation Learning

Out-of-Distribution Recovery with Object-Centric Keypoint Inverse Policy For Visuomotor Imitation Learning

IROS 2025George Jiayuan Gao, Tianyu Li, Nadia Figueroa

An object-centric recovery policy that detects when an imitation policy drifts out of distribution and steers it back via object keypoints, with no extra data. Spotlight Paper at the Workshop on Lifelong Learning for Home Robots, CoRL 2024.

Constrained Passive Interaction Control: Leveraging Passivity and Safety for Robot Manipulators

Constrained Passive Interaction Control: Leveraging Passivity and Safety for Robot Manipulators

ICRA 2024Zhiquan Zhang, Tianyu Li, Nadia Figueroa

A control architecture for torque-controlled robots that enforces safety constraints such as joint limits, self-collisions, external collisions, and singularities, while staying passive whenever the constraints allow.

Learning Safe and Stable Motion Plans with Neural Ordinary Differential Equations

Learning Safe and Stable Motion Plans with Neural Ordinary Differential Equations

ICRA 2024Farhad Nawaz, Tianyu Li, Nikolai Matni, Nadia Figueroa

A motion planning approach that learns plans with Neural Ordinary Differential Equations and certifies stability with Control Lyapunov Functions and safety with Control Barrier Functions, so learned motions stay stable and safe.

Constraint-Aware Intent Estimation for Dynamic Human-Robot Object Co-Manipulation

Constraint-Aware Intent Estimation for Dynamic Human-Robot Object Co-Manipulation

RSS 2024Yifei Simon Shao, Tianyu Li, Shafagh Keyvanian, Pratik Chaudhari, Vijay Kumar, Nadia Figueroa

A dynamical-system representation for estimating human intent during dynamic object co-manipulation that accounts for the constraints of the human, letting the robot anticipate and follow its partner's motion.

Task Generalization with Stability Guarantees via Elastic Dynamical System Motion Policies

Task Generalization with Stability Guarantees via Elastic Dynamical System Motion Policies

CoRL 2023Tianyu Li, Nadia Figueroa

A learning-from-demonstration method that encodes motion policies as elastic dynamical systems, so a learned policy adapts to new environment constraints without new demonstrations while preserving stability guarantees.

Directionality-Aware Mixture Model Parallel Sampling for Efficient Linear Parameter Varying Dynamical System Learning

Directionality-Aware Mixture Model Parallel Sampling for Efficient Linear Parameter Varying Dynamical System Learning

RA-LSunan Sun, Haihui Gao, Tianyu Li, Nadia Figueroa

A novel statistical model that applies the Riemannian metric on the n-sphere to efficiently blend non-Euclidean directional data with Euclidean states for learning stable, time-independent motion policies

Past Projects

Planning & Prediction with Human Preference via Deep Inverse Reinforcement Learning

Planning & Prediction with Human Preference via Deep Inverse Reinforcement Learning

[website]

Using maximum entropy deep IRL to learn agent preference in continuous environment path planning

Using Rethink Sawyer Robot Arm to Play Yoyo

Using Rethink Sawyer Robot Arm to Play Yoyo

[website]

Developed software and hardware pipeline to play yoyo with visual feedback control on the Sawyer Robot arm

Data-driven Receding Horizon Control with the Koopman Operator

Data-driven Receding Horizon Control with the Koopman Operator

[website]

Performed receding horizon control using data-driven approach with small data in a continuous space