Zoox
AI

PhD Research Intern, Multi-Modal Foundation Encoder for Perception

Zoox · Foster City, CA · $45k - $75k

Actively hiring Posted about 2 months ago

About Our Internship Program

 

Zoox’s internship program offers hands-on experience with cutting-edge technology, mentorship from some of the industry’s brightest minds, and the opportunity to make meaningful contributions to real projects. We seek interns who demonstrate strong academic performance, engagement beyond the classroom, intellectual curiosity, and a genuine interest in Zoox’s mission.


Project Overview

 

During this internship, you will lead the development of a multi-modality (vision, LiDAR, Radar, and language), temporal foundation encoder to support 3D object detection & tracking, 3D segmentation (occupancy), and live maps. This Multi-Modal Foundation Encoder (MMFE) is a critical key to achieving End-to-End Perception at Zoox.

Your research will aim to significantly improve system performance on long-tail events and rare classes by utilizing a large-capacity foundation model to learn rich representations across different sensor modalities. Additionally, the project aims to improve perception in adverse environmental conditions (such as medium to heavy rain and fog, reducing false positives on water splashes or dust particles) , achieve long-range sensing for highway driving , and build robustness to occlusion.

This is a highly research-driven role with the goal of publication. You will have the opportunity to explore novel directions such as tri-modal foundation models with self-supervised pre-training, radar-language grounding for zero-shot detection, efficient sensor fusion via sparse cross-attention, or integrating 3D Gaussian Splats for dynamic agent geometry and streaming sparse Gaussian occupancy prediction.

Requirements:

  • Currently working towards a Ph.D., or advanced degree in a relevant engineering program

  • Good academic standing

  • Able to commit to a 12-week internship during one of the following summer 2026 cohorts: May 18th - August 7th, OR May 26th - August 14th, OR June 15th - September 4th

  • At least one previous industry internship, co-op, or project completed in a relevant area

  • Ability to relocate to the Bay Area, California (or Boston, Massachusetts) for the duration of the internship

  • Interns at Zoox may not use any proprietary information they are working on as part of their thesis, any published work with their university, or to be distributed to anyone outside of Zoox

Qualifications (It’s helpful if you meet a majority of the following qualifications, but it isn’t a requirement):

  • Currently enrolled in a Ph.D. program in Computer Science, Electrical/Computer Engineering, Robotics, or a related field with a focus on Deep Learning, Computer Vision, or Autonomous Driving.

  • Publication record in top-tier AI/Robotics conferences (e.g., CVPR, ICCV, ECCV, NeurIPS, ICLR, ICRA).

  • Prior experience designing and training foundation models (such as World Models, VLMs, LLMs, or VLAs) using large-scale multi-modal autonomous driving datasets.

  • Hands-on experience developing deep learning models for 3D object detection, tracking, or 3D segmentation.

  • Experience working with multi-modal sensor data, specifically combining representations from vision, LiDAR, Radar, or language.

Bonus Qualifications

  • Experience with 4D radar object detection or handling sensor data in adverse weather conditions.

  • Experience with cross-modal alignment for zero-shot detection.

  • Familiarity with 3D Gaussian Splatting, voxel grid representations, or streaming sparse occupancy prediction.

  • Experience with self-supervised pre-training or masked sensor modeling.

Compensation:
The monthly salary for this position is $9,500. Compensation will vary based on geographic location. Additional benefits may include medical insurance, and a housing stipend (relocation assistance will be offered based on eligibility).
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Tags & focus areas

Used for matching and alerts on DevFound
Research Intern Entry Level
Common Questions

Frequently asked questions

Quick answers about how DevFound's AI matching, resumes, and referrals work.

DevFound's AI Copilot ingests your profile, goals, and live job data to deliver curated matches in seconds. Every match includes a resume variant, suggested referrals, and interview prep so you can act immediately. The more feedback you provide, the sharper the Copilot becomes.

AI-led job searches shrink the hours spent sifting through boards and formatting resumes. DevFound pairs automation with your personal outreach, so you reserve energy for interviews and negotiation. Traditional networking still matters, but AI gives you a lift before you even send a message.

Modern AI roles expect comfort with production-grade code, data fluency, and practical ML tooling. The strongest candidates pair deep technical chops with storytelling—translating model impact to product, GTM, and exec partners. Continuous learning keeps you ahead as stacks evolve.

DevFound rewards active seekers. Keep your profile fresh, respond to match quality prompts, and enable alerts so you never miss a role. The AI prioritizes companies and teams that align with your feedback, accelerating both introductions and interview invites.

High-density tech hubs continue to host the deepest AI talent pools, yet distributed teams are catching up fast. Use DevFound filters to hone in on onsite, hybrid, or fully remote roles and watch openings expand across time zones.

DevFound aggregates thousands of remote AI openings and flags the nuances—core hours, async culture, and visa needs—up front. The Copilot also recommends how to position your distributed work experience so hiring managers know you can thrive on a remote team.