Machine & Robot Learning Engineer · Bengaluru, India

Soham Shinde

I build data and model flywheels for robot learning at Clutterbot. My work also includes training and deploying policies on the edge.

Portrait view
Soham Shinde taking a mirror photo, wearing white headphones and a black backpack
YOLO11x-seg (COCO) + YOLO11x-pose (COCO)

Both the models ran once on this photo, offline. The page does not run a model, and the errors stay visible.

Work

Newest first.

  1. May 2025 to present

    ClutterbotMachine Learning Engineer

    Data pipelines and policy training for Robot Learning.

    • I build data and ML infrastructure for VLA pipelines, including the processing that turns robot recordings into training datasets: timestamp alignment, resampling and validation.
    • I run policy-training experiments with models like SmolVLA, NVIDIA GROOT, Pi0.5, etc, and test them on robot hardware.
    • I deploy computer vision pipelines on Qualcomm DragonWing and NVIDIA edge hardware. Earlier, I trained the segmentation and detection models for our indoor robots.
    • LeRobot
    • ROS2
    • Qualcomm DragonWing
    • GStreamer
  2. Jul 2024 to May 2025

    Nanyang Technological UniversityResearch Associate

    As a part of my Bachelor’s Thesis, I built and benchmarked a Video Vision Transformer (ViViT) for classroom activity recognition. Used saliency maps to inspect the regions associated with model predictions. With Dr. Yuvaraj and Dr. Amalin, also worked on gaze estimation for student-engagement measures.

    • Gaze Estimation
    • ViViT
    • Kinetics-400
  3. Jun 2024 to Aug 2024

    TCS ResearchIntern

    Built a PyQt5 based annotation tool around Segment Anything (SAM) for AI-assisted image annotation. Automated the stitching of segmented regions into larger sub-scenes for scene understanding.

    • Computational Creativity
    • SAM2
    • PyQt5
  4. May 2023 to Aug 2023

    CSIR-CEERI, PilaniResearch Intern

    Segmented and restored deteriorated Rajasthani murals under Dr. Dhiraj Sangwan. Compared U-Net++, DeepLabV3+, PSPNet and FPN for damage segmentation, and generated synthetic damage with StyleGAN2-ADA.

    • U-Net++
    • DeepLabV3+
    • StyleGAN2-ADA

Projects

Tools and research projects, newest first.

  1. 2026

    trtcheckopen source, MIT

    Built a tool that checks ONNX models for TensorRT compatibility before engine compilation, with static checks that need no GPU.

  2. Feb 2024 to May 2024

    CloSe++with Dr. Garvita Tiwari

    Extended CloSe-Net for 3D clothing segmentation from coloured point clouds, with sharper edges between garments and automatic clothing-type detection.

  3. Oct 2022 to Aug 2023

    Project Visiowith Prof. Sougata Sen

    Smart glasses for visually impaired people, with TinyML object detection on ESP microcontrollers and an Android companion app.

  4. Sep 2022 to Jan 2023

    Project KratosBITS Goa Mars rover

    Worked on autonomous navigation for the BITS Goa student Mars rover: ROS path planning with A*, Dijkstra and SLAM, run in Gazebo on an NVIDIA Jetson Xavier.

Papers

Research work.

Munch painting of figures on a bridge, recoloured by region to show the sub-scene segmentation
Research figure

Subscene Segmentation for Artwork Scene Understanding

Soham Shinde, Vikram Jamwal

ECCV AI4VA Workshop

Groups the segmented regions of a painting into larger sub-scenes for scene understanding.

From the CVIP 2023 paper

Restoring a Rajasthani mural

Move the slider to compare the damaged image with the model output. Select “Damage mask” to show the predicted damaged regions.

The model fills damaged areas with generated content. It does not recover the exact original painting. CSIR-CEERI, 2023.

A Rajasthani mural of three figures, shown damaged and as model output, with the predicted damage mask

About

Education
BITS Pilani, K.K. Birla Goa Campus (opens in a new tab)

B.E. Electronics & Communication Engineering

Minor in Data Science · Graduated July 2025

Outside work
  • Spot me with a Uke
  • Bouldering
  • Probably sipping on coffee

Contact

sohams.web@gmail.com

Email me about robotics, computer vision, or ML engineering queries or roles.