Training at scale

Large multimodal models are only as good as the system that trains them. At Amazon I worked on the distributed training infrastructure behind the team’s VLM-based models.

Distributed training platform on Ray

I worked on an internal distributed training platform built on Ray. The platform delivered two generations of VLM-based models.

  • Role: contributor
  • Built on: Ray
  • Status: internal platform, two model generations delivered