BriefsToolAvailable now
Amazon SageMaker AI adds custom sequence lengths for serverless model customization
Amazon SageMaker AI now allows configuring sequence lengths for serverless model customization jobs instead of using fixed lengths.
Summary
Amazon SageMaker AI updated its serverless model customization jobs to support configurable sequence lengths. Users can now adjust these parameters up to the published model maximums for fine-tuning open-weight models.
What changed
- Configure the sequence length used during your serverless model customization job.
- Set the dataset_max_len hyperparameter for SFT and DPO jobs.
- Set max_prompt_length and max_response_length hyperparameters for RFT jobs.
Availability
Available now“Serverless model customization on SageMaker AI is available in US East (N. Virginia), US West (Oregon), Asia Pacific (Tokyo), and Europe (Ireland).”
Founder takeaway
If you use SageMaker AI for serverless model fine-tuning, check your model's published maximums and adjust sequence length hyperparameters to better fit your training data.
Source
Researched and drafted with AI from the official sources above, then checked automatically before publishing. Spotted a mistake? Tell us.
Related
More briefs
Vercel adds sandbox plugin support for running Paseo AI agents
Paseo now supports running AI agents in the cloud using the Vercel Sandbox plugin.
Vercel1 min read
Vercel introduces Virtual Models on AI Gateway for AI apps
Vercel released Virtual Models on AI Gateway to let developers manage model strings and fallbacks centrally.
Vercel1 min read
Vercel CLI allows AI agents to enable web analytics and observability
AI agents can now enable Web Analytics and Observability Plus for projects without requiring an interactive terminal.
Vercel1 min read
One email, every Monday
Briefs are published here through the day. Monday Heist is the email: one useful AI workflow, the files to use it, and the catch. The first issue is being prepared; subscribers get it first. Free, and you can leave in one click.
One email. Every Monday.