Skip to content

Conversation

@mrubens
Copy link
Collaborator

@mrubens mrubens commented Dec 5, 2025

Important

Reduces maxTokens to 16,384 for multiple models in baseten.ts and adds supportsNativeTools to deepseek-ai/DeepSeek-V3.2.

  • Behavior:
    • Reduces maxTokens to 16,384 for models in baseten.ts, including moonshotai/Kimi-K2-Thinking, zai-org/GLM-4.6, and deepseek-ai/DeepSeek-R1, among others.
    • Adds supportsNativeTools: true to deepseek-ai/DeepSeek-V3.2 in baseten.ts.

This description was created by Ellipsis for 32cc0a2. You can customize this summary. It will automatically update as commits are pushed.

@mrubens mrubens requested review from cte and jr as code owners December 5, 2025 17:43
@dosubot dosubot bot added the size:S This PR changes 10-29 lines, ignoring generated files. label Dec 5, 2025
@roomote
Copy link
Contributor

roomote bot commented Dec 5, 2025

Rooviewer Clock   See task on Roo Cloud

Review complete. No issues found.

The PR updates Baseten model definitions by reducing maxTokens to 16,384 across multiple models and adds native tool support to DeepSeek-V3.2. All changes comply with the type schema and won't cause breaking changes.

Mention @roomote in a comment to request specific changes to this pull request or fix all unresolved issues.

@hannesrudolph hannesrudolph added the Issue/PR - Triage New issue. Needs quick review to confirm validity and assign labels. label Dec 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Issue/PR - Triage New issue. Needs quick review to confirm validity and assign labels. size:S This PR changes 10-29 lines, ignoring generated files.

Projects

Status: Triage

Development

Successfully merging this pull request may close these issues.

3 participants