Make Vertex Gemini use built-in structured output for .withStructuredOutput

[jacoblee93]

Privileged issue

• I am a LangChain maintainer, or was asked directly by a LangChain maintainer to create an issue here.

Issue Content

@afirstenberg

[afirstenberg]

See
https://ai.google.dev/gemini-api/docs/structured-output?lang=rest

Probably should double-check to make sure which models can handle it, but I'm pretty sure most that have functions do. I just can't find the date it was first made available.

@jacoblee93 - Feel free to assign this to me, but I'm also happy if anyone gets to this before I do.

[jacoblee93]

You're the best!

[kashifmin]

@afirstenberg native structured output would be great, let me know if you need any help testing this!

[dosubot]

Hi, @jacoblee93. I'm Dosu, and I'm helping the LangChain JS team manage their backlog. I'm marking this issue as stale.

Issue Summary

• Enhancement request for Vertex Gemini to support structured output via .withStructuredOutput.
• @afirstenberg shared documentation and offered to work on the issue.
• @kashifmin showed interest and offered help with testing.

Next Steps

• Please confirm if this issue is still relevant to the latest version of LangChain JS. If so, feel free to comment to keep the discussion open.
• If there is no further activity, the issue will be automatically closed in 7 days.

Thank you for your understanding and contribution!