GCP Vertex AI

[ziiw]

Hello,

Thanks for the project, it's really refreshing to see that kind of open source initiative.

I would like to propose the Google Vertex AI integration. ≠ Google AI Studio.

Vertex AI is usually used for companies that already have a GCP account. The authentication works a bit differently since it needs to use a file generated by the gcloud CLI.

Cline VSCode extension has an implementation working.

Happy to work on this if possible,

Thanks !

[andrewpareles]

Yes, we want to add support for the common cloud providers (Vertex, Azure AI Foundry).

Happy to assign this to you! If you search for the word groq in the repo, you should get a sense of how providers work. Can also talk and help you get set up 😄

[hongkongkiwi]

Be great to add Gemini as it's cheaper than Vertex. Vertex can use Gemini, but they charge per character, whereas Gemini charges per token.

[ziiw]

Vertex is needed for companies where they use Vertex. The difference is that Vertex needs gcloud-sdk to authenticate the project. It's working locally, I'll push an PR soon

[andrewpareles]

@ziiw Great!

[andrewpareles]

@ziiw Lmk if you need any help with this