Dapr Conversation API - DeepSeek with Ollama?

[thangchung]

Describe the feature

Currently, I am experimenting with Conversation API - deepseek. It works fine with the deepseek API key. But it could not work with the Ollama - deepseek model. I read through the code at https://github.com/dapr/components-contrib/blob/v1.15.0-rc.3/conversation/deepseek/deepseek.go, and found out that this component uses https://github.com/cohesion-org/deepseek-go, and it can only work with deepseek API (cloud platform).

Is there any way to run it with Ollama - Deepseek deepseek-r1:1.5b?

/cc @yaron2

My environment:

• Windows 11
• Dapr

[berndverst]

We can only rely on SDKs written in Go without C extensions.

I did a quick search for Go libraries related to Ollama but could not find any that do not use CGO.

Unfortunately, CGO based SDKs cannot be accepted for Dapr components. Dapr needs to be able to be compiled as a platform agnostic distribution.

If you find a Go SDK that does not use CGO that does what you want we will accept contributions with such a SDK.

[yaron2]

We can only rely on SDKs written in Go without C extensions.

I did a quick search for Go libraries related to Ollama but could not find any that do not use CGO.

Unfortunately, CGO based SDKs cannot be accepted for Dapr components. Dapr needs to be able to be compiled as a platform agnostic distribution.

If you find a Go SDK that does not use CGO that does what you want we will accept contributions with such a SDK.

I'm fairly certain the SDK we're using for Langchain supports Ollama without cgo: https://github.com/tmc/langchaingo