OpenAPI-Compatible Proxy

[janus-reith]

I found BAML when I already had my tools for LLM usage with structured output and function calling in place, but wanted to give other models a shot which don’t natively support it.

I‘m wondering, couldn’t the same principles BAML works with be applied to a kind of OpenAI-compatible Proxy? So something that receives the details about tool use / schema from the input and strips/reshapes it similar to how it does with with the BAML files and forwards it.

[aaronvg]

Yes theres a few folks working on this. We will share more on this soon