Enabling Follow up Questions -

[elegoupil]

@pamelafox - I can see in the code the capacity to display follow up questions -

https://github.com/search?q=repo%3AAzure-Samples%2Frag-postgres-openai-python++Followup+Questions&type=code

though I am still not finding a way to get this displayed in my interface? Can you share any hints for that?

[pamelafox]

Hm, it's possible that I never implemented it in this version of the code. This code was based off https://github.com/Azure-Samples/azure-search-openai-demo/ which definitely does support follow-up questions.
It requires some finicky parsing logic on the backend for the streaming response, to separate the follow-up questions from the actual answer, and I probably thought it was better to avoid that code in this backend.
You could look at that solution's approach and bring that into this one.

[elegoupil]

Thanks for the hint @pamelafox - will be checking it! - also a nice add-on I have been looking at - https://ecologits.ai/latest/tutorial/providers/openai/#compatibility-with-azure-openai

[pamelafox]

@elegoupil That's a really interesting project. As the docs note, the estimates for Azure OpenAI / OpenAI are low precision since I don't think the actual environmental impact details are sent through the API. As I understand it, Microsoft has various efforts around carbon neutrality, water reuse, etc, so my personal hope is that Azure calls do not have as negative an impact as other calls. 🤞🏻