essentially we are formatting the llm output before sending it to the synthesizer