I've tried it with Mermaid so much over the years but their renderer is just so limited.
It gives you no decent control over pathing and positioning, and styling is pretty basic.
I do think its syntax might be helpful, so you could maybe do natural language > mermaid code > your renderer