Support new AI Chat protocol

[sinedied]

This issue is for a: (mark with an x)

- [ ] bug report -> please search issues before submitting
- [x] feature request
- [ ] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)

Ai Chat protocol has been updated with a separate endpoint for streaming and slightly different object shapes.
We need to update the backend/frontend to match it.

There's also an NPM package implementing the client side communication that we could use in place of existing code in the frontend.

[github-actions]

This issue is stale because it has been open 60 days with no activity. Remove stale label or comment or this issue will be closed.

[github-actions]

This issue was closed because it has been stalled for 7 days with no activity.

[sinedied]

This one is needed for #214 , but will also imply an update of the frontend and parser.

[github-actions]

This issue is stale because it has been open 60 days with no activity. Remove stale label or comment or this issue will be closed.