While github copilot is an excellent AI companion, not all the companies are willing to stream their srcs over the internet, and they prefer to use local LLMs.

The biggest problem is the plenty of LLMs solutions out there, each with its own (REST) APIs. IMHO, the biggest challenge will be find a way to allow users to easily add new clients.