I asked GPT4 to refactor a simple, working python script for my smart lights... and it completely butchered the code and apologized mid-generation.
No amount of pleading or correction would get it to function as it did just a week or two ago.
It is so over.
Microsoft wants to own tools crucial to the mainstream of software development. They also want to own the cloud infrastructure on which those tools depend. Today, they might lose dimes on every LLM call. In five years, they’ll make a penny on orders of magnitude more calls. Microsoft has many flaws, including cloud capacity, but they aren’t short-sighted about investment. (I used to work in DevDiv and Azure Machine Learning.)