Overloaded: Microsoft Admits Bing Chat Needs More GPUs to Generate Fast Responses

2023-05-08 15:32:00

Microsoft released Bing Chat to everyone last week, but now some users are reporting that the time to generate responses is slower. In response, Microsoft positioned itself saying that the service is overloading due to high demand and that upgrades will be necessary to reduce latency.

The answer was given by Mikhail Parakhin, head of archyde news and Web Services at Microsoft, on Twitter, where he said:

Sorry about the latency: Usage keeps growing, we’re not adding GPUs fast enough. We’re going to work this out.

It is interesting to mention GPUs, as they are essential for the use of generative artificial intelligence, which is the case of ChatGPT, as it uses its power to analyze data to create unique answers to questions.

Lastly, Parakhin also revealed features coming soon to Bing. Among them is the history of conversations with the chat and new proportions for the images of the Bing Image Creator, which should be released in the coming days.

The executive also spoke about Code Interpreter, saying it will take some more time to release as it needs to be “done safely; it’s not a trivial task”.


1683580120
#Overloaded #Microsoft #Admits #Bing #Chat #GPUs #Generate #Fast #Responses

Leave a Comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.