ChatGPT costs more than BRL 3.5 million per day to operate, analyst says

ChatGPT costs more than BRL 3.5 million per day to operate, analyst says


An analyst says that OpenAI spends around BRL 3.5 million to keep chatGPT running, and the cost would be even higher with GPT-4

ChatGPT is expected to cost more than $700,000 (R$3.5 million) a day, lead analyst at semiconductor research firm SemiAnalysis, Dylan Patel, said. OpenAI’s conversational chatbot requires an insane amount of computational performance to meet worldwide user demand and the Microsoft want to reduce that cost.




“Most of the cost is spending on the servers they need,” the analyst said. Now, with the availability of GPT-4, maintenance must have become even more expensive, as its evaluation only considered the chatbot using GPT-3, the predecessor model of the OpenAI platform.

The training alone costs tens of millions of dollars, but the operational expense and inference (data processing) costs are much higher, Patel and another SemiAnalysis analyst, Afzal Ahmad, told the Forbes website. “Indeed, the costs of inferring ChatGPT outweigh the costs of training on a weekly basis,” they said.

Microsoft wants to make operations cheaper

To make the model business cheaper, Microsoft seems to be developing specific hardware for data processing with artificial intelligence. That would be the role of Athena, an AI-optimized chip that has been in development since 2019, the year the company closed a $1 billion deal with OpenAI.

There are about 300 Microsoft employees focused on the project, but it wouldn’t be released to the general public: It would be used exclusively by Microsoft and OpenAI to boost their products with artificial intelligence as early as 2024, The Information noted.

Source: The information, Business Insider, forbes

Trending on Canaltech:

Source: Terra

You may also like