Rising Costs of AI, is it actually profitable business?
AI is currently a significant trend, with millions of users accessing ChatGPT daily. Given this high demand, it's unsurprising that ChatGPT incurs substantial operational costs. It is estimated that running ChatGPT costs OpenAI about $700,000 each day, translating to 36 cents per query. Despite skyrocketing interest from businesses and individuals, running an OpenAI chatbot in a free to use basic business model could make it challenging to generate profits. These expenses are exacerbated by the need for AI companies, including Microsoft, to purchase GPUs in large quantities from manufacturers like NVIDIA. To support its commercial endeavors, it's estimated that OpenAI might require an additional 30,000 NVIDIA GPUs this year, compared to the 10,000-15,000 GPUs currently in usage.
Start investing today or test a free demo
Create account Try a demo Download mobile app Download mobile app
Nvidia's upcoming cutting edge technology!
Yesterday, Nvidia announced the release of its GH200 super chip, designed to meet the growing demand for running large AI models and associated large costs. The GH200 boasts the same GPU as Nvidia's current top-tier AI chip, the H100, but offers triple the memory capacity. This enhancement is crucial for generative AI applications, such as ChatGPT, which require substantial computational power. The cost of running such models is significant, especially given that even with Nvidia's H100 chips, some models need to be distributed across multiple GPUs. The GH200 aims to address this challenge, with Nvidia's CEO, Jensen Huang, emphasizing its design for scaling out global data centers. The chip is set to be available in the second quarter of 2024, and while the price remains undisclosed, the current H100 line is priced around $40,000.
Nvidia market share
Microsoft and Nvidia have collaborated on building new supercomputers, even as Microsoft reportedly explores manufacturing its own AI chips. However, Nvidia's near-monopoly in the AI-capable GPU market, with an estimated 80% market share, might face challenges. Cloud providers, including AWS, Azure, and Google, mostly use Nvidia's H100 Tensor Core GPUs, but they are also working on adding their own services. Nvidia's dominance is also under threat from competitors like AMD, which plans to increase production of its AI GPU later this year. Additionally, tech giants like Google and Amazon are venturing into designing custom AI chips. The competitive landscape suggests that while Nvidia remains the dominant player, the AI hardware space is rapidly evolving, with new companies also exploring this space.
The content of this report has been created by XTB S.A., with its registered office in Warsaw, at Prosta 67, 00-838 Warsaw, Poland, (KRS number 0000217580) and supervised by Polish Supervision Authority ( No. DDM-M-4021-57-1/2005). This material is a marketing communication within the meaning of Art. 24 (3) of Directive 2014/65/EU of the European Parliament and of the Council of 15 May 2014 on markets in financial instruments and amending Directive 2002/92/EC and Directive 2011/61/EU (MiFID II). Marketing communication is not an investment recommendation or information recommending or suggesting an investment strategy within the meaning of Regulation (EU) No 596/2014 of the European Parliament and of the Council of 16 April 2014 on market abuse (market abuse regulation) and repealing Directive 2003/6/EC of the European Parliament and of the Council and Commission Directives 2003/124/EC, 2003/125/EC and 2004/72/EC and Commission Delegated Regulation (EU) 2016/958 of 9 March 2016 supplementing Regulation (EU) No 596/2014 of the European Parliament and of the Council with regard to regulatory technical standards for the technical arrangements for objective presentation of investment recommendations or other information recommending or suggesting an investment strategy and for disclosure of particular interests or indications of conflicts of interest or any other advice, including in the area of investment advisory, within the meaning of the Trading in Financial Instruments Act of 29 July 2005 (i.e. Journal of Laws 2019, item 875, as amended). The marketing communication is prepared with the highest diligence, objectivity, presents the facts known to the author on the date of preparation and is devoid of any evaluation elements. The marketing communication is prepared without considering the client’s needs, his individual financial situation and does not present any investment strategy in any way. The marketing communication does not constitute an offer of sale, offering, subscription, invitation to purchase, advertisement or promotion of any financial instruments. XTB S.A. is not liable for any client’s actions or omissions, in particular for the acquisition or disposal of financial instruments, undertaken on the basis of the information contained in this marketing communication. In the event that the marketing communication contains any information about any results regarding the financial instruments indicated therein, these do not constitute any guarantee or forecast regarding the future results.
