Anthropic Dethroned By Gemini 1.5 Pro’s 1-Million-Token Context Window

Gemini 1.5 Pro—the newest foundation model in Google’s Gemini series—has now achieved a 1-million-token context window, making it the longest of any large-scale foundation model to date. Anthropic’s Claude 2.1 previously held the context record with 200,000 tokens. Large context windows allow a model to process and understand extremely long documents, books, scripts or codebases that would otherwise need to be processed separately.

Gemini 1.5 Pro is differentiated by a mixture-of-experts architecture. This architecture provides better performance by dividing problems into segments and then using specialized expert sub-models to solve each segment. Google trained this model on 4,096-chip pods of Google's TPUv4 accelerators using multilingual data along with Web documents, code and multimodal content including audio and video.

300 Billion Perfect Storm Bitcoin Price Crash Under 60 000 Suddenly Accelerates As Ethereum XRP And Crypto Brace For Shock Fed FlipThe new model’s 1-million-token context window allows users to upload large PDFs, code repositories and lengthy videos as prompts. Developers can upload multiple large files and then ask questions about the intersections of multimodal content, such as in which video frame a particular piece of dialogue occurred.

Anthropic has been a leader in expanding context-window size. To highlight one of the potential downsides of longer context windows, it recently publishedexplaining how a long context window can be used to exploit an LLM by using a method called many-shot jailbreaking. Using techniques such as MSJ causes large language models to ignore their safety guardrails.

Ai Ai Latest News, Ai Ai Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

Amazon builds Olympus AI model to compete with Anthropic, OpenAIAmazon is pushing to be a leading player in the AI wars by aggressively investing $ billion in the OpenAI rival Anthropic, even as it quietly works to build a competing AI model codenamed Olympus.
Source: verge - 🏆 94. / 67 Read more »

Anthropic says its AI models are as persuasive as humansA new study finds AI is getting more 'persuasive.'
Source: axios - 🏆 302. / 63 Read more »

Anthropic lone bright spot in slow quarter for startupsThe number of deals raised by City-based companies fell significantly in the first quarter
Source: sfexaminer - 🏆 236. / 63 Read more »

Anthropic launches external tool use for Claude AI, enabling stock ticker integrations and moreAnthropic AI has launched a beta of its “tool use” functionality for all Anthropic Message API users for the Claude suite of generative artificial intelligence (AI) models.
Source: Cointelegraph - 🏆 562. / 51 Read more »

FTC investigating Microsoft, Amazon, and Google investments into OpenAI and AnthropicThe FTC opened an inquiry into the impact of billion-dollar investments by cloud providers into AI startups on the competitive landscape of generative AI.
Source: verge - 🏆 94. / 67 Read more »

Amazon-backed Anthropic launches iPhone app and business tier to compete with OpenAI's ChatGPTAnthropic on Wednesday announced its first-ever enterprise offering, as well as its first iOS app.
Source: CNBC - 🏆 12. / 72 Read more »