Saturday, September 7, 2024

Why we invested in Unify, a single API to run any AI mannequin throughout all suppliers — Samsung Subsequent

The flexibility to unify libraries and frameworks in synthetic intelligence (AI) is an important step in the direction of streamlining improvement processes, lowering prices, and making AI extra accessible and versatile.

One of many key challenges in AI improvement has been the fragmentation of frameworks and {hardware}, resulting in elevated prices and improvement time. We’re excited to spend money on Unify, and are significantly compelled by the group’s method in routinely bridging the hole between completely different frameworks through a single line of code. 

Unify streamlines LLM testing and deployment throughout suppliers via a unified interface, normal API, single-sign-on, and dynamic routing to optimize for pace, price, and mannequin high quality per immediate. It differs from different routers with clear each day runtime and high quality benchmarks, as its knowledge is publicly accessible. Moreover, Unify integrates seamlessly with main LLMOps platforms like LangChain and LlamaIndex, making it useful for large-scale LLM deployment, lowering latency, and chopping prices for companies. By offering built-in capabilities for reminiscence, vector operations, cryptography, and extra, Unify makes compute extra environment friendly and efficient. With Unify, builders can seamlessly run any piece of code on any machine studying framework, backend, and {hardware}, all whereas optimizing AI fashions throughout compilation.

We’re impressed by the group’s sturdy background in generative AI for code and enormous language fashions. CEO & Founder Daniel Lenton pursued his PhD at Imperial Faculty of London focusing his analysis on fixing the ML-Fragmentation drawback by inventing a brand new AI-specific compiler. Whereas there, he noticed colleagues going through collaboration challenges on account of numerous software program stacks at main tech firms. Annoyed, he developed Ivy, a unified machine studying framework, which gained reputation on GitHub with 14k stars and a 20k-member Discord group. Now, with Unify, the group goals to simplify and speed up massive language mannequin deployment, addressing the present problems with pace, complexity, and value in AI.

Unify’s capabilities have far-reaching implications for AI improvement. Because the demand for task-specific ML libraries grows, the necessity for a unified compiler turns into extra pressing. Unify’s built-in AI-specific capabilities, together with transformer and neural community layer consideration strategies, provide a revolutionary answer. By routinely resolving vital dependencies throughout compilation, Unify accelerates improvement, cuts prices, and reduces coaching instances for AI fashions, all whereas guaranteeing optimum efficiency.

We’re excited to hitch Unify on their journey, and consider that the corporate’s distinctive method to AI mannequin optimization has the potential to reshape the trade, simplifying improvement, chopping prices, and accelerating progress. 

Andy Duong is an investor at Samsung Subsequent. Samsung Subsequent’s funding technique is proscribed to its personal views and doesn’t replicate the imaginative and prescient or technique of another Samsung enterprise unit, together with, however not restricted to, Samsung Electronics.

Related Articles

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Latest Articles