NeuReality raises $35M to bring its inferencing chip to the market

NeuReality, an AI hardware startup which specializes in the next generation of AI inferencing platforms, is announcing a $35M Series A funding round. The round was led by Samsung Ventures, Cardumen Capital, Varana Capital, OurCrowd and XT Hitech. SK Hynix, Cleveland Avenue, Korean Investment Partners, StoneBridge, and Glory Ventures also participated in the round. The round brings NeuReality’s total funding to $48 million

The new fundraising will support NeuReality’s plans to start deploying its Inference solutions in 2023. NeuReality’s system is built for optimized deployment in data centers and near-edge on-premises locations in need for higher performance, lower latency, and much higher efficiency compared to existing technologies. The company had already reported its close collaboration with leading AI ecosystem partners and customers such as IBM, AMD, and Lenovo.

NeuReality makes AI easier to deploy in terms of usability, cost, scalability, and sustainability. The company uses a new type of Network Addressable Processing Units (NAPU) optimized for deep learning inference use cases such as computer vision, natural language processing, and recommendation engines. The NAPU

will bring AI for a broader set of less technical companies. It is also set to allow large-scale users such as Hyperscalers and next-wave datacenter customers to support their growing scale of AI usage. NeuReality’s disruptive system approach includes hardware, software and tools that work together to boost efficiency and simplify the adoption and deployment of AI in a wider range of real-world applications.

The funding will allow NeuReality to bring its first-in-class NAPU, the NR1, to the global market. This next-generation AI chip, which is based on NeuReality’s AI-centric architecture, is pushing the performance and efficiency of AI systems to the next level. It does so by removing existing system bottlenecks to increase the utilization of current deep-learning processors, while lowering the latency of AI operations, and saving in overall system cost and power consumption, which are so critical for an improved total cost of ownership (TCO) of data-centers and on-premises large-scale compute systems, and vital for the business models of many applications. NeuReality also pushes the bar higher on power consumption of those power-hungry applications, a stepping stone for the sustainability requirements driven by governments around the globe.

“This investment is another sign of confidence in the talent and innovation that NeuReality and the Israeli tech industry offer the world,” stated Moshe Tanach, CEO and co-founder of NeuReality. “The high-profile investors in our Series A fundraising prove that NeuReality’s value proposition, architecture and flagship product are a viable reality which will transform the AI market.”

Yoav Sebba, Managing Director at XT Hi-Tech, added: “We are honored to join the NeuReality journey led by this exceptional team, headed by Moshe, Tzvika, Yossi and Lior. High performance and sustainable Inference computing is so critical for growth in day-to-day usage of AI. We are seeing endless AI opportunities developed by software companies, but the existing hardware infrastructure is limiting the deployment of those use cases. Recently new deep learning processors had been developed by multiple companies, serving as new type of “brains”. NeuReality is the full body surrounding those brains and allowing it to serve intelligent voice, language, vision, and recommendation applications”.

Dr. Mingu Lee, Managing Partner at Cleveland Avenue Technology Investments, noted: “NeuReality is bringing ease of use and scalability into the deployment of AI inference solutions, and we see great synergy between their promising technology Fortune 500 enterprises companies we communicate with. We feel that investing in companies such as NeuReality is vital, not only to ensure the future of technology, but also in terms of sustainability.”

NeuReality, which raised its seed round early 2020, is led by a seasoned management team with extensive experience in AI, data-center architecture, system, and software. NeuReality was co-founded by CEO Moshe Tanach, formerly Director of Engineering at Marvell and Intel and AVP R&D at DesignArt-Networks (acquired by Qualcomm); VP Operations Tzvika Shmueli, formerly VP of Backend at Mellanox Technologies and VP of Engineering at Habana Labs; and VP VLSI Yossi Kasus, formerly Senior Director of Engineering at Mellanox and the head of VLSI at EZChip. The company’s leading team also includes CTO Lior Khermosh, former co-founder and Chief Scientist of ParallelM and a fellow at PMC Sierra.

Samsung Ventures invests in Israeli AI company NeuReality

NeuReality, an Israeli AI systems and semiconductor company, announced that Samsung Ventures has made an investment in the company. NeuReality makes inference technologies, such as computer vision, natural language processing, and recommendation engines easier to implement for a broader set of less technical companies.

More than just a chip company, NeuReality’s comprehensive solution includes hardware, software and tools that work together to simplify and accelerate AI deployment. The company currently employs more than 30 employees and plans to double its size and recruit talent in VLSI chip design, AI, software, and hardware.

Ori Kirshner, head of Samsung Ventures in Israel, stated: “We see substantial and immediate need for higher efficiency and easy-to-deploy inference solutions for data centers and on-premises use cases, and this is why we are investing in NeuReality. The company’s innovative disaggregation, data movement and processing technologies improve computation flows, compute-storage flows, and in-storage compute – all of which are critical for the ability to adopt and grow AI solutions. Samsung Ventures is committed to invest in companies with strong synergy to Samsung’s core business and NeuReality fits well into this commitment.”

The adoption and growth of AI solutions face various obstacles, which prevent retail, manufacturing, healthcare, and other sectors from deploying AI inference capabilities into business workflows. While the company is new, NeuReality’s team draws from decades of experience in AI, data center systems, hardware design, and software development. As a result, NeuReality uses a system level approach that combines easy-to-use software with high efficiency deep learning and data handling acceleration hardware. This holistic approach dramatically simplifies and accelerates the adoption and mass deployment of inference technology.

Focusing on the growth of real-life AI applications, NeuReality’s solutions are purpose built for a wide variety of sectors including public safety, e-commerce, social networks, medical and healthcare, digital personal assistants, and more. NR1 solution targets cloud and enterprise datacenters, alongside carriers, telecom operators and other near edge compute solutions.

NeuReality emerged out of stealth last year with $8 million seed funding from Cardumen Capital, OurCrowd and Varana Capital. In November 2021, NeuReality signed an agreement with IBM to develop the next generation of high-performance AI inference platforms that will deliver disruptive cost and power consumption improvements for deep learning use cases. NeuReality is also collaborating with AMD to deliver its first-generation AI-centric FPGA based platforms for Inference acceleration to customers.

NeuReality is creating purpose-built AI-platforms for ultra-scalability of real-life AI applications and positioned itself as a pioneer in the deep learning and AI solutions market. The company’s NR1 is the company’s next generation integrated circuit device that is based on its AI-centric architecture. The SoC improves the utilization of AI compute resources that are currently deployed by removing the existing system bottlenecks, lowering the latency of AI operations and saving in overall system cost and power consumption. The company also develops complementary software tools and runtime libraries that make it easy for customers in various skill levels and various deployment topologies to adopt new AI based services in their business workflows.

Moshe Tanach, CEO and co-founder of NeuReality, stated: “The investment from Samsung Ventures is a big vote of confidence in NeuReality’s technology. The funds will help us take the company to the next level and take our NR1 SoC to production. This will enable our customers to evolve their system architecture, and this evolution will make it easier for them to scale and maintain their AI infrastructure, whether it is in their data center, in a cloud or on-premises.”

NeuReality was founded in 2019 and is led by a seasoned management team with extensive experience in AI, data-center architecture, system, and software. NeuReality was co-founded by CEO Moshe Tanach, formerly Director of Engineering at Marvell and Intel and AVP R&D at DesignArt-Networks (later acquired by Qualcomm); VP Operations Tzvika Shmueli, formerly VP of Backend at Mellanox Technologies and VP of Engineering at Habana Labs; and VP VLSI Yossi Kasus, formerly Senior Director of Engineering at Mellanox and the head of VLSI at EZChip. The company’s leading team also includes CTO Lior Khermosh, former co-founder and Chief Scientist of ParallelM and a fellow at PMC Sierra.

IBM and NeuReality team up to build AI Server-on-a-Chip

IBM and NeuReality, an Israeli AI systems and semiconductor company, have signed an agreement to develop the next generation of high-performance AI inference platforms that will deliver disruptive cost and power consumption improvements for deep learning use cases. IBM and NeuReality will enable critical sectors such as finance, insurance, healthcare, manufacturing, and smart cities to deploy computer vision, Natural Language Processing, recommendation systems, and other AI use cases. The collaboration is also aimed at accelerating deployments in today’s ever-growing AI use cases which are already deployed in public and private cloud datacenters

The agreement involves NR1, NeuReality’s first Server-on-a-Chip ASIC implementation of their revolutionary AI-centric architecture. NR1 is based on NeuReality’s first generation FPGA-based NR1-P prototype platform that was introduced earlier this year. The NR1 will be a new type of integrated circuit device with native AI-over-Fabric networking, full AI pipeline offload and hardware-based AI hypervisor capabilities. These capabilities remove the system bottlenecks of today’s solutions and provide disruptive cost and power consumption benefits for inference systems and services. The NR1-P platform will support software integration and system level validation prior to the availability of the NR1 production platform next year.

This partnership also marks NeuReality as the first start-up semiconductor product member of the IBM Research AI Hardware Center and licensee of the Center’s low-precision high performance Digital AI Cores. As part of the agreement, IBM becomes a design partner of NeuReality and will work on the product requirements for the NR1 chip, system, and SDK, that will be implemented in the next revision of the architecture. Together the two companies will evaluate NeuReality’s products for use in IBM’s Hybrid Cloud, including AI use cases, system flows, virtualization, networking, security and more.

The agreement with IBM marks the continued momentum for NeuReality. In February this year, the company emerged from stealth announcing its first-of-a-kind AI-centric architecture and laying out its roadmap, where NR1-P will be followed by NR1. Shortly after, in September, NeuReality announced that it is collaborating with Xilinx to deliver their new AI-centric FPGA based NR1-P platforms to market.

Moshe Tanach, CEO and co-founder of NeuReality, stated: “We are excited and deeply satisfied that a world-class multinational innovator like IBM is partnering with us. We believe our collaboration is a vote of confidence for our AI-centric technology and architecture and in its potential to power real life AI use cases with unprecedented deep learning capabilities.” Tanach added: “Having the NR1-P FPGA platform available today allows us to develop IBM’s requirements and test them before the NR1 Server-on-a-Chip’s tapeout. Being able to develop, test and optimize complex datacenter distributed features, such as Kubernetes, networking, and security before production is the only way to deliver high quality to our customers. I am extremely proud of our engineering team who will deliver a new reality to datacenters and near edge solutions. This new reality will allow many new sectors to deploy AI use cases more effciently than ever before.”

Dr. Mukesh Khare, Vice President of Hybrid Cloud research at IBM Research, said: “In light of IBM’s vision to deliver the most advanced Hybrid Cloud and AI systems and services to our clients, teaming up with NeuReality, which brings a disruptive AI-centric approach to the table, is the type of industry collaboration we are looking for. The partnership with NeuReality is expected to drive a more streamlined and accessible AI infrastructure, which has the potential to enhance people’s lives.”

NeuReality collaborates with Xilinx to deliver first AI-centric server

NeuReality, an Israeli AI startup developing high performance AI compute platforms for cloud data centers and edge nodes, is collaborating with Xilinx, Inc. to deliver new AI-centric platforms that empower, optimize, and tune real-world AI applications. The collaboration is based on NeuReality’s novel AI-centric inference platform NR1-P, which includes a new type of AI Server-on-Chip (SoC) developed by NeuReality and delivers all components necessary to deploy a complete inference solution. The platform targets high volume AI applications in various fields such as public safety, e-commerce, healthcare, retail, and many other computer-vision use cases.

NeuReality has worked closely with Xilinx to deliver the world’s first fully functional AI-centric server to the market. This breakthrough prototype platform will reduce the two key barriers that inhibit customers’ AI deployment today, cost and complexity. As part of the collaboration, the NR1-P platform, based on the Xilinx Versal ACAP architecture, can be purchased directly from NeuReality, and will be fulfilled through Colfax International.

NR1-P is NeuReality’s first implementation of the company’s new AI-centric architecture, with other implementations to follow. The new prototype platform is accessible for testing and evaluation via remote access. NeuReality’s NR1-P was built upon the Xilinx Versal VCK5000 development card and can deliver up to 3X greater performance/Dollar/Watt compared to the latest Nvidia A100 or T4 based systems, according to NeuReality. The complete prototype solution includes a 4xRU server chassis, 16 AI-centric modules based on the Xilinx development cards, an embedded Linux software stack with Kubernetes support, orchestration functionality and a model database.

Moshe Tanach, CEO and co-founder of NeuReality, noted: “Working closely with Xilinx, the market leader of FPGAs for AI, has taken us one step closer to a new reality of AI-centric Server-on-Chip silicon devices that deliver best in class TCO, linear scalability, reduced latency and a simple user interface and experience. These can enable use cases such as healthcare, public safety and other applications that depend on higher efficiency and much lower cost solutions compared to the existing CPU-centric offerings from companies such as Nvidia.”

NeuReality Ltd. is an AI technology innovation company creating purpose-built AI-platforms for ultra-scalability of real-life AI applications. NeuReality is a pioneer in the deep learning and AI solutions market.

NeuReality was founded in 2019 and is led by a seasoned management team with extensive experience in data centers architecture, system, and software. The co-founders are CEO Moshe Tanach, VP Operations Tzvika Shmueli and VP VLSI Yossi Kasus. Prior to founding NeuReality, Tanach served in several executive roles as Director of Engineering at Marvell and Intel and AVP R&D at DesignArt-Networks (later acquired by Qualcomm). Tzvika Shmueli served as VP of Backend at Mellanox Technologies and VP of Engineering at Habana Labs. Yossi Kasus served as Senior Director of Engineering at Mellanox and the head of VLSI at EZChip.