Altair’s new business: AI DSP Engines

Photo above: Sony intelligent vision sensors IMX500 (left) and IMX501. Both include Altair’s DSP processor

Hod Hasharon-based Altair Semiconductor (owned by Sony) has secretly expanded its operations beyond the IoT sector and entered the Artificial Intelligence (AI) chips market. This came to light last month, when Sony announced new image sensors for smart control systems . The component is built of two chips embedded in stacked configuration inside a single package (Multi Chip Module) consisting of a Sony image sensor, and a DSP processor developed by Altair, which is responsible for a neuronal network inference operations.

This new family of smart image sensors is currently consists of two components: IMX500 and IMX501. When installed in a security camera, street camera, or other IoT devices, the logic circuit processes and sends only the inference itself to the network center. Thus, it saves considerable processing and communication resources and enables a given device to function as a smart sensor without compromising the privacy of the people being photographed.

A smart camera equipped with the visual-logic sensor can enumerate the number of people in the store and transmit the information without having to send their images to the cloud. It can discern congestion patterns in various complexes, and even track customer behavior in the store –  based only on analyzing their movements –  and without having to identify the customers themselves.

The images are sent back in a variety of configurations (see below): pure decoded information without visual elements, an image in various formats, or only the relevant visual area. From Sony’s point of view, this constitutes an entrance to a major market characterized by a very large growth. As far as Altair is concerned, this is a very surprising development, since so far the company has focused on communication solutions for IoT devices and not on the development of DSP or artificial intelligence processors.

Altair’s core activity is focused on IoT connectivity chips, with its flagship product being the ALT1250 chipset, which includes a modulator and a modem for supporting Cat-M1 standard and the NB-IoT standard. It features an RF front end circuit that supports all LTE bands, an RFIC circuit, a power management unit (PMU), memory, amplifier circuits, filters, an antenna switch, global navigation satellite system (GNSS), hardware-based security, an eSIM circuit and an internal micro controller unit (MCU) that allows customers to develop unique applications.

A new strategy for both Altair and Sony

Sony’s announcement positions it in a massive market and transforms it into ahybrid IoT-image-sensors player. The move can secure orders for Altair in very large quantities. However, it can also hint at a new Altair strategy that can develop in two interesting directions: the first is the integration of ALT1250 technologies into Sony’s future image sensors – alongside the recently unveiled AI processor.

The other direction is independent: integrating the artificial intelligence processor into its next-generation connectivity chip – a kind of ALT1250 reinforced with artificial intelligence. An IoT connectivity chip embedded with artificial intelligence has many advantages – from providing artificial intelligence to ‘dumb’ cameras – thus allowing enhanced communication management capabilities – and even enhancing the current-generation ALT1250 security system.

Connected Devices in an Era of Pandemics

By: Igor Tovberg, Director of Product Marketing at Altair Semiconductor, a Sony Group Company

Technology has a history of helping to track and treat viruses. And, with the World Health Organization (WHO) declaring COVID-19 a global pandemic, people are rightly asking themselves how new technologies such as the Internet of Things (IoT), AI, and Big Data can be employed to slow down the proliferation of pandemics and avoid a future global health crisis.  In this article, I describe how connected medical devices could help.

Monitoring trends with Wearables

Millions of wearable devices have been deployed globally. Activity and heart-rate sensing are becoming a baseline feature in every fitness band and smartwatch, with data being continuously sensed and uploaded into the cloud. Would this data be useful in predicting a spreading epidemic?

Indeed, a recently published study by Scripps Research Translational Institute in The Lancet Digital Health analyzed such data and found that resting heart rate and sleep-duration data collected from wearable devices could help inform timely and accurate models of population-level influenza trends. Sensing and analyzing more physiological factors would improve the speed and accuracy in the discovery of epidemics.

Changes in patient care habits

Isolation is one of the preventive actions being taken to stop the virus spread, as exposure to an infected carrier could prove fatal for people with a weakened immune system. Now, more than ever, health stats relating to virus symptoms can be sent to health care providers without patients having to visit their clinic and risking exposure.

mHealth

Connected devices such as thermometers, blood pressure meters, inhalers, glucose meters, or other personal health monitoring devices will play a significant role in protecting people’s lives.

Cellular connectivity through the CAT-M or NB-IoT network can ensure a secure and reliable countrywide link for the delivery of patients’ stats to their health care provider from any location, regardless of WiFi/BLE coverage.

Connected out-of-the-box cellular-based devices are freeing doctors from relying on a patient’s ability to set up the LAN/PAN connection by themselves.

Quarantine compliance with smart cellular IoT wristbands

The general population can wear smart wristbands as a health monitor. With an emphasis on the small size and long battery life, Cellular IoT offers reliable connectivity for smart wristbands, with autonomy from paired smartphones. Recently, the Hong Kong Government has deployed smart wristbands to monitor city residents quarantined inside their homes.

Accelerating the speed of reaction

Monitoring is vital in the detection chain, and reaction time is critical for prevention. Enterprises, airports, and cities would surely benefit from monitoring devices for citizens, and healthcare facilities would benefit from the ability to monitor remote patients. Timely discovery of outbreaks could prevent many new dangerous viruses in the future.

Solution

For personal, medical, or environmental monitoring, Altair’s ALT1250 ultra-low power, compact, secure, and highly integrated cellular IoT chipset enables slimmer devices with long battery life, which can remain continuously connected – reliably connecting people in ways previously unobtainable. All without the need for a smartphone or home WiFi network.

Conclusion

According to Bill Gates, in any crisis, leaders have two equally important responsibilities: Solving the immediate problem and keeping it from happening again. It’s clear that IoT technology, and specifically medical devices, have an important role to play in the containment and treatment of outbreaks like COVID-19. I genuinely believe that IoT can be fully harnessed to control and potentially prevent the next global pandemic.

AI Chipmaker Hailo Raised $60 Million

The Tel Aviv based chipmaker startup Hailo, has successfully completed a a $60 million financing round with the participation of key strategic investors ABB Technology Ventures (VC arm of ABB) and NEC Corporation. The funding will be used to enter mass production of the company’s processor Hailo-8 Deep Learning chip during 2020. Today the company employs approximately 80 employees.

Since its inception in February 2017, Hailo had raised $88 million. Following the last investment round, it begins to recruit 30-40 new employees for its research and development and support department, as well as offshore stuff for new offices in Europe, Japan and the US, to be opened in 2020. The company’s Hailo-8 processor is a dedicated Neural Networks processor aimed to implement inference functions on edge devices in Automotive and Industrial applications.

“We look forward to combining Hailo’s solution with our cutting-edge industrial technology as an important piece of the puzzle to drive the digital transformation of industries,” said Kurt Kaltenegger, Head of ABB Technology Ventures. Hiroto Sugahara, General Manager of Corporate Technology Division, NEC Corporation, said that Hailo’s technology will help NEC,  “to dive  deeper into the intelligent video analytics market. We look forward to incorporating Hailo’s technology into our next generation edge-based products.”

CEO, Orr Danon: A novel architecture to enable fast and power saving implementation of Neural Networks
CEO, Orr Danon: A novel architecture to enable fast and power saving implementation of Neural Networks

The Company’s co-founder and CEO, Orr Danon, told Techtime Hailo-8 chip presents a novel architecture to enable fast and power saving implementation of Neural Networks. “We identified that in during the processing of inference, there are differences in the behavior of the different layers in the neural network. Our solution provides the exact resources needed in each layer.

“In contrast, our competitors, who use solutions such as GPU processors, allocate to each and every layer the same level of resources. Our development software learns the specific problem of each application, characterizes it, and give the chip instructions on how to manage the resources of each layer in an optimal method.”

According to Hailo, its processor reaches up to 26 Tera Operations Per Second (TOPS) and 3 TOPS per Watt. It will meet the strict ISO 26262 ASIL-B as well as the AEC Q 100 Grade 2 standards. Hailo-8 is comprised of four main components: an Image Signal Processor to improves the image arriving from the sensor before its transfer for processing by the neural network core, an H.264 encoder that handles the video stream, an ARM-M4 processor to manages the chip, and the neural network core itself.

This neural network is comprised of a flexible matrix of software-configurable processing, controls, computational resources and memory units. “Hailo’s Deep Learning chip is a real game changer in industries such as automotive, industry 4.0, robotics, smart cities, and more,” said Hailo Chairman Zohar Zisapel, “A new age of AI chips means a new age of computing capabilities at the edge.”

Arbe Raised $32M for New Automotive 4D Radar Chipset

Arbe from Tel-aviv, announced the closing of $32 million in Round B funding for its 4D Imaging Radar Chipset Solution. Arbe will use the funding to move to full production of its automotive radar chipset, which generates an image 100 times more detailed than any other solution on the market today.

The Tel-aviv based company has developed a 4D Imaging Radar Chipset Solution, enabling high-resolution sensing for ADAS and autonomous vehicles. Arbe’s technology produces detailed images, separates, identifies, and tracks objects in high resolution in both azimuth and elevation in a long range and a wide field of view, and complemented by AI-based post-processing and SLAM (simultaneous localization and mapping).

Its Phoenix radar chip supports more than 2000 virtual channels, tracking hundreds of objects simultaneously in a wide field of view at long-range with 30 frames per second of full scan. The company believes its solution pose a low cost alternative to the current LiDAR sensors in ADAS Systems and the future Autonomous Vehicles.

Panasonic sells its 49% Stake in TPSCo to Nuvoton

Photo above: TPSCo fab in Uozu, Japan

In order to to strengthen its financial results,Panasonic Corp. transfer its unprofitable semiconductor operations to Nuvoton Technology Corporation from Taiwan. The company did not reveal financial details, but Zacks SCR’s analyst,  Lisa Thompson, wrote in her update that it is a $250 million in cash deal.

For TowerJazz it is a big news. The Israeli-based semiconductors foundry holds 51% in TPSCo, a company formed by TowerJazz and Panasonic (49%) in April 2014 following the transfer of its semiconductor manufacturing process and capacity tools of 8 inch and 12 inch wafers at its Hokuriku factories (Uozu, Tonami and Arai) to TPSCo.

Panasonic announced that it will transfer the semiconductor business mainly operated by Panasonic Semiconductor Solutions (PSCS), to Nuvoton Technology Corporation, a Taiwan-based semiconductor company owned (62%) by Winbond Electronics. The deal is expected to end in June 2020.

The Competion is “Aggressive”

Panasonic explained in a press release that the competitive environment surrounding the semiconductor business has become extremely severe due to aggressive expansion of competitors, huge investments and industry reorganization through M&A. “In such an environment, the Company has come to believe that the even stronger business operation and the continuous investment is critical in order to achieve a sustained growth and expansion of the semiconductor business. Accordingly, it has concluded that the best option would be to transfer the business to Nuvoton.”

Nuvoton Technology was spun-off as a Winbond affiliate in 2008 while Winbond continues to focus on its large Memory business. Nuvoton provides Microcontrollers, Platform Modules for the PC industry and Mixed Signal devices such as Speech Playback and Record Products with embedded Flash, Audio Power Amplifiers, Audio ADC’s/DAC’s and CODECS. The deal with Panasonic includes technology know how transfer of technologies such as image sensors, battery management and MOSFET for LiB battery circuits protection.

Nohik Semel named the next CEO of Altair

Photo above: Oded Melamed (left) and Nohik Semel

Altair Semiconductor is appointing current VP System Engineering and Product Management Nohik Semel to CEO, to replace outgoing co-founder and CEO Oded Melamed who is stepping down to pursue new startup Opportunity. The appointment will be effective on November 18th, 2019. Semel joined Altair in its very beginning and has spent the last 14 years in different executive positions. He is credited with the development of Altair’s LTE product portfolio.

His accomplishments include developing the ALT1250 and the ALT1160 chipset. ALT1250 is the company’s flagship. It is considered is the smallest and most highly integrated LTE CAT-M and NB-IoT chipset. It features ultra-low power consumption, hardware-based security, and a carrier-grade integrated SIM (iUICC), all 5G ready. ,“We wish Oded the best of luck and expect to see sensational developments from his next project,” said Nohik Semel.

Altair was founded in 2005 by Melamed and the current CTO Yigal Bitran, former Texas Instrument Israel employees, where they led Cable Modem Research and Development. Altair was a pioneer at Cellular IoT chipsets. In 2016 it was acquires by Sony for $212 Million. Altair partners with leading global vendors, including G+D (Giesecke+Devrient), HERE Technologies, Murata, Sierra Wireless and WNC. Its chipsets have been commercially deployed on the LTE networks of AT&T, China Mobile, KDDI, SoftBank, Verizon and Vodafone.

Hailo Prepares for Mass Production of its AI Chips

Photo above: A development team at Hailo. The Tel Aviv based company employs around 65 workers today

Tel Aviv-based Hailo is preparing for the mass production of its AI chip that meets the ASIL-B standard of the automotive industry, and start full-scale production during 2020.  Company co-founder and CEO Orr Danon told Techtime that the new chip is named Hailo-8 and was developed as part of the cooperation between Hailo and auto manufacturers. The chip enables the meeting of demands for critical life-saving systems, including the meeting of working under conditions of up to 105 degrees Celsius.

According to company data, the Hailo-8 processor reaches up to 26 tera operations per second (TOPS) and 3 TOPS per Watt power efficiency. It will meet the strict ISO 26262 ASIL-B as well as the AEC Q 100 Grade 2 standards. Hailo-8 is comprised of four main components: an Image Signal Processor that improves the image from the sensor before its transfer for processing by the neural network core, an H.264 encoder that handles the video stream, an ARM-M4 processor that manages the chip, and the neural network core itself, that is comprised of a flexible matrix of software-configurable processing, controls, computational resources and memory units.

Renew the Old Idea of DFP Processors

Hailo was established in February 2017 by CEO Orr Danon, CTO Avi Baum and the Business Development Manager Hadar Zeitlin. The first investor in the company was Zohar Zisapel, who serves today as Chairman of the board. To date Hailo has raised around $24 million, of which $21 million was in the latest round of financing which was completed in January 2019. The company developed a new architecture for AI chips for edge devices that carry out the execution phase – i.e.  the application of the inference of a neural network in edge devices at a rapid speed and with a huge saving in energy.  According to Danon, the architecture, which is protected by dozens of pending patents, “belongs to a forgotten family of processors from the Data Flow Processors type.”

CEO Orr Danon. “Our architecture describes the structure of a neural network"
CEO Orr Danon. “Our architecture describes the structure of a neural network”

In DFP processors, the processing activity takes place only when data is fed into the processor, which conducts a fixed series of operations on top of this information, and then transfers the processed information. “In recent years, it turned out that the reliance on neural networks is an efficient and reliable means of solving many problems, and therefore most of the AI systems that we see in the market are based on neural networks. Here the challenge is structural, since the chip needs to implement a structure of a neural network. In a neural network one infuses experience into the description of a structure, and therefore it is a very efficient solution in solving problems which are based on recognizing examples.”

How is your chip designed? What are the main principles of the architecture?

Danon: “Our architecture describes the structure of the neural network and allocates resources to every layer in the network. We identified that in during the processing of inference, there were differences in the behavior of the various layers of the neural network, and therefore there was a need to provide them with different resources. This runs counter to our competitors, who use solutions such as GPU processors that allocate to each and every layer the same level of resources. Our development software learns the specific problem, characterizes it, and knows how to transfer to the chip instructions on how to manage the resources of each layer in an optimal method.”

What are the components of the chip?

“The idea is to use the memory units that are located very close to the processing units. We allocate memory and processing units in accordance with every task, and in this way achieve very fast processing, and extensive savings in the chip’s power consumption.  This allows us to meet the extremely strict standards of the automotive industry, since the chip does not heat up and is capable of operating in the environmental temperatures that the industry demands.”

You claim that your chip is more efficient that other solutions in the market. However, there is no universally accepted means of measuring AI chips.

“We measure the performance of our chips by checking how many operations per Watt we execute a specific neural network. Nowadays there is the MLPerf consortium that is attempting to define a benchmark which will serve as a basis for comparing different deep learning processors. Regarding edge devices, the industry is apparently going in the direction of measuring the number of operations per Watt (TOPS/W) that the neural network carries out for a specific task, like an image.”

Today new methods are being developed for deceiving neural networks.  How are you dealing with this problem?

“It is possible to relate to AI deception as a weakness, just as one relates to security vulnerabilities. At the outset, the weaknesses of the software systems surprised the industry, but gradually they found solutions. In the AI field, first of all this is a conceptual problem that lacks a solution on the silicon level. However, if the network was trained in the wrong way, and the attacker is aware of how the network was trained, then he is capable planning an attack. We also deal with this problem, and in principle it shows the advantage of installing AI systems at the edges of the network, since in this way there are less vulnerabilities along the route of transferring information.“

Hailo is growing quickly, and currently employs around 65 workers. The company is in the process of hiring additional manpower. Hailo is focusing its efforts on two key markets: the automotive and IoT. These two markets are expected to be huge and are also very demanding as in both there is a need for a product which is very reliable, low-cost, with very low power consumption. Danon: “In many respects the camera in a vehicle is no different than the IoT camera in a smart city. These are two areas that will be very dominant, and they share many common requirements.”