Ambient Scientific

Ambient Scientific is a Silicon Valley startup that has developed a new AI processor based on analog-circuit techniques. CEO Gajendra Singh, previously VP of Engineering at Wave Computing, launched the company in 2017. It remained in stealth mode until its 2019 announcement of the GPX-10, which followed the close of its $17 million Series A funding. The company sampled the chip in 4Q20 and planned to start production in 2Q21, but we believe it has postponed that plan while prospective customers evaluate the device. Ambient has about 70 employees.

Key Features and Performance

Although TSMCmanufactures the GPX-10 in 40nm embedded-flash technology, Ambient’s design employs standard CMOS transistors to implement analog multipliers, rather than the flash-based approach of Mythic. The MAC-unit arrays, which the company calls DigAn cores, execute 256 analog MAC operations per cycle.

As in other analog DLAs, we believe themultipliers employ a simple transconductance property, yielding the product of their inputs according to Ohm’s law. INT4, INT8, or INT16 operands from SRAM feed into digital-to-analog converters (DACs) that create the analog multiplier inputs. Analog-to-digital converters (ADCs) sum themultiplier outputs, converting the result to a digital output.

DigAn cores also include eight digital ALUs that perform integer operations at up to 32-bit precision. The ALUs handle biasing, normalization, and general arithmetic. The activation engine comprises both digital and analog components. An SRAM array stores a multisegmented lookup table that provides a coarse collection of activation data points for processing by mixed-signal logic.

The GPX-10 integrates 10 DigAn cores that together can deliver 512 GOPS. A Cortex-M4 CPU controls the DLA’s operations, loading neural-network parameters froma 512KB embedded flashmemory. Customers can also connect external flash to the SPI port. The CPU and DLA cores can use the 320KB integrated cache for temporary storage.

The SoC can operate in a variety of power states: always-on voice detection, always-on fault detection, and activemode. With all systems running at maximum specifications, it consumes 120mW. For always-on voice commands and fault detection, the power drops to just 80microwatts, allowing the GPX-10 to operate froma small battery. We estimate the chip provides only 0.3 GOPS at this power level.

Ambient additionally developed a five-coremodel called the GPX-5 that delivers 256 GOPS. Whereas the larger chip targets on-device inference and training, the GPX-5 only runs inference. It also omits embedded flashmemory and replaces the Cortex-M4 CPU with a Cortex-M0. The company specifies power at amaximumof 1.5mW for keyword recognition after wake-up and 60microwatts in always-on standby mode.