Intel's Heracles chip accelerates FHE computing
Intel has unveiled Heracles, a specialized chip designed to drastically accelerate fully homomorphic encryption (FHE) computing. Presented at the IEEE International Solid-State Circuits Conference in San Francisco, the chip solves a critical bottleneck in encrypted data processing by speeding up FHE tasks by up to 5,000 times compared to a top-tier Intel Xeon server CPU. FHE allows computations to be performed on data while it remains encrypted, ensuring privacy for sensitive applications like medical genetic testing or secure voting systems. However, traditional CPUs and GPUs struggle with this task because encrypted data is significantly larger and requires complex mathematical operations that are thousands of times slower than standard processing. Heracles represents a significant leap in scale and performance. While previous research chips were typically under 10 square millimeters, Heracles measures about 20 times larger and is manufactured using Intel's advanced 3-nanometer FinFET technology. The chip features 64 compute cores arranged in an eight-by-eight grid, connected by a high-speed on-chip network. It is paired with two 24-gigabyte high-bandwidth memory chips, a configuration usually reserved for AI training GPUs, enabling a total of 48 gigabytes of on-package memory. In a live demonstration simulating a voter privacy check, Heracles completed the task in 14 microseconds, whereas a standard Intel Xeon CPU required 15 milliseconds. This efficiency translates to verifying 100 million ballots in just 23 minutes on Heracles, compared to over 17 days on a conventional CPU. The project, initiated five years ago under a DARPA program, was led by Ro Cammarota and Sanu Mathew. The architecture uses 32-bit arithmetic circuits to handle massive numbers required by FHE algorithms while maintaining precision. By processing data through three synchronized instruction streams for data movement and computation, the chip minimizes latency and maximizes throughput. Intel reports speedups ranging from 1,074 to 5,547 times depending on the operation, proving the first hardware solution capable of scaling FHE for real-world workloads. The announcement has intensified competition among startups and industry leaders. Companies like Duality Technology, Niobium Microsystems, Fabric Cryptography, and Optalysys are developing their own FHE accelerators. Niobium has already secured a $6.9 million deal to fabricate its chip using Samsung Foundry's 8-nanometer process, aiming to be the first commercially viable solution. Optalysys is pursuing a photonic approach to exceed digital limits, targeting a commercial release within three years. While some experts note that specialized hardware may not yet be necessary for current smaller-scale encrypted applications, the consensus is that FHE will become essential for future encrypted artificial intelligence and large machine learning models. Intel has no immediate commercial plans for Heracles but views the chip as the beginning of a new computing journey, with future iterations expected to further refine performance and tackle even larger problems.
