Cerebras launches the world’s fastest AI inference, 20X performance compared to NVIDIA
Tweet Cerebras Systems launched Cerebras Inference, the world's fastest AI inference solution. It's 20x faster than NVIDIA's solutions and offers …
inference
Nvidia announces TensorRT 8, slashes BERT inference times down to a millisecond
Tweet Providing over twice the precision and inference speed compared to the last generation, Nvidia’s new TensorRT 8 deep learning …
Researchers accelerate sparse inference on XNNPack and TensorFlow Lite for realtime apps
Tweet XNNPack and TensorFlow Lite now support efficient inference of sparse networks. Researchers demonstrated substantial speedups in inference times on …
FPGA-based inference accelerator outscores GPUs and ASICs in MLPerf benchmark
Tweet Mispology’s FPGA-based Zebra AI inference accelerator outperformed Nvidia A100, V100, Tesla T4, AWS Inferencia, Google TPUv3, and others, on …