Apps for AI optimization

Speedster

Automatically apply SOTA optimization techniques to achieve the maximum inference speed-up on your hardware.

Hugging Face

ONNX

PyTorch

TensorFlow

CNN

Transformers

Inference

Nos

Automatically maximize the utilization and performance of GPU resources in your Kubernetes cluster.

Kubernetes

Infrastructure

OpenAlphaTensor

Increase the computational performances of an AI model with custom-generated matrix multiplication algorithm.

Hugging Face

PyTorch

TensorFlow

CNN

Diffusion

Transformers

Inference

ChatLLaMA

Build faster and cheaper ChatGPT-like training process based on LLaMA architectures.

PyTorch

Training

Forward-Forward

Test the performance of the Forward-Forward algorithm in PyTorch.

PyTorch

Training

GPT Optimizer

Effortlessly personalize large APIs generative models from OpenAI, Cohere and Hugging Face.

Hugging Face

PyTorch

Transformers

Optimization

CloudSurfer

Automatically discover the optimal cloud configuration and hardware on AWS, GCP and Azure to run your AI models.

Hugging Face

ONNX

PyTorch

TensorFlow

CNN

Transformers

Inference

OptiMate

Interactive tool guiding savvy users in achieving the best inference performance out of a given model / hardware setup.

Hugging Face

ONNX

PyTorch

TensorFlow

CNN

Transformers

Inference

TrainingSim

Easily simulate and optimize the training of large AI models on a distributed infrastructure.

CNN

Transformers

Training