Audience
Anyone searching for a neural network solution
About DeePhi Quantization Tool
This is a model quantization tool for convolution neural networks(CNN). This tool could quantize both weights/biases and activations from 32-bit floating-point (FP32) format to 8-bit integer(INT8) format or any other bit depths. With this tool, you can boost the inference performance and efficiency significantly, while maintaining the accuracy. This tool supports common layer types in neural networks, including convolution, pooling, fully-connected, batch normalization and so on. The quantization tool does not need the retraining of the network or labeled datasets, only one batch of pictures are needed. The process time ranges from a few seconds to several minutes depending on the size of neural network, which makes rapid model update possible. This tool is collaborative optimized for DeePhi DPU and could generate INT8 format model files required by DNNC.
Other Popular Alternatives & Related Software
TFLearn
TFlearn is a modular and transparent deep learning library built on top of Tensorflow. It was designed to provide a higher-level API to TensorFlow in order to facilitate and speed up experimentations while remaining fully transparent and compatible with it. Easy-to-use and understand high-level API for implementing deep neural networks, with tutorial and examples. Fast prototyping through highly modular built-in neural network layers, regularizers, optimizers, metrics. Full transparency over Tensorflow. All functions are built over tensors and can be used independently of TFLearn. Powerful helper functions to train any TensorFlow graph, with support of multiple inputs, outputs, and optimizers. Easy and beautiful graph visualization, with details about weights, gradients, activations and more. The high-level API currently supports most of the recent deep learning models, such as Convolutions, LSTM, BiRNN, BatchNorm, PReLU, Residual networks, Generative networks.
Learn more
Latent AI
We take the hard work out of AI processing on the edge. The Latent AI Efficient Inference Platform (LEIP) enables adaptive AI at the edge by optimizing for compute, energy and memory without requiring changes to existing AI/ML infrastructure and frameworks. LEIP is a modular, fully-integrated workflow designed to train, quantize, adapt and deploy edge AI neural networks. LEIP is a modular, fully-integrated workflow designed to train, quantize and deploy edge AI neural networks.
Latent AI believes in a vibrant and sustainable future driven by the power of AI and the promise of edge computing.
Our mission is to deliver on the vast potential of edge AI with solutions that are efficient, practical, and useful. Latent AI helps a variety of federal and commercial organizations gain the most from their edge AI with an automated edge MLOps pipeline that creates ultra-efficient, compressed, and secured edge models at scale while also removing all maintenance and configuration concerns
Learn more
Deci
Easily build, optimize, and deploy fast & accurate models with Deci’s deep learning development platform powered by Neural Architecture Search. Instantly achieve accuracy & runtime performance that outperform SoTA models for any use case and inference hardware. Reach production faster with automated tools. No more endless iterations and dozens of different libraries. Enable new use cases on resource-constrained devices or cut up to 80% of your cloud compute costs. Automatically find accurate & fast architectures tailored for your application, hardware and performance targets with Deci’s NAS based AutoNAC engine. Automatically compile and quantize your models using best-of-breed compilers and quickly evaluate different production settings. Automatically compile and quantize your models using best-of-breed compilers and quickly evaluate different production settings.
Learn more
Zebra by Mipsology
Zebra by Mipsology is the ideal Deep Learning compute engine for neural network inference. Zebra seamlessly replaces or complements CPUs/GPUs, allowing any neural network to compute faster, with lower power consumption, at a lower cost. Zebra deploys swiftly, seamlessly, and painlessly without knowledge of underlying hardware technology, use of specific compilation tools, or changes to the neural network, the training, the framework, and the application. Zebra computes neural networks at world-class speed, setting a new standard for performance. Zebra runs on highest-throughput boards all the way to the smallest boards. The scaling provides the required throughput, in data centers, at the edge, or in the cloud. Zebra accelerates any neural network, including user-defined neural networks. Zebra processes the same CPU/GPU-based trained neural network with the same accuracy without any change.
Learn more
Pricing
Starting Price:
$0.90 per hour
Integrations
No integrations listed.
Company Information
DeePhi Quantization Tool
aws.amazon.com/marketplace/pp/prodview-bwtx6kzwg3gva
Videos and Screen Captures
Other Useful Business Software
Managed Cloud Hosting Platform | Nexcess
The managed cloud solution engineered for simplicity, with built-in governance and risk-mitigation, plus a bill you can actually forecast.
Product Details
Platforms Supported
Cloud
Training
Documentation
Support
Online
