Techniques to Accelerate Deep Learning Model Inference

Model Complexity Reduction Model complexity directly impacts inference latancy. Overly intricate architectures with excessive parameters demand more computational resources. To address this, simplify layer counts and neuron densities. import torch import torch.nn as nn # Original dense model class OriginalNet(nn.Module): def __init__(self) ...

Posted on Mon, 03 Aug 2026 16:57:37 +0000 by Asinox

Deploying YOLOv8 on ITX-3588J with RKNN Toolkit

Environment Setup Target Device Configuration Refer to previous documentation regarding ITX-3588J development board setup. This guide assumes usage of rknn-toolkit2-lite version 2.0 with updated board drivers and toolkit. Host Development Environment The PC-side toolkit has compatibility limitations with Windows systems. Ubuntu-based environmen ...

Posted on Fri, 15 May 2026 17:39:35 +0000 by BenMo

Deploying a Custom YOLOv8s Handwritten Digit Detector on AX650N NPU with Pulsar2 Toolkit

Deploying a custom object detector on edge NPU hardware invovles training, quantization, and compilation. This guide walks through the entire pipeline using a YOLOv8s model trained on handwritten digits. Training the Custom YOLOv8s Model Preparing the Custom Dataset The dataset structure can be organized in any way; the following layout worked ...

Posted on Wed, 13 May 2026 11:58:01 +0000 by RaythMistwalker

Building a Cuisine Recommendation Web App with ONNX and Machine Learning

In this guide, we will build a cuisine recommendation web application that runs a machine learning model directly in the browser. Instead of using a backend server, we will leverage ONNX Web to let users interact with the model through a simple frontend interface. Cuisine Recommendation Web Application This project focuses on the machine learni ...

Posted on Mon, 11 May 2026 05:24:42 +0000 by largo