Techniques to Accelerate Deep Learning Model Inference
Model Complexity Reduction
Model complexity directly impacts inference latancy. Overly intricate architectures with excessive parameters demand more computational resources. To address this, simplify layer counts and neuron densities.
import torch
import torch.nn as nn
# Original dense model
class OriginalNet(nn.Module):
def __init__(self) ...
Posted on Mon, 03 Aug 2026 16:57:37 +0000 by Asinox
Deploying YOLOv8 on ITX-3588J with RKNN Toolkit
Environment Setup
Target Device Configuration
Refer to previous documentation regarding ITX-3588J development board setup. This guide assumes usage of rknn-toolkit2-lite version 2.0 with updated board drivers and toolkit.
Host Development Environment
The PC-side toolkit has compatibility limitations with Windows systems. Ubuntu-based environmen ...
Posted on Fri, 15 May 2026 17:39:35 +0000 by BenMo
Deploying a Custom YOLOv8s Handwritten Digit Detector on AX650N NPU with Pulsar2 Toolkit
Deploying a custom object detector on edge NPU hardware invovles training, quantization, and compilation. This guide walks through the entire pipeline using a YOLOv8s model trained on handwritten digits.
Training the Custom YOLOv8s Model
Preparing the Custom Dataset
The dataset structure can be organized in any way; the following layout worked ...
Posted on Wed, 13 May 2026 11:58:01 +0000 by RaythMistwalker
Building a Cuisine Recommendation Web App with ONNX and Machine Learning
In this guide, we will build a cuisine recommendation web application that runs a machine learning model directly in the browser. Instead of using a backend server, we will leverage ONNX Web to let users interact with the model through a simple frontend interface.
Cuisine Recommendation Web Application
This project focuses on the machine learni ...
Posted on Mon, 11 May 2026 05:24:42 +0000 by largo