Freaks City

Understanding Vision Transformers for Image Classification The Vision Transformer (ViT) represents a groundbreaking approach that merges principles from natural language processing with computer vision. This architecture leverages self-attention mechanisms to achieve impressive results in image classification tasks without relying on traditiona ...

Introduction When training deep learning models with Caffe, visualizing the training progress through loss curves is essential for monitoring model convergence. This article presents two practical approaches for generating training visualizations. Method 1: Custom Python Script for Headless Servers The following implementation is specifically d ...

When migrating legacy TensorFlow 1.x code to TensorFlow 2.x, several common attribute errors may occur due to API changes. Below are typical issues and their solutions: 1. module 'tensorflow' has no attribute 'placeholder' tf.placeholder was removed in TensorFlow 2.x. To retain 1.x behavior: import tensorflow.compat.v1 as tf tf.disable_v2_behav ...

1.1 Approach 1: Using os.environ['CUDA_VISIBLE_DEVICES'] import os os.environ['CUDA_VISIBLE_DEVICES'] = '2' model = NeuralNet().cuda() batch = batch.cuda() 1.2 Approach 2: Using torch.device() target_device = torch.device('cuda:2') model = NeuralNet().to(target_device) batch = batch.to(target_device) 1.3 Errer 1: RuntimeError: CUDA error: inv ...

Color adjustment (brightness, saturation, contrast) Random scaling Random cropping PCA-based color augmentation Translation shifting Horizontal/vertical flipping Rotation and affine transformations Gaussian noise additoin Class imbalance correction Implementation Example (NumPy/PIL) from PIL import Image, ImageEnhance import numpy as np impo ...

Chemical Informatics Fundamentals The evolution of artificial intelligence in chemistry involves several stages. Early efforts focused on digitizing chemical knowledge into databases using various representation methods. Mid-stage approaches relied on manual feature engineering to encode existing data, followed by traditional machine learning a ...

Tensor Creaiton and Initialization Basic Tensor Operations import torch # Create tensor from list data_tensor = torch.tensor([1, 2, 3], dtype=torch.float32) # Create tensor with random values (uniform distribution) rand_tensor = torch.rand(2, 3) # Create tensor with normal distribution values normal_tensor = torch.randn(3, 4) # Create tenso ...

PyTorch's Automatic Mixed Precision (AMP) feature allows efficient training by combining FP32 and FP16 precision operations. This technique reduces memory usage and accelerates computation while maintaining model accuracy. Understanding Mixed Precision Deep learning models traditionally use 32-bit floating point (FP32) for all operations. Mixed ...

Version Checking # Check CUDA version (Command Prompt) nvcc -V or nvcc --version # Check Python version (Command Prompt) python # Check available CUDA versions (Command Prompt) nvidia-smi # CUDA Version is displayed after this text Installation Process 1. Visual Studio Installation Version Selection: For CUDA 11.8.0 (can be higher th ...

Convolution is a foundational operation in deep learning—especially in computer vision—where it enables hierarchical feature extraction through localized, parameter-shared transformations. Unlike general matrix multiplication, convolution exploits spatial locality and translation invariance, making it both computationally efficient and semantic ...