Spark Framework Overview and Environment Setup
What is Spark?
Spark is a unified analytics engine designed for large-scale data processing. It supports custom computations on various data types, including structured, semi-structured, and unstructured data.
Origin
Spark was developed at UC Berkeley in 2009 and open-sourced in 2010. The original team founded Databricks in 2013 and donated Spa ...
Posted on Sat, 26 Sep 2026 16:06:12 +0000 by paladaxar
Distributed Approximate Nearest Neighbor Search with HNSWlib and PySpark
Context
Approximate Nearest Neighbor (ANN) search is a critical operation in large-scale data processing pipelines, particularly for applications like content recommendation and image similarity retrieval. While the standard HNSWlib implementation provides excellent single-node performance, it often struggles with memory and compute limitations ...
Posted on Wed, 16 Sep 2026 16:05:31 +0000 by mgs019
Understanding Java RMI: Implementation and Security Considerations
What is RMI?
Remote Method Invocation (RMI) is a Java-native mechanism that enables method calls between different JVM processes. Unlike generic RPC frameworks, RMI is purpose-built for Java environments, allowing objects in one virtual machine to invoke methods on objects residing in another JVM across the network.
The communication backbone o ...
Posted on Tue, 15 Sep 2026 16:39:08 +0000 by Mr Camouflage
Storing Set Data with RedissonClient
Initializing Redissson Client
Config cfg = new Config();
cfg.useSingleServer().setAddress("redis://localhost:6379");
RedissonClient rClient = Redisson.create(cfg);
Accessing a Distributed Set
RSet<Object> dataCollection = rClient.getSet("sampleSet");
Addding Members
dataCollection.add("alpha");
dataCollecti ...
Posted on Fri, 21 Aug 2026 16:21:26 +0000 by scbookz
Ray: A Powerful Python Library for Distributed Computing
In the era of big data and artificial intelligence, the demand for distributed computing frameworks is increasingly urgent. Python Ray library was created to meet this demand. It is a high-performance, easy-to-use distributed application framework designed specifically for solving parallel and distributed computing problems in Python. This arti ...
Posted on Sun, 10 May 2026 01:42:47 +0000 by ccrevcypsys