Gumbel-Softmax Technique and Gumbel Distribution
While studying the MADDPG paper, I encountered the use of the Gumbel-Softmax estimator in discrete communication environments. Further exploration revealed that this technique has broad applications, including various GANs in deep learning and algorithms like A2C and MADDPG in reinforcement learning. The Gumbel-Softmax Trick can be applied when ...
Posted on Tue, 20 Oct 2026 16:32:16 +0000 by Levan
Mathematical Foundations of Reinforcement Learning: Value and Policy Iteration Algorithms
Value Iteration streamlines the search for optimal state values by alternating between two operations: optimizing the policy relative to current value estimates, and updating those estimates using the newly identified greedy actions. Unlike standard Bellmen expectation equations, the optimality variant incorporates a maximization operator acros ...
Posted on Fri, 11 Sep 2026 16:19:02 +0000 by mlla2