Mochan Shrestha [mochan.org]
Tutorials, Education, Learning and Knowledge
Isaac Sim MCP Server
(
2026/03/03
) : Introducing isaacsim-mcp, an MCP server that lets AI coding agents (Claude, …
GAE: Generalized Advantage Estimation
(
2025/08/31
) : In reinforcement learning, agents learn to make better decisions by …
Weights & Biases Tutorial
(
2025/06/29
) : In this tutorial, we will go over how to log data to weights & biases …
MLflow Tutorial
(
2025/06/28
) : In this tutorial, we will go over the basics of running and logging data to …
Actor Critic Methods in Reinforcement Learning
(
2025/03/21
) : Actor-critic methods combine value-based learning and policy-based learning, …
Importance Sampling in Off-Policy Reinforcement Learning
(
2025/02/08
) : Importance sampling is a technique that solves a fundamental challenge in RL: …
Bayes Theorem Conditioned on Multiple Variables
(
2024/04/06
) : We want to prove Bayes theorem that is conditioned on multiple variables. We …
Reduce PDF Tool
(
2024/01/07
) : This is a tool to reduce the size of PDF files by removing or compressing …
Adding Perplexity.ai API support to Langchain
(
2023/12/26
) : We will add support for calling perplexity.ai API from LangChain. This will …
Mujoco Mocapper
(
2023/12/21
) : Mujoco Mocapper is a tool that takes a mujoco file and adds mocap to it. It can …
Local LLMs using Llama.Cpp and Python
(
2023/12/19
) : We will run local GMML models using llama.cpp and python. We will use the python …
Local LLMs using Ollama Server API with Python
(
2023/12/03
) : We will run local LLM models using python by calling the Ollama server API. We …
Mujoco Mocap Tutorial 2: Mujoco Mocap of the Google Robot
(
2023/11/26
) : We use mocap to control the Google Robot and move the end effector to a desired …
Mixed Integer Linear Programming
(
2023/11/25
) : Mixed integer linear programming is a set of optimization problems where some of …
Shapley Values
(
2023/11/12
) : Given a group of players working cooperatively, Shapley value is a measure of …
Mujoco Mocap Tutorial 1: Mocap object and keyboard movement
(
2023/11/11
) : In this tutorial, we will go over the mocap object in mujoco and set up a simple …
