Skip to content
Haifeng's Notes
ZeRO
Initializing search
GitHub
Haifeng's Notes
GitHub
Home
Book
Book
The Book of Why
The Presentation Secrets of Steve Jobs
自控力
Competitive Programming
Competitive Programming
Codeforces
Codeforces
383C
388B
392B
396B
398B
403B
406B
407B
414B
418B
420B
425B
429B
434B
438B
442B
444B
446B
449B
453B
455B
461B
464B
468B
477B
480B
482B
484B
487B
489C
504B
506B
Leetcode
Leetcode
4. Median of Two Sorted Arrays
23. Merge K sorted Lists
32. Longest Valid Parentheses
126. Word Ladder II
174. Dungeon Game
212. Word Search II
215. Kth Largest Element in an Array
220. Contains Duplicate III
321. Create Maximum Number
363. Max Sum of Rectangle No Larger Than K
398. Random Pick Index
440. Kth Smallest in Lexicographical Order
465. Optimal Account Balancing
490. Reverse Pair
530. Minimum Absolute Difference in BST
546. Remove Boxes
686. Repeated String Match
843. Guess the Word
975. Odd Even Jump
C++ Grammar
Combinatorics
Computational Geometry
Data Structures
Dynamic Programming
Game Theory
Graph Theory
Hashing
Interview Tips
Java Grammar
Network Flow
Number Theory
Python Grammar
RMQ & LCA
String
Health
Health
Diet
Exercise
Sleep
Math
Math
Calculus
Calculus
Derivatives
Gradient
Hessian Matrix
Integral
L'Hopital's Rule
Limits
Matrix Differentiation
Taylor Theorem
Vector Field
Information Theory
Information Theory
Conditional Entropy
Cross Entropy
Entropy
Joint Entropy
KL Divergence
Mutual Information
Noisy-Channel Coding Theorem
Shannon's Source Coding Theorem
Shannon–Hartley Theorem
Linear Algebra
Linear Algebra
Abstract Vectors
Change of Basis
Column Space
Cross Product
Determinant
Dot Product
Eigenvector and Eigenvalues
Inverse Matrix
Linear Transformation
Null Space
Quadratic Form
Rank
Machine Learning
Machine Learning
Rotary Positional Embedding
Optimization
Optimization
Multi-Armed Bandit
Statistics
Statistics
Distributions
Distributions
Cumulative Distribution Function
Normal Distribution
Poisson Distribution
Probability Density Function
Probability Mass Function
Bayes Theorem
L-Norms
Law of Iterated Expectations
Linear Regression
Logistic Regression
Logit Function
Maximum Likelihood Estimation
Maximum a Posteriori Estimation
Regularization
Trigonometry
Tech
Tech
Computer Networks
Computer Networks
Hub
Modem
OSI Model
Router
Switch
Snippets
Snippets
GPU
LaTex
Linux C Socket
Linux C Thread
Linux Commands
ubuntu
windows socket C++
Software Engineering
Software Engineering
C++
C++
Abseil
Best Practices
Declaration and Definition
Deduction
Forwarding References
Header Guard
Header vs Source
Internal vs External Linkage
Lambda functions
Move-only Class
Pointers
RAII
Return Value Optimization (RVO)
Template
The constexpr keyword
The move function
The nodiscard keyword
The noexcept keyword
The optional keyword
The static keyword
Translation Unit
lvalue vs rvalue
API Design
Design Patterns
Design Review
Git
Guide for Technical Development
Java Log Best Practices
Management
Python
Refactor
Unified Modeling Language
Unit Testing
System Design
System Design
tabase replication modes:
System
System
Architecture
Architecture
CPU
Machine learning
Machine learning
Gpu
Gpu
CUDA Kernel
CUDA Stream
Memory Hierarchy
NCCL
NVCC
Streaming Multiprocessor (SM)
Thread Block
Continuous Batching
Disaggregated Serving
Flash Attention
Flex Attention
GSPMD
Megatron
Ring Attention
Speculative decoding
ZeRO
Operating System
Operating System
Operating System
Compiler
Tools
Tools
Bazel
Debugging with GDB | BetterExplained
Docker
Google Cloud Platform
Jekyll
Keras
Pycharm
Screen
Subversion
TMUX
VIM
ZeRO
FSDP