Nedu Ekeruche
← Projects

Deep Reinforcement Learning for Portfolio Allocation

Reproducing J.P. Morgan AI research to compare PPO against classical mean-variance optimization under market volatility.

GitHubPaper

Out-of-sample on ten S&P 500 sector portfolios, one held-out year at a time (2012–2021). PPO is a five-seed average for that year’s window. MVO is max-Sharpe with Ledoit–Wolf covariance. PPO matches MVO on Sharpe (0.96 vs 0.94) with lower volatility (9.8% vs 14.7%) and a much smaller worst drawdown (−15.4% vs −36.3%). MVO’s average annual return is higher (10.2% vs 8.5%).

Ten-year summary

Summary averages the ten yearly statistics. Max drawdown is the worst year (2020 for both). Calmar is the mean of yearly Calmar ratios. Turnover is mean absolute change in sector weights (cash ignored).

PPOMVO
Average annual return8.5%10.2%
Average Sharpe ratio0.960.94
Average annual volatility9.8%14.7%
Worst max drawdown−15.4%−36.3%
Average yearly Calmar ratio2.081.76
Average daily turnover (Δp_w)0.680.29

By test year

PPO has the higher Sharpe in 2014, 2015, 2019, 2020, and 2021. In 2020 PPO stayed positive (+3.9%, drawdown −15.4%) while MVO lost 2.5% and drew down 36.3%.

YearPPO returnMVO returnPPO SharpeMVO SharpePPO max DDMVO max DD
20120.9%5.3%0.150.53−6.4%−10.1%
20133.5%23.3%0.511.89−7.2%−7.8%
201413.6%12.2%2.121.07−3.4%−7.7%
20150.6%0.4%0.110.10−8.1%−12.4%
20169.5%20.1%1.051.33−8.9%−8.5%
20176.7%14.5%1.332.05−1.9%−2.9%
2018−6.8%−11.6%−0.82−0.72−7.4%−18.9%
201915.5%18.6%1.791.68−5.3%−5.9%
20203.9%−2.5%0.280.11−15.4%−36.3%
202137.7%21.2%3.121.36−4.1%−8.0%

Full OOS equity

2017–2021 results console: normalized equity for PPO vs MVO vs S&P 500, summary cards, and 63-day rolling Sharpe.

Full out-of-sample DRL portfolio equity and rolling Sharpe charts

Full OOS weights

Sector allocation on a selected day and weight intensity over the full out-of-sample window.

Full out-of-sample portfolio weight bars and intensity heatmap

2012 equity

Single-year preset for 2012: normalized equity, PPO and MVO cards, and rolling Sharpe.

2012 DRL portfolio equity and rolling Sharpe charts

2012 weights

2012 allocation snapshot and weight intensity heatmap across the year.

2012 portfolio weight bars and intensity heatmap