You will be provided with a research report. The body of the report will contain some citations to references.

Citations in the main text may appear in the following forms:
1. A segment of text + space + number, for example: "Li Qiang constructed a socioeconomic status index (SES) based on income, education, and occupation, dividing society into 7 levels 15"
2. A segment of text + [number], for example: "Li Qiang constructed a socioeconomic status index (SES) based on income, education, and occupation, dividing society into 7 levels[15]"
3. A segment of text + [number†(some line numbers, etc.)], for example: "Li Qiang constructed a socioeconomic status index (SES) based on income, education, and occupation, dividing society into 7 levels[15†L10][5L23][7†summary]"
4. [Citation Source](Citation Link), for example: "According to [ChinaFile: A Guide to Social Class in Modern China](https://www.chinafile.com/reporting-opinion/media/guide-social-class-modern-china)'s classification, Chinese society can be divided into nine strata"

Please identify **all** instances where references are cited in the main text, and extract (fact, ref_idx, url) triplets. When extracting, pay attention to the following:
1. Since these facts will need to be verified later, you may need to look for some context before and after the citation to ensure that the fact is complete and understandable, rather than just a simple phrase or short expression.
2. If a fact cites multiple references, then it should correspond to two triplets: (fact, ref_idx_1, url_1) and (fact, ref_idx_2, url_2).
3. For the third form of citation (i.e., where the citation source and link appear directly in the text), the ref_idx should be uniformly set to 0.
4. If the main text does not specify the exact location of the citation (for example, only the reference list is listed at the end of the article, without specifying the citation point in the text), please return an empty list.

You should return a JSON list format, where each item in the list is a triplet, for example:
[
    {
        "fact": "Text segment from the original document. Note that Chinese quotation marks should use full-width marks. And add a single backslash before the English quotation mark to make it a readable for python json module.",
        "ref_idx": "The index of the cited reference in the reference list for this text segment.",
        "url": "The URL of the cited reference for this text segment (extracted from the reference list at the end of the research report or from the parentheses at the citation point)."
    }
]

Here is the main text of the research report:
# Machine Learning and Quantitative Models for Asset Allocation: Mean-Variance, Black-Litterman, Deep Learning, and Hybrid Frameworks

## TL;DR

- **No single paradigm dominates**: classical Mean-Variance (MV) is an "error maximizer" whose out-of-sample gains are usually offset by estimation error (DeMiguel, Garlappi & Uppal 2009 show none of 14 optimizers consistently beats naive 1/N); Black-Litterman (BL) stabilizes it by treating expected returns as a Bayesian quantity to be estimated; deep learning (DL/DRL) captures non-linearity and alternative data but is fragile, opaque, and prone to backtest overfitting. The state of the art in 2022–2026 is explicitly **hybrid**.
- **The winning hybrid pattern is "ML generates the views/inputs, a structured optimizer allocates."** BL with ML/LLM-generated views, DL-estimated covariance feeding MV, and differentiable end-to-end "predict-and-optimize" layers repeatedly beat both pure classical and pure black-box approaches on Sharpe ratio and drawdown, because they marry ML's forecasting flexibility with the regularization and interpretability of financial structure.
- **Recommended framework**: a regime-aware, three-layer stack — (1) ML/DL forecasting engine (returns + covariance + uncertainty), (2) a Bayesian/BL fusion layer that shrinks noisy ML views toward market equilibrium, (3) a differentiable or robust optimizer with explicit downside-risk (CVaR) constraints — governed by rigorous purged cross-validation and deflated-Sharpe testing to control overfitting.

## Key Findings

1. **MV's core flaw is estimation error, not the concept of optimization.** Chopra & Ziemba (1993) quantified that errors in means are over ten times as damaging as errors in variances, and over twenty times as damaging as errors in covariances, and the optimizer amplifies them. Michaud (1989), in "The Markowitz Optimization Enigma: Is 'Optimized' Optimal?", found that "the major problem with MV optimization is its tendency to maximize the effects of errors in the input assumptions" and that "unconstrained MV optimization can yield results that are inferior to those of simple equal-weighting schemes." This is why the minimum-variance and 1/N portfolios are hard to beat out-of-sample.
2. **BL solves MV's instability via Bayesian shrinkage toward equilibrium.** By reverse-optimizing market-cap weights into implied returns (the prior) and blending in views (the likelihood), BL produces posterior returns that yield far more stable, intuitive, diversified portfolios.
3. **Deep learning's value is concentrated in the *inputs* (forecasting returns/covariances/risk), not necessarily in replacing the optimizer.** LSTM covariance estimators, DL return forecasts, and neural CVaR estimators improve the raw ingredients; the allocation step often still benefits from classical structure.
4. **Deep reinforcement learning (DRL) is competitive but must be benchmarked against robust baselines, not just indices.** In the fair, same-objective comparison of Sood, Papasotiriou, Vaiciulis & Balch (2023), across 10 backtests (2012–2021) DRL annual returns and Sharpe ratio were roughly 1.85× those of MVO, with DRL showing lower maximum drawdown in virtually every year — yet simple 1/N frequently beats both, so DRL is a serious contender rather than a clear winner.
5. **Hybrids win in recent literature.** Transformer-DRL-BL (Sun et al. 2024), Transformer-GAN-BL (Zhu & Yen 2024), LLM-view BL (Lee et al. 2025), and end-to-end differentiable MV layers (Butler & Kwon; Zhang et al.) all report material Sharpe/return improvements over their pure counterparts.
6. **Overfitting is the central threat.** López de Prado's deflated Sharpe ratio, probability of backtest overfitting (PBO), and combinatorial purged cross-validation (CPCV) are now essential validation tools; naive walk-forward and in-sample Sharpe massively overstate performance.

## Details

### 1. Mean-Variance (Markowitz) Model

**Formulation.** For asset weights \(w
\), expected returns \(\mu
\), covariance \(\Sigma
\), and risk-aversion \(\lambda
\), the canonical problem is:

\[\max_w \; w^\top \mu - \tfrac{\lambda}{2} w^\top \Sigma w \quad \text{s.t. } w^\top \mathbf{1} = 1\]

or equivalently minimize variance \(w^\top\Sigma w
\) subject to a target return. Varying the target traces the **efficient frontier**; with a risk-free asset the tangency portfolio maximizes the Sharpe ratio \((\mu_p - r_f)/\sigma_p
\). The unconstrained solution is closed-form: \(w^\* \propto \Sigma^{-1}\mu
\).

**Assumptions.** Returns are normally distributed (or investors have quadratic utility), so mean and variance fully describe preferences; investors are rational and risk-averse; a single period; expected returns constant over time. Variance treats upside and downside symmetrically — a key weakness given real returns exhibit fat tails and negative skew.

**Risk & return measurement.** Risk = variance/covariance matrix; returns = historical sample means. The covariance matrix has \(n(n+1)/2
\) free parameters — 125,250 for n=500 assets — so estimation error compounds badly in high dimensions.

**Limitations.** (i) Extreme, concentrated corner solutions (large offsetting long/short weights) practitioners distrust; (ii) acute input sensitivity — small changes in \(\mu
\) produce wildly different weights; (iii) estimation-error amplification ("error maximizer"); (iv) unrealistic normality. DeMiguel, Garlappi & Uppal (2009, *Review of Financial Studies* 22(5):1915–1953) show that across 14 optimizers and 7 datasets, **none consistently beats 1/N** on Sharpe, certainty-equivalent return, or turnover, and that "the estimation window needed for the sample-based mean-variance strategy… to outperform the 1/N benchmark is around 3000 months for a portfolio with 25 assets and about 6000 months for a portfolio with 50 assets."

**Extensions.** Global Minimum-Variance (GMVP) — drops the return input entirely, isolating covariance estimation, and often outperforms full MV; Robust MV (Ben-Tal/Nemirovski uncertainty sets); Michaud Resampled Efficiency (Monte-Carlo averaging of frontiers); shrinkage estimators (Ledoit-Wolf covariance, James-Stein means); norm-constrained/penalized (L1/L2) portfolios; mean-absolute-deviation and mean-CVaR objectives.

### 2. Black-Litterman (BL) Model

**Formulation.** BL is Bayesian. The prior is the CAPM equilibrium: reverse-optimize market weights \(w_{mkt}
\) to get implied excess returns

\[\Pi = \lambda \Sigma w_{mkt}.\]

Views are expressed as \(P\mu = Q + \varepsilon,\ \varepsilon\sim N(0,\Omega)
\), where \(P
\) (K×N) is the "picking" matrix mapping K views onto N assets, \(Q
\) is the view vector, and \(\Omega
\) is the diagonal view-uncertainty matrix. The **posterior (master) formula** for expected returns is:

\[E[R] = \left[(\tau\Sigma)^{-1} + P^\top\Omega^{-1}P\right]^{-1}\left[(\tau\Sigma)^{-1}\Pi + P^\top\Omega^{-1}Q\right]\]

with posterior covariance \(\hat\Sigma = \Sigma + [(\tau\Sigma)^{-1}+P^\top\Omega^{-1}P]^{-1}
\). The result is a **precision-weighted average of equilibrium prior and views**. These posterior moments then feed a standard MV optimization. Equivalently, BL can be cast as a generalized-least-squares Bayesian regression \(y = X\mu + \varepsilon
\) with \(y=[\Pi; Q]
\), \(X=[I; P]
\), and block-diagonal covariance \(V = \mathrm{diag}(\tau\Sigma, \Omega)
\).

**Key parameters.** \(\tau
\) (scalar, ~0.025–0.05 or 1/T, scaling prior uncertainty; He & Litterman used 0.025, and 1/T is a common alternative); \(\Omega
\) (view confidence — larger = less influence); \(P
\), \(Q
\) (view structure and magnitude); \(\lambda
\) (risk aversion in reverse optimization).

**Strengths.** Produces stable, well-diversified, intuitive portfolios; anchors to a market-neutral prior so that with no views you recover market weights; [Readthedocs](https://pyportfolioopt.readthedocs.io/en/latest/BlackLitterman.html) directly addresses MV's estimation-error and corner-solution problems by treating \(\mu
\) as an estimated quantity.

**Limitations.** Subjectivity/difficulty in specifying views and especially \(\Omega
\) (view confidence); mis-specifying \(\Omega
\) and ignoring \(\tau
\) are common errors; [Stockalpha](https://stockalpha.ai/alpha-learning/black-litterman-model-explained-incorporating-investor-views-into-portfolio-opti) assumes normally distributed returns and a market-cap prior that may not be an appropriate equilibrium. Elliptical-distribution extensions (Xiao & Valdez 2015) relax normality for heavy tails.

### 3. Deep Learning Models for Asset Allocation

**Model families.**

- **Sequence models for forecasting**: LSTM, GRU, BiLSTM, Temporal Convolutional Networks (TCN), Transformers/attention — for return and volatility time-series prediction, often combined with signal decomposition (CEEMDAN, EMD, SSA) to denoise financial series.
- **CNNs**: pattern extraction from price "images"/OHLC and limit-order-book data (DeepLOB).
- **Autoencoders**: dimensionality reduction / latent factor extraction ("deep factor models").
- **GANs**: scenario/return-distribution generation, view generation.
- **Deep Reinforcement Learning (DRL)**: DDPG, TD3, PPO, A2C, SAC, DQN — learn allocation policies directly.

**Return prediction.** Two paradigms: (a) predict-then-optimize (forecast \(\mu
\), \(\Sigma
\), then optimize) and (b) end-to-end (learn weights directly). Gu, Kelly & Xiu (2020) is the landmark: neural nets and trees deliver the best monthly out-of-sample return prediction, and long-short portfolios on NN forecasts earn large Sharpe ratios (see Empirical Evidence).

**Risk measurement.** Neural network VaR/CVaR estimation (LSTM-CVaR for tail-risk-adjusted utility); [Wiley Online Library](https://onlinelibrary.wiley.com/doi/full/10.1002/ijfe.70012) GARCH-LSTM hybrids for volatility; LSTM covariance estimators that produce superior out-of-sample covariance forecasts and higher-Sharpe tangency portfolios vs. classical estimators; [ScienceDirect](https://www.sciencedirect.com/science/article/pii/S2405918826000279) copula-GARCH-DL for dependence structure; mean-CVaR portfolios built on DL stock-return forecasts (RNN/LSTM/GRU/MLP/RBFN, with LSTM most accurate).

**End-to-end / deep portfolio theory.** Networks output weights via a softmax layer and train by maximizing Sharpe directly (Zhang-Zohren-Roberts), bypassing return forecasting. [ResearchGate](https://www.researchgate.net/publication/346737516_Deep_Learning_for_Portfolio_Optimization) Differentiable optimization layers (OptNet, cvxpylayers, BPQP) embed a QP/MV solver *inside* the network so allocation and prediction are learned jointly by differentiating through the KKT conditions ("task-based"/"decision-focused" learning).

**DRL framework design.** MDP formulation: **state** = price/return history window + technical/macro/alternative features (+ often previous weights); **action** = portfolio weight vector (continuous, softmax for long-only; long/short if shorting allowed); **reward** = log portfolio return, differential Sharpe, or return net of transaction costs and a risk penalty (e.g., extended Markowitz mean-variance reward as in the RTC-CNN-TD3 model, negative max-drawdown as in DeepTrader, [AAAI](https://ojs.aaai.org/index.php/AAAI/article/view/16144) or CVaR-aware rewards). Transaction costs are subtracted at rebalancing; [arXiv](https://arxiv.org/pdf/2102.06233) memory-augmentation (appending lagged weights) improves stability under path-dependent costs. [ScienceDirect](https://www.sciencedirect.com/science/article/pii/S2590005626003140)

**Strengths.** Capture non-linearity, high-dimensional and unstructured/alternative data (news, satellite, transcripts), adapt dynamically to regimes, and can optimize the true objective end-to-end.

**Limitations.** Black-box opacity (regulatory barrier); overfitting and data-hunger; non-stationarity of markets; unstable across seeds; backtest look-ahead and survivorship bias; hard to trust extreme learned weights. DRL results are highly sensitive to reward design and hyperparameters.

### 4. Core Differences

| Dimension | Mean-Variance | Black-Litterman | Deep Learning / DRL |
| --- | --- | --- | --- |
| **Return estimate** | Historical sample means | Bayesian posterior: equilibrium prior + views | Learned non-linear forecasts (or bypassed entirely in end-to-end) |
| **Risk measure** | Sample covariance (variance) | Market-implied + posterior covariance | Learned covariance; NN VaR/CVaR; GARCH-LSTM; downside/drawdown |
| **Allocation mechanism** | Closed-form / QP on efficient frontier | Posterior moments → MV optimization | Policy learning (DRL) or differentiable optimization layer |
| **Market efficiency** | Implicitly assumes tradable inefficiency | Anchors to equilibrium (semi-efficient) | Agnostic; exploits learned patterns |
| **Return distribution** | Normal / quadratic utility | Normal (elliptical extensions) | Non-parametric, captures fat tails/skew |
| **Stationarity** | Assumes stationary moments | Assumes stationary prior | Can model non-stationarity but suffers from it |
| **Interpretability** | High (transparent) | High (views are explicit) | Low (needs SHAP/attention/distillation) |
| **Computational cost** | Low | Low–moderate | High (training) |
| **Data requirements** | Moderate | Moderate | Very high |
| **Key failure mode** | Estimation-error amplification | Subjective/mis-specified views & Ω | Overfitting, non-stationarity, opacity |

### 5. Hybrid Frameworks (2020–2026)

**BL with ML-generated views** — the most active area:

- **CNN-BiLSTM → Dynamic BL** (Barua & Sharma 2022): CNN-BiLSTM predictions as views in a time-varying BL; outperforms three benchmarks on efficiency and diversification.
- **GARCH-EVT-Copula + LSTM → BL** (*Annals of Operations Research* 2025): beats max-Sharpe and original BL. [Springer](https://link.springer.com/article/10.1007/s10479-025-06597-6)
- **CEEMDAN-GLSTM-LSTM (CGL-BL)** (*Expert Systems with Applications*): decomposition + dual-LSTM generate objective views.
- **SSA-MAEMD-TCN → BL** (arXiv:2505.01781, 2025): decomposition/denoising + TCN forecasts as reliable BL inputs, beating MAEMD-TCN, MEMD-TCN, and MAEMD-LSTM on RMSE/MAPE/R².
- **View fusion / Bayesian BL** (Spears, Zohren & Roberts 2023): information-fusion of multiple ML view+uncertainty estimates into BL, subsuming APT. [arxiv](https://arxiv.org/pdf/2301.13594)
- Earlier foundations: Pyo & Lee (2018, low-risk anomaly), Kara et al. (2019, GARCH-SVR), Min et al. (2021), Rezaei et al. (2021, CEEMD-CNN-LSTM).

**Transformer / DRL + BL**:

- **Sun, Stefanidis, Jiang & Su (2024)** "Combining Transformer-based DRL with BL" (*Neural Computing & Applications* 36:20111–20146; arXiv:2402.16609). Their **BDA** agent learns to *apply* BL — using the transformer to capture dynamic cross-asset correlation and drive a long/short strategy on the 29 Dow Jones constituents. It reports the highest accumulated return in all four rolling back-test windows, outperforming comparison strategies "by at least 42% in terms of accumulated return." [arxiv](https://arxiv.org/abs/2402.16609)
- **Transformer-GAN in BL framework** (Zhu & Yen 2024, arXiv:2404.02029).
- **DRL-BL under elliptical distributions** (Springer 2025) and **Bayesian VAR + elliptical BL** (arXiv:2606.09104) for heavy tails and regime changes.

**LLM-enhanced BL / MV**:

- **Lee et al. (2025)**, "Integrating LLM-Generated Views into MV Optimization Using the BL Model" (ICLR 2025 workshop; arXiv:2504.14345): LLMs estimate expected returns + uncertainty → BL views; [ICLR](https://iclr.cc/virtual/2025/33834) BLM-Llama achieved the highest cumulative return (CAGR 0.6731) vs. S&P 500, equal-weight, and MVO baselines over the 2024 test window.
- **Multi-LLM sentiment aggregation → BL** (Business Perspectives 2025): LSTM-aggregated Meta-LLM sentiment as views; ~31.22% annualized return vs. 24.57% baseline. [Businessperspectives](https://businessperspectives.org/index.php/journals/investment-management-and-financial-innovations/issue-493/enhancing-portfolio-optimization-with-multi-llm-sentiment-aggregation-a-black-litterman-integration-approach)
- Caveat: "Your AI, Not Your View" (arXiv:2507.20957) documents systematic LLM bias in investment analysis.

**DL + MV / end-to-end differentiable optimization**:

- **Butler & Kwon**: Markowitz layer via implicit KKT differentiation; lower out-of-sample cost than OLS predict-then-optimize. [arxiv](https://arxiv.org/pdf/2507.01918)
- **End-to-end risk budgeting** (*Annals of Operations Research* 2023) and **distributionally robust end-to-end** (Costa & Iyengar 2022).
- **End-to-end GMV with covariance cleaning** (2025–2026): recasts GMV as a differentiable rotation-invariant denoising pipeline trained on realized out-of-sample variance; over 2000–2024 it delivered systematically lower realized volatility, smaller maximum drawdowns, and higher Sharpe ratios than state-of-the-art non-linear shrinkage.
- **BPQP** (2024): efficient differentiable QP scaling to 500-asset problems where CVXPY/JAXOpt layers cannot.

**RL + regime models & Bayesian DL**:

- **HMM + RL regime-aware allocation** (arXiv:2605.27848): three-state Gaussian HMM (selected by BIC) + RL across SPY/TLT/GLD (2004–2025); the RL policy achieves the highest Sharpe and lower drawdowns while staying interpretable via discrete regime-dependent actions.
- **DeepTrader** (Wang et al., AAAI 2021): macro market-condition embedding dynamically adjusts long/short balance with negative max-drawdown reward, [Association for the Advancement of Artificial Intelligence](https://aaai.org/papers/00643-deeptrader-a-deep-reinforcement-learning-approach-for-risk-return-balanced-portfolio-management-with-market-conditions-embedding/) using a causal-graph GCN for cross-asset dependencies; [GitHub](https://github.com/CMACH508/DeepTrader) excels in volatile periods such as the subprime crisis.
- **Residual Switching Network** (regime-switching module on a deep residual net) and **Feature-Saliency HMM** smart-beta allocation.
- Bayesian deep learning / neural-process RL for uncertainty-aware allocation.

**Practitioner approaches.** BlackRock Systematic — per WealthManagement.com, a 230-person global team running a 3–4-month horizon under co-CIO Jeff Shen — combines human insight with ML, alternative data (satellite, web-search patterns, and a proprietary model trained on 400,000+ earnings-call transcripts) and ML-based portfolio construction. It claims roughly 90% of its funds outperformed peer medians over a five-year period, and its systematic-equity AUM reportedly doubled from about $200 billion to $400 billion over roughly the two years to Q2 2026. The dominant institutional pattern is ML-for-signals feeding disciplined, risk-controlled construction rather than fully autonomous black-box allocation.

### 6. Empirical Evidence

- **Gu, Kelly & Xiu (2020, *Review of Financial Studies* 33(5))**: Trees and neural networks achieve monthly out-of-sample stock-level R² of ~0.33–0.40%, versus ~0.11% (elastic net) and ~0.26% (PCR/PLS); [NBER](https://www.nber.org/system/files/working_papers/w25398/w25398.pdf) OLS on the full 900+ predictor set overfits to negative R². A long-short decile portfolio on NN forecasts earns an annualized out-of-sample Sharpe of **1.35 value-weighted / 2.45 equal-weighted**, versus 0.61 / 0.83 for OLS. [Chicagobooth](https://dachxiu.chicagobooth.edu/download/ML_BKP.pdf) NN-based S&P 500 market timing lifts Sharpe to 0.77 vs. 0.51 buy-and-hold. [Oxford Academic](https://academic.oup.com/rfs/article/33/5/2223/5758276)
- **Zhang, Zohren & Roberts (2020, *Journal of Financial Data Science*)**: an LSTM directly maximizing Sharpe on a 4-ETF portfolio (VTI/AGG/DBC/VIX; 2011–Apr 2020) achieves annualized Sharpe of **1.858** (no vol scaling) / **1.962** (with 10% vol scaling), vs. best fixed-allocation baseline ~1.23 / ~1.58; the MV baseline reached only 0.759 / 1.120. Outperformance held through the Q1 2020 COVID crash. [arxiv](https://arxiv.org/pdf/2005.13665)[arXiv](https://arxiv.org/abs/2005.13665)
- **Sun et al. (2024)** transformer-DRL-BL: daily (risk-free = 0) Sharpe > 0.08 in all four experiments and highest accumulated return in all four (Experiment 1 AR ≈ 39.7% with Sharpe 0.139; Experiment 2 AR ≈ 27.5% with the highest Sharpe 0.087). Importantly, in Experiment 1 the ONS benchmark achieved a higher Sharpe (0.162) — the universal claim is on accumulated return, not always Sharpe.
- **Sood, Papasotiriou, Vaiciulis & Balch (2023, FinPlan/ICAPS)**: in a *fair* same-objective comparison over 10 backtests (2012–2021), DRL annual returns and Sharpe were ≈1.85× MVO's with lower maximum drawdown in virtually every year; notably MVO's drawdown was nearly double DRL's during the March 2020 downturn, [Icaps-conference](https://icaps23.icaps-conference.org/papers/finplan/FinPlan23_paper_4.pdf) and DRL's five-seed averaging aids stability. [Icaps-conference](https://icaps23.icaps-conference.org/papers/finplan/FinPlan23_paper_4.pdf)
- **DeMiguel et al. (2009)**: the 1/N benchmark beats sample MV and 13 extensions out-of-sample — the enduring cautionary baseline. Recent PPO tests echo this: one 2024–2025 out-of-sample study found PPO at 10.24% return / 0.62 Sharpe, below equal-weight (12.62% / 0.74) but far above rolling max-Sharpe MV (1.98% / 0.20).
- **Regime behavior**: HMM/regime-switching studies (e.g., SPY/TLT/GLD, 2004–2025) show equities dominate calm regimes while Treasuries/gold protect in stress; [arxiv](https://arxiv.org/pdf/2605.27848) regime-conditioned allocation improves risk-adjusted returns and cuts drawdowns.
- **Comparative DL study** (arXiv:2604.24486): with correct predictive inputs, **MVO remained competitive** [arXiv](https://arxiv.org/pdf/2604.24486) (Sharpe 1.09), narrowly beating Transformer+GNN (1.07), Autoencoder (1.05), and Autoencoder+DRL (1.04); a naive DRL baseline lagged badly (0.37) — architecture and feature extraction matter more than the "DRL" label.

### 7. Building a General-Purpose Framework

**Design principles.** (1) Separate concerns: use ML where it is strongest (forecasting returns, covariance, risk, regimes from high-dimensional/alternative data) and structured optimization where it is strongest (stable, constrained, interpretable allocation). (2) Shrink aggressively: treat ML forecasts as *noisy views* to be blended with an equilibrium prior (BL) rather than plugged directly into MV. (3) Quantify and propagate uncertainty end-to-end. (4) Make regime-awareness explicit. (5) Validate with overfitting-resistant protocols.

**Proposed architecture — three layers + governance:**

- **Layer 1 — Forecasting engine.** Ensemble of sequence models (LSTM/GRU/TCN/Transformer) with decomposition/denoising for returns; LSTM/GARCH-hybrid or DL covariance-cleaning for \(\Sigma
  \); a neural CVaR head for tail risk. Output predictive *distributions* (means + uncertainties), not point estimates. Use Bayesian DL / MC-dropout / deep ensembles for calibrated uncertainty.
- **Layer 2 — Bayesian fusion (BL core).** Convert Layer-1 forecasts into BL views: \(Q
  \) = ML expected returns, \(\Omega
  \) = ML predictive variance (higher model uncertainty → weaker view). Blend with equilibrium prior \(\Pi=\lambda\Sigma w_{mkt}
  \) via the master formula. This regularizes wild ML forecasts and preserves interpretability (views are explicit and auditable).
- **Layer 3 — Optimizer.** Differentiable MV/QP layer (OptNet/cvxpylayers/BPQP) or robust/CVaR optimizer with realistic constraints (leverage, position limits, turnover/transaction costs). Optionally train Layers 1–3 end-to-end so the loss is realized risk-adjusted return (decision-focused learning). A DRL agent can sit atop for dynamic rebalancing timing.
- **Regime handling.** An HMM or attention-based regime classifier gates model parameters, risk targets, and prior confidence; volatility scaling to a target (e.g., 10%) stabilizes risk across regimes.
- **Uncertainty quantification.** Deep ensembles/Bayesian layers feed \(\Omega
  \); distributionally robust optimization guards against forecast misspecification.
- **Interpretability.** SHAP for feature attribution, attention weights for temporal drivers, symbolic distillation of the policy into rules, and the inherently transparent BL view layer. Note that SHAP is not portfolio-invariant, a caveat for regulatory use.
- **Validation & governance.** Combinatorial Purged Cross-Validation (CPCV), deflated Sharpe ratio, and probability of backtest overfitting; strict point-in-time data to avoid look-ahead/survivorship bias; multi-seed averaging; transaction-cost and turnover stress tests.

## Recommendations

**Stage 1 — Establish honest baselines (weeks 1–4).** Implement 1/N, GMV (Ledoit-Wolf shrinkage), and vanilla BL. If a sophisticated model cannot beat 1/N and GMV on *deflated* out-of-sample Sharpe with realistic costs, do not deploy it. Threshold to proceed: deflated Sharpe materially above shrinkage-GMV after costs.

**Stage 2 — Add ML forecasting into a BL wrapper (months 2–4).** Start with the predict-then-optimize pattern: LSTM/Transformer return forecasts + DL/shrinkage covariance → BL views (\(\Omega
\) from forecast uncertainty) → constrained MV. This is the highest-ROI, lowest-risk hybrid and preserves interpretability. Benchmark against Stage 1.

**Stage 3 — Add regime-awareness and downside risk (months 4–6).** Introduce an HMM/attention regime gate, volatility targeting, and a CVaR constraint or reward. Evaluate specifically in bear/high-vol sub-samples and crises (2008, 2020, 2022).

**Stage 4 — Consider end-to-end / DRL only if justified (months 6+).** Move to differentiable optimization layers or DRL only if Stages 2–3 leave clear residual value and you have the data, compute, and validation discipline. Require multi-seed stability and CPCV/PBO evidence before any capital.

**Continuous governance.** Re-estimate regimes and retrain on a rolling basis; monitor live-vs-backtest Sharpe decay; enforce SHAP/attention reporting for every allocation decision.

**Thresholds that change the plan.** If ML out-of-sample R² is indistinguishable from zero after purged CV → drop the return-forecasting view and revert to GMV/risk-based allocation. If DRL fails multi-seed stability → keep it out of production. If drawdowns in stress sub-samples exceed tolerance → tighten the CVaR constraint and raise prior confidence (shrink harder toward equilibrium).

## Caveats

- **Performance numbers are not directly comparable across studies**: Sun et al. (2024) Sharpe ratios are daily with a zero risk-free rate (~0.08–0.16), whereas Gu-Kelly-Xiu (1.35/2.45) and Zhang-Zohren-Roberts (1.86/1.96) are annualized. Sun et al. do not report maximum drawdown.
- **Published backtests are optimistic.** Selection bias, backtest overfitting, look-ahead and survivorship bias inflate reported Sharpe ratios; [SSRN](https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2460551) deflated-Sharpe/PBO corrections routinely shrink or eliminate apparent edge. Treat single-paper outperformance claims skeptically.
- **Many hybrid results are on narrow universes / short windows** (a handful of ETFs, DJIA constituents, single markets, or crypto), limiting generalization; scalability to large universes is often unproven.
- **LLM-generated views carry model bias and hallucination risk** and depend heavily on the specific model; each LLM exhibits a distinct, persistent "investment style." [GitHub](https://github.com/KatsuyaITO/indx-autoresearch-financeaiready/issues/1768)
- **Regime and structural breaks** mean any trained model can degrade out-of-distribution; non-stationarity is the deepest unsolved problem for DL in finance.
- **Practitioner (BlackRock etc.) performance figures are self-reported** marketing/earnings disclosures, not peer-reviewed, and the underlying methods are proprietary and opaque.


Please begin the extraction now. Output only the JSON list directly, without any chitchat or explanations.