book

Machine Learning for Trading - Third Edition

Name: Machine Learning for Trading - Third Edition
Author: Stefan Jansen
ISBN: 9781803246970

by Stefan Jansen

July 2026

Intermediate

826 pages

30h 11m

English

Packt Publishing

Read now

Unlock full access

Preface
A book and a living repositoryHow each chapter maps to the repositoryThe companion ecosystem at ml4trading.ioWho this book is forWhat this book coversTo get the most out of this bookDownload the example codeGet in touchFree benefits with your book
The Process Is Your Edge
1.1 Why process discipline mattersFour shockwaves and the fragility of assumptionsA vocabulary for changeWhy process trumps modelsProcess as a research-to-production system1.2 Introducing the ML4T workflowData infrastructureResearch and evidence frameworkFeature engineering and model developmentStrategy design from signals to tradesDeployment and monitoringThe evidence boundary1.3 Causal inference and generative AI in the workflowTwo practical starting points and two deliverable typesCausal inference as a discipline-enforcing toolExpanding capability and scaling risk with generative AI1.4 Keeping up with changing market regimesRegime detection with labeling, conditioning, and monitoringStyle regimes with century-long factor dataWhat the model estimatesMacro regimes and volatility environmentsMarket validation – Volatility and drawdownsReal-time detection and risk management1.5 Independent versus institutional workflows in the real worldSolo failure modes that institutions partially avoidDecision discipline through documentation and checkpointsScoping check (implementability first)Data integrity checkSignal check (robustness before cleverness)Tradability check (fragility audit)Monitoring check (diagnosis maps to action)Constraints and asymmetric advantagesCompounding returns with reusable infrastructure1.6 Summary
The Financial Data Universe
2.1 A Modern taxonomy of financial dataMarket data – A hierarchy of aggregationFundamental data – Drivers of value with release lagsAlternative data – High variety, high validation burden2.2 The asset-class market data landscapeEquitiesWhat you observeFailure modesEngineering decisionsDatasetsExchange-traded productsWhat you observeFailure modesEngineering decisionsFuturesWhat you observeFailure modesEngineering decisionDatasetsOptionsWhat you observeFailure modesEngineering decisionDatasetsDigital assetsWhat you observeFailure modesEngineering decisionDatasetsForeign exchangeWhat you observeFailure modesConcrete exampleEngineering decisionDatasetsFixed incomeWhat you observeFailure modesEngineering decisionSwaps and OTC derivatives (rates, credit)What you observeFailure modesEngineering decisionCommoditiesWhat you observeFailure modesEngineering decisionMicrostructure tooling applicability2.3 A due diligence framework for data sourcingGeneral data quality dimensionsFinance-specific failure modesPoint-in-time correctnessSurvivorship biasCorporate actionsIdentifier integrityThe vendor ecosystemVendor due diligence checklistData qualityLegal and complianceTechnical and commercialMinimum viable data validation checklistData governance2.4 Storing dataWhat we benchmark and whyBenchmark context and caveatsFile-based storageEmbedded analytics databasesServer time-series databasesASOF join performanceStrategic decision framework2.5 Summary
Market Microstructure
3.1 How microstructure impacts price formationThe frictions faced by liquidity providersHow order types express intent in the limit order bookMarket design and intraday regimes3.2 The anatomy of modern market data feedsThe data hierarchy – From best quote to full order bookLevel 1 (L1): Top-of-book quotesLevel 2 (L2): Market-by-price depth (MBP)Level 3 (L3): Market-by-order messages (MBO)Trades and quotes – The standard data packagePrice conventions in this chapterSample datasets – From MBO to enriched barsMessage protocols – From human-readable to fast binaryData integrity challenges3.3 From raw messages to the limit order bookNASDAQ TotalView-ITCH – A case studyBinary parsing at scaleThe LOB state machineMaintaining book integritySingle-exchange data – A local viewSnapshots and analysisEmpirical findingsLOB stylized facts – Predictive patterns3.4 The art of samplingStandard aggregation methodsTime barsTick, volume, and dollar barsInformation-driven barsTrade classification – Data sources matterThe Lee-Ready algorithmEmpirical validation – Classification accuracyVolume imbalance barsTick imbalance barsRun barsCalibration – Avoiding threshold spiralStatistical properties comparisonTrade-offs and selection3.5 Detecting price jumps in intraday returnsContinuous and jump varianceThe Lee–Mykland TestWhat the data showWhy a local volatility adjustment mattersJumps as features3.6 Microstructure data quality and sessionization3.7 Summary
Fundamental and Alternative Data
4.1 The point-in-time pipelineWhy restatements create leakageBitemporal storage and as-of queriesTimestamp authority by modalityThe EDGAR sourcing pipelineXBRL and taxonomy structureHandling data inconsistency4.2 Entity resolution and mappingWhy resolution is criticalA hierarchical resolution approachStage 1: Deterministic matchingStage 2: Probabilistic matchingStage 3: Manual review and QABuilding a master security databaseTemporal entity mappingMapping quality assurance4.3 Fundamentals across the asset-class spectrumMacro and sovereign data (FX/Rates)Key sourcesAlignment challengesCommodities – Physical market dataEnergy and agricultureMapping to tradable instrumentsCryptocurrency and digital assets – On-chain fundamentalsCore on-chain metricsData sourcesAMM and DEX data4.4 Understanding alternative dataThe alternative data landscapeThe evaluation frameworkBuild versus buy for alternative dataData sources and implementation4.5 Using text data for NLP featuresTargeting MD&A and risk factorsThe engineering pipelineStep 1: Filing access and metadataStep 2: Section extractionStep 3: Cleaning and normalizationStep 4: PIT-correct storageOutput artifact4.6 Summary
Synthetic Financial Data
5.1 The quant’s dilemmaThe multiple testing challengeSynthetic data as simulation infrastructure5.2 Evaluating synthetic financial dataDoes it preserve the relevant data structure?Does it support the intended use case?Does it leak training information?Synthetic-specific failure modesPractical validation checklist5.3 Classical simulation baselinesBootstrap methodsParametric price and volatility modelsLimitations and how to use these baselines5.4 Generative model taxonomy5.5 GANs for financial time seriesUsing TimeGAN for sequential dataArchitectureTrainingData requirementsWhen to use TimeGANUsing Tail-GAN for risk-constrained generationPortfolio focusWhen to use Tail-GANUsing Sig-CWGAN for path signatures for temporal fidelityUsing GT-GAN for irregular time seriesGAN training challenges5.6 Diffusion models for financial time seriesThe denoising diffusion frameworkWhy diffusion models fit financial returnsConditional generation for regime stress testingApplying Diffusion-TS with interpretable decompositionChoosing between GANs and diffusion models5.7 LLMs for structured financial dataThe GReaT frameworkFinancial applicationsLimitations and risks5.8 Applying the Fidelity–Utility–Privacy frameworkReading the Diffusion-TS resultsPrivacy–utility trade-off with DP-GAN5.9 Summary
Strategy Research Framework
6.1 From idea to evidence with the ML4T workflowThe live trading loopThe research loopIllustrating the research framework with case studies6.2 Mapping strategies and sources of edgeStrategy families as feasibility filtersPrice-based strategiesFundamental and valuation strategiesFlow and microstructure strategiesMarket mechanics and payoff strategiesDefining edge, alpha, and capacitySources of edge as durability filtersSlow adjustment and behavioral responsesRisk compensationMarket segmentation and limits to arbitrageMechanical and institutional flowsInformation and measurement advantagesUsing the map6.3 Defining the trading setupWhat the trading setup must fixUniverse and tradability rulesDecision schedule and admissible informationCadence and horizon feasibilityScore-to-trade mappingConstraints and risk controls in scopeCost model class and componentsWhen a change requires a new setup version6.4 Setting objectives and evaluation metricsThree metric layers, each with a different role6.5 Evaluation protocol for time seriesData leakage and estimation biasFrom k-fold cross-validation to time series evaluationWalk-forward cross-validation as the baselineRetraining frequencyTemporal buffers – Label buffer and feature bufferHoldout test set and rolling retuningCombinatorial methods and path dependenceDesign commitments6.6 Establishing a baseline checkpointThree preflight sanity checksThe first reference run is narrow by design6.7 Search accounting and run loggingTrial taxonomyMinimum contents of the run log6.8 Summary
Defining the Learning Task
7.1 Data preprocessing and encodingsSplit-aware preprocessingOutliers and heavy tailsScaling and representation choicesHandling missing data7.2 Label engineeringExecution conventionsFixed-horizon labelsContinuous targetsDiscrete targetsVariable-horizon labelsAdaptive horizons via trend scanningEvent-style labelsMaximum favorable and adverse excursion diagnosticsOverlap, sample dependence, and effective sample sizeDealing with overlapLabel diagnostics before modelingMeta-labels for confidence-weighted sizing7.3 Univariate feature–label evaluationCorrectness screens – The non-negotiable first passEvaluating continuous labelsThe Information CoefficientFold-level summarization – ICIR and sign consistencyIC across horizons and rebalancing frequencyInference at triageKendall’s and mutual informationDiscrete labels – Evaluating features as classifiersThreshold-dependent evaluationThreshold-free metricsNonparametric diagnostics – Quantile and decile analysisPreliminary feasibility checks7.4 Search accounting and multiple testingDefine the searched setSeparate exploration from confirmationAdjustment methodsReport effect sizes, not only significanceStrategy-level selection-bias diagnostics7.5 From correlation to causalityWhy causal thinking matters for featuresWhat is a directed acyclic graph?Three structural rolesFrom DAG vocabulary to falsification checksMechanism plausibility checksWorked example – 12-1 momentum versus short-term reversalPlausibility scorecard7.6 Summary
Financial Feature Engineering
8.1 Capturing and configuring the economic drivers8.2 Price-derived featuresTrend and momentumReversal and mean reversion to an anchorVolatility and tail-risk stateEfficient volatility estimation from OHLC dataTail-risk and regime indicatorsMicrostructure, volume, and order flow8.3 Structural and cross-instrument featuresCarry, funding, and term structureCross-asset structure and relative valueOptions-implied features8.4 Contextual and slow-moving featuresFundamentals and characteristicsTime, calendar, and event encodingsMacro and policy state8.5 Cross-cutting feature types and the limits of direct aggregationWhen direct aggregation is not enough8.6 Combining features and controlling searchInteraction diagnosticsCommon interaction patternsWorked example – Momentum × volatility-regime tercilesEvent studiesDegrees of freedom disciplineThree implementation choices that change the hypothesis8.7 Summary
Model-Based Feature Extraction
9.1 Diagnostics and stationarity featuresStationarity tests as featuresStructural break featuresFractional differencing features9.2 Transforming signals to uncover hidden structureKalman filter featuresSpectral featuresWavelet featuresPath signature features9.3 Volatility FeaturesAutoregressive integrated moving average featuresGeneralized autoregressive conditional heteroskedasticity featuresAsymmetric volatility – Exponential GARCH featuresHeterogeneous autoregressive volatility featuresRe-estimation cadence and online updatesRough volatility and the Hurst exponent9.4 Uncertainty featuresThe uncertainty-as-feature principleStochastic volatility featuresARIMA forecast uncertainty features9.5 Regime featuresObservable regime rulesHidden Markov model featuresMarkov-switching autoregressive featuresDistribution-based regime featuresUsing regime features downstream9.6 Cross-sectional and panel featuresCross-sectional transforms of temporal featuresRelative and benchmark-adjusted featuresPairwise temporal featuresUniverse-level aggregationPoint-in-time handling in panels9.7 Summary

Text Feature Engineering
10.1 Lexical and statistical modelsLexicon-based sentimentStatistical representations using bag-of-wordsCritical limitations10.2 Static embeddingsLearning from local context with Word2VecGlobal co-occurrence statistics with GloVeAsset embeddings from portfolio dataThe polysemy problem10.3 Sequential models10.4 TransformersQuery, key, value, and the attention mechanismMulti-head attention and positional informationTransformer architecturesBidirectional transformersDomain-Specific Variants for FinanceBeyond BERT in the LLM Era10.5 The modern feature extraction workflowText-to-signal pipeline contractThe pre-train, adapt, fine-tune cascadeStage 1: General pre-trainingStage 2: Domain adaptationStage 3: Task fine-tuningFine-tuning in practiceTokenization pitfallsFrom tokens to document embeddingsEmbedding selection and long documentsHandling long documentsText signal families and factor constructionEmbedding-based factor constructionEvaluating text-derived signalsExtract-to-schema feature engineeringModel interpretability10.6 Summary
The ML Pipeline
11.1 From inference to predictionTwo modeling culturesWhat inference requiresWhy prediction demands a different approach11.2 Regularized regressionRidge regression for distributed signalLASSO regression for sparse signalCombining both priors with elastic netStandardizationHyperparameter optimization with OptunaLoss function choiceEvaluating regression modelsSample weightingTraining loss versus trading objective11.3 Predicting direction with logistic regressionBinary logistic regressionMulti-class extensionRegularizationProbability calibrationFrom probabilities to trading signalsHandling class imbalanceEvaluating classification models11.4 Interpreting models with SHAPGame-theoretic attribution with SHAPEfficient computationPractical application in global and local analysisGlobal feature importanceLocal explanationsFeature dependenceBuilding an economic narrativeLimitations and failure modesIntegration with the walk-forward pipeline11.5 Quantifying predictive uncertaintySplit-conformal predictionThe exchangeability problemAdaptive conformal inferenceConformalized quantile regressionConformal prediction sets for classificationEvaluating calibration quality11.6 Case study insightsWhere the signal isChoice of regularizationWhether the signal persistsHorizon effectsDirection versus magnitudeFrom IC to profitability11.7 Summary
Advanced Models for Tabular Data
12.1 From decision trees to ensemblesRandom forests – Reducing variance with baggingThe path to boosting12.2 Gradient boosting machinesHigh performance with boostingWhy GBMs excel on tabular dataInside the engines – XGBoost, LightGBM, and CatBoostXGBoost – Regularization and sparsityLightGBM – Speed through sampling and bundlingCatBoost – State-of-the-art categorical handlingPractical comparison – Which GBM to choose?Native feature importance and its limitationsLearning to rankWhen LTR outperforms pointwise regressionA worked example – LambdaMART versus Pointwise MSEEnforcing economic logic with monotonic constraints12.3 Deep learning alternatives for tabular dataTabular foundation modelsModern neural baselines – TabM and strong defaultsRetrieval-augmented models – TabRWhen to look beyond GBMs – A decision framework12.4 Advanced hyperparameter tuning with OptunaThe tree-structured Parzen EstimatorThe define-by-run APIGBM-specific tuning strategyMulti-objective optimizationOptimizing IC versus turnover in practice12.5 Model explainability with SHAPDependence and interaction effectsSHAP-based drift monitoringThe Rashomon Effect – When equally good models disagreeUsing SHAP for feature selection and pruningFrom explanation to uncertainty and robustness12.6 Case study insightsWhere flexibility adds ranking contentWhat the lift rests onChoosing the configurationWhether the lift persistsRegression versus classificationReading the modelFrom IC to profitability12.7 Summary
Deep Learning for Time Series
13.1 Recurrent networks and their limitsThe LSTM gating mechanismTwo limitations13.2 N-BEATS and explicit decompositionBlocks, stacks, and doubly residual learningBasis expansionMaking N-BEATS interpretableExtensions – N-BEATSx and N-HiTSPractical caveats13.3 Attention for time seriesAdapting Transformers for temporal dataThe self-attention mechanism13.4 Linear baselines versus TransformersPermutation-invariance and temporal orderThe LTSF-Linear benchmarkResults and diagnostic evidenceCounterpoints and caveats13.5 Modern Transformer variantsPatching as inductive bias with PatchTSTInverting the dimensions with iTransformerCovariate-rich forecasting with Temporal Fusion Transformers13.6 Alternative architectures and foundation modelsState space modelsTime series foundation modelsAdaptation modesThe limits of scalingThe finance transfer gap13.7 A practical frameworkStep 1: Establish strong baselinesStep 2: Diagnose the problemStep 3: Apply the selection matrixForecasting paths versus predicting horizon labelsForecasting libraries13.8 Quantifying prediction uncertaintyEstimating uncertainty with MC dropout and deep ensemblesFoundation model calibration13.9 Case study insightsWhere the sequence models add ranking contentWhich architectures carry the signalWhether the predictive uncertainty is reliableDirect prediction versus forecastingFrom IC to profitability13.10 Summary
Latent Factor Models
14.1 Making the case for latent factorsThree axes of the factor zoo debateAxis 1 – Statistical validityAxis 2 – Identification and measurementAxis 3 – Risk versus mispricingThe recurring coreFrom the zoo to latent factors14.2 Extracting latent factors with PCAThe mechanics of eigendecompositionAssumptions and design choicesCovariance or correlation?Idiosyncratic volatility normalizationCovariance estimation qualityHow many PCA factors are real?14.3 Eigenportfolios for equity strategiesConstructing and interpreting eigenportfoliosApplications in quantitative financeImproving interpretability with hierarchical PCAFixing eigenvector instabilityPractitioner recipe for two-stage production PCA14.4 Decoding the yield curveLevel, slope, and curvatureWhy PCA works for yield curvesPractical application for efficient hedging14.5 Bridging economics and statistics with advanced modelsThe three-stage latent-factor forecasting adapterDynamic betas with instrumented PCAFinding priced factors with risk-premium PCATest assets as a design choice14.6 The conditional autoencoderPreparing the characteristic panelSpecifying the dual-network architectureEstimating the CAETurning latent factors into forecastsTuning, validation, and failure modesEmpirical evidence and replication caveats14.7 The stochastic discount factor and the supervised autoencoder modelsThe stochastic discount factorBuilding the SDF with adversarial deep learningThe supervised autoencoder14.8 Case study insightsWhere latent factors add ranking contentWhich objective extracts the signalDimensionality and stabilityRegression versus classificationChoosing a method14.9 Summary
Causal Machine Learning
15.1 From theory to estimationThe causal estimation challengeThree estimation problems15.2 Identification and validationFrom outcome and intervention to estimandDirected acyclic graphs and adjustment setsAlternative identification designsInstrumental variablesDifference in differencesRegression discontinuityEvent study counterfactualsChoosing among designs15.3 Validation and refutationPlacebo and negative control testsSensitivity to omitted confoundingStability across samples, specifications, and outcomes15.4 Isolating factor effects with DMLThe intuition behind double machine learningMeasuring the causal impact of momentumOutcome choice shapes causal credibilityRegime-conditional position sizing – A case study15.5 Measuring event impact with Bayesian structural time-seriesThe intuition behind BSTSThe impact of a Fed announcement on bond ETFsIllustrative resultsPlacebo test validationPosterior probability versus credible intervals15.6 Causal discovery from observational dataTime-series discovery with Granger, PCMCI, and VAR-LiNGAMCross-sectional DAG learning with NOTEARSEmpirical method comparison15.7 Case study causal evidenceThe two gatesConfounding biasVariation across horizonsCausal evidence and predictive signal15.8 Summary
Strategy Simulation
16.1 Backtesting as falsificationFailure modes and diagnostic designPractical workflow and decision standard16.2 Specifying your backtest protocolSignal generation timingScore to signal conversionRebalancing frequency and holding periodPosition sizingOrder types and fill assumptionsConstraintsCost modelTesting sensitivity to cost assumptions16.3 Vectorized and event-driven backtestingHow vectorized backtesting worksHow event-driven backtesting worksHow to select a backtest methodologyHow simulation semantics control resultsWhere the major libraries fitA practical workflow16.4 An auditable non-ML baselineA simple baseline – Momentum with risk filterStep-by-step baseline constructionDocumenting baseline specification and performance16.5 Understanding performance metricsDesign principles for backtest reportingReturn and compounding metricsRisk and drawdown metricsRisk-adjusted performance metricsTrading and exposure metricsCost and implementation metrics16.6 Diagnosing the economic valueFrom aggregate metrics to diagnostic decompositionCost sensitivity and turnover fragilityBaseline comparison and incremental model valueRegime-sliced performanceRegime-sliced drawdowns and failure modesRegime snooping and diagnostic disciplineReporting economic diagnostics16.7 Statistical inference and backtest overfittingA backtest statistic is an estimateSharpe inference under serial dependenceFrom strategy inference to search adjustmentSelection bias and White’s reality checkDeflated Sharpe ratio and search haircutsFalse discovery control and effective search complexitySearch budget, sample length, and trial accountingReporting and decision standards16.8 Summary
Portfolio Construction
17.1 Defining the allocation problemThe decision problem – Weights, exposure, and timingConstraints as first-class modeling choicesHow signal quality becomes portfolio performance17.2 A portfolio construction workflowThe allocator term sheetEstimation windows and leakage prevention17.3 Portfolio evaluation metricsBenchmark-relative performanceConcentration and diversificationStability and implementation metricsEvaluating the risk model through the portfolio17.4 Defining baseline allocatorsEqual weight – The null modelInverse volatility weightingScore-weighted portfoliosConformal position sizingRisk parity – Equal risk contributionVolatility targetingThe Kelly criterion – Optimal sizing from signal quality17.5 Mean-variance optimization and the Markowitz curseWhy MVO fails out of sampleMaking MVO more robust with covariance shrinkageShrinkage hedging as robust optimizationFactor-mimicking portfolios17.6 Optimizing for stability with Hierarchical Risk ParityFrom correlations to weights – The HRP algorithmWhy HRP can be more stable than naive MVOLimitations and extensionsETF walk-forward results17.7 Comparing allocator performanceExperimental designEmpirical results for an ETF momentum strategyThe broader lesson17.8 Deep learning for portfolio constructionThe end-to-end pipelineTraining a portfolio objective directlyArchitecture under a portfolio objectiveVariable selection – VLSTM as the case studyDeePM – Structural priors and a regime-robust lossEvaluating learned allocators17.9 Summary
Transaction Costs
18.1 Where costs enter the ML4T workflowThe false positive problem18.2 A cost taxonomy for practitionersExplicit costsImplicit costsCapacity costsThe cost stack18.3 The microstructure regime linkIntraday liquidity patternsVolatility and spread dynamicsRegime transitionsImplications for cost modeling18.4 Baseline backtesting cost modelsA unified view of impact modelsThe spread modelThe linear slippage modelThe square-root impact modelChoosing and stress testing a baseline cost modelCosts as portfolio regularizer18.5 Execution algorithms as controlsTime-weighted average priceVolume-weighted average price (VWAP)Regime-aware participationExecution as strategy design input18.6 Optimizing execution with Almgren–Chriss as a unifying frameworkModel componentsThe optimal trajectoryRegime-dependent parametersWhat Almgren-Chriss means for research18.7 Transaction cost analysis and model validationImplementation shortfallCost decompositionRegime context in TCAClosing the loopThe hidden costs of risk-model-driven turnoverTCA report elements18.8 Designing practical cost guardrailsBreak-even turnoverMinimum required edgeAlpha-to-go – What a signal is worth after costsCapacity analysisKill switch criteriaWhen to abandon rather than modifyA practical example – Cost mitigation for optionsComparing fixed and relative cost regimes18.9 Summary
Risk Management
19.1 Turning your backtest winner into a tradable system19.2 A practical risk taxonomy for quant strategiesMarket riskFactor riskLeverage riskConcentration riskLiquidity and capacity risksModel riskOperational riskThe risk control matrix19.3 Measuring the tail – VaR and CVaRValue at riskConditional value-at-riskWhy VaR understates real riskRegime-conditional risk metricsIncorporating liquidity haircutsEvaluating risk model qualityPractical guidance19.4 Drawdowns, path risk, and time to recoveryMaximum drawdownThe historical record – 150 years of drawdownsConditional drawdown analysisLinking drawdowns to kill switches19.5 Decomposing factor, sector, and macro exposuresThe factor model frameworkIntended and unintended exposuresExposure stability across regimesSector and geographic decompositionMacro factor sensitivitiesAttribution and decomposition in practiceAttribution uncertainty and why point estimates are not enoughDetecting hidden dependencies in residualsPrecision matrix quality – The Mahalanobis-distance variance diagnosticResolving attribution ambiguity via factor rotationTrade-level SHAP as a diagnostic tool19.6 Stress testing and scenario analysisHistorical crises as regime examplesStressing cost parametersScenario matrix constructionFactor-specific stress testsReverse stress testingConnecting stress results to controls19.7 Adaptive risk controls without leakageGARCH and EWMA as operational volatility enginesVolatility targetingShort-term volatility updates for crisis responseRegime-triggered exposure capsConcentration and turnover limitsPosition-level controlsFrom rule-based controls to learned hedging policiesAnti-patterns to avoidWalk-forward validation and auditability19.8 Applying kill switches and risk governanceEscalation and review cadenceThe drawdown rule paradoxDrift detection as early warningModel risk management documentationGovernance as a competitive advantage19.9 Summary
Strategy Synthesis
20.1 First-pass results across nine case studiesEvaluation metricsHeadline outcomesCases that hold or decayCase studies that show little to no edgeFrom validation to holdout20.2 Setup and feature evaluationFeature survival and strategy survival20.3 Signal quality and prediction uncertaintyThe noisy link from model to strategy performanceStability metrics – A diagnostic bundleUncertainty around the best-performing configurationLabel choice as a first-order decision20.4 From signals to strategiesThe fundamental law, empiricallyCadence and effective breadthWin rate and payoff asymmetryFamily rankings shift across the pipelineEnsembling the top clustersWhen deep learning helpsComplementary Roles20.5 Portfolio allocation across the case studiesHow much the allocator moves the resultWhich allocator leads, and why20.6 Trading realism – Costs, capacity, and executionThe cost survival landscapeCapacity and concentration20.7 Risk overlays20.8 Causal credibility and confounding bias20.9 Next steps after the first research iteration20.10 Summary
Reinforcement Learning
21.1 The sequential decision-making paradigm in financeThe temporal credit assignment problemEnd-to-end optimizationWhy this chapter focuses on execution rather than alpha21.2 Financial markets as Markov decision processesThe MDP frameworkPartial observability in financial marketsState representationAction space designReward engineeringTransition dynamics and discount factors21.3 Core algorithms – From DQN to actor-criticThe Bellman equationDeep Q-networksActor-critic – On-policyActor-critic – Off-policyRisk-aware RLModel-based and model-free approachesPractical algorithm selection21.4 Application I – Optimal trade executionClassical benchmarking with Almgren-ChrissThe RL approach to executionHigh-fidelity simulation requirements21.5 Application II – Market makingClassical benchmark – Avellaneda-StoikovThe RL approach to market makingLearned risk management behaviors21.6 Application III – Deep hedging for derivativesOvercoming classical hedging limitationsMDP formulation for deep hedgingThe no-transaction bandImplementation with pfhedgeQ-Learner in Black-Scholes – A value-based alternative21.7 Inverse reinforcement learning – Learning from observed behaviorThe IRL frameworkBehavior cloning versus reward inferenceFinancial applicationsPractical considerations21.8 The simulation-to-reality gapSources of failureHigh-fidelity simulationOffline reinforcement learningRL-specific backtesting pitfallsDeployment checklistExplainability and regulation21.9 Summary
RAG for Financial Research
22.1 From feature extraction to generation22.2 Grounding LLMs with retrieval-augmented generationThe index-retrieve-generate pipelineThe orchestration layer22.3 Intelligent document ingestionThe failure of naïve chunkingChunk size – The fundamental trade-offStructure-aware parsingMultimodal content – Tables, charts, and imagesMetadata – The key to verifiable citations22.4 Domain-specific embeddingsThe FinMTEB benchmarkDomain-adapted embedding modelsEmbedding dimensions and quantizationEvaluating embedding models on the target corpus22.5 Hybrid retrieval and vector databasesReciprocal rank fusionBeyond bi-encoders – The retrieval architecture spectrumQuery enhancement techniquesVector database selectionFiltered retrieval22.6 Re-ranking and constraint-based promptingCross-encoder rerankingContext window managementConstraint-based promptingNumeric reliability and tool-verified computationProgrammatic output validationThe prompt as contract22.7 Diagnosing RAG pipeline bottlenecksFailure modesRAGAs and claim-level evaluationExtending the harness to adversarial inputsIterative correction loops22.8 Applications and strategic choicesThe 10-K due diligence assistantComparative case study – ESG analysisGeneration model selectionProduction lifecycleDeployment in regulated environmentsStructured data extraction – Institutional holdings22.9 Introducing agentic frameworksThe ReAct paradigmRAG as an agent toolIndustry adoption22.10 Summary
Knowledge Graphs
23.1 When relational structure justifies a graphWhen graphs add valueMulti-hop dependency queriesStructural crowding and co-ownershipTemporal relationship evolutionWhen graphs do not helpSingle-entity attribute lookupNarrative synthesis over broad corporaSparse graphs with few relationshipsPractical decision framework23.2 Constructing financial knowledge graphsFrom legacy pipelines to directed extractionGovernance before promptIdentity contractSchema contractProvenance contractA five-stage extraction workflowError taxonomy and monitoringSupply chain schema example23.3 Deterministic relational reasoning with graph RAGEnd-to-end architectureExample query flowComparing explicit KG graph RAG to community-summary GraphRAGEvaluation and failure modes23.4 From graphs to machine learning featuresNetwork topology featuresSupply chain risk featuresInstitutional crowding featuresCross-graph integration and temporal dynamics23.5 Correlations and portfolios in financial networksThe established traditionFrom minimum spanning trees to portfolio constructionGNN maturity assessmentThe pragmatic recommendation23.6 Temporal integrity and leakage-safe evaluationThe three-timestamp model8-K filings as a temporal case study13F temporal considerationsSnapshot construction and dynamic featuresLeakage-safe evaluation protocol23.7 Building a KG-ready pipelineEngine and query language selectionOntology strategyQuery safety controlsSchema versioning23.8 Summary
Autonomous Agents
24.1 From prediction functions to agentic workflowsWhere agentic workflows do not helpAutonomy levels and realistic deployment boundariesInterface with reinforcement learning24.2 Cognitive architectures – How agents reasonThe ReAct frameworkTree of thoughtsReflexionChoosing and composing reasoning patterns24.3 Agent memory – State, persistence, and replayThe memory hierarchyWhy explicit state is mandatoryCheckpointing, replay, and diagnosisMemory lifecycle and governanceMemory and evaluation are coupled24.4 Tool integration – Contracts, controls, and context engineeringTool categories for research and forecastingTool contracts and selection qualityContext engineeringProvenance and structured outputEnforcing structured outputSource policyError handling and graceful degradation24.5 The engineering stack – Frameworks and migrationStart from constraints, not preferencesFrom notebook pattern to production demoMigration sequence that reduces reworkComparing frameworks locally24.6 Designing the research agent at the heart of the pipelineArchitecture and toolsetReAct loop and rich output extractionTrace inspection and replayWalkthrough of a typical runEvaluation and acceptance criteria24.7 Multi-agent forecasting systemsArchitecture – From agent ensemble to production pipelineAggregation and extremizationThe debate-supervisor patternProbability calibrationEvaluation, ablation, and baselines24.8 The ML4T research agentThe operator’s shapeSkills are the task-specific knowledge layerTwo example runs of the ML4T research loopWhat the runs share and where the limits sitKey Takeaways24.9 Preparing for productionThe reliability gap and observabilityStatistical testing and point-in-time integrityContamination-resistant evaluationEvaluation metric stackCost, latency, and deployment fitRelease process and monitoringCollective effects and risk posture24.10 Security and governanceThreat model – Where failures originatePrompt injection and retrieval defensesLeast privilege and the warden patternHuman-in-the-loop controls and governance artifactsSecurity testing and metrics24.11 Summary
Live Trading Systems
25.1 The unified research-to-production frameworkTechnical divergenceThe unified framework solutionArchitecture for dual-mode operationFrom simulation to live25.2 Integrating with Interactive BrokersTWS versus IB GatewayConnection patternsOrder types and executionPosition and account managementError handlingHistorical data access25.3 Integrating with AlpacaREST and WebSocket APIsPaper trading modeKey differences from IBKRDirect crypto exchange APIsError handlingIdempotency keys25.4 QuantConnect and managed platformsThe platform approach versus self-hostedLEAN engine overviewTrade-offs – Convenience versus flexibility versus costWhen platforms make senseMigration considerations25.5 Order lifecycle managementState machine for order statusHandling partial fills, rejections, and cancellationsEnd-of-day reconciliationIdempotency for crash recovery25.6 Ensuring technical parity through pipeline verificationThe verification methodologyFeature parity testingPrediction consistency testingSizing logic verificationAutomated regression testsDiagnosing divergence pointsUnified data sourcesFunding rate strategy – Live deploymentParity versus regime stabilityA contrasting deployment – FX daily signals25.7 Operational readinessPreflight checklistKill switches and emergency proceduresEnforced safety in the live runtimeTransitioning from paper to live tradingRegulatory and jurisdictional considerationsUnited StatesEuropean UnionIndiaTransaction taxes and access constraintsMonitoring handoff to Chapter 2625.8 Summary
MLOps and Governance
26.1 Two sources of live trading failureTechnical failure caused by pipeline divergenceStatistical failure caused by performance decayWhy the distinction matters26.2 Performance monitoringData integrity gatesThe rolling metrics frameworkRolling Sharpe ratioInformation coefficientHit rate and win/loss ratioDrawdown depth and durationAlert thresholdsVisual dashboardsComparison to backtesting expectationsExecution quality monitoringExample monitoring workflow26.3 Drift detectionData drift caused by input distribution changesFeature drift caused by importance shiftConcept drift caused by relationship changesPractical workflowFrom detection to diagnosis26.4 Safe model updatesWhen to retrainShadow mode evaluationDeciding durationStatistical testingEffect size mattersPhased rolloutsRollback procedures26.5 Circuit breakers and safetyMulti-level protectionLoss-based breakersPosition-based breakersAnomaly-based breakersImplementation patterns and librariesRecovery proceduresManual override considerations26.6 MLOps infrastructure overviewPreventing training-serving skew with feature storesData versioning and lineageExperiment tracking with model registriesCI/CD for trading modelsRight-sizing your stack26.7 Summary
The Systematic Edge
27.1 The systematic edge – From techniques to philosophy27.2 The modern quant careerFive core rolesInstitutional ecosystemsGeographic dynamics27.3 Building a learning practiceThe foundational libraryStaying current onlineMastering the toolchainStructured learning pathwaysCommunity and brand building27.4 Navigating the frontiers – Quantum, DeFi, and ethical AIQuantum computing – Promise versus realityThe reality checkPractical implicationsDeFi – A live marketAI ethics – From philosophy to complianceStrategic prioritization27.5 Building your path forwardConduct a skills assessmentDesign a learning systemAvoid common pitfalls27.6 Summary
Other Books You May Enjoy
Index

Content preview from Machine Learning for Trading - Third Edition

12 Advanced Models for Tabular Data

Gradient Boosting Machines (GBMs) dominate tabular prediction in both academic research and production trading systems, combining predictive power with computational efficiency. While Chapter 11’s linear models assume additive feature relationships, GBMs capture the interaction effects and threshold dynamics that financial data exhibit, without manual feature engineering.

This chapter covers the three industry-standard GBM libraries (XGBoost, LightGBM, and CatBoost) and the techniques that make them production-ready. By the end of this chapter, you will be able to:

Explain how boosting differs from bagging and why sequential error correction makes GBMs effective for financial tabular prediction.
Select among ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Machine Learning for Algorithmic Trading - Second Edition

Publisher Resources

ISBN: 9781803246970

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

Machine Learning for Trading - Third Edition

by Stefan Jansen

12

Advanced Models for Tabular Data

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.