Machine learning · Case study
Constrained synthetic financial data
- Organization
- Fidelity Investments
- Context
- Data Scientist, Research & Data
- Period
- 2023 – 2024
- Methods
- Conditional generative model · Post-hoc constraint enforcement · Statistical validation
- Tools
- Python · PyTorch
95.16%
statistical fidelity
Aggregate statistical-validation score
3×
generation throughput
40%
lower per-dataset operational cost
Note Methodology-level description only. No data, schemas or model details from Fidelity are included.
01Problem
Synthetic data is valuable when real financial records are sensitive, but it has to meet two standards at once. It must be statistically faithful, reproducing marginal distributions and relationships between columns. And it must be valid: tabular financial data carries deterministic rules between fields, and rows that violate them break downstream use.
Generative models are good at the first standard and do not guarantee the second, because they learn distributions and not rules.
02Method
- Conditional generation. A PyTorch conditional deep learning model learns the joint structure of the table.
- Constraint enforcement. A post-hoc enforcer applies the table's deterministic constraints to generated rows, so validity is guaranteed by construction instead of hoped for.
- Validation. Aggregate statistics of the synthetic data are validated against the source data.
03Deployment
Moved from research into production use at Fidelity, with throughput and cost measured alongside statistical fidelity.
04Results
95.16%
statistical fidelity
Aggregate statistical-validation score
3×
generation throughput
40%
reduction in per-dataset operational cost
05Limitations
- An aggregate score summarizes many statistics. It can hide weaker fidelity in a specific column or rare segment, which is why the individual statistics matter too.
- Post-hoc enforcement guarantees validity but can slightly shift distributions near constraint boundaries.