Skip to content

Work

Machine learning · Case study

Constrained synthetic financial data

Synthetic tabular financial data that preserves source statistics and satisfies deterministic constraints.
Organization
Fidelity Investments
Context
Data Scientist, Research & Data
Period
2023 – 2024
Methods
Conditional generative model · Post-hoc constraint enforcement · Statistical validation
Tools
Python · PyTorch

95.16%

statistical fidelity

Aggregate statistical-validation score

3×

generation throughput

40%

lower per-dataset operational cost

Note Methodology-level description only. No data, schemas or model details from Fidelity are included.

01Problem

Synthetic data is valuable when real financial records are sensitive, but it has to meet two standards at once. It must be statistically faithful, reproducing marginal distributions and relationships between columns. And it must be valid: tabular financial data carries deterministic rules between fields, and rows that violate them break downstream use.

Generative models are good at the first standard and do not guarantee the second, because they learn distributions and not rules.

02Method

  1. Conditional generation. A PyTorch conditional deep learning model learns the joint structure of the table.
  2. Constraint enforcement. A post-hoc enforcer applies the table's deterministic constraints to generated rows, so validity is guaranteed by construction instead of hoped for.
  3. Validation. Aggregate statistics of the synthetic data are validated against the source data.

03Deployment

Moved from research into production use at Fidelity, with throughput and cost measured alongside statistical fidelity.

04Results

95.16%

statistical fidelity

Aggregate statistical-validation score

3×

generation throughput

40%

reduction in per-dataset operational cost

05Limitations

  • An aggregate score summarizes many statistics. It can hide weaker fidelity in a specific column or rare segment, which is why the individual statistics matter too.
  • Post-hoc enforcement guarantees validity but can slightly shift distributions near constraint boundaries.