Skip to content

[FEATURE]: Add methods to persist generated data #323

@ghanse

Description

@ghanse

Is there an existing issue for this?

  • I have searched the existing issues

Problem statement

DataGenerator currently implements methods returning a Spark DataFrame. We rely on the calling code to persist generated data.

Having internal methods to persist generated data will allow us to build end-to-end data generation workflows.

Proposed Solution

Add methods to persist generated data in files or tables.

Additional Context

No response

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions