Support generation of test data from spark schema with nested structures

[adamski201]

Currently from my understanding automatic generation of test data directly from a spark schema alone is possible but only for simple (flat) structures. Maps, arrays, and structs are not supported.

Is there any plans to support generation of test data with more complex structures? Such a feature would be incredibly useful in allowing QAs to generate test data templates without any programming experience.

[ireneisdoomed]

@adamski201 Although it is not natively supported, you can define a nested structure using expressions. We do it here:
https://github.com/opentargets/gentropy/blob/4820e655fa6715dae5c6d0e9af81c86b3b4bbd10/tests/gentropy/conftest.py#L118